Code

sync master#27

Code

Merged

tc-mb merged 28 commits intominicpmv-main-devOpenBMB/llama.cpp:minicpmv-main-devfrom masterOpenBMB/llama.cpp:masterCopy head branch name to clipboardAug 15, 2024

+2,954-1,339

Commits

Commits on Aug 10, 2024

• Add support for encoder-only T5 models (ggerganov#8900)

  Show description for 7c3f55c
  

  fairydreaming

  and

  sszymczy

  authored
  7c3f55c

  Copy full SHA for 7c3f55c

• llama : default n_swa for phi-3 (ggerganov#8931)

  Show description for 7eb2384
  ngxson

  authored
  7eb2384

  Copy full SHA for 7eb2384

• metal : fix uninitialized abort_callback (ggerganov#8968)

  slaren

  authored
  6e02327

  Copy full SHA for 6e02327

Commits on Aug 11, 2024

• Optimize Vulkan backend for better CPU performance and less GPU synchronization overhead. (ggerganov#8943)

  Show description for 7c5bfd5
  

  mtavenrath

  and

  0cc4m

  authored
  7c5bfd5

  Copy full SHA for 7c5bfd5

• llama : check all graph nodes when searching for result_embd_pooled (ggerganov#8956)

  Show description for 33309f6
  

  fairydreaming

  and

  sszymczy

  authored
  33309f6

  Copy full SHA for 33309f6

• update guide (ggerganov#8909)

  Show description for a21c6fd
  arthw

  authored
  a21c6fd

  Copy full SHA for a21c6fd

• flake.lock: Update (ggerganov#8979)

  ggerganov

  authored
  8cd1bcf

  Copy full SHA for 8cd1bcf

• gguf-py : Numpy dequantization for most types (ggerganov#8939)

  Show description for 4134999
  compilade

  authored
  4134999

  Copy full SHA for 4134999

Commits on Aug 12, 2024

• server : handle models with missing EOS token (ggerganov#8997)

  Show description for 5ef07e2
  ggerganov

  authored
  5ef07e2

  Copy full SHA for 5ef07e2

• py : fix requirements check '==' -> '~=' (ggerganov#8982)

  Show description for d3ae0ee
  ggerganov

  authored
  d3ae0ee

  Copy full SHA for d3ae0ee

• Fix a spelling mistake (ggerganov#9001)

  Septa2112

  authored
  2589292

  Copy full SHA for 2589292

• ggml: fix div-by-zero (ggerganov#9003)

  Show description for df5478f
  DavidKorczynski

  authored
  df5478f

  Copy full SHA for df5478f

• grammar-parser : fix possible null-deref (ggerganov#9004)

  Show description for 1262e7e
  DavidKorczynski

  authored
  1262e7e

  Copy full SHA for 1262e7e

• docs: introduce gpustack and gguf-parser (ggerganov#8873)

  Show description for 84eb2f4
  thxCode

  authored
  84eb2f4

  Copy full SHA for 84eb2f4

• llama : model-based max number of graph nodes calculation (ggerganov#8970)

  Show description for 0fd93cd
  

  nicoboss

  and

  slaren

  authored
  0fd93cd

  Copy full SHA for 0fd93cd

• ci : enable RPC in all of the released builds (ggerganov#9006)

  Show description for 1f67436
  rgerganov

  authored
  1f67436

  Copy full SHA for 1f67436

• ci : fix github workflow vulnerable to script injection (ggerganov#9008)

  Show description for fc4ca27
  diogoteles08

  authored
  fc4ca27

  Copy full SHA for fc4ca27

Commits on Aug 13, 2024

• export-lora : throw error if lora is quantized (ggerganov#9002)

  ngxson

  authored
  828d6ff

  Copy full SHA for 828d6ff

• ggml : move rope type enum to ggml.h (ggerganov#8949)

  Show description for 06943a6
  

  danbev

  and

  slaren

  authored
  06943a6

  Copy full SHA for 06943a6

Commits on Aug 14, 2024

• cmake : remove unused option GGML_CURL (ggerganov#9011)

  ggerganov

  authored
  43bdd3c

  Copy full SHA for 43bdd3c

• server : fix segfault on long system prompt (ggerganov#8987)

  Show description for 98a532d
  compilade

  authored
  98a532d

  Copy full SHA for 98a532d

• Vulkan Optimizations and Fixes (ggerganov#8959)

  Show description for 5fd89a7
  0cc4m

  authored
  5fd89a7

  Copy full SHA for 5fd89a7

Commits on Aug 15, 2024

• server : init stop and error fields of the result struct (ggerganov#9026)

  Show description for 234b306
  jpodivin

  authored
  234b306

  Copy full SHA for 234b306

• ci : disable bench workflow (ggerganov#9010)

  ggerganov

  authored
  d5492f0

  Copy full SHA for d5492f0

• llama : add pre-tokenizer regexes for BLOOM and gpt3-finnish (ggerganov#8850)

  Exploder98

  authored
  6bda7ce

  Copy full SHA for 6bda7ce

• common : remove duplicate function llama_should_add_bos_token (ggerganov#8778)

  kylo5aby

  authored
  4af8420

  Copy full SHA for 4af8420

• server : fix duplicated n_predict key in the generation_settings (ggerganov#8994)

  snowyu

  authored
  37501d9

  Copy full SHA for 37501d9

• retrieval : fix memory leak in retrieval query handling (ggerganov#8955)

  Show description for 4b9afbb
  gtygo

  authored
  4b9afbb

  Copy full SHA for 4b9afbb