Code

feat: merge develop#123

Code

Merged

taprosoft merged 88 commits intomainCinnamon/kotaemon:mainfrom developCinnamon/kotaemon:developCopy head branch name to clipboardAug 26, 2024

+14,727-1,042

Commits

Commits on May 26, 2024

• Support hybrid vector retrieval

  trducng

  committed
  32329fa

  Copy full SHA for 32329fa

• Enable figures and table reading in Azure DI

  trducng

  committed
  3e2f98c

  Copy full SHA for 3e2f98c

• Retrieve with multi-modal

  trducng

  committed
  d876ed2

  Copy full SHA for d876ed2

• Fix mixing up table

  trducng

  committed
  b9ceb00

  Copy full SHA for b9ceb00

• Add txt loader

  trducng

  committed
  63879f2

  Copy full SHA for 63879f2

• Add Anthropic Chat

  trducng

  committed
  322a94b

  Copy full SHA for 322a94b

• Raising error when retrieving help file

  trducng

  committed
  c55572c

  Copy full SHA for c55572c

• Allow same filename for different people if private is True

  trducng

  committed
  5b2773c

  Copy full SHA for 5b2773c

• Allow declaring extra LLM vendors

  trducng

  committed
  3e80168

  Copy full SHA for 3e80168

• Show chunks on the File page

  trducng

  committed
  7d3354f

  Copy full SHA for 7d3354f

Commits on May 28, 2024

• Allow elasticsearch to get more docs

  trducng

  committed
  620b81d

  Copy full SHA for 620b81d

Commits on May 31, 2024

• Fix Cohere response (#86)

  Show description for ad61c71
  

  doviettung96

  and

  trducng

  authored
  ad61c71

  Copy full SHA for ad61c71

Commits on Jun 3, 2024

• Add confidence score (#87)

  Show description for 0708fb5
  doviettung96

  authored
  0708fb5

  Copy full SHA for 0708fb5

Commits on Jun 6, 2024

• Upgrade the confidence score appearance (#90)

  Show description for 684f1c5
  doviettung96

  authored
  684f1c5

  Copy full SHA for 684f1c5

Commits on Jun 7, 2024

• Remove columns and rows in Excel loader which contains all NaN (#91)

  Show description for ce1f9d6
  

  3 peopleauthored
  ce1f9d6

  Copy full SHA for ce1f9d6

• Track retriever state

  trducng

  committed
  3b8ce6a

  Copy full SHA for 3b8ce6a

Commits on Jun 8, 2024

• Bump llama-index version 0.10

  trducng

  committed
  f279447

  Copy full SHA for f279447

Commits on Jun 12, 2024

• feat/save-azuredi-mhtml-to-markdown (#93)

  Show description for baabcbc
  

  jacky0218

  and

  jacky0218

  authored
  baabcbc

  Copy full SHA for baabcbc

• fix: losing first chunk (#94)

  Show description for e5e85ea
  

  jacky0218

  and

  jacky0218

  authored
  e5e85ea

  Copy full SHA for e5e85ea

Commits on Jun 13, 2024

• fix: adding the base64 image in markdown (#95)

  jacky0218

  authored
  fd1e5ac

  Copy full SHA for fd1e5ac

• feat: more chunk info on UI

  trducng

  committed
  7dd26f5

  Copy full SHA for 7dd26f5

• fix: error when reindexing files

  trducng

  committed
  bf61f1b

  Copy full SHA for bf61f1b

Commits on Jun 16, 2024

• refactor: allow more information exception trace when using gpt4v

  trducng

  committed
  7618738

  Copy full SHA for 7618738

• feat: add excel reader that treats each worksheet as a document

  trducng

  committed
  8ac48f6

  Copy full SHA for 8ac48f6

Commits on Jun 18, 2024

• Persist loader information when indexing file

  trducng

  committed
  91ebdca

  Copy full SHA for 91ebdca

• feat: allow hiding unneeded setting panels

  trducng

  committed
  868a0d8

  Copy full SHA for 868a0d8

• feat: allow specific timezone when creating conversation

  trducng

  committed
  c541507

  Copy full SHA for c541507

• feat: add more confidence score (#96)

  Show description for 428bbe2
  doviettung96

  authored
  428bbe2

  Copy full SHA for 428bbe2

• feat: replace text length with token in file list

  trducng

  committed
  1e26358

  Copy full SHA for 1e26358

• ui: show index name instead of id in the settings

  trducng

  committed
  8cd8758

  Copy full SHA for 8cd8758

• feat(ai): restrict the vision temperature

  trducng

  committed
  11bc6d6

  Copy full SHA for 11bc6d6

• fix(ui): remove the misleading message about non-retrieved evidences

  trducng

  committed
  aea24de

  Copy full SHA for aea24de

• feat(ui): show the reasoning name and description in the reasoning setting page

  trducng

  committed
  aa18272

  Copy full SHA for aa18272

• feat(ui): show version on the main windows

  trducng

  committed
  55ac272

  Copy full SHA for 55ac272

• feat(ui): show default llm name in the setting page

  trducng

  committed
  3f5fd6f

  Copy full SHA for 3f5fd6f

Commits on Jun 21, 2024

• fix(conf): append the result of doc in llm_scoring (#97)

  doviettung96

  authored
  ad26dff

  Copy full SHA for ad26dff

Commits on Jun 22, 2024

• fix: constraint maximum number of images

  trducng

  committed
  54a4e9c

  Copy full SHA for 54a4e9c

• feat(ui): allow filter file by name in file list page

  trducng

  committed
  ff0f852

  Copy full SHA for ff0f852

Commits on Jul 3, 2024

• Fix exceeding token length error for OpenAI embeddings by chunking then averaging (#99)

  Show description for ceebbb2
  trducng

  authored
  ceebbb2

  Copy full SHA for ceebbb2

Commits on Jul 4, 2024

• fix: Allow empty string when calling embedding

  trducng

  committed
  d04dc2f

  Copy full SHA for d04dc2f

Commits on Jul 7, 2024

• fix: update trulens LLM ranking score for retrieval confidence, improve citation (#98)

  Show description for 9e2fe4a
  

  doviettung96

  and

  taprosoft

  authored
  9e2fe4a

  Copy full SHA for 9e2fe4a

Commits on Jul 8, 2024

• feat: add question decomposition & few-shot rewrite pipeline (#89)

  Show description for fd54bbd
  

  doviettung96

  and

  taprosoft

  authored
  fd54bbd

  Copy full SHA for fd54bbd

• fix: add encoding utf-8 when save temporal markdown in vectorIndex (#101)

  phv2312

  authored
  fccb8f6

  Copy full SHA for fccb8f6

• fix: improve retrieval pipeline and relevant score display (#102)

  Show description for b4cee6f
  taprosoft

  authored
  b4cee6f

  Copy full SHA for b4cee6f

• feat: improve UI default settings and add quick switch option for pipeline

  taprosoft

  committed
  16a7e4f

  Copy full SHA for 16a7e4f

• fix: improve agent logics (#103)

  Show description for f0a7576
  taprosoft

  authored
  f0a7576

  Copy full SHA for f0a7576

• fix: less verbose debug log

  taprosoft

  committed
  813f871

  Copy full SHA for 813f871

• feat: add warning message for low confidence

  taprosoft

  committed
  87f14a3

  Copy full SHA for 87f14a3

• fix: LLM scoring enabled by default

  taprosoft

  committed
  e98b797

  Copy full SHA for e98b797

Commits on Jul 9, 2024

• fix: minor update logics

  trducng

  committed
  af2a542

  Copy full SHA for af2a542

• fix: hotfix image citation

  trducng

  committed
  775476c

  Copy full SHA for 775476c

Commits on Jul 10, 2024

• feat: update docx loader for handle merged table cells + handle zip file upload (#104)

  Show description for 7e25728
  phv2312

  authored
  7e25728

  Copy full SHA for 7e25728

• fix: escape text in download UI

  taprosoft

  committed
  7a1bdeb

  Copy full SHA for 7a1bdeb

Commits on Jul 12, 2024

• feat: optimize vector store query db (#105)

  Show description for 88d02c3
  

  phv2312

  and

  taprosoft

  authored
  88d02c3

  Copy full SHA for 88d02c3

Commits on Jul 16, 2024

• fix: add openai embedidng exponential back-off

  trducng

  committed
  9e215c4

  Copy full SHA for 9e215c4

Commits on Jul 17, 2024

• fix: update import download_loader

  phv2312

  committed
  774e359

  Copy full SHA for 774e359

• refactor: codespell

  phv2312

  committed
  79b8511

  Copy full SHA for 79b8511

• Merge pull request #107 from Cinnamon/fix/kh_unitest

  Show description for df1f738
  phv2312

  authored
  df1f738

  Copy full SHA for df1f738

• fix: update some default settings

  taprosoft

  committed
  4c277d8

  Copy full SHA for 4c277d8

• fix: update installation instruction

  taprosoft

  committed
  1223e38

  Copy full SHA for 1223e38

Commits on Jul 24, 2024

• fix: default chunk length in simple QA

  taprosoft

  committed
  527b98b

  Copy full SHA for 527b98b

Commits on Jul 29, 2024

• feat: add share converstation feature and enable retrieval history (#108)

  Show description for f23a510
  

  phv2312

  and

  taprosoft

  authored
  f23a510

  Copy full SHA for f23a510

• fix: allow exponential backoff for failed OCR call (#109)

  trducng

  authored
  f20371e

  Copy full SHA for f20371e

Commits on Jul 30, 2024

• fix: update default prompt when no retrieval is used

  taprosoft

  committed
  d8fc296

  Copy full SHA for d8fc296

• fix: create embedding for long image chunks

  trducng

  committed
  91fc5eb

  Copy full SHA for 91fc5eb

Commits on Jul 31, 2024

• fix: add exception handling for additional table retriever

  trducng

  committed
  9b1a0c0

  Copy full SHA for 9b1a0c0

• fix: clean conversation & file selection UI

  taprosoft

  committed
  214a268

  Copy full SHA for 214a268

Commits on Aug 5, 2024

• fix: elastic search with empty doc_ids

  trducng

  committed
  61ed484

  Copy full SHA for 61ed484

• feat: add thumbnail PDF reader for quick multimodal QA

  trducng

  committed
  591eb2a

  Copy full SHA for 591eb2a

• feat: add thumbnail handling logic in indexing

  trducng

  committed
  6d354b8

  Copy full SHA for 6d354b8

Commits on Aug 6, 2024

• fix: UI text update

  trducng

  committed
  5a00fc1

  Copy full SHA for 5a00fc1

• fix: PDF thumb loader page number logic

  trducng

  committed
  c414db1

  Copy full SHA for c414db1

• feat: add quick indexing pipeline and update UI

  trducng

  committed
  ab305b5

  Copy full SHA for ab305b5

• feat: add conv name suggestion

  trducng

  committed
  0303e1e

  Copy full SHA for 0303e1e

• fix: minor UI change

  trducng

  committed
  389c973

  Copy full SHA for 389c973

• feat: citation in thread

  trducng

  committed
  f36def8

  Copy full SHA for f36def8

Commits on Aug 8, 2024

• fix: add conv name suggestion in regen

  trducng

  committed
  c610171

  Copy full SHA for c610171

• chore: add assets for usage doc

  trducng

  committed
  22c7987

  Copy full SHA for 22c7987

• chore: update usage doc

  trducng

  committed
  5f8bd84

  Copy full SHA for 5f8bd84

Commits on Aug 18, 2024

• feat: pdf viewer (#110)

  Show description for 8ecac2c
  

  3 peopleauthored
  8ecac2c

  Copy full SHA for 8ecac2c

• feat: graph rag (#116)

  Show description for 3ae0fce
  taprosoft

  authored
  3ae0fce

  Copy full SHA for 3ae0fce

• feat: add knowledge network index (#118)

  Show description for e50da52
  

  taprosoft

  and

  jeff52415

  authored
  e50da52

  Copy full SHA for e50da52

• fix: update info panel return for graphrag

  taprosoft

  committed
  23fa4fb

  Copy full SHA for 23fa4fb

• fix: retriever setting graphrag

  trducng

  committed
  6ac627c

  Copy full SHA for 6ac627c

Commits on Aug 26, 2024

• feat: local llm settings (#122)

  Show description for 33ee7dd
  

  taprosoft

  and

  trducng

  authored
  33ee7dd

  Copy full SHA for 33ee7dd

• chore: update README

  taprosoft

  committed
  7cd8280

  Copy full SHA for 7cd8280

• chore: update README

  taprosoft

  committed
  1efa5df

  Copy full SHA for 1efa5df

• Merge branch 'main' into develop

  taprosoft

  committed
  38d8e6b

  Copy full SHA for 38d8e6b