Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Llm empty response fix #423

Open
wants to merge 15 commits into
base: main
Choose a base branch
from
+6 −0
Open

Llm empty response fix #423

Changes from all commits
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
b1071f0
Changes to allow Vector to have a continuous conversation
hiamitabha Sep 2, 2024
4594324
Merge branch 'main' of https://github.com/hiamitabha/wire-pod into co…
hiamitabha Sep 15, 2024
186737c
Some more refinements in order to make Vector do Q&A successfully
hiamitabha Sep 15, 2024
80a55fb
Increasing the MaxTokens in the query
hiamitabha Sep 16, 2024
de32e1c
Merge pull request #4 from hiamitabha/conversation
hiamitabha Sep 16, 2024
540d6aa
Merge branch 'main' of https://github.com/hiamitabha/wire-pod
hiamitabha Dec 28, 2024
25ac03f
Fixing wirepod crashing when LLM returns an empty response.
hiamitabha Jan 16, 2025
1928b09
Undoing unwanted change in prompt
hiamitabha Jan 16, 2025
8f0292c
Merge branch 'kercre123:main' into llm-empty-response-fix
hiamitabha Jan 16, 2025
a99c390
Merge branch 'main' of https://github.com/hiamitabha/wire-pod into ll…
hiamitabha Jan 16, 2025
02310a6
Merge branch 'llm-empty-response-fix' of https://github.com/hiamitabh…
hiamitabha Jan 16, 2025
e38f5d3
Restoring original version of kgsim_cmds from main. Changes committed…
hiamitabha Jan 16, 2025
9372553
More restores
hiamitabha Jan 16, 2025
5be240c
Fixing allignment
hiamitabha Jan 16, 2025
760f8c5
More allignment issues
hiamitabha Jan 16, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions chipper/pkg/wirepod/ttr/kgsim.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -261,6 +261,7 @@ func StreamingKGSim(req interface{}, esn string, transcribedText string, isKG bo

stream, err := c.CreateChatCompletionStream(ctx, aireq)
if err != nil {
log.Printf("Error creating chat completion stream: %v", err)
if strings.Contains(err.Error(), "does not exist") && vars.APIConfig.Knowledge.Provider == "openai" {
logger.Println("GPT-4 model cannot be accessed with this API key. You likely need to add more than $5 dollars of funds to your OpenAI account.")
logger.LogUI("GPT-4 model cannot be accessed with this API key. You likely need to add more than $5 dollars of funds to your OpenAI account.")
Expand Down Expand Up @@ -344,6 +345,11 @@ func StreamingKGSim(req interface{}, esn string, transcribedText string, isKG bo
return
}

if (len(response.Choices) == 0) {
logger.Println("Empty response")
return
}

fullfullRespText = fullfullRespText + removeSpecialCharacters(response.Choices[0].Delta.Content)
fullRespText = fullRespText + removeSpecialCharacters(response.Choices[0].Delta.Content)
if strings.Contains(fullRespText, "...") || strings.Contains(fullRespText, ".'") || strings.Contains(fullRespText, ".\"") || strings.Contains(fullRespText, ".") || strings.Contains(fullRespText, "?") || strings.Contains(fullRespText, "!") {
Expand Down
Loading