Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

After LLMPipeline calls start_chat twice, generate will report an error #1445

Open
qihui-liu opened this issue Dec 27, 2024 · 1 comment
Open

After LLMPipeline calls start_chat twice, generate will report an error #1445

qihui-liu opened this issue Dec 27, 2024 · 1 comment
Assignees
@sbalandi
Labels
bug Something isn't working category: LLM LLM pipeline (stateful, static) support_request Support team

Comments

@qihui-liu
Copy link

qihui-liu commented Dec 27, 2024 •
edited
Loading

After LLMPipeline calls start_chat twice, generate will report an error

After calling 'generate' once, calling 'start_chat' again will trigger 'reset_kv_state'.
Afterwards, using 'generate' will result in an error message saying 'External component has thrown down an exception.'

The above situation will not occur in "2024.5.0.0" in "Tags"

The above situation will occur in "Release/2024/5" and above versions
@YuChern-Intel
Copy link

Could you provide us the reproducible script/example for LLMPipeline to call start_chat twice?

@avitial avitial added the support_request Support team label Dec 30, 2024
@ilya-lavrenov ilya-lavrenov added the category: LLM LLM pipeline (stateful, static) label Jan 4, 2025
@ilya-lavrenov ilya-lavrenov added the bug Something isn't working label Jan 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@sbalandi sbalandi

Labels
bug Something isn't working category: LLM LLM pipeline (stateful, static) support_request Support team
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
6 participants
@ilya-lavrenov @avitial @qihui-liu @sbalandi @Munesh-Intel @YuChern-Intel