Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Define data models for LLM interactions #4

Merged
merged 17 commits into from
Dec 18, 2024
Merged

Conversation

NeonDaniel
Copy link
Member

@NeonDaniel NeonDaniel commented Nov 15, 2024

Description

Add llm module
Defines LLMPersona from backend implementation
Defines LLMRequest based on HANA and BrainForge implementations
Defines MQ API for LLM interactions

Issues

Other Notes

This is compatible with the current implementation in HANA, but it will reformat requests st history follows the OpenAI format
This implements some logic in the BrainForge webapp demo, adding some validation of parameters
This includes some refactoring of module init to resolve circular import/partial-init errors

Defines LLMPersona from backend implementation
Defines LLMRequest based on HANA and BrainForge implementations
Define `llm.__all__` and add submodule-level import for consistency
Add support for arbitrary `role` values in `to_completion_kwargs`
Add `MqLlmRequest` model with test coverage
Update LLMPersona to be compatible with model in `neon-llm-core`
Refactor `MqLlmRequest` to `LLMProposeRequest` to be consistent with Chatbotsforum terminology
@NeonDaniel NeonDaniel force-pushed the FEAT_LLMRequestModels branch from 20c4853 to 7940b24 Compare November 22, 2024 23:29
@NeonDaniel NeonDaniel marked this pull request as ready for review November 23, 2024 00:36
@NeonDaniel NeonDaniel mentioned this pull request Dec 11, 2024
@NeonBohdan
Copy link

Consider adding finish_reason to LLMResponse
And looks like one test shows wrong behaviour

@NeonDaniel NeonDaniel merged commit a7c754d into dev Dec 18, 2024
6 checks passed
@NeonDaniel NeonDaniel deleted the FEAT_LLMRequestModels branch December 18, 2024 17:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants