Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Performance test for LLM Functions #526

Open
hahwul opened this issue Feb 3, 2025 · 1 comment
Open

Performance test for LLM Functions #526

hahwul opened this issue Feb 3, 2025 · 1 comment
Assignees
@hahwul
Labels
💊 spec Issue for test codes
Milestone
v0.20.0

Comments

@hahwul
Copy link
Member

hahwul commented Feb 3, 2025 •
edited
Loading

I had a verbal conversation with @ksg97031. For the optimization of prompts and other parameters, the LLM function also necessitates a separate test.

Requirements:

  • Modify the analysis prompt and test (since it needs to process each value separately)
  • Time and other relevant measurements need to be taken.
@hahwul hahwul added the 💊 spec Issue for test codes label Feb 3, 2025
@hahwul
Copy link
Member Author

hahwul commented Feb 10, 2025 •
edited
Loading

  • ENV: NOIR_ENABLE_LLM_SPEC
  • REQUIREMENTS: Check duration time and Output quality

@hahwul hahwul self-assigned this Feb 10, 2025
@hahwul hahwul added this to the v0.20.0 milestone Feb 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@hahwul hahwul

Labels
💊 spec Issue for test codes
Projects
None yet
Milestone
v0.20.0
Development

No branches or pull requests
1 participant
@hahwul