Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

o1 and o1 mini messages don't render #513

Open
grahamseamans opened this issue Nov 3, 2024 · 5 comments
Open

o1 and o1 mini messages don't render #513

grahamseamans opened this issue Nov 3, 2024 · 5 comments

Comments

@grahamseamans
Copy link

Screenshot 2024-11-03 at 1 42 57 PM

All other models I've tried worked fine.

They send off, and I know I have access, but maybe there's something about how they're formatted that's incompatible with the current renderer?

If someone has a fix already or if it works for them please lmk

@Niek
Copy link
Owner

Niek commented Nov 4, 2024

I still don't have o1 and o1-mini access, so I can't verify. Can you check if you see something in the devtools console? Or can you possibly send me your API key in private?

@Niek
Copy link
Owner

Niek commented Nov 4, 2024

Thanks for sending your key, @grahamseamans.

I see the o1 integration needs some work. For starters, streaming is not supported, so this has to be disabled (will probably be supported on GA release though?).
Secondly, the standard token maximum (max_completion_tokens) of 512 is way too low, even a simple question uses a lot more tokens on o1 due to the reasoning.
Finally, we should should a warning message when finish_reason is different than stop. In case of exceeding the max tokens it's length, but we do not show this anywhere and only show the empty return message, hence the confusion.

@grahamseamans
Copy link
Author

Great

-not stream
-very high token limit
makes o1 and o1 mini work for me.

@Niek
Copy link
Owner

Niek commented Nov 4, 2024

I'll keep this open for now, since I want to increase the default tokens and add a warning for the length stop reason.

@Crestina2001
Copy link

Error: Failed to fetch still happens if it takes a long time to respond(I am using o1-mini). Any clues why it happens.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants