Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bug: calling o1 or o3 causes NeMo to use deprecated chat completion API #992

Open
3 of 4 tasks
Headless-Sourceman opened this issue Feb 10, 2025 · 0 comments
Open
3 of 4 tasks
Assignees
Labels
bug Something isn't working

Comments

@Headless-Sourceman
Copy link

Did you check docs and existing issues?

  • I have read all the NeMo-Guardrails docs
  • I have updated the package to the latest version before submitting this issue
  • (optional) I have used the develop branch
  • I have searched the existing issues of NeMo-Guardrails

Python version (python --version)

Python 3.10.11

Operating system/version

Microsoft Windows 11 Enterprise

NeMo-Guardrails version (if you must use a specific version and not the latest

0.11.1

Describe the bug

Trying to use Azure OpenAI o3-mini (or any o1 model) causes a bad request error.

Steps To Reproduce

  1. Put this model into config.yml
type: main
    engine: azure
    model: o3-mini
    api_version: 2024-12-01-preview
    ...
  1. Start a chat with
    nemoguardrails chat --config your/path --verbose --debug-level=DEBUG

  2. Ask anything that uses the main model.

Expected Behavior

Receive a chat completion without error.

Actual Behavior

HTTPStatusError: Client error '400 Bad Request' for url
                             'https://...openai.azure.com/openai/.../o3-mini/completions?api-version=...'

Stack trace ends with
nemoguardrails.actions.llm.utils.LLMCallException: LLM Call Exception: Error code: 400 - {'error': {'code': 'OperationNotSupported', 'message': 'The completion operation does not work with the specified model, o3-mini. Please choose different model and try again. You can learn more about which models can be used with each operation here: https://go.microsoft.com/fwlink/?linkid=2197993.'}}

@Headless-Sourceman Headless-Sourceman added bug Something isn't working status: needs triage New issues that have not yet been reviewed or categorized. labels Feb 10, 2025
@Pouyanpi Pouyanpi removed the status: needs triage New issues that have not yet been reviewed or categorized. label Feb 11, 2025
@Pouyanpi Pouyanpi self-assigned this Feb 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants