OpenAI support?

[tasercake]

Neat tool!

Just started playing around with it but I'd rather not have to spin up an ollama server every time I want to use it. I've added support for OpenAI models (specifically gpt-4o) over on tasercake/unit-text

Is this a path you'd be interested in going down with this project? Happy to open a PR - lmk!

[borgoat]

This is a great idea! I'd like it to be compatible with as many providers as possible, since we aren't really using any fancy features that would be exclusive to any API (except structured output of course...)

I'm wondering whether it'd be easier to do this with LiteLLM¹ which does support multiple providers² and structured outputs,³ too.

Ideally I'd like to support at least 3:

• Ollama, for local development (I worked on this thing on a plane!)
• OpenRouter
• OpenAI

Footnotes

1. https://docs.litellm.ai/#basic-usage ↩

2. https://docs.litellm.ai/docs/providers ↩

3. https://docs.litellm.ai/docs/completion/json_mode ↩

[tasercake]

Big fan of LiteLLM :)

Been a busy few weeks but I'll see if I can get a simple PR up soon