Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for Solar AI models #1712

Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open

Conversation

jee14
Copy link
Contributor

@jee14 jee14 commented Nov 10, 2024

Hello,

I have added a Solar model client. Solar is an LLM and embedding model from Upstage, a company based in South Korea, and is especially optimized for Korean and Japanese embeddings.

Links

If needed, I can provide my API key for your use.

@markpollack
Copy link
Member

Hi. Is this model have openai API compatability? That would be a preferred direction to ease with maintenance.

@jsilverman26
Copy link
Contributor

jsilverman26 commented Nov 13, 2024

@jee14 @markpollack Hi, Solar model has OpenAI API compatibility.
check this.
Upstage API Documentation

from openai import OpenAI # openai==1.52.2
 
client = OpenAI(
    api_key="UPSTAGE_API_KEY",
    base_url="https://api.upstage.ai/v1/solar"
)

@jee14
Copy link
Contributor Author

jee14 commented Nov 14, 2024

Hi. Is this model have openai API compatability? That would be a preferred direction to ease with maintenance.

Yes. Please refer to @jsilverman26 comment.
There are a lot of features that need to be added to this PR (e.g. streaming), but I think more people can participate in the contribution to this model if it merges.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants