Skip to content
This repository has been archived by the owner on Aug 20, 2024. It is now read-only.
/ Anyscale Public archive

SDK for Anyscale Endpoint that makes it easy and cheap to use LLama 2

License

Notifications You must be signed in to change notification settings

tryAGI/Anyscale

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

21 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Anyscale

Nuget package dotnet License: MIT Discord

SDK for Anyscale Endpoint that makes it easy and cheap to use LLama 2

Usage

using Anyscale;

using var httpClient = new HttpClient();
var api = new AnyscaleApi(apiKey, httpClient);
var response = await api.CreateChatCompletionAsync(new CreateChatCompletionRequest
{
    Messages = new List<ChatCompletionRequestMessage>
    {
        "You are a helpful weather assistant.".AsSystemMessage(),
        "What's the weather like today?".AsUserMessage(),
    },
    Model = ModelIds.Llama2_70B,
});
var message = result.GetFirstChoiceMessage().Content;

Support

Priority place for bugs: https://github.com/tryAGI/Anyscale/issues
Priority place for ideas and general questions: https://github.com/tryAGI/Anyscale/discussions
Discord: https://discord.gg/Ca2xhfBf3v