Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LLaMA cpp python server: IPV6 support #1427

Open
wants to merge 19 commits into
base: main
Choose a base branch
from

Conversation

Smartappli
Copy link
Contributor

Replace uvicorn by hypercorn to support ipv6

@abetlen
Copy link
Owner

abetlen commented May 4, 2024

Hey @Smartappli let me consider this, technically you should be able to do by just launching the app directly from the cli via hypercorn correct?

@Smartappli
Copy link
Contributor Author

Smartappli commented May 4, 2024

@Smartappli
Copy link
Contributor Author

@gaby review plz

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants