Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support lower cost deployment #215

Open
pamelafox opened this issue Aug 15, 2024 · 5 comments
Open

Support lower cost deployment #215

pamelafox opened this issue Aug 15, 2024 · 5 comments
Assignees
Labels
backend Backend features or code documentation Improvements or additions to documentation infra Issues related to infrastructure

Comments

@pamelafox
Copy link
Contributor

Any chance you could support lower cost deployment, ala https://github.com/Azure-Samples/azure-search-openai-demo/blob/main/docs/deploy_lowcost.md ?
That would help hackers who want to deploy this for the upcoming RAGHack.
It'd require adding azd parameters for free skus.

@anfibiacreativa
Copy link
Member

We will work on this.

@sinedied
Copy link
Contributor

I think the most important step we can implement is to support free tier for AI Search, meaning disabling semantic search when it's enabled (if it still a limitation of free tier?).
We can also add an option to allow scaling the backend to 0 to reduce the ACA costs.

@sinedied sinedied added documentation Improvements or additions to documentation backend Backend features or code infra Issues related to infrastructure labels Aug 23, 2024
@pamelafox
Copy link
Contributor Author

Yes, the lack of semantic ranker is still a limitation. That'd be great, as AI Search can often be the most pricey in the Pricing calculator for these apps.

Copy link

This issue is stale because it has been open 60 days with no activity. Remove stale label or comment or this issue will be closed.

@github-actions github-actions bot added the Stale label Oct 23, 2024
Copy link

This issue was closed because it has been stalled for 7 days with no activity.

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Oct 30, 2024
@sinedied sinedied reopened this Oct 30, 2024
@github-actions github-actions bot removed the Stale label Oct 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backend Backend features or code documentation Improvements or additions to documentation infra Issues related to infrastructure
Projects
None yet
Development

No branches or pull requests

3 participants