Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use API calls to send query and receive response instead of from end #2297

Open
rpaGuyai opened this issue Jan 23, 2025 · 2 comments
Open

Use API calls to send query and receive response instead of from end #2297

rpaGuyai opened this issue Jan 23, 2025 · 2 comments

Comments

@rpaGuyai
Copy link

I have already successfully provisioned this app within my company's corporate Azure Tenant and documents which serves as RAG, source are some policy documents.

Query - Now I have another chatBot - not hosted on Azure, actually it's openWebUi hosted on our AWS server, is there a way I can make API calls to Azure OpenAI/ Azure Search which would query the policy documents and return response.

Any suggestion would be very helpful.

Thanks

@pamelafox
Copy link
Collaborator

Are you asking how to call your RAG app from AWS? If so, you can set up CORS:
https://github.com/Azure-Samples/azure-search-openai-demo/blob/main/docs/deploy_features.md#enabling-cors-for-an-alternate-frontend
And then you can make calls to /chat or /chat/stream
The HTTP protocol is described here:
https://github.com/microsoft/ai-chat-protocol/tree/main/spec#microsoft-ai-chat-protocol-api-specification-version-2024-05-29

@rpaGuyai
Copy link
Author

rpaGuyai commented Feb 6, 2025

Thanks @pamelafox , apologies for not making it clear, I just wanted to understand if there is a way to connect/query Azure AI Search Service via API and fetch the information.

I have successfully hosted the chatbot provided in this repository in my Azure tenant and the repository has documents related to some policies, all works well, I wanted to understand, if I can fetch the information stored in Azure AI search through AP as well by some means?
This is to implement an agentic approach, where user won't be using the chat interface, instead based on user's input a flow will trigger which will fetch the information from Search Service via API and deliver the response.

May be my approach is incorrect, and you can guide me on this as well.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants