Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for AWS bedrock models and embeddings #201

Open
Hearsch-Jariwala opened this issue Sep 4, 2024 · 3 comments
Open

Support for AWS bedrock models and embeddings #201

Hearsch-Jariwala opened this issue Sep 4, 2024 · 3 comments

Comments

@Hearsch-Jariwala
Copy link

Is your feature request related to a problem? Please describe.
AdalFlow currently does not support AWS Bedrock models and embeddings. This limits the ability to leverage state-of-the-art AI models and capabilities provided by AWS in AdalFlow workflows.

Describe the solution you'd like

Implement support for AWS Bedrock models and embeddings in AdalFlow:

  • Allow specifying Bedrock models as a model type in AdalFlow configuration
  • Enable passing Bedrock model names/IDs to use pre-trained models
  • Support providing Bedrock embeddings as inputs to AdalFlow components
  • Integrate with AWS Bedrock APIs to run inference and access model outputs
  • Document/Tutorials on how to configure and use Bedrock models/embeddings in AdalFlow

Describe alternatives you've considered
Using other model types like HuggingFace in AdalFlow instead of Bedrock. But this foregoes the advanced capabilities of the Bedrock platform such as content moderation configurations, etc.

Additional context
Supporting AWS Bedrock will allow AdalFlow users to take advantage of powerful AI models and embeddings to enhance their workflows. This will make AdalFlow more versatile and compelling for a wider range of use cases and users.

@khalilfiremind
Copy link
Contributor

did a PR for it #213

@Hearsch-Jariwala
Copy link
Author

did a PR for it #213

Were you able to also add in AWS embedding models support and streaming responses?

@khalilfiremind
Copy link
Contributor

@Hearsch-Jariwala currently no, only LLM, I am waiting for the review, then I will add the embedding and streaming.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants