Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: enable Azure blob storage #176

Merged
merged 8 commits into from
Nov 12, 2024
Merged

Conversation

bvs-langchain
Copy link
Contributor

No description provided.

@bvs-langchain bvs-langchain marked this pull request as ready for review November 12, 2024 21:36
@@ -272,6 +272,13 @@ Template containing common environment variables that are used by several servic
{{- if .Values.config.blobStorage.enabled }}
- name: FF_S3_STORAGE_ENABLED
value: {{ .Values.config.blobStorage.enabled | quote }}
- name: FF_BLOB_STORAGE_ENABLED
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Will the old values still work?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

old values are used for now, yeah. will start using the new ones after this is released

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

sorry i mean like for people not using helm, will the old variables still be read

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ah right, probably worth respecting the old values until 0.9?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yea though i guess that can just be a backend thing to read both

azureStorageAccountKey: ""
azureStorageContainerName: ""
azureStorageConnectionString: ""
azureStorageSASToken: ""
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we need to support all these auth modes? E.g wouldn't really ever expect someone to use SAS or connection string (that's like presignrd url right?)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think connection string is useful for the flexibility - it isn't specifically presigned URL, could use account name and key in the string. would prefer to keep that one.
probably fine to remove SAS token and add support only if needed

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

removed

Copy link
Contributor

@langchain-infra langchain-infra Nov 12, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

if we do wanna support connection string via secret could we just pass these in via connectionString always? Seems like that parameter should also allow you to specify accountKey or SAStoken?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

oops sorry meant accountKey rather than connectionString, think connectionString we should keep for sure since seems like its kind of like apiUrl?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

kind of nice to construct the URL for them with accountKey and secret imo, even if that's just for teams testing out on Azure

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ah gotcha, what happens if both are specified today? i think fine maybe just add a note that x overrides this if manually specified. i just generally have a bias towards connectionString when possible since it allows you to add url params and stuff (e.g when specifying db uris)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

account & key has higher precedence. added a comment here & updated the docs to call this out

@bvs-langchain bvs-langchain merged commit 4963b8a into main Nov 12, 2024
2 checks passed
@bvs-langchain bvs-langchain deleted the brian/ls-2204-azure-support branch November 12, 2024 22:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants