Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Function to import parquet file from Azure datalake into R dataframe #3

Open
craig-shenton opened this issue Sep 6, 2022 · 0 comments
Labels

Comments

@craig-shenton
Copy link
Contributor

Example in python from NHSX data engineering:

# Helper functions
# -------------------------------------------------------------------------
def datalake_download(CONNECTION_STRING, file_system, source_path, source_file):
    service_client = DataLakeServiceClient.from_connection_string(CONNECTION_STRING)
    file_system_client = service_client.get_file_system_client(file_system=file_system)
    directory_client = file_system_client.get_directory_client(source_path)
    file_client = directory_client.get_file_client(source_file)
    download = file_client.download_file()
    downloaded_bytes = download.readall()
    return downloaded_bytes

where CONNECTION_STRING is an environmental variable.

@craig-shenton craig-shenton added docs Improvements or additions to documentation feature New feature or request function and removed docs Improvements or additions to documentation feature New feature or request labels Sep 6, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Development

When branches are created from issues, their pull requests are automatically linked.

1 participant