Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add S3 File and Folder Operations in S3FileHandler Class #29

Closed
wants to merge 1 commit into from

Conversation

Alphagon
Copy link
Contributor

Description: This pull request introduces several new features to the S3FileHandler class, providing comprehensive support for interacting with AWS S3. The new methods allow users to list, upload, and download files and folders to and from an S3 bucket.

Key Features:

List Buckets and Objects:
    list_s3_buckets: Lists all S3 buckets in the account.
    list_s3_objects: Lists all files within a specific S3 bucket or under a given prefix.

File Upload:
    upload_file_to_s3: Uploads a file from the local file system to an S3 bucket, with optional metadata support.

File Download:
    download_s3_file: Downloads a specific file from an S3 bucket to a local directory. Optionally retrieves file metadata.

Folder Download:
    download_s3_folder: Recursively downloads an entire folder from an S3 bucket to a local directory while preserving the directory structure.

These enhancements streamline the process of handling files and folders in S3, offering a more user-friendly API to manage S3 resources efficiently.

Changes:

Added new methods for file and folder operations.
Optional metadata handling for file uploads and downloads.

Testing:

Manually tested against various S3 buckets, verifying upload/download functionality and metadata retrieval.

@Alphagon Alphagon closed this Oct 16, 2024
@Alphagon Alphagon deleted the s3_loader2 branch October 16, 2024 05:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant