This is the repository for the npm package @eduelias/bucket-search
This package helps scrapping S3 buckets using it's SQL capabilities to go through all files and querying them sequentially or simultaneously.
Getting started1
- Install the package into your project:
npm i --save @eduelias/bucket-search
- Create a project file like
SimpleQuery.ts
- Create a new class that extends
DefaultProject.ts
- Instantiate your class
- Call method
.run()
To see some examples, look for the folder examples. There we have a simple sequential query runner that will list all files in the bucket and query each one sequentially and log to console when any records are found.
Footnotes
-
To be able to query the S3 bucket you configured on your project, you need to have AWS credentials file set up and the correct credentials on your environment. ↩