S3 Compatible

[caiofonteles]

Hi all,

Can ERDDAP read datasets directly from an S3-compatible storage like Oracle Cloud Infrastructure (OCI), or is it restricted to AWS S3?

Thanks,

Caio

[ChrisJohnNOAA]

Currently it only works with AWS. We do want to support all S3 compatible storage, it's on our Priority Project List (#158 ).

If you want more context or to help contribute to this there are a some issues with some discussion:
#95
#107

[caiofonteles]

Thanks Chris!

It will be nice to have this feature. If it helps, I can share a dataset in OCI for use in tests and development. Let me know if this can help you.

[ChrisJohnNOAA]

Yes, an example dataset would be helpful, especially one not on aws.

[caiofonteles]

Hi Chris,

here you have a link for an oracle S3 compatible bucket.

https://axm5g5gwb06v.compat.objectstorage.eu-madrid-1.oraclecloud.com/erddap/

The data has several time series for each city in Portugal.

Please let me know if you need additional information regarding the data.

[srstsavage]

I created a Backblaze bucket and uploaded the tx_zonal_stats.csv, as well as a dataset derived from the nosSosATemp demo dataset coops1611400AirTemp.csv. Backblaze doesn't allow unauthenticated S3 connections. I'm sending read only credentials to Chris, but if anyone else wants to work on this let me know and I can send you the key.