Multiple S3 key pairs

[bilec]

Hi, is it possible to use multiple s3 accounts (for various warehouses)?
We are currently running Ceph S3 a I have multiple warehouses (each with one key pair). Is there way to deal with this other than key pairs being same?
Key pair being secret-key and access-key.

Thank you.

[dimas-b]

Hi @bilec !

Currently, for S3, Polaris can accept only one base key/secret pair per Polaris server. It can then use STS (if available) to assume a different role per catalog.

That said, the community is aware of the need for multiple user-provided credentials and is in the process of discussing possible solutions.

Related discussions:

• https://lists.apache.org/thread/2y2vv8jrgps7s3sr241k6tgm440jzbp9
• https://lists.apache.org/thread/boqdzdtmhhk1bncv2xr43sz4nsrhgwro

If you're willing to make a custom build based on Polaris it should be possible to provide per-catalog custom base credentials even now by implementing PolarisStorageIntegrationProvider.