bbi.experimental.s3_files

class S3Files(bucket_name: str | None = None, aws_access_key_id: str | None = None, aws_secret_access_key: str | None = None, **kwargs: Any)

Bases: object

Generic S3 source representing arbitrary files stored in an S3 bucket.

The bucket name and credentials default to the STARDUST_S3_BUCKET_NAME, STARDUST_S3_ACCESS_KEY_ID and STARDUST_S3_SECRET_ACCESS_KEY environment variables when not passed explicitly.

generate_presigned_url(object_name: str) → str

Generate a presigned URL to share an S3 object. This method checks if the object name is in the bucket.

Parameters:

object_name (str) – The name of the object to generate a presigned URL for.