Skip to content

Parquet

parquetopen_generic

parquetopen_generic(key: str, bucket: Bucket | str | None = None, blocksize: int = DEFAULT_CHUNK_SIZE) -> pq.ParquetFile

Open an S3 object or local file as a ParquetFile.

Parameters:

  • key (str) –

    path or S3 key

  • bucket (Bucket | str | None, default: None ) –

    Bucket object or bucket name if this is an S3 object; None if a local file

  • blocksize (int, default: DEFAULT_CHUNK_SIZE ) –

    block size for read operation, relevant only for S3

Returns: a ParquetFile object created from key