Types

Data types used throughout the mast-upload-tools which are not complicated enough to need their own file.

TransferEntity module-attribute

TransferEntity = Literal['validator', 'client', 'lambda']

Named entities in transfer process

TransferType module-attribute

TransferType = Literal['staging', 'sample']

Names of transfer categories

YAMLString module-attribute

YAMLString = str

alias for strings that can be parsed as valid YAML

LambdaEventParameters

Bases: TypedDict

Information the pipeline launch lambda expects to receive from the upload client on invocation in normal operation.

PipelineLaunchParameters

Bases: TypedDict

Information the validation pipeline expects to receive from the pipeline launch lambda on startup in normal operation.

PipelineNetworkConfig

Bases: TypedDict

AWS configuration settings necessary for executing various aspects of the pipeline but not for initial client auth. Components are expected to fetch them from Parameter Store.

TaskConfig

Bases: TypedDict

Format of full validation task configuration. The default task configuration YAML object should contain all of these keys. Dataset- specific objects may contain any subset.

ValidationSQSReport

Bases: TypedDict

Format for SQS message sent by validation pipeline on exit (assuming successful init). Dumped to JSON in actual message.