class Aws::SageMaker::Types::ProcessingS3Input
Configuration for downloading input data from Amazon S3 into the processing container.
@note When making an API call, you may pass ProcessingS3Input
data as a hash: { s3_uri: "S3Uri", # required local_path: "ProcessingLocalPath", s3_data_type: "ManifestFile", # required, accepts ManifestFile, S3Prefix s3_input_mode: "Pipe", # accepts Pipe, File s3_data_distribution_type: "FullyReplicated", # accepts FullyReplicated, ShardedByS3Key s3_compression_type: "None", # accepts None, Gzip }
@!attribute [rw] s3_uri
The URI of the Amazon S3 prefix Amazon SageMaker downloads data required to run a processing job. @return [String]
@!attribute [rw] local_path
The local path in your container where you want Amazon SageMaker to write input data to. `LocalPath` is an absolute path to the input data and must begin with `/opt/ml/processing/`. `LocalPath` is a required parameter when `AppManaged` is `False` (default). @return [String]
@!attribute [rw] s3_data_type
Whether you use an `S3Prefix` or a `ManifestFile` for the data type. If you choose `S3Prefix`, `S3Uri` identifies a key name prefix. Amazon SageMaker uses all objects with the specified key name prefix for the processing job. If you choose `ManifestFile`, `S3Uri` identifies an object that is a manifest file containing a list of object keys that you want Amazon SageMaker to use for the processing job. @return [String]
@!attribute [rw] s3_input_mode
Whether to use `File` or `Pipe` input mode. In File mode, Amazon SageMaker copies the data from the input source onto the local ML storage volume before starting your processing container. This is the most commonly used input mode. In `Pipe` mode, Amazon SageMaker streams input data from the source directly to your processing container into named pipes without using the ML storage volume. @return [String]
@!attribute [rw] s3_data_distribution_type
Whether to distribute the data from Amazon S3 to all processing instances with `FullyReplicated`, or whether the data from Amazon S3 is shared by Amazon S3 key, downloading one shard of data to each processing instance. @return [String]
@!attribute [rw] s3_compression_type
Whether to GZIP-decompress the data in Amazon S3 as it is streamed into the processing container. `Gzip` can only be used when `Pipe` mode is specified as the `S3InputMode`. In `Pipe` mode, Amazon SageMaker streams input data from the source directly to your container without using the EBS volume. @return [String]
@see docs.aws.amazon.com/goto/WebAPI/sagemaker-2017-07-24/ProcessingS3Input AWS API Documentation
Constants
- SENSITIVE