class Aws::SageMaker::Types::ProcessingS3Input

Configuration for downloading input data from Amazon S3 into the processing container.

@note When making an API call, you may pass ProcessingS3Input

data as a hash:

    {
      s3_uri: "S3Uri", # required
      local_path: "ProcessingLocalPath",
      s3_data_type: "ManifestFile", # required, accepts ManifestFile, S3Prefix
      s3_input_mode: "Pipe", # accepts Pipe, File
      s3_data_distribution_type: "FullyReplicated", # accepts FullyReplicated, ShardedByS3Key
      s3_compression_type: "None", # accepts None, Gzip
    }

@!attribute [rw] s3_uri

The URI of the Amazon S3 prefix Amazon SageMaker downloads data
required to run a processing job.
@return [String]

@!attribute [rw] local_path

The local path in your container where you want Amazon SageMaker to
write input data to. `LocalPath` is an absolute path to the input
data and must begin with `/opt/ml/processing/`. `LocalPath` is a
required parameter when `AppManaged` is `False` (default).
@return [String]

@!attribute [rw] s3_data_type

Whether you use an `S3Prefix` or a `ManifestFile` for the data type.
If you choose `S3Prefix`, `S3Uri` identifies a key name prefix.
Amazon SageMaker uses all objects with the specified key name prefix
for the processing job. If you choose `ManifestFile`, `S3Uri`
identifies an object that is a manifest file containing a list of
object keys that you want Amazon SageMaker to use for the processing
job.
@return [String]

@!attribute [rw] s3_input_mode

Whether to use `File` or `Pipe` input mode. In File mode, Amazon
SageMaker copies the data from the input source onto the local ML
storage volume before starting your processing container. This is
the most commonly used input mode. In `Pipe` mode, Amazon SageMaker
streams input data from the source directly to your processing
container into named pipes without using the ML storage volume.
@return [String]

@!attribute [rw] s3_data_distribution_type

Whether to distribute the data from Amazon S3 to all processing
instances with `FullyReplicated`, or whether the data from Amazon S3
is shared by Amazon S3 key, downloading one shard of data to each
processing instance.
@return [String]

@!attribute [rw] s3_compression_type

Whether to GZIP-decompress the data in Amazon S3 as it is streamed
into the processing container. `Gzip` can only be used when `Pipe`
mode is specified as the `S3InputMode`. In `Pipe` mode, Amazon
SageMaker streams input data from the source directly to your
container without using the EBS volume.
@return [String]

@see docs.aws.amazon.com/goto/WebAPI/sagemaker-2017-07-24/ProcessingS3Input AWS API Documentation

Constants

SENSITIVE