class Aws::SageMaker::Types::MultiModelConfig

Specifies additional configuration for hosting multi-model endpoints.

@note When making an API call, you may pass MultiModelConfig

data as a hash:

    {
      model_cache_setting: "Enabled", # accepts Enabled, Disabled
    }

@!attribute [rw] model_cache_setting

Whether to cache models for a multi-model endpoint. By default,
multi-model endpoints cache models so that a model does not have to
be loaded into memory each time it is invoked. Some use cases do not
benefit from model caching. For example, if an endpoint hosts a
large number of models that are each invoked infrequently, the
endpoint might perform better if you disable model caching. To
disable model caching, set the value of this parameter to
`Disabled`.
@return [String]

@see docs.aws.amazon.com/goto/WebAPI/sagemaker-2017-07-24/MultiModelConfig AWS API Documentation

Constants

SENSITIVE