Table of Contents - elastic-mapreduce-2011.11.23 Documentation
Pages
- LICENSE
-
README
- Amazon Elastic Map Reduce Ruby Client Readme (Unofficial Gem and Ruby 1.9 Version)
- Usage
- Original Readme
- Amazon Elastic Map Reduce Ruby Client Readme
- Conventions Used in this Document
- Installation and Dependencies
- Step 1: Download and Install Ruby
- Step 2: Download the Amazon Elastic MapReduce Ruby Client
- Step 2a: Edit Your Path
- Step 3: Create a Credentials File
- Basic Usage
- Listing Job Flows
- Running a Development Job Flow
- Debugging a Failed Step
- Enabling Hadoop Debugging
- Adding a JAR Step
- Adding a JobFlow from JSON
- Samples
- Running a Custom Jar
- Compiling and Uploading a Jar
- Running a Pig Program
- Running Pig in Interactive Mode
- Running Pig in Batch Mode
- Running a Hive Program
- Running Hive in Interactive Mode
- Running Hive in Batch Mode
- Terminating a Job Flow
- Environment Variables
- Bootstrap Actions
- Example Bootstrap Actions
- Configure Hadoop
- Configure Daemons
- Run-if
- Using the Ruby Client as a Library
- README.header
- cacert.pem
Classes and Modules
- AWS
- AWS::AddressLimitExceeded
- AWS::ArgumentError
- AWS::AttachmentLimitExceeded
- AWS::AuthFailure
- AWS::DuplicateLoadBalancerName
- AWS::Error
- AWS::IncorrectState
- AWS::InstanceLimitExceeded
- AWS::InsufficientAddressCapacity
- AWS::InsufficientInstanceCapacity
- AWS::InsufficientReservedInstanceCapacity
- AWS::InsufficientReservedInstancesCapacity
- AWS::InternalError
- AWS::InvalidAMIAttributeItemValue
- AWS::InvalidAMIIDMalformed
- AWS::InvalidAMIIDNotFound
- AWS::InvalidAMIIDUnavailable
- AWS::InvalidAttachmentNotFound
- AWS::InvalidClientTokenId
- AWS::InvalidConfigurationRequest
- AWS::InvalidDeviceInUse
- AWS::InvalidGroupDuplicate
- AWS::InvalidGroupInUse
- AWS::InvalidGroupNotFound
- AWS::InvalidGroupReserved
- AWS::InvalidInstance
- AWS::InvalidInstanceIDMalformed
- AWS::InvalidInstanceIDNotFound
- AWS::InvalidKeyPairDuplicate
- AWS::InvalidKeyPairNotFound
- AWS::InvalidManifest
- AWS::InvalidParameterCombination
- AWS::InvalidParameterValue
- AWS::InvalidPermissionDuplicate
- AWS::InvalidPermissionMalformed
- AWS::InvalidReservationIDMalformed
- AWS::InvalidReservationIDNotFound
- AWS::InvalidReservedInstancesId
- AWS::InvalidReservedInstancesOfferingId
- AWS::InvalidSnapshotIDMalformed
- AWS::InvalidSnapshotIDNotFound
- AWS::InvalidUserIDMalformed
- AWS::InvalidVolumeIDDuplicate
- AWS::InvalidVolumeIDMalformed
- AWS::InvalidVolumeIDNotFound
- AWS::InvalidVolumeIDZoneMismatch
- AWS::InvalidZoneNotFound
- AWS::LoadBalancerNotFound
- AWS::NonEBSInstance
- AWS::PendingSnapshotLimitExceeded
- AWS::ReservedInstancesLimitExceeded
- AWS::SignatureDoesNotMatch
- AWS::SnapshotLimitExceeded
- AWS::TooManyLoadBalancers
- AWS::Unavailable
- AWS::UnknownParameter
- AWS::ValidationError
- AWS::VolumeLimitExceeded
- Amazon
- Amazon::Coral
- Amazon::Coral::AwsQuery
- Amazon::Coral::AwsQueryChainHelper
- Amazon::Coral::AwsQueryHandler
- Amazon::Coral::AwsQueryUriHandler
- Amazon::Coral::Call
- Amazon::Coral::Dispatcher
- Amazon::Coral::Ec2Client
- Amazon::Coral::ElasticMapReduceClient
- Amazon::Coral::Handler
- Amazon::Coral::HttpDelegationHelper
- Amazon::Coral::HttpDestinationHandler
- Amazon::Coral::HttpHandler
- Amazon::Coral::IdentityHandler
- Amazon::Coral::Job
- Amazon::Coral::LogFactory
- Amazon::Coral::Option
- Amazon::Coral::Orchestrator
- Amazon::Coral::QueryStringMap
- Amazon::Coral::Service
- Amazon::Coral::SimpleLog
- Amazon::Coral::SimpleLogFactory
- Amazon::Coral::UrlEncoding
- Amazon::Coral::V0SignatureHandler
- Amazon::Coral::V0SignatureHelper
- Amazon::Coral::V1SignatureHandler
- Amazon::Coral::V1SignatureHelper
- Amazon::Coral::V2SignatureHandler
- Amazon::Coral::V2SignatureHelper
- Amazon::Coral::WrappedLogger
- Amazon::RetryDelegator
- Amazon::StdErrLogger
- Array
- Commands
- Commands::AbstractInstanceGroupCommand
- Commands::AbstractListCommand
- Commands::AbstractSSHCommand
- Commands::AddInstanceGroupCommand
- Commands::AddJobFlowStepsCommand
- Commands::ArgOption
- Commands::ArgsOption
- Commands::BootstrapActionCommand
- Commands::Command
- Commands::CommandOption
- Commands::Commands
- Commands::CreateInstanceGroupCommand
- Commands::CreateJobFlowCommand
- Commands::DescribeActionCommand
- Commands::EipCommand
- Commands::EnableDebuggingCommand
- Commands::FlagOption
- Commands::GetCommand
- Commands::GlobalFlagOption
- Commands::GlobalOption
- Commands::HelpCommand
- Commands::HiveCommand
- Commands::HiveInteractiveCommand
- Commands::HiveScriptCommand
- Commands::HiveSiteCommand
- Commands::InstanceCountOption
- Commands::InstanceTypeOption
- Commands::JarStepCommand
- Commands::JsonStepCommand
- Commands::ListActionCommand
- Commands::LogsCommand
- Commands::ModifyInstanceGroupCommand
- Commands::OptionWithArg
- Commands::ParamOption
- Commands::PigInteractiveCommand
- Commands::PigScriptCommand
- Commands::PrintHiveVersionCommand
- Commands::PutCommand
- Commands::ResizeJobflowCommand
- Commands::SSHCommand
- Commands::SetTerminationProtection
- Commands::StepCommand
- Commands::StepProcessingCommand
- Commands::StreamStepCommand
- Commands::TerminateActionCommand
- Commands::UnarrestInstanceGroupCommand
- Commands::VersionCommand
- Credentials
- Ec2ClientWrapper
- EmrClient
- FalseClass
- Hash
- JSON
- JSON::Lexer
- NilClass
- Numeric
- Object
- SimpleExecutor
- SimpleLogger
- String
- TrueClass
- UUID
- UUID::UUID_TOOLS_VERSION
- UUIDTools
- UUIDTools::UUID
Methods
- ::add_commands — Commands
- ::add_delegation_token — Amazon::Coral::HttpDelegationHelper
- ::check_args — Amazon::Coral::AwsQuery
- ::create_and_execute_commands — Commands
- ::encode — Amazon::Coral::UrlEncoding
- ::fold_commands — Commands
- ::getLog — Amazon::Coral::LogFactory
- ::install — Amazon::Coral::SimpleLog
- ::is_create_child_command — Commands
- ::mac_address= — UUIDTools::UUID
- ::md5_create — UUIDTools::UUID
- ::new — Amazon::Coral::AwsQueryChainHelper
- ::new — Amazon::Coral::AwsQueryHandler
- ::new — Amazon::Coral::AwsQueryUriHandler
- ::new — Amazon::Coral::Call
- ::new — Amazon::Coral::Dispatcher
- ::new — Amazon::Coral::Ec2Client
- ::new — Amazon::Coral::ElasticMapReduceClient
- ::new — Amazon::Coral::HttpDestinationHandler
- ::new — Amazon::Coral::HttpHandler
- ::new — Amazon::Coral::IdentityHandler
- ::new — Amazon::Coral::Job
- ::new — Amazon::Coral::Option
- ::new — Amazon::Coral::Orchestrator
- ::new — Amazon::Coral::QueryStringMap
- ::new — Amazon::Coral::Service
- ::new — Amazon::Coral::WrappedLogger
- ::new — Amazon::Coral::SimpleLogFactory
- ::new — Amazon::Coral::V0SignatureHelper
- ::new — Amazon::Coral::V1SignatureHelper
- ::new — Amazon::Coral::V2SignatureHandler
- ::new — Amazon::Coral::V2SignatureHelper
- ::new — Amazon::RetryDelegator
- ::new — Amazon::StdErrLogger
- ::new — EmrClient
- ::new — Commands::Commands
- ::new — Commands::Command
- ::new — Commands::CommandOption
- ::new — Commands::StepCommand
- ::new — Commands::StreamStepCommand
- ::new — Commands::AbstractSSHCommand
- ::new — Commands::SSHCommand
- ::new — Commands::StepProcessingCommand
- ::new — Commands::CreateJobFlowCommand
- ::new — Commands::BootstrapActionCommand
- ::new — Commands::AbstractInstanceGroupCommand
- ::new — Commands::FlagOption
- ::new — Commands::JsonStepCommand
- ::new — Commands::ParamOption
- ::new — Commands::EipCommand
- ::new — Credentials
- ::new — Ec2ClientWrapper
- ::new — JSON::Lexer
- ::new — SimpleLogger
- ::new — UUIDTools::UUID
- ::new_aws_query — Amazon::Coral::Ec2Client
- ::new_aws_query — Amazon::Coral::ElasticMapReduceClient
- ::new_chain — Amazon::Coral::AwsQuery
- ::new_from_commands — Commands::PigInteractiveCommand
- ::new_from_commands — Commands::HiveInteractiveCommand
- ::new_orchestrator — Amazon::Coral::AwsQuery
- ::parse — Amazon::Coral::Option
- ::parse — UUIDTools::UUID
- ::parse — JSON
- ::parse_hexdigest — UUIDTools::UUID
- ::parse_int — UUIDTools::UUID
- ::parse_raw — UUIDTools::UUID
- ::pretty_generate — JSON
- ::pretty_generate_recursive — JSON
- ::random_create — UUIDTools::UUID
- ::setInstance — Amazon::Coral::LogFactory
- ::sha1_create — UUIDTools::UUID
- ::timestamp_create — UUIDTools::UUID
- ::to_json — String
- ::work_out_globals — Commands
- #<< — Commands::Commands
- #<=> — UUIDTools::UUID
- #AddInstanceGroups — Amazon::Coral::ElasticMapReduceClient
- #AddJobFlowSteps — Amazon::Coral::ElasticMapReduceClient
- #AllocateAddress — Amazon::Coral::Ec2Client
- #AssociateAddress — Amazon::Coral::Ec2Client
- #DescribeJobFlows — Amazon::Coral::ElasticMapReduceClient
- #ModifyInstanceGroups — Amazon::Coral::ElasticMapReduceClient
- #RunJobFlow — Amazon::Coral::ElasticMapReduceClient
- #SetTerminationProtection — Amazon::Coral::ElasticMapReduceClient
- #TerminateJobFlows — Amazon::Coral::ElasticMapReduceClient
- #add_bootstrap_command — Commands::CreateJobFlowCommand
- #add_fields — Amazon::Coral::V0SignatureHelper
- #add_fields — Amazon::Coral::V1SignatureHelper
- #add_fields — Amazon::Coral::V2SignatureHelper
- #add_flattened — Amazon::Coral::QueryStringMap
- #add_flattened_helper — Amazon::Coral::QueryStringMap
- #add_instance_group_command — Commands::CreateJobFlowCommand
- #add_instance_groups — EmrClient
- #add_step_command — Commands::AddJobFlowStepsCommand
- #add_step_command — Commands::CreateJobFlowCommand
- #add_steps — EmrClient
- #after — Amazon::Coral::AwsQueryHandler
- #after — Amazon::Coral::Handler
- #allocate_address — Ec2ClientWrapper
- #apply_jobflow_option — Commands::CreateJobFlowCommand
- #associate_address — Ec2ClientWrapper
- #attach — Commands::CommandOption
- #attach — Commands::GlobalOption
- #attach — Commands::GlobalFlagOption
- #attach — Commands::ArgsOption
- #attach — Commands::ArgOption
- #attach — Commands::InstanceCountOption
- #attach — Commands::InstanceTypeOption
- #attach — Commands::OptionWithArg
- #attach — Commands::FlagOption
- #attach — Commands::ParamOption
- #aws_error? — Amazon::Coral::AwsQueryHandler
- #back — JSON::Lexer
- #before — Amazon::Coral::AwsQueryHandler
- #before — Amazon::Coral::AwsQueryUriHandler
- #before — Amazon::Coral::Handler
- #before — Amazon::Coral::HttpDestinationHandler
- #before — Amazon::Coral::HttpHandler
- #before — Amazon::Coral::IdentityHandler
- #before — Amazon::Coral::V0SignatureHandler
- #before — Amazon::Coral::V1SignatureHandler
- #before — Amazon::Coral::V2SignatureHandler
- #bootstrap_action — Commands::BootstrapActionCommand
- #call — Amazon::Coral::Call
- #canonicalize — Amazon::Coral::V0SignatureHelper
- #canonicalize — Amazon::Coral::V1SignatureHelper
- #canonicalize — Amazon::Coral::V2SignatureHelper
- #compute_signature — Amazon::Coral::V0SignatureHelper
- #compute_signature — Amazon::Coral::V1SignatureHelper
- #compute_signature — Amazon::Coral::V2SignatureHelper
- #consume — Amazon::Coral::Option
- #convert_to_json — Amazon::Coral::AwsQueryHandler
- #create_jobflow — Commands::CreateJobFlowCommand
- #debug — Amazon::Coral::WrappedLogger
- #debug? — Amazon::Coral::WrappedLogger
- #default_enable_debugging_path — Commands::StepCommand
- #default_hadoop_version — Commands::CreateJobFlowCommand
- #default_hive_cmd — Commands::StepCommand
- #default_hive_path — Commands::StepCommand
- #default_instance_group_name — Commands::AbstractInstanceGroupCommand
- #default_job_flow_name — Commands::CreateJobFlowCommand
- #default_pig_cmd — Commands::StepCommand
- #default_pig_path — Commands::StepCommand
- #default_resize_jobflow_cmd — Commands::StepCommand
- #default_script_runner_path — Commands::StepCommand
- #describe_jobflow — EmrClient
- #describe_jobflow_with_id — EmrClient
- #description — Amazon::Coral::Option
- #dispatch — Amazon::Coral::Dispatcher
- #each — Commands::Commands
- #each — JSON::Lexer
- #ec2_endpoint_from_az — Commands::EipCommand
- #enact — Commands::Commands
- #enact — Commands::Command
- #enact — Commands::AbstractSSHCommand
- #enact — Commands::SSHCommand
- #enact — Commands::PutCommand
- #enact — Commands::GetCommand
- #enact — Commands::PrintHiveVersionCommand
- #enact — Commands::LogsCommand
- #enact — Commands::AddJobFlowStepsCommand
- #enact — Commands::CreateJobFlowCommand
- #enact — Commands::AbstractListCommand
- #enact — Commands::ListActionCommand
- #enact — Commands::DescribeActionCommand
- #enact — Commands::SetTerminationProtection
- #enact — Commands::TerminateActionCommand
- #enact — Commands::VersionCommand
- #enact — Commands::HelpCommand
- #enact — Commands::AddInstanceGroupCommand
- #enact — Commands::ModifyInstanceGroupCommand
- #enact — Commands::UnarrestInstanceGroupCommand
- #enact — Commands::EipCommand
- #ensure_install_cmd — Commands::StepCommand
- #eql? — UUIDTools::UUID
- #error — Amazon::Coral::WrappedLogger
- #error — SimpleLogger
- #error? — Amazon::Coral::WrappedLogger
- #error_if_nil — Credentials
- #exec — Commands::Commands
- #exec — Commands::AbstractSSHCommand
- #exec — Commands::EipCommand
- #exec — SimpleExecutor
- #extra_args — Commands::StepCommand
- #fatal — Amazon::Coral::WrappedLogger
- #fatal — SimpleLogger
- #fatal? — Amazon::Coral::WrappedLogger
- #format — Amazon::Coral::WrappedLogger
- #format — Commands::ListActionCommand
- #from_json — Array
- #from_json — Hash
- #generate_hash — UUIDTools::UUID
- #generate_hexdigest — UUIDTools::UUID
- #generate_i — UUIDTools::UUID
- #generate_raw — UUIDTools::UUID
- #generate_s — UUIDTools::UUID
- #getLog — Amazon::Coral::LogFactory
- #getLog — Amazon::Coral::SimpleLogFactory
- #get_field — Commands::Commands
- #get_field — Commands::Command
- #get_key — Amazon::Coral::QueryStringMap
- #get_scp_opts — Commands::AbstractSSHCommand
- #get_ssh_opts — Commands::AbstractSSHCommand
- #get_value — Amazon::Coral::AwsQueryHandler
- #get_version_args — Commands::HiveCommand
- #has_value — Commands::Command
- #hash — UUIDTools::UUID
- #have — Commands::Commands
- #have — Commands::Command
- #have_role — Commands::CreateJobFlowCommand
- #hexdigest — UUIDTools::UUID
- #http_request — Amazon::Coral::HttpHandler
- #identity — Amazon::Coral::Call
- #identity= — Amazon::Coral::Call
- #info — Amazon::Coral::WrappedLogger
- #info — Amazon::StdErrLogger
- #info — SimpleLogger
- #info? — Amazon::Coral::WrappedLogger
- #inspect — UUIDTools::UUID
- #instance_group — Commands::AbstractInstanceGroupCommand
- #is_error_response — EmrClient
- #is_error_response — Ec2ClientWrapper
- #is_retry_exception — Amazon::RetryDelegator
- #is_retryable_error_response — EmrClient
- #is_retryable_error_response — Ec2ClientWrapper
- #jobflow_has_install_step — Commands::PigInteractiveCommand
- #jobflow_has_install_step — Commands::HiveInteractiveCommand
- #last — Commands::Commands
- #long — Amazon::Coral::Option
- #mac_address — UUIDTools::UUID
- #main — Amazon::Coral::Service
- #message — Amazon::StdErrLogger
- #method_missing — Amazon::RetryDelegator
- #modify_instance_groups — EmrClient
- #more? — JSON::Lexer
- #newAddInstanceGroupsCall — Amazon::Coral::ElasticMapReduceClient
- #newAddJobFlowStepsCall — Amazon::Coral::ElasticMapReduceClient
- #newAllocateAddressCall — Amazon::Coral::Ec2Client
- #newAssociateAddressCall — Amazon::Coral::Ec2Client
- #newDescribeJobFlowsCall — Amazon::Coral::ElasticMapReduceClient
- #newModifyInstanceGroupsCall — Amazon::Coral::ElasticMapReduceClient
- #newRunJobFlowCall — Amazon::Coral::ElasticMapReduceClient
- #newSetTerminationProtectionCall — Amazon::Coral::ElasticMapReduceClient
- #newTerminateJobFlowsCall — Amazon::Coral::ElasticMapReduceClient
- #new_instance_group_command — Commands::CreateJobFlowCommand
- #nextchar — JSON::Lexer
- #nextchars — JSON::Lexer
- #nextclean — JSON::Lexer
- #nextmatch — JSON::Lexer
- #nextstring — JSON::Lexer
- #nextto — JSON::Lexer
- #nextvalue — JSON::Lexer
- #nil_uuid? — UUIDTools::UUID
- #option — Commands::Command
- #opts — Commands::AbstractSSHCommand
- #orchestrate — Amazon::Coral::Orchestrator
- #parse_command — Commands::Commands
- #parse_credentials — Credentials
- #parse_jobflows — Commands::Commands
- #parse_option — Commands::Commands
- #parse_options — Commands::Commands
- #print_usage — Amazon::Coral::Service
- #puts — SimpleLogger
- #raise_on_error — EmrClient
- #raise_on_error — Ec2ClientWrapper
- #random_node_id? — UUIDTools::UUID
- #raw — UUIDTools::UUID
- #region_from_az — Commands::EipCommand
- #reorder_steps — Commands::StepCommand
- #reorder_steps — Commands::EnableDebuggingCommand
- #reorder_steps — Commands::PigScriptCommand
- #reorder_steps — Commands::HiveSiteCommand
- #reorder_steps — Commands::HiveScriptCommand
- #reorder_steps — Commands::StepProcessingCommand
- #reply — Amazon::Coral::Job
- #request — Amazon::Coral::Job
- #request_id — Amazon::Coral::Call
- #request_id= — Amazon::Coral::Call
- #require — Commands::Command
- #require_single_jobflow — Commands::Command
- #require_singleton_array — Commands::AbstractInstanceGroupCommand
- #resolve — Commands::Command
- #run_jobflow — EmrClient
- #script_args — Commands::StepCommand
- #set_termination_protection — EmrClient
- #setup_instance_groups — Commands::CreateJobFlowCommand
- #short — Amazon::Coral::Option
- #sign — Amazon::Coral::V0SignatureHelper
- #sign — Amazon::Coral::V1SignatureHelper
- #sign — Amazon::Coral::V2SignatureHelper
- #signT — Amazon::Coral::V0SignatureHelper
- #signT — Amazon::Coral::V1SignatureHelper
- #signT — Amazon::Coral::V2SignatureHelper
- #size — Commands::Commands
- #skippast — JSON::Lexer
- #skipto — JSON::Lexer
- #sort — Amazon::Coral::V0SignatureHelper
- #sort — Amazon::Coral::V1SignatureHelper
- #sort — Amazon::Coral::V2SignatureHelper
- #sort_streaming_args — Commands::StreamStepCommand
- #steps — Commands::ResizeJobflowCommand
- #steps — Commands::EnableDebuggingCommand
- #steps — Commands::PigScriptCommand
- #steps — Commands::PigInteractiveCommand
- #steps — Commands::HiveSiteCommand
- #steps — Commands::HiveScriptCommand
- #steps — Commands::HiveInteractiveCommand
- #steps — Commands::JarStepCommand
- #steps — Commands::StreamStepCommand
- #steps — Commands::JsonStepCommand
- #terminate_jobflows — EmrClient
- #timestamp — UUIDTools::UUID
- #to_i — UUIDTools::UUID
- #to_json — Object
- #to_json — NilClass
- #to_json — TrueClass
- #to_json — FalseClass
- #to_json — Numeric
- #to_json — String
- #to_json — Array
- #to_json — Hash
- #to_s — Amazon::Coral::QueryStringMap
- #to_s — UUIDTools::UUID
- #to_str — UUIDTools::UUID
- #to_uri — UUIDTools::UUID
- #trace — SimpleLogger
- #unescape — JSON::Lexer
- #utf8str — JSON::Lexer
- #valid? — UUIDTools::UUID
- #validate — Commands::Commands
- #validate — Commands::Command
- #validate — Commands::StepCommand
- #validate — Commands::ResizeJobflowCommand
- #validate — Commands::AddJobFlowStepsCommand
- #validate — Commands::CreateJobFlowCommand
- #validate — Commands::AddInstanceGroupCommand
- #validate — Commands::CreateInstanceGroupCommand
- #validate — Commands::ModifyInstanceGroupCommand
- #validate — Commands::UnarrestInstanceGroupCommand
- #variant — UUIDTools::UUID
- #version — UUIDTools::UUID
- #wait_for_jobflow — Commands::AbstractSSHCommand
- #wait_for_jobflow — Commands::EipCommand
- #warn — Amazon::Coral::WrappedLogger
- #warn? — Amazon::Coral::WrappedLogger
- #xml_to_json — Amazon::Coral::AwsQueryHandler