class HTTP2Next::Connection
Connection
encapsulates all of the connection, stream, flow-control, error management, and other processing logic required for a well-behaved HTTP 2.0 endpoint.
Note that this class should not be used directly. Instead, you want to use either Client
or Server
class to drive the HTTP 2.0 exchange.
rubocop:disable Metrics/ClassLength
Attributes
Number of active streams between client and server (reserved streams are not counted towards the stream limit).
Current settings value for local and peer
Size of current connection flow control window (by default, set to infinity, but is automatically updated on receipt of peer settings).
Max number of streams that can be in-transit in this connection.
Pending settings value
Sent but not ack'ed settings
Connection
state (:new, :closed).
Size of current connection flow control window (by default, set to infinity, but is automatically updated on receipt of peer settings).
Public Class Methods
Initializes new connection object.
# File lib/http/2/next/connection.rb, line 81 def initialize(settings = {}) @local_settings = DEFAULT_CONNECTION_SETTINGS.merge(settings) @remote_settings = SPEC_DEFAULT_CONNECTION_SETTINGS.dup @compressor = Header::Compressor.new(settings) @decompressor = Header::Decompressor.new(settings) @active_stream_count = 0 @max_streams = nil @last_activated_stream = 0 @last_stream_id = 0 @streams = {} @streams_recently_closed = {} @pending_settings = [] @framer = Framer.new(@local_settings[:settings_max_frame_size]) @local_window_limit = @local_settings[:settings_initial_window_size] @local_window = @local_window_limit @remote_window_limit = @remote_settings[:settings_initial_window_size] @remote_window = @remote_window_limit @recv_buffer = "".b @continuation = [] @error = nil @h2c_upgrade = nil @closed_since = nil @received_frame = false end
Public Instance Methods
# File lib/http/2/next/connection.rb, line 401 def <<(data) receive(data) end
# File lib/http/2/next/connection.rb, line 112 def closed? @state == :closed end
Sends a GOAWAY frame indicating that the peer should stop creating new streams for current connection.
Endpoints MAY append opaque data to the payload of any GOAWAY frame. Additional debug data is intended for diagnostic purposes only and carries no semantic value. Debug data MUST NOT be persistently stored, since it could contain sensitive information.
@param error [Symbol] @param payload [String]
# File lib/http/2/next/connection.rb, line 155 def goaway(error = :no_error, payload = nil) last_stream = if (max = @streams.max) max.first else 0 end send(type: :goaway, last_stream: last_stream, error: error, payload: payload) @state = :closed @closed_since = Process.clock_gettime(Process::CLOCK_MONOTONIC) end
Allocates new stream for current connection.
@param priority [Integer] @param window [Integer] @param parent [Stream]
# File lib/http/2/next/connection.rb, line 121 def new_stream(**args) raise ConnectionClosed if @state == :closed raise StreamLimitExceeded if @active_stream_count >= (@max_streams || @remote_settings[:settings_max_concurrent_streams]) connection_error(:protocol_error, msg: "id is smaller than previous") if @stream_id < @last_activated_stream stream = activate_stream(id: @stream_id, **args) @last_activated_stream = stream.id @stream_id += 2 stream end
Sends PING frame to the peer.
@param payload [String] optional payload must be 8 bytes long @param blk [Proc] callback to execute when PONG is received
# File lib/http/2/next/connection.rb, line 140 def ping(payload, &blk) send(type: :ping, stream: 0, payload: payload) once(:ack, &blk) if blk end
Decodes incoming bytes into HTTP 2.0 frames and routes them to appropriate receivers: connection frames are handled directly, and stream frames are passed to appropriate stream objects.
@param data [String] Binary encoded string
# File lib/http/2/next/connection.rb, line 193 def receive(data) @recv_buffer << data # Upon establishment of a TCP connection and determination that # HTTP/2.0 will be used by both peers, each endpoint MUST send a # connection header as a final confirmation and to establish the # initial settings for the HTTP/2.0 connection. # # Client connection header is 24 byte connection header followed by # SETTINGS frame. Server connection header is SETTINGS frame only. if @state == :waiting_magic if @recv_buffer.size < 24 raise HandshakeError unless CONNECTION_PREFACE_MAGIC.start_with? @recv_buffer return # maybe next time elsif @recv_buffer.read(24) == CONNECTION_PREFACE_MAGIC # MAGIC is OK. Send our settings @state = :waiting_connection_preface payload = @local_settings.reject { |k, v| v == SPEC_DEFAULT_CONNECTION_SETTINGS[k] } settings(payload) else raise HandshakeError end end while (frame = @framer.parse(@recv_buffer)) if is_a?(Client) && !@received_frame connection_error(:protocol_error, msg: "didn't receive settings") if frame[:type] != :settings @received_frame = true end # Implementations MUST discard frames # that have unknown or unsupported types. if frame[:type].nil? # However, extension frames that appear in # the middle of a header block (Section 4.3) are not permitted; these # MUST be treated as a connection error (Section 5.4.1) of type # PROTOCOL_ERROR. connection_error(:protocol_error) unless @continuation.empty? next end emit(:frame_received, frame) # Header blocks MUST be transmitted as a contiguous sequence of frames # with no interleaved frames of any other type, or from any other stream. unless @continuation.empty? connection_error unless frame[:type] == :continuation && frame[:stream] == @continuation.first[:stream] @continuation << frame next unless frame[:flags].include? :end_headers payload = @continuation.map { |f| f[:payload] }.join frame = @continuation.shift @continuation.clear frame.delete(:length) frame[:payload] = payload frame[:flags] << :end_headers end # SETTINGS frames always apply to a connection, never a single stream. # The stream identifier for a settings frame MUST be zero. If an # endpoint receives a SETTINGS frame whose stream identifier field is # anything other than 0x0, the endpoint MUST respond with a connection # error (Section 5.4.1) of type PROTOCOL_ERROR. if connection_frame?(frame) connection_error(:protocol_error) unless frame[:stream].zero? connection_management(frame) else case frame[:type] when :headers # When server receives even-numbered stream identifier, # the endpoint MUST respond with a connection error of type PROTOCOL_ERROR. connection_error if frame[:stream].even? && is_a?(Server) # The last frame in a sequence of HEADERS/CONTINUATION # frames MUST have the END_HEADERS flag set. unless frame[:flags].include? :end_headers @continuation << frame next end # After sending a GOAWAY frame, the sender can discard frames # for new streams. However, any frames that alter connection # state cannot be completely ignored. For instance, HEADERS, # PUSH_PROMISE and CONTINUATION frames MUST be minimally # processed to ensure a consistent compression state decode_headers(frame) return if @state == :closed stream = @streams[frame[:stream]] if stream.nil? verify_pseudo_headers(frame) stream = activate_stream( id: frame[:stream], weight: frame[:weight] || DEFAULT_WEIGHT, dependency: frame[:dependency] || 0, exclusive: frame[:exclusive] || false ) verify_stream_order(stream.id) emit(:stream, stream) end stream << frame when :push_promise # The last frame in a sequence of PUSH_PROMISE/CONTINUATION # frames MUST have the END_HEADERS flag set unless frame[:flags].include? :end_headers @continuation << frame return end decode_headers(frame) return if @state == :closed # PUSH_PROMISE frames MUST be associated with an existing, peer- # initiated stream... A receiver MUST treat the receipt of a # PUSH_PROMISE on a stream that is neither "open" nor # "half-closed (local)" as a connection error (Section 5.4.1) of # type PROTOCOL_ERROR. Similarly, a receiver MUST treat the # receipt of a PUSH_PROMISE that promises an illegal stream # identifier (Section 5.1.1) (that is, an identifier for a stream # that is not currently in the "idle" state) as a connection error # (Section 5.4.1) of type PROTOCOL_ERROR, unless the receiver # recently sent a RST_STREAM frame to cancel the associated stream. parent = @streams[frame[:stream]] pid = frame[:promise_stream] # if PUSH parent is recently closed, RST_STREAM the push if @streams_recently_closed[frame[:stream]] send(type: :rst_stream, stream: pid, error: :refused_stream) return end connection_error(msg: "missing parent ID") if parent.nil? unless parent.state == :open || parent.state == :half_closed_local # An endpoint might receive a PUSH_PROMISE frame after it sends # RST_STREAM. PUSH_PROMISE causes a stream to become "reserved". # The RST_STREAM does not cancel any promised stream. Therefore, if # promised streams are not desired, a RST_STREAM can be used to # close any of those streams. if parent.closed == :local_rst # We can either (a) 'resurrect' the parent, or (b) RST_STREAM # ... sticking with (b), might need to revisit later. send(type: :rst_stream, stream: pid, error: :refused_stream) else connection_error end end _verify_pseudo_headers(frame, REQUEST_MANDATORY_HEADERS) stream = activate_stream(id: pid, parent: parent) verify_stream_order(stream.id) emit(:promise, stream) stream << frame else if (stream = @streams[frame[:stream]]) stream << frame if frame[:type] == :data update_local_window(frame) calculate_window_update(@local_window_limit) end else case frame[:type] # The PRIORITY frame can be sent for a stream in the "idle" or # "closed" state. This allows for the reprioritization of a # group of dependent streams by altering the priority of an # unused or closed parent stream. when :priority stream = activate_stream( id: frame[:stream], weight: frame[:weight] || DEFAULT_WEIGHT, dependency: frame[:dependency] || 0, exclusive: frame[:exclusive] || false ) emit(:stream, stream) stream << frame # WINDOW_UPDATE can be sent by a peer that has sent a frame # bearing the END_STREAM flag. This means that a receiver could # receive a WINDOW_UPDATE frame on a "half-closed (remote)" or # "closed" stream. A receiver MUST NOT treat this as an error # (see Section 5.1). when :window_update stream = @streams_recently_closed[frame[:stream]] connection_error(:protocol_error, msg: "sent window update on idle stream") unless stream process_window_update(frame: frame, encode: true) else # An endpoint that receives an unexpected stream identifier # MUST respond with a connection error of type PROTOCOL_ERROR. connection_error(msg: "stream does not exist") end end end end end rescue StandardError => e raise if e.is_a?(Error::Error) connection_error(e: e) end
Sends a connection SETTINGS frame to the peer. The values are reflected when the corresponding ACK is received.
@param settings [Array or Hash]
# File lib/http/2/next/connection.rb, line 180 def settings(payload) payload = payload.to_a validate_settings(@local_role, payload) @pending_settings << payload send(type: :settings, stream: 0, payload: payload) @pending_settings << payload end
Sends a WINDOW_UPDATE frame to the peer.
@param increment [Integer]
# File lib/http/2/next/connection.rb, line 171 def window_update(increment) @local_window += increment send(type: :window_update, stream: 0, increment: increment) end
Private Instance Methods
# File lib/http/2/next/connection.rb, line 764 def _verify_pseudo_headers(frame, mandatory_headers) headers = frame[:payload] return if headers.is_a?(String) pseudo_headers = headers.take_while do |field, value| # use this loop to validate pseudo-headers connection_error(:protocol_error, msg: "path is empty") if field == ":path" && value.empty? field.start_with?(":") end.map(&:first) return if mandatory_headers.size == pseudo_headers.size && (mandatory_headers - pseudo_headers).empty? connection_error(:protocol_error, msg: "invalid pseudo-headers") end
Activates new incoming or outgoing stream and registers appropriate connection managemet callbacks.
@param id [Integer] @param priority [Integer] @param window [Integer] @param parent [Stream]
# File lib/http/2/next/connection.rb, line 727 def activate_stream(id:, **args) connection_error(msg: "Stream ID already exists") if @streams.key?(id) raise StreamLimitExceeded if @active_stream_count >= (@max_streams || @local_settings[:settings_max_concurrent_streams]) stream = Stream.new(connection: self, id: id, **args) # Streams that are in the "open" state, or either of the "half closed" # states count toward the maximum number of streams that an endpoint is # permitted to open. stream.once(:active) { @active_stream_count += 1 } stream.once(:close) do # Store a reference to the closed stream, such that we can respond # to any in-flight frames while close is registered on both sides. # References to such streams will be purged whenever another stream # is closed, with a minimum of 15s RTT time window. @streams_recently_closed.reject! do |stream_id, v| to_delete = (Process.clock_gettime(Process::CLOCK_MONOTONIC) - v) > 15 @streams.delete stream_id if to_delete to_delete end @streams_recently_closed[id] = Process.clock_gettime(Process::CLOCK_MONOTONIC) end stream.on(:promise, &method(:promise)) if is_a? Server stream.on(:frame, &method(:send)) @streams[id] = stream end
Emit GOAWAY error indicating to peer that the connection is being aborted, and once sent, raise a local exception.
@param error [Symbol] @option error [Symbol] :no_error @option error [Symbol] :internal_error @option error [Symbol] :flow_control_error @option error [Symbol] :stream_closed @option error [Symbol] :frame_too_large @option error [Symbol] :compression_error @param msg [String]
# File lib/http/2/next/connection.rb, line 790 def connection_error(error = :protocol_error, msg: nil, e: nil) goaway(error) unless @state == :closed || @state == :new @state = :closed @error = error msg ||= e ? e.message : "protocol error" backtrace = e ? e.backtrace : nil raise Error.types[error], msg, backtrace end
Check if frame is a connection frame: SETTINGS, PING, GOAWAY, and any frame addressed to stream ID = 0.
@param frame [Hash] @return [Boolean]
# File lib/http/2/next/connection.rb, line 450 def connection_frame?(frame) (frame[:stream]).zero? || frame[:type] == :settings || frame[:type] == :ping || frame[:type] == :goaway end
Process received connection frame (stream ID = 0).
-
Handle SETTINGS updates
-
Connection
flow control (WINDOW_UPDATE) -
Emit PONG auto-reply to PING frames
-
Mark connection as closed on GOAWAY
@param frame [Hash]
# File lib/http/2/next/connection.rb, line 464 def connection_management(frame) case @state when :waiting_connection_preface # The first frame MUST be a SETTINGS frame at the start of a connection. @state = :connected connection_settings(frame) when :connected case frame[:type] when :settings connection_settings(frame) when :window_update process_window_update(frame: frame, encode: true) when :ping ping_management(frame) when :goaway # Receivers of a GOAWAY frame MUST NOT open additional streams on # the connection, although a new connection can be established # for new streams. @state = :closed @closed_since = Process.clock_gettime(Process::CLOCK_MONOTONIC) emit(:goaway, frame[:last_stream], frame[:error], frame[:payload]) when :altsvc # 4. The ALTSVC HTTP/2 Frame # An ALTSVC frame on stream 0 with empty (length 0) "Origin" # information is invalid and MUST be ignored. emit(frame[:type], frame) if frame[:origin] && !frame[:origin].empty? when :origin return if @h2c_upgrade || !frame[:flags].empty? frame[:payload].each do |origin| emit(frame[:type], origin) end when :blocked emit(frame[:type], frame) else connection_error end when :closed case frame[:type] when :goaway connection_error when :ping ping_management(frame) else connection_error if (Process.clock_gettime(Process::CLOCK_MONOTONIC) - @closed_since) > 15 end else connection_error end end
Update connection settings based on parameters set by the peer.
@param frame [Hash]
# File lib/http/2/next/connection.rb, line 579 def connection_settings(frame) connection_error unless frame[:type] == :settings && (frame[:stream]).zero? # Apply settings. # side = # local: previously sent and pended our settings should be effective # remote: just received peer settings should immediately be effective settings, side = if frame[:flags].include?(:ack) # Process pending settings we have sent. [@pending_settings.shift, :local] else validate_settings(@remote_role, frame[:payload]) [frame[:payload], :remote] end settings.each do |key, v| case side when :local @local_settings[key] = v when :remote @remote_settings[key] = v end case key when :settings_max_concurrent_streams # Do nothing. # The value controls at the next attempt of stream creation. when :settings_initial_window_size # A change to SETTINGS_INITIAL_WINDOW_SIZE could cause the available # space in a flow control window to become negative. A sender MUST # track the negative flow control window, and MUST NOT send new flow # controlled frames until it receives WINDOW_UPDATE frames that cause # the flow control window to become positive. case side when :local @local_window = @local_window - @local_window_limit + v @streams.each_value do |stream| stream.emit(:local_window, stream.local_window - @local_window_limit + v) end @local_window_limit = v when :remote # can adjust the initial window size for new streams by including a # value for SETTINGS_INITIAL_WINDOW_SIZE in the SETTINGS frame. # The connection flow-control window can only be changed using # WINDOW_UPDATE frames. @streams.each_value do |stream| # Event name is :window, not :remote_window stream.emit(:window, stream.remote_window - @remote_window_limit + v) end @remote_window_limit = v end when :settings_header_table_size # Setting header table size might cause some headers evicted case side when :local @compressor.table_size = v when :remote @decompressor.table_size = v end when :settings_enable_push # nothing to do when :settings_max_frame_size @framer.remote_max_frame_size = v # else # ignore unknown settings end end case side when :local # Received a settings_ack. Notify application layer. emit(:settings_ack, frame, @pending_settings.size) when :remote unless @state == :closed || @h2c_upgrade == :start # Send ack to peer send(type: :settings, stream: 0, payload: [], flags: [:ack]) # when initial window size changes, we try to flush any buffered # data. @streams.each_value(&:flush) end end end
Decode headers payload and update connection decompressor state.
The receiver endpoint reassembles the header block by concatenating the individual fragments, then decompresses the block to reconstruct the header set - aka, header payloads are buffered until END_HEADERS, or an END_PROMISE flag is seen.
@param frame [Hash]
# File lib/http/2/next/connection.rb, line 676 def decode_headers(frame) frame[:payload] = @decompressor.decode(frame[:payload], frame) if frame[:payload].is_a?(String) rescue CompressionError => e connection_error(:compression_error, e: e) rescue ProtocolError => e connection_error(:protocol_error, e: e) rescue StandardError => e connection_error(:internal_error, e: e) end
Applies HTTP 2.0 binary encoding to the frame.
@param frame [Hash] @return [Array of Buffer] encoded frame
# File lib/http/2/next/connection.rb, line 435 def encode(frame) frames = if frame[:type] == :headers || frame[:type] == :push_promise encode_headers(frame) # HEADERS and PUSH_PROMISE may create more than one frame else [frame] # otherwise one frame end frames.map { |f| @framer.generate(f) } end
Encode headers payload and update connection compressor state.
@param frame [Hash] @return [Array of Frame]
# File lib/http/2/next/connection.rb, line 690 def encode_headers(frame) payload = frame[:payload] payload = @compressor.encode(payload) unless payload.is_a?(String) frames = [] begin while payload && payload.bytesize > 0 cont = frame.dup cont[:type] = :continuation cont[:flags] = [] cont[:payload] = payload.byteslice(0, @remote_settings[:settings_max_frame_size]) payload = payload.byteslice(@remote_settings[:settings_max_frame_size]..-1) frames << cont end if frames.empty? frames << frame else frames.first[:type] = frame[:type] frames.first[:flags] = frame[:flags] - [:end_headers] frames.last[:flags] << :end_headers end rescue StandardError => e connection_error(:compression_error, e: e) end frames end
# File lib/http/2/next/connection.rb, line 801 def manage_state(_) yield end
# File lib/http/2/next/connection.rb, line 516 def ping_management(frame) if frame[:flags].include? :ack emit(:ack, frame[:payload]) else send(type: :ping, stream: 0, flags: [:ack], payload: frame[:payload]) end end
Send an outgoing frame. DATA frames are subject to connection flow control and may be split and / or buffered based on current window size. All other frames are sent immediately.
@note all frames are currently delivered in FIFO order. @param frame [Hash]
# File lib/http/2/next/connection.rb, line 413 def send(frame) emit(:frame_sent, frame) if frame[:type] == :data send_data(frame, true) elsif frame[:type] == :rst_stream && frame[:error] == :protocol_error # An endpoint can end a connection at any time. In particular, an # endpoint MAY choose to treat a stream error as a connection error. goaway(frame[:error]) else # HEADERS and PUSH_PROMISE may generate CONTINUATION. Also send # RST_STREAM that are not protocol errors frames = encode(frame) frames.each { |f| emit(:frame, f) } end end
Validate settings parameters. See sepc Section 6.5.2.
@param role [Symbol] The sender's role: :client or :server @return nil if no error. Exception object in case of any error.
# File lib/http/2/next/connection.rb, line 529 def validate_settings(role, settings) settings.each do |key, v| case key when :settings_enable_push case role when :server # Section 8.2 # Clients MUST reject any attempt to change the # SETTINGS_ENABLE_PUSH setting to a value other than 0 by treating the # message as a connection error (Section 5.4.1) of type PROTOCOL_ERROR. next if v.zero? connection_error(:protocol_error, msg: "invalid #{key} value") when :client # Any value other than 0 or 1 MUST be treated as a # connection error (Section 5.4.1) of type PROTOCOL_ERROR. next if v.zero? || v == 1 connection_error(:protocol_error, msg: "invalid #{key} value") end when :settings_initial_window_size # Values above the maximum flow control window size of 2^31-1 MUST # be treated as a connection error (Section 5.4.1) of type # FLOW_CONTROL_ERROR. next if v <= 0x7fffffff connection_error(:flow_control_error, msg: "invalid #{key} value") when :settings_max_frame_size # The initial value is 2^14 (16,384) octets. The value advertised # by an endpoint MUST be between this initial value and the maximum # allowed frame size (2^24-1 or 16,777,215 octets), inclusive. # Values outside this range MUST be treated as a connection error # (Section 5.4.1) of type PROTOCOL_ERROR. next if v >= 16_384 && v <= 16_777_215 connection_error(:protocol_error, msg: "invalid #{key} value") # when :settings_max_concurrent_streams # Any value is valid # when :settings_header_table_size # Any value is valid # when :settings_max_header_list_size # Any value is valid # else # ignore unknown settings end end end
# File lib/http/2/next/connection.rb, line 757 def verify_stream_order(id) return unless id.odd? connection_error(msg: "Stream ID smaller than previous") if @last_stream_id > id @last_stream_id = id end