Skip to content

503 UR when use websocket  #8147

@zhiqli

Description

@zhiqli

hi:
I use envoy as the http 1.1 service proxy. When using envoy 1.7 with v1 configuration is ok. After upgrade to envoy 1.9 with v2 configuration, I have been 503 UR error。
My service is deployed like this
image

The complete debug log
[2019-09-04 09:37:57.021][000012][debug][http] [source/common/http/conn_manager_impl.cc:200] [C161] new stream
[2019-09-04 09:37:57.021][000012][trace][http] [source/common/http/http1/codec_impl.cc:316] [C161] completed header: key=Host value=10.10.75.131
[2019-09-04 09:37:57.022][000012][trace][http] [source/common/http/http1/codec_impl.cc:316] [C161] completed header: key=Connection value=Upgrade
[2019-09-04 09:37:57.022][000012][trace][http] [source/common/http/http1/codec_impl.cc:316] [C161] completed header: key=Pragma value=no-cache
[2019-09-04 09:37:57.022][000012][trace][http] [source/common/http/http1/codec_impl.cc:316] [C161] completed header: key=Cache-Control value=no-cache
[2019-09-04 09:37:57.022][000012][trace][http] [source/common/http/http1/codec_impl.cc:316] [C161] completed header: key=User-Agent value=Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/76.0.3809.132 Safari/537.36
[2019-09-04 09:37:57.022][000012][trace][http] [source/common/http/http1/codec_impl.cc:316] [C161] completed header: key=Upgrade value=websocket
[2019-09-04 09:37:57.022][000012][trace][http] [source/common/http/http1/codec_impl.cc:316] [C161] completed header: key=Origin value=chrome-extension://omalebghpgejjiaoknljcfmglgbpocdp
[2019-09-04 09:37:57.022][000012][trace][http] [source/common/http/http1/codec_impl.cc:316] [C161] completed header: key=Sec-WebSocket-Version value=13
[2019-09-04 09:37:57.022][000012][trace][http] [source/common/http/http1/codec_impl.cc:316] [C161] completed header: key=Accept-Encoding value=gzip, deflate
[2019-09-04 09:37:57.022][000012][trace][http] [source/common/http/http1/codec_impl.cc:316] [C161] completed header: key=Accept-Language value=zh-CN,zh;q=0.9,en;q=0.8
[2019-09-04 09:37:57.022][000012][trace][http] [source/common/http/http1/codec_impl.cc:316] [C161] completed header: key=Sec-WebSocket-Key value=DWGXE2nuMBZyPZDEXuomkw==
[2019-09-04 09:37:57.022][000012][trace][http] [source/common/http/http1/codec_impl.cc:412] [C161] headers complete
[2019-09-04 09:37:57.022][000012][trace][http] [source/common/http/http1/codec_impl.cc:316] [C161] completed header: key=Sec-WebSocket-Extensions value=permessage-deflate; client_max_window_bits
[2019-09-04 09:37:57.022][000012][trace][http] [source/common/http/http1/codec_impl.cc:420] [C161] codec entering upgrade mode.
[2019-09-04 09:37:57.022][000012][debug][http] [source/common/http/conn_manager_impl.cc:537] [C161][S17377287246961922087] request headers complete (end_stream=false):
':authority', '10.10.75.131'
':path', '/xlchannel.app2amlogic/sio/?EIO=3&transport=websocket'
':method', 'GET'
'connection', 'Upgrade'
'pragma', 'no-cache'
'cache-control', 'no-cache'
'user-agent', 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/76.0.3809.132 Safari/537.36'
'upgrade', 'websocket'
'origin', 'chrome-extension://omalebghpgejjiaoknljcfmglgbpocdp'
'sec-websocket-version', '13'
'accept-encoding', 'gzip, deflate'
'accept-language', 'zh-CN,zh;q=0.9,en;q=0.8'
'sec-websocket-key', 'DWGXE2nuMBZyPZDEXuomkw=='
'sec-websocket-extensions', 'permessage-deflate; client_max_window_bits'

[2019-09-04 09:37:57.022][000012][debug][router] [source/common/router/router.cc:270] [C161][S17377287246961922087] cluster 'xlchannel.app2amlogic' match for URL '/xlchannel.app2amlogic/sio/?EIO=3&transport=websocket'
[2019-09-04 09:37:57.022][000012][debug][router] [source/common/router/router.cc:328] [C161][S17377287246961922087] router decoding headers:
':authority', '10.10.75.131'
':path', '/xlchannel.app2amlogic/sio/?EIO=3&transport=websocket'
':method', 'GET'
':scheme', 'http'
'connection', 'Upgrade'
'pragma', 'no-cache'
'cache-control', 'no-cache'
'user-agent', 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/76.0.3809.132 Safari/537.36'
'upgrade', 'websocket'
'origin', 'chrome-extension://omalebghpgejjiaoknljcfmglgbpocdp'
'sec-websocket-version', '13'
'accept-encoding', 'gzip, deflate'
'accept-language', 'zh-CN,zh;q=0.9,en;q=0.8'
'sec-websocket-key', 'DWGXE2nuMBZyPZDEXuomkw=='
'sec-websocket-extensions', 'permessage-deflate; client_max_window_bits'
'content-length', '0'
'x-forwarded-for', '192.168.61.139'
'x-forwarded-proto', 'http'
'x-envoy-internal', 'true'
'x-request-id', 'e1e5b5d7-4fad-4f07-8a6e-1f7e915bfee6'
'x-envoy-expected-rq-timeout-ms', '15000'

[2019-09-04 09:37:57.022][000012][debug][client] [source/common/http/codec_client.cc:26] [C162] connecting
[2019-09-04 09:37:57.022][000012][debug][connection] [source/common/network/connection_impl.cc:634] [C162] connecting to 172.30.50.181:9001
[2019-09-04 09:37:57.022][000012][debug][connection] [source/common/network/connection_impl.cc:643] [C162] connection in progress
[2019-09-04 09:37:57.023][000012][debug][http2] [source/common/http/http2/codec_impl.cc:721] [C162] setting stream-level initial window size to 268435456
[2019-09-04 09:37:57.023][000012][debug][http2] [source/common/http/http2/codec_impl.cc:743] [C162] updating connection-level initial window size to 268435456
[2019-09-04 09:37:57.023][000012][debug][pool] [source/common/http/conn_pool_base.cc:20] queueing request due to no available connections
[2019-09-04 09:37:57.023][000012][trace][http] [source/common/http/conn_manager_impl.cc:772] [C161][S17377287246961922087] decode headers called: filter=0x2502370 status=1
[2019-09-04 09:37:57.023][000012][trace][http] [source/common/http/http1/codec_impl.cc:433] [C161] message complete
[2019-09-04 09:37:57.023][000012][trace][http] [source/common/http/http1/codec_impl.cc:438] [C161] Pausing parser due to upgrade.
[2019-09-04 09:37:57.023][000012][trace][http] [source/common/http/http1/codec_impl.cc:369] [C161] parsed 586 bytes
[2019-09-04 09:37:57.023][000012][trace][http] [source/common/http/http1/codec_impl.cc:342] [C161] direct-dispatched 0 bytes
[2019-09-04 09:37:57.032][000012][trace][connection] [source/common/network/connection_impl.cc:439] [C162] socket event: 2
[2019-09-04 09:37:57.032][000012][trace][connection] [source/common/network/connection_impl.cc:507] [C162] write ready
[2019-09-04 09:37:57.032][000012][debug][connection] [source/common/network/connection_impl.cc:516] [C162] connected
[2019-09-04 09:37:57.032][000012][debug][client] [source/common/http/codec_client.cc:64] [C162] connected
[2019-09-04 09:37:57.032][000012][debug][pool] [source/common/http/http2/conn_pool.cc:83] [C162] creating stream
[2019-09-04 09:37:57.032][000012][debug][router] [source/common/router/router.cc:1023] [C161][S17377287246961922087] pool ready
[2019-09-04 09:37:57.032][000012][trace][http2] [source/common/http/http2/codec_impl.cc:554] [C162] send data: bytes=24
[2019-09-04 09:37:57.032][000012][trace][connection] [source/common/network/connection_impl.cc:376] [C162] writing 24 bytes, end_stream false
[2019-09-04 09:37:57.032][000012][trace][http2] [source/common/http/http2/codec_impl.cc:554] [C162] send data: bytes=21
[2019-09-04 09:37:57.032][000012][trace][connection] [source/common/network/connection_impl.cc:376] [C162] writing 21 bytes, end_stream false
[2019-09-04 09:37:57.032][000012][trace][http2] [source/common/http/http2/codec_impl.cc:508] [C162] sent frame type=4
[2019-09-04 09:37:57.032][000012][trace][http2] [source/common/http/http2/codec_impl.cc:554] [C162] send data: bytes=13
[2019-09-04 09:37:57.032][000012][trace][connection] [source/common/network/connection_impl.cc:376] [C162] writing 13 bytes, end_stream false
[2019-09-04 09:37:57.032][000012][trace][http2] [source/common/http/http2/codec_impl.cc:508] [C162] sent frame type=8
[2019-09-04 09:37:57.032][000012][trace][http2] [source/common/http/http2/codec_impl.cc:554] [C162] send data: bytes=505
[2019-09-04 09:37:57.032][000012][trace][connection] [source/common/network/connection_impl.cc:376] [C162] writing 505 bytes, end_stream false
[2019-09-04 09:37:57.032][000012][trace][http2] [source/common/http/http2/codec_impl.cc:508] [C162] sent frame type=1
[2019-09-04 09:37:57.032][000012][trace][connection] [source/common/network/connection_impl.cc:507] [C162] write ready
[2019-09-04 09:37:57.032][000012][trace][connection] [source/common/network/raw_buffer_socket.cc:62] [C162] write returns: 563
[2019-09-04 09:37:57.032][000012][trace][connection] [source/common/network/connection_impl.cc:439] [C162] socket event: 2
[2019-09-04 09:37:57.032][000012][trace][connection] [source/common/network/connection_impl.cc:507] [C162] write ready
[2019-09-04 09:37:57.042][000012][trace][connection] [source/common/network/connection_impl.cc:439] [C162] socket event: 3
[2019-09-04 09:37:57.042][000012][trace][connection] [source/common/network/connection_impl.cc:507] [C162] write ready
[2019-09-04 09:37:57.042][000012][trace][connection] [source/common/network/connection_impl.cc:477] [C162] read ready
[2019-09-04 09:37:57.042][000012][trace][connection] [source/common/network/raw_buffer_socket.cc:21] [C162] read returns: 56
[2019-09-04 09:37:57.042][000012][trace][connection] [source/common/network/raw_buffer_socket.cc:21] [C162] read returns: -1
[2019-09-04 09:37:57.042][000012][trace][connection] [source/common/network/raw_buffer_socket.cc:29] [C162] read error: 11
[2019-09-04 09:37:57.042][000012][trace][http2] [source/common/http/http2/codec_impl.cc:340] [C162] dispatching 56 bytes
[2019-09-04 09:37:57.042][000012][trace][http2] [source/common/http/http2/codec_impl.cc:398] [C162] recv frame type=4
[2019-09-04 09:37:57.042][000012][trace][http2] [source/common/http/http2/codec_impl.cc:398] [C162] recv frame type=4
[2019-09-04 09:37:57.042][000012][trace][http2] [source/common/http/http2/codec_impl.cc:398] [C162] recv frame type=8
[2019-09-04 09:37:57.042][000012][trace][http2] [source/common/http/http2/codec_impl.cc:398] [C162] recv frame type=3
[2019-09-04 09:37:57.042][000012][trace][http2] [source/common/http/http2/codec_impl.cc:494] [C162] remote reset: 1
[2019-09-04 09:37:57.042][000012][debug][http2] [source/common/http/http2/codec_impl.cc:563] [C162] stream closed: 1
[2019-09-04 09:37:57.042][000012][debug][client] [source/common/http/codec_client.cc:105] [C162] request reset
[2019-09-04 09:37:57.042][000012][trace][main] [source/common/event/dispatcher_impl.cc:130] item added to deferred deletion list (size=1)
[2019-09-04 09:37:57.042][000012][debug][pool] [source/common/http/http2/conn_pool.cc:222] [C162] destroying stream: 0 remaining
[2019-09-04 09:37:57.042][000012][debug][router] [source/common/router/router.cc:481] [C161][S17377287246961922087] upstream reset
[2019-09-04 09:37:57.042][000012][debug][http] [source/common/http/conn_manager_impl.cc:1188] [C161][S17377287246961922087] encoding headers via codec (end_stream=false):
':status', '503'
'content-length', '57'
'content-type', 'text/plain'
'date', 'Wed, 04 Sep 2019 09:37:56 GMT'
'server', 'envoy'
'connection', 'close'

[2019-09-04 09:37:57.042][000012][trace][connection] [source/common/network/connection_impl.cc:376] [C161] writing 153 bytes, end_stream false
[2019-09-04 09:37:57.042][000012][trace][http] [source/common/http/conn_manager_impl.cc:1304] [C161][S17377287246961922087] encoding data via codec (size=57 end_stream=true)
[2019-09-04 09:37:57.042][000012][trace][connection] [source/common/network/connection_impl.cc:376] [C161] writing 57 bytes, end_stream false
[2019-09-04 09:37:57.042][000012][trace][main] [source/common/event/dispatcher_impl.cc:130] item added to deferred deletion list (size=2)
[2019-09-04 09:37:57.042][000012][debug][connection] [source/common/network/connection_impl.cc:101] [C161] closing data_to_write=210 type=2
[2019-09-04 09:37:57.042][000012][debug][connection] [source/common/network/connection_impl.cc:153] [C161] setting delayed close timer with timeout 1000 ms
[2019-09-04 09:37:57.042][000012][trace][main] [source/common/event/dispatcher_impl.cc:130] item added to deferred deletion list (size=3)
[2019-09-04 09:37:57.042][000012][trace][http2] [source/common/http/http2/codec_impl.cc:355] [C162] dispatched 56 bytes
[2019-09-04 09:37:57.042][000012][trace][http2] [source/common/http/http2/codec_impl.cc:554] [C162] send data: bytes=9
[2019-09-04 09:37:57.042][000012][trace][connection] [source/common/network/connection_impl.cc:376] [C162] writing 9 bytes, end_stream false
[2019-09-04 09:37:57.042][000012][trace][http2] [source/common/http/http2/codec_impl.cc:508] [C162] sent frame type=4
[2019-09-04 09:37:57.042][000012][trace][main] [source/common/event/dispatcher_impl.cc:56] clearing deferred deletion list (size=3)
[2019-09-04 09:37:57.043][000012][trace][connection] [source/common/network/connection_impl.cc:439] [C162] socket event: 2
[2019-09-04 09:37:57.043][000012][trace][connection] [source/common/network/connection_impl.cc:507] [C162] write ready
[2019-09-04 09:37:57.043][000012][trace][connection] [source/common/network/raw_buffer_socket.cc:62] [C162] write returns: 9
[2019-09-04 09:37:57.043][000012][trace][connection] [source/common/network/connection_impl.cc:439] [C161] socket event: 2
[2019-09-04 09:37:57.043][000012][trace][connection] [source/common/network/connection_impl.cc:507] [C161] write ready
[2019-09-04 09:37:57.043][000012][trace][connection] [source/common/network/raw_buffer_socket.cc:62] [C161] write returns: 210
[2019-09-04T09:37:57.021Z] "GET /xlchannel.app2amlogic/sio/?EIO=3&transport=websocket HTTP/1.1" 503 UR 0 57 21 - "192.168.61.139" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/76.0.3809.132 Safari/537.36" "e1e5b5d7-4fad-4f07-8a6e-1f7e915bfee6" "10.10.75.131" "172.30.50.181:9001"

Metadata

Metadata

Assignees

Labels

questionQuestions that are neither investigations, bugs, nor enhancements

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions