Proxy: Support proxy server for SRS. v7.0.16 by winlinvip · Pull Request #4158 · ossrs/srs

winlinvip · 2024-08-26T04:08:36Z

Please note that the proxy server is a new architecture or the next version of the Origin Cluster, which allows the publication of multiple streams. The SRS origin cluster consists of a group of origin servers designed to handle a large number of streams.

                         +-----------------------+
                     +---+ SRS Proxy(Deployment) +------+---------------------+
+-----------------+  |   +-----------+-----------+      +                     +
| LB(K8s Service) +--+               +(Redis/MESH)      + SRS Origin Servers  +
+-----------------+  |   +-----------+-----------+      +    (Deployment)     +
                     +---+ SRS Proxy(Deployment) +------+---------------------+
                         +-----------------------+

The new origin cluster is designed as a collection of proxy servers. For more information, see Discussion #3634. If you prefer to use the old origin cluster, please switch to a version before SRS 6.0.

A proxy server can be used for a set of origin servers, which are isolated and dedicated origin servers. The main improvement in the new architecture is to store the state for origin servers in the proxy server, rather than using MESH to communicate between origin servers. With a proxy server, you can deploy origin servers as stateless servers, such as in a Kubernetes (K8s) deployment.

Now that the proxy server is a stateful server, it uses Redis to store the states. For faster development, we use Go to develop the proxy server, instead of C/C++. Therefore, the proxy server itself is also stateless, with all states stored in the Redis server or cluster. This makes the new origin cluster architecture very powerful and robust.

The proxy server is also an architecture designed to solve multiple process bottlenecks. You can run hundreds of SRS origin servers with one proxy server on the same machine. This solution can utilize multi-core machines, such as servers with 128 CPUs. Thus, we can keep SRS single-threaded and very simple. See https://github.com/ossrs/srs/discussions/3665#discussioncomment-6474441 for details.

                                       +--------------------+
                               +-------+ SRS Origin Server  +
                               +       +--------------------+
                               +
+-----------------------+      +       +--------------------+
+ SRS Proxy(Deployment) +------+-------+ SRS Origin Server  +
+-----------------------+      +       +--------------------+
                               +
                               +       +--------------------+
                               +-------+ SRS Origin Server  +
                                       +--------------------+

Keep in mind that the proxy server for the Origin Cluster is designed to handle many streams. To address the issue of many viewers, we will enhance the Edge Cluster to support more protocols.

+------------------+                                               +--------------------+
+ SRS Edge Server  +--+                                    +-------+ SRS Origin Server  +
+------------------+  +                                    +       +--------------------+
                      +                                    +
+------------------+  +     +-----------------------+      +       +--------------------+
+ SRS Edge Server  +--+-----+ SRS Proxy(Deployment) +------+-------+ SRS Origin Server  +
+------------------+  +     +-----------------------+      +       +--------------------+
                      +                                    +
+------------------+  +                                    +       +--------------------+
+ SRS Edge Server  +--+                                    +-------+ SRS Origin Server  +
+------------------+                                               +--------------------+

With the new Origin Cluster and Edge Cluster, you have a media system capable of supporting a large number of streams and viewers. For example, you can publish 10,000 streams, each with 100,000 viewers.

Co-authored-by: Jacob Su suzp1984@gmail.com

winlinvip · 2024-08-29T12:03:47Z

It works pretty well :)

trunk/conf/origin1-for-proxy.conf

proxy/srs.go

…4171) The heartbeat of SRS is a timer that requests an HTTP URL. We can use this heartbeat to report the necessary information for registering the backend server with the proxy server. ```text SRS(backend) --heartbeat---> Proxy server ``` A proxy server is a specialized load balancer for media servers. It operates at the application level rather than the TCP level. For more information about the proxy server, see issue #4158. Note that we will merge this PR into SRS 5.0+, allowing the use of SRS 5.0+ as the backend server, not limited to SRS 7.0. However, the proxy server is introduced in SRS 7.0. It's also possible to implement a registration service, allowing you to use other media servers as backend servers. For example, if you gather information about an nginx-rtmp server and register it with the proxy server, the proxy will forward RTMP streams to nginx-rtmp. The backend server is not limited to SRS. --------- Co-authored-by: Jacob Su <suzp1984@gmail.com>

The heartbeat of SRS is a timer that requests an HTTP URL. We can use this heartbeat to report the necessary information for registering the backend server with the proxy server. ```text SRS(backend) --heartbeat---> Proxy server ``` A proxy server is a specialized load balancer for media servers. It operates at the application level rather than the TCP level. For more information about the proxy server, see issue #4158. Note that we will merge this PR into SRS 5.0+, allowing the use of SRS 5.0+ as the backend server, not limited to SRS 7.0. However, the proxy server is introduced in SRS 7.0. It's also possible to implement a registration service, allowing you to use other media servers as backend servers. For example, if you gather information about an nginx-rtmp server and register it with the proxy server, the proxy will forward RTMP streams to nginx-rtmp. The backend server is not limited to SRS. --------- Co-authored-by: Jacob Su <suzp1984@gmail.com>

VyVu · 2025-02-14T08:01:49Z

It works pretty well :)

What is the hardware configuration of each server (CPU , RAM , bandwidth)?

jurry · 2025-02-17T23:52:06Z

proxy/rtc.go

+	}
+
+	// Proxy all messages from backend to client.
+	go func() {


This causes a goroutine leak and consumes the whole available memory very soon (10 GB in my case). I have a fix and can create a PR. Please let me know, maybe you already solved it @winlinvip

Please to send your PR.

winlinvip added the EnglishNative This issue is conveyed exclusively in English. label Aug 26, 2024

suzp1984 reviewed Aug 31, 2024

View reviewed changes

trunk/conf/origin1-for-proxy.conf Outdated Show resolved Hide resolved

suzp1984 reviewed Aug 31, 2024

View reviewed changes

proxy/srs.go Show resolved Hide resolved

winlinvip force-pushed the feature/srs-proxy branch from 15f132a to 54d01ba Compare September 1, 2024 05:07

winlinvip force-pushed the develop branch from e52ad4b to d70e735 Compare September 1, 2024 09:04

winlinvip force-pushed the feature/srs-proxy branch from 54d01ba to 1217a4d Compare September 1, 2024 09:22

winlinvip marked this pull request as ready for review September 5, 2024 07:28

winlinvip mentioned this pull request Sep 5, 2024

Heartbeat: Report ports for proxy server. v5.0.215 v6.0.156 v7.0.15 #4171

Merged

suzp1984 reviewed Sep 5, 2024

View reviewed changes

proxy/srs.go Outdated Show resolved Hide resolved

winlinvip added 17 commits September 9, 2024 10:56

Proxy: Support proxy server for SRS.

fdcd86c

Add logger with context ID.

19d6d54

Add version and signature.

7aba30a

Add errors for proxy server.

df04a8e

Add HTTP server versions.

2eae020

Refine code to files.

650befd

Add RTMP and AMF0 protocol stack.

a3aaa0b

Support RTMP proxy server.

9b2e734

Support FFmpeg RTMP publisher.

9e43187

Support HTTP API server proxy.

e00fcae

Add system api server for proxy.

73a16e3

Add SRS load balancer.

b62b1e3

Support proxy RTMP to backend.

fc4b657

Refine default ports.

fa39d74

Refine the amf0 any API and RTMP.

b8ded5a

Support redis load balancer.

3269228

Use memory LB for simple use scenarios.

82707eb

winlinvip added 20 commits September 9, 2024 10:56

Refine error for HTTP stream.

2242bf0

Refine errors for HTTP streaming.

e311928

Fix bugs.

cc4fdb6

Support HLS streaming with memory LB.

3c5f6a4

Refine HLS streaming.

f05d3fe

Support hls proxy via redis LB.

0dc47d9

Refine HLS error.

3d5db62

Refine HTTP streaming error.

d053b81

Refine RTMP streaming error.

68595a5

Support proxy to webrtc api.

17f836a

Support proxy to webrtc media.

5b6c9df

Refine the logs.

bf4b973

Support redis LB for WebRTC.

ebdb078

Support proxy SRT media server.

1c10756

WaitGroup: Do not wait automatically.

e982852

Support static files.

8b64ebe

Refine comments.

79f090c

Support parse listen endpoint.

d5032f6

Support SRT listen ep in UDP.

62c280c

Refine names.

79161b9

winlinvip force-pushed the feature/srs-proxy branch from 2120738 to 79161b9 Compare September 9, 2024 03:12

winlinvip added 3 commits September 9, 2024 11:17

Refine comments.

2e7f2c2

Refine makefile.

7b20e58

Update release to v7.0.16

7f5c1c9

winlinvip changed the title ~~Proxy: Support proxy server for SRS.~~ Proxy: Support proxy server for SRS. v7.0.16 Sep 9, 2024

winlinvip added the RefinedByAI Refined by AI/GPT. label Sep 9, 2024

winlinvip merged commit 2e4014a into ossrs:develop Sep 9, 2024

winlinvip added a commit that referenced this pull request Sep 10, 2024

Proxy: Remove dependency of godotenv. #4158

e674f82

jurry reviewed Feb 17, 2025

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Proxy: Support proxy server for SRS. v7.0.16#4158

Proxy: Support proxy server for SRS. v7.0.16#4158
winlinvip merged 46 commits intoossrs:developfrom
winlinvip:feature/srs-proxy

winlinvip commented Aug 26, 2024 •

edited

Loading

Uh oh!

winlinvip commented Aug 29, 2024

Uh oh!

Uh oh!

Uh oh!

Uh oh!

VyVu commented Feb 14, 2025

Uh oh!

jurry Feb 17, 2025

Uh oh!

suzp1984 Feb 18, 2025

Uh oh!

Reviewers

Assignees

Labels

Milestone

Development

Uh oh!

4 participants

Uh oh!

Conversation

winlinvip commented Aug 26, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

winlinvip commented Aug 29, 2024

Uh oh!

Uh oh!

Uh oh!

Uh oh!

VyVu commented Feb 14, 2025

Uh oh!

jurry Feb 17, 2025

Choose a reason for hiding this comment

Uh oh!

suzp1984 Feb 18, 2025

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Milestone

Development

Uh oh!

4 participants

winlinvip commented Aug 26, 2024 •

edited

Loading