Unity Render Streaming is an open-source project that enables real-time streaming of Unity content to web browsers. It utilizes WebRTC technology to achieve low-latency streaming of both video and audio, making it suitable for interactive applications and remote rendering scenarios.

Pros

• Low-latency streaming of Unity content to web browsers
• Cross-platform support, including mobile devices
• Enables remote rendering and interactive applications
• Integrates well with Unity's existing rendering pipeline

Cons

• Requires a good network connection for optimal performance
• May have compatibility issues with older browsers or devices
• Learning curve for developers new to WebRTC technology
• Limited documentation and examples compared to some other Unity packages

Code Examples

1. Setting up a render streaming connection:

using Unity.RenderStreaming;

public class StreamingSetup : MonoBehaviour
{
    private RenderStreaming renderStreaming;

    void Start()
    {
        renderStreaming = GetComponent<RenderStreaming>();
        renderStreaming.Run(HandleOnStarted);
    }

    void HandleOnStarted(string connectionId)
    {
        Debug.Log($"Streaming started. Connection ID: {connectionId}");
    }
}

2. Adding a video stream:

using Unity.RenderStreaming;
using UnityEngine.UI;

public class VideoStreamer : MonoBehaviour
{
    [SerializeField] private RawImage displayImage;
    private VideoStreamSender streamSender;

    void Start()
    {
        streamSender = GetComponent<VideoStreamSender>();
        streamSender.OnStartedStream += HandleStreamStarted;
    }

    void HandleStreamStarted(RenderTexture texture)
    {
        displayImage.texture = texture;
    }
}

3. Handling input from the remote client:

using Unity.RenderStreaming.InputSystem;

public class RemoteInput : MonoBehaviour
{
    private RemoteInputReceiver inputReceiver;

    void Start()
    {
        inputReceiver = GetComponent<RemoteInputReceiver>();
        inputReceiver.OnDeviceChange += HandleDeviceChange;
    }

    void HandleDeviceChange(InputDevice device, InputDeviceChange change)
    {
        if (change == InputDeviceChange.Added)
        {
            Debug.Log($"New input device connected: {device.name}");
        }
    }
}

Getting Started

1. Install the Unity Render Streaming package via the Package Manager.
2. Add the RenderStreaming component to a GameObject in your scene.
3. Configure the Signaling Settings in the RenderStreaming component.
4. Add StreamingSender components for video/audio you want to stream.
5. Build and run your Unity project.
6. Open the provided web application to connect and view the stream.

For detailed setup instructions, refer to the official documentation on the GitHub repository.