SERVICE DESCRIPTION LIVEARENA BROADCAST ROOM
We’ve taken broadcast AI to the next level, embedding never-before-seen artificial intelligence into the LiveArena Broadcast Room. The fully automated suite provides integrated content formats for news, presentations, and talk shows.
Simply select your format, turn on your camera, and watch as the Broadcast Room technology intelligently follows the action. The Broadcast Room evaluates your live stream pixel-by-pixel, analyzing the video input to detect who is speaking and how they are moving, seamlessly tracking the presenter’s motion as he or she moves and speaks.
LiveArena Broadcast Room automates the production of live video hence mittegating the need of production staff. Based on advanced pattern recognition and AI it enables fully automated production of live video events to Microsoft Teams and Microsoft Stream. In addition to the supported Microsoft Office 365 services additional streaming services based on RTMP(S) ingest can in some cases be utilized.
2. System Overview
The LiveArena Broadcast Room main system componets are:
Virtual Director server
Touch Screen Panel - Management Console
Data Input Converter
2.1 Virtual Director Server
The heart of the Broadcast Room is the computer that receives the feeds from the Camera and Data Input sources. Both inputs are analyzed and encoded into a single broadcast, streamed to the supported streaming platforms (Microsoft Teams/Stream and LiveArena Broadcast). The produced and encoded stream is also recorded and stored on a local drive for backup purposes in case of connectivity issues.
2.2 Broadcast Camera
The Broadcast Room camera should be a 4K enabled camera. For best performance and maintanence the camera should be permanently mounted in the room at a distance of between 4-12 meters from the center of attention.
2.3 Management Console
The Management Console should also be permanently mounted. Reccomended placement is close to the center of attention since it is used to start and stop the broadcast as well as other management tasks performed by the host of the broadcast.
2.4 Data Input
The Data Input or secondary source connector can be used to connect the host (Presenters) computer via HDMI to NDI over ethernet to the Virtual Director server. It is also possible to connect the an external device (e.g. projector or TV) to the source connecter via HDMI in order to show the presenters computer to a local audience. To minimize issues with the HDMI to NDI Data Input converter It is recommended to have it mounted and hidden away with a single HDMI cable permanently attaced to it..
2.5 Audio System
The Audio System consist of two wireless microphones with rechargeable batteries and a charging station. The Audio System is self configuring and communicates with the Virtual Director server over ethernet. The Microsophones will automatically be switched on, when removed from the charging station. The charging station can be permanently mounted.
3.1 System Overview
Systems Overview, a detaild descriptions of the required hardware can be found below.
3.2 Hardware details
3.3 Hardware details
The Touch Screen Panale or Management Console is used to control the the LiveArena Broacast Room. This is where the host inputs the globally unique, 6 digit, PIN-code that authenticates and configures the Broadcast Room. It is also used to choose the production format, Presentation or TalkShow, and to decide the destination of the live stream i.e. Microsoft Teams/Stream, LiveArena Broadcast etc. Please note that the destination of the stream cannot be decided from the Touch Screen. The stream destionation has to be set-up separately and encapsulated in the PIN-code.
During a live broadcast the Management Console displays a low-res preview of the outgoing broadcast.
The Management Console also performes continuous self tests of the Broadcast Room equipment to make sure that the system is fully operational. If errors occur they are presented on the Management Console as well as logged to the LiveArena Broadcast administarion service.
The Management Console start screen where the PIN-code is entered to initiate the Broadcast.
5. Production Formats
LiveArena Broadcast Room features two production formats, Presentation and TalkShow. Presentation is based on the concept of one host with andditional data source consisting of PowerPoint slides, still images or pre-recorded video material. TalkShow is a dalog format with two persons infront of the camera.
The Broadcast Room computer will, during a Presentation run advanced pattern recognition to track the host (Presenter) as the person moves infront of the Camera. As the presenter switches slides the AI of the Broadcast Room will kick in and start to automatically mix between the Camera source and the Data Source. The person tracking feature mitigates the need of a camera man and makes sure to keep the presenter in center frame of the Camera source. Slide switch detection analyzes the image from the Data Source and intelligently decides which scene to present to the viewers. If there are a lot of details in the image the output will be either a side-by-side (butterfly) with the Presenter and Data Source next to each other or the Data Source in fullscreen. If on the other hand there is less details the Data Source (presentation slides etc.) that source is shown for a brief period of time and primarily cut to full screen shots of the Presenter.
5.1.1 Person tracking
The advanced pattern recognition of the Broadcast Room will evaluate the Camera image pixel-by-pixel to detect the Presenter and how the Presenter is moving. The tracking motion will seamlessly follow the Presenter as he moves infront of the Camera
5.1.2 Slide switching
Broadcast Room uses advanced algorithms and text analytics to determine when slides or graphics should be shown full-screen, and automatically navigates between the Presenters, full-screen slide view, and side-by-side shots of both the Presenter and the Data Source – always selecting the best and most relevant sources to create a polished and professional production.
The Broadcast Room computer will, during a Talkshow run advanced pattern recognition to track a host and a guest.
If the host is talking the output will be a close up of the host and vice versa as the guest starts talking. During transitions in the conversation or if both persons are talking at the same time the system will switch to a wide shot featuring both.
5.2.1 Person tracking
The advanced pattern recognition of the Broadcast Room will evaluate the Camera image pixel-by-pixel to detect where the host and guest are located and, if applicable, track them as they move. The person tracking feature mitigates the need of a camera man and makes sure to keep the host and guest in center frame of the different scenes
5.2.2 Speach detection
The AI of the Broadcast Room also uses speech detection analyzes on the audio input to intelligently decides which scene to present to the viewers, always selecting the best and most relevant output to create a polished and professional production.
6.1 Network Security
The LiveArena Broadcast Room runs on its own local network with a single point of contact to the Internet, protected by the included firewall. The local network and Internet access should preferably be set-up on a VLAN to isolate the Broadcast Room from the corporate network. The minimum requirement for the Internet connection is 5Mbps. Recommended is 10Mbps of good connectivity to the Internet in general and with low latency to the streaming service of choice in particular. The primary network traffic from the Broadcast Room is HTTP/HTTPS/RTMP over ports 80/443/1935. For RTMP distribution of video port 1936 can be utilized as an alternative to port 1935. Ports 2935 and 2936 can also be utilized for RTMPS.
All video transmission from the camera and audio transmission from the microphones in a Broadcast Room runs on the local network to the Virtual Director server. The video transmission is NDI and audio transmission is DANTE. The Virtual Director server also contains video and audio transcoding and encoding capabilities. The encoder of the Virtual Director server transmits the RTMP streams to a streaming service i.e. Microsoft Azure (Microsoft Teams/Stream) Facebook, YouTube etc.
In addition to the video streaming, the software installed on the Virtual Director server and the Touch Screen Panel will make external calls to LiveArena servers. Calls are made over HTTPS to *.livearena.com. Calls are made continuously for monitoring purposes. Monitoring calls include internet connectivity and latency (currently done towards Microsoft Azure), health and status of camera, microphones, Virtual Director and touch screen control panel. Additional calls of the Broadcast Room are:
Port 22 (SSH, for secure shell connections)
Port 1194 (openvpn, used by the other BCR machines to setup VPN connections)
Port 123 (NTP, for synchronization of clocks with internet clock sources)
Port 53 (DNS, for hostname lookups)
Port 8000 (http, used for getting VPN keys when setting up new BCR machines)
6.1.2 Internal calls
The touch s creen control panel of the Broadcast Room will load a Broadcast Room PIN UI from pingu.livearena.com. The touch screen control panel is also responsible for starting and stopping broadcasts and monitor system health by communicating with the Virtual Director server. The communication between the touch screen control panel and the Virtual Director server are HTTP calls over ports 1150 and 1151 using an internal IP address, typically 10.10.10.10. The touch screen control panel also makes call to the camera to control its positioning. By default, the camera has two positions, “Home” when a broadcast is started and “Away” when the system is idle. Additional positions can be configured.
6.2 Virtual Director Security
The Virtual Director server runs all software necessary for the Broadcast Room AI and video encoding. The operating system of the Virtual Director server is Linux, Debian (currently v.9). The Virtual Director server can be, for maintenance and monitoring purposes, accessed remotely over VPN. The VPN server is maintained by LiveArena. The VPN server is a Virtual Machine with very tight security – only the necessary ports are open, listening for VPN connections.
The Virtual Director server is always locally installed with every Broadcast Room and always placed behind the included firewall.
The only way to access the Virtual Director server from the outside world is through the LiveArena VPN server.
The Virtual Director server is not running any file services.
The Virtual Director server is not used for internet browsing or similar activities.
The outgoing connections from the Virtual Director server are either over VPN or RTMP video streaming.
HTTPS calls can also be made from the BCR client application (node)
6.2.1 Video Streaming
Video is streamed over RTMP, port 1935. Video streaming can be done via a Proxy. If a proxy is used It is important that the proxy allows high throughput of the video stream.
6.2.2 Locally stored videos
All broadcasts from a Broadcast Room are recorded on a hard drive of the Virtual Director server. This feature is intended as a back-up in case of network failure. The recordings can, if needed, be uploaded to a streaming service for on-demand consumption. Upload procedures of locally stored recordings are manual. When stored on the hard drive of the Virtual Director server the recordings are encrypted and automatically deleted after a predetermined time.
6.3 Audio Security
The LiveArena Broadcast Room (as a Service) contains a DANTE based audio system from Shure. Shure has considered the unique security needs of their customers and developed technology to safeguard content without compromising audio quality. Shure Network Audio Encryption uses AES-256 crypto technology to protect confidential content. The AES-256 encryption algorithm has been adopted as one of the safest forms of network protection by leading financial institutions, Government bodies and Health Care Services. While the AES-256 encryption standard has been widely adopted and used worldwide, Shure take security seriously and understand that you may not be able to achieve 100 per cent secure Dante audio. However, Shure Network Audio Encryption is the most secure form of transmission available.
The AES-256 encryption algorithm utilizes a user-configured passphrase on each device, similar to applying a passphrase to the Wi-Fi connections on home router products. Shure devices with mismatching passphrases will result in no audio (silence) at the listening end. Non-Shure devices will not connect to an encrypted Shure device.
7. System Management
LiveArena Broadcast Room is continuously improved and updated. All software updates to LiveArena Broadcast Room are included in the subscription fee. Updates will for the most part be possible to do remotely without local (physical) assistance. Updates that are expected to be possible to perform without downtime are not communicated in advance. Updates that are expected to result in service downtime, or when local assistance is needed, are communicated to customers via e-mail in advance of an update. New features and release notes to the Broadcast Room are communicated and presented on LiveArena HelpCenter.
7.1 Monitoring and Incident Response
A LiveArena Broadcast Room is continuously monitored for performance, availability and errors. Detailed information on service levels can be found in the Service Level Agreement provided by the re-seller.
7.2 Customer Care
A LiveArena Broadcast Room provided as a service includes user support and parts replacement for optimal availability and ease of use. If parts of the equipment in a Broadcast Room is provided by the customer, limitation on support provided by the re-seller can apply. Availability of customer care functions and lead times for parts replacement can vary. See re-seller agreement for details.