A large portion of today's network traffic consists of streamed video of large variety, such as films, television shows, live-streamed games and recently omnidirectional videos. A common way of delivering video is by using Dynamic Adaptive Streaming over HTTP (DASH), or recently with encrypted HTTPS. Encrypted video streams disable the use of Quality of Service (QoS) systems that rely on knowledge of application-dependent data, such as video resolution and bit-rate. This could make it difficult for a party providing bandwidth to efficiently allocate resources and estimate customer satisfaction. An application-independent way of measuring video stream quality could be of interest for such a party. In this paper, we investigate encrypted streaming of omni-directional video via YouTube to a smartphone in a Google Cardboard VR-headset. We monitored such sessions, delivered via both WiFi and mobile networks, at different times of day, implying different levels of congestion, and characterised the network traffic by using the Coefficient of Throughput Variation (CoTV) as statistic. We observe that this statistic shows to be able to indicate whether a stream is stable or unstable, in terms of potential video playback freezes, when the DASH delivery strategy is used.

Virtual Reality (VR) is becoming increasingly popular, and wireless cable replacements unleash the user of VR Head Mounted Displays (HMD) from the rendering desktop computer. However, the price to pay for additional freedom of movement is a higher sensitivity of the wireless solution to temporal disturbances of both video frame and input traffic delivery, as compared to its wired counterpart. This paper reports on the development of a test-bed to be used for studying temporal delivery issues of both video frames and input traffic in a wireless VR environment, here using TPCAST with a HTC Vive headset. We provide a solution for monitoring and recording of traces of (1) video frame freezes as observed on the wireless VR headset, and (2) input traffic from the headset and hand controls to the rendering computer. So far, the test-bed illustrates the resilience of the underlying WirelesslID technology and TCP connections that carry the input traffic, and will be used in future studies of Quality of Experience (QoE) in wireless desktop VR.

This paper shows the impact of bitrate settings on objective quality measures when streaming non-panoramic remote-rendered Virtual Reality (VR) images. Non-panoramic here refers to the images that are rendered and sent across the network, they only cover the viewport of each eye, respectively.

To determine the required bitrate of remote rendering for VR, we use a server that renders a 3D-scene, encodes the resulting images using the NVENC H.264 codec and transmits them to the client across a network. The client decodes the images and displays them in the VR headset. Objective full-reference quality measures are taken by comparing the image before encoding on the server to the same image after it has been decoded on the client. By altering the average bitrate setting of the encoder, we obtain objective quality scores as functions of bitrates. Furthermore, we study the impact of headset rotation speeds, since this will also have a large effect on image quality.

We determine an upper and lower bitrate limit based on headset rotation speeds. The lower limit is based on a speed close to the average human peak head-movement speed, 360°s. The upper limit is based on maximal peaks of 1080°s. Depending on the expected rotation speeds of the specific application, we determine that a total of 20--38Mbps should be used at resolution 2160×1200@90,fps, and 22--42Mbps at 2560×1440@60,fps. The recommendations are given with the assumption that the image is split in two and streamed in parallel, since this is how the tested prototype operates.

Rendering VR-content generally requires large image resolutions. This is both due to the display being positioned close to the eyes of the user and to the super-sampling typically used in VR. Due to the requirements of low latency and large resolutions in VR, remote rendering can be difficult to support at sufficient speeds in this medium.In this paper, we propose a method that can reduce the required resolution of non-panoramic VR images from a codec perspective. Because VR images are viewed close-up from within a headset with specific lenses, there are regions of the images that will remain unseen by the user. This unseen area is referred to as the Hidden-Area Mesh (HAM) and makes up 19% of the screen on the HTC Vive VR headset as one example. By remapping the image in a specific manner, we can cut out the HAM, reduce the resolution by the size of the mesh and thus reduce the amount of data that needs to be processed by encoder and decoder. Results from a prototype remote renderer show that by using the proposed Hidden-Area Mesh Remapping (HAMR), an implementation-dependent speed-up of 10-13% in encoding, 17-18% in decoding and 7-11% in total can be achieved while the negative impact on objective image quality in terms of SSIM and VMAF remains small. © 2021 IEEE.