Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Synchronous Remote Rendering for VR
Blekinge Institute of Technology, Faculty of Computing, Department of Computer Science.ORCID iD: 0000-0002-0536-7165
Blekinge Institute of Technology, Faculty of Computing, Department of Technology and Aesthetics.ORCID iD: 0000-0001-8929-4911
Ericsson Research, SWE.
2021 (English)In: International Journal of Computer Games Technology, ISSN 1687-7047, E-ISSN 1687-7055, Vol. 2021, article id 6676644Article in journal (Refereed) Published
Abstract [en]

Remote rendering for VR is a technology that enables high-quality VR on low-powered devices. This is realized by offloading heavy computation and rendering to high-powered servers that stream VR as video to the clients. This article focuses on one specific issue in remote rendering when imperfect frame timing between client and server may cause recurring frame drops. We propose a system design that executes synchronously and eliminates the aforementioned problem. The design is presented, and an implementation is tested using various networks and hardware. The design cannot drop frames due to synchronization issues but may on the other hand stall if temporal disturbances occur, e.g., due to network delay spikes or loss. However, experiments confirm that such events can remain rare given an appropriate environment. For example, remote rendering on an intranet at 90 fps with a server located approximately 50 km away yielded just 0.002% stalled frames while rendering with extra latency corresponding to the duration of exactly one frame (11.1 ms at 90 fps). In a LAN without extra latency setting, i.e., with latency equal to locally rendered VR, 0.009% stalls were observed while using a wired Ethernet connection and 0.058% stalls when using 5 GHz wireless IEEE 802.11 ac. © 2021 Viktor Kelkkanen et al.

Place, publisher, year, edition, pages
Hindawi Limited , 2021. Vol. 2021, article id 6676644
Keywords [en]
Drops, IEEE Standards, Ethernet connections, High quality, IEEE 802.11s, Imperfect frames, Low-powered devices, Network delays, Remote rendering, Rendering (computer graphics)
National Category
Computer Sciences Communication Systems
Identifiers
URN: urn:nbn:se:bth-22021DOI: 10.1155/2021/6676644ISI: 000680193300001Scopus ID: 2-s2.0-85112052314OAI: oai:DiVA.org:bth-22021DiVA, id: diva2:1586436
Note

open access

Available from: 2021-08-20 Created: 2021-08-20 Last updated: 2023-03-21Bibliographically approved
In thesis
1. Evaluation and Reduction of Temporal Issues in Remote VR
Open this publication in new window or tab >>Evaluation and Reduction of Temporal Issues in Remote VR
2023 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

The aim of this thesis is to study and advance knowledge and technologies surrounding remote rendering of Virtual Reality (VR). In particular regarding temporal aspects such as latency and video stalling events. In remote rendering, rendered content is commonly streamed as video images in network packets from a server to a client. The main purpose is to be able to utilize the processing power available in stationary machines on thin clients that are otherwise limited by weight and size due to their mobility requirements. Achieving this process in real-time with excellent quality is not trivial in interactive VR due to the requirements on low latency and high visual fidelity. The dissertation brings to light the main challenges of the field as well as a set of new proposals and knowledge on the topic. 

As an introduction to the field, the dissertation begins with a study on 360-video streaming, which is a form of VR but less interactive. Moving on into real-time remote rendering, a commercial wireless VR adapter is studied and a method for monitoring its data traffic is proposed and implemented. The monitoring is able to provide a baseline in terms of video stalling events in a commercial remote-VR product. Moving on, a prototype remote renderer for VR is implemented using a proposed architecture, it is furthermore tested in various network conditions to determine under which conditions such remote rendering may be viable. Having constructed the remote renderer, a study is conducted that shows the effect of headset movements on the resulting video bitrate requirements in remote VR. Furthermore, a method that can reduce the codec image size in remote VR is proposed and its viability is tested with the prototype. Finally, two works are reported, in which human participants are involved, one for studying the subjective effects of video stalls in VR and one for studying the objective effects of hand-controller latency on aiming accuracy in VR.

Place, publisher, year, edition, pages
Karlskrona: Blekinge Tekniska Högskola, 2023. p. 191
Series
Blekinge Institute of Technology Doctoral Dissertation Series, ISSN 1653-2090 ; 4
Keywords
Remote Rendering VR Network
National Category
Computer Sciences
Research subject
Computer Science
Identifiers
urn:nbn:se:bth-24388 (URN)978-91-7295-453-3 (ISBN)
Public defence
2023-05-08, J1630, Valhallavägen 1, Karlskrona, 09:15 (English)
Opponent
Supervisors
Funder
Knowledge Foundation, 20170056
Available from: 2023-03-21 Created: 2023-03-21 Last updated: 2023-04-18Bibliographically approved

Open Access in DiVA

fulltext(2685 kB)659 downloads
File information
File name FULLTEXT01.pdfFile size 2685 kBChecksum SHA-512
b73621ba1f11b8db2e057552b5eeac1d2398e4f179ff21fd9a392b52af091302778aadc72a1481ab272f57f7344f690ffb8f6e080d031b060af9e73b1de34382
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Kelkkanen, ViktorFiedler, Markus

Search in DiVA

By author/editor
Kelkkanen, ViktorFiedler, Markus
By organisation
Department of Computer ScienceDepartment of Technology and Aesthetics
In the same journal
International Journal of Computer Games Technology
Computer SciencesCommunication Systems

Search outside of DiVA

GoogleGoogle Scholar
Total: 660 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 294 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf