On the Opinion Score Consistency in Repeated 360° Video Quality Assessment for Standing and Seated Viewing on Head-Mounted Displays
2021 (English)In: 2021 15th International Conference on Signal Processing and Communication Systems, ICSPCS 2021 - Proceedings / [ed] Wysocki T.A., Wysocki B.J., Institute of Electrical and Electronics Engineers Inc. , 2021Conference paper, Published paper (Refereed)
Abstract [en]
The development of immersive media systems and services relies on subjective tests that provide ground truth on the quality of experience as perceived by humans. In this paper, we investigate the opinion score consistency through a repeated subjective 360° video quality assessment experiment. The test stimuli are presented on a head-mounted display with participants given the task to rate the video quality in three repeated sessions for both standing and seated viewing. The statistical analysis of the data from the subjective tests aims at revealing if participants change their rating behavior over time or keep their opinion scores given to the test stimuli in standing and seated viewing consistent in a statistical sense. The experimental results are reported in terms of histograms of opinion scores, skewness and kurtosis of opinion scores, mean opinion scores, standard deviation of opinion scores (SOS), SOS fitting functions, and analysis of variance tests. The statistical analysis supports the conjecture that each participant has its own but consistent rating behavior throughout the respective sessions for standing and seated viewing. The finding that the quality rating behavior of the individual participant does not fundamentally change over time may, e.g., assist in scheduling subjective tests under pandemic conditions where experimental campaigns may need to be stalled for an unknown period of time. © 2021 IEEE.
Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers Inc. , 2021.
Keywords [en]
360° videos, head-mounted display, mean opinion score, seated viewing, standing viewing, subjective tests, Helmet mounted displays, Quality of service, Systems engineering, 360° video, Head-mounted-displays, Immersive media, Mean opinion scores, Media systems, Quality assessment, Subjective test, Video quality, Higher order statistics
National Category
Telecommunications
Identifiers
URN: urn:nbn:se:bth-22674DOI: 10.1109/ICSPCS53099.2021.9660331ISI: 000802223300039Scopus ID: 2-s2.0-85124628339ISBN: 9781665436991 OAI: oai:DiVA.org:bth-22674DiVA, id: diva2:1640700
Conference
15th International Conference on Signal Processing and Communication Systems, ICSPCS 2021, Virtual, Online, 13 December 2021 through 15 December 2021
Part of project
VIATECH- Human-Centered Computing for Novel Visual and Interactive Applications, Knowledge Foundation
Funder
Knowledge Foundation, 20170056
Note
open access
2022-02-252022-02-252022-07-01Bibliographically approved