Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
A Holistic View of QoE for Multimedia Streaming
Blekinge Institute of Technology, Faculty of Computing, Department of Technology and Aesthetics.ORCID iD: 0009-0004-2874-0403
2023 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

Internet access has evolved in the last decade with the availability of smart handheld devices and high bandwidth offered by mobile networks at reduced costs. Multimedia traffic primarily video became the main share of global Internet traffic due to the popularity of multimedia supported social applications, online gaming, and IPTV. Thus, the success of any network based business model is dependent on service quality and Quality of Experience (QoE) is widely accepted as a means to describe user satisfaction with a service. QoE can be influenced by numerous factors ranging from content liking to system and context-related artifacts.

In this thesis, a holistic approach is adopted to evaluate the QoE of an end-user regarding video quality based on system, contextual and human factors. At the system level, an impact of the Maximum Transmission Unit (MTU), and the comparison of widely used video codecs in error-prone networks is investigated by using diverse streaming protocols on an emulated network. It is found that the myth of using small MTU for better performance in high-loss scenarios comes at a cost of increased latency at the intermediate nodes and doesn’t provide any gain in video quality. The performance of the Google royalty-free VP8 codec was also shown to be on par with the widely adopted and proprietary H.264, especially in scenarios involving high jitter. At a human level, user delight towards the shown stimulus, his or her mood along with the frequency of watching online content (contextual), and their impact on quality ratings are investigated. It is found that human-related personality traits tend to influence subjective ratings and highlight the requirement of more cohesive QoE models to estimate user perception.

Place, publisher, year, edition, pages
Karlshamn: Blekinge Tekniska Högskola, 2023. , p. 120
Series
Blekinge Institute of Technology Licentiate Dissertation Series, ISSN 1650-2140 ; 4
Keywords [en]
QoE metrics; Video quality assessments; AVC performance; mobile codecs efficiency; QoE IFs
National Category
Communication Systems
Research subject
Telecommunication Systems
Identifiers
URN: urn:nbn:se:bth-24393ISBN: 978-91-7295-454-0 (print)OAI: oai:DiVA.org:bth-24393DiVA, id: diva2:1746255
Presentation
2023-05-15, Ateljén, Campus Karlshamn, Karlshamn, 10:15 (English)
Opponent
Supervisors
Available from: 2023-03-30 Created: 2023-03-27 Last updated: 2025-09-30Bibliographically approved
List of papers
1. Optimal MTU for Realtime Video Broadcast with Packet Loss - A QoE Perspective
Open this publication in new window or tab >>Optimal MTU for Realtime Video Broadcast with Packet Loss - A QoE Perspective
2014 (English)In: 2014 9TH INTERNATIONAL CONFERENCE FOR INTERNET TECHNOLOGY AND SECURED TRANSACTIONS (ICITST), IEEE , 2014, p. 396-401Conference paper, Published paper (Refereed)
Abstract [en]

Multimedia applications have become the prime source of Internet traffic in recent years due to high bandwidth offered by almost all access mechanisms. This highlights the need of intense research efforts to improve the already demanding user perception levels for high-performance video delivery networks. Quality of Experience (QoE) based metrics are often used to quantify user satisfaction levels regarding an application or service. In this paper, we have analyzed the impact of variable frame sizes at link layer with different packet loss scenarios to evaluate the performance degradation of H.264 based live video streams from the end user perspective using subjective tests. We have focused on both subjective and objective quantitative measures to analyze the myth that smaller packets provide better quality in error-prone networks. We found that this assumption may not be true for some cases with a considerable packet loss ratio. Moreover, we observed that full-reference video assessment software like PEVQ predicts QoE to an acceptable extent, which allows cutting cost and effort coming with subjective evaluations. Keywords-Quality of Experience, Multimedia communication, Streaming media

Place, publisher, year, edition, pages
IEEE, 2014
Series
International Conference for Internet Technology and Secured Transactions, ISSN 2164-7046
National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
urn:nbn:se:bth-14580 (URN)000380428300061 ()978-1-908320-39-1 (ISBN)
Conference
International Conference for Internet Technology and Secured Transactions*, DEC 08-10, 2014, London, ENGLAND
Available from: 2017-06-19 Created: 2017-06-19 Last updated: 2025-09-30Bibliographically approved
2. QoE based comparison of H.264/AVC and WebM/VP8 in an error-prone wireless network
Open this publication in new window or tab >>QoE based comparison of H.264/AVC and WebM/VP8 in an error-prone wireless network
2017 (English)In: Proceedings of the IM 2017 - 2017 IFIP/IEEE International Symposium on Integrated Network and Service Management / [ed] Chemouil P.,Simoes P.,Madeira E.,Secci S.,Monteiro E.,Gaspary L.P.,dos Santos C.R.P.,Charalambides M., Institute of Electrical and Electronics Engineers (IEEE), 2017, p. 1005-1010Conference paper, Published paper (Refereed)
Abstract [en]

Quality of Experience (QoE) management is a prime topic of research community nowadays as video streaming, online gaming and security applications are completely reliant on the network service quality. Moreover, there are no standard models to map Quality of Service (QoS) into QoE. HTTP media streaming is primarily used for such applications due to its coherence with the Internet and simplified management. The most common video codecs used for video streaming are H.264/AVC and Google's VP8. In this paper, we have analyzed the performance of these two codecs from the perspective of QoE. The most common end-user medium for accessing video content is via home based wireless networks. We have emulated an error-prone wireless network with different scenarios involving packet loss, packet delay and delay variation. The focus of this paper is evaluating the end user satisfaction with the multimedia content by subjective assessment using Mean Opinion Score (MOS). We have observed the overall superiority of H.264/AVC but the VP8 codec strongly gains ground in highly error-prone networks in terms of user satisfaction. © 2017 IFIP.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2017
Keywords
H.264/AVC, Multimedia communication, QoE management, Quality of Experience, WebM(VP8), Errors, HTTP, Human computer interaction, Media streaming, Motion Picture Experts Group standards, Multimedia systems, Packet networks, Video signal processing, Video streaming, Wireless networks, Multi-media communications, Qoe managements, Quality of experience (QoE), Quality of service
National Category
Communication Systems
Identifiers
urn:nbn:se:bth-15217 (URN)10.23919/INM.2017.7987426 (DOI)2-s2.0-85029430735 (Scopus ID)9783901882890 (ISBN)
Conference
15th IFIP/IEEE International Symposium on Integrated Network and Service Management, IM 2017, Lisbon
Available from: 2017-09-29 Created: 2017-09-29 Last updated: 2025-09-30Bibliographically approved
3. The Effects of Additional Factors on Subjective Quality Assessments
Open this publication in new window or tab >>The Effects of Additional Factors on Subjective Quality Assessments
2019 (English)In: 2nd International Conference on Advancements in Computational Sciences, ICACS 2019, Institute of Electrical and Electronics Engineers Inc. , 2019, p. 120-124, article id 8689138Conference paper, Published paper (Refereed)
Abstract [en]

In Quality of Experience, the users' degrees of delight or annoyance are quantized by direct human interaction via subjective quality assessments. There are many factors that may influence the users' responses, and standards have been laid down to strictly control the monitoring conditions. In this paper, we analyze limitations of Mean Opinion Score (MOS) assessment to portray the influence of additional factors on user behavior while assessing multimedia content. We show that the frequency of watching online video content as well as the user delight with the content play a significant role in her final feedback. Our study emphasizes the need to use additional metrics along with MOS for content ratings to obtain a more accurate measure of the user experience. © 2019 The University of Lahore.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers Inc., 2019
Keywords
Multimedia communication, Quality of Experience, User Perception, Multimedia systems, Quality of service, Content ratings, Human interactions, Mean opinion scores, Multi-media communications, Multimedia contents, Quality of experience (QoE), Subjective quality assessments, User perceptions, Behavioral research
National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
urn:nbn:se:bth-17906 (URN)10.23919/ICACS.2019.8689138 (DOI)000470736000018 ()2-s2.0-85065105387 (Scopus ID)9789699721014 (ISBN)
Conference
2nd International Conference on Advancements in Computational Sciences, ICACS, Lahore, 18 February 2019 through 20 February 2019
Available from: 2019-05-21 Created: 2019-05-21 Last updated: 2025-09-30Bibliographically approved
4. Impact of Human and Content Factors on Quality of Experience of Online Video Streaming
Open this publication in new window or tab >>Impact of Human and Content Factors on Quality of Experience of Online Video Streaming
2020 (English)In: PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON E-BUSINESS AND TELECOMMUNICATIONS - DCNET, OPTICS, SIGMAP AND WINSYS (ICETE), VOL 2 / [ed] Callegari, C Ng, SX Sarigiannidis, P Battiato, S DeLeon, ASS Ksentini, A Lorenz, P Obaidat, M BenOthman, J, SCITEPRESS , 2020, p. 59-66Conference paper, Published paper (Refereed)
Abstract [en]

Although expensive, but the most reliable measure of user perception is by direct human interaction by taking input from the user about a stimulus quality. In our previous studies, we have identified some subjects getting bored and losing focus by rating lots of video clips of small duration during subjective quality assessments. Moreover, the psychological effects, i.e. user delight, frequency of watching online videos (experience), mood, etc. must not influence the user Mean Opinion Score (MOS) for determining the quality of the shown stimuli. In this paper, we have investigated the impact of user delight, frequency of watching online video content (experience) and different mood levels on MOS for streamed video stimuli in various network conditions by subjective quality assessments. We have observed a slight tendency of better scores when the user likes the stimulus. However, our results show that if the subjective assessments are conducted by carefully following the guidelines, the users impartially rate the video stimuli solely based on the quality artifacts irrespective of their delight towards the shown content. Although, we have observed an effect of user mood on MOS ratings; for almost all the stimuli, but the results suggest the need of more detailed study; i.e. with a large and diverse set of subjects, to obtain significant statistical relevance.

Place, publisher, year, edition, pages
SCITEPRESS, 2020
Keywords
Quality of Experience, Mean Opinion Score, User Perception, Multimedia Communication
National Category
Telecommunications Communication Systems
Identifiers
urn:nbn:se:bth-21156 (URN)10.5220/0009831400590066 (DOI)000615962300005 ()2-s2.0-85108460067 (Scopus ID)9789897584459 (ISBN)
Conference
17th International Joint Conference on E-Business and Telecommunications (SECRYPT), Lieusant, Paris on 8-10 July
Note

open access

Available from: 2021-03-04 Created: 2021-03-04 Last updated: 2025-09-30Bibliographically approved
5. Influence of Gender and Viewing Frequency on Quality of Experience
Open this publication in new window or tab >>Influence of Gender and Viewing Frequency on Quality of Experience
2020 (English)In: 12th International Conference on Quality of Multimedia Experience, QoMEX 2020, IEEE, 2020, article id 9123106Conference paper, Published paper (Refereed)
Abstract [en]

Some of the most important aspects for content creators and service providers are the content appeal and the time consumed by the end users on a particular application or service. Gender and age can influence the Quality of Experience (QoE) ratings of multimedia based on the nature of the shown content, yet few studies have quantized this notion. In this paper, we zoom in on the influence of gender on user ratings in a video QoE study (N=89) with packet loss as the main system influence factor. We have analyzed the impact of gender on QoE subjective ratings both as a standalone influence factor and in coherence of temporal traits like the frequency of watching online content. We have observed significant trends to highlight the importance of systematically checking and reporting on the impact of basic human factors, such as gender in relation to quality perception with respect to different types of content. © 2020 IEEE.

Place, publisher, year, edition, pages
IEEE, 2020
Series
International Workshop on Quality of Multimedia Experience (QoMEX), ISSN 2372-7179, E-ISSN 2472-7814
Keywords
Human Factors, Machine Learning, QoE, User Diversity, Multimedia systems, Content creators, End users, On-line contents, Quality of experience (QoE), Quality perceptions, Service provider, Subjective rating, User rating, Quality of service
National Category
Computer Sciences Telecommunications
Identifiers
urn:nbn:se:bth-20275 (URN)10.1109/QoMEX48832.2020.9123106 (DOI)000619223500033 ()2-s2.0-85087721388 (Scopus ID)9781728159652 (ISBN)
Conference
12th International Conference on Quality of Multimedia Experience, QoMEX 2020, Athlone, Ireland, 26 May 2020 through 28 May 2020
Available from: 2020-08-11 Created: 2020-08-11 Last updated: 2025-09-30Bibliographically approved

Open Access in DiVA

fulltext(2519 kB)291 downloads
File information
File name FULLTEXT01.pdfFile size 2519 kBChecksum SHA-512
a319f27efb1552265bc58e1924b804644ab34b310f727491485873d95922f8fbd7619aa05e15758ec9ca6f3707694ccc05da10cd46a049011b822a25fb67ea68
Type fulltextMimetype application/pdf

Authority records

Nawaz, Omer

Search in DiVA

By author/editor
Nawaz, Omer
By organisation
Department of Technology and Aesthetics
Communication Systems

Search outside of DiVA

GoogleGoogle Scholar
Total: 300 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 1025 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf