skip to main content
10.1145/1163673.1163692acmconferencesArticle/Chapter ViewAbstractPublication PagesmswimConference Proceedingsconference-collections
Article

Subjective evaluation of packet service performance in UMTS and heterogeneous networks

Published: 02 October 2006 Publication History

Abstract

Quality of Service in mobile telecommunication systems is usually identified by some basic performance metrics such as delay, throughput and jitter. However, the main impact of service quality is on the end user, and as such a detailed study of service performance should involve the end user. In this paper, such an approach is taken where subjective performance evaluation is undertaken for web browsing and video streaming services in Universal Mobile Telecommunication System (UMTS) and a heterogeneous network comprised of UMTS and Wireless LAN (WLAN)Using a real-time network emulation testbed, users rated the perceived quality of the services under different network conditions. The users' ratings are analyzed and the results showed clear trends with very few outliers. The objective and subjective measures also were found to be in line except for one case where a higher layer effect influenced the users' perception.

References

[1]
ITU-T Recommendation G.1010. End-user Multimedia QoS Categories, August 2001.
[2]
ITU-T Recommendation E.800. Terms and definitions related to quality of service and network performance including dependability, August 1994.
[3]
J. Rubin. Handbook of Usability Testing. Wiley, 1994.
[4]
J. Nielsen. Usability Enginnering. Acadamic Press, 1993.
[5]
ETSI. Human Factors (HF):Usability Evaluation for the Design of Telecommunication Systems, Services and Terminals, February 2000.
[6]
D. C. Montgomery. Design and Analysis of Experiments. John Wiley & Sons, 2000.
[7]
Harri Holma and Antti Toskala. WCDMA for UMTS, Radio Access for Third Generation Mobile Communications. John Wiley & Sons, 2004.
[8]
Oumer M. Teyeb and Malek Boussif and Troels B. Sørensen and Jeroen Wigard and Preben E. Mogensen. RESPECT: A Real-time Emulator for Service Performance Evaluation in Cellular neTworks. VTC Fall 2005, September 2005.
[9]
Choosing SureStream or Single Rate Encoding. http://service.real.com/help/library/blueprints/85codecs/htmfiles/producer2.html.
[10]
Real System Production Guide. http://www17.real.com/help/library/guides/ProductionGuide/prodguide/htmfiles/realsys.htm.
[11]
ITU-T Recommendation P.800. Methods for Subjective Determination of Transmission Quality, August 1996.

Cited By

View all

Index Terms

  1. Subjective evaluation of packet service performance in UMTS and heterogeneous networks

          Recommendations

          Comments

          Information & Contributors

          Information

          Published In

          cover image ACM Conferences
          Q2SWinet '06: Proceedings of the 2nd ACM international workshop on Quality of service & security for wireless and mobile networks
          October 2006
          146 pages
          ISBN:1595934863
          DOI:10.1145/1163673
          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Sponsors

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          Published: 02 October 2006

          Permissions

          Request permissions for this article.

          Check for updates

          Author Tags

          1. QoS
          2. UMTS
          3. heterogeneous networks
          4. network emulation
          5. usability testing

          Qualifiers

          • Article

          Conference

          MSWiM06
          Sponsor:

          Acceptance Rates

          Overall Acceptance Rate 46 of 131 submissions, 35%

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • Downloads (Last 12 months)1
          • Downloads (Last 6 weeks)0
          Reflects downloads up to 19 Feb 2025

          Other Metrics

          Citations

          Cited By

          View all
          • (2019)A network management algorithm and protocol for improving QoE in mobile IPTVComputer Communications10.1016/j.comcom.2012.06.00235:15(1855-1870)Online publication date: 5-Jan-2019
          • (2018)Addressing user expectations in mobile content deliveryMobile Information Systems10.5555/1376820.13768233:3,4(153-164)Online publication date: 16-Dec-2018
          • (2016)Measurement of Quality of Experience of Video-on-Demand Services: A SurveyIEEE Communications Surveys & Tutorials10.1109/COMST.2015.240142418:1(401-418)Online publication date: Sep-2017
          • (2015)Network management in the era of convergence: Focusing on application-based quality assessment of Internet access serviceTelecommunications Policy10.1016/j.telpol.2015.07.00539:8(705-716)Online publication date: Sep-2015
          • (2013)Quantifying the Influence of Rebuffering Interruptions on the User's Quality of Experience During Mobile Video WatchingIEEE Transactions on Broadcasting10.1109/TBC.2012.222023159:1(47-61)Online publication date: Mar-2013
          • (2009)A General Performance Evaluation Framework for Streaming Service over 3G/B3GComputer and Information Science 200910.1007/978-3-642-01209-9_15(159-168)Online publication date: 2009
          • (2008)QoE-aware QoS managementProceedings of the 6th International Conference on Advances in Mobile Computing and Multimedia10.1145/1497185.1497210(111-116)Online publication date: 24-Nov-2008

          View Options

          Login options

          View options

          PDF

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          Figures

          Tables

          Media

          Share

          Share

          Share this Publication link

          Share on social media