Mellifluous Viewport Bitrate Adaptation for 360° Videos Streaming over HTTP/2

  • Duc Thien Nguyen
  • Trieu Hai Tran
  • Nguyen Viet Hung East Asia University of Technology
DOI: https://doi.org/10.32913/mic-ict-research.v2024.n2.1251
Keywords: VR, HTTP/2, 360° video, QoE, Viewport Adaptive Streaming

Abstract

Virtual reality provides an immersive experience
for users. There has recently been much research on adaptive
methods of playing 360° video over HTTP/2 to excite
users. This paper analyzes users’ behaviors and perceptions
when watching 360° online videos. We also provide some
measurements and evaluation of the main features of 360°
video streaming. Experiments show that our method improves
bitrate by up to 45.8% and buffer size counter-up to 25.0%
compared to referenced methods.

Author Biographies

Duc Thien Nguyen

Received the B.Sc.degree in Informatics of Vietnam Na-tional University, Hanoi, in 2005, the M.Sc.degree Master of Data transmission andcomputer network of Pots and Telecommu-nications Institute of Technology, Vietnam,in 2011.He is a lecturer in the Faculty of Informa-tion Technology at the East Asia University of Technology, TrinhVan Bo Street, Nam Tu Liem District, Hanoi, Vietnam. His research interests include multimedia communications, net-work security, artificial intelligence, and applications

Trieu Hai Tran

TRAN TRIEU HAI received aB.Sc.degree in Bachelor of InformationTechnology, Faculty of InformationTechnology, Hanoi National University, Vietnam, in 2004 and an M.Sc. degreefrom Master of Information Managementin Information Management, Shu-teUniversity, Taiwan, in 2013. He is also an IT Lecturer at the Faculty of General Education- at Hanoi Open University, Nguyen Hien Street, Hai Ba Trung District, Hanoi, Vietnam. His research interests include Network Security, ArtificialIntelligence, Natural Language Processing, and applications

Nguyen Viet Hung, East Asia University of Technology

NGUYEN VIET HUNG received a B.Sc.degree in Bachelor of Informatics pedagogy from the Faculty of Engineering Technology of Ha Tinh University, Vietnam, in 2012, the M.Sc. degree Master of Information Technology from the Faculty of Information Technology of Ho Chi Minh City University of Technology, Vietnam, in 2016, and has been learning the Ph.D. degree in Telecommunications Engineering from the Hanoi University of Science and Technology, Vietnam. He is also a lecturer in the Faculty of Information Technology at the East Asia University of Technology, Trinh Van Bo Street, Nam Tu Liem District, Hanoi, Vietnam. His research interests include multimedia communications, network security, artificial intelligence, QoE/QoS guarantee for network services, Virtual Reality, Natural Language Processing, Data Mining, and applications.

References

T. Stockhammer. MPEG Immersive Media. Accessed: 2023-12-27. [Online]. Available: https://www.itu.int/en/ITU-T/studygroups/2017-2020/16/Documents/ws/201701ILE/S2P2-1701-01-19-

MPEG-Immersive-Media-Thomas-Stockhammer.pdf

V. H. Nguyen, N. N. Pham, C. T. Truong, D. T. Bui, H. T. Nguyen, and T. H. Truong, “Retina-based quality

assessment of tile-coded 360-degree videos,” EAI Endorsed Transactions on Industrial Networks and Intelligent Systems, vol. 9, no. 32, 2022.

Huewei. (2017) Virtual reality/augmented reality white paper. [Online]. Available: http://www-file.huawei.com/-

/media/CORPORATE/PDF/ilab/vr-ar-en.pdf

H. Nguyen, T. N. Dao, N. S. Pham, T. L. Dang, T. D. Nguyen, and T. H. Truong, “An accurate viewport estimation

method for 360 video streaming using deep learning,” EAI Endorsed Transactions on Industrial Networks and Intelligent Systems, vol. 9, no. 4, pp. e2–e2, 2022.

C. Ozcinar, A. De Abreu, and A. Smolic, “Viewport-aware adaptive 360° video streaming using tiles for virtual reality,” in 2017 IEEE International Conference on Image Processing (ICIP), Beijing, China, Sep. 2017, pp. 2174–2178.

D. Nguyen, N. V. Hung, N. T. Phong, T. T. Huong, and T. C. Thang, “Scalable multicast for live 360-degree video

streaming over mobile networks,” IEEE Access, vol. 10, pp. 38 802–38 812, 2022.

N. V. Hung, P. H. Thinh, N. H. Thanh, T. T. Lam, T. T. Hien, V. T. Ninh, and T. T. Huong, “Lvsum-optimized live 360

degree video streaming in unicast and multicast over mobile networks,” in 2023 IEEE 15th International Conference on Computational Intelligence and Communication Networks (CICN), 2023, pp. 29–34.

W. L. S. Ramos, M. M. Silva, E. R. Araujo, A. C. Neves, and E. R. Nascimento, “Personalizing fast-forward videos based on visual and textual features from social network,” in 2020 IEEE Winter Conference on Applications of Computer Vision (WACV), 2020, pp. 3260–3269.

T. C. Thang, H. T. Le, A. T. Pham, and Y. M. Ro, “An evaluation of bitrate adaptation methods for HTTP live streaming,” IEEE Journal on Selected Areas in Communications, vol. 32, no. 4, pp. 693–705, 2014.

H. T. T. Tran, N. P. Ngoc, A. T. Pham, and T. C. Thang, “A Multi-Factor QoE Model for Adaptive Streaming over

Mobile Networks,” in 2016 IEEE Globecom Workshops (GC Wkshps), Dec 2016, pp. 1–6.

D. V. Nguyen and H. T. T. Tran and T. C. Thang, “Impact of delays on 360-degree video communications,” in 2017 TRON Symposium (TRONSHOW), 12 2017, pp. 1–6.

F. Muheidat, K. Dajani, and L. A. Tawalbeh, “Security concerns for 5g/6g mobile network technology and quantum communication,” Procedia Computer Science, vol. 203, pp. 32–40, 2022, 17th International Conference on Future Networks and Communications / 19th International Conference on Mobile Systems and Pervasive Computing / 12th International Conference on Sustainable Energy Information Technology (FNC/MobiSPC/SEIT 2022), August 9-11, 2022, Niagara Falls, Ontario, Canada. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S18 77050922006123

X. Chen, D. Wu, and I. Ahmad, “Optimized viewportadaptive 360-degree video streaming,” CAAI Transactions on Intelligence Technology, vol. 6, no. 3, pp. 347–359, 2021.

S. Lederer, C. M¨uller, and C. Timmerer, “Dynamic adaptive streaming over http dataset,” in Proceedings of the 3rd multimedia systems conference, 2012, pp. 89–94.

J. Kua, G. Armitage, and P. Branch, “A survey of rate adaptation techniques for dynamic adaptive streaming over http,” IEEE Communications Surveys & Tutorials, vol. 19, no. 3, pp. 1842–1866, 2017.

H. Wu, X. Li, G. Wang, G. Cheng, and X. Hu, “Resolution identification of encrypted video streaming based on

http/2 features,” ACM Trans. Multimedia Comput. Commun. Appl., vol. 19, no. 2, feb 2023. [Online]. Available:

https://doi.org/10.1145/3551891

V. H. Nguyen, D. T. Bui, T. L. Tran, C. T. Truong, and T. H. Truong, “Scalable and resilient 360-degree-video adaptive streaming over http/2 against sudden network drops,” Computer Communications, vol. 216, pp. 1–15, 2024. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S014036642400001X

M. Mahmoud, S. Rizou, A. S. Panayides, N. V. Kantartzis, G. K. Karagiannidis, P. I. Lazaridis, and Z. D. Zaharis, “A survey on optimizing mobile delivery of 360° videos: Edge caching and multicasting,” IEEE Access, 2023.

A. Kumar, S. Banerjea, and M. Pandey, “Churn-tolerant cdn at the edge for adaptive video streaming: towards multiconnection approach using http/2,” International Journal of Information Technology, vol. 15, no. 7, pp. 3491–3497, 2023.

M. Nguyen, H. Amirpour, F. Tashtarian, C. Timmerer, and H. Hellwagner, “Performance analysis of h2br: Http/2-based segment upgrading to improve the qoe in has,” Multimedia Tools and Applications, pp. 1–35, 2023.

N. V. Hung, T. D. Chien, N. P. Ngoc, and T. H. Truong, “Flexible http-based video adaptive streaming for good qoe during sudden bandwidth drops,” EAI Endorsed Transactions on Industrial Networks and Intelligent Systems, vol. 10, no. 2, pp. e3–e3, 2023.

X. Corbillon, F. De Simone, and G. Simon, “360-degree video head movement dataset,” in Proceedings of the 8th ACM on Multimedia Systems Conference, ser. MMSys’17. Taipei, Taiwan: Association for Computing Machinery, 2017, p. 199–204.

JVET, “360lib,” https://jvet.hhi.fraunhofer.de/, October 2016. [Online]. Available: https://jvet.hhi.fraunhofer.de/

J. M. Boyce, Y. Ye, J. Chen, and A. K. Ramasubramonian, “Overview of shvc: Scalable extensions of the high

efficiency video coding standard,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 26, no. 1,

pp. 20–34, 2015.

H. L. D. Huong, D. V. Nguyen, T. T. Huong, P. N. Nam, and T. C. Thang, “Smooth viewport bitrate adaptation for 360 video streaming,” in 2019 6th NAFOSTED Conference on Information and Computer Science (NICS). IEEE, 2019, pp. 512–517.

Published
2024-09-15
Issue
Vol 2024 No 2: Journal on Information Technologies & Communications
Section
Regular Articles