VRProj: Delivering 360-degree Video With Viewport-Adaptive Truncation

Authors: Tian Qiu, Ish Kumar Jain, Raini Wu, Dinesh Bharadia, Pamela Cosman

[Paper]

Abstract

Delivering Virtual Reality (VR) content wirelessly involves projecting a 360-video into a 2D format and then encoding it to satisfy the wireless bitrate requirements. However, the popular equirectangular and cubemap projections offer little flexibility to adapt to changing bitrates and headset motion. In this work, we show that the truncated square pyramid projection offers high flexibility for network and headset motion adaptation. We adapt by tuning a truncation parameter that controls the video quality for different spatial regions in the 360-video. Depending on the video, our scheme improves average video quality by up to 1.1dB in PSNR and up to 4.6 in VMAF score compared to a non-adaptive baseline.

Other relevant papers

• mmFlexible: Flexible Directional Frequency Multiplexing for Multi-user mmWave Networks.” Infocom 2023.
• mmSpoof: Resilient Spoofing of Automotive Millimeter-wave Radars using Reflect Array. In 2023 IEEE Symposium on Security and Privacy (SP), pp. 1971-1985. IEEE Computer Society, 2022.
• mmReliable: Two beamsare better than one: Towards Reliable and High Throughput mmWave Links. In ACM SIGCOMM 2021 Conference (SIGCOMM ’21), August 23–27, 2021 https://doi.org/10.1145/3452296.3472924