SVI360: Spherical Video Interpolation

This paper addresses the problem of omnidirectional videointerpolation, which plays an essential role in applications such as vir-tual reality and immersive video enhancement. Existing video interpo-lation methods are not well-suited for spherical videos, as they havedifficulty handling severe distortions close to the poles. To address thisissue, we propose SVI360, a dual-branch framework that combines theimage frame and its rotated orthogonal view to deal with these dis-tortions. The core methodological aspect of the approach is to rein-force equivariance of the flow displacements between the original andorthogonal views to improve intermediate frame prediction. Experimentsshow that our method outperforms state-of-the-art approaches in inter-polation quality while maintaining accurate optical flow in four differ-ent public benchmarks. Code and pre-trained models are available at:https://icb-vision-ai.github.io/video360_interpolation/