Turning 4D Gaussian Splats into Video Streams

Fraunhofer Heinrich Hertz Institute, HHI

Mobile World Congress 2026 Demo

📍 Barcelona, Spain
📅 March 02-05

Interactive 4D Gaussian Splatting streams at real-time frame rates.

Efficient Compression on Today's Video Hardware

Real-time Hardware Decoding Pipeline

  • Fraunhofer HHI demonstrates a Video-codec-based (H.264/AVC or H.265/HEVC) compression for Dynamic 3D Gaussian Splats, achieving high compression rates and real-time decompression.
  • We demonstrate our framework using a diverse set of MPEG dynamic sequences. Our method enables complex dynamic scenes compliant with HEVC Level 5.0 (4K) hardware decoders.
  • Overview Diagram

    Overview Diagram

    Overview pipeline of the proposed 3DGS compression method involving Tri-Planes optimization and video encoding.

    JVET 4DGS Showcase

    We are currently contributing this technology to the ongoing Gaussian splatting compression (GSC) work in JVET. Our 4DGS showcase demonstrates real-time decoding of dynamic Gaussian splats using video-based implicit representations and standard video decoding hardware, bringing the proposed representation into a practical playback pipeline.

    For more details, see JVET-AP0220 (MPEG m76452).

    BibTeX

    @InProceedings{Lee_2025_ICCV,
        author    = {Lee, Soonbin and Shu, Fangwen and Sanchez, Yago and Schierl, Thomas and Hellge, Cornelius},
        title     = {Compression of 3D Gaussian Splatting with Optimized Feature Planes and Standard Video Codecs},
        booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
        month     = {October},
        year      = {2025},
        pages     = {25496-25505}
    }
    
    @inproceedings{Lee_2026_DCC,
        author = {Lee, Soonbin and Sasse, Simon and Sanchez de la Fuente, Yago and Skupin, Robert and Borges, Tomas M. and Hellge, Cornelius and Schierl, Thomas},
        title = {CodecGS-IR: Implicit Representation for Decoder-friendly Video-based Gaussian Splat Compression},
        booktitle = {Data Compression Conference (DCC)},
        year = {2026},
        doi = {10.1109/DCC66757.2026.00042}
    }
    
    @techreport{Lee_2026_4DGS_Showcase,
        author = {Lee, Soonbin and Sasse, Simon and Berensohn, Yoel and Sanchez de la Fuente, Yago and Skupin, Robert and Borges, Tomas M. and Hellge, Cornelius and Schierl, Thomas},
        title = {AHG9: Showcase for Real-time Decoding using Video-based Implicit Representations for 4DGS},
        institution = {JVET},
        number = {JVET-AP0220},
        month = {April},
        year = {2026}
    }