4D Volumetric: Video to Gaussian Splats
Computer Graphics · Full StackA web application that turns an ordinary video into an animated 3D Gaussian splat you can orbit and scrub through in the browser. It recovers the camera trajectory to classify each clip, then either fuses orbiting footage into a single 3D model or builds a spacetime model from a static background plus flow tracked gaussian trajectories. I wrote a differentiable splat renderer in PyTorch that optimizes every gaussian by gradient descent on Apple silicon, a custom binary scene format, and a WebGL viewer that interpolates motion continuously on the GPU.
Repository private. Demo and code walkthrough available on request.
- 300kGaussians optimized
- 2 to 10×Smaller scene files
- Apple MPSNo CUDA required