Luma AI: Gaussian Splats & Nerfs and AI/ML Tools for VFX

Part of the CETI Sensory SPA (Spring Adventures in Learning) 2025

Instructors: Peter Vickery

Sun Apr 27 2025. 10:30am -- 1:00pm.

This workshop is an introduction to the fast moving world of AI/ML tools for visual effects, virtual production, and XR as they are actually being used in the industry today. We will look at video to video models for stylizing previs, storyboarding & style frame creation as well as ML segmentation, inpainting & monocular depth estimation in Nuke.

We’ll start with recent developments in 3D scanning using Neural Radiance Fields (Nerfs) & Gaussian Splatting and how to get these into applications to view, edit and use them to create environments and game level 3D assets. Finally we’ll talk about different ML models that can be used to upres the models & textures for use in professional level applications for 2.5 environment assets, for 3D assets, for segmentation/ automatic rotoscoping, match cuts & deep fakes, for high res upscaling.

Prerequisite: Beginner to Intermediate.

Required Materials: A laptop with Luma AI desktop (free) installed. Own phone with Luma AI mobile app.

- ----------------------------------------------

By participating in this and any CETI event, you are agreeing to r and to abide by and CETI PSU Policies and Protocols.

Host or Publisher CETI