AI-Enhanced 3D Content Creation in Media Arts

This workshop will familiarise participants with the latest set of tools and design pipelines that leverage AI-assisted (neural network) methods of capturing real-life objects and locations and converting them into 3D assets.

Experience level: Beginner - Intermediate. Familiarity with Unity 3D/Unreal is an advantage.

Equipment needed: laptop or smartphone (iOS, no older than iPhone 12)

Generative AI’s deep learning methods have transformed how artists and game designers can capture and process real-world objects into photorealistic 3D assets for 3D/XR experiences, animations, and playable media. They outpace manual modelling and photogrammetry and produce visual materials of extraordinary quality with quite mesmerising aesthetics. Emerging over the past three years the technology changes monthly and it can be hard for artists to develop a good workflow, let alone keep up with the monthly changes.

Workshop tutor, Lukasz Mirocha will share a range of frameworks and services that leverage Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS). He will demonstrate how to use these tools to create 3D assets that can be used with industry-standard 3D content authoring tools such as general-purpose game engines (e.g. Unity 3D and Unreal 5).

The workshop will share a variety of options suitable for all of creative budgets, demonstrating both commercial and freely available graphics pipelines.

In advance of the workshop please install: Unreal Engine and Unity and set up a Unity ID (free) and Epic ID (free)

The workshop is led by Dr Lukasz Mirocha, a Hong Kong based new media and creative software artist working with immersive and real-time 3D media. He is currently a Post-Doctoral Research Fellow at the Academy of Visual Arts, Hong Kong Baptist University, focusing on real-time media design techniques.

Host or Publisher Stone Stories