Skip to content
digital_developer
ToolsResearchRenderingSIGGRAPH

Neural materials, explained for people who ship real-time games

A plain-language walkthrough of NVIDIA's Real-Time Neural Appearance Models paper: what it replaces, what it claims, and what it needs from hardware.

Digital Developer Desk, 37d ago, 5 min read

Real-Time Neural Appearance Models, by Tizian Zeltner and colleagues at NVIDIA, was published in ACM Transactions on Graphics and presented at SIGGRAPH 2024. The idea is to replace a complex layered material with a small learned model that reproduces how the surface looks.

The paper reports neural material shaders that are over an order of magnitude faster than the non-neural layered materials they replace, while keeping fine detail such as clear-coat glaze, fingerprints, smudges and dust. The authors also say filtered materials render without aliasing at any distance and without supersampling.

The catch is hardware and tooling. The approach exposes hardware-accelerated tensor operations to ray tracing shaders so the decoders can run inside a real-time path tracer, which is why it's worth watching how engines and GPUs support it before planning a material pipeline around it.

Sources

Get the daily brief

The five stories that matter, every weekday morning. Free.

Blender 5.3 adds initial support for 3D Gaussian splats

Blender 5.3 can import, edit and render 3D Gaussian splats (gsplats), with support in EEVEE, Workbench and Cycles. The Blender developers blog covers the file formats, the Geometry Nodes attributes and the current limitations.

code.blender.org4d ago3 min read