Chaos
podcast banner

Jo Plaete — Chief Innovation Officer & VFX Supervisor at Metaphysic.ai

495_JoPlaete_MG_Full.jpg

Jo Plaete, a pioneer in digital humans and chief innovation officer at Metaphysic, joins the podcast to discuss his company’s groundbreaking work on the newly released film Here, now in theaters. Jo traces his journey from his early career in computer graphics and visual effects, working on films like Where the Wild Things Are and Aladdin, to creating cutting-edge AI-driven tools that enable photorealistic de-aging of actors like Tom Hanks and Robin Wright. His experience includes collaborating with Disney Research on facial reconstruction technologies and pushing the boundaries of neural network-based visual effects.

Jo also explains how Metaphysic’s tools provided real-time feedback on set, allowing filmmakers to see younger versions of the actors instantly. This innovation enabled directors and actors to evaluate performances live, making adjustments on the spot to achieve the most authentic and emotionally resonant portrayal. Jo reflects on the future of digital humans in cinema, emphasizing how AI and real-time feedback are reshaping storytelling while maintaining a high level of artistic control.

Links:

Metaphysic.ai >

Here Trailer >

Jo Plaete on IMDB >



495_JoPlaete_MG_YouTube.jpg495_JoPlaete_MG_YouTube.jpg

0:08:45 Jo Plaete and Metaphysic

0:10:28 How Jo and Chris met through Ed Ulbrich at the Real Time Economic Summit

0:12:33 Jo’s early career in computer science and multimedia

0:15:07 Working at Framestore and Animal Logic on Where the Wild Things Are and Legend of the Guardians

0:17:45 Collaborating with Disney Research on Aladdin and exploring machine learning

0:20:59 Challenges of digital human creation and markerless facial capture

0:26:07 Working with ILM on ABBA’s digital concert and retargeting challenges

0:30:03 The complexities of achieving photorealism and the uncanny valley

0:33:14 Jo’s work on digital doubles, using machine learning to enhance fidelity

0:38:22 Discussion on traditional versus AI-driven digital human pipelines

0:43:00 Real-time feedback on set for Here and the importance of maintaining performance fidelity

0:48:29 How Metaphysic’s tools enable real-time de-aging feedback for actors and directors

0:53:06 The evolving role of visual effects artists and their creative contributions

0:59:18 The collaborative nature of AI-driven VFX tools in filmmaking

1:03:22 Ethical considerations and the artistic future of AI in cinema

1:09:57 Final thoughts on the future of digital humans and Metaphysic’s upcoming projects 

IMG_h96auu.jpg
About the author

Christopher Nichols

Chris is a CG industry veteran and Director of Chaos Labs. He can also be heard regularly as the host of the CG Garage podcast which attracts 20,000 weekly listeners. With a background in both VFX and Design, Chris has worked for Gensler, Digital Domain, Imageworks and Method Studios. His credits include Maleficent, Oblivion and Tron: Legacy.

Originally published: November 12, 2024.
© Škoda Design

Subscribe to our blog.

Get the latest news, artist spotlight stories, tips and tricks delivered to your inbox.

By submitting your information you are agreeing to receive marketing messages from Chaos. You can opt-out at any time. Privacy Policy.

Chaos
© 2024 Chaos Software EOOD. All Rights reserved. Chaos®, V-Ray® and Phoenix FD® are registered trademarks of Chaos Software EOOD in Bulgaria and/or other countries.