Jo Plaete, a pioneer in digital humans and chief innovation officer at Metaphysic, joins the podcast to discuss his company’s groundbreaking work on the newly released film Here, now in theaters. Jo traces his journey from his early career in computer graphics and visual effects, working on films like Where the Wild Things Are and Aladdin, to creating cutting-edge AI-driven tools that enable photorealistic de-aging of actors like Tom Hanks and Robin Wright. His experience includes collaborating with Disney Research on facial reconstruction technologies and pushing the boundaries of neural network-based visual effects.
Jo also explains how Metaphysic’s tools provided real-time feedback on set, allowing filmmakers to see younger versions of the actors instantly. This innovation enabled directors and actors to evaluate performances live, making adjustments on the spot to achieve the most authentic and emotionally resonant portrayal. Jo reflects on the future of digital humans in cinema, emphasizing how AI and real-time feedback are reshaping storytelling while maintaining a high level of artistic control.
Links:
0:08:45 Jo Plaete and Metaphysic
0:10:28 How Jo and Chris met through Ed Ulbrich at the Real Time Economic Summit
0:12:33 Jo’s early career in computer science and multimedia
0:15:07 Working at Framestore and Animal Logic on Where the Wild Things Are and Legend of the Guardians
0:17:45 Collaborating with Disney Research on Aladdin and exploring machine learning
0:20:59 Challenges of digital human creation and markerless facial capture
0:26:07 Working with ILM on ABBA’s digital concert and retargeting challenges
0:30:03 The complexities of achieving photorealism and the uncanny valley
0:33:14 Jo’s work on digital doubles, using machine learning to enhance fidelity
0:38:22 Discussion on traditional versus AI-driven digital human pipelines
0:43:00 Real-time feedback on set for Here and the importance of maintaining performance fidelity
0:48:29 How Metaphysic’s tools enable real-time de-aging feedback for actors and directors
0:53:06 The evolving role of visual effects artists and their creative contributions
0:59:18 The collaborative nature of AI-driven VFX tools in filmmaking
1:03:22 Ethical considerations and the artistic future of AI in cinema
1:09:57 Final thoughts on the future of digital humans and Metaphysic’s upcoming projects