Deep Fake Enfacement Experiment

[MSc Level] This project will involve creating a real-time enfacment system from the state of the art deep-fake networks, and conducting perceptual experiments to identify if participants have ownership of their new face, and if properties of the source-actor (e.g., age, gender, etc.) can be perceived, even though the generated video is a photorealistic depiction … Read more

Non-verbal behaviours for speaking virtual avatars

[MSc level] Virtual assistants are becoming commonplace but the ability for them to gesture naturally and appropriately is still a huge research challenge (see image which shows a typical assistant displayed from the neck up, without gesturing arms and hands). In this project, you will develop a method to automatically learn structure from speech sequences … Read more

Learned Motion Matching for body-swapping experiences in VR

[MSc level] In this project, you will investigate learned motion matching and how it can be used for embodiment in VR, in particular body-swapping, where the user takes on the motion of somebody else. Student must be taking the Real Time Animation module and also a machine learning module and have strong programming in Unreal … Read more

[TAKEN] How does it feel if your avatar in Virtual Reality is wearing realistic clothing?

[FYP or MSc Level] This project will investigate clothing a virtual character using existing cloth plugins (e.g. uDraper or Marvelous Designer), and applying them to photorealistic Metahuman characters in UE5. Cloth simulation will then be tested using Chaos cloth or other, and student will create an embodiment system, where the user can embody a character … Read more

Cartoon Pose Estimation

[MSc Level] We will collaborate with award-winning animation studio Cartoon Saloon to investigate animated character body part recognition. This project aims to search through cartoon scenes in order to identify character body parts. This task is more difficult than typical human pose-estimation as cartoon characters are often drawn to defy the laws of physics. Knowledge … Read more