Virtual Conversational Agent with Emotions

Metahuman characters

[FYP] This project is about building an emotional conversational virtual agent in Unreal Engine that can take text as input and produce speech and associated animations on a Metahuman. The main aspect will be learning to work with virtual human animations and programming the to animate in state-machines. The project will involve integrating a number of plugins for animation such as Audio2Face and dialogue such as IBM Watson or DialogFlow. The student will also develop suitable conversational scenarios for the agent and program empathetic agent-reactions to the users emotions. Student should have knowledge of computer graphics (be taking the CSU44052 module) and be interested to program with Unreal Engine and Metahuman Creator.