Continual Reinforcement Learning for Cyber-Physical Systems

Reinforcement learning (RL) and especially deep reinforcement learning have emerged as powerful paradigms for learning quasi-optimal sequential decision making strategies (in applications as diverse as game playing and urban traffic control). RL uses an approach based on’ trial and error’ in which agents learn by interacting with their environment. Most RL algorithms assume that the … Read more

Multi-agent Reinforcement Learning for Travel Time Reliability

Poor travel-time reliability, meaning that travel times for the same journey are highly variable and unpredictable, gives rise to similar negative impacts on the environment and the economy as does traffic congestion. Moreover, being able to offer a high degree of travel-time reliability will facilitate the uptake of sustainable road transportation including future public, shared, … Read more

Swarm Intelligence for Travel Time Reliability

Poor travel-time reliability, meaning that travel times for the same journey are highly variable and unpredictable, gives rise to similar negative impacts on the environment and the economy as does traffic congestion. Moreover, being able to offer a high degree of travel-time reliability will facilitate the uptake of sustainable road transportation including future public, shared, … Read more

Reinforcement Learning for Motorway Demand Management

This project will investigate the use of reinforcement learning to develop a highway journey booking system incorporating a dynamic pricing strategy to allow traffic demand to be shaped in ways that will improve traffic efficiency and enhance sustainability by reducing emissions and fuel consumption. The goal will be to evaluate the potential benefit of the … Read more

Decoding music enjoyment from eye and pupil dynamics (taken)

Music is central in our society. However, the neural mechanisms leading to the enjoyment of music remain unclear. This project is part of a bigger investigation with multimodal data. One dimension of that data involves eye and pupil dynamics, which are known to reflect neural activity relevant to sound perception. Here, you will analyse eye/pupil … Read more

Individualised project in Wireless networking, Machine Learning, Artificial Intelligence, Quantum Computing (and associated application domains)

I am happy to supervise a project in all the areas of computer networking that I am interested in — wireless networking, Machine Learning, Artificial Intelligence and in their application to a wide range of real world settings (healthcare, IoT, structural health monitoring). I am particularly interested in exploring some aspects of quantum computing; for … Read more

Federated Learning for Imbalanced Datasets

The performance of artificial intelligence based learning models is often initially assessed using well established benchmark datasets. However, satisfactory performance on these datasets does not guarantee similar performance in real-world settings where the data may be significantly more imbalanced.  For example, in a medical dataset a positive diagnosis may be a relatively rare event and … Read more

Natural Language Processing

Please use this form to arrange a time to meet me to discuss project supervision: https://forms.gle/G82EJhXymGU3Wbf58 I have the below projects available, all related to Natural Language Processing: Data Collection for Analysis of Language in Video; Video Sentiment Analysis; Automatic Video Transcription; Automatic Identification of bias in Video Language; Automatic Prediction of Video Content Quality; … Read more