Designing Agents For Co Creation In Virtual Reality With Deep Reinforcement Learning
Thesis Masters2023

Designing Agents for Co-Creation in Virtual Reality with Deep Reinforcement Learning

MSCD

Mitchell Foo

AdvisorsDaniel Cardoso Llach, Thomas Corbett

Abstract

The ways that we embody interactions in virtual spaces are rapidly evolving with developments in the fields of deep learning and virtual reality. This is significant because these spaces are increasingly becoming extensions of different human social and creative practices. That being said, there is a lack of perspectives offered towards shaping technological usage that considers creative practices alongside immersive platforms and cutting-edge AI technologies. How then might we as designers, developers, and users, interrogate the intersection of deep learning and VR to better understand how the future landscape of design and virtual interaction might change? This thesis offers insight into how these technologies might overlap in future design environments. This thesis provides a framework for a design interaction between human and agent co-creator in VR supported by reinforcement learning, an unsupervised training method focused on crafting AI behavior. This thesis contributes in two ways, by firstly providing insight into how human-agent interactions can be facilitated given open-ended design problems, and secondly, by exploring RL as a design medium for crafting agent behaviors through creating human demonstrations in VR. This thesis helps create and guide future questioning on the relevancy of emerging AI technologies in open-ended design contexts.

Overview of the human-AI co-creation environment,  User view cursoring over a with their gaze and deciding which color to assign it, A selected Creator Agent observation within the latent evaluation interface
Overview of the human-AI co-creation environment, User view cursoring over a with their gaze and deciding which color to assign it, A selected Creator Agent observation within the latent evaluation interface
How This Connects
Mitchell FooMitchell FooDaniel Cardoso LlachDaniel Cardoso …
Designing Agents for Co-Creation in Virtual Reality with Deep Reinforcement Learning
Open in Constellation View