A Human Centered Reinforcement Learning Driven Robotic Framework For Assisting Construction Workers
Thesis PhD2024

A Human-Centered, Reinforcement Learning Driven Robotic Framework For Assisting Construction Workers

PhD-CD

Yuning Wu

AdvisorsDaniel Cardoso Llach, Jean Oh, Jieliang Luo

Abstract

This research explores how robots can be designed to support, rather than replace, labor-intensive workers in construction. It develops a robotic framework leveraging Reinforcement Learning (RL) algorithms, encompassing robot hardware prototyping, unstructured site perception, worker detection and tracking, hierarchical motion planning, and contextualized RL training. Realized as a “work companion robot” for carpentry workers, the framework is tested in both lab and real construction sites. Key contributions include a practical RL-driven robot for tool/material delivery and worker-robot interaction, a modular and lightweight system with tailored control and sensory packages, an comprehensive perception architecture for navigating unstructured environments, a hierarchical motion planning stack that integrates RL-based and search-based path planning, and a contextual RL finetuning pipeline for social navigation around workers. This robotic framework lays a technical foundation for future research into robotically-supported collaborative work, advancing the field of computational design, robotics, and AI/ML by integrating advanced robotics into real-world construction contexts with a focus on human-centered support.

Figure 5.7: Robot trajectory from the time-lapse recording and photo documentation of Script 1. Some photos were published in [Wu et al., 2024b] and [Wu et al., 2024a].
Figure 5.7: Robot trajectory from the time-lapse recording and photo documentation of Script 1. Some photos were published in [Wu et al., 2024b] and [Wu et al., 2024a].
How This Connects
Yuning WuYuning WuDaniel Cardoso LlachDaniel Cardoso …Robot in the loop: a human-centered approach to contextualizing AI and robotics in constructionRobot in the lo…Towards Human-Centered Construction Robotics: A Reinforcement Learning-Driven Companion Robot for Contextually Assisting Carpentry WorkersTowards Human-C…Robot in the loop: a human-centered approach to contextualizing AI and robotics in constructionRobot in the lo…Towards Human-Centered Construction Robotics: A Reinforcement Learning-Driven Companion Robot for Contextually Assisting Carpentry WorkersTowards Human-C…Towards a Distributed, Robotically Assisted Construction FrameworkTowards a Distr…
A Human-Centered, Reinforcement Learning Driven Robotic Framework For Assisting Construction Workers
Open in Constellation View