Autoware in Construction: Gap Analysis and LiDAR Perception Toward Off-Road Autonomous Driving

Autoware in Construction: Gap Analysis and LiDAR Perception Toward Off-Road Autonomous Driving

Yu Otsuki, Teja Emmey, Sena Matsushita, Akiro Harada, Takeshi Miura · N/A · 2026

Framework

N/A

License

N/A

Stars

N/A

Summary

Autoware is an open-source autonomous driving software platform widely adopted by researchers and industry developers.

Abstract Summary

Autoware is an open-source autonomous driving software platform widely adopted by researchers and industry developers. Originally developed primarily for public-road applications, including passenger vehicles, taxis, and buses, Autoware is increasingly being extended to off-road environments such as construction and agricultural sites. Construction sites, however, differ fundamentally from public roads and challenge many assumptions underlying conventional autonomous driving systems. They are characterized by unstructured terrain, airborne dust, continuously evolving site conditions, and construction-specific objects. This paper presents lessons learned from ongoing efforts to extend an Autoware-based autonomous driving system to large dump trucks operating at construction sites. We identify gaps between public-road and off-road construction applications across the sensing, mapping, localization, perception, planning, and control modules of the Autoware stack. We then discuss potential solutions for addressing these gaps, with particular emphasis on ongoing LiDAR-based perception pipeline development and findings from field testing. Finally, we propose a roadmap toward end-to-end autonomous driving for construction vehicles.

Key Points

  • Autoware is an open-source autonomous driving software platform widely adopted by researchers and industry developers.
  • Originally developed primarily for public-road applications, including passenger vehicles, taxis, and buses, Autoware is increasingly being extended to off-road environments such as construction and agricultural sites.
  • Construction sites, however, differ fundamentally from public roads and challenge many assumptions underlying conventional autonomous driving systems.
  • They are characterized by unstructured terrain, airborne dust, continuously evolving site conditions, and construction-specific objects.
  • This paper presents lessons learned from ongoing efforts to extend an Autoware-based autonomous driving system to large dump trucks operating at construction sites.

Technology Gaps in Autonomous Driving Between Public Roads and Construction Sites

We identified key differences between public-road and off-road construction environments in each module of the Autoware stack, as summarized in Table I . Challenges in construction environments are interdependent across these modules. Therefore, achieving construction autonomy requires system-wide integration rather than the isolated replacement of individual algorithms.

Technology Gaps in Autonomous Driving Between Public Roads and Construction Sites — Autoware in Construction: Gap Analysis and LiDAR Perception Toward Off-Road Autonomous Driving
Fig. 3: Comparison of LiDAR ground segmentation results obtained at an off-road environment using the scan ground filter (left) and GSeg3D (right). The raw point cloud is shown in green, while non-ground points identified by the scan ground filter and GSeg3D are highlighted in red and blue, respectively.

Lessons Learned from Field Development of LiDAR-based Perception

Among the technology gaps in Table I , this section presents our LiDAR-based perception pipeline: LiDAR sensor $\rightarrow$ sensor driver $\rightarrow$ preprocessing filters $\rightarrow$ multi-LiDAR concatenation $\rightarrow$ postprocessing filters $\rightarrow$ ground segmentation $\rightarrow$ dust filtering $\rightarrow$ object detection, developed by extending the existing Autoware pipeline.

Lessons Learned from Field Development of LiDAR-based Perception — Autoware in Construction: Gap Analysis and LiDAR Perception Toward Off-Road Autonomous Driving
Fig. 4: Comparison of LiDAR return modes under dusty conditions. The strongest return (left) is more affected by dust particles, whereas the last return (right) better preserves ground surfaces and objects behind the dust.

Roadmap toward End-to-End autonomous driving in construction

Current learning-based perception modules in Autoware have been trained primarily on public-road datasets [ 14 ] . For example, a standard LiDAR-based CenterPoint model detects five object classes: cars, trucks, buses, bicycles, and pedestrians.

Construction sites, however, contain a substantially different range of objects, including heavy construction machinery, service vehicles, workers wearing high-visibility clothing, traffic cones, rocks, and berms.

Roadmap toward End-to-End autonomous driving in construction — Autoware in Construction: Gap Analysis and LiDAR Perception Toward Off-Road Autonomous Driving
Fig. 5: LiDAR point cloud (left) and camera image (right). In the LiDAR point cloud, LAST returns with intensity values of 1 or lower are shown in pink; others are shown in green. Dust returns and ground returns obscured by the dust are predominantly pink, whereas unobscured ground returns and the cones and mannequin behind the dust appear green.

Sources and Demonstrations

Figures are reproduced from Otsuki et al. See the full paper for experimental details and the project page, when the paper links one, for demonstrations and videos.

Share

Related Papers

Aim Short to Reach Far: Your Frozen World Model Can Plan Better Than You Think
arXiv preprint

Aim Short to Reach Far: Your Frozen World Model Can Plan Better Than You Think

Xvyuan Liu, Jianjie Fang, Chen Gao et al.

Planners built on visual world models commonly score each predicted outcome by its distance to the encoded goal image. We show that this target can limit control even with exact dynamics and globally optimal short-horizon search: reaching a goal may require actions that initially move away from it.

vision reinforcement-learning planning control human-robot-interaction benchmark
PDF Intermediate
Autonomous Droplet Navigation via Model-Based Reinforcement Learning: Zero-Shot Transfer and Emergent Dynamics
arXiv preprint

Autonomous Droplet Navigation via Model-Based Reinforcement Learning: Zero-Shot Transfer and Emergent Dynamics

Rajneesh Anand, Mayuresh V. Kothare

Self-driving laboratories (SDLs) are transforming chemical and materials discovery through closed-loop automation, yet automated infrastructure for physical manipulation of soft, deformable matter remains beyond current robotic platforms.

manipulation vision reinforcement-learning planning control
Code PDF Intermediate
GitHub ★ —
Catch, Throw, Repeat: Planning for Human-Robot Partner Juggling
arXiv preprint

Catch, Throw, Repeat: Planning for Human-Robot Partner Juggling

Jonathan Rainer Lippert, Kai Ploeger, Abir Chowdhury et al.

Dynamic object exchange between humans and robots remains a challenging problem due to uncertainty in perception, timing, and contact-rich interaction.

vision reinforcement-learning planning control human-robot-interaction
PDF Intermediate