?-BA: Bundle Adjustment Acceleration on Embedded FPGAs with Co-Observation Optimization

Speaker:  Shaoshan Liu – Fremont, CA, United States
Topic(s):  Architecture, Embedded Systems and Electronics, Robotics

Abstract

Bundle adjustment (BA) is a fundamental optimization technique used in many crucial applications, including 3D scene reconstruction, robotic localization, camera calibration, autonomous driving, space exploration, street view map generation etc. Essentially, BA is a joint non-linear optimization problem, and one which can consume a significant amount of time and power, especially for large optimization problems. Previous approaches of optimizing BA performance heavily rely on parallel processing or distributed computing, which trade higher power consumption for higher performance. In this talk we introduce π-BA, the first hardware-software co-designed BA engine on an embedded FPGA-SoC that exploits custom hard- ware for higher performance and power efficiency. Specifically, based on our key observation that not all points appear on all images in a BA problem, we designed and implemented a Co- Observation Optimization technique to accelerate BA operations with optimized usage of memory and computation resources. Experimental results confirm that π-BA outperforms the existing software implementations in terms of performance and power consumption.

About this Lecture

Number of Slides:  40
Duration:  45 minutes
Languages Available:  English
Last Updated: 

Request this Lecture

To request this particular lecture, please complete this online form.

Request a Tour

To request a tour with this speaker, please complete this online form.

All requests will be sent to ACM headquarters for review.