Volltext-Downloads (blau) und Frontdoor-Views (grau)

Efficient and robust 3D object reconstruction based on monocular SLAM and CNN semantic segmentation

  • Various applications implement slam technology, especially in the field of robot navigation. We show the advantage of slam technology for independent 3d object reconstruction. To receive a point cloud of every object of interest void of its environment, we leverage deep learning. We utilize recent cnn deep learning research for accurate semantic segmentation of objects. In this work, we propose two fusion methods for cnn-based semantic segmentation and slam for the 3d reconstruction of objects of interest in order to obtain a more robustness and efficiency. As a major novelty, we introduce a cnn-based masking to focus slam only on feature points belonging to every single object. Noisy, complex or even non-rigid features in the background are filtered out, improving the estimation of the camera pose and the 3d point cloud of each object. Our experiments are constrained to the reconstruction of industrial objects. We present an analysis of the accuracy and performance of each method and compare the two methods describing their pros and cons.

Download full text files

  • 2533.pdf

Export metadata

Additional Services

Search Google Scholar


Author of HS ReutlingenWeber, Thomas; Triputen, Sergey; Gopal, Atmaraaj; Eißler, Steffen; Höfert, Christian; Rätsch, Matthias
Erschienen in:RoboCup 2019: Robot World Cup XXIII. - (Lecture notes in artificial intelligence ; 11531)
Place of publication:Cham
Editor:Stephan Chalup
Document Type:Conference proceeding
Publication year:2019
Tag:3d reconstruction; bin-picking; cnn; collaborative robot; depth estimation; lsd-slam; monocular camera; semantic segmentation; slam
Page Number:13
First Page:351
Last Page:363
City of University:Sydney, Australien
PPN:Im Katalog der Hochschule Reutlingen ansehen
DDC classes:006 Spezielle Computerverfahren
Open access?:Nein
Licence (German):License Logo  In Copyright - Urheberrechtlich geschützt