基于云机器人的视觉SLAM微服务化.rar

# ORB-SLAM2 **Authors:** [Raul Mur-Artal](http://webdiis.unizar.es/~raulmur/), [Juan D. Tardos](http://webdiis.unizar.es/~jdtardos/), [J. M. M. Montiel](http://webdiis.unizar.es/~josemari/) and [Dorian Galvez-Lopez](http://doriangalvez.com/) ([DBoW2](https://github.com/dorian3d/DBoW2)) **13 Jan 2017**: OpenCV 3 and Eigen 3.3 are now supported. **22 Dec 2016**: Added AR demo (see section 7). ORB-SLAM2 is a real-time SLAM library for **Monocular**, **Stereo** and **RGB-D** cameras that computes the camera trajectory and a sparse 3D reconstruction (in the stereo and RGB-D case with true scale). It is able to detect loops and relocalize the camera in real time. We provide examples to run the SLAM system in the [KITTI dataset](http://www.cvlibs.net/datasets/kitti/eval_odometry.php) as stereo or monocular, in the [TUM dataset](http://vision.in.tum.de/data/datasets/rgbd-dataset) as RGB-D or monocular, and in the [EuRoC dataset](http://projects.asl.ethz.ch/datasets/doku.php?id=kmavvisualinertialdatasets) as stereo or monocular. We also provide a ROS node to process live monocular, stereo or RGB-D streams. **The library can be compiled without ROS**. ORB-SLAM2 provides a GUI to change between a *SLAM Mode* and *Localization Mode*, see section 9 of this document. <a href="https://www.youtube.com/embed/ufvPS5wJAx0" target="_blank"><img src="http://img.youtube.com/vi/ufvPS5wJAx0/0.jpg" alt="ORB-SLAM2" width="240" height="180" border="10" /></a> <a href="https://www.youtube.com/embed/T-9PYCKhDLM" target="_blank"><img src="http://img.youtube.com/vi/T-9PYCKhDLM/0.jpg" alt="ORB-SLAM2" width="240" height="180" border="10" /></a> <a href="https://www.youtube.com/embed/kPwy8yA4CKM" target="_blank"><img src="http://img.youtube.com/vi/kPwy8yA4CKM/0.jpg" alt="ORB-SLAM2" width="240" height="180" border="10" /></a> ### Related Publications: [Monocular] Raúl Mur-Artal, J. M. M. Montiel and Juan D. Tardós. **ORB-SLAM: A Versatile and Accurate Monocular SLAM System**. *IEEE Transactions on Robotics,* vol. 31, no. 5, pp. 1147-1163, 2015. (**2015 IEEE Transactions on Robotics Best Paper Award**). **[PDF](http://webdiis.unizar.es/~raulmur/MurMontielTardosTRO15.pdf)**. [Stereo and RGB-D] Raúl Mur-Artal and Juan D. Tardós. **ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Cameras**. *IEEE Transactions on Robotics,* vol. 33, no. 5, pp. 1255-1262, 2017. **[PDF](https://128.84.21.199/pdf/1610.06475.pdf)**. [DBoW2 Place Recognizer] Dorian Gálvez-López and Juan D. Tardós. **Bags of Binary Words for Fast Place Recognition in Image Sequences**. *IEEE Transactions on Robotics,* vol. 28, no. 5, pp. 1188-1197, 2012. **[PDF](http://doriangalvez.com/php/dl.php?dlp=GalvezTRO12.pdf)** ## SLAM 微服务化 ### 安装 1. 安装原版ORB-SLAM2依赖库 2. 在~/.bashrc中添加Package声明，例如 ```sh export ROS_PACKAGE_PATH=${ROS_PACKAGE_PATH}:/home/rain/workspace/ORB_SLAM2 ``` 3. 将当前源码目录中mnorbslam_msgs消息包复制到catkin_ws工作区域中进行编译 ### 运行 分别在三个端口中启动三个节点，根据自己的目录调整相应的路径 ```sh $ rosrun ORB_SLAM2 LocalMapping Vocabulary/ORBvoc.bin $ rosrun ORB_SLAM2 LoopClosing Vocabulary/ORBvoc.bin $ rosrun ORB_SLAM2 Tracking Vocabulary/ORBvoc.bin Examples/RGB-D/TUM2.yaml Examples/RGB-D/rgbd_dataset_freiburg2_desk Examples/RGB-D/rgbd_dataset_freiburg2_desk/associate.txt ``` ### LoopClosing 1. SLAM分解为三个ROS节点，采用数据库作为Map数据容器,在LoopClosing线程中,进行闭环检测Sim3求解时需要配置LoopClosing.cc中446行， ```c++ pSolver->SetRansacParameters(0.99,5,300); ``` 中将第二个参数从20改为5，这样才能检测到闭环，同时也容易造成误匹配。 2. KeyFrameDatabase类的数据在Loopclosing线程中没有进行处理，主要是因为从数据库中读取的KeyFrame数据关系原版本程序已经有不小的区别了。 ### orb-slam环境配置方法指南 详情见项目附件 --- # 1. License ORB-SLAM2 is released under a [GPLv3 license](https://github.com/raulmur/ORB_SLAM2/blob/master/License-gpl.txt). For a list of all code/library dependencies (and associated licenses), please see [Dependencies.md](https://github.com/raulmur/ORB_SLAM2/blob/master/Dependencies.md). For a closed-source version of ORB-SLAM2 for commercial purposes, please contact the authors: orbslam (at) unizar (dot) es. If you use ORB-SLAM2 (Monocular) in an academic work, please cite: @article{murTRO2015, title={{ORB-SLAM}: a Versatile and Accurate Monocular {SLAM} System}, author={Mur-Artal, Ra\'ul, Montiel, J. M. M. and Tard\'os, Juan D.}, journal={IEEE Transactions on Robotics}, volume={31}, number={5}, pages={1147--1163}, doi = {10.1109/TRO.2015.2463671}, year={2015} } if you use ORB-SLAM2 (Stereo or RGB-D) in an academic work, please cite: @article{murORB2, title={{ORB-SLAM2}: an Open-Source {SLAM} System for Monocular, Stereo and {RGB-D} Cameras}, author={Mur-Artal, Ra\'ul and Tard\'os, Juan D.}, journal={IEEE Transactions on Robotics}, volume={33}, number={5}, pages={1255--1262}, doi = {10.1109/TRO.2017.2705103}, year={2017} } # 2. Prerequisites We have tested the library in **Ubuntu 12.04**, **14.04** and **16.04**, but it should be easy to compile in other platforms. A powerful computer (e.g. i7) will ensure real-time performance and provide more stable and accurate results. ## C++11 or C++0x Compiler We use the new thread and chrono functionalities of C++11. ## Pangolin We use [Pangolin](https://github.com/stevenlovegrove/Pangolin) for visualization and user interface. Dowload and install instructions can be found at: https://github.com/stevenlovegrove/Pangolin. ## OpenCV We use [OpenCV](http://opencv.org) to manipulate images and features. Dowload and install instructions can be found at: http://opencv.org. **Required at leat 2.4.3. Tested with OpenCV 2.4.11 and OpenCV 3.2**. ## Eigen3 Required by g2o (see below). Download and install instructions can be found at: http://eigen.tuxfamily.org. **Required at least 3.1.0**. ## g2o We use [g2o](https://github.com/RainerKuemmerle/g2o) library to perform non-linear optimizations. Download and install instructions can be found at: https://github.com/RainerKuemmerle/g2o ## DBoW2(Included in Thirdparty folder) We use modified versions of the [DBoW2](https://github.com/dorian3d/DBoW2) library to perform place recognition(which are BSD) is included in the *Thirdparty* folder. ## ROS (optional) We provide some examples to process the live input of a monocular, stereo or RGB-D camera using [ROS](ros.org). Building these examples is optional. In case you want to use ROS, a version Hydro or newer is needed. # 3. Building ORB-SLAM2 library and examples Clone the repository: ``` git clone https://github.com/raulmur/ORB_SLAM2.git ORB_SLAM2 ``` We provide a script `build.sh` to build the *Thirdparty* libraries and *ORB-SLAM2*. Please make sure you have installed all required dependencies (see section 2). Execute: ``` cd ORB_SLAM2 chmod +x build.sh ./build.sh ``` This will create **libORB_SLAM2.so** at *lib* folder and the executables **mono_tum**, **mono_kitti**, **rgbd_tum**, **stereo_kitti**, **mono_euroc** and **stereo_euroc** in *Examples* folder. # 4. Monocular Examples ## TUM Dataset 1. Download a sequence from http://vision.in.tum.de/data/datasets/rgbd-dataset/download and uncompress it. 2. Execute the following command. Change `TUMX.yaml` to TUM1.yaml,TUM2.yaml or TUM3.yaml for freiburg1, freiburg2 and freiburg3 sequences respectively. Change `PATH_TO_SEQUENCE_FOLDER`to the uncompressed sequence folder. ``` ./Examples/Monocular/mono_tum Vocabulary/ORBvoc.txt Examples/Monocular/TUMX.yaml PATH_TO_SEQUENCE_FOLDER ``` ## KITTI Dataset 1. Download the dataset (grayscale images) from http://www.cvlibs.net/datasets/kitti/eval_odometry.php 2. Execute the