Scene Visual Perception and AR Navigation Applications

Abstract: With the rapid popularization of mobile devices and the wide application of various sensors, scene perception methods applied to mobile devices occupy an important position in location-based services such as navigation and augmented reality (AR). The development of deep learning technologies has greatly improved the visual perception ability of machines to scenes. The basic framework of scene visual per⁃ ception, related technologies and the specific process applied to AR navigation are introduced, and future technology development is pro⁃ posed. An application (APP) is designed to improve the application effect of AR navigation. The APP includes three modules: navigation map generation, cloud navigation algorithm, and client design. The navigation map generation tool works offline. The cloud saves the navigation map and provides navigation algorithms for the terminal. The terminal realizes local real-time positioning and AR path rendering.

Keywords: 3D reconstruction; image matching; visual localization; AR navigation; deep learning