3D local descriptors used in methods of visual 3D object recognition
Marek Jakab, Wanda Benesova
Slovenska Technicka Univ. (Slovakia)
Abstract. In this paper, we propose an enhanced method of 3D object description and recognition based on local descriptors using RGB image and depth information (D) acquired by Kinect sensor. Our main contribution is focused on an extension of the SIFT feature vector by the 3D information derived from the depth map (SIFT-D). We also propose a novel local depth descriptor (DD) that includes a 3D description of the key point neighborhood. Thus defined the 3D descriptor can then enter the decision-making process. Two different approaches have been proposed, tested and evaluated in this paper. First approach deals with the object recognition system using the original SIFT descriptor in combination with our novel proposed 3D descriptor, where the proposed 3D descriptor is responsible for the pre-selection of the objects. Second approach demonstrates the object recognition using an extension of the SIFT feature vector by the local depth description. In this paper, we present the results of two experiments for the evaluation of the proposed depth descriptors. The results show an improvement in accuracy of the recognition system that includes the 3D local description compared with the same system without the 3D local description. Our experimental system of object recognition is working near real-time.
Keywords: local descriptor, depth descriptor, SIFT, segmentation, Kinect v2, 3D object recognition
Paper is available at SPIE proceedings:
http://spie.org/EI/conferencedetails/intelligent-robots-computer-vision
Paper 9406-21
Source code:
Solution (VS 2013):
https://www.dropbox.com/s/a9o1tques7ven9d/Object_Detection_Solution.zip?dl=0
Sources Only:
https://www.dropbox.com/s/qyn73e68s3dq1py/Object_Detection_SourcesOnly.zip?dl=0