Vol. 10, no.2, 2018
РусскийEnglish
INFORMATION TECHNOLOGIES
SEMANTIC FUSION AND JOINT ANALYSIS OF TERAHERTZ AND 3D VIDEO IMAGES BY THE MEANS OF OBJECT-ORIENTED LOGIC PROGRAMMING
1Alexei A. Morozov, 1Olga S. Sushkova, 1Alexander F. Polupanov, 1,2Vyacheslav E. Antsiperov, 1Gennady K. Mansurov, 1Stanislav K. Paprotskiy, 1Alexander V. Yanushko, 1Nadezda G. Petrova, 1,2Alexander S. Bugaev
1Kotelnikov Institute of Radioengineering and Electronics of RAS, http://www.cplire.ru
Moscow 125009, Russian Federationn
2Moscow Institute of Physics and Technology, http://mipt.ru
9, Institutsky per., Dolgoprudny 141701, Moscow Region, Russian Federation
morozov@cplire.ru, o.sushkova@mail.ru, sashap55@mail.ru, antciperov@gmail.com, gmansurov@mail.ru, s.paprotskiy@gmail.com, yanushko@gmail.com, petrova@cplire.ru, bugaev@cplire.ru
Received 16.06.2003 [1]
Abstract. The aim of the work is to create methods and software tools for the terahertz range intelligent video surveillance, that is, for automatic analysis of video images in the terahertz frequency range. Terahertz video surveillance provides unique prospects in the area of public safety; in particular, it allows you to remotely identify weapons and dangerous items hidden under clothing on the human body. However, such characteristics of terahertz video, as low resolution, low contrast, and low signal-to-noise ratio, lead to the need to develop new methods and approaches to automatic video analysis. To understand the terahertz video image, the operator of the industrial video surveillance system usually compares it with images in other frequency ranges (visible or infrared). The comparison of these images of different types helps the operator to interpret the colored and/or one-color spots in the terahertz image in a proper way. In terms of automatic video analysis, this means that the context of the observed events and objects is taken into account, or in other words, a semantic fusion is implemented of the terahertz range video image with video images of other frequency ranges, e.g., near-infrared, visible, etc. The authors consider the semantic fusion of the video images as a critical component of the prospective terahertz intelligent video surveillance technology. A new method of the terahertz video surveillance based on the fusion of the terahertz video with 3D video is proposed. The means of the object-oriented logic programming developed for the semantic fusion of the terahertz and 3D video images are described. The developed method provides a real-time fusion of the terahertz video acquired using the THERZ-7A (Astrohn Technology Ltd) subterahertz scanning device (0.23-0.27 THz) and 3D video data acquired using the Kinect 2 (Microsoft Inc) time-of-flight sensor. The method and software tools for the semantic fusion of the terahertz and 3D video images are developed.
Keywords: terahertz video surveillance; 3D video surveillance; intelligent visual surveillance; object-oriented logic programming; Actor Prolog
UDC 510.663; 519.68:007.5; 519.68:681.513.7; 681.3.06
RENSIT, 2018, 10(2):329-340 DOI: 10.17725/rensit.2018.10.329
Full-text electronic version of this article - web site http://en.rensit.ru/vypuski/article/259/10(2)329-340e.pdf