Navigation methods using airlandscape data for small UAVs

The purpose of the research. UAVs are widely used in such fields as military, intelligence, and research. As a result, the issue of their use in electronic warfare conditions and the presence of various interference, both man-made and natural, is acute. Thus, the need for UAV navigation using visual data increases.

The purpose is study of the main negative factors affecting the quality of aerial photography images and methods for eliminating them to construct a correct orthomosaic for UAV visual navigation.

Methods. Mathematical methods are proposed to eliminate negative distortions in UAV camera images using various image transformation approaches. After applying these methods to the original images, corrected versions are obtained, which are used to construct the tile covering. Tiled coverage created from processed images provides continuous and uniform coverage of the area collected during the UAV’s flight. This allows you to obtain exact coordinates of images and objects on them.

Results. An analysis of the main methods for eliminating negative factors that distort images during aerial photography for the visual navigation of UAVs, as well as a brief overview of the visual navigation methods themselves.

Conclusion. To successfully implement visual navigation of a UAV, it is necessary to apply a number of methods for converting aerial photography images, as well as the use of certain algorithms for visual navigation. It is concluded that in addition to the use of mathematical and software algorithms, it will also be necessary to analyze and study the necessary computing power for the use of the entire hardware and software complex on board the UAV, taking into account its weight-dimensional properties.

1. Stepanov D.N. Mathematical models for obtaining stereo images from two-mirror catadioptric systems taking into account lens distortion. Komp’yuternaya optika = Computer Optics. 2019;43(1):105–114. (In Russ.)

2. Nikitin V.N., Semencov A.V. Calibration of cameras based on images of a flat test object. Izvestiya vysshih uchebnyh zavedenij. Geodeziya i aerofotos"emka = Proceedings of Higher Educational Institutions. Geodesy and Aerial Photography. 2014;(2):71–80. (In Russ.)

3. Zhang Yu-Jin. Camera Calibration. In: 3-D Computer Vision. Springer; 2023. P. 37–65.

4. Ramalingam S., Sturm P.A Unifying Model for Camera Calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2017;39(7):1309–1319.

5. Grammatikopoulos L., Adam K., Petsa E., Karras G. Camera calibration using multiple unordered coplanar chessboards. In: The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. Optical 3D Metrology. Vol. XLII-2/W18. Strasbourg, France; 2019. P. 59–66.

6. Blokhinov Yu.B., Andrienko E.E., Kazakhmedov K.K., Vishnyakov B.V. Automatic calibration of video camera and lidar systems for autonomous mobile systems. Computernaya Optika = Computer Optics. 2021;45(3):382–393. (In Russ.)

7. Zhimbueva L.D., Damdinova T.C. Issledovanie faktorov, vliyayushchih na distorsiyu opticheskih sistem cifrovyh kamer. Vestnik Vostochno-Sibirskogo gosudarstvennogo universiteta tekhnologij i upravleniya = Bulletin of the East Siberian State University of Technology and Management. 2015;53(2):38–42. (In Russ.)

8. Glagolev V.M. Description and software correction of lens distortion. Izvestiya Tul’skogo gosudarstvennogo universiteta. Tekhnicheskie nauki = Proceedings Tula State University. Technical Sciences. 2017; (9–4):188–194. (In Russ.)

9. Kholopov I.S. Simplified distortion compensation algorithm for projecting video on priori unknown form aspherical reflective surfaces. Cifrovaya Obrabotka Signalov = Digital Signal Processing. 2014;(3): 57–61. (In Russ.)

10. Rong J., Huang S., Shang Z., Ying X. Radial Lens Distortion Correction Using Convolutional Neural Networks Trained with Synthesized Images. In: Computer Vision. ACCV: Proceedings of the Southwest State University. Series: Control, Computer Engineering, Information Science. Medical Instruments Engineering. 2024;14(3):144–156 13th Asian Conference on Computer Vision, Taipei, Taiwan, 20–24 November 2016. Springer; 2016. P. 35–49.

11. Kholopov I.S. Algorithm for correcting projective distortions during low-altitude photography. Komp’yuternaya optika = Computer Optics. 2017;41(2):284–290. (In Russ.)

12. Zolotukhin Yu.N., Nesterov A.A. Control of the angular position of an aircraft. Avtometriya = Autometry. 2015;51(5):35–41. (In Russ.)

13. Alpatov B.A., Ershov M.D., Feldman A.B. Image processing algorithm for combined vision system of aircraft. Cifrovaya Obrabotka Signalov = Digital Signal Processing. 2015;(3):8–14. (In Russ.)

14. Belov Yu.S., Rybkin S.V. Mathematical models of geometrical transformations of images in a problem of the analysis of video frames. Elektronnyj zhurnal: nauka, tekhnika i obrazovanie = Electron Journal: Science, Technology and Education. 2015;(3):15–24. (In Russ.)

15. Zahlebin A.S. The technique of constructing orthophotoplanes of the terrain using an unmanned quadcopter equipped with a navigation geodetic receiver. Doklady Tomskogo gosudarstvennogo universiteta sistem upravleniya i radioelektroniki = Proceedings of TUSUR University. 2021;24(3):44–49. (In Russ.)

16. Kern A., Fanta-Jende P., Glira P., Bruckmüller F., Sulzbachner C. An accurate realtime uav mapping solution for the generation of orthomosaics and surface models. In: The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. Vol. XLIII-B1. Strasburg, France; 2021. P. 165–171.

17. Tanathong S., Smith A.P., Remde S. SurfaceView: Seamless and Tile-Based Orthomosaics Using Millions of Street-Level Images From Vehicle-Mounted Cameras. IEEE Transactions on Intelligent Transportation Systems. 2022;23(4):3482–3497.

18. Gómez-Candón D., De Castro A. I., Lopez-Granados F. The accuracy of mosaics from unmanned aerial vehicle (UAV) imagery for precision agriculture purposes in wheat. Precision Agriculture. 2014;(15):44–56.

19. Pagliari D., Pinto L., Sona G. Experimental analysis of different software packages for orientation and digital surface modelling from UAV images. Earth. Sci. Inform. 2014;(7):97–107.