Study on performance improvement of HoloLens2 tracking registration in night combat support operations

DOI:	10.11809/bqzbgcxb2023.06.008
Keywords:	HoloLens2; low illumination environment; tracking and registration; fluorescence texture; design principle
Abstract:	In view of an urgent need for nighttime combat assistance operations and the reality that the tracking and registration function of HoloLens2 fails in low light environments at night, besides the fact that the existing methods for enhancing tracking and registration in low light environments are not specially developed for HoloLens2 or for really low light environments at night, this paper proposes a method to restore the night tracking and registration of HoloLens2 by using fluorescent textures, which is used to assist auxiliary operations in night battles. Firstly, by analyzing the tracking and registration principle of HoloLens2, the key feature that can affect the tracking and registration of HoloLens2 is determined as the corner point. Secondly, the tracking and registration performance of HoloLens2 under low light at night is tested, and the minimum ambient light level at which HoloLens2 can stably track and register is determined to be 0.4 Lux. Finally, different textures are designed, and the effects of five factors on restoring the function of HoloLens2 night tracking and registration are analyzed, such as texture symmetry, texture sharpness, presence or absence of contours, mark width and feature number density. Through an analysis of the experimental results, five design principles or suggestions for textures are summarized to guide the subsequent project development in low light environments, which are indistinguishable symmetry, clear edges, envelope contours, good results due to a marker pixel width of 10 and the largest number of feature corners under the premise of the same mark width.
Published:	2023-06-28
PDF HTML