LODESTAR (Live Operational Data Enhancement for Situational Awareness Through Augmented Reality) is a soldier system which aims to give to the soldier informations about all his surroundings thanks to a panoply of sensors. It also evaluate the physiological condition of the user. And it has a C4ISR aim to inform commandant of live mission process.
It is divided in 4 zones :
Head zone : AR (augmented reality) HMSD-OST (helmet Mounted Sight Display – Optical See Through) with cameras, IMU, LiDaR, displays, physiological sensors, headsets etc.
Torso zone : a nano body worn calculator for image processing, recording, streaming, SLAM, GNSS, Battery, radio, HMI, recognize forms, people, mines, etc. thanks to AI
Weapon zone : optic, camera, IMU, connected wirelessly connected to the Torso Zone (Ultra Wide Band (UWB))
External zone : UAV with VSA (Visual Situation Awareness) system, connected to the soldier
This project has received funding from the European Defence Fund (EDF) under grant agreement no. 101102526
CHALLENGES
AR HMSD-OST (respecting SWaP conditions) : the visor itself for the displays and the optics remaining stealth
Gathering all in one calculator (not to have different radio, different caluculators, etc.). All in a mini box (to avoid the soldier to carry too much components)
Gaze tracking
Head tracking in external condition (no fixed references)
SLAM
MAIN TECHNICAL CHARACTERISTICS
8K optical seethrought AR color helmet mounted display (50pix/°)
Ultra wide field of view (100° FoV)
Voice spatialisation (3D sound)
Corner shooting thermal riffle scope
Companion UAV/UGV control
High performance AI vision processor for situational awareness
HD color dark night vision sensor (NATO level 5)
Thermal infrared image sensor
Soldier health monitoring (cardio, brain activity/stress/tiredness, perspiration, temperature)
CBRN/environnement and navigation sensors
Gaze tracking/head tracking for hand free control and targeting
