Computer vision and map registration enable high-precision lunar landing that wasn’t possible with the radio-based techniques during the Apollo missions. Digital cameras, computers, algorithms, and global imagery unavailable to Apollo make this now possible. Map registration is the process of matching camera image features to a pre-built database of features from a map of the Moon. This allows for an absolute position reference which is critical for the minimization of drift that results from other techniques used to determine position. Furthermore, this database could be loaded onto a spacecraft such that it could navigate without communication to the Earth, allowing for landing on the far side of the Moon where radio-location from Earth isn’t viable. The database of key points is constructed from NASA Lunar Reconnaissance Orbiter image data and processed on Earth into a compact database optimized for location lookup. During orbit, the lander’s computer can ask for the points that it should be observing, and then compare those to the points that it actually sees in order to compute its actual absolute position.
Under drastic lighting conditions or in locations where map data is not available at a sufficiently high quality, we use image analysis between pictures taken by the lander over time. Looking at pairs of successive images, we identify the “features” of each image—the critical points of the lunar surface that are likely to be identifiable in a picture taken under varying conditions (i.e. changing light, rotation, scaling, etc.). These are marked by the multicolored circles in the video. Each of the features of the first image are matched against those of the second image to determine pairs of corresponding features. Once the location of specific features in both images is determined, the amount of motion and rotation can be calculated. These values are relative to the images themselves, but given an estimate of the relationship between the size of the image and the area of the lunar surface that it represents, the motion of the camera can be computed in meters.
This graph represents an estimated and actual X and Y trajectory. The red line in this graph represents a simulated trajectory of a lunar lander where the lander is at a constant altitude of 300 meters above the lunar surface and is moving away from a skylight visible at the start of the video. The blue line represents the estimated trajectory of the lander as computed by the software demonstrated in the first half of the video. As the software computes the change in motion based upon its own current position estimate, the drift of the estimated position relative to the actual lander position is compounded over time. This will be corrected by the map registration process to provide an accurate position over time.






























