Note: Please note that this is an “archived project” and is no longer updated. This article is meant for historical purposes only.
Over the next decades, NASA wants to open the boundaries to human exploration of space, expanding our presence well beyond low-Earth orbit to advance exploration, science, innovation, benefits to humanity, and international collaboration. To achieve its deep space exploration goals, NASA needs to maximize crew efficiency and safety. New mixed reality technologies have the potential to help the agency meet this objective by reducing time needed for crew training and task execution.
The goal of the Mixed Reality Crew Assistance project is to create mixed reality tools that enhance operational procedures by augmenting what the crew sees and hears while performing a task. Specific project objectives toward creating and fielding these tools include:
- Model alignment: Aligning and rendering instructional holographic animations on top of the equipment relevant to a task
- Authoring & playback: Enabling task experts to efficiently author and revise holographic instructions
- Object recognition: Automatic recognition of objects relevant to a procedure
The key deliverable of this project is a software system ready for testing and use in support of Earth-based personnel training and onboard ISS.
