3D Visual Training (3D VIT) - 10.04.17

Overview | Description | Applications | Operations | Results | Publications | Imagery

ISS Science for Everyone

Science Objectives for Everyone
European Space Agency (ESA) developed a 3D Procedure Authoring Tool (3D PAT) currently used for building a 3 dimensional visualisation of procedures for refresher training on orbit. This technology is to be assessed for its efficiency for training of tasks occurring at short notice on orbit where no pre-flight training has taken place. This 3D Visual Training (3D VIT) could be very useful, considering the possibility of increased failures on the International Space Station (ISS) as the station ages, and lead the way towards training during future human exploration missions outside of low Earth orbit, reducing the time required for ground-based training.
Science Results for Everyone
Information Pending

The following content was provided by Frank Nicolini, and is maintained in a database by the ISS Program Science Office.
Information provided courtesy of the Erasmus Experiment Archive.
Experiment Details

OpNom: 3D Visual Training

Principal Investigator(s)
Frank Nicolini, European Space Agency/European Astronaut Centre (ESA/EAC), Cologne, Germany

Co-Investigator(s)/Collaborator(s)
RĂ¼diger Seine, Ph.D., European Space Agency/European Astronaut Centre (ESA/EAC), Cologne, Germany

Developer(s)
European Space Agency, European Astronaut Centre (ESA/EAC), Cologne, Germany
Thales Alenia Space - Italia, HQ, Rome, Italy
Advanced Logistics Technology Engineering Centre (ALTEC), Torino, Italy

Sponsoring Space Agency
European Space Agency (ESA)

Sponsoring Organization
European Space Agency

Research Benefits
Information Pending

ISS Expedition Duration
March 2015 - March 2016

Expeditions Assigned
43/44,45/46

Previous Missions
Information Pending

^ back to top

Experiment Description

Research Overview

Astronaut training for the ISS relies almost exclusively on ground training of planned activities for any given mission. On board training is mostly used to maintain a set of perishable skills (e.g. complex manual activities, emergency response, robotics). As the ISS ages, it is expected that failures will occur more often, and that a shorter reaction cycle for the crew is required. This could be accomplished by training the crew on orbit for tasks that have not been trained on the ground, using the philosophy behind 3D Visual Training (3D VIT).
 
ESA has already developed a 3D Procedure Authoring Tool (3D PAT) that targets instructors and technical specialists to build a 3 dimensional visualisation of procedures that can be used for refresher training, but this may also be efficient for training of tasks occurring at short notice on orbit. This technology has already been used for refresher training during the ATV4 and ATV5 missions. The present experiment is needed to demonstrate that the technology can also be used efficiently on the ISS for tasks that have not been covered in pre-flight training.

Description
Training using 3D Visual Training (3D VIT) is performed prior to on board task execution. The operational sequence consists of: tool setup and content transfer (activation), on board training session (OBT), and task execution.

^ back to top

Applications

Space Applications
It is expected that the 3D visualisation technology could prove to be an efficient and effective tool to prepare crew members for tasks that were not trained for on the ground. Once the technology is used successfully on the ISS, it could also lead the way towards training during future human exploration missions outside of low Earth orbit. This could considerably reduce the time required for ground based training. Since no instructor/trainee interaction is required, delays in the communication link would not be a problem. In addition, the crew could use the travel time in a meaningful way to prepare for tasks at the destination of the exploration mission. In case of a successful outcome, this could reduce the turn-around time for generation of onboard training significantly, with the target being one week after identification of the activity in which to be trained.

Earth Applications
With the remote nature of human spaceflight for which this technology is advantageous, there are obviously similarities that can be drawn on Earth with respect to remote training potential, whether we are talking about Antarctic stations, mountainous areas, or undeveloped areas without good transport access for example. This type of technology could therefore be especially important in contingency situations. Additionally the highly interactive visualisation of complex manual activities might be very useful in various industrial applications.

^ back to top

Operations

Operational Requirements and Protocols

The ISS crew member will not receive ground training on the tasks to be trained using 3D visualisation. The crew member reviews the on-board training material provided on a Space Station Computer (SSC) or iPad during a period of scheduled on-board-training prior to performing the selected task. The task execution using the regular procedure including 3D visualisation as reference is observed, if possible, via video downlink. Post flight, the crew member is interviewed to provide feedback on the experience with the training tool.
 
For each of the 3 expected tasks, a training session 15 minutes (target duration, maximum duration 30 minutes) shall be scheduled. Exact duration of the training sessions are determined through dry-runs on the ground.
 
Crew feedback on tool usage is provided by on board crew within 3 days after execution of the activity based on questions posted in the Data Collection Tool (OCT) for the training session.

^ back to top

Decadal Survey Recommendations

Information Pending

^ back to top

Results/More Information

Information Pending

^ back to top

Related Websites
ESA Erasmus Database

^ back to top


Imagery

image
A screenshot of the 3D-ViT training tool that allows astronauts to run through complicated hardware setups before doing them on the International Space Station. Here the Haptics/Interact experiment setup is shown. Image courtesy of ESA.

+ View Larger Image