Appendix A Acronyms
Appendix B Glossary
Appendix C How to Write a Good Requirement— Checklist
Appendix D Requirements Verification Matrix
Appendix E Creating the Validation Plan with a Validation Requirements Matrix
Appendix F Functional, Timing, and State Analysis
Appendix G Technology Assessment/Insertion
Appendix H Integration Plan Outline
Appendix I Verification and Validation Plan Outline
Appendix J SEMP Content Outline
Appendix K Technical Plans
Appendix L Interface Requirements Document Outline
Appendix M CM Plan Outline
Appendix N Guidance on Technical Peer Reviews/Inspections
Appendix O Reserved
Appendix P SOW Review Checklist
Appendix Q Reserved
Appendix R HSI Plan Content Outline
Appendix S Concept of Operations Annotated Outline
Appendix T Systems Engineering in Phase E
References Cited
Bibliography
This appendix contains references that were cited in the sections of the handbook.
Preface
NPR 7123.1, Systems Engineering Processes and Requirements
NASA Chief Engineer and the NASA Integrated Action Team (NIAT) report, Enhancing Mission Success – A Framework for the Future, December 21, 2000. Authors: McBrayer, Robert O and Thomas, Dale, NASA Marshall Space Flight Center, Huntsville, AL United States.
NASA. Columbia Accident Investigation Board (CAIB) Report, 6 volumes: Aug. 26, Oct. 2003. https://www.nasa.gov/columbia/caib/html/report.html
NASA. Diaz Report, A Renewed Commitment to Excellence: An Assessment of the NASA Agency-wide Applicability of the Columbia Accident Investigation Board Report, January 30, 2004. Mr. Al Diaz, Director, Goddard Space Flight Center, and team.
International Organization for Standardization (ISO) 9000:2015, Quality management systems – Fundamentals and vocabulary. Geneva: International Organization for Standardization, 2015.
Section 1.1 Purpose
NPR 7123.1. Systems Engineering Processes and Requirements
Section 1.2 Scope and Depth
NASA Office of Chief Information Officer (OCIO), Information Technology Systems Engineering Handbook Version 2.0
NASA-HDBK-2203, NASA Software Engineering Handbook (February 28, 2013)
Section 2.0 Fundamentals of Systems Engineering
NPR 7120.5, NASA Space Flight Program and Project Management Requirements
NPR 7120.7, NASA Information Technology and Institutional Infrastructure Program and Project Management Requirements
NPR 7120.8, NASA Research and Technology Program and Project Management Requirements
NPR 7123.1, NASA Systems Engineering Processes and Requirements
NASA Engineering Network (NEN) Systems Engineering Community of Practice (SECoP), located at https://nen.nasa.gov/web/se
Griffin, Michael D., NASA Administrator. “System Engineering and the Two Cultures of Engineering.” Boeing Lecture, Purdue University, March 28, 2007.
Rechtin, Eberhardt. Systems Architecting of Organizations: Why Eagles Can’t Swim. Boca Raton: CRC Press, 2000.
Section 2.1 The Common Technical Processes and the SE Engine
NPR 7123.1, NASA Systems Engineering Processes and Requirements
Society of Automotive Engineers (SAE) and the European Association of Aerospace Industries (EAAI). AS9100C Quality Management Systems (QMS) – Requirements for Aviation, Space, and Defense Organizations Revision C: January 15, 2009.
Section 2.3 Example of Using the SE Engine
NPD 1001.0, 2006 NASA Strategic Plan
NPR 7120.5, NASA Space Flight Program and Project Management Requirements
Section 2.5 Cost Effectiveness Considerations
Department of Defense (DOD) Defense Acquisition University (DAU). Systems Engineering Fundamentals Guide. Fort Belvoir, VA, 2001.
INCOSE-TP-2003-002-04, Systems Engineering Handbook: A Guide for System Life Cycle Processes and Activities, Version 4, edited by Walden, David D., et al., 2015
Section 2.6 Human Systems Integration (HSI) in the SE Process
NPR 7120.5, NASA Space Flight Program and Project Management Requirements
NPR 7123.1, NASA Systems Engineering Processes and Requirements
Section 3.0 NASA Program/Project Life Cycle
NPR 7120.5, NASA Space Flight Program and Project Management Requirements
NPR 7120.8, NASA Research and Technology Program and Project Management Requirements
NASA Office of the Chief Information Officer (OCIO), Information Technology Systems Engineering Handbook Version 2.0
NASA/SP-2014-3705, NASA Space Flight Program and Project Management Handbook
Section 3.1 Program Formulation
NPR 7120.5, NASA Space Flight Program and Project Management Requirements
NPR 7120.7, NASA Information Technology and Institutional Infrastructure Program and Project Management Requirements
NPR 7120.8, NASA Research and Technology Program and Project Management Requirements
NPR 7123.1, NASA Systems Engineering Processes and Requirements
Section 3.2 Program Implementation
NPR 7120.5, NASA Space Flight Program and Project Management Requirements
NPR 7123.1, NASA Systems Engineering Processes and Requirements
Section 3.3 Project Pre-Phase A: Concept Studies
NPR 7120.5, NASA Space Flight Program and Project Management Requirements
NPR 7123.1, NASA Systems Engineering Processes and Requirements
Section 3.4 Project Phase A: Concept and Technology Development
NPD 1001.0, 2014 NASA Strategic Plan
NPR 2810.1, Security of Information Technology
NPR 7120.5, NASA Space Flight Program and Project Management Requirements
NPR 7123.1, NASA Systems Engineering Processes and Requirements
NPR 7150.2, NASA Software Engineering Requirements
NASA-STD-8719.14, Handbook for Limiting Orbital Debris. Rev A with Change 1. December 8, 2011.
National Institute of Standards and Technology (NIST), Federal Information Processing Standard Publication (FIPS PUB) 199, Standards for Security Categorization of Federal Information and Information Systems, February 2004.
Section 3.5 Project Phase B: Preliminary Design and Technology Completion
NPR 7120.5, NASA Space Flight Program and Project Management Requirements
NPR 7123.1, NASA Systems Engineering Processes and Requirements
Section 3.6 Project Phase C: Final Design and Fabrication
NPR 7120.5, NASA Space Flight Program and Project Management Requirements
NPR 7123.1, NASA Systems Engineering Processes and Requirements
Section 3.7 Project Phase D: System Assembly, Integration and Test, Launch
NPR 7120.5, NASA Space Flight Program and Project Management Requirements
NPR 7123.1, NASA Systems Engineering Processes and Requirements
NASA Office of the Chief Information Officer (OCIO), Information Technology Systems Engineering Handbook Version 2.0
Section 3.8 Project Phase E: Operations and Sustainment
NPR 7120.5, NASA Space Flight Program and Project Management Requirements
NPR 7123.1, NASA Systems Engineering Processes and Requirements
Section 3.9 Project Phase F: Closeout
NPR 7120.5, NASA Space Flight Program and Project Management Requirements
NPR 7123.1, NASA Systems Engineering Processes and Requirements
NPD 8010.3, Notification of Intent to Decommission or Terminate Operating Space Systems and Terminate Missions
NPR 8715.6, NASA Procedural Requirements for Limiting Orbital Debris
Section 3.10 Funding: The Budget Cycle
NASA’s Financial Management Requirements (FMR) Volume 4
Section 3.11 Tailoring and Customization of NPR 7123.1 Requirements
NPD 1001.0, 2014 NASA Strategic Plan
NPR 7120.5, NASA Space Flight Program and Project Management Requirements
NPR 7120.7, NASA Information Technology and Institutional Infrastructure Program and Project Management Requirements
NPR 7120.8, NASA Research and Technology Program and Project Management Requirements
NPR 7123.1, NASA Systems Engineering Processes and Requirements
NPR 7150.2, NASA Software Engineering Requirements
NPR 8705.4, Risk Classification for NASA Payloads
NASA-HDBK-2203, NASA Software Engineering Handbook (February 28, 2013)
NASA Engineering Network (NEN) Systems Engineering Community of Practice (SECoP), located at https://nen.nasa.gov/web/se
Section 4.1 Stakeholder Expectations Definition
NPR 7120.5, NASA Space Flight Program and Project Management Requirements
NASA Science Mission Directorate strategic plans
Presidential Policy Directive PPD-4 (2010), National Space Policy
Presidential Policy Directive PPD-21 (2013), Critical Infrastructure Security and Resilience
Ball, Robert E. (Naval Postgraduate School), The Fundamentals of Aircraft Combat Survivability Analysis and Design, 2nd Edition, AIAA Education Series, 2003
Larson (Wiley J.), Kirkpatrick, Sellers, Thomas, and Verma. Applied Space Systems Engineering: A Practical Approach to Achieving Technical Baselines. 2nd Edition,
Boston, MA: McGraw-Hill Learning Solutions, CEI Publications, 2009.
Section 4.2 Technical Requirements Definition
NPR 7120.10, Technical Standards for NASA Programs and Projects
NPR 8705.2, Human-Rating Requirements for Space Systems
NPR 8715.3, NASA General Safety Program Requirements
NASA-STD-3001, NASA Space Flight Human System Standard – 2 volumes
NASA-STD-8719.13, Software Safety Standard, Rev C. Washington, DC, May 7, 2013.
NASA/SP-2010-3407, Human Integration Design Handbook (HIDH)
Section 4.3 Logical Decomposition
Department of Defense (DOD) Architecture Framework (DODAF) Version 2.02 Change 1, January 2015
Institute of Electrical and Electronics Engineers (IEEE) STD 610.12-1990, IEEE Standard Glossary of Software Engineering Terminology. Reaffirmed 2002. Superseded by ISO/IEC/IEEE 24765:2010, Systems and Software Engineering – Vocabulary
Section 4.4 Design Solution Definition
NPD 8730.5, NASA Quality Assurance Program Policy
NPR 8735.2, Management of Government Quality Assurance Functions for NASA Contracts
NASA-HDBK-1002, Fault Management (FM) Handbook, Draft 2, April 2012.
NASA-STD-3001, NASA Space Flight Human System Standard – 2 volumes
NASA-STD-8729.1, Planning, Developing, and Maintaining an Effective Reliability and Maintainability (R&M) Program. Washington, DC, December 1, 1998.
Code of Federal Regulations (CFR), Title 48 – Federal Acquisition Regulation (FAR) System, Part 46.4 Government Contract Quality Assurance (48 CFR 46.4)
International Organization for Standardization, ISO 9001:2015 Quality Management Systems (QMS)
Society of Automotive Engineers and the European Association of Aerospace Industries. AS9100C Quality Management Systems (QMS)—Requirements for Aviation, Space, and Defense Organizations Revision C: 2009-01-15
Blanchard, Benjamin S., System Engineering Management. 4th Edition, Hoboken, NJ: John Wiley & Sons, Inc., 2008
Section 5.1 Product Implementation
NPR 7150.2, NASA Software Engineering Requirements
NASA Engineering Network (NEN) Systems Engineering Community of Practice (SECoP), located at https://nen.nasa.gov/web/se
NASA Engineering Network (NEN) V&V Community of Practice, located at https://nen.nasa.gov/web/se
American Institute of Aeronautics and Astronautics (AIAA) G-118-2006e. AIAA Guide for Managing the Use of Commercial Off the Shelf (COTS) Software Components for Mission-Critical Systems. Reston, VA, 2006
Section 5.2 Product Integration
NASA Lyndon B. Johnson Space Center (JSC-60576), National Space Transportation System (NSTS), Space Shuttle Program, Transition Management Plan, May 9, 2007
Section 5.3 Product Verification
NPR 7120.5, NASA Space Flight Program and Project Management Requirements
NPR 7120.8, NASA Research and Technology Program and Project Management Requirements
NPR 7123.1, NASA Systems Engineering Processes and Requirements
NPR 8705.4, Risk Classification for NASA Payloads
NASA-STD-7009, Standard for Models and Simulations. Washington, DC, October 18, 2013
NASA GSFC-STD-7000, Goddard Technical Standard: General Environmental Verification Standard (GEVS) for GSFC Flight Programs and Projects. Goddard Space Flight Center. April 2005
Department of Defense (DOD). MIL-STD-1540D, Product Verification Requirements for Launch, Upper Stage, and Space Vehicles. January 15, 1999
Section 5.4 Product Validation
NPD 7120.4, NASA Engineering and Program/Project Management Policy
NPR 7150.2, NASA Software Engineering Requirements
Section 5.5 Product Transition
(The) National Environmental Policy Act of 1969 (NEPA). See 42 U.S.C. 4321-4347. https://ceq.doe.gov/
Section 6.1 Technical Planning
NPR 7120.5, NASA Space Flight Program and Project Management Requirements
NPD 7120.6, Knowledge Policy on Programs and Projects
NPR 7123.1, NASA Systems Engineering Processes and Requirements
NASA-SP-2010-3403, NASA Schedule Management Handbook
NASA-SP-2010-3404, NASA Work Breakdown Structure Handbook
NASA Cost Estimating Handbook (CEH), Version 4, February 2015.
DOD. MIL-STD-881C, Work Breakdown Structure (WBS) for Defense Materiel Items. Washington, DC, October 3, 2011.
Institute of Electrical and Electronics Engineers (IEEE) STD 1220-2005. IEEE Standard for Application and Management of the Systems Engineering Process, Washington, DC, 2005.
Office of Management and Budget (OMB) Circular A-94, “Guidelines and Discount Rates for Benefit-Cost Analysis of Federal Programs” (10/29/1992)
Joint (cost and schedule) Confidence Level (JCL). Frequently asked questions (FAQs) can be found at: https://www.nasa.gov/wp-content/uploads/2019/10/394931main_JCL_FAQ_10_12_09.pdf?emrc=aaf47a
The U. S. Chemical Safety Board (CSB) case study reports on mishaps found at: http://www.csb.gov/
Section 6.3 Interface Management
NPR 7120.5, NASA Space Flight Program and Project Management Requirements
Section 6.4 Technical Risk Management
NPR 8000.4, Agency Risk Management Procedural Requirements
NASA/SP-2010-576, NASA Risk-Informed Decision Making Handbook
NASA/SP-2011-3421, Probabilistic Risk Assessment Procedures Guide for NASA Managers and Practitioners
NASA/SP-2011-3422, NASA Risk Management Handbook
Code of Federal Regulations (CFR) Title 22 – Foreign Relations, Parts 120-130 Department of State: International Traffic in Arms Regulations (ITAR) (22 CFR 120-130).
Implements 22 U.S.C. 2778 of the Arms Export Control Act (AECA) of 1976 and Executive Order 13637, “Administration of Reformed Export Controls,” March 8, 2013
Section 6.5 Configuration Management
NPR 7120.5, NASA Space Flight Program and Project Management Requirements
NASA. Columbia Accident Investigation Board (CAIB) Report, 6 volumes: Aug. 26, Oct. 2003. https://www.nasa.gov/columbia/caib/html/report.html
NASA. NOAA N-Prime Mishap Investigation Final Report, Sept. 13, 2004 https://www.nasa.gov/wp-content/uploads/2015/01/65776main_noaa_np_mishap.pdf?emrc=8ee322
SAE International (SAE)/Electronic Industries Alliance (EIA) 649B-2011, Configuration Management Standard (Aerospace Sector) April 1, 2011
American National Standards Institute (ANSI)/Electronic Industries Alliance (EIA). ANSI/EIA-649, National Consensus Standard for Configuration Management, 1998–1999
Section 6.6 Technical Data Management
NPR 1441.1, NASA Records Retention Schedules
NPR 1600.1, NASA Security Program Procedural Requirements
NID 1600.55, Sensitive But Unclassified (SBU) Controlled Information
NPR 7120.5, NASA Space Flight Program and Project Management Requirements
NPR 7123.1, NASA Systems Engineering Processes and Requirements
NASA Form (NF) 1686, NASA Scientific and Technical Document Availability Authorization (DAA) for Administratively Controlled Information.
Code of Federal Regulations (CFR) Title 22 – Foreign Relations, Parts 120-130 Department of State: International Traffic in Arms Regulations (ITAR) (22 CFR 120-130).
Implements 22 U.S.C. 2778 of the Arms Export Control Act (AECA) of 1976 and Executive Order 13637, “Administration of Reformed Export Controls,” March 8, 2013
The Invention Secrecy Act of 1951, 35 U.S.C. §181–§188. Secrecy of Certain Inventions and Filing Applications in Foreign Country; §181 – Secrecy of Certain Inventions and Withholding of Patent.
Code of Federal Regulations (CFR) Title 37 – Patents, Trademarks, and Copyrights; Part 5 Secrecy of Certain Inventions and Licenses to Export and File Applications in
Foreign Countries; Part 5.2 Secrecy Order. (37 CFR 5.2)
Section 6.7 Technical Assessment
NPR 1080.1, Requirements for the Conduct of NASA Research and Technology (R&T)
NPR 7120.5, NASA Space Flight Program and Project Management Requirements
NPR 7120.7, NASA Information Technology and Institutional Infrastructure Program and Project Management Requirements
NPR 7120.8, NASA Research and Technology Program and Project Management Requirements
NPR 7123.1, NASA Systems Engineering Processes and Requirements
NPR 8705.4, Risk Classification for NASA Payloads
NPR 8705.6, Safety and Mission Assurance (SMA) Audits, Reviews, and Assessments
NPR 8715.3, NASA General Safety Program Requirements
NASA-HDBK-2203, NASA Software Engineering Handbook. February 28, 2013
NASA/SP-2012-599, NASA’s Earned Value Management (EVM) Implementation Handbook
NASA Federal Acquisition Regulation (FAR) Supplement (NFS) 1834.201, Earned Value Management System Policy.
NASA EVM website http://evm.nasa.gov/index.html
NASA Engineering Network (NEN) EVM Community of Practice located at https://nen.nasa.gov/web/pm/evm
NASA Engineering Network (NEN) Systems Engineering Community of Practice (SECoP) under Tools and Methods at https://nen.nasa.gov/web/se/tools/ and then NASA Tools & Methods
American National Standards Institute/Electronic Industries Alliance (ANSI-EIA), Standard 748-C Earned Value Management Systems. March, 2013.
International Council on Systems Engineering (INCOSE). INCOSE-TP-2003-020-01, Technical Measurement, Version 1.0, 27 December 2005. Prepared by Garry J. Roedler (Lockheed Martin) and Cheryl Jones (U.S. Army).
Section 6.8 Decision Analysis
NPR 7120.5, NASA Space Flight Program and Project Management Requirements
NPR 7123.1, NASA Systems Engineering Processes and Requirements
Brughelli, Kevin (Lockheed Martin), Deborah Carstens (Florida Institute of Technology), and Tim Barth (Kennedy Space Center), “Simulation Model Analysis Techniques,” Lockheed Martin presentation to KSC, November 2003
Saaty, Thomas L. The Analytic Hierarchy Process. New York: McGraw-Hill, 1980
Appendix B: Glossary
NPR 2210.1, Release of NASA Software
NPD 7120.4, NASA Engineering and Program/Project Management Policy
NPR 7120.5, NASA Space Flight Program and Project Management Requirements
NPR 7123.1, NASA Systems Engineering Processes and Requirements
NPR 7150.2, NASA Software Engineering Requirements
NPR 8000.4, Agency Risk Management Procedural Requirements
NPR 8705.2, Human-Rating Requirements for Space Systems
NPR 8715.3, NASA General Safety Program Requirements
International Organization for Standardization (ISO). ISO/IEC/IEEE 42010:2011. Systems and Software Engineering – Architecture Description. Geneva: International Organization for Standardization, 2011. (http://www.iso-architecture.org/ieee-1471/index.html)
Avizienis, A., J.C. Laprie, B. Randell, C. Landwehr, “Basic concepts and taxonomy of dependable and secure computing,” IEEE Transactions on Dependable and Secure Computing 1 (1), 11–33, 2004
Appendix F: Functional, Timing, and State Analysis
NASA Reference Publication 1370, Training Manual for Elements of Interface Definition and Control. 1997
Defense Acquisition University. Systems Engineering Fundamentals Guide. Fort Belvoir, VA, 2001
Buede, Dennis. The Engineering Design of Systems: Models and Methods. New York: Wiley & Sons, 2000
Long, James E. Relationships Between Common Graphical Representations in Systems Engineering. Vienna, VA: Vitech Corporation, 2002
Sage, Andrew, and William Rouse. The Handbook of Systems Engineering and Management. New York: Wiley & Sons, 1999
Appendix G: Technology Assessment/Insertion
NPR 7120.5, NASA Space Flight Program and Project Management Requirements
NPR 7123.1, NASA Systems Engineering Processes and Requirements
Appendix H: Integration Plan Outline
Federal Highway Administration and CalTrans, Systems Engineering Guidebook for ITS, Version 2.0. Washington, DC: U.S. Department of Transportation, 2007
Appendix J: SEMP Content Outline
NPR 7120.5, NASA Space Flight Program and Project Management Requirements
NPR 7123.1, Systems Engineering Processes and Requirements
Appendix K: Technical Plans
NPR 7120.5, NASA Space Flight Program and Project Management Requirements
Appendix M: CM Plan Outline
SAE International (SAE)/Electronic Industries Alliance (EIA) 649B-2011, Configuration Management Standard (Aerospace Sector) April 1, 2011
Appendix N: Guidance on Technical Peer Reviews/Inspections
NPR 7123.1, Systems Engineering Processes and Requirements
NPR 7150.2, NASA Software Engineering Requirements
NASA Langley Research Center (LARC), Instructional Handbook for Formal Inspections. http://sw-eng.larc.nasa.gov/files/2013/05/Instructional-Handbook-for-Formal-Inspections.pdf
Appendix P: SOW Review Checklist
NASA Langley Research Center (LaRC) Procedural Requirements (LPR) 5000.2 Procurement Initiator’s Guide
NASA Langley Research Center (LaRC) Guidance on System and Software Metrics for Performance-Based Contracting sites-e.larc.nasa.gov/sweng/files/2013/05/Guidance_on_Metrics_for_PBC_R1V01.doc
Appendix R: HSI Plan Content Outline
NPR 7123.1, NASA Systems Engineering Processes and Requirements
NPR 8705.2, Human-Rating Requirements for Space Systems
NASA-STD-3001, Space Flight Human-System Standard, Volume 2: Human Factors, Habitability, and Environmental Health, Section 3.5 [V2 3005], “Human-Centered Design Process.” February 10, 2015