Suggested Searches

14 min read

SEH References Cited

Contents

Appendix A    Acronyms  
Appendix B    Glossary  
Appendix C    How to Write a Good Requirement— Checklist
Appendix D    Requirements Verification Matrix  
Appendix E    Creating the Validation Plan with a Validation Requirements Matrix
Appendix F    Functional, Timing, and State Analysis
Appendix G    Technology Assessment/Insertion
Appendix H    Integration Plan Outline
Appendix I     Verification and Validation Plan Outline
Appendix J     SEMP Content Outline
Appendix K    Technical Plans
Appendix L     Interface Requirements Document Outline
Appendix M    CM Plan Outline
Appendix N    Guidance on Technical Peer Reviews/Inspections
Appendix O    Reserved
Appendix P    SOW Review Checklist
Appendix Q    Reserved
Appendix R    HSI Plan Content Outline
Appendix S    Concept of Operations Annotated Outline
Appendix T    Systems Engineering in Phase E

References Cited
Bibliography

This appendix contains references that were cited in the sections of the handbook.

Preface

NPR 7123.1, Systems Engineering Processes and Requirements

NASA Chief Engineer and the NASA Integrated Action Team (NIAT) report, Enhancing Mission Success – A Framework for the Future, December 21, 2000. Authors: McBrayer, Robert O and Thomas, Dale, NASA Marshall Space Flight Center, Huntsville, AL United States.

NASA. Columbia Accident Investigation Board (CAIB) Report, 6 volumes: Aug. 26, Oct. 2003. https://www.nasa.gov/columbia/caib/html/report.html

NASA. Diaz Report, A Renewed Commitment to Excellence: An Assessment of the NASA Agency-wide Applicability of the Columbia Accident Investigation Board Report, January 30, 2004. Mr. Al Diaz, Director, Goddard Space Flight Center, and team.

International Organization for Standardization (ISO) 9000:2015, Quality management systems – Fundamentals and vocabulary. Geneva: International Organization for Standardization, 2015.

Section 1.1 Purpose

NPR 7123.1. Systems Engineering Processes and Requirements

Section 1.2 Scope and Depth

NASA Office of Chief Information Officer (OCIO), Information Technology Systems Engineering Handbook Version 2.0

NASA-HDBK-2203, NASA Software Engineering Handbook (February 28, 2013)

Section 2.0 Fundamentals of Systems Engineering

NPR 7120.5, NASA Space Flight Program and Project Management Requirements

NPR 7120.7, NASA Information Technology and Institutional Infrastructure Program and Project Management Requirements

NPR 7120.8, NASA Research and Technology Program and Project Management Requirements

NPR 7123.1, NASA Systems Engineering Processes and Requirements

NASA Engineering Network (NEN) Systems Engineering Community of Practice (SECoP), located at https://nen.nasa.gov/web/se

Griffin, Michael D., NASA Administrator. “System Engineering and the Two Cultures of Engineering.” Boeing Lecture, Purdue University, March 28, 2007.

Rechtin, Eberhardt. Systems Architecting of Organizations: Why Eagles Can’t Swim. Boca Raton: CRC Press, 2000.

Section 2.1 The Common Technical Processes and the SE Engine

NPR 7123.1, NASA Systems Engineering Processes and Requirements

Society of Automotive Engineers (SAE) and the European Association of Aerospace Industries (EAAI). AS9100C Quality Management Systems (QMS) – Requirements for Aviation, Space, and Defense Organizations Revision C: January 15, 2009.

Section 2.3 Example of Using the SE Engine

NPD 1001.0, 2006 NASA Strategic Plan

NPR 7120.5, NASA Space Flight Program and Project Management Requirements

Section 2.5 Cost Effectiveness Considerations

Department of Defense (DOD) Defense Acquisition University (DAU). Systems Engineering Fundamentals Guide. Fort Belvoir, VA, 2001.

INCOSE-TP-2003-002-04, Systems Engineering Handbook: A Guide for System Life Cycle Processes and Activities, Version 4, edited by Walden, David D., et al., 2015

Section 2.6 Human Systems Integration (HSI) in the SE Process

NPR 7120.5, NASA Space Flight Program and Project Management Requirements

NPR 7123.1, NASA Systems Engineering Processes and Requirements

Section 3.0 NASA Program/Project Life Cycle

NPR 7120.5, NASA Space Flight Program and Project Management Requirements

NPR 7120.8, NASA Research and Technology Program and Project Management Requirements

NASA Office of the Chief Information Officer (OCIO), Information Technology Systems Engineering Handbook Version 2.0

NASA/SP-2014-3705, NASA Space Flight Program and Project Management Handbook

Section 3.1 Program Formulation

NPR 7120.5, NASA Space Flight Program and Project Management Requirements

NPR 7120.7, NASA Information Technology and Institutional Infrastructure Program and Project Management Requirements

NPR 7120.8, NASA Research and Technology Program and Project Management Requirements

NPR 7123.1, NASA Systems Engineering Processes and Requirements

Section 3.2 Program Implementation

NPR 7120.5, NASA Space Flight Program and Project Management Requirements

NPR 7123.1, NASA Systems Engineering Processes and Requirements

Section 3.3 Project Pre-Phase A: Concept Studies

NPR 7120.5, NASA Space Flight Program and Project Management Requirements

NPR 7123.1, NASA Systems Engineering Processes and Requirements

Section 3.4 Project Phase A: Concept and Technology Development

NPD 1001.0, 2014 NASA Strategic Plan

NPR 2810.1, Security of Information Technology

NPR 7120.5, NASA Space Flight Program and Project Management Requirements

NPR 7123.1, NASA Systems Engineering Processes and Requirements

NPR 7150.2, NASA Software Engineering Requirements

NASA-STD-8719.14, Handbook for Limiting Orbital Debris. Rev A with Change 1. December 8, 2011.

National Institute of Standards and Technology (NIST), Federal Information Processing Standard Publication (FIPS PUB) 199, Standards for Security Categorization of Federal Information and Information Systems, February 2004.

Section 3.5 Project Phase B: Preliminary Design and Technology Completion

NPR 7120.5, NASA Space Flight Program and Project Management Requirements

NPR 7123.1, NASA Systems Engineering Processes and Requirements

Section 3.6 Project Phase C: Final Design and Fabrication

NPR 7120.5, NASA Space Flight Program and Project Management Requirements

NPR 7123.1, NASA Systems Engineering Processes and Requirements

Section 3.7 Project Phase D: System Assembly, Integration and Test, Launch

NPR 7120.5, NASA Space Flight Program and Project Management Requirements

NPR 7123.1, NASA Systems Engineering Processes and Requirements

NASA Office of the Chief Information Officer (OCIO), Information Technology Systems Engineering Handbook Version 2.0

Section 3.8 Project Phase E: Operations and Sustainment

NPR 7120.5, NASA Space Flight Program and Project Management Requirements

NPR 7123.1, NASA Systems Engineering Processes and Requirements

Section 3.9 Project Phase F: Closeout

NPR 7120.5, NASA Space Flight Program and Project Management Requirements

NPR 7123.1, NASA Systems Engineering Processes and Requirements

NPD 8010.3, Notification of Intent to Decommission or Terminate Operating Space Systems and Terminate Missions

NPR 8715.6, NASA Procedural Requirements for Limiting Orbital Debris

Section 3.10 Funding: The Budget Cycle

NASA’s Financial Management Requirements (FMR) Volume 4

Section 3.11 Tailoring and Customization of NPR 7123.1 Requirements

NPD 1001.0, 2014 NASA Strategic Plan

NPR 7120.5, NASA Space Flight Program and Project Management Requirements

NPR 7120.7, NASA Information Technology and Institutional Infrastructure Program and Project Management Requirements

NPR 7120.8, NASA Research and Technology Program and Project Management Requirements

NPR 7123.1, NASA Systems Engineering Processes and Requirements

NPR 7150.2, NASA Software Engineering Requirements

NPR 8705.4, Risk Classification for NASA Payloads

NASA-HDBK-2203, NASA Software Engineering Handbook (February 28, 2013)

NASA Engineering Network (NEN) Systems Engineering Community of Practice (SECoP), located at https://nen.nasa.gov/web/se

Section 4.1 Stakeholder Expectations Definition

NPR 7120.5, NASA Space Flight Program and Project Management Requirements

NASA Science Mission Directorate strategic plans

Presidential Policy Directive PPD-4 (2010), National Space Policy

Presidential Policy Directive PPD-21 (2013), Critical Infrastructure Security and Resilience

Ball, Robert E. (Naval Postgraduate School), The Fundamentals of Aircraft Combat Survivability Analysis and Design, 2nd Edition, AIAA Education Series, 2003

Larson (Wiley J.), Kirkpatrick, Sellers, Thomas, and Verma. Applied Space Systems Engineering: A Practical Approach to Achieving Technical Baselines. 2nd Edition,

Boston, MA: McGraw-Hill Learning Solutions, CEI Publications, 2009.

Section 4.2 Technical Requirements Definition

NPR 7120.10, Technical Standards for NASA Programs and Projects

NPR 8705.2, Human-Rating Requirements for Space Systems

NPR 8715.3, NASA General Safety Program Requirements

NASA-STD-3001, NASA Space Flight Human System Standard – 2 volumes

NASA-STD-8719.13, Software Safety Standard, Rev C. Washington, DC, May 7, 2013.

NASA/SP-2010-3407, Human Integration Design Handbook (HIDH)

Section 4.3 Logical Decomposition

Department of Defense (DOD) Architecture Framework (DODAF) Version 2.02 Change 1, January 2015

Institute of Electrical and Electronics Engineers (IEEE) STD 610.12-1990, IEEE Standard Glossary of Software Engineering Terminology. Reaffirmed 2002. Superseded by ISO/IEC/IEEE 24765:2010, Systems and Software Engineering – Vocabulary

Section 4.4 Design Solution Definition

NPD 8730.5, NASA Quality Assurance Program Policy

NPR 8735.2, Management of Government Quality Assurance Functions for NASA Contracts

NASA-HDBK-1002, Fault Management (FM) Handbook, Draft 2, April 2012.

NASA-STD-3001, NASA Space Flight Human System Standard – 2 volumes

NASA-STD-8729.1, Planning, Developing, and Maintaining an Effective Reliability and Maintainability (R&M) Program. Washington, DC, December 1, 1998.

Code of Federal Regulations (CFR), Title 48 – Federal Acquisition Regulation (FAR) System, Part 46.4 Government Contract Quality Assurance (48 CFR 46.4)

International Organization for Standardization, ISO 9001:2015 Quality Management Systems (QMS)

Society of Automotive Engineers and the European Association of Aerospace Industries. AS9100C Quality Management Systems (QMS)—Requirements for Aviation, Space, and Defense Organizations Revision C: 2009-01-15

Blanchard, Benjamin S., System Engineering Management. 4th Edition, Hoboken, NJ: John Wiley & Sons, Inc., 2008

Section 5.1 Product Implementation

NPR 7150.2, NASA Software Engineering Requirements

NASA Engineering Network (NEN) Systems Engineering Community of Practice (SECoP), located at https://nen.nasa.gov/web/se

NASA Engineering Network (NEN) V&V Community of Practice, located at https://nen.nasa.gov/web/se

American Institute of Aeronautics and Astronautics (AIAA) G-118-2006e. AIAA Guide for Managing the Use of Commercial Off the Shelf (COTS) Software Components for Mission-Critical Systems. Reston, VA, 2006

Section 5.2 Product Integration

NASA Lyndon B. Johnson Space Center (JSC-60576), National Space Transportation System (NSTS), Space Shuttle Program, Transition Management Plan, May 9, 2007

Section 5.3 Product Verification

NPR 7120.5, NASA Space Flight Program and Project Management Requirements

NPR 7120.8, NASA Research and Technology Program and Project Management Requirements

NPR 7123.1, NASA Systems Engineering Processes and Requirements

NPR 8705.4, Risk Classification for NASA Payloads

NASA-STD-7009, Standard for Models and Simulations. Washington, DC, October 18, 2013

NASA GSFC-STD-7000, Goddard Technical Standard: General Environmental Verification Standard (GEVS) for GSFC Flight Programs and Projects. Goddard Space Flight Center. April 2005

Department of Defense (DOD). MIL-STD-1540D, Product Verification Requirements for Launch, Upper Stage, and Space Vehicles. January 15, 1999

Section 5.4 Product Validation

NPD 7120.4, NASA Engineering and Program/Project Management Policy

NPR 7150.2, NASA Software Engineering Requirements

Section 5.5 Product Transition

(The) National Environmental Policy Act of 1969 (NEPA). See 42 U.S.C. 4321-4347. https://ceq.doe.gov/

Section 6.1 Technical Planning

NPR 7120.5, NASA Space Flight Program and Project Management Requirements

NPD 7120.6, Knowledge Policy on Programs and Projects

NPR 7123.1, NASA Systems Engineering Processes and Requirements

NASA-SP-2010-3403, NASA Schedule Management Handbook

NASA-SP-2010-3404, NASA Work Breakdown Structure Handbook

NASA Cost Estimating Handbook (CEH), Version 4, February 2015.

DOD. MIL-STD-881C, Work Breakdown Structure (WBS) for Defense Materiel Items. Washington, DC, October 3, 2011.

Institute of Electrical and Electronics Engineers (IEEE) STD 1220-2005. IEEE Standard for Application and Management of the Systems Engineering Process, Washington, DC, 2005.

Office of Management and Budget (OMB) Circular A-94, “Guidelines and Discount Rates for Benefit-Cost Analysis of Federal Programs” (10/29/1992)

Joint (cost and schedule) Confidence Level (JCL). Frequently asked questions (FAQs) can be found at: https://www.nasa.gov/wp-content/uploads/2019/10/394931main_JCL_FAQ_10_12_09.pdf?emrc=aaf47a

The U. S. Chemical Safety Board (CSB) case study reports on mishaps found at: http://www.csb.gov/

Section 6.3 Interface Management

NPR 7120.5, NASA Space Flight Program and Project Management Requirements

Section 6.4 Technical Risk Management

NPR 8000.4, Agency Risk Management Procedural Requirements

NASA/SP-2010-576, NASA Risk-Informed Decision Making Handbook

NASA/SP-2011-3421, Probabilistic Risk Assessment Procedures Guide for NASA Managers and Practitioners

NASA/SP-2011-3422, NASA Risk Management Handbook

Code of Federal Regulations (CFR) Title 22 – Foreign Relations, Parts 120-130 Department of State: International Traffic in Arms Regulations (ITAR) (22 CFR 120-130).

Implements 22 U.S.C. 2778 of the Arms Export Control Act (AECA) of 1976 and Executive Order 13637, “Administration of Reformed Export Controls,” March 8, 2013

Section 6.5 Configuration Management

NPR 7120.5, NASA Space Flight Program and Project Management Requirements

NASA. Columbia Accident Investigation Board (CAIB) Report, 6 volumes: Aug. 26, Oct. 2003. https://www.nasa.gov/columbia/caib/html/report.html

NASA. NOAA N-Prime Mishap Investigation Final Report, Sept. 13, 2004 https://www.nasa.gov/wp-content/uploads/2015/01/65776main_noaa_np_mishap.pdf?emrc=8ee322

SAE International (SAE)/Electronic Industries Alliance (EIA) 649B-2011, Configuration Management Standard (Aerospace Sector) April 1, 2011

American National Standards Institute (ANSI)/Electronic Industries Alliance (EIA). ANSI/EIA-649, National Consensus Standard for Configuration Management, 1998–1999

Section 6.6 Technical Data Management

NPR 1441.1, NASA Records Retention Schedules

NPR 1600.1, NASA Security Program Procedural Requirements

NID 1600.55, Sensitive But Unclassified (SBU) Controlled Information

NPR 7120.5, NASA Space Flight Program and Project Management Requirements

NPR 7123.1, NASA Systems Engineering Processes and Requirements

NASA Form (NF) 1686, NASA Scientific and Technical Document Availability Authorization (DAA) for Administratively Controlled Information.

Code of Federal Regulations (CFR) Title 22 – Foreign Relations, Parts 120-130 Department of State: International Traffic in Arms Regulations (ITAR) (22 CFR 120-130).

Implements 22 U.S.C. 2778 of the Arms Export Control Act (AECA) of 1976 and Executive Order 13637, “Administration of Reformed Export Controls,” March 8, 2013

The Invention Secrecy Act of 1951, 35 U.S.C. §181–§188. Secrecy of Certain Inventions and Filing Applications in Foreign Country; §181 – Secrecy of Certain Inventions and Withholding of Patent.

Code of Federal Regulations (CFR) Title 37 – Patents, Trademarks, and Copyrights; Part 5 Secrecy of Certain Inventions and Licenses to Export and File Applications in

Foreign Countries; Part 5.2 Secrecy Order. (37 CFR 5.2)

Section 6.7 Technical Assessment

NPR 1080.1, Requirements for the Conduct of NASA Research and Technology (R&T)

NPR 7120.5, NASA Space Flight Program and Project Management Requirements

NPR 7120.7, NASA Information Technology and Institutional Infrastructure Program and Project Management Requirements

NPR 7120.8, NASA Research and Technology Program and Project Management Requirements

NPR 7123.1, NASA Systems Engineering Processes and Requirements

NPR 8705.4, Risk Classification for NASA Payloads

NPR 8705.6, Safety and Mission Assurance (SMA) Audits, Reviews, and Assessments

NPR 8715.3, NASA General Safety Program Requirements

NASA-HDBK-2203, NASA Software Engineering Handbook. February 28, 2013

NASA/SP-2012-599, NASA’s Earned Value Management (EVM) Implementation Handbook

NASA Federal Acquisition Regulation (FAR) Supplement (NFS) 1834.201, Earned Value Management System Policy.

NASA EVM website http://evm.nasa.gov/index.html

NASA Engineering Network (NEN) EVM Community of Practice located at https://nen.nasa.gov/web/pm/evm

NASA Engineering Network (NEN) Systems Engineering Community of Practice (SECoP) under Tools and Methods at https://nen.nasa.gov/web/se/tools/ and then NASA Tools & Methods

American National Standards Institute/Electronic Industries Alliance (ANSI-EIA), Standard 748-C Earned Value Management Systems. March, 2013.

International Council on Systems Engineering (INCOSE). INCOSE-TP-2003-020-01, Technical Measurement, Version 1.0, 27 December 2005. Prepared by Garry J. Roedler (Lockheed Martin) and Cheryl Jones (U.S. Army).

Section 6.8 Decision Analysis

NPR 7120.5, NASA Space Flight Program and Project Management Requirements

NPR 7123.1, NASA Systems Engineering Processes and Requirements

Brughelli, Kevin (Lockheed Martin), Deborah Carstens (Florida Institute of Technology), and Tim Barth (Kennedy Space Center), “Simulation Model Analysis Techniques,” Lockheed Martin presentation to KSC, November 2003

Saaty, Thomas L. The Analytic Hierarchy Process. New York: McGraw-Hill, 1980

Appendix B: Glossary

NPR 2210.1, Release of NASA Software

NPD 7120.4, NASA Engineering and Program/Project Management Policy

NPR 7120.5, NASA Space Flight Program and Project Management Requirements

NPR 7123.1, NASA Systems Engineering Processes and Requirements

NPR 7150.2, NASA Software Engineering Requirements

NPR 8000.4, Agency Risk Management Procedural Requirements

NPR 8705.2, Human-Rating Requirements for Space Systems

NPR 8715.3, NASA General Safety Program Requirements

International Organization for Standardization (ISO). ISO/IEC/IEEE 42010:2011. Systems and Software Engineering – Architecture Description. Geneva: International Organization for Standardization, 2011. (http://www.iso-architecture.org/ieee-1471/index.html)

Avizienis, A., J.C. Laprie, B. Randell, C. Landwehr, “Basic concepts and taxonomy of dependable and secure computing,” IEEE Transactions on Dependable and Secure Computing 1 (1), 11–33, 2004

Appendix F: Functional, Timing, and State Analysis

NASA Reference Publication 1370, Training Manual for Elements of Interface Definition and Control. 1997

Defense Acquisition University. Systems Engineering Fundamentals Guide. Fort Belvoir, VA, 2001

Buede, Dennis. The Engineering Design of Systems: Models and Methods. New York: Wiley & Sons, 2000

Long, James E. Relationships Between Common Graphical Representations in Systems Engineering. Vienna, VA: Vitech Corporation, 2002

Sage, Andrew, and William Rouse. The Handbook of Systems Engineering and Management. New York: Wiley & Sons, 1999

Appendix G: Technology Assessment/Insertion

NPR 7120.5, NASA Space Flight Program and Project Management Requirements

NPR 7123.1, NASA Systems Engineering Processes and Requirements

Appendix H: Integration Plan Outline

Federal Highway Administration and CalTrans, Systems Engineering Guidebook for ITS, Version 2.0. Washington, DC: U.S. Department of Transportation, 2007

Appendix J: SEMP Content Outline

NPR 7120.5, NASA Space Flight Program and Project Management Requirements

NPR 7123.1, Systems Engineering Processes and Requirements

Appendix K: Technical Plans

NPR 7120.5, NASA Space Flight Program and Project Management Requirements

Appendix M: CM Plan Outline

SAE International (SAE)/Electronic Industries Alliance (EIA) 649B-2011, Configuration Management Standard (Aerospace Sector) April 1, 2011

Appendix N: Guidance on Technical Peer Reviews/Inspections

NPR 7123.1, Systems Engineering Processes and Requirements

NPR 7150.2, NASA Software Engineering Requirements

NASA Langley Research Center (LARC), Instructional Handbook for Formal Inspections. http://sw-eng.larc.nasa.gov/files/2013/05/Instructional-Handbook-for-Formal-Inspections.pdf

Appendix P: SOW Review Checklist

NASA Langley Research Center (LaRC) Procedural Requirements (LPR) 5000.2 Procurement Initiator’s Guide

NASA Langley Research Center (LaRC) Guidance on System and Software Metrics for Performance-Based Contracting sites-e.larc.nasa.gov/sweng/files/2013/05/Guidance_on_Metrics_for_PBC_R1V01.doc

Appendix R: HSI Plan Content Outline

NPR 7123.1, NASA Systems Engineering Processes and Requirements

NPR 8705.2, Human-Rating Requirements for Space Systems

NASA-STD-3001, Space Flight Human-System Standard, Volume 2: Human Factors, Habitability, and Environmental Health, Section 3.5 [V2 3005], “Human-Centered Design Process.” February 10, 2015