Appendix A Acronyms
Appendix B Glossary
Appendix C How to Write a Good Requirement— Checklist
Appendix D Requirements Verification Matrix
Appendix E Creating the Validation Plan with a Validation Requirements Matrix
Appendix F Functional, Timing, and State Analysis
Appendix G Technology Assessment/Insertion
Appendix H Integration Plan Outline
Appendix I Verification and Validation Plan Outline
Appendix J SEMP Content Outline
Appendix K Technical Plans
Appendix L Interface Requirements Document Outline
Appendix M CM Plan Outline
Appendix N Guidance on Technical Peer Reviews/Inspections
Appendix O Reserved
Appendix P SOW Review Checklist
Appendix Q Reserved
Appendix R HSI Plan Content Outline
Appendix S Concept of Operations Annotated Outline
Appendix T Systems Engineering in Phase E
References Cited
Bibliography
The bibliography contains sources cited in sections of the document and additional sources for developing the material in the document.
AIAA American Institute of Aeronautics and Astronautics
ANSI American National Standards Institute
ASME American Society of Mechanical Engineers
ASQ American Society for Quality
CCSDS Consultative Committee for Space Data Systems
CFR (U.S.) Code of Federal Regulations
COSPAR The Committee on Space Research
DOD (U.S.) Department of Defense
EIA Electronic Industries Alliance
GEIA Government Electronics Information Technology Association
IEEE Institute of Electrical and Electronics Engineers
INCOSE International Council on Systems Engineering
ISO International Organization for Standardization
NIST National Institute of Standards and Technology
SAE Society of Automotive Engineers
TOR Technical Operating Report
U.S.C. United States Code
A | B | C | D | E | F | G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | W | X | Y | Z
– A –
Adams, R. J., et al. Software Development Standard for Space Systems, Aerospace Corporation Report No. TOR-2004(3909)3537, Revision B. March 11, 2005. Prepared for the U.S. Air Force.
AIAA G-118-2006e, AIAA Guide for Managing the Use of Commercial Off the Shelf (COTS) Software Components for Mission-Critical Systems, Reston, VA, 2006
AIAA S-120-2006, Mass Properties Control for Space Systems. Reston, VA, 2006
AIAA S-122-2007, Electrical Power Systems for Unmanned Spacecraft, Reston, VA, 2007
ANSI/AIAA G-043-1992, Guide for the Preparation of Operational Concept Documents, Washington, DC, 1992
ANSI/EIA-632, Processes for Engineering a System, Arlington, VA, 1999
ANSI/EIA-649, National Consensus Standard for Configuration Management, 1998-1999
ANSI/GEIA-649, National Consensus Standard for Configuration Management, National Defense Industrial Association (NDIA), Arlington, VA 1998
ANSI/EIA-748-C Standard: Earned Value Management Systems, March, 2013
ANSI/GEIA GEIA-859, Data Management, National Defense Industrial Association (NDIA), Arlington, VA 2004
ANSI/IEEE STD 1042. IEEE Guide to Software Configuration Management. Washington, DC, 1987
Architecture Analysis & Design Language (AADL): https://wiki.sei.cmu.edu/aadl/index.php/Main_Page
(The Architecture Analysis and Design Language (AADL) Wiki (https://wiki.sei.cmu.edu/aadl/) has been retired. The information included in the AADL wiki will soon be available in a different format.)
(The) Arms Export Control Act (AECA) of 1976, see 22 U.S.C. 2778
ASME Y14.24, Types and Applications of Engineering Drawings, New York, 1999
ASME Y14.100, Engineering Drawing Practices, New York, 2004
ASQ, Statistics Division, Statistical Engineering, http://asq.org/statistics/quality-information/statistical-engineering
Avizienis, A., J.C. Laprie, B. Randell, C. Landwehr, “Basic concepts and taxonomy of dependable and secure computing,” IEEE Transactions on Dependable and Secure Computing 1 (1), 11–33, 2004
– B –
Ball, Robert E. The Fundamentals of Aircraft Combat Survivability Analysis and Design. 2nd Edition, AIAA Education Series, 2003
Bayer, T.J., M. Bennett, C. L. Delp, D. Dvorak, J. S. Jenkins, and S. Mandutianu. “Update: Concept of Operations for Integrated Model-Centric Engineering at JPL,” paper #1122, IEEE Aerospace Conference 2011
Blanchard, Benjamin S., System Engineering Management. 4th Edition, Hoboken, NJ: John Wiley & Sons, Inc., 2008
Blanchard, Benjamin S., and Wolter J. Fabrycky. Systems Engineering and Analysis, 5th Edition Prentice Hall International Series in Industrial & Systems Engineering; February 6, 2010
Brown, Barclay. “Model-based systems engineering: Revolution or Evolution,” IBM Software, Thought Leadership White Paper, IBM Rational, December 2011
Brughelli, Kevin (Lockheed Martin), Deborah Carstens (Florida Institute of Technology), and Tim Barth (Kennedy Space Center), “Simulation Model Analysis Techniques,” Lockheed Martin presentation to KSC, November 2003
Buede, Dennis. The Engineering Design of Systems: Models and Methods. New York: Wiley & Sons, 2000.
Business Process Modeling Notation (BPMN) http://www.bpmn.org/
– C –
CCSDS 311.0-M-1, Reference Architecture for Space Data Systems, Recommended Practice (Magenta), Sept 2008. http://public.ccsds.org/publications/MagentaBooks.aspx
CCSDS 901-0-G-1, Space Communications Cross Support Architecture Description Document, Informational Report (Green) Sept 2013. http://public.ccsds.org/publications/GreenBooks.aspx
Chapanis, A. “The Error-Provocative Situation: A Central Measurement Problem in Human Factors Engineering.” In The Measurement of Safety Performance. Edited by W. E. Tarrants. New York: Garland STPM Press, 1980
Chattopadhyay, Debarati, Adam M. Ross, and Donna H. Rhodes, “A Method for Tradespace Exploration of Systems of Systems,” presentation in Track 34-SSEE-3: Space Economic Cost Modeling, AIAA Space 2009, September 15, 2009. © 2009 Massachusetts Institute of Technology (MIT), SEARI: Systems Engineering Advancement Research Initiative, seari.mit.edu
Chung, Seung H., Todd J. Bayer, Bjorn Cole, Brian Cooke, Frank Dekens, Christopher Delp, Doris Lam. “Model-Based Systems Engineering Approach to Managing Mass Margin,” in Proceedings of the 5th International Workshop on Systems & Concurrent Engineering for Space Applications (SECESA), Lisbon, Portugal, October, 2012
Clark, J.O. “System of Systems Engineering and Family of Systems Engineering From a Standards, V-Model, and Dual-V Model Perspective,” 3rd Annual IEEE International Systems Conference, Vancouver, Canada, March 23–26, 2009
Clemen, R., and T. Reilly. Making Hard Decisions with DecisionTools Suite. Pacific Grove, CA: Duxbury Resource Center, 2002
CFR, Title 14 – Aeronautics and Space, Part 1214 NASA Space Flight (14 CFR 1214)
CFR, Title 14 – Aeronautics and Space, Part 1216.3 NASA Environmental Quality: Procedures for Implementing the National Environmental Policy Act (NEPA) (14 CFR 1216.3)
CFR Title 22 – Foreign Relations, Parts 120-130 Department of State: International Traffic in Arms Regulations (ITAR) (22 CFR 120-130). Implements 22 U.S.C. 2778 of the Arms Export Control Act (AECA) of 1976 and Executive Order 13637, “Administration of Reformed Export Controls,” March 8, 2013
CFR Title 37 – Patents, Trademarks, and Copyrights; Part 5 Secrecy of Certain Inventions and Licenses to Export and File Applications in Foreign Countries; Part 5.2 Secrecy Order. (37 CFR 5.2)
CFR Title 40 – Protection of Environment, Part 1508.27 Council on Environmental Quality: Terminology “significantly.” (40 CFR 1508.27)
CFR Title 48 – Federal Acquisition Regulation (FAR) System, Part 1214 NASA Acquisition Planning: Acquisition of Commercial Items: Space Flight. (48 CFR 1214)
CFR Title 48 – Federal Acquisition Regulation (FAR) System, Part 46.103 Government Contract Quality Assurance: Contracting office responsibilities. (48 CFR 46.103)
CFR Title 48 – Federal Acquisition Regulation (FAR) System, Part 46.4 Government Contract Quality Assurance (48 CFR 46.4)
CFR Title 48 – Federal Acquisition Regulation (FAR) System, Part 46.407 Government Contract Quality Assurance: Nonconforming Supplies or Services (48 CFR 46.407)
COSPAR, Planetary Protection Policy. March 24, 2005. http://w.astro.berkeley.edu/~kalas/ethics/documents/environment/COSPAR%20Planetary%20Protection%20Policy.pdf
– D –
Deming, W. Edwards, see https://www.deming.org/
Dezfuli, H. “Role of System Safety in Risk-informed Decisionmaking.” In Proceedings, the NASA Risk Management Conference 2005. Orlando, December 7, 2005
DOD Architecture Framework (DODAF) Version 2.02 Change 1, January 2015 http://dodcio.defense.gov/Library/DoDArchitectureFramework.aspx
DOD. Defense Acquisition Guidebook (DAG). 2014
DOD Defense Acquisition University (DAU). Systems Engineering Fundamentals Guide. Fort Belvoir, VA, 2001
DOD Defense Logistics Agency (DLA). Cataloging Handbook, H4/H8 Series. Washington, DC, February 2003
DOD Defense Technical Information Center (DTIC). Directory of Design Support Methods (DDSM). 2007. http://www.dtic.mil/dtic/tr/fulltext/u2/a437106.pdf
DOD MIL-HDBK-727 (Validation Notice 1). Military Handbook: Design Guidance for Producibility, U.S. Army Research Laboratory, Weapons and Materials Research Directorate: Adelphi,MD, 1990
DOD. MIL-HDBK-965. Acquisition Practices for Parts Management. Washington, DC, September 26, 1996. Notice 1: October 2000
DOD. MIL-STD-881C. Work Breakdown Structure (WBS) for Defense Materiel Items. Washington, DC, October 3, 2011
DOD. MIL-STD-1472G, DOD Design Criteria Standard: Human Engineering. Washington, DC, January 11, 2012
DOD. MIL-STD-1540D, Product Verification Requirements for Launch, Upper Stage, and Space Vehicles. January 15, 1999
DOD. MIL-STD-46855A, Human Engineering Requirements for Military Systems, Equipment, and Facilities. May 24, 2011. Replacement for DOD HDBK 763 and DOD MIL-HDBK-46855A, which have been cancelled.
DOD Office of the Under Secretary of Defense, Acquisition, Technology, & Logistics. SD-10. Defense Standardization Program: Guide for Identification and Development of Metric Standards. Washington, DC, April, 2010
DOD Systems Management College. Systems Engineering Fundamentals. Defense Acquisition University Press: Fort Belvoir, VA 22060-5565, 2001 http://ocw.mit.edu/courses/aeronautics-and-astronautics/16-885j-aircraft-systems-engineering-fall-2005/readings/sefguide_01_01.pdf
Duren, R. et al., “Systems Engineering for the Kepler Mission: A Search for Terrestrial Planets,” IEEE Aerospace Conference, 2006
– E –
Eggemeier, F. T., and G. F. Wilson. “Performance and Subjective Measures of Workload in Multitask Environments.” In Multiple-Task Performance. Edited by D. Damos. London: Taylor and Francis, 1991
Endsley, M. R., and M. D. Rogers. “Situation Awareness Information Requirements Analysis for En Route Air Traffic Control.” In Proceedings of the Human Factors and
Ergonomics Society 38th Annual Meeting. Santa Monica: Human Factors and Ergonomics Society, 1994
Eslinger, Suellen. Software Acquisition Best Practices for the Early Acquisition Phases. El Segundo, CA: The Aerospace Corporation, 2004
Estefan, Jeff, Survey of Model-Based Systems Engineering (MBSE) Methodologies, Rev B, Section 3.2. NASA Jet Propulsion Laboratory (JPL), June 10, 2008. The document was originally authored as an internal JPL report, and then modified for public release and submitted to INCOSE to support the INCOSE MBSE Initiative.
Executive Order (EO) 12114, Environmental Effects Abroad of Major Federal Actions. January 4, 1979.
Executive Order (EO) 12770, Metric Usage in Federal Government Programs, July 25, 1991.
Executive Order (EO) 13637, Administration of Reformed Export Controls, March 8, 2013.
Extensible Markup Language (XML) http://www.w3.org/TR/REC-xml/
Extensible Markup Language (XML) Metadata Interchange (XMI) http://www.omg.org/spec/XMI/
– F –
Federal Acquisition Regulation (FAR). See: Code of Federal Regulations (CFR), Title 48.
Federal Aviation Administration (FAA), HF-STD-001, Human Factors Design Standard (HFDS). Washington, DC, May 2003. Updated: May 03, 2012. hf.tc.faa.gov/hfds
Federal Highway Administration, and CalTrans. Systems Engineering Guidebook for ITS, Version 2.0. Washington, DC: U.S. Department of Transportation, 2007
Friedenthal, Sanford, Alan Moore, and Rick Steiner. A Practical Guide to SysML: Systems Modeling Language, Morgan Kaufmann Publishers, Inc., July 2008
Fuld, R. B. “The Fiction of Function Allocation.” Ergonomics in Design (January 1993): 20–24
– G-
Garlan, D., W. Reinholtz, B. Schmerl, N. Sherman, T. Tseng. “Bridging the Gap between Systems Design and Space Systems Software,” Proceedings of the 29th IEEE/NASA Software Engineering Workshop, 6-7 April 2005, Greenbelt, MD, USA
Glass, J. T., V. Zaloom, and D. Gates. “A Micro-Computer-Aided Link Analysis Tool.” Computers in Industry 16, (1991): 179–87
Gopher, D., and E. Donchin. “Workload: An Examination of the Concept.” In Handbook of Perception and Human Performance: Vol. II. Cognitive Processes and Performance. Edited by K. R. Boff, L. Kaufman, and J. P. Thomas. New York: John Wiley & Sons, 1986
Griffin, Michael D., NASA Administrator. “System Engineering and the Two Cultures of Engineering.” Boeing Lecture, Purdue University, March 28, 2007
– H –
Hart, S. G., and C. D. Wickens. “Workload Assessment and Prediction.” In MANPRINT: An Approach to Systems Integration. Edited by H. R. Booher. New York: Van Nostrand Reinhold, 1990
Hoerl, R.W. and R.S. Snee, Statistical Thinking – Improving Business Performance, John Wiley & Sons. 2012
Hoffmann, Hans-Peter, “Harmony-SE/SysML Deskbook: Model-Based Systems Engineering with Rhapsody,” Rev. 1.51, Telelogic/I-Logix white paper, Telelogic AB, May 24, 2006
Hofmann, Hubert F., Kathryn M. Dodson, Gowri S. Ramani, and Deborah K. Yedlin. Adapting CMMI® for Acquisition Organizations: A Preliminary Report, CMU/SEI-2006-SR-005. Pittsburgh: Software Engineering Institute, Carnegie Mellon University, 2006, pp. 338–40
Huey, B. M., and C. D. Wickens, eds. Workload Transition. Washington, DC: National Academy Press, 1993
– I –
IEEE STD 610.12-1990. IEEE Standard Glossary of Software Engineering Terminology. 1999, superceded by ISO/IEC/IEEE 24765:2010, Systems and Software Engineering – Vocabulary. Washington, DC, 2010
IEEE STD 828. IEEE Standard for Software Configuration Management Plans. Washington, DC, 1998
IEEE STD 1076-2008 IEEE Standard VHDL Language Reference Manual, 03 February 2009
IEEE STD 1220-2005. IEEE Standard for Application and Management of the Systems Engineering Process, Washington, DC, 2005
IEEE Standard12207.1, EIA Guide for Information Technology Software Life Cycle Processes—Life Cycle Data, Washington, DC, 1997
INCOSE. Systems Engineering Handbook, Version 3.2.2. Seattle, 2011
INCOSE-TP-2003-002-04, Systems Engineering Handbook: A Guide for System Life Cycle Processes and Activities, Version 4, Edited by Walden, David D., et al., 2015
INCOSE-TP-2003-020-01, Technical Measurement, Version 1.0, 27 December 2005. Prepared by Garry J. Roedler (Lockheed Martin) and Cheryl Jones (U.S. Army).
INCOSE SE Vision 2025: A world in Motion, https://www.incose.org/products-and-publications/se-vision-2025
INCOSE-TP-2005-001-03, Systems Engineering Leading Indicators Guide, Version 2.0, January 29, 2010; available at http://seari.mit.edu/documents/SELI-Guide-Rev2.pdf. Edited by Garry J. Roedler and Howard Schimmoller (Lockheed Martin), Cheryl Jones (U.S. Army), and Donna H. Rhodes (Massachusetts Institute of Technology)
ISO 9000:2015, Quality management systems – Fundamentals and vocabulary. Geneva: International Organization for Standardization, 2015
ISO 9001:2015 Quality Management Systems (QMS). Geneva: International Organization for Standardization, September 2015
ISO 9100/AS9100, Quality Systems Aerospace—Model for Quality Assurance in Design, Development, Production, Installation, and Servicing. Geneva: International Organization for Standardization, 1999
ISO 10007: 1995(E). Quality Management—Guidelines for Configuration Management, Geneva: International Organization for Standardization, 1995
ISO 10303-AP233, Application Protocol (AP) for Systems Engineering Data Exchange (AP-233) Working Draft 2 published July 2006
ISO/TS 10303-433:2011 Industrial automation systems and integration – Product data representation and exchange – Part 433: Application module: AP233 systems engineering. ISO: Geneva, 2011
ISO/IEC 10746-1 to 10746-4, ITU-T Specifications X.901 to x.904, Reference Model of Open distributed Processing (RM-ODP), Geneva: International Organization for Standardization, 1998. https://standards.nasa.gov (Moderate security level access is required.)
ISO 13374-1, Condition monitoring and diagnostics of machines—Data processing, communication and presentation – Part 1: General guidelines. Geneva: International Organization for Standardization, 2002
ISO/IEC 15288:2002. Systems Engineering—System Life Cycle Processes. Geneva: International Organization for Standardization, 2002
ISO/TR 15846. Information Technology—Software Life Cycle Processes Configuration Management, Geneva: International Organization for Standardization, 1998
ISO/IEC TR 19760:2003. Systems Engineering—A Guide for the Application of ISO/IEC 15288. Geneva: International Organization for Standardization, 2003
ISO/IEC/IEEE 24765:2010, Systems and Software Engineering – Vocabulary. Geneva: International Organization for Standardization, 2010
ISO/IEC/IEEE 42010:2011. Systems and Software Engineering—Architecture Description. Geneva: International Organization for Standardization, 2011 http://www.iso-architecture.org/ieee-1471/index.html
(The) Invention Secrecy Act of 1951, see 35 U.S.C. §181–§188. Secrecy of Certain Inventions and Filing Applications in Foreign Country; §181 – Secrecy of Certain Inventions and Withholding of Patent
– J –
Joint (cost and schedule) Confidence Level (JCL). Frequently asked questions (FAQs) can be found at: https://www.nasa.gov/wp-content/uploads/2019/10/394931main_JCL_FAQ_10_12_09.pdf?emrc=aaf47a
Jennions, Ian K. editor. Integrated Vehicle Health Management (IVHM): Perspectives on an Emerging Field. SAE International, Warrendale PA (IVHM Book) September 27, 2011
Jennions, Ian K. editor. Integrated Vehicle Health Management (IVHM): Business Case Theory and Practice. SAE International, Warrendale PA (IVHM Book) November 12, 2012
Jennions, Ian K. editor. Integrated Vehicle Health Management (IVHM): The Technology. SAE International, Warrendale PA (IVHM Book) September 5, 2013
Johnson, Stephen B. et al., editors. System Health Management with Aerospace Applications. John Wiley & Sons, Ltd, West Sussex, UK, 2011
Jones, E. R., R. T. Hennessy, and S. Deutsch, eds. Human Factors Aspects of Simulation. Washington, DC: National Academy Press, 1985
– K-
Kaplan, S., and B. John Garrick. “On the Quantitative Definition of Risk.” Risk Analysis 1(1). 1981
Karpati, G., Martin, J., Steiner, M., Reinhardt, K., “The Integrated Mission Design Center (IMDC) at NASA Goddard Space Flight Center,” IEEE Aerospace Conference 2003 Proceedings, Volume 8, Page(s): 8_3657–8_3667, 2003
Keeney, Ralph L. Value-Focused Thinking: A Path to Creative Decisionmaking. Cambridge, MA: Harvard University Press, 1992
Keeney, Ralph L., and Timothy L. McDaniels. “A Framework to Guide Thinking and Analysis Regarding Climate Change Policies.” Risk Analysis 21(6): 989–1000. 2001
Keeney, Ralph L., and Howard Raiffa. Decisions with Multiple Objectives: Preferences and Value Tradeoffs. Cambridge, UK: Cambridge University Press, 1993
Kirwin, B., and L. K. Ainsworth. A Guide to Task Analysis. London: Taylor and Francis, 1992
Kluger, Jeffrey with Dan Cray, “Management Tips from the Real Rocket Scientists,” Time Magazine, November 2005
Knowledge Based Systems, Inc. (KBSI), Integration Definition for functional modeling (IDEF0) ISF0 Function Modeling Method, found at http://www.idef.com/idef0.htm
Kruchten, Philippe B. The Rational Unified Process: An Introduction, Third Edition, Addison-Wesley Professional: Reading, MA, 2003
Kruchten, Philippe B. “A 4+1 view model of software architecture,” IEEE Software Magazine 12(6) (November 1995), 42–50
Kurke, M. I. “Operational Sequence Diagrams in System Design.” Human Factors 3: 66–73. 1961
– L-
Larson, Wiley J.et al.. Applied Space Systems Engineering: A Practical Approach to Achieving Technical Baselines. 2nd Edition, Boston, MA: McGraw-Hill Learning Solutions, CEI Publications, 2009
Long, James E., Relationships Between Common Graphical Representations in Systems Engineering. Vienna, VA: Vitech Corporation, 2002
Long, James E., “Systems Engineering (SE) 101,” CORE®: Product & Process Engineering Solutions, Vitech training materials. Vienna, VA: Vitech Corporation, 2000
– M –
Maier, M.W. “Architecting Principles for Systems-of-Systems,” Systems Engineering 1(1998), 267-284, John Wiley & Sons, Inc.
Maier, M.W., D. Emery, and R. Hillard, “ANSI/IEEE 1471 and Systems Engineering,” Systems Engineering 7 (2004), 257–270, Wiley InterScience, http://www.interscience.wiley.com
Maier, M.W. “System and Software Architecture Reconciliation,” Systems Engineering 9 (2006), 146–159, Wiley InterScience, http://www.interscience.wiley.com
Maier, M.W., and E. Rechtin, The Art of Systems Architecting, 3rd Edition, CRC Press, Boca Raton, FL, 2009
Martin, James N., Processes for Engineering a System: An Overview of the ANSI/GEIA EIA-632 Standard and Its Heritage. New York: Wiley & Sons, 2000
Martin, James N., Systems Engineering Guidebook: A Process for Developing Systems and Products. Boca Raton: CRC Press, 1996.
Mathworks: Matlab http://www.mathworks.com/
McGuire, M., Oleson, S., Babula, M., and Sarver-Verhey, T., “Concurrent Mission and Systems Design at NASA Glenn Research Center: The origins of the COMPASS Team,” AIAA Space 2011 Proceedings, September 27-29, 2011, Long Beach, CA
Meister, David, Behavioral Analysis and Measurement Methods. New York: John Wiley & Sons, 1985
Meister, David, Human Factors: Theory and Practice. New York: John Wiley & Sons, 1971
(The) Metric Conversion Act of 1975 (Public Law 94-168) amended by the Omnibus Trade and Competitiveness Act of 1988 (Public Law 100-418), the Savings in Construction Act of 1996 (Public Law 104-289), and the Department of Energy High-End Computing Revitalization Act of 2004 (Public Law 108-423). See 15 U.S.C. §205a et seq.
Miao, Y., and J. M. Haake. “Supporting Concurrent Design by Integrating Information Sharing and Activity Synchronization.” In Proceedings of the 5th ISPE International Conference on Concurrent Engineering Research and Applications (CE98). Tokyo, 1998, pp. 165–74
The Mitre Corporation, Common Risks and Risk Mitigation Actions for a COTS-based System. McLean, VA. http://www2.mitre.org/…/files/CommonRisksCOTS.doc (no date)
MODAF https://www.gov.uk/guidance/mod-architecture-framework
Moeller, Robert C., Chester Borden, Thomas Spilker, William Smythe, Robert Lock , “Space Missions Trade Space Generation and Assessment using the JPL Rapid Mission Architecture (RMA) Team Approach,” IEEE Aerospace Conference, Big Sky, Montana, March 2011
Morgan, M. Granger, and M. Henrion, Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis. Cambridge, UK: Cambridge University Press, 1990
M. Moshir, et al., “Systems engineering and application of system performance modeling in SIM Lite mission,” Proceedings. SPIE 7734, 2010
Mulqueen, J.; R. Hopkins; D. Jones, “The MSFC Collaborative Engineering Process for Preliminary Design and Concept Definition Studies.” 2012 http://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/20120001572.pdf
NASA Publications
NASA Federal Acquisition Regulation (FAR) Supplement (NFS) 1834.201, Earned Value Management System Policy
NASA Form (NF) 1686, NASA Scientific and Technical Document Availability Authorization (DAA) for Administratively Controlled Information
Reports
NASA Chief Engineer and the NASA Integrated Action Team (NIAT) report, “Enhancing Mission Success—A Framework for the Future,” December 21, 2000. Authors: McBrayer, Robert O and Thomas, Dale, NASA Marshall Space Flight Center, Huntsville, AL United States
NASA. Columbia Accident Investigation Board (CAIB) Report, 6 volumes: Aug. 26, Oct. 2003. https://www.nasa.gov/columbia/caib/html/report.html
NASA. NOAA N-Prime Mishap Investigation Final Report, Sept. 13, 2004. https://www.nasa.gov/wp-content/uploads/2015/01/65776main_noaa_np_mishap.pdf?emrc=8ee322
NASA. Diaz Report, A Renewed Commitment to Excellence: An Assessment of the NASA Agency-wide Applicability of the Columbia Accident Investigation Board Report, January 30, 2004. Mr. Al Diaz, Director, Goddard Space Flight Center, and team
NASA JPL D-71990, Europa Study 2012 Full Report. May 1 2012, publicly available here: https://solarsystem.nasa.gov/moons/jupiter-moons/europa/overview/
NASA Office of Inspector General. Final Memorandum on NASA’s Acquisition Approach Regarding Requirements for Certain Software Engineering Tools to Support NASA Programs, Assignment No. S06012. Washington, DC, 2006
NASA Office of Inspector General. Performance-Based Contracting https://oig.nasa.gov/docs/S-06-012a.pdf
Specialty Web Sites
NASA Engineering Network (NEN) Systems Engineering Community of Practice (SECoP) located at https://nen.nasa.gov/web/se
NASA Engineering Network (NEN) Systems Engineering Community of Practice (SECoP) under Tools and Methods at https://nen.nasa.gov/web/se/tools/ and then NASA
Tools & Methods
NASA Engineering Network (NEN) V&V Community of Practice, located at https://nen.nasa.gov/web/se
NASA Engineering Network (NEN) EVM Community of Practice, https://nen.nasa.gov/web/pm/evm
NASA EVM website http://evm.nasa.gov/index.html
NASA Procurement Library found at http://www.hq.nasa.gov/office/procurement/
Conference Publications
Aerospace Conference, 2007 IEEE Big Sky, MT 3–10 March 2007. NASA/Aerospace Corp. paper: “Using Historical NASA Cost and Schedule Growth to Set Future Program and Project Reserve Guidelines,” by Emmons, D. L., R.E. Bitten, and C.W. Freaner. IEEE Conference Publication pages: 1–16, 2008. Also presented at the NASA Cost Symposium, Denver CO, July 17–19, 2007
NASA Cost Symposium 2014, NASA “Mass Growth Analysis: Spacecraft & Subsystems.” LaRC, August 14th, 2014. Presenter: Vincent Larouche – Tecolote Research, also James K. Johnson, NASA HQ Study Point of Contact
Planetary Science Subcommittee, NASA Advisory Council, 23 June, 2008, NASA GSFC. NASA/Aerospace Corp. presentation; “An Assessment of the Inherent Optimism in Early Conceptual Designs and its Effect on Cost and Schedule Growth,” by Freaner, Claude, Bob Bitten, Dave Bearden, and Debra Emmons
Technical Documents
NASA Office of Chief Information Officer (OCIO). Information Technology Systems Engineering Handbook Version 2.0
NASA Science Mission Directorate, Risk Communication Plan for Planetary and Deep Space Missions, 1999
NASA PD-EC-1243, Preferred Reliability Practices for Fault Protection, October 1995
NASA-CR-192656, Contractor Report: Research and technology goals and objectives for Integrated Vehicle Health Management (IVHM). October 10, 1992
NASA Jet Propulsion Laboratory (JPL), JPL-D-17868 (REV.1), JPL Guideline: Design, Verification/Validation and Operations Principles for Flight Systems. February 16, 2001
NASA Lyndon B. Johnson Space Center (JSC-65995), Commercial Human Systems Integration Processes (CHSIP), May 2011
NASA/TP-2014-218556, Technical Publication: Human Integration Design Processes (HIDP). NASA ISS Program, Lyndon B. Johnson Space Center, Houston TX, September 2014. https://www.nasa.gov/wp-content/uploads/2015/03/human_integration_design_processes.pdf?emrc=e6ee2f
NASA Lyndon B. Johnson Space Center (JSC-60576), National Space Transportation System (NSTS), Space Shuttle Program, Transition Management Plan, May 9, 2007
NASA Langley Research Center (LARC) Guidance on System and Software Metrics for Performance-Based Contracting. 2013 sites-e.larc.nasa.gov/sweng/files/2013/05/Guidance_on_Metrics_for_PBC_R1V01.doc
NASA Langley Research Center (LARC), Instructional Handbook for Formal Inspections. 2013 http://sw-eng.larc.nasa.gov/files/2013/05/Instructional-Handbook-for-Formal-Inspections.pdf
NASA/TM-2008-215126/Volume II (NESC-RP-06-108/05-173-E/Part 2), Technical Memorandum: Design Development Test and Evaluation (DDT&E) Considerations for Safe and Reliable Human-Rated Spacecraft Systems. April 2008.Volume II: Technical Consultation Report. James Miller, Jay Leggett, and Julie Kramer-White, NASA Langley Research Center, Hampton VA, June 14, 2007
NASA Reference Publication 1370. Training Manual for Elements of Interface Definition and Control. Vincent R. Lalli, Robert E. Kastner, and Henry N. Hartt. NASA Lewis Research Center, Cleveland OH, January 1997
NASA. Systems Engineering Leading Indicators Guide, http://seari.mit.edu/
NASA Cost Estimating Handbook (CEH), Version 4, February 2015
NASA Financial Management Requirements (FMR) Volume 4
Special Publications
NASA/SP-2010-576 NASA Risk-Informed Decision Making Handbook
NASA/SP-2012-599, NASA’s Earned Value Management (EVM) Implementation Handbook
NASA/SP-2010-3403, NASA Schedule Management Handbook
NASA/SP-2010-3404, NASA Work Breakdown Structure Handbook
NASA/SP-2010-3406, Integrated Baseline Review (IBR) Handbook
NASA/SP-2010-3407, Human Integration Design Handbook (HIDH)
NASA/SP-2011-3421, Probabilistic Risk Assessment Procedures Guide for NASA Managers and Practitioners
NASA/SP-2011-3422, NASA Risk Management Handbook
NASA/SP-2013-3704, Earned Value Management (EVM) System Description
NASA/SP-2014-3705, NASA Space Flight Program and Project Management Handbook
NASA/SP-2015-3709, Human Systems Integration Practitioners Guide
Handbooks and Standards
NASA-HDBK-1002, Fault Management (FM) Handbook, Draft 2, April 2012
NASA-HDBK-2203, NASA Software Engineering Handbook, February 28, 2013
NASA Safety Standard (NSS) 1740.14, Guidelines and Assessment Procedures for Limiting Orbital Debris. Washington, DC, 1995 https://www.nasa.gov/wp-content/uploads/2015/03/human_integration_design_processes.pdf?emrc=e6ee2f NASA-STD 8719.14 should be used in place of NSS 1740.14 to implement NPR 8715.6. See NPR 8715.6 for restrictions on the use of NSS 1740.14.
NASA GSFC-STD-1000, Rules for the Design, Development, Verification, and Operation of Flight Systems. NASA Goddard Space Flight Center, February 8, 2013
NASA-STD-3001, Space Flight Human System Standard. Volume 1: Crew Health. Rev. A, July 30, 2014
NASA-STD-3001, Space Flight Human System Standard. Volume 2: Human Factors, Habitability, and Environmental Health. Rev. A, February 10, 2015
NASA GSFC-STD-7000, Goddard Technical Standard: General Environmental Verification Standard (GEVS) for GSFC Flight Programs and Projects. Goddard Space Flight Center, April 2005
NASA KSC-NE-9439 Kennedy Space Center Design Engineering Handbook, Best Practices for Design and Development of Ground Systems. Kennedy Space Center, November 20 2009
NASA-STD-7009, Standard for Models and Simulations. Washington, DC, October 18, 2013
NASA-STD-8719.13, Software Safety Standard, Rev C. Washington, DC, May 7, 2013
NASA-STD-8719.14, Handbook for Limiting Orbital Debris. Rev A with Change 1. December 8, 2011
NASA-STD-8729.1, Planning, Developing, and Maintaining an Effective Reliability and Maintainability (R&M) Program. Washington, DC, December 1, 1998
Policy Directives
NPD 1001.0, 2014 NASA Strategic Plan
NID 1600.55, Sensitive But Unclassified (SBU) Controlled Information
NPD 2820.1, NASA Software Policy
NPD 7120.4, NASA Engineering and Program/Project Management Policy
NPD 7120.6, Knowledge Policy on Programs and Projects
NPD 8010.2, Use of the SI (Metric) System of Measurement in NASA Programs
NPD 8010.3, Notification of Intent to Decommission or Terminate Operating Space Systems and Terminate Missions
NPD 8020.7, Biological Contamination Control for Outbound and Inbound Planetary Spacecraft
NPD 8730.5, NASA Quality Assurance Program Policy
Procedural Requirements
NPR 1080.1, Requirements for the Conduct of NASA Research and Technology (R&T)
NPR 1441.1, NASA Records Retention Schedules
NPR 1600.1, NASA Security Program Procedural Requirements
NPR 2210.1, Release of NASA Software
NPR 2810.1, Security of Information Technology
LPR 5000.2, Procurement Initiator’s Guide. NASA Langley Research Center (LARC)
JPR 7120.3, Project Management: Systems Engineering & Project Control Processes and Requirements. NASA Lyndon B. Johnson Space Center (JSC)
NPR 7120.5, NASA Space Flight Program and Project Management Processes and Requirements
NPR 7120.7, NASA Information Technology and Institutional Infrastructure Program and Project Management Requirements
NPR 7120.8, NASA Research and Technology Program and Project Management Requirements
NPR 7120.10, Technical Standards for NASA Programs and Projects
NPR 7120.11, NASA Health and Medical Technical Authority (HMTA) Implementation
NPR 7123.1, Systems Engineering Processes and Requirements
NPR 7150.2, NASA Software Engineering Requirements
NPR 8000.4, Risk Management Procedural Requirements
NPI 8020.7, NASA Policy on Planetary Protection Requirements for Human Extraterrestrial Missions
NPR 8020.12, Planetary Protection Provisions for Robotic Extraterrestrial Missions
APR 8070.2, EMI/EMC Class D Design and Environmental Test Requirements. NASA Ames Research Center (ARC)
NPR 8580.1, Implementing the National Environmental Policy Act and Executive Order 12114
NPR 8705.2, Human-Rating Requirements for Space Systems
NPR 8705.3, Probabilistic Risk Assessment Procedures Guide for NASA Managers and Practitioners
NPR 8705.4, Risk Classification for NASA Payloads
NPR 8705.5, Probabilistic Risk Assessment (PRA) Procedures for NASA Programs and ProjectsNPR 8705.6, Safety and Mission Assurance (SMA) Audits, Reviews, and Assessments
NPR 8710.1, Emergency Preparedness Program
NPR 8715.2, NASA Emergency Preparedness Plan Procedural Requirements
NPR 8715.3, NASA General Safety Program Requirements
NPR 8715.6, NASA Procedural Requirements for Limiting Orbital Debris
NPR 8735.2, Management of Government Quality Assurance Functions for NASA Contracts
NPR 8900.1, NASA Health and Medical Requirements for Human Space Exploration
Work Instructions
MSFC NASA MWI 8060.1, Off-the-Shelf Hardware Utilization in Flight Hardware Development. NASA Marshall Space Flight Center.
JSC Work Instruction EA-WI-016, Off-the-Shelf Hardware Utilization in Flight Hardware Development. NASA Lyndon B. Johnson Space Center.
Acquisition Documents
NASA. The SEB Source Evaluation Process. Washington, DC, 2001
NASA. Solicitation to Contract Award. Washington, DC, NASA Procurement Library, 2007
NASA. Statement of Work Checklist. Washington, DC. See: Appendix P in this handbook.
– N –
(The) National Environmental Policy Act of 1969 (NEPA). See 42 U.S.C. 4321-4347. https://www.fsa.usda.gov/Internet/FSA_File/nepa_statute.pdf
National Research Council (NRC) of the National Academy of Sciences (NAS), The Planetary Decadal Survey 2013–2022, Vision and Voyagers for Planetary Science in the Decade 2013–2022, The National Academies Press: Washington, D.C., 2011. http://www.nap.edu
NIST Special Publication 330: The International System of Units (SI) Barry N. Taylor and Ambler Thompson, Editors, March 2008. The United States version of the English text of the eighth edition (2006) of the International Bureau of Weights and Measures publication Le Système International d’ Unités (SI)
NIST Special Publication 811: NIST Guide for the Use of the International System of Units (SI) A. Thompson and B. N. Taylor, Editors. Created July 2, 2009; Last updated January 28, 2016
NIST, Federal Information Processing Standard Publication (FIPS PUB) 199, Standards for Security Categorization of Federal Information and Information Systems, February 2004
– O –
Oberto, R.E., Nilsen, E., Cohen, R., Wheeler, R., DeFlorio, P., and Borden, C., “The NASA Exploration Design Team; Blueprint for a New Design Paradigm”, 2005 IEEE Aerospace Conference, Big Sky, Montana, March 2005
Object Constraint Language (OCL) http://www.omg.org/spec/OCL/
Office of Management and Budget (OMB) Circular A-94, Guidelines and Discount Rates for Benefit-Cost Analysis of Federal Programs, October 29, 1992
Oliver, D., T. Kelliher, and J. Keegan, Engineering Complex Systems with Models and Objects, New York, NY, USA: McGraw-Hill 1997
OOSEM Working Group, Object-Oriented Systems Engineering Method (OOSEM) Tutorial, Version 03.00, Lockheed Martin Corporation and INCOSE, October 2008
OWL, Web Ontology Language (OWL) http://www.w3.org/2001/sw/wiki/OWL
– P –
Paredis, C., Y. Bernard, R. Burkhart, H.P. Koning, S. Friedenthal, P. Fritzon, N.F. Rouquette, W. Schamai. “Systems Modeling Language (SysML)-Modelica Transformation.” INCOSE 2010
Pennell, J. and Winner, R., “Concurrent Engineering: Practices and Prospects,” Global Telecommunications Conference, GLOBECOM ‘89, 1989
Presidential Directive/National Security Council Memorandum No. 25 (PD/NSC-25), “Scientific or Technological Experiments with Possible Large-Scale AdverseEnvironmental Effects and Launch of Nuclear Systems into Space,” as amended May 8, 1996
Presidential Policy Directive PPD-4 (2010), National Space Policy
Presidential Policy Directive PPD-21 (2013), Critical Infrastructure Security and Resilience
Price, H. E. “The Allocation of Functions in Systems.” Human Factors 27: 33–45. 1985
The Project Management Institute® (PMI). Practice Standards for Work Breakdown Structures. Newtown Square, PA, 2001
– Q-
Query View Transformation (QVT) http://www.omg.org/spec/QVT/1.0/
– R –
Rasmussen, Robert. “Session 1: Overview of State Analysis,” (internal document), State Analysis Lite Course, Jet Propulsion Laboratory, California Institute of Technology, Pasadena, CA, 2005
R. Rasmussen, B. Muirhead, Abridged Edition:
A Case for Model-Based Architecting in NASA, California Institute of Technology, August 2012
Rechtin, Eberhardt. Systems Architecting of Organizations: Why Eagles Can’t Swim. Boca Raton: CRC Press, 2000
– S –
Saaty, Thomas L. The Analytic Hierarchy Process. New York: McGraw-Hill, 1980
SAE Standard AS5506B, Architecture Analysis & Design Language (AADL), SAE International, September 10, 2012
SAE International and the European Association of Aerospace Industries (EAAI) AS9100C, Quality Management Systems (QMS): Requirements for Aviation, Space, and Defense Organizations Revision C, January 15, 2009
SAE International/Electronic Industries Alliance (EIA) 649B-2011, Configuration Management Standard (Aerospace Sector), April 1, 2011
Sage, Andrew, and William Rouse. The Handbook of Systems Engineering and Management, New York: Wiley & Sons, 1999
Shafer, J. B. “Practical Workload Assessment in the Development Process.” In Proceedings of the Human Factors Society 31st Annual Meeting, Santa Monica: Human Factors Society, 1987
Shames, P., and J. Skipper. “Toward a Framework for Modeling Space Systems Architectures,” SpaceOps 2006 Conference, AIAA 2006-5581, 2006
Shaprio, J., “George H. Heilmeier,” IEEE Spectrum, 31(6), 1994, pg. 56–59 http://ieeexplore.ieee.org/iel3/6/7047/00284787.pdf?arnumber=284787
Software Engineering Institute (SEI). A Framework for Software Product Line Practice, Version 5.0. Carnegie Mellon University, http://www.sei.cmu.edu/productlines/frame_report/arch_def.htm
Stamelatos, M., H. Dezfuli, and G. Apostolakis. “A Proposed Risk-Informed Decision making Framework for NASA.” In Proceedings of the 8th International Conference on Probabilistic Safety Assessment and Management. New Orleans, LA, May 14–18, 2006
Stern, Paul C., and Harvey V. Fineberg, eds. Understanding Risk: Informing Decisions in a Democratic Society. Washington, DC: National Academies Press, 1996
Systems Modeling Language (SysML) http://www.omgsysml.org/
– T –
Taylor, Barry. Guide for the Use of the International System of Units (SI), Special Publication 811. Gaithersburg, MD: NIST, Physics Laboratory, 2007
– U –
Unified Modeling Language (UML) http://www.uml.org/
UPDM: Unified Profile for the (US) Department of Defense Architecture Framework (DoDAF) and the (UK) Ministry Of Defense Architecture Framework (MODAF) http://www.omg.org/spec/UPDM/
U.S. Air Force. SMC Systems Engineering Primer and Handbook, 3rd ed. Los Angeles: Space and Missile Systems Center, 2005
U. S. Chemical Safety Board (CSB) case study reports on mishaps found at: http://www.csb.gov/
U.S. Navy. Naval Air Systems Command, Systems Engineering Guide: 2003 (based on requirements of ANSI/EIA 632:1998). Patuxent River, MD, 2003
U.S. Nuclear Regulatory Commission. SECY-98-144, White Paper on Risk-Informed and Performance-Based Regulation,Washington, DC, 1998
U.S. Nuclear Regulatory Commission. NUREG-0700, Human-System Interface Design Review Guidelines, Rev.2. Washington, DC, Office of Nuclear Regulatory Research, 2002
United Nations, Office for Outer Space Affairs. Treaty of Principles Governing the Activities of States in the Exploration and Use of Outer Space, Including the Moon and Other Celestial Bodies. Known as the “Outer Space Treaty of 1967”
– W –
Wall, S., “Use of Concurrent Engineering in Space Mission Design,” Proceedings of EuSEC 2000, Munich, Germany, September 2000
Warfield, K., “Addressing Concept Maturity in the Early Formulation of Unmanned Spacecraft,” Proceedings of the 4th International Workshop on System and Concurrent Engineering for Space Applications, October 13–15, 2010, Lausanne, Switzerland
Web Ontology Language (OWL) http://www.w3.org/2001/sw/wiki/OWL
Wessen, Randii R., Chester Borden, John Ziemer, and Johnny Kwok. “Space Mission Concept Development Using Concept Maturity Levels,” Conference paper presented at the American Institute of Aeronautics and Astronautics (AIAA) Space 2013 Conference and Exposition; September 10–12, 2013; San Diego, CA. Published in the AIAA
Space 2013 Proceedings
Winner, R., Pennell, J., Bertrand, H., and Slusarczuk, M., The Role Of Concurrent Engineering In Weapons System Acquisition, Institute of Defense Analyses (IDA) Report R-338, Dec 1988
Wolfram, Mathematica http://www.wolfram.com/mathematica/
– X –
XMI: Extensible Markup Language (XML) Metadata Interchange (XMI) http://www.omg.org/spec/XMI/
XML: Extensible Markup Language (XML) http://www.w3.org/TR/REC-xml/
– Z –
Ziemer, J., Ervin, J., Lang, J., “Exploring Mission Concepts with the JPL Innovation Foundry A-Team,” AIAA Space 2013 Proceedings, September 10–12, 2013, San Diego, CA