NDIA HSI SubCommittee Brief 090609.1

DoD Human Systems Integration Overview
Stuart Booth
ODUSD(A&T) Systems and Software Engineering
HSI SE Division HSI Sub-committee Meeting, June, 2009
Agenda
•
•
•
•
•
•
•
Introduction
SSE Organization Structure
What is HSI?
HSI and Systems Engineering Overview
HSI and SE Benefits
Recent HSI Developments
DoD HSI Management Plan Overview
2
SSE Organization
Director, Systems and
Software Engineering
Gordon Kranz SES
Deputy Director
Strategic Initiatives
Kristen Baldwin
SES
Deputy Director
Engineering and Test
Policy and Guidance
Christopher DiPetto
SES
Functional Responsibilities
Functional Responsibilities
• Early Systems Engineering
• System of Systems SE
• Program Protection Plan
Policy & Guidance
• Acquisition Cyber Security
• SE Research Center –
University Affiliated Research
Center (UARC)
• Studies and Analyses
•Policy & Guidance
- Systems Engineering
- Test & Evaluation
- Software Engineering
•SSE Document Coordination
and Approval Process
- Systems Engineering Plan
- Test & Evaluation Master
Plan
- Test & Evaluation Strategy
•Standards
•Energy
Deputy Director
Human Capital and
Specialty Engineering
Nicholas Torelli
SES
Functional Responsibilities
•Human Capital Strategy &
Planning:
- Technical Mgmt Workforce
Development / Health
- DAWIA Certification Standards
- Competency Models
•Specialty Engineering:
- Quality and Producibility
- Reliability, Availability,
Maintainability / Supportability
- Value Engineering / Reduction
in Total Ownership Cost
(RTOC)
- Human Systems Integration
- System Safety
- Modeling & Simulation
Deputy Director
Acquisition Systems
Engineering and Test
Support
James Thompson
SES
Functional Responsibilities
•OIPT/DAB/DSAB Support
•Technical Support to
Acquisition Programs
•Program Assessments:
- Assessments of Operational
Test Readiness
- Program Support Reviews
- Non-Advocate Reviews
•DAES Database Analysis and
Support
•Measurements and Analysis
•T&E Oversight List
3
What is Human Systems Integration?
Human Systems Integration (HSI) is the interdisciplinary
technical and management processes for integrating
human considerations within and across all system
elements; an essential enabler to systems engineering
practice.
Personnel
Manpower
Human
Systems
Integration
Survivability
SOH
INCOSE Systems Engineering Handbook v.3.1 ; Aug 2007
Training
Human
Factors
Eng
4
System Development Challenge
Hardware
HSI performs its
technical work at
the intersection
of Hardware,
Software and
Human elements.
Software
Human
Thekey
keyisisto
tostrike
strikethe
theright
rightbalance
balancebetween
betweenthe
thehardware,
hardware,software
softwareand
and
The
humanininachieving
achievingthe
thebest
bestpossible
possiblesystem
systemperformance.
performance.
human
5
Improved Total System Performance
DoD Acquisition
Process
MS A
MDD
Materiel
Solution
Analysis
MS B
MS C
Engineering and
Manufacturing
Development
Technology
Development
PDR or PDR
Production and
Deployment
O&S
Full Rate Production
Decision Review
CDR
Acquisition Lifecycle
Total Integrated System ( Hardware, Software, Human)
SE & HSI
Policy & Guidance
HSI Activities
& Products
( Capabilities ‐> System Requirements ‐> Design ‐> Implementation ‐> Verification & Validation)
Human‐Machine
Interface Design,
procedures and aids
Knowledge, Skills
and Abilities
Work Distribution
over Crew
Crew are qualified, rested, motivated,
vigilant and healthy
Human Systems Integration Activity (within and among the elements)
Human
Factors Engineering
Personnel
Training
Manpower
Safety, &
Occ. Health
Habitability
Survivability
Human Systems Integration Definition (Ref: DoDI 5000.02 Encl. 8, DAG Chap. 6)
Systems Engineering (Ref: DoDI 5000.02 Encl. 12, DAG Chap 4)
(Incorporates all technical and technical management activities)
6
Systems Engineering Life Cycle
Processes
Technical Management Processes
Decision Analysis
Risk Management
Technical Planning
Technical
Assessment
Configuration
Management
Technical Data
Management
Requirements
Management
Interface
Management
Human Systems Integration Activities
Human‐Machine
Interface Design,
procedures and aids
Knowledge, Skills
and Abilities
Work Distribution
over Crew
Crew are qualified, rested, motivated,
vigilant and healthy
Human Systems Integration Activity ( within and among the elements)
Technical Processes
Stakeholder
Requirements
Definition
Integration
Human
Factors Engineering
Personnel
Training
Manpower
Environment,
Safety, &
Occ. Health
Habitability
Personnel
Survivability
Human Systems Integration Definition (Ref: DoDI 5000.02 Encl. 8, DAG Chap. 6)
Requirements
Analysis
Architecture
Design
Verification
Transition
Implementation
Validation
The respective overarching technical processes (that include HSI) are iterative, concurrent, & integrated
…and the processes are applied with different emphasis over the program development life cycle.
7
Technical Processes
Notional Emphasis of Activity
Acquisition
AcquisitionPhases
Phases
Technical
Technical
Processes
Processes
Materiel
Solution
Analysis
MS A
Technology
Development
Engineering
and
Manufacturing
Development
MS B
MS C
Production
and
Deployment
Stakeholder Requirements
Definition
Requirements Analysis
HSI is
involved in all
these
processes!
Architecture Design
Implementation
Note: The process
activity emphasis will
vary depending on
the program strategy.
Operations
and Support
Integration
Verification
Transition
Validation
Technical Reviews
Technical Reviews
Technical
TechnicalBaseline
Baseline
ITR
ASR
Preferred
System
Concept
SRR
System
Spec
SFR
System
Functional
Baseline
PDR
Allocated
Baseline
ITR - Initial Technical Review
ASR- Alternative Systems Review
SRR - System Requirements Review
SFR – System Functional Review
PDR – Preliminary Design Review
CDR – Critical Design Review
CDR
Initial
Product
Baseline
TRR
SVR/
FCA/
PRR
OTRR PCA
ISR
Product
Baseline
SVR – System Verification Review
TRR- Test Readiness Review
FCA- Functional Configuration Audit
PRR – Product Readiness Review
OTRR –
Operational Test Readiness Review
PCA – Physical Configuration Audit
ISR – In- Service Review
8
NASA SE Investment Analysis
Total Program Overrun
32 NASA Programs
200
GRO76
Program Overrun
180
TDRSS
160
GALL
IRAS
140
Actual + Definition$
Program Overrun = ---------------------------------Target + Definition$
HST
TETH
120
100
80
Definition $
Definition Percent = ---------------------------------Target + Definition$
OMV
GOES I-M MARS
CEN
ACT
EDO
LAND76
ERB77
MAG
CHA.REC.
COBE
STS
60
LAND78
GRO82
SEASAT
40
UARS
DE
20
SMM
0
0
Programsthat
thatinvest
investless
lessthan
than55%%
Programs
onSE
SEare
arealmost
almostguaranteed
guaranteedan
an
on
80%ororgreater
greateroverrun.
overrun.
80%
5
ERB88
VOY
HEAO
2
R = 0.5206
EUVE/EP
ULYS
PIONVEN
10
IUE
ISEE
15
20
Definition Percent of Total Estimate
Source Werner Gruhl, 1992
NASA Comptroller’s Office
9
Consolidated SE and HSI
Investment Projection
Target SE Investment Estimate: 10% to 15%
Target HSI Investment Estimate: 1% to 4.5 %
200
Objective:DoDI
DoDI5000.02
5000.02requires
requiresup-front
up-frontinvestment
investmentto
to
Objective:
achievean
aninformed
informedand
andbalanced
balancedacquisition
acquisitionsolution
solution
achieve
whereSE
SEand
andHSI
HSIplay
playaakey
keyrole.
role.
where
Program Overrun
180
160
140
120
100
80
60
40
20
0
0
5
10
15
20
Definition Percent of Total Estimate
Ref: http://www.incose.org/secoe/
Ref: Impact of SE at NASA (SECOE 02-02)
10
SSE’s Shifting Concentration
2009 and Beyond Concentration on Program Formulation
•
•
•
•
•
Implement technically-based Materiel Development Decision
Ensure mandatory Milestone A supported by SE analysis
Analyze PDR Reports and Post-CDR Reports to inform the MDA
Renew government oversight of DT&E to reduce risk in IOT&E
Execute mandated PSRs and AOTRs
A 2009
ICD
Materiel
Solution
Analysis
Materiel
Development
Decision
2003 – 2008
B
Technology
Development
Engineering and
Manufacturing Development
Post-PDR
Assessment
PDR
PDR
IOC
Production and
Deployment
CPD
CDD
Pre-Systems Acquisition
C
Post-CDR
Assessment
FRP Decision
Review
FOC
Operations
and
Support
CDR
or
Systems Acquisition
Sustainment
2003 – 2008 Concentration on Program Execution
•
•
•
•
•
Stood up new AT&L organization focused on SE
Integrated SE and DT&E
Published AT&L SE policy letters instantiated in DoDI 5000.02
Overhauled and enriched DAWIA curriculum
Created common framework for program assessments
11
Congressional & AT&L Direction
National Defense Authorization (NDAA) Act FY 2008
Responsibility for Human Systems Integration Activities
AT&L Memorandum
Assigns DoD Executive
Responsibility or HSI
NDAA FY 09
Congressional report request
for an HSI Plan
12
DoD HSI Organization
Office of Secretary of Defense
Under Secretary of Defense
(Acquisition, Technology and Logistics)
Director, Defense Research
and Engineering
Under Secretary of Defense
(Personnel & Readiness)
DUSD, Acquisition &
Technology (A&T)
DUSD, Science &
Technology (S&T)
HSI Management Responsibility
Director, Biological
Systems
Director, Requirements
& Program & Budgeting
Director, Systems and
Software Engineering
Joint HSI Steering Committee
(OSD, Army, Navy, Air Force, JHSI WG)
Associate Director, Total
Force Requirements
Joint HSI Working Group
(OSD, Army, Navy, Air Force)
13
DoD HSI Governance Structure
OSD
S&T
• JHSISC Co-Chair
• HSI Research
A&T
• JHSISC Co-Chair
• Systems Engineering Policy
• Systems Engineering Guidance
• Program Support Reviews
P&R
• HSI Policy
• HSI Guidance
Future Plans
(2009 and
beyond):
NSA, NRO,
DSOC*, US
Coast Guard,
etc.
OSD
DoD HSI Management Plan
Joint HSI Steering Committee
(JHSISC)
Army
Navy
MANPRINT
NAVPRINT
Army HSI Mgt. Plan
Navy HSI Mgt. Plan
•Army HSI Org
•Army HSI Process
•Resources
•Metrics
•Tasks
• Navy HSI Org
• Navy HSI Process
• Resources
• Metrics
• Tasks
Tasking, Coordination, Status
Joint HSI Working Group
Air Force
AFHSI
AF HSI Mgt. Plan
•Air Force HSI Org
•Air Force HSI Process
•Resources
•Metrics
•Tasks
14
DoD HSI Planning Approach
FY09 DoD HSI Management Plan
Summary Outline
• HSI Organization
• Roles and Responsibilities
• Lifecycle Process
• HSI Acquisition Integration
• HSI Human Capital Development
• FY09 Key Tasks
• FY09 Schedule
• Resource Requirements
• Maturity and Effectiveness Metrics
• Assessment Process
Objectives:
• Foster communication
• Address common need areas
• Describe how HSI is implemented
• Report on progress against plan
• Foster consistency where it makes sense
Air Force HSI Mgmt Plan Annex
Army HSI Mgmt Plan Annex
Naval HSI Mgmt Plan Annex
15
DoD HSI Acquisition Implementation
Army MANPRINT Program
Air Force HSI Program
Office of Secretary of Defense
Under Secretary of Defense
(Acquisition, Technology and Logistics)
Director, Defense Research
and Engineering
Under Secretary of Defense
(Personnel & Readiness)
DUSD, Acquisition &
Technology (A&T)
DUSD, Science &
Technology (S&T)
HSI Management Responsibility
Director, Biological
Systems
Director, Requirements
& Program & Budgeting
Director, Systems and
Software Engineering
Associate Director, Total
Force Requirements
Joint HSI Steering Group
(OSD, Army, Navy, Air Force, JHSI WG)
Joint HSI Working Group
(OSD, Army, Navy, Air Force)
NAVPRINT Program
Joint HSI
Working Group
Secretary of
the Navy
ASN Research,
Development &
Acquisition
Program
Executive
Offices
Program
Management
Offices
Chief of Naval
Operations
CHSENG
NAVSEA
N1
NAVAIR
NAVSUP
SPAWAR
NETC
SYSCOM HSI
Working Group
(rotating lead,
currently NAVSEA)
N2
N4
N6
NPS
N8
N091
CNIC
N09F
Fleet
Readiness
Enterprise
NAVFAC
HSI Program
planning and
execution
MARCORSYSCOM
ONR
N3/N5
NPC
HSI Policy,
Requirements &
Resources
16
OSD HSI Plan for FY09
•
•
•
•
Continue to strengthen OSD and Services HSI relationships
Expand the reach of Joint HSI Steering Committee to agencies and
other Title 10 commands
Establish alignment with ongoing Environment, Safety, and
Occupational Health (ESOH) and Defense Safety Oversight Council
(DSOC) efforts
Develop Human Capital Development Plan
– HSI competency development for SEs
•
•
•
Strengthen Program Assessment Reviews in the HSI domain
Conduct HSI industry outreach through INCOSE, NDIA, GEIA (now
TechAmerica)
Develop consistent method for reporting Services HSI operating
costs.
17
HSI Outreach & Coordination
•
DSOC (Defense Safety Oversight Council)
– MG Travis, DSOC HSI Task Force
•
NDIA (National Defense Industrial Association)
– Formed HSI Subcommittee at OSD request
•
INCOSE (International Council on Systems Engineering)
– INCOSE SE Handbook includes HSI
– OSD / Services are Members of the INCOSE HSI WG
•
HFE TAG ( Human Factors Engineering Technical Advisory Group)
– S&T Outreach
•
Tech America (formerly GEIA)
– HSI Standards Committee – OSD / Service participation
•
Graduate HSI Education within Service’s Academic Programs (Naval
Post Graduate School and Air Force Institute of Technology)
18
DoD HSI Mgmt Plan
Key Tasks Areas
Key Task Area
Notes
Process and Planning
Effectively integrate HSI as part of the technical planning on programs.
Definitions and Terminology
Establish consistent definition in terms across for HSI that all three
Services will share.
Education and Training
Strengthen workforce education and training for HSI.
HSI Staffing
Increase dedicated HSI staffing to support programs.
HSI Maturity and Effectiveness Metrics
Define common and consistent means for defining and collecting data
to assess HSI maturity and effectiveness on programs.
Acquisition Guidance
Define supporting acquisition guidance to assist program managers to
enable HSI implementation on programs.
Requirements Development
Implement HSI requirements (KPPs/KSAs) within the JCIDS process.
Tools and Technology
Intelligently apply tools an technology that systemize HSI methods on
programs and provide consistent results.
Communications
Proactively engage the DoD community to explain the benefits of HSI.
Standards
Consider standards that address the full scope of HSI that links
element level standards. This may be done in the context of systems
engineering.
Leadership and Governance
Establish and maintain HSI DoD leadership and governance among
DoD Components to achieve acquisition goals of improved overall
system performance and lower ownership costs.
19
Backup
20
NASA Programs
ACT
CEN CHA.REC
COBE DE
EDO ERB 77 ERB 80 EUVF/EP
GALL GOES 1‐M GRO 78 GRO 82 HEAO
HST IRAS ISEE
IUE
LAND 76 LAND 78
MARS
OMV PIONVEN
SEASAT SMM
STS
TDRSS TETH UARS ULYSSES
VOYAGER
APPLIED COMMUNICATIONS TECHNOLOGY SATELLITE CENTAUR (UPPER STAGE ‐‐TO BOOST FROM SHUTTLE TO GEO) (???) COSMIC RAY (OBSERVATORY) BACKGROUND EXPLORER DYNAMICS EXPLORER (A & B) EXTENDED DURATION ORBITER (MEDICAL) EARTH RADIATION BUDGET SATELLITE EARTH RADIATION BUDGET SATELLITE EXTREME ULTRAVIOLET EXPLORER/EXPLORER PLATFORM PLANETARY MISSION TO JUPITER EARTH OBSERVATION MISSION GAMMA RAY OBSERVATORY (1978) GAMMA RAY OBSERVATORY (1982) HIGH ENERGY ASTRONOMICAL OBSERVATORY (A, B & C) HUBBLE SPACE TELESCOPE INFRARED ASTRONOMICAL OBSERVATORY INTERNATIONAL/SUN EARTH EXPLORER INTERNATIONAL ULTRA VIOLET EXPLORER LANDSAT ‐EARTH OBSERVER LANDSAT ‐EARTH OBSERVER MARS OBSERVER ORBITAL MANEUVERING VEHICLE PIONEER/VENUS (NAME, NOT AN ACRONYM) SEA OBSERVER SATELLITE SOLAR MAXIMUM MISSION (SUN SPOT PERIOD) SHUTTLE MISSIONS TRACKING DATA RELAY SATELLITE SYSTEM TETHERED SATELLITE ULTRAVIOLET ASTRONOMICAL RESEARCH SATELLITE SOLAR/POLAR PLANETARY MISSIONS (NAME, NOT AN ACRONYM) 21
Heuristic Claim of SE & HSI
• Effective systems engineering & HSI leads to
– Improved system quality and performance
– Lower life cycle costs
– Improved schedule performance
Traditional Design
SYSTEM DETAILED
DESIGN DESIGN
PRODUCTION
INTEGRATION
Risk
Time
TEST
Risk
“System Thinking” Design
Saved
Time/
Cost
Value of Systems Engineering; INCOSE Symposium 6/04
Time
Ref: Eric Honour
Honourcode, Inc.
22
HSI Activities During Acquisition
MS A
MDD
Materiel
Solution
Analysis
MS B
Technology
Development
PDR or PDR
ƒ Validate HSI
Requirements and
POM ( Manpower,
Personnel, Training,
Safety, Occupational
Health, Survivability
and Human Factors
Engineering)
ƒInclude HSI
considerations in
initial TDS, SEP, and
TES
ƒInclude HSI analysis
and deliverables in
the in AoA
ƒAnalyze and
decompose HSI
requirements.
ƒValidate HSI
requirements
allocations via Mockups, simulation and
analysis.
ƒContribute to system
and subsystem level
trade studies.
ƒInclude HSI in the
SEP and TEMP.
ƒAssess HSI Total
Operating Cost
MS C
Engineering and
Manufacturing
Development
Production and
Deployment
Full Rate Production
Decision Review
CDR
ƒValidate HSI
requirements against
the system design via
analysis, simulations
and reviews.
ƒInclude HSI in the
SEP and TEMP
ƒAssess HSI Total
Operating Cost
O&S
ƒTest and evaluate
HSI during OT&E
ƒInclude HSI in the
SEP and TEMP
ƒAssess HSI Total
Operating Cost
ƒEvaluate user
performance on
fielded system.
ƒMake
recommendations for
improvements.
Assessedduring
duringtechnical
technicalreviews,
reviews,T&E,
T&E,
Assessed
andProgram
ProgramSupport
SupportReviews
Reviews
and
23