Performance
Assessment
Business & Operations Advisory
Committee -- March 31, 2004
1
Objectives Statement
Develop and use performance
assessment tools and measures
to provide an environment of
continuous improvement in NSF’s
intellectual investments as well as its
management effectiveness.
Who? & How?
Advisory
Committees (ACs)
Committees of
Visitors (COVs)
NSF Staff
President’s Management Agenda (PMA)
Government Performance & Results Act
(GPRA)
Program Assessment Ratings Tool
(PART)
Various Other Assessments
B&O AC Meeting – March 2004
2
GAO Report on Program Evaluation
The U.S. General Accounting Office (GAO)
identified NSF as one of five federal agencies
that successfully demonstrated an evaluative
culture with analytical expertise and a
commitment to self-examination.
B&O AC Meeting – March 2004
3
Many Assessments
Managed at Different Levels
Components
NSF Mission
• Strategic or Long-Term
Planning
• NSF Performance Planning
• Advisory Committee Reviews
OUTCOMES
STRATEGIC
• Advisory Committee for GPRA
Performance Assessment
(AC/GPA)
• Business & Operations
Advisory Committee
• Committee of Visitors (COV)
OUTPUT
OPERATIONAL
• Merit Review
• Project Reports
• Program Assessment Ratings
Tool
INDIVIDUAL
ACTIVITY
• Individual Performance
Assessments
B&O AC Meeting – March 2004
4
Government
Performance & Results
Act or GPRA (1993)
Government-wide
Performance
Assessments
President’s Management
Agenda or PMA (2001)
Program
Assessment Rating
Tool or PART (2002)
R&D Investment
Criteria (2002)
B&O AC Meeting – March 2004
5
GPRA Performance
Planning and Reporting
• 5-year Strategic Plan
(‘03-’08)
• Annual Performance
Plan (in the budget)
• Annual Performance
Report (45 days after
close of FY)
– Performance Highlights
B&O AC Meeting – March 2004
6
GPRA Results
Annual Goal Type
Strategic Outcome Goals
FY99
FY00
FY01
FY02
FY03
100%
75%
80%
100%
100%
5 of 5
Management Goals
67%
15 of 20
6 of 8
4 of 5
60%
18 of 28
61%
15 of 23
4 of 4
4 of 4
74%
18 of 23
63%
14 of 20
FY04 GPRA Goals
Long-Term Strategic Goals
People
Annual Goals
Increase Award Size
Ideas
Increase Award Duration
Tools
Decrease Dwell Time
Organizational Excellence
+ (by 2006, over 100 PART goals)
B&O AC Meeting – March 2004
7
Strategic Goals – How to Assess?
People Goal – A diverse, competitive, and globally-engaged
U.S. workforce of scientists, engineers, technologists and wellprepared citizens
Ideas Goal - Discovery across the frontier of science and
engineering, connected to learning, innovation and service
to society
Tools Goal – Broadly accessible, state-of-the-art S&E
facilities, tools and other infrastructure that enable
discovery, learning and innovation
Organizational Excellence Goal - An agile,
innovative organization that fulfills its mission through
leadership in state-of-the-art business practices
B&O AC Meeting – March 2004
8
Advisory Committee for GPRA Performance
Assessment (AC/GPA)
Scientists, Engineers and Educators
(one-third or more from Directorate ACs)
COV
Project
Nuggets
Reports Reports
Using Indicators:
Significant
Achievement?
AC/GPA
People
Ideas
Tools
B&O AC
Organizational
Excellence
AC/GPA Report
B&O AC Meeting – March 2004
9
PMA
 Human
S
P
S = STATUS
Capital
P = PROGRESS
Competitive
Sourcing

Financial
Management

EGovernment

Budget/
Performance


R&D Criteria ???
B&O AC Meeting – March 2004
10
Program Assessment
Rating Tool (PART)
• Designed to focus on program performance
• Spreadsheet with questions on purpose, planning,
management and performance with goals
• Provides a score and effectiveness rating
B&O AC Meeting – March 2004
11
NSF PART Schedule
FY 2005
FY 2006
People
Individuals
Ideas
Tools
Facilities
Institutions
Collaborations
Polar
Priority Areas
Nanoscale S&E
Info. Tech. Research
Biocomplexity Env.
FY 2007
Fundamental S&E
FFRDCs
FY 2008
Centers
Infrastructure & Instrumentation Workforce for 21st C
Capability Enhancements
Math. Sciences
Human, Social Dyn.
B&O AC Meeting – March 2004
12
NSF FY05 PART Results
FY 2005
People
Individuals
Ideas
Tools
Facilities
Priority Areas
Nanoscale S&E
Info. Tech. Research
Government-Wide Results (399 PARTs)
All NSF FY05
PARTs rated
Effective
(highest rating)
11%
Effective
26%
37%
Moderately
Effective
Adequate
Ineffective
21%
5%
B&O AC Meeting – March 2004
Results Not
Demonstrated
13
Items Planned as References in
NSF’s Assessment of This
Indicator
1. PART Spreadsheets and Results from OMB
(http://www.whitehouse.gov/omb/budget/fy2005/pma/nsf.pdf and
http://www.whitehouse.gov/omb/budget/fy2005/pdf/ap_cd_rom/part.pdf)
2. Performance and Accountability Report
(http://www.nsf.gov/pubs/2004/nsf0410)
3. Performance Highlights Brochure
(http://www.nsf.gov/pubs/2004/nsf04011/)
4. President’s Management Agenda Results
(www.results.gov)
5. Committee of Visitors Reports
(www.nsf.gov/od/gpra/cov.htm)
6. FY05 Performance Budget, GAO Report, etc.
B&O AC Meeting – March 2004
14
Wrap-Up
• Today
– Presented Framework
• Technology Enabled Business Processes – Andrea and Mary
• Human Capital Management - Joe
• Performance Assessment - Craig
– Get Feedback
• Tomorrow to Mid-May
– NSF to Conduct Assessment
• Mid-May
– Transmit results to B&O Committee
• Early June
– Committee conference call to discuss results
– Letter from Committee
• June 22-23, 2004 – AC/GPA Meeting
B&O AC Meeting – March 2004
15