Wayne Lutters - (QEM) Network

Preparing Evaluation, Project Management, and Data Management Plans WAY N E LU T T E R S Q E M C O N SU LTA N T Critical documentation for evaluation •  Is your project a “good risk” or a “bad risk”? •  How will you… •  organize and oversee your project? •  know if it is progressing well and ultimately has been successful? •  mentor the junior scholars on your team? •  mange and share your data? Project Management Plan H O W W ILL Y O U O RGA N IZ E Y O UR P ROJE C T ? •  Brilliant scientific projects fall prey to the mundane challenges of conducting science all the time •  Your strategy to acknowledge and resist the natural entropy Rationale MRI •  Description of space and/or facility •  Operation and maintenance – how and by whom? (letter) •  Anticipated costs and technical expertise – acquired? •  Allocating access, attracting new users •  Anticipated usage and downtime Requirements Tracks 1 & 2 MRI •  Full work breakdown structure and schedule •  Organization of project team, responsibility matrix •  Risk assessment and mitigation •  Dissemination of instrument design Requirements Track 2 only RIA •  General plan of work •  Identify collaborator (letter) •  Home or other institution •  NSF-­‐funded research center or national lab •  Timeline, including summer and/or release time •  PI meeting Requirements Project Assessment Plans H O W W ILL Y O U E VA LUAT E Y O UR P ROJE C T ? •  Continual evaluation of your progress with clear metrics •  Formative assessment (on-­‐going) •  Am I doing what I said I would do? Am I doing this well? What do I need to change? Rationale •  Summative assessment (conclusion) •  What are the metrics of success? Was I successful? What were the outcomes? What impact did they have? MRI •  General project management •  Impact on research and training infrastructure •  Enhance institutional capacity •  Broaden participation Requirements RIA •  Central to all HBCU-­‐UP awards “culture of assessment” •  Plan for how the progress of the research will be assessed •  Map goals to specific activities, outputs, and outcomes •  Formative and summative assessments •  Timeline of evaluation milestones •  Lessons learned Requirements •  Don’t overlook in your budget Mentoring Plans H O W W ILL Y O UR JUN IO R SC H O LA RS B E N E F IT ? •  Balance of educational and employment opportunities •  As an educator your junior scholars are not just labor •  Thoughtful plan for how this research experience develops them personally and professionally Rationale MRI RIA •  Post-­‐doctoral mentoring plan required for any NSF project with someone in that capacity •  Less common for these competitions •  For MRI, only track 2 “development” •  For RIA, budget constraints •  Professional development Post-­‐Doc •  Fostering independence, transition to management •  Experience: authorship, granstmanship, teaching, review •  Performance evaluation •  Networking, career planning RIA •  RIA Supplemental document if requesting student funding •  Mentoring activities: summer vs. academic year •  On-­‐site with your collaborator Undergraduate & Graduate Project Management Plan C A RE TA K IN G O F Y O UR SC IE N T IF IC P RO DUC T S, RAW & F IN ISH E D •  Your project is a US taxpayer investment •  What is the return on that investment? •  Always an emphasis on broad dissemination of outcomes •  Now extended to the more “raw” material of research as a public resource Rationale •  This is an ongoing, evolving process for all federal funding agencies MRI RIA •  Per GPG II.C.2.j “1. the types of data, samples, physical collections, software, curriculum materials, and other materials to be produced in the course of the project; 2. the standards to be used for data and metadata format and content ([or to be developed]); Policy 3. policies for access and sharing including provisions for appropriate protection of privacy, confidentiality, security, intellectual property, or other rights or requirements; 4. policies and provisions for re-­‐use, re-­‐distribution, and the production of derivatives; and 5. plans for archiving data, samples, and other research products, and for preservation of access to them.” MRI RIA •  Standard formats for recording and storing •  Volume – how much? appropriate storage •  Temporal – how long? protected 1st use? •  Reuse – how much metadata? documentation? •  Infrastructure for hosting and sharing Common Issues •  Roles and responsibilities •  Costs during and after project MRI RIA •  Supplemental document (max 2 page) •  May expand in the project description •  Actively reviewed as intellectual merit and/or broader impact, specific reviewer and panel requirement •  Directorate specific guidelines Requirements •  “No data are expected to be produced from this project.” Must provide clear justification MRI RIA •  Grant Proposal Guide (GPG) Chapter II.C.2.j •  Award & Administration Guide (AAG) Chapter VI.D.4. •  Guidelines by directorate http://www.nsf.gov/bfa/dias/policy/dmp.jsp Resources •  FAQ http://www.nsf.gov/bfa/dias/policy/dmpfaqs.jsp Questions?