Subsystem Acceptance and
Verification in Commissioning
Chuck Claver
LSST Systems Scientist
LSST All-Hands Meeting
Bremerton
August 18, 2015
Outline
• Subsystem Acceptance Plans
– Camera
– Telescope
– Data Management
• Compliance evaluation during the Commissioning Phase
• Operations Readiness
• Further detailing of the Commissioning Plan
8/18/2015
LSST Systems Engineering
1
Acceptance Data Package
• Relevant requirements
– Specifications and interface requirements
– Non-conformance reports, change requests, deviation approvals
• Compliance assessment & certification
–
–
–
–
–
•
•
•
•
•
Verification Matrix
Verification and acceptance test plans and procedures
Qualification and/or acceptance test results
Calibration and certification requirements records
Material and/or process certifications
Safety documentation and constraints
As-built technical documentation
Shipping, handling and storage plans
Spares and/or overage inventory
Operations, maintenance, and repair procedures and manuals
How we get here will be unique to each subsystem.
8/17/2015
LSST Systems Engineering
2
Systems Engineering tracks subsystem
development with the integrated project
schedule
Telescope assembly,
integration & test.
Final assembly and
testing done on-site
Telescope development
ends with significant onsky optical testing.
Telescope Ready for I&T and
Integration Readiness Review
Oct. 2019
Telescope Acceptance Plan
The telescope is made up mostly from large contracted subsystems
that are integrated on-site. There is no “pre-shipment” review.
• PSE will observe early subsystem acceptance tests/reviews with the T&S team.
• T&S team will have on sky testing during final stages of Telescope & Site
Integration:
– On-axis optical testing with Shack-Hartmann WFS
– PSE will participate in and observe optical testing as part of T&S acceptance
• Integration Readiness and T&S Acceptance Review at the conclusion of on-axis
testing. Compliance assessment with respect to the Telescope & Site Subsystem
Requirements (LSE-60):
–
–
–
–
–
–
Optical performance – on-axis only
Dynamic performance – Telescope + Dome
Telescope telemetry is being recorded into the Engineering Facility Database
Safety interlock system fully functional
Functional control with TCS and OCS fully operational
Etc…
8/18/2015
LSST Systems Engineering
4
Systems Engineering tracks subsystem
development with the integrated project
schedule
Camera assembly,
integration and test.
Camera pre-ship acceptance
at SLAC Feb 2020.
Camera re-verification in Chile
Full System I&T Start Aug 2020.
Camera Acceptance Plan
The LSST Camera will be tested and verified fully assembled at
SLAC and delivered the the Observatory as a complete unit.
• PSE will observe final Camera verification tests at SLAC
• Compliance assessment with respect to the Camera Subsystem Requirements
(LSE-59) at the Pre-shipment review.
• PSE will support and coordinate the re-verification of the Camera at the LSST
Summit Facility
• At the conclusion of the summit re-verification the PSE will conduct a Camera
Integration Readiness Review:
– Camera mounted to Top End integration hub on transport cart
– CCS is communicating with the OCS and accepting commands
– Camera DAQ connected to network and able to send data to Base Facility Archive and
NCSA
– Camera telemetry is being recorded in to the Engineering Facility Database
– Filter swap demonstrated
– Camera safety interlock system fully operational
8/18/2015
LSST Systems Engineering
6
Systems Engineering tracks subsystem
development with the integrated project
schedule
DMS integration,
test and release.
R8.
1
DMS Ready for Early I&T
Start.
R9.
1
R10.1
Data Management Acceptance Plan
Software and infrastructure capabilities from Data Management
follows a phased approach aligned with the Project needs during
Commissioning per LDM-240.
• Phase 1 of DM acceptance will follow Release 8.0/8.1 with readiness
review of software and infrastructure needed to support ComCam.
– Compute and networking infrastructure limited
• Phase 2 of DM acceptance will follow Release 9.0/9.1 with readiness
review of software and infrastructure needed to support the full LSST
Camera.
– Compute and networking infrastructure full scale
• Phase 3 of DM acceptance will follow Release 10.0/10.1 with a readiness
review of software and infrastructure needed to support Science
Verification and initial Survey Operations.
Details still needs coordination with DM
8/18/2015
LSST Systems Engineering
8
Commissioning Phases
• Each phase has a hardware driven period followed by a
data/software driven period
• A readiness/status review will govern the transition between phases:
– Unverified subsystem requirements will be reassessed
– System status and compliance assessment from previous phase will be reviewed
– System verification & test plans for the new phase will be reviewed
• Transition from hardware to software/data driven periods and will be
governed by intermediate status reviews.
• Reviews will assess compliance with all requirements and interfaces
as appropriate:
– Early I&T phase driven by verification of OSS and Subsystem Interface
Requirements
– Full System I&T phase driven by verification of the LSR, OSS and Subsystem
Interface Requirements.
– Science Verification phase driven by verification and characterization of
LSR/SRD survey performance requirements
• Transition to Operations marked by the Operations Readiness
Review
Commissioning Phases
• 6 month (+4m optional) early System I&T
– Interface testing & Active Optics Control Testing
– Calibration Operations and Cal. Data Products
Pipeline Processing,
ComCam
– Scheduler Driven Operations Testing
– DM Algorithm Development
• 7 ½ month Camera-Telescope-DM integration
– Final System Interface Verification
– Telescope-Camera Integration and Test
– DM Pipeline Testing with Full FPA Data
• 5 month Science Verification
– Operations Readiness mini-survey using
Initial Survey Cadence
– Pre-Operations Engineering
ComCam
LSR/SRD verification matrix will be filled in with
compliance & characterization data at ORR
Occurrences
LSE-79
25
20
15
10
5
0
Other Requirements for Operation
Readiness
• The project team shall demonstrate that the integrated LSST system
can collect and process time-domain Level 1 data products, including
the generation and distribution of alerts;
• The project team shall demonstrate that the integrated LSST system
can monitor and assess the quality of the data as it is being collected;
• The project team shall demonstrate that relevant metadata are being
collected and archived;
• The project team shall deliver a complete set of documented
operational procedures and supporting technical documents needed to
operate the LSST as a scientific facility for the purpose of conducting a
10-year survey; and
• The project team shall deliver all reports documenting the as-built
hardware and software including: drawings, source code,
modifications, compliance exceptions, and recommendations for
improvement.
Developing the details going forward
Detailed commissioning activities and procedures must be integrated
with the system verification plans.
We will be looking for someone to help in FY16
Associate Commissioning Scientist (TBD)
The Large Synoptic Survey Telescope (LSST) is looking for a scientist to help the project develop
and validate the tests, procedures and analysis needed in the Commissioning Phase of the
project. This person will work with Project Systems Engineering and Systems Scientist to take the
activities and tests identified as part of the system verification and commissioning plans and develop
detailed procedures that will be used at the telescope. It is expected that this person would also
work with the project simulations team to validate these procedures using the Project's simulations
tools and framework. Further, the person is expected to develop the corresponding analysis
pipelines and visualization tools using the LSST's Data Management software stack and validate
their effectiveness. The end goal is throughout the detailed development of the LSST's
commissioning plan critical tasks and analyses are validated through simulations and that the
analysis "toolbox" needed for commissioning is developed along the way.
This position requires a PhD in Astronomy or a related field. It also requires strong coding
proficiency in python and familiarity with working in relational database systems. The position is
sited initially in Tucson for the first 4 years, but will be taken to Chile once commissioning
begins. Previous experience with commissioning astronomical instruments and/or telescopes is
desired.