Traceability Requirements Management2 Traceability Systems Engineering STD.
U.S. Department of Energy Office of Civilian Radioactive ... · - Assure consistency and...
Transcript of U.S. Department of Energy Office of Civilian Radioactive ... · - Assure consistency and...
U.S. Department of EnergyOffice of Civilian Radioactive Waste Management
TSPA-SR IssuesManagement Plan
Presented to:DOE/NRC Quarterly QA Meeting
..- / ,. I / / 1
Introduction
Recent Quality Concerns- 2 CARs
* Model Validation
* Software
- TSPA-SR Quality Concerns
* NRC Telecons (May 4 and 9, 2001)
* NRC Letter (May 17, 2001)
Ym p Yucca Mountain Project/Preliminary Predecisional Draft Materials 613-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 2
Systematic Continuing Issues
* February 12, 2001 - BSC Assumed Prime ContractorRole on YMP
* Evidence of Continuing Quality Problems
* Initiated Management Plan to Correct QualityProblems
YA V Yucca Mountain ProjectlPreliminary Predecisional Draft Materials 613-Williamns-QA-Mtg-TSPA-Mgt-Plan.ppt 3
Quality Initiative Issues
* Document Integrity- Quality and traceability of documents and analytical models
that will be subject to the public process
Root Cause Determination (2 CARs)- Root cause assessment and action plan for
* Model Validation
* Software Verification
YM P Yucca Mountain Project/Preliminary Predecisional Draft Materials 613-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 4
Chronology
5/4-1712001 - Identification of errors by NRC and subsequenttelephone calls / correspondence with NRC
* 5/18/2001 - BSC Board Meeting
* 5/22/2001 - Bechtel mobilizes executive management team
5/29/2001 - Bechtel mobilizes senior project management team fromOak Ridge and Denver to finalize action plan
* 6/4/2001 - Bechtel executive management approves Quality Initiativeaction plan
6/4/2001 - Mobilization to support plan
Y M SP Yucca Mountain Project/Preliminary Predecisional Draft Materials 613-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 5
Quality Initiative Goals
* Assure the quality/sustainability of technicalreports/analyses supporting the YMP work
* Establish process improvements toperformance for continuing phases
improve projectof work
IYJ VP Yucca Mountain ProjectPreliminary Predecisional Draft Materials,"', amendment, � A� ���; I'll,
613-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 6
Overview
* Systematic Approach
* Regular Reporting on Progress and Results
* Immediate Corrective Actions
* Short Term Corrective Actions
* Longer Term Corrective Actions (Based on QualityInitiative Investigations)
* Highly Experienced Diverse Team
YM P Yucca Mountain ProjectlPreliminary Predecisional Draft Materials 613-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 7
Action Plan Scope
* Immediate/Short Term Actions
Short Term (through end of FY01)
- Document Integrity- Management Stand-Down on Software Development
- Root Cause Assessments
Long Term and Ongoing Actions
- Process Improvements
- Responsibility/Accountability
Y M P Yucca Mountain ProjectPreliminary Predecisional Draft Materials 613-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 8
Document Integrity Strategy
Horizontal review across key documents
- assure consistency of inputs and conclusions
Vertical reviews of the SSPA documents andsupporting analysis (both volumes)
- assure consistency and traceability
* Vertical review of TSPA Rev. 0, ICN 1
- assure traceability, consistency, linkage tosupporting models
Y M p Yucca Mountain Project/Preliminary Predecisional Draft Materials 613-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 9
Document Integrity Strategy
Horizontal Reviews- DEIS Supplement, S&ER, SSPA Volumes I & 2, and
TSPA Rev. 0, ICN 1
- Ensure consistency of technical inputs andconclusions
- DEIS Supplement and S&ER will be pace settingdocuments since they are already issued
- Duration:* 3 weeks review
* I week comment incorporation
YM P Yucca Mountain ProjectlPreliminary Predecisional Draft Materials 613-Williains-QA-Mtg-TSPA-Mgt-Plan.ppt 10
Document Integrity Strategy
* Vertical reviews of the SSPA documents andsupporting analysis
- Assure consistency and traceability
- Each volume
* Staggered Overlapping Reviews* Duration:
> 2 weeks review
> 1 week comment resolution
TrM Ar" Yucca Mountain ProjectPreliminary Predecisional Draft Materials 613-Williams-OA-Mtg-TSPA-Mgt-Plan.pot
11111_ _ . .
Document Integrity Approach
Prepare review guidance checklists- Reference checks
- Consistency checks
- Traceability checks
- Error checks
- Input and output checks
Identify bins for collecting daily review results formanagement review
d Y M neliminay Ped i iSiTal rfNaeials 61;- Wlmp1
J MP~ri Yucca Mountain Project/Preliminary Predecisional Draft Materials 61 3-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 12
Document Integrity Management
Weekly Review of Results
* Upon Completion of 1Management Will Ass
YM P Yucca Mountain ProjectlPreliminary Predecisional Draft Materials
lorizontal and Vertical Reviews:Fess Need for Further Action
~~~~~~63Wilans-AMgTP-g-lnpt1613-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 13
Document Integrity Strategy
* Vertical review of TSPA Rev. 0, ICN 1- assure traceability, linkage to supporting models, and to
identify errors
- Duration:
* 4 weeks review
* 3 weeks comment resolution
I Sk i/ Yucca Mountain Project(Preliminary Predecisiona Draft MaterialsYM>, ~Yucca Mountain ProjectlPreliminary Predecisional Draft Materials61-WlimQAMgTPMtPanpt4- I 11-1
613-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 14
Quality InitiativeResults of Initial Investigation
Programmatic/Process Issues- 4 Deficiency Reports
- 3 CIRS Items
* Technical Issues- were mostly known to technical personnel
- further assessments still in progress
- all assessed to date have minimal or no impact
YM .P Yucca Mountain Project/Preliminary Predecisional Draft Materials 613-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 15
TSPA-SR Rev. 0, ICN 1DRs CARCIRS
#1577 - Develop reviewprocess for responses toNRC informal requests
BSC-01-D-078 - Out-of-Bound,< Models
BSC-0I-D-068 - Unqualified codes(WAPDEG & FEHM) used in
V TQP A
#1580 - Investigateerrors identified by NRC
h-P-
YMSC-01 -C-002
Software IssuesX ".L z 1.
I
-
#1581 - Investigateorigination, checking, &approval process
BSC-01-D-077 - Output DTNsrevised or superceded w/odocumentation in reports
BSC-01-D-080 - No DRs developedwhen quality of TSPA wasindeterminate
(~~~~~~~~~~~~~~~~~~~~~~~~}h~~i/0Ml4}i Pear~ gon1m1 i= /
YM P Yucca Mountain ProjectlPreliminary Predecisional Draft Materials 613-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 16
Corrective Action Requests
* Institute Immediate Actions
* Conduct Root Cause Determinations- Model Validation (May 3, 2001)
- Software Verification (June 2001)
IY MlP Yucca Mountain Project/Preliminary Predecisional Draft Materials
mand "'I N -- lx � �r- - - --613-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 17
Corrective Action Requests
Initial Immediate Actions
- BSC Management stand-down to control the furtherdevelopment of software (June 7, 2001)
- Initiated teams to begin model validation and softwareverification actions immediately
- Initiated formal root cause analysis in compliance withprocedural requirements (June 4, 2001)
- General Manager Meeting to Emphasize Expectations(June 11, 2001)
YA V Yucca Mountain ProjectlPreliminary Predecisional Draft Materials 613-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 18
Corrective Action Requests
* Formal Root Cause Analyses- Single Team Will Conduct Both Root Cause Analyses to
Ensure Integration of Common Causes
* Model Validation
* Software Verification
- Utilize Tap Root Process (Mandated by Project Procedures)
IYM P Yucca Mountain ProjectPreliminary Predecisional Draft Materials11,17' -�e' �IZAI'�:
613-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 19
Corrective Action Requests
Root Cause Assessments- Team Composition
* Team Leader* Technical Experts and Independent Outside Consultants
* Project Liaison* Administrative Support
Y M -Y ucc M rri- -_ X 6Atan#t 20
1'7M 1J Yucca Mountain ProjectiPreliminary Predecisional Draft Materials 61 3-Williams-QA-Mtg-TSPA-Mgt-Plan ppt 20
Corrective Action Requests
* Immediate Actions: Model Review- Initiate a review of the existing models that lack
compliant validation and document the results ofthe review
- Review will categorize:
* adequate confidence for intended use in SR butrequiring further documentation prior to LA
* inadequate confidence in the use of the model forSR requiring immediate impact assessment orfurther validation
W Y MiI, j, isoa Dr M rYM P Yucca Mountain Project/Preliminary Predecisional Draft Materials 6 13-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 21
Model ValidationDRs STIR CAR
LVMO-00-D-046 - Draft UZ testconceptualization model validation doesnot meet AP-3.I OQ, Rev 1, JCN 1(Closed into DR- 119)
LVMO-00-D- 119 - Sampling of AMRsused to support TSPA-SR foundinadequate documentation of modelvalidation
STIR BSC-01-004Concluded thatmany modelsacross a broadrange ofAnalysis/ModelReports were notin compliancewith proceduralrequirements forvalidation
YMSC-01 -C-001
Ineffective correctiveaction regardingmodel validationLVMO-00-D 151 - Igneous Consequence
Modeling AMR contains modelvalidation deficiencies
LVMO-01-D-007 - SZ radionuclidetransport model validation is unclear
LVMO-O1-D-050 - four models in EBSPhysical and Chemical EnvironmentalModel AMR used subjective criteria notdelineated in procedure for validation
O W W idg , , v,;YM P Yucca Mountain Project/Preliminary Predecisional Draft Materials 61 3-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 22
Corrective Action Requests
* Immediate Actions: Software- Software Review
* Review existing software and prepare appropriate verificationdocumentation
* Initiate revisions to the software procedures to provideappropriate requirements and controls for softwaredevelopment and configuration control
hf ,.If 7 fflf_-_~~~~uc Monti Prjet/rlimnr Prendecsiona Drf Maeral 61 d -WilfiarsQ-t-TP- - Ia Xpp 23_
YM P Yucca Mountain ProjectlPreliminary Predecisional Draft Materials 613-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 23
-' I
Longer Term Actions
Procedure Revisions/Enhancements
* Baseline Management/Controls
* Corrective Actions Identified by Root CauseDetermination
YM P Yucca Mountain ProjectPreliminary Predecisional Draft Materials 613-Williains-QA-Mtg-TSPA-Mgt-Plan.ppt 24
Impact of Unqualified Data and Software
* Compile unqualified/TBV inventory
* Identify information not needing qualification
* Conduct vertical trace from source to TSPA-SR input parameter
* Determine significance to TSPA-SR input parameter and results
* Prepare documentation of findings
* Prepare summary of conclusions
* Review prior to release
IY M P Yucca Mountain ProjectlPreliminary Predecisional Draft Materials'r �2,, , �� �
6 13-Williams-QA-Mtg-TSPA-Mgt-Plan.ppt 25