Issue Date: 1/17/02

NRC Inspection Manual IIPB

# Inspection Procedure 95003

Table Of Contents

- 95003-01 Inspection Objectives
- 95003-02 Inspection Requirements
- 95003-03 Inspection Guidance
- 95003-04 Resource Estimate

## Supplemental Inspection for Repetitive Degraded Cornerstones, Multiple Degraded Cornerstones, Multiple Yellow Inputs, or One Red Input

PROGRAM APPLICABILITY: | 2515

CORNERSTONES: | ALL

INSPECTION BASIS: | BASIS: The NRC's revised inspection program includes three parts: baseline inspections; generic safety issues and special inspections; and supplemental inspections performed as a result of risk significant performance issues. The inspection program is designed to apply NRC inspection assets in an increasing manner when risk significant performance issues are identified, either by inspection findings evaluated using the significance determination process (SDP) or when performance indicator thresholds are exceeded. Accordingly, following the identification of an inspection finding categorized as risk significant (i.e., white, yellow, or red) via Table 2 of the SDP, or when a performance indicator exceeds the "licensee response band" threshold, the NRC regional office will perform supplemental inspection(s). The scope and breadth of these inspections will be based upon the guidance provided in the NRC's "Assessment Action Matrix" and the Supplemental Inspection Selection Table (included in 2515 Appendix B). This procedure provides the supplemental response for repetitive degraded cornerstones, multiple degraded cornerstones, multiple yellow inputs, or one red input to the Assessment Action Matrix. The intent of this procedure is to provide the NRC with supplemental information regarding licensee performance, as necessary to determine the breadth and depth of safety, organizational, and programmatic issues. As such, this procedure is more diagnostic than indicative, and includes reviews of programs and processes not inspected as part of the baseline inspection program. While the procedure does allow for focus to be applied to areas where performance issues have been previously identified, the procedure does require that some sample reviews be performed for all key attributes of the effected strategic performance areas. The rational behind this is that additional NRC assurance is required to ensure public health and safety, beyond that provided by the baseline inspection program and the performance indicators at those facilities where significant performance issues have been identified. The results of this inspection will aid the NRC in deciding whether additional regulatory actions are necessary to assure public health and safety. These additional regulatory actions could include orders, confirmatory action letters, or additional supplemental inspections, as necessary to confirm that corrective actions to the identified performance concerns have been effective. This procedure was developed with consideration of the following boundary conditions: The NRC is performing the inspection; The procedure is not intended to be used for event response; New issues identified by the team will be evaluated using the significance determination process during the course of the inspection; other process issues will be documented in the inspection report; and, The procedure is intended to provide insight into the root and contributing causes of performance deficiencies, but is not intended to be a substitute for a more focused root cause analysis (or self assessment) of specific performance issues to be performed by the licensee or by a third party.

### 95003-01 Inspection Objectives

01.01 | To provide the NRC additional information to be used in deciding whether the continued operation of the facility is acceptable and whether additional regulatory actions are necessary to arrest declining plant performance.
01.02 | To provide an independent assessment of the extent of risk significant issues to aid in the determination of whether an unacceptable margin of safety exists.
01.03 | To independently assess the adequacy of the programs and processes used by the licensee to identify, evaluate, and correct performance issues.
01.04 | To independently evaluate the adequacy of programs and processes in the affected strategic performance areas.
01.05 | To provide insight into the overall root and contributing causes of identified performance deficiencies.
01.06 | To determine if the NRC oversight process provided sufficient warning to significant reductions in safety.

### 95003-02 Inspection Requirements

The intent of this procedure is to allow the NRC to obtain a comprehensive understanding of the depth and breadth of safety, organizational, and performance issues at facilities where data indicates the potential for serious performance degradation. The procedure is not intended to duplicate the scope of previously performed baseline and supplemental inspections; however, some repetition may be necessary where previous inspections were not sufficient to fully scope the breadth and depth of licensee performance issues. Considerable leeway has been built into the procedure to allow it to be customized, to better reflect the specific nature of the previously identified performance issues.

This procedure was written with the assumption that supplemental inspections (either 95001 or 95002) have been conducted to evaluate the licensee's root cause evaluations and associated corrective actions for "white" or greater performance indicators or inspection findings. If such supplemental inspections have not been conducted, the scope of this inspection should include inspection of the licensee's evaluation of those issues.

02.01 | Strategic Performance Area(s) Identification
| a. | Using the information contained in the Assessment Action Matrix, identify the strategic performance areas for which performance has significantly declined (e.g. Reactor Safety, Radiation Safety, or Safeguards). The scope of this inspection will generally include all key attributes of the degraded strategic performance areas. Specific inspection requirements pertaining to each strategic performance area are contained in Sections 02.03 - 02.06 of the procedure.
| b. | Inspection Requirements 02.02, 02.07, and 02.08 should always be performed regardless of the strategic performance areas selected for review. Attachment 95003.01, "Additional Emergency Preparedness Cornerstone Inspection," to this procedure should be performed when Emergency Preparedness Cornerstone performance issues are a contributing factor to the reason this procedure is being implemented, e.g., the EP Cornerstone is degraded and Reactor Safety is the relevant strategic performance area. When Attachment 95003.01 is implemented it supplants the EP related inspection requirements contained in the body of this procedure.
02.02 | Review of Licensee Control Systems for Identifying, Assessing, and Correcting Performance Deficiencies. Once significant performance concerns have been identified in the Action Matrix, the NRC must ensure that licensee systems for identifying, assessing, and correcting performance deficiencies are sufficient to prevent further performance degradations. The following inspection requirements evaluate whether licensee programs are sufficient to prevent further declines in safety that could result in unsafe operation.

| a. | Determine whether licensee evaluations of, and corrective actions to, significant performance deficiencies have been sufficient to correct the deficiencies and prevent recurrence.
| b. | Evaluate the effectiveness of audits and assessments performed by the quality assurance group, line organizations, and external organizations. Focus on how the performance data is integrated with other data to arrest declining performance. This review should include the organization's response to EP related corrective actions identified as a result of actual events, exercises and drills.
| c. | Determine whether the process for allocating resources provides for appropriate consideration of safety and compliance, and whether appropriate consideration is given to the management of maintenance backlogs and correction of work-arounds.
| d. | Evaluate whether licensee performance goals are congruent with those corrective actions needed to address the documented performance issues.
| e. | By reviewing selected aspects of the employee concerns program, ensure that employees are not hesitant to raise safety concerns and that safety significant concerns entered into the employee concern program receive an appropriate level of attention.
| f. | Evaluate the effectiveness of the organization's use of industry information for previously documented performance issues.
02.03 | Assessment of Performance in the Reactor Safety Strategic Performance Area (Initiating Events, Mitigation Systems, Barrier Integrity, and Emergency Preparedness Cornerstones).
| a. | Inspection Preparation
|  | Develop an information base to allow the review of the effectiveness of corrective actions. (a)Compile performance information from the licensee's corrective action program, audits, self-assessments, licensee event reports (LERs), and the inspection report record (both the inspection reports and the PIM) for the time period determined by the team manager. (b)Review the compiled information and sort the issues by the key attributes listed below. Licensee corrective actions for the issues should be assessed as part of the following key attribute reviews. Select a system(s) for focus using the plant specific individual plant evaluation (IPE) and issues identified as part of the performance information developed above. Perform the following inspection requirements for each key attribute focusing on the selected system. While the inspectors should focus on the selected system, other systems and components may be reviewed as necessary to assess licensee performance for the following key attributes.
|  | 4. Review inspection reports and critique findings from EP related event response and drills. Review a summary of recent EP corrective actions. Review recent changes to the Emergency Plan (Plan) changes. Review licensee analyses of corrective actions related to specific findings and general audits where available. Develop an inspection plan to address concerns identified as well as the inspection requirements.
| b. | Key Attribute - Design. Inadequacies in the design, the as-built configuration, or the post- installation testing of plant modifications can cause initiating events, affect the capability and reliability of mitigating systems, and the margin of safety in barrier design. As plants age, their design basis may be misunderstood or forgotten such that an important design feature may be inadvertently removed or disabled as changes are made to the plant.
|  | Independently assess the extent of risk significant design issues by performing the following inspection requirements. The review shall cover the as-built design features of the selected system to verify its capability to perform its intended functions with a sufficient margin of safety. Focus will be on system modifications rather than original system design. Information from this inspection will be used to assess the licensee's ability to maintain and operate the facility in accordance with the design basis.
|  | Assess the effectiveness of corrective actions for deficiencies involving design. Select several modification to the system for review and determine if the system is capable of functioning as specified by the current design and licensing documents, regulatory requirements, and commitments for the facility. Determine if the system is operated consistent with the design and licensing documents. Evaluate the interfaces between engineering, plant operations, maintenance, and plant support groups.
| c. | Key Attribute - Human Performance. By nature of the design of nuclear power plants and the role of plant personnel in maintenance, testing and operation; human performance plays an important part in normal, off-normal and emergency operations. Human performance impacts each of the cornerstones and therefore should be considered across this entire inspection.
|  | The team members reviewing the specific key attributes should coordinate their activities to ensure that the following requirements are addressed:
|  | Assess the effectiveness of corrective actions for deficiencies involving human performance. Review specific problem areas and issues identified by inspections to determine if concerns exist in the following human performance areas.
|  | (a)Organizational Practices such as pre-job briefings, control room team work, shift turnover, self-checking and procedural use and adherence. (b)Training and Qualifications. (c)Communications. (d)Control of Overtime and Fatigue. (e)Human-System Interfaces including work area design and environmental conditions.
|  | 3. Conduct EP Emergency Response Organization Performance-Drills, in accordance with Inspection Procedure 82001, with a sampling of shift crews and management teams to assess their ability to implement the Emergency Plan.
| d. | Key Attribute - Procedure Quality. Inadequate procedures can cause initiating events by inducing plant personnel to take inappropriate actions during plant operations, maintenance, calibration, testing, or event response. Adequate procedures also assure proper functioning of mitigating systems during operation, maintenance, and testing. Emergency and abnormal operating procedures are also essential for mitigating system performance and assuring appropriate actions will be taken to preserve reactor coolant system (RCS) and containment integrity. To the extent that there are procedure deficiencies associated with the above noted activities, they should be identified as causes of problems in other key attributes.
|  | Determine the technical adequacy of procedures by verifying that they are consistent with desired actions and modes of operation by completing the following inspection requirements.
|  | Assess the effectiveness of corrective actions for deficiencies involving procedure quality. Evaluate the quality of procedures and as applicable, determine the adequacy of the procedure development and revision processes. Review a sample of Emergency Plan Implementing Procedure (EPIPs) changes against the requirements of the Plan and corrective action assessments. Determine if the EPIP change process is adequate in correcting EPIP related deficiencies and maintaining Plan commitments in EPIP instructions.
| e. | Key Attribute - Equipment Performance. Equipment failure or degradation can cause initiating events during power operation and losses of decay heat removal during shutdowns. To limit challenges to safety functions due to equipment problems, licensees should have programs to achieve a high degree of availability and reliability of equipment that can cause initiating events. The availability and reliability of equipment is also critical to mitigating the impact of initiating events on plant safety. Strong preventive and corrective maintenance programs are an integral part of assuring equipment availability and reliability.
|  | Determine that the licensee is adequately maintaining and testing the functional capability of risk significant systems and components by completing the following inspection requirements.
|  | Assess the effectiveness of corrective actions for deficiencies involving equipment performance, including equipment designated for increased monitoring via implementation of the Maintenance Rule. Determine if the licensee has effectively implemented programs for control and evaluation of surveillance testing, calibration, and post-maintenance testing. Assess the operational performance of the selected safety system to verify its capability of performing the intended safety functions. Review a sample of EP related equipment and facilities (including communications gear) against Plan commitments. Review the adequacy of the surveillance program to maintain equipment and facilities. Review the correction of deficiencies identified by the surveillance program.
| f. | Key Attribute - Configuration Control. Loss of configuration control of risk-significant systems or equipment can lead to the initiation of a reactor transient and/or can compromise mitigation capability. Maintaining proper water chemistry in the RCS is essential to long term reliability of both the nuclear fuel and the RCS pressure boundary. Proper configuration control is necessary to maintain assurance that the RCS pressure boundary is maintained intact and monitored for degradation. Containment integrity depends on maintaining the configuration of penetrations and safety-related systems that need to respond following an accident. Also, maintaining the containment within its design limits ensure that it will be able to accommodate a design basis or severe accident.
|  | Assess the licensee's ability to maintain risk-significant systems and the principle fission product barriers in configurations which support their safety functions by completing the following inspection requirements.
|  | Assess the effectiveness of corrective actions for deficiencies involving configuration control. Perform a walkdown of the selected system. In addition, if the selected system does not directly have a containment over-pressure safety function (such as containment spray), conduct an additional review of such a system. (a)Independently verify that the selected safety system is in proper configuration through a system walkdown. (b)Review temporary modifications to ensure proper installation in accordance with the design information. Determine that the work control process uses risk appropriately during planning and scheduling of maintenance and surveillance testing activities and the control of emergent work. Determine whether the primary and secondary chemistry control programs adequately control the quality of plant process water to ensure long-term integrity of the reactor coolant pressure boundary. Assess the programs and controls (tracking systems) in place for maintaining knowledge of the configuration of the fission product barriers including: containment leakage monitoring and tracking, containment isolation device operability (valves, blank flanges), and reactor coolant leak-rate calculation and monitoring. Review the results of the plant specific IPE relative to the system(s) selected. Determine if the IPE is being maintained to reflect actual system conditions regarding system capability and reliability.
| g. | Key Attribute - Emergency Response Organization Readiness. Implementation of the Emergency Response Plan is dependent on the readiness of the emergency response organization to respond to an emergency. In this usage, "readiness" means the ability of the licensee to activate timely ERO augmentation of on shift personnel as necessary to implement the emergency plan. Self-assessments of readiness during drills and activation tests are used to identify areas for improvement. Self-assessment and corrective action resolution is critical to ERO readiness.
|  | Assess the effectiveness of corrective actions for deficiencies involving ERO readiness. Verify that adequate staffing is available on shift for emergencies. Verify the capability to activate and staff the emergency response facilities and augment the response organization within the requirements of the licensee emergency response plan. Verify licensee ability to meet Emergency Plan goals for activation by implementing Inspection Procedure 71114.03, "Emergency Response Organization Augmentation." If this inspection procedure has been implemented recently, the inspector may exercise judgement as to the need to implement the inspection procedure as part of the 95003 inspection effort. If Attachment 95003.01 is being implemented, there are additional requirements under this key attribute to consider.
02.04 | Assessment of Performance in the Radiation Safety Strategic Performance Area (Occupational Radiation Safety)
| a. | Inspection Preparation
|  | Develop an information base to allow review of the effectiveness of corrective actions. Compile performance information from the licensee's corrective action program, audits, self-assessments, LERs, and the inspection report record (both the inspection reports and the PIM) for the designated time period. Review the compiled information and sort the issues by the key attributes listed below. Perform the following inspection requirements for each key attribute. Note that specific areas such as external and internal dosimetry are not specifically delineated and treated as key attributes, but should they need to be closely examined, the inspector should use the procedures listed in 2515 Appendix B for evaluating extent of condition.
| b. | Key Attribute - Program/Processes. The effective implementation of the required radiation protection (RP) program and implementing procedures contribute to proper control and minimization of occupational exposures. Programmatic deficiencies, inadequate procedures, and/or improper implementation have all resulted in significant, uncontrolled occupational exposures in excess of regulatory limits (both from internal and external radiation sources). Worker radiation exposure controls are governed by both administrative and physical controls which serve as protective barriers that prevent excessive, unintended exposures in high and very high radiation areas, and significantly contaminated and airborne areas.
|  | The team members reviewing this aspect of the key attribute should coordinate their activities to ensure that the following inspection requirements are addressed:
|  | Assess the RP organization to ensure it is clearly defined (assignment of duties, authorities, and responsibilities); scope of program and the staffing are adequate. Select several implementing procedures (from three or more programmatic areas - job controls/coverage, surveys, RWP issuance, etc.) and evaluate their technical adequacy. Focus on problem areas identified in previous inspections. Review the procedure development process and determine its adequacy. Observe planned work activities in high radiation, high airborne, and/or highly contaminated areas and determine effectiveness of work planning, coordination, implementation and lessons learned.
|  | The facilities ALARA program focuses on ensuring that plant operations and maintenance activities are performed using planning, methods and procedures based to achieve occupational doses that are ALARA. The team members reviewing this aspect of the key attribute should coordinate their activities to ensure that the following inspection requirements are address:
|  | Determine adequacy/implementation of the radiological source term controls and quality of related chemistry controls. Determine adequacy/implementation of work planning and controls, focusing on outage maintenance periods. Determine effectiveness and degree of management support and integration of ALARA into facility craft work units.
| c. | Key Attribute - Plant Facilities/Equipment & Instrumentation. To properly conduct adequate radiation monitoring and surveillance activities and to protect workers, the facility is required to maintain fixed and portable radiation survey equipment (for airborne and external hazards), respiratory protection, communication, temporary ventilation and shielding, and anti-contamination clothing. Routine calibration and maintenance of this equipment ensures its continued operability. If problems are identified during the inspection preparation or during the conduct of this team inspection, the team should pursue the inspection requirements below. The team members reviewing this aspect of the key attribute should coordinate their activities to ensure that the following inspection requirements are addressed:
|  | Select several implementing procedures (from three or more programmatic areas - survey instrument calibration, self-contained breathing apparatus maintenance, etc.) and evaluate their technical adequacy. Focus on problem areas identified in previous inspections. Review the procedure development process and determine its adequacy. Observe several planned equipment maintenance or calibration activities. If possible, focus on equipment used in high risk areas (high radiation or airborne areas, potential oxygen-deficient, immediately dangerous to life or health (IDLH) areas, etc.). Determine level of management support in maintaining adequate equipment and support facilities.
| d. | Key Attribute - Human Performance. Worker performance has an obvious, important impact on work activities in radiological areas. Two of the major components are health physics technician (HPT) and general radiation worker (crafts) groups. Human performance is impacted by several vital factors -- qualification and training. The selection, qualification and training requirements for facility personnel are generally governed by a commitment in the plant technical specifications (to a ANS standard). For HPTs and others, 10 CFR 50.120 (training rule) requires HPTs (including contractors) to be task qualified for their assigned normal and outage duties.
|  | The team members reviewing this aspect of the key attribute should coordinate their activities to ensure that the following inspection requirements are addressed:
|  | Assess the effectiveness of corrective actions involving human performance. Review the applicable experience, qualification and training of selected members of the licensee's (and its contractor's) radiation protection organization. Review applicable radiation protection worker qualification and training of selected members of other facility work units (including contractor employees). Interview several radiation protection personnel, including first-line supervisors, professional RP staff, and the designated RPM. Assess their level of knowledge about the program, and applicable implementing procedures. During in-field observations of work in radiological areas, focus on HPT and worker performance relative to required RP work practices. Review specific problem areas and issues identified by inspections to determine if concerns exist in the following human performance areas:
|  | (a)Department practices such as shift turnover, self-checking and procedural use and adherence, pre-job briefings. (b)Communications. (c)Control of overtime and fatigue. (d)Human-System interfaces including environmental conditions and work area design.
02.05 | Assessment of Performance in the Radiation Safety Strategic Performance Area - (PUBLIC RADIATION SAFETY -- Radiological Effluent Monitoring, Radioactive Material Control, and Transportation of Radioactive Material)
| a. | Key Attribute - Plant Facilities / Equipment and Instrumentation. The improper installation, modification, maintenance, or calibration of radioactive effluent monitoring equipment, and associated radiochemistry laboratory equipment and meteorological system equipment can adversely affect licensee performance in achieving and demonstrating compliance with regulatory limits and ALARA design objectives for radioactive effluents. For transportation activities, shipping packages not prepared in accordance with their applicable design requirements increase the potential for unexpected exposure or loss of radioactive material which could result in uncontrolled and unnecessary exposure to members of the public. To prevent the inadvertent release of licensed radioactive material from the licensee's control requires the use of sensitive radiation survey equipment that is properly setup and calibrated.
|  | The inspectors reviewing this area should ensure the following requirements are addressed:
|  | Review the results of audits and appraisals performed for the designated time period. Review deficiency reports (also referred to as incident reports or condition reports) issued for the area being inspected. Perform a walkdown of the selected facility or equipment to assess its physical condition. Review any significant changes made by the licensee to the facilities or equipment that were not included in the prior inspection period. Determine the level of management support for the maintenance of facilities and equipment of the program.
| b. | Key Attribute - Program/Process. Procedures must be technically adequate and implemented appropriately to ensure the proper processing, control, and discharge of radioactive effluents into the environment. For transportation activities, procedural guidance is necessary for the proper evaluation of radioactive waste to determine the quantities and types of radioactive material present for the selection and preparation of shipping packages. Detailed procedures are required to conduct radiation surveys of the packaged radioactive waste to ensure that radiation levels are within regulatory limits. The performance of radiation surveys on equipment and material to be released from the licensee's facility requires appropriate policy and technical procedural guidance for handling and processing a wide variety of potentially contaminated materials.
|  | The inspectors should review the licensee's program documents and implementing procedures to ensure the following requirements are addressed:
|  | Review the results of audits and appraisals performed for the designated time period. Review deficiency reports (also referred to as incident reports or condition reports) issued for the area being inspected. Select several implementing procedures from the area being inspected and review for general quality (i.e., clearly written, contain specific actions, and contain data record sheets) and technical adequacy. Review the licensee's program documents and implementing procedures for any recent significant changes in the area being inspected. Review the records which resulted from the implementation of the selected procedures. Review them to determine if the procedure was correctly used.
| c. | Key Attribute - Human Performance. Human performance can directly affect radioactive waste processing, radioactive effluent processing, and transportation programs. It is important to ensure that plant workers are adequately trained and qualified to perform their job function. Periodic retraining is also needed to ensure that workers maintain their qualifications and are updated with new information and requirements.
|  | The inspectors reviewing this key attribute should coordinate their activities to ensure that the following requirements are addressed:
|  | Review the results of audits and appraisals performed for the designated time period which focused on human performance issues. Review deficiency reports (also referred to as incident reports or condition reports) issued for the area being inspected. Review specific problem areas and issues identified by inspections to determine if concerns exist in the following human performance areas:
|  | (a)Training and job qualification. (b)Communication within the specific department and with other departments. (c)Human-System interfaces, including work area design and environmental conditions. (d)Control of overtime and fatigue. (e)Organizational practices, such as pre-job briefings, team work, shift turnover, self-checking, and procedural use and adherence.
|  | 3. Observe the performance of activities described in the selected procedures. If the activities are not scheduled to be performed during the inspection time period, request that the activity be simulated so that worker performance and the adequacy of the procedure can generally be assessed.
|  | 4. Interview several personnel (i.e., technicians, engineers, health physicists, and supervisors) associated with the program to assess their level of knowledge about the program and procedures.
02.06 | Assessment of Performance in the Safeguards Strategic Performance Area
| a. | Key Attribute - Access Authorization (AA). The personnel screening process is the process used to verify trustworthiness of personnel prior to granting unescorted access to the protected area. The failure in the Access Authorization Program can compromise the licensee's ability to adequately protect against the insider threat of radiological sabotage that may result in core damage.
|  | Assess the licensee's ability to implement the behavior observation portion of the personnel screening and fitness for duty program.
|  | Verify that the licensee is identifying problems related to the access authorization program at an appropriate threshold and entering those problems into the corrective action program. Verify that the licensee has appropriately resolved the concerns and regulatory requirements for a selected sample of problems associated with AA.
| b. | Key Attribute - Access Control (Searches of personnel, packages, and vehicles). The Access Control program's function is to prevent the introduction of contraband (i.e. firearms, explosives, incendiary devices) into the plant that could aid in the attempt to commit radiological sabotage. The failure of the Access Control program could compromise security measures in place that are required to protect vital and risk significant plant equipment and functions.
|  | Assess whether the licensee has effective access controls, and equipment in place designed and functioning as intended to detect and prevent the introduction of contraband into the protected area that could be used to commit sabotage. Verify that the identification and authorization process is properly used to ensure that only those personnel who have been properly screened are granted unescorted access to the protected and vital area.
| c. | Key Attribute - Response to Contingency Events (protection strategy, program design, and support elements). The purpose of the licensee's contingency response program is to provide reasonable assurance that the licensee can protect identified target sets against the design basis threat and thus prevent core damage. The licensee should have developed a response strategy and the associated security response infrastructure necessary to maintain, update, and implement that strategy. The strategy's objective shall be to respond with sufficient force, properly armed, appropriately trained and within the appropriate time to protected positions to interdict and defeat the design basis threat in order to protect target sets, and thus prevent core damage.
|  | Verify that the licensee has established and maintains a contingency response program and the necessary infrastructure to support the performance of an adequate protective strategy.
| d. | Key Attribute - Response to Contingency Events (performance-based force-on-force exercises and target set evaluation). The licensee should be able to respond to contingency events with sufficient force, properly armed, appropriately trained and within the appropriate time to protected defensive positions to interdict and defeat the design basis threat in order to protect against radiological sabotage and prevent core damage.
|  | Verify through review of documents and discussions with the licensee that appropriate target sets are identified and have an associated protective strategy to those target sets. Verify through the conduct of table-top drills and NRC evaluated exercises that for any selected target set, the licensee's protective strategy is adequate and it can protect against the design basis threat.
| e. | Key Attribute - Security Plan Changes. The licensee's Security Plan is the licensee's plan for the physical protection at their site. An inadequate security plan can compromise the licensee's ability to protect against the design basis threat and be ineffective against acts of radiological sabotage. Changes to basic security measures could allow a direct reduction in the effectiveness of the physical protection measures that are vital to maintaining adequate physical protection.
|  | Verify that changes made to the licensee's Security Plan do not reduce its effectiveness to prevent or mitigate an attack by the design basis threat or increase the likelihood of acts of radiological sabotage. Verify that changes to the licensee's security procedures have not decreased the effectiveness of the previous plan, as required by 10 CFR Part 50.54(p).
02.07 | Group the safety performance deficiencies identified during the inspection by apparent root and contributing causes.
02.08 | Compare the team's findings with previous performance indicator and inspection program data to determine whether sufficient warning was provided to identify a significant reduction in safety. Evaluate whether the NRC assessment process appropriately characterized licensee performance based on previous information. The findings from this inspection requirement will not be contained in the inspection report associated with this inspection, but should be documented in a separate report, co-addressed to the appropriate Regional Administrator and the Director of NRR.

### 95003-03 Inspection Guidance

General Guidance

This procedure provides a framework for conducting a comprehensive assessment of licensee performance in affected strategic performance areas. As such, the procedure is broad in scope, but is designed to allow focus in certain areas where performance concerns have already been identified. While some inspection should be performed for each key attribute, certain inspection guidance is only applicable if problems are identified in that area. The team leader should ensure that an appropriate balance is maintained between determining the depth of previously identified issues and determining the breadth of performance issues within the strategic performance area.

In order to consolidate inspection activities, the team leader may decide to include a continuous main control room observation as part of the inspection. The results from the main control room continuous observation should satisfy several inspection requirements for the key attributes of configuration control, equipment performance, human performance, and procedure quality.

Team Staffing

The inspection should be staffed primarily by inspectors from other regional offices and/or headquarters. This provides sufficient diversity of talent and opinion, and also adds a degree of independence to the overall effort. The team leader selected to perform this inspection should have extensive experience in conducting NRC team inspections. Also, consideration should be given to staffing the inspection with an assistant team leader (ATL). The ATL's duties and responsibilities should mirror those of the team leader and should include the majority of the administrative tasks. The 95003 inspection is a demanding effort, and the team leader should have flexibility to respond to emergent demands for briefing NRC management and public officials as well as maintaining overall cognizance of the inspection effort. An ATL would aid in freeing up valuable time for the team leader to effectively accomplish these duties.

It is also desirable to staff the inspection with at least one inspector who has detailed knowledge of the site/plant layout. Consideration should be given to using the assigned resident staff or another inspector who has recently served as a resident at the site.

A "team manager" should also be designated for the 95003 effort. Ideally, the team manager should be based in the sponsoring region and should be an SES level manager. The role of the team manager is to coordinate important senior management briefings and interface with other Commission offices and external stakeholders as necessary during the conduct of the inspection. Additionally, the team manager would be responsible for acquiring additional resources as necessary to support the overall effort.

The use of contractor support should be considered for conducting aspects of the system design reviews and for help in reviewing the licensee's business and strategic plans. The statement of work (SOW) associated with contractor efforts should specifically include provisions for weekend travel for contractors as well as funding for review and concurrence on the final report.

Inspection Planning and Logistics

The decision to perform this inspection is based on the action matrix. Consideration should also be given to assigning an assistant team leader to help. At least one senior reactor analyst should be assigned full time to the team. Based on the documented performance issues and the guidance contained in this procedure, the team leader should develop an outline for a customized inspection plan which should describe the overall scope of the inspection, team member assignments, scheduling information, etc.. The team leader should then notify the licensee of the inspection dates and scope, and provide the licensee a list of requested documents that the team will need for its initial in-office review.

Prior to the start of the inspection, the team leader should also establish with the licensee an agreed upon method for tracking NRC information requests and potential issues (findings) that arise during the inspection. The NRC team should not provide written documentation to the licensee during the inspection, but rather, should ensure that both the team and the licensee have a common understanding of the developing issues, throughout the inspection. The joint use of a licensee developed and controlled issue tracking list is highly encouraged.

The team should prepare for the inspection at a location determined by the team leader. During this time, the team members should provide input into the inspection plan for their assigned areas and should provide the licensee a list of any other documentation that will be required for review on-site. This preparation phase of the inspection should normally last one to two weeks.

The on-site portion of the inspection should generally consist of two weeks on site, one or two weeks offsite, and a final week on-site. A final debrief should be provided to the licensee on the last day of the on-site inspection. A public exit meeting should be held approximately three weeks after completion of inspection. All team members should attend the final de-brief.

Due to the diagnostic nature of this inspection, a thorough documentation of the team's observations, findings. and conclusions is required. Unlike the content of baseline inspections, this inspection report should include the team's assessment of licensee performance for each inspection requirementof the key attributes contained in the section of this procedure. IMC 0612 (formerly 0610*) guidance regarding documentation thresholds is not applicable to this procedure. While certain issues should be evaluated using the SDP, this may not be possible for many of the team's more programmatic conclusions.

Specific Guidance

03.01 | Strategic Performance Area(s) Identification. No additional guidance provided.
03.02 | Review of Licensee Control Systems for Identifying, Assessing, and Correcting Performance Deficiencies.
| a. | The inspector should evaluate whether licensee evaluations into significant deficiencies are of a depth commensurate with the significance of the issue. Evaluations should ensure that the root and contributing causes of risk significant deficiencies are identified. Corrective actions should be taken to correct the immediate problems and to prevent recurrence. Include in the sample to be reviewed the licensee's evaluations associated with "white" or greater performance indicators and inspection findings that were not been previously inspected. Use the guidance contained in supplemental inspection procedure 95001 to help in evaluating the adequacy of the licensee's evaluations.
|  | To the extent possible, include in the sample licensee evaluations and assessments associated with programmatic performance issues and organization deficiencies, as well as those related to specific hardware issues. Consider the results of NRC's evaluation of licensee root causes performed during Inspection Procedure 71152 "Identification and Resolution of Problems".
| b. | Line organization, quality assurance, and external audits and assessments should be reviewed to determine whether the licensee has demonstrated the capability to identify performance issues before they result in actual events of undesired consequence. The findings of these audits and assessments should be integrated with more quantitative performance metrics and compared to those findings identified during this and other NRC inspections. Management systems should be in place to process and act upon this performance data as appropriate. The inspector should evaluate management's support to the audit and assessment process, as evidenced by staffing of the quality organization, responsiveness to audit and assessment findings, and contributions of the quality organization to improvements in licensee activities.
|  | With regard to EP related activities, Inspection Procedure 71114.05 "Correction of Emergency Preparedness Weaknesses and Deficiencies," contains guidance that may be useful in inspecting EP aspects of the PI&R program.
| c. | Processes for authorizing modifications and allocating resources for completing work should give adequate consideration to safety (risk) and the need for abiding by regulatory requirements. The authorization and allocation processes should provide for a manageable maintenance backlog and prevent the need for multiple work-arounds that could increase the likelihood of an initiating event or complicate accident mitigation.
| d. | The inspector should ensure that licensee performance goals are not in conflict with the actions needed to correct performance issues and are in alignment throughout the organization. To complete this requirement, a review should be performed of corporate, site, and organizational strategic plans, as well as other associated licensee documents.
| e. | Using the guidance contained in Inspection Procedure 40001, perform a limited review of the licensee's program for the resolution of employee concerns. In selecting samples for review, focus on those concerns and programs specifically applicable to the strategic performance areas which are the subject of this inspection. The intent of this review is to determine: (1) whether weaknesses in the employee concerns program have contributed to previously identified performance deficiencies; (2) whether additional safety issues exist that have not been adequately captured by the corrective action program; and, (3) whether weaknesses in the employee concerns program have resulted in issues associated with the maintenance of a safety conscious work environment.
| f. | The team's review of licensee industry information programs should be limited to those problems that might have contributed to the previously identified performance concerns. For example, weaknesses in licensee programs to review and assess vendor information may have contributed to equipment problems.
03.03 | Assessment of Performance in the Reactor Safety Strategic Performance Area
| a. | Inspection Preparation
|  | No specific guidance provided. System Selection. During the planning process, the team leader should select a system(s) based on the plant IPE, past safety system functional inspections that may have already been performed on a system by the licensee or by other NRC teams, and through review of issues contained in the Assessment Action Matrix. The team should select a number of electrical, mechanical, and instrumentation and control components for detailed review. The majority of these components should be from the principal system with the remainder from support systems which are necessary for successful operation of the principal system or from interfacing safety systems served by the principal system. No specific guidance provided. There are significant preparation activities associated with the review of the corrective actions program and the conduct of Performance-Drills. Guidance on those activities is given under the appropriate sections.
| b. | Key Attribute- Design
|  | The design review portion of the inspection should be performed by inspectors (or contractors) with extensive nuclear plant design experience. It is also important that the inspectors performing the design review have a good understanding of integrated plant operations, maintenance, testing, and quality assurance so that they are able to relate their findings to the other areas being inspected.
|  | The inspectors should focus their review on the system selected in paragraph 02.03.a.2. Specific supplemental inspection procedures are available for certain systems (e.g. service water, electrical, I/C) and should be considered as additional guidance for evaluating their functional adequacy. Prior to evaluating the selected system, the inspectors should review the design basis documents such as calculations and analyses. The review should provide the inspectors an understanding of the functional requirements for each system and each active component throughout the range of required operating conditions, including accident and abnormal conditions. The intent is to focus on the risk significant aspects of design that could contribute to an increased frequency of initiating events, degradation of mitigation systems, or degradation of barrier integrity. The inspection is not intended to be a re-validation of the original system design.
|  | In selecting a sample of modifications to the system to be reviewed, the inspectors should concentrate on those modifications with the potential to significantly alter the system design and functional capability. The sample should include modifications involving vendor supplied products or services where practicable, since the licensee's ability to oversee vendor supplied services is an important aspect of design control. Inspectors should consider expanding the sample of modifications, if significant problems are found. This expansion should consider other similar modifications and should not be limited to the initially selected system.
|  | The following inspection guidance covers a comprehensive number of design areas. The inspectors should focus their review as necessary to best reflect previous performance deficiencies.
|  | No specific guidance is provided for this requirement. For the selected modifications:
|  | (a)Verify that the design and licensing input and output information has been properly controlled. (b)Check the adequacy of design calculations for the selected modifications and Consider the following when evaluating the calculation design parameters of the following components:
|  | (1) For valves: What permissive interlocks are involved? What differential pressures will exist when the valve strokes? Will the valve be repositioned during the course of the event? What is the source of control and indication power? What control logic is involved? What manual actions are required to back up and restore a degraded function? Are the valves subject to pressure locking? Do the valves fail to their safety position? Are the valves addressed in emergency or abnormal operating procedures?
|  | (2) For pumps: What are the flow paths the pump will experience during accident scenarios? Do the flow paths change? What permissive interlock and control logic applies? How is the pump controlled during accident conditions? What manual actions are required to back up and restore a degraded function?What suction and discharge pressures can the pump be expected to experience during accident conditions? What is the motive power for the pump during all conditions? Do vendor data and specifications support sustained operations at low and high flows?
|  | (3) For instrumentation and automatic controls: What plant parameters are used as inputs to the initiation and control system? Is operator intervention required in certain scenarios? Are the range and accuracy of instrumentation adequate? What is the extent of surveillance and calibrations of such instrumentation? What are the power sources during blackout conditions?
|  | (c)Compare the as-built design with the current design basis and the licensing requirements for the selected system and consider the following questions:
|  | (1)Verify that the modification does not invalidate assumptions made as part of the original design and the accident analyses, including interfaces with supporting systems. For example, are service water flow capacities sufficient with the minimum number of pumps available under accident conditions?Are the voltage studies accurate and will the required motor operated valves (MOVs) and relays operate under end-of-life battery conditions and degraded grid voltages? Are fuses and thermal overloads properly sized? Are current dc loads within the capacity of the station batteries?Is the instrumentation adequate in range and accessibility for operations to control the system under normal and abnormal conditions? Are maintenance frequencies sufficient to maintain the equipment within the range of acceptable operating parameters such as motor operated valve friction factors? Are test results for the system consistent with the design assumptions?
|  | (2)Does the modification invalidate design input parameters provided to accident analyses vendors?
|  | (3)Have modified structures surrounding safety equipment, components, or structures been evaluated for seismic 2-over-1 considerations? Have modified equipment or components under the scope of 10 CFR 50.49 been thoroughly evaluated for environmental equipment qualification considerations such as temperature, radiation, and humidity?
|  | (d) Verify whether the selected modifications have introduced an unreviewed safety question.
|  | (e) For the selected system, review recent changes to maintenance procedures and operating procedures to confirm that the changes have not introduced new design parameters or changed current design parameters. Confirm that any such design changes have been subjected to the formal design change process (e.g. 50.59 review).
|  | Examples of potential inadvertent design changes follow:
|  | (1)changing maintenance/surveillance procedures to tighten the packing on the main steam non-return check valves such that they are no longer free-swinging gravity-closing valves;
|  | (2)changing emergency operating procedures to require that operators immediately throttle auxiliary feedwater following a reactor trip to prevent pump runout/failure that could otherwise occur during a main steam line break.
|  | (f)Ensure that verification and validation of computer programs used for design and for monitoring of important safety features has been adequately accomplished.
|  | 3.Consistency between system design and operation.
|  | (a)training programs are consistent with the current design.
|  | (b)Verify that operator actions can be performed in the required time-frame to mitigate design basis events. Verify that any changes to operator actions resulting from system modification(s) have been subjected to a safety evaluation and are consistent with the UFSAR including the accident analyses.
|  | (1)Was reliance on the operator actions approved by the NRC?
|  | (2)Is there reasonable assurance that, under all anticipated circumstances (e.g. lighting, ambient temperature, radiation levels) operators can perform the actions within the times assumed in the accident analyses?
|  | 4.Evaluation of communications affecting design control.
|  | (a)Assess the ability to communicate accurate information on the status of system modifications. Plant policies on updating design related material such as the UFSAR may not support timely documentation of changes to the system. Verify that provisions are in place and being followed to assure the accurate recording of the as-designed and as-built conditions during the interim period between modification implementation and incorporation into the plant design basis documents.
|  | (b)Verify that operations involves engineering in determining the operability of degraded safety systems and components (SSC's).
|  | (c)Verify that operations, engineering, maintenance, and affected plant support groups are involved in the evaluation and concurrence process for approving:
|  | (1)performance of non-routine maintenance activities
|  | (2)temporary modifications
|  | (3)field change requests
|  | (d)Review the licensee's control of vendor supplied services and products including the evaluation for technical adequacy and quality assurance. The licensee's evaluation and control of vendor supplied services and products should be multi-disciplinary in its approach, including operations, engineering, maintenance, and the affected plant support groups.
|  | (e)Verify that self-revealing deficiencies and those identified by the licensee's vendor control process are properly communicated to the vendor.
| c. | Key Attribute - Human Performance
|  | Using data from the corrective action program, LERs, and licensee assessments, determine if human performance issues have contributed to performance issues. Evaluate the overall effectiveness of human performance corrective actions. Review the following attributes of human performance, as related to the previously identified human performance issues.
|  | (a)Organizational Practices - perform only those steps related to previous performance deficiencies.
|  | (1)For operations, assess whether: (aa)The turnover environment is adequate for clear communication; whether on-coming operators are walking down panels with current operators or independently; and whether the turnover process is proceduralized and procedures are being followed; (bb)the operators exhibit attentiveness and are pro-active in assessing plant conditions that may indicate a safety concern; (cc)necessary plant status information is identified, and equipment/ operational problems are discussed in enough detail for the oncoming shift to understand. After turnovers, verify that the operators have sufficient knowledge of the plant conditions and activities in progress. Inspectors should try to observe at least two different shifts, including a back-shift.
|  | (2)For on-line maintenance work windows, complex surveillance and tests, verify that the activities are coordinated with the control room, the shift supervision is maintaining effective control of plant operations, and the control room is implementing the compensatory measures required by the risk/safety evaluation. Observe pre-evolution briefings and communication between operations and other disciplines to verify that effect on safety and risk is being considered.
|  | (3)Review a number of scheduled and non-scheduled maintenance activities. Question the control room operators to determine their awareness of ongoing activities that could affect plant operations, and the priorities in resolving plant issues and equipment problems. The intent here is for the inspector to verify that control room personnel are appropriately aware of ongoing activities, such as maintenance, surveillance and testing, plant equipment taken out of service, and their impact on plant operation; and are implementing the necessary actions.
|  | (4)Perform a tour of the plant and note indications of operator work-arounds or conditions that might require work-arounds including: (aa)unapproved job aids or marking; (bb)inadequate equipment labeling; (cc)inadequate maintenance, surveillance, or operating procedures; (dd)equipment that is not performing as designed; (ee)the potential for adverse environmental condition(s), e.g., insulation removed from high energy lines, doors left open that are required for area isolation during a high energy line break in an adjacent area, and open doors that may render blowout panels and back-draft dampers inoperable.
|  | (5)Observe operators perform evolutions, tests, and response to annunciators, if possible. (aa)Verify that TS and/or procedure prerequisites were satisfied prior to execution of the procedure. (bb)Determine if operator actions or compensatory measures were required due to degraded equipment or plant conditions resulting in an operator work-around. (cc)Evaluate whether the evolution was performed in accordance with approved directives and night orders if applicable. Directives and night orders are often issued by plant management, and disciplines like chemistry, reactor engineering, and systems engineering.
|  | (6)If applicable, review the control room disabled annunciator logs. For selected safety-significant annunciators, question the operators as to why annunciators are in alarm conditions, what operator response was required by the procedure(s) and if taken, if continuously lit annunciator windows prevent annunciation of new alarm conditions, and why and how annunciators are removed from service. For control room and local annunciators that cause operator distractions, determine if a controlled process for their removal is in place that includes an assessment of operational impact, compensatory actions, authorization, and corrective actions for restoration. Also, review the alarm summary printout to determine if any significant alarms occurred that were not documented in the control room logs, and whether the operators were aware of and had taken appropriate action. Review of the alarm summary printout may lead to important operator performance indication during and after a transient.
|  | (7)Review the licensee's administrative procedure for shift supervisor's conduct and duties. Verify that shift command and control is maintained.
|  | (8)Observe routine activities of non-licensed personnel. Determine whether these individuals are knowledgeable about the current status of SSCs and equipment performance and understand the impact of ongoing work activities. Verify that procedural requirements are being met and that the procedure is implemented using the correct level of use (i.e. continuous, reference, etc...) Determine how the individuals identify and communicate deficiencies to control room or supervision, and whether deficiencies are resolved using the corrective action program rather than implementing their own work-arounds.
|  | (b)Training and Qualifications
|  | For identified areas of human performance problems, verify that training and personnel qualification is adequate and appropriate for the level of work being performed.
|  | (1)If possible, observe classroom training and work in progress using the checklists of NUREG-1220, Training Review Criteria and Procedures, Rev .1.
|  | (2)Using the guidance in Inspection Procedure 41500, perform a limited review of training problem areas. If necessary, interview trainees, supervisors, and instructors using the IP 41500 guidance.
|  | (c)Communications - perform only those steps related to previous performance deficiencies.
|  | (1)The inspector should assess the quality of communications by observing that: (aa)Communications are consistent with licensee procedures during the conduct of operations, maintenance and testing activities; (bb)Instructions or information disseminated using the plant's phone and paging systems are clearly and concisely communicated; (cc)Personnel inform the appropriate level of management for any abnormal conditions or significant changes in plant equipment and systems.
|  | (2)The inspector should review a sample of written logs and shift status reports or updates to verify that they: (aa)provide sufficient detail to allow a full understanding of operationally significant matters, including abnormal occurrences or test results and any compensatory measures taken; (bb)describe changes in plant or equipment status.
|  | (3)An evaluation should be performed to assess whether communications between departments and licensee management provide information needed for continued safe plant operation. Included should be: (aa)an evaluation of the responsiveness and timeliness to requests for assistance and problem resolution; (bb)an evaluation as to whether other departments are aware of the extent and significance of deficiencies that cross-cut organizational boundaries.
|  | (d)Control of Overtime and Fatigue In instances where previous performance issues were related to the use of excess overtime perform the following reviews.
|  | (1)Review the licensee's process for controlling overtime.
|  | (2)Interview personnel identified as having worked overtime to determine how management ensures that personnel are not assigned to safety related duties while in a fatigued condition.
|  | (3)Interview personnel involved in working hours in excess of those listed in the plant's technical specifications (with or without approval) to evaluate indications of recurrent/routine use of overtime.
|  | (e)Human-System Interfaces including work area design and environmental conditions
|  | (1)Using the guidance contained in Inspection Procedure XXXXX perform a review of identified problem areas.
|  | (2)As necessary, if specific problem areas are identified the inspector should: (aa)walk down several control panels to evaluate the size, shape, location, function or content of displays, controls, and alarms; (bb)evaluate panels and equipment for correct labeling; (cc)evaluate work areas for accessibility of equipment, equipment layout, emergency equipment location, including location of remote panels; (dd)evaluate the impact of environmental conditions on human performance.
|  | 3. The guidance for observed Performance-Drills found in inspection Procedure 82001 Attachments 01 & 02 may be used to construct drill scenarios and evaluate performance.
|  | (a)Evaluate Performance-Drills with a sample of off-duty shift crews, including the Shift Supervisor and appropriate support personnel. During the drill evaluate capability to (1) classify hypothetical conditions notify local authorities (3) perform dose calculations (4) recommend appropriate protective actions. This scope allows the assessment of licensee performance in all the RSPS. The inspection report should document licensee capability accordingly. The distinction between low significance mis-steps and the capability to implement the Plan to protect public health and safety should be clearly delineated.
|  | (b)A small sample of significant changes to the licensee's emergency operating, abnormal operating, emergency response procedures and equipment can be examined and discussed with personnel to determine whether they are aware of the changes, understand them and have received training appropriate for their use.
|  | (c)It should be noted that there is no intent to inspect the licensee's ability to critique the performance-drills. The inspection is performed to verify the licensee's ability to implement the Emergency Plan, not verify the ability to critique drills as is done under the baseline inspection procedure. As such, poor performance should be documented as observations under "scope" in the EP section of the inspection report. Corrective action program identification numbers may be included in the report to facilitate verification of correction during future inspections.
| d. | Key Attribute - Procedure Quality
|  | Evaluate to what extent procedure quality has contributed to previously identified performance issues. In performing this evaluation, select a sample of procedures which reflect instances where problems with procedures have been documented in LERs, NRC inspection reports, or licensee assessments or audits. Focus on the technical adequacy of the procedures using the following guidance as applicable. Development and review of procedures.
|  | (a)When reviewing procedures, the inspector should assess the technical adequacy of the procedures and determine if the procedural steps will achieve required system performance for normal, abnormal, remote shutdown, and emergency conditions. The inspectors should determine if the system is operated in accordance with the system design.
|  | (b)Determine whether the procedures will accomplish the activity within the design characteristics and regulatory requirements. During this evaluation, the review may include technical specifications, limiting condition for operation, UFSAR descriptions, vendor manuals, design information, piping and instrumentation drawings (P&IDs), and instrumentation and electrical wiring and control diagrams.
|  | (c)Review maintenance procedures for technical adequacy. Determine if the procedures are sufficient to perform the maintenance task and provide for identification and evaluation of equipment and work deficiencies. Verify the use of quality verification holdpoints for independent verification of important attributes. Check the procedure content against the vendor manuals to verify that the procedure satisfies the vendor requirements for maintaining the equipment in proper working order. Verify that important vendor manuals are complete and up-to-date. Documents, such as vendor manuals, equipment operating and maintenance instructions, or approved drawings with acceptance criteria, may by reference be part of a procedure. If these documents are so used, the documents (or applicable portions) require the same level of review and approval as the procedure that references it.
|  | (d)If the technical adequacy of procedures is a concern review the following.
|  | (1)Review a sufficient number of procedures to provide assurance that the procedures (including checklists, and related forms) in the plant working files are current. the modification.
|  | (2)Verify that personnel have the ability to reference an up-to-date and accurate copy of documents. This is necessary because the controlled drawings may not be revised, unless changes due to modifications are extensive. As an interim measure, some utilities have marked-up a controlled set of the control room documents to show the design changes. In such situations, the inspector should also verify that revisions of the controlled documents incorporating the marked-up changes are performed in a timely manner following
|  | (3)Procedure changes should be in accordance with licensee processes and regulatory requirements. Verify the adequacy of all procedure changes which resulted from recent (within the last year) license change(s) or revision(s) to a technical specification.
|  | (4)Verify procedure changes are in conformance to 10 CFR Part 50.59. This item applies only to changes to procedures which are described or summarized in the UFSAR, normally a small portion of the procedures in use at the facility. General guidance and contrasting examples relating to the procedure changes which can be made by the licensee are described in NRC Inspection Manual Part 9900, "Guidance on 10 CFR 50.59 -- Changes to Facilities, Procedures, and Tests (or Experiments)."
|  | (5)Through discussions with personnel and a review of approved procedures, determine if skilled craft, engineering, and technical support personnel contribute to the development, review, and approval of procedures. Are special or complex procedures "dry run" and discussed prior to use?
|  | (6)Incorporating accepted human factors principles about format and writing style into procedures increases the likelihood that the procedures will be easier to use and follow. Standards for format and writing style can usually be found in the licensee's writer's guide. Usability should be determined by evaluating the degree to which procedures follow the guidance outlined in the writer's guide.
|  | (7)When a writer's guide is not available or if the writer's guide is in question, procedure usability can be determined by evaluating the elements of writing style, format, and organization described in Inspection Procedure 42700, "Plant Procedures."
|  | (e)Verify temporary procedures were properly approved and did not conflict with technical specifications requirements. Review a sample of temporary procedures and temporary procedure changes issued during the past year to determine that the approval and subsequent review requirements of the technical specifications are being followed. Determine whether the licensee has procedural limitations on how long a temporary procedure or a temporary procedure change can be in effect, and compare this with observed practices. Verify that unapproved "procedures" are not instituted by night orders, work orders, etc.
|  | (f)Review the method by which the licensee incorporates temporary changes to emergency or significant event procedures. The method used should not be so complicated as to preclude proper and timely operator action during abnormal plant conditions. The NRC position concerning control of procedural adherence is described in NRC Inspection Manual Part 9900, "Technical Guidance, Operations -- Procedural Adherence."
|  | (g)NRC Inspection Procedure (IP) 42001, "Emergency Operating Procedures," and the NUREGs referenced in it provide additional guidance for reviewing, developing, implementing, changing and maintaining emergency operating procedures. The team leader should consider adding an emergency preparedness specialist inspector to the team if a detailed review of emergency plan implementing procedures is to be conducted.
|  | (h)Inspection Procedure 82001.05 contains guidance for the inspection of emergency plan implementing procedures.
| e. | Key Attribute - Equipment Performance
|  | Corrective actions (a)Based on implementation of the maintenance rule, 10 CFR 50.65 "Requirements for Monitoring the Effectiveness of Maintenance at Nuclear Power Plants", the inspectors should evaluate the maintenance area by concentrating on performance examples that have shown to be a product of poor maintenance programs. Performance issues should be identified by the inspectors during the review of non-conformance reports, machinery history results, plant tours, observation of maintenance work activities, LER reviews, and NRC and licensee's assessments. Risk significant SSCs identified with poor performance should receive the highest priority. After identifying the performance issue, the inspectors should attempt to determine its cause and use this performance example as a means to establish issues in any of the maintenance related programs. The inspectors should also see if the licensee appropriately implemented the maintenance rule in correcting the performance issue and whether the licensee is maintaining an appropriate balance between SSC availability and reliability. (b)Examples of maintenance program issues include a relatively large maintenance work request backlog, related maintenance work not being accomplished in accordance with written administrative and procedural controls, and not identifying procedures for needed changes. Programs and processes for testing(a)Determine that effective methods have been implemented for review and evaluation of surveillance test/calibration data, including procedures for reporting deficiencies, failures, malfunctions, etc., identified during the tests/calibrations or inspections with required verification of operability.
|  | (b)Review a sample of post-maintenance tests to ensure that the tests are adequate to ensure that the equipment has been returned to an operable configuration. (c)Verify that the surveillance test procedure acceptance criteria are adequate to demonstrate continued operability. (d)Verify that the licensee is effectively calibrating instruments that are important to safety. The Technical Specifications do not specify calibration requirements for some of these instruments, for example: boric acid tank temperature; discharge pressures for various engineered safety feature pumps; safety injection accumulator level and nitrogen cover gas pressure; cooling water flow to containment coolers; main steam isolation valve limit switches used to verify valve closure time and provide input to reactor protection system.
|  | 3. Operational performance of systems and components. Observe any maintenance or testing performed on the selected system while the inspection team is onsite.
|  | (a)Walk through the system operating procedures and the system P&IDs. If any special equipment is required to perform these procedures, determine if the equipment is available and in good working order. Verify that the knowledge level of operators is adequate concerning equipment location and operation.
|  | (b)Conduct interviews with licensee personnel to determine how the system is operated. Determine if system operation is consistent with the intended safety function.
|  | (c)Determine if the environmental conditions assumed under accident conditions are adequate for remote operation of equipment, such as expected room temperature, emergency lighting, steam, radiation levels, etc.
|  | (d)Review the maintenance program for the selected system to determine if the preventive maintenance (PM) requirements are adequate and comprehensive.
|  | (e)Review applicable design documents, vendor manuals, generic communications (i.e., Bulletins, Information Notices, Generic Letters, and special studies) and verify that the licensee has integrated and implemented the applicable items into the maintenance program.
|  | (f)Conduct interviews with personnel to determine what maintenance and modifications have been performed. Determine if the maintenance and modifications are consistent with the licensing basis.
|  | (g)Determine if engineering input into maintenance activities is at an appropriate level to ensure safe and reliable plant operations.
|  | (h)Verify that methods and responsibilities have been designated for performing functional testing of structures, systems, or components following maintenance work and/or prior to their being returned to service.
|  | 4. Inspection Procedure 82001 Attachment 4 contains guidance for the inspection of EP related equipment and facilities that may be useful.
| f. | Key Attribute - Configuration Control
|  | Select a sample of the corrective action process/PIM issues related to configuration control and review the adequacy of the corrective actions implemented. Review all operability determinations that have been completed on the selected system. System Walkdown
|  | (a)For the selected system, obtain current drawings and review the associated operating procedures and UFSAR sections. Review the licensee's system lineup procedure, system design basis documents, and determine whether the documents are consistent with the as-built configuration.
|  | Compare system line-up procedures with drawings to ensure that they are consistent (e.g., valve positions, installation of blank flanges and caps).
|  | (b)Review jumper, lifted lead, and other temporary modification logs. Determine (1) if an adequate technical review was performed before the plant modification was performed to ensure the absence of unreviewed safety questions, and (2) if plant drawings were updated, as needed, to reflect the change. The licensee's controls for limiting the duration of temporary modifications should be reviewed. Assess the role of the plant, system, and design engineering groups in the temporary modification process.
|  | (c)Determine if accessible valves in the system flow path are in the correct positions by either visual observation of the valve; by flow indication; or by stem, local or remote position indication and that they are locked or sealed, if appropriate.
|  | (d)Verify that valves do not exhibit excessive packing or boron leakage, missing hand-wheels or bent stems. Ensure that local and remote position indications are functional and indicate the same values. Remote manual operating devices should be functional.
|  | (e)Verify that pump seals do not show signs of excessive leakage.
|  | (f)Verify that cooling water is aligned to bearings and seals and that oil bubblers and bearings do not show signs of excessive leakage.
|  | (g)Verify that power is available and correctly aligned, functional, and available for components that must activate on receipt of an initiation signal.
|  | (h)Verify that major and support system components are correctly labeled, lubricated, cooled, and ventilated to ensure fulfillment of their functional requirements.
|  | (i)Review system mechanical joints (packing, flanges, body to bonnet joint) leakage requirements and verify that known leakage is properly addressed and that observed leaks are accounted for.
|  | (j)Determine if selected instrumentation, essential to system actuation, isolation, and performance, is correctly installed and functioning, correctly calibrated, and displaying indication consistent with expected values. Instrument elevations are consistent with design documents.
|  | (k)Identify whether actual or potential adverse environmental condition(s) exist, and the adequacy of any compensatory measures.
|  | (l)Identify whether components inspected for the system are consistent with the UFSAR description. Determine whether a 10 CFR 50.59 safety evaluation was performed for any items that differ from the UFSAR description.
|  | (m)Identify additional equipment conditions and items that might degrade plant performance by verifying whether:
|  | (1)Freeze protection, such as insulation, heaters, heat tracing, temperature monitoring, and other equipment, is installed and operational.
|  | (2)Hangers and supports are in their proper positions, aligned correctly, and intact.
|  | (3)No unauthorized ignition sources or flammable materials are present in the vicinity of the system being inspected.
|  | (4)Cleanliness is being maintained.
|  | (5)Temporary storage of material and equipment is in accordance with the licensee's seismic control procedures and does not interfere with equipment operations or operator actions.
|  | 3. Maintenance Work Control
|  | (a)Determine the nature and extent of the licensee's backlog of corrective and preventive maintenance, especially concerning equipment of high safety significance. Assess the licensee's efforts to integrate preventive and corrective maintenance to minimize equipment unavailability.
|  | (b)Assess the licensee's process for planning work, including the assessment of risk and the inclusion of new emergent work into the schedule. Review the licensee's policies with respect to schedule generation and the use of risk insight. Select several work packages on safety related equipment and determine how risk was factored into their scheduling. Assess whether the licensee evaluates possible interactions between components in service and those to be tested.
|  | (1)What risk assessment tools are provided to the operators?
|  | (2)What risk training has been given to the planning staff?
|  | (3)Who has the absolute say in allowing work to progress?
|  | (4)How is emergent work factored into previous risk evaluations?
|  | (c)For the selected systems review the operating performance history and compare it with the assumed out-of-service times in the IPE. Ensure that the assumptions are conservative with respect to actual equipment performance.
|  | (d)If warranted as a result of past performance deficiencies, select one or more safety system tag-outs for inspection. Determine if the tagout is adequate for the work to be accomplished. Verify in the plant that operators are thorough in tagging and isolation of plant equipment. Verify by observation that tags are properly hung and equipment has been placed in the designated position. Determine if equipment status changes and corresponding entry into or exit from technical specification action statements are appropriately documented.
|  | (e)If warranted as a result of past performance deficiencies, determine if the licensee has adequate controls to ensure the independent verification of equipment status, particularly when equipment is returned to service.
|  | (f)Verify that maintenance activities are coordinated with control room operations and that appropriate briefings and turnovers are held with control room operators.
|  | (g)Equipment that is environmentally qualified should be identified as such prior to maintenance and sufficient controls should exist to ensure it is returned to that status upon reassembly.
|  | (h)The inspectors should review the following: long-term (typically greater than six months) tagouts (caution and danger tags), disabled control room annunciators and instruments, control room deficiencies, operator work arounds and other equipment deficiency tracking systems to assess the significance of these conditions.
|  | (i)If warranted as a result of past performance deficiencies, review the licensee's process for using rapid response maintenance teams.
|  | (j)Verify that work control procedures have been established to require special authorization for activities involving welding, open flame, or other ignition sources and take cognizance of nearby flammable material, cable trays, or critical process equipment. Ensure that work control procedures have been established to require a firewatch, with capability for communication with the control room, if an activity identified above is to be performed in the proximity of flammable material, cable trays, or vital process equipment. Procedures should address scaffold controls around safety, critical or operating equipment.
|  | 4.Chemistry Controls - limit reviews to primary and secondary chemistry which could degrade the RCS pressure boundary.
|  | (a)Review records of completed chemical analyses to determine if required analyses have been performed.
|  | (b)Review trends of recorded water quality data.
|  | (c)Assess corrective actions taken when chemical variables have exceeded the established levels or limits, including consideration of the timeliness of these actions.
|  | (d)Assess the effectiveness of measures taken to prevent the introduction of chemical contaminants into primary and secondary coolant water and to detect the presence of these contaminants.
|  | (e)Review licensee evaluations of parameter trends associated with steam generator leakage.
|  | 5.Fission Product Barrier Assessment
|  | (a)Observe a selected portion of the containment isolation lineup and independently verify whether valves, dampers and airlock doors are being properly controlled in accordance with the Technical Specifications.
|  | Select several components and independently verify that they are in their required positions. Where possible, confirm valve position indication by direct observation of valve mechanism. For valves that isolate on a containment isolation signal verify proper breaker position and availability of power supply. Also, for motor and air-operated valves, verify they are not mechanically blocked and power is available, unless it is required to be otherwise. Inspect piping and the associated test, vent and drain valves, if any, for possible leakage paths.
|  | (b)Assess the licensee's method of calculating the RCS leakrate.
|  | (c)Containment temperature and pressure monitoring - review the licensee's procedures for ensuring that the containment atmosphere and/or water space meets the design basis assumptions for average temperature and pressure.
|  | 6.No specific guidance provided.
| g. | Key Attribute - Emergency Response Organization Readiness
|  | The guidance of Inspection Procedure 71114.03 is applicable and may be useful.
03.04 | Assessment of Performance in the Radiation Safety Strategic Performance Area
| a. | Inspection Preparation
|  | No specific guidance provided. Look particularly for those audits and self-assessments that probe for programmatic weaknesses and assess the quality of the program. Look for trends indicative of programmatic weaknesses. Requirements for reviews and audits normally are contained in the technical specifications. Audit teams should include someone with experience or training commensurate with the scope, complexity, or special nature of the activities audited. No specific guidance provided. No specific guidance provided.
| b. | Key Attribute - Program/Processes
|  | Each position within the RP organization should have its own position description with authorities and responsibilities clearly defined. For example, each health physics technician (HPT) should know what authority should be exercised to ensure the RP program can be effectively implemented (e.g., enforce the stoppage of work, adherence to procedures). The HPT and the crafts workers should all understand these responsibilities and authorities. The inspector should be sensitive to the designated radiation protection manager's position in the facilities reporting chain and level in the organization and how this affects the RPM's direct recourse to onsite station manager on problems with the conduct of the radiation protection program. The impact of any organizational change in the RPM position relative to its level should be examined and discussed with appropriate level of management. Plant staffing levels have been reduced during the 1990's, so determine if adequate HPT coverage is being provided during outages and normal backshift operations. Determine the extent of first-line supervision (foremen) presence in the field -- past lack of foremen having direct involvement at the onset of infrequent work activities in high radiation areas has contributed to serious mishaps and over exposures. Evaluate to what extent procedure quality has contributed to previously identified performance issues. Select a sample of procedures where problems with procedures has been documented in LERs, NRC inspection reports, or licensee assessments or audits. Focus on the technical adequacy and completeness of the procedures using the following guidance as applicable.
|  | (a)When reviewing the procedures, the inspector should determine if the procedural steps will achieve the required goal. The inspector should determine if the procedure is understood and used by the HPTs. (b)Verify that the licensee has a workable system to ensure that the plant working files contain current procedures (including checklists and related forms). (c)Procedure changes should be in accordance with licensee processes and regulatory requirements. Verify the adequacy of all changes (within the last year) in a selected area of concern (e.g., RWP issuance). (d)Through discussions with personnel, determine if HPT and first line supervision contribute to the development, review and approval of procedures. (e)Verify temporary procedures were properly approved and did not conflict with requirements, by review of a sample of recent temporary procedures and revisions to them.(f)NRC Inspection Manual 9900 provides the NRC position on control of procedural adherence.
|  | 3. Effective radiation work practices include considerations of high and very high radiation areas and awareness of potential hazards (e.g., in diving operations, removing neutron-activated items from the reactor, and other non-routine and infrequent operations). See Regulatory Guide 8.38, " Control of Access to High and Very High Radiation Areas in Nuclear Power Plants" for further guidance on these problem areas. Based on current licensee work planning, select at least three jobs being performed in radiologically challenging areas. Whenever possible, select jobs in locked high radiation areas (with >1 rem planned job collective person-rem). Additionally, focus on work in Airborne radioactivity areas, with a special emphasis on areas were transuranic radionuclides may be present.
|  | (a)Review all pertinent job requirements (RWP, work control procedures, etc.), attend job briefing, and observe infield work and judge compliance to above requirements.
|  | (b)Determine if the job conditions were adequately communicated to the worker, by pre-work briefing and work site postings.
|  | (c)Verify accuracy of required surveys, HPT job coverage is consistent with RWP requirements. Verify that worker dose monitoring is consistent with licensee and regulatory requirements. This should include the need for extremity and multi-badging for DDE. Improper uses of digital alarming dosimeters have resulted from (1) lack of training in their proper use, (2) use in high noise areas or under protective clothing, which made the alarm inaudible, and (3) poor (or no) procedures for their use.
|  | (d)Attend any post-job debriefing to capture any lessons learned discussion. Determine how (if) licensee incorporates applicable lessons learned into procedures, RWP process, etc.
|  | (e)Review the diving procedure and determine if it meets of intent of Regulatory Guide 8.38, Appendices A and B. See Information Notice 97-68, "Loss of Control of Diver in a Spent Fuel Pool" for further guidance.
|  | (f)Transuranics can be a potential airborne problem at plants with previous fuel performance problems (fuel leakers). See Information Notice 97-36, "Unplanned Intakes By Worker of Transuranic Airborne Radioactive Materials and External Exposure Due to Inadequate Control of Work". Note that while a plant (with a history of fuel leakers) may not have seen significant evidence of transuranics for years (on loose-contamination smears or routine air samples), alpha contamination may be incorporated into a corrosion layer on the interior surfaces of system components that carry primary system fluids. When these interior surfaces have be perturbed (by mechanical actions like scabbling), high levels of transuranic airborne activities have resulted in significant, unplanned worker intakes.
|  | (g)Review each planned special exposure to determine whether it meets the requirements of 10 CFR 20.1206. See Regulatory Guide 8.35, "Planned Special Exposures."
|  | (h)Review a selected sample of the records of exposures of declared pregnant women to determine whether, in each case, the dose to the embryo/fetus meets of the requirements of 10 CFR 20.1208. See Regulatory Guide 8.36, "Radiation Dose to the Embryo Fetus."
|  | 4.Review the extent to which the licensee has implemented or assessed methods offering significant potential for reducing occupational radiation exposure by reducing out-of-core radiation sources/fields. The following techniques are reported to be available for reducing exposure [See the Electric Power Research Institute (EPRI) report TR-107991, "Radiation Field Control Manual - 1997 Revision," October 1997.]
|  | (a)PWRs: Methods available now that can provide an immediate impact are (a) chemical decontamination together with a modified pH primary chemistry control program (2.2 ppm Li, pH 7.2- 7.4) and use of Zircalloy fuel grids, and (b) valve maintenance procedures to remove Co debris. Methods available now that will have a slower impact are (a) Zircalloy fuel grids without decontamination, (b) electropolishing of replacement steam generators, (c) cobalt replacement guidelines and NOREM valves, (d) use of low-cobalt Inconel 690 tubing for replacement steam generators.
|  | (b)BWRs: Methods available now that can provide an immediate impact are (a) chemical decontamination together with (1) replacement of control blade pins and rollers and (2) zinc injection, (b) installation of cobalt-free feedwater control valves, and (c) valve maintenance procedures to remove Co debris. [Note: The use of natural zinc injection has resulted in problems at some BWRs. The zinc-65 produced by neutron activation of zinc has caused higher radiation fields, higher volumes of radioactive waste, and in at least one case, surface contamination problems. As of October 1997, these problems are minimized by the use of depleted zinc. The industry is currently developing the most cost effective approach to zinc injection. Methods available now that will have a slower impact are (a) pins and rollers replacements and zinc injection without decontamination, (b) electropolishing/pre-conditioning replacement components, and (c) cobalt replacement guidelines. Methods showing promise are (a) replacement of in situ pins and rollers, and (b) NOREM cobalt-free hardfacings for valves.
|  | The techniques above involve cobalt source reduction, preconditioning of out-of-core surfaces, control of crud transport (water chemistry control), and chemical decontamination.
|  | Licensees should not be expected to implement a method for reducing out-of-core radiation sources/fields until the method has been fully tested and proven by a full-scale field demonstration in one or more nuclear power plants. The term "fully tested and proven" means that the technique has been fully scoped and reliable generic technical basis documentation is available for the licensees to evaluate the potential for their particular plant application.
|  | 5.The licensee should have an appropriate basis for establishing dose goals and objectives. Goals should be frequently monitored and actions taken as necessary when goals are exceeded. Goals should be set for the facility as a whole, for different divisions or groups within the facility, and for specific work activities.
|  | Review work tasks to verify that pre- and post-job ALARA reviews were conducted. Determine whether the pre-job reviews adequately addressed the work to be performed, and whether lessons learned from post-job reviews are factored into future work/training. Ensure that the radiological significance of work performed under the direction of licensee vendors/contractors is adequately reviewed before the work is started. Review the method used to perform ALARA reviews of on-going work activities. These reviews should identify anomalies in the expected rate at which personnel exposure is being accumulated.
|  | Compare, as a minimum, the licensee's total annual collective dose (person-rem) against their goals. Determine whether the licensee's collective doses are increasing or decreasing. Discuss with the licensee reasons for any trends and actions they are taking or have taken that impacted the trend. Determine whether the licensee is effective in identifying causes of higher than necessary doses and in effecting corrective actions. Determine whether the licensee reviews dose experience for specific jobs against available industry norms for similar jobs.
|  | For plants planning their first outage, or for experienced plants performing significant tasks (e.g., 10-year in-service inspection) for the first time, determine the extent to which the outage experience of other similar plants is being used in the planning process. For plants that have experienced outages, determine the extent to which experience from, and lessons learned during, previous outages are being incorporated to improve performance. Approval of needed visits by radiation protection personnel to other sites to observe outage activities is a good indication of proper management support for ALARA.
|  | 6.Review the licensee's organizational structure for ALARA responsibilities. There should be a clear delineation of authority and responsibility, including dedicated ALARA staff adequate to implement the program on a daily basis as well as during outages. ALARA training that extends beyond the scope of General Employee Training for personnel such as radiation workers, is desirable for radiation protection technicians, and special maintenance teams. Professional development training should be available for the ALARA coordinator and related staff. To be most effective, mockup training should be reasonably realistic (e.g., including realistic temperature, humidity, and lighting) and address ALARA considerations.
|  | Discuss the ALARA program with several workers to determine whether they understand the program, understand their role in the program, and are actively involved in the program.
| c. | Key Attribute - Plant Facilities/Equipment & Instrumentation
|  | Select a variety of equipment and on-going maintenance to observe full calibration of beta/gamma survey instruments, as well as the daily source/response checks (or prior to use functional checks) for these instruments. Verify that the HPT or maintenance technician is familiar with the procedure governing the selected activity. Determine that the HPT is following the procedure, and discuss any deviations (and the reasons) from the procedure. Be aware of the facilities "art of the craft" position -- a level of skill and proficiency that is assumed (by the level of qualification). This position has a impact on the level of detail of the procedures, and allows the HPT, etc. to perform certain tasks or actions without a procedure. Ensure that the facility has a adequate supply of materials necessary to support current operations and emergent work/special outages. This includes anti-c's, respiratory protection, temporary shielding, temporary portable ventilation equipment, personal cooling devices (heat stress) and other needed equipment. Determine if the facility has adequate areas for personal and equipment decontamination, equipment maintenance and calibration (including spare parts). Discuss the budgetary process with the RPM and first line supervisors and examine and determine reasons for budget item disapprovals for selected (rejected items). Focus on those budget items that had been approved by the RPM, but not supported by upper management. Determine reasons for budget denials for major proposed items, and judge the impact on any identified program deficiencies. Identify plant areas that have become unusable as a result of an operational occurrence and licensee actions to control and recover such areas. (See SECY-89-326 dated 10/20/89 located at microfiche address 70038-056.)
| d. | Key Attribute - Human Performance
|  | Evaluate the effectiveness of the corrective actions for radiation protection deficiencies. Review the licensee's corrective action commitments and determine whether identified problems were reviewed by the appropriate management and supervision, and prioritized commensurate with their safety significance. By review of documentation, discussion with appropriate staff and direct observation, determine whether the problems identified were prioritized commensurate with their safety significance, and whether the corrective actions were technically correct, sufficiently broad in scope and performed in a timely manner. Experience, qualification, and training of radiation protection staff.
|  | (a)Select individuals on the radiation protection staff and contractor personnel. By a review of applicable documentation, direct observation and discussion with the technicians, determine if they meet the training and qualification requirements of their assigned duties/position. Licensee administration technical specifications normally contain a specific commitment to an industry standard on personnel selection, training and qualification.
|  | (b)For a selected sample of contractor health physics technicians (HPTs), review the actions taken by the licensee, in accordance with the training rule (10 CFR 50.120) to ensure that these individuals are task qualified to perform their assigned outage activities. The following general guidance exists concerning the10 CFR 50.120:
|  | (1)The only radiation protection personnel covered by the new rule are "radiological protection technicians" (HPTs) who are employees of the power plant. No supervisory, managerial or technical staff are covered. Contractor HPTs are not covered unless they occupy regular positions performing independently within the licensee's organization. If short-term contractor HPTs (e.g., outage workers) are assigned to work independently, they must be qualified to perform their assigned tasks.
|  | (2)The training rule covers qualification only in the sense of job task qualification, not qualification based on pre-selection criteria. Furthermore, successful completion of a training program required by the rule does not obviate the need to comply with other training or qualification requirements imposed by other regulations and/or license conditions.
|  | By direct observation and discussion with HPTs providing job coverage, determine if they have knowledge of the job activities and radiological conditions to provide adequate coverage. In discussions with HPTs, focus on ensuring adequate knowledge of radiological hazards associated with plant systems [especially neutron-activated components such as traversing incore probes (TIPs), incore neutron detectors, and cabling, as discussed in Information Notice No. 88-63 and its Supplements 1 and 2, "High Radiation Hazards from Irradiated Incore Detectors and Cables"]. Interviews using event scenarios and role-playing (preferably in small groups) may be useful for assessing HPT knowledge and capabilities.
|  | Review the licensee's method to provide training of permanent and contractor personnel on safety- significant changes in procedures and recent events. Emphasis should be on training provided to the increased work force required for the outage. Discuss with plant management and the RPM.
|  | 3.Review training records and lesson plans, for a sampling of station and contractor crafts workers, to determine if the requirements of 10 CFR Part 19.12 are satisfied. If possible, observe portions of the general employee training (focus on the "hands-on portions" of the training).
|  | 4.Interviews should focus on identified program deficiencies, root causes, and action plans for improving performance. Discuss how improvements will be implemented -- what programmatic changes are needed, how these will be accomplished, etc.
|  | 5.No specific guidance provided.
|  | 6.Department Practices - perform only those steps related to previous performance deficiencies.
|  | (a)Determine if shift turnover time is sufficient, and that appropriate plant/work status/conditions are discussed. Determine if the radiation protection log (or night-orders) is governed by training or procedure, and whether it is a reliable and consistent tool for the HPTs. At the end of an inspection shift, attend a radiation protection HPT shift turnover and identify any weaknesses or deficiencies in the communication exchange. Discuss these with the on-shift management.
|  | (b)Assess the quality of communications by:
|  | (1)Observing HPT interaction with crafts during development of RWP (on High Radiation area work, if possible). (2)Determine how and when HPTs inform the appropriate level of management on any abnormal condition or significant changes in work environments. (3)Evaluate the use of Engineering and Radiation Protection staff support during high risk (dose) work.
|  | (c)Control of overtime
|  | (1)Review licensee's overtime process and interview personnel having worked overtime to determine how management ensures these workers are not assigned to safety related duties while in a fatigued conditions (See HPPOS #'s 024,173, and 253).
|  | (2)Interview HPTs and other RP staff that worked hours greater than the plant's technical specifications (with or without approval) to evaluate any repetitive nature of this practice.
|  | (d)As necessary, if specific problems are identified in this area, the inspector should:
|  | (1)Evaluate work areas for accessibility, equipment layout, emergency equipment location, power supplies for infield sampling, etc.
|  | (2)Evaluate the impact (and means to compensate) for temperature extremes (heat stress), and other industrial hygiene hazards that might hamper radiation safety performance.
03.05 | Assessment of Performance in the Radiation Safety Strategic Performance Area - PUBLIC RADIATION SAFETY (Radiological Effluent Monitoring, Radioactive Material Control, and Transportation of Radioactive Material)
| a. | Key Attribute - Plant Facilities / Equipment and Instrumentation
|  | Perform an extensive tour of the facility which includes interviews with plant and contractor personnel to evaluate the adequacy of the plant facilities, equipment and instrumentation.
|  | No specific guidance provided. Evaluate the physical condition of the facilities, equipment and instrumentation. Determine if the facility is appropriate for its intended use and adverse conditions (i.e., radiation levels, temperature, lighting, industrial hygiene hazards, etc.) that may hamper the performance of the workers are minimized.
|  | (a)Verify that equipment and instrumentation are operable, calibrated, source checked, and maintained as specified in the licensee's procedures. Where appropriate, verify that the alarm/trip setpoints are correctly set to meet the requirements of the technical specifications or regulatory requirements.
|  | (b)Review the licensee's use of computers and software used to perform selected tasks. Review the licensee's technical evaluation to ensure the software is appropriate for its intended use. Verify that the computer software has been verified and validated.
|  | (c)Perform direct observation of the calibration of selected equipment and instruments. Verify that the proper materials, as specified in the procedure, are being used to perform the calibration. If radioactive sources are being used, are they properly transported, handled, used, controlled, and stored in accordance with approved plant procedures. Is the process in accordance with the plant's ALARA program?
|  | 3.Verify that there is an adequate supply of spare parts and materials needed to maintain the equipment and instruments.
| b. | Key Attribute - Program / Process
|  | For the assessment of procedures which implement the program being inspected, evaluate to what extent procedure quality has contributed to previously identified performance issues. In performing this evaluation, select a sample of procedures which reflect instances where problems with procedures have been documented in LERs, NRC inspection reports, or licensee assessments, audits or corrective action programs. The inspectors should focus on the technical adequacy of the procedures using the following guidance as applicable.
|  | No specific guidance provided. Review of procedures
|  | (a)When reviewing the licensee's procedures, the inspector should assess the technical adequacy of the procedures and determine if the procedural steps will achieve the required result.
|  | (b)Determine whether the procedures are consistent with the technical specifications, program documents, and regulatory requirements. During this evaluation, the review may include technical specifications, program documents, UFSAR descriptions, vendor manuals, design information, and instrumentation diagrams.
|  | (c)If applicable, review maintenance procedures associated with the instrumentation and equipment being inspected for technical adequacy. Determine if the procedures are adequate to perform the maintenance task and provide for identification and evaluation of instruments and equipment and work deficiencies. If applicable, verify the use of quality verification holdpoints for independent verification of important attributes. Check the procedure content against the vendor manual to verify that the procedure satisfies the vendor requirements. Verify that the vendor manuals are complete and up-to-date. Documents, such as vendor manuals, equipment operating and maintenance instructions, or approved drawings with acceptance criteria, may by reference be part of a procedure. If these documents are so used, the documents (or applicable portions) require the same level of review and approval as the procedure that references it.
|  | (d)Through discussions with personnel and a review of approved procedures, determine if radiation protection and technical support personnel contribute to the development, review, and approval of procedures. Determine if unique and/or complex high radiation work procedures are reviewed and approved by personnel responsible for work performance.
|  | (e)Incorporating accepted human factors principles on format and writing style into procedures increases the likelihood that the procedures will be easier to use and follow. Standards for format and writing style can usually be found in the licensee's writer's guide. Usability should be determined by evaluating the degree to which procedures follow the guidance outlined in the writer's guide.
|  | (f)When a writer's guide is not available or if the writer's guide is in question, procedure usability can be determined by evaluating the elements of writing style, format, and organization described in Inspection Procedure 42700, "Plant Procedures."
|  | (g)Verify temporary procedures were properly approved and did not conflict with technical specification requirements. Review a sample of temporary procedure changes issued during the past year to determine that the approval and subsequent review requirements of the technical specifications are being followed. Determine whether the licensee has procedural limitations on how long a temporary procedure or a temporary procedure change can be in effect, and compare this with observed practices.
|  | 3.If the technical adequacy of procedures is a concern, review the following.
|  | (a)Review a sufficient number of procedures to provide assurance that the procedures (including checklists, and related forms) in the plant working files are current.
|  | (b)Verify that personnel have the ability to reference an up-to-date and accurate copy of documents. This is necessary because the controlled drawings may not be revised, unless changes due to modifications are extensive. As an interim measure, some utilities have marked-up a controlled set of documents to show the design changes. In such situations, the inspector should also verify that revisions of the controlled documents incorporating the marked-up changes are performed in a timely manner following the modification.
|  | (c)Procedure changes should be in accordance with licensee processes and regulatory requirements. Verify the adequacy of all procedure changes which resulted from recent (within the last year) license change(s) or revision(s) to a technical specification or the top tier program document. Verify procedure changes are in conformance to 10 CFR Part 50.59. This item applies only to changes to procedures which are described or summarized in the UFSAR, normally a small portion of the procedures in use at the facility.
|  | General guidance and contrasting examples relating to the procedure changes which can be made by the licensee are described in NRC Inspection Manual Part 9900, "Guidance on 10 CFR 50.59 -- Changes to Facilities, Procedures, and Test (or Experiments)."
|  | 4.Review a selection of records produced from implementation of the procedures. Review the record file system to determine if the records are adequately filed and controlled in accordance with the procedure. Verify that the records are legible and have the appropriate sign-offs as required by the procedure.
| c. | Key Attribute - Human Performance
|  | Using data from the licensee's corrective action program, LERs, and audits, determine if human performance issues have contributed to performance issues. Evaluate the overall effectiveness of human performance corrective actions by reviewing the licensee's corrective action commitments. Determine if the problems were reviewed by the appropriate level of management and prioritized according to their safety significance. Evaluate whether the corrective actions were technically correct and implemented in a timely manner. The inspectors should review the following human performance areas: (a)Review the licensee's program to provide training and periodic retraining to plant and contractor personnel on assigned duties and on safety significant changes to programs and procedures. Determine whether this training includes lessons learned from recent industry events and NRC communications (i.e., Information Notices, Generic Letters, Administrative Letters, etc). By discussion with selected personnel, review of training lesson plans, and completed training records, determine if the requirements of 10 CFR Part 19.12 are met. If possible, observe portions of the general employee training (focus on the practical aspects of the training). (b)Are assignments and technical information from management being effectively being communicated to the workers? (c)No specific guidance.
|  | (d)Review the licensee's overtime program and process to determine how management ensures that workers are not assigned safety related duties while in a fatigued condition. Interview workers to determine if they worked hours greater than specified in the technical specifications (with or without approval) to evaluate any repetitive nature that can lead to a degradation of performance.
|  | (e)Is there a mechanism for workers to report deficiencies and suggest improvements? Is there feedback mechanism in which the evaluation of deficiencies and follow-up corrective actions are reported back to the workers?
|  | 3.No specific guidance.
|  | 4.Interview several plant and contractor personnel (i.e., technicians, engineers, health physicists, and supervisors) associated with the program to assess their level of knowledge about the program and procedures and to determine their qualifications for the assigned position and duties. This should be performed by a review of job documentation (usually specified in a licensee document), direct observation, and discussion with the individual.
03.06 | Assessment of Performance in the Safeguards Strategic Performance Area
| a. | Key Attribute - Access Authorization (AA)
|  | Using data from the licensee's corrective action system, and Inspection Procedures IP 71130.01, "Access Authorization Program" and 71152, "Identification and Resolution of Problems," verify that the licensee is identifying problems, entering those problems into their correction action system at an appropriate threshold, and effecting corrective action to prevent recurrence. Review current regulatory requirements on behavior observation and identify license procedures that were changed under 10 CFR Part 50.54(p). See IP 71130.01 for further guidance.
| b. | Key Attribute - Access Control
|  | Using IP 71130.02, "Access Control (Search of Personnel, Packages, and Vehicles: Identification and Authorization)," review any open LER, safeguards log and any self-assessments associated with access control for follow up, if necessary. Using IP 71130.02, perform 02.02 (b) through (j), or as warranted. Pay particular attention to (h) if the licensee has a process for granting access to plant equipment, including vital equipment to authorized personnel who have an identified need for such access. Verify that access authorization criteria established by the security plan and procedures is being adequately implemented. See IP 71130.02-02, Section 02.02(h) for further guidance.
| c. | Key Attribute - Response to Contingency Events (protection strategy, program design, and support elements)
|  | Using IP 71130.03, "Response to Contingency Events," review the recorded description of the current response strategy and response plans to evaluate the effectiveness of the protective measures contained in a sample of those written response plans.
|  | a. Inspectors may request that the licensee perform table-top drills to assess and understand how the written strategy is effective and ascertain if it is implemented as described. See IP 71130.03, for further inspection guidance. b. Conduct interviews and meet with the appropriate licensee managers to review the protective strategy and discuss any identified weakness in that strategy.
| d. | Key Attribute - Response to Contingency Events (performance-based force-on-force Exercises and Target Set Evaluation) Using IP 71130.05, Response to Contingency Events (Force on Force Exercises and Target Set Evaluation), the inspectors should request that the licensee explain their target set analysis and conduct force-on-force evaluated exercises. See IP 71130.05 for guidance.
| e. | Key Attribute - Security Plan Changes Over a 2-year period, review and assess changes to the security plan and associated security procedures which appear to affect the ability of the safeguards program to prevent core damage. Determine if any changes decrease the effectiveness of the security plan or program, and if so, if those changes were reported to the NRC for approval prior to making the change. See IP 71130.04 for further inspection guidance.
03.07 | Using the results from this inspection, in conjunction with information obtained from the NRC's review of previous root cause analyses that may have been performed by the licensee or others, attempt to group the apparent causes of the risk significant performance issues. The issues should be grouped using a structured technique such as that provided by MORT analysis. An attempt should be made to provide insight into the upper level causes of the performance issues, as applicable.
| Also the senior reactor analyst assigned to this team and other risk experts as appropriate should conduct a detailed assessment of the individual and collective risk associated with team's findings. This information will be useful in evaluating the adequacy of licensee proposed corrective actions to the performance issues, and to aid in deciding if additional regulatory actions are warranted.
03.08 | Perform a limited review of the NRC's assessment and inspection process at the subject facility.
| a. | Should the results of this inspection indicate that a significant reduction in safety has occurred, compare the team's findings with current assessment data (both PIs and inspection findings) to determine if sufficient warning was provided. If the results of this inspection indicate that a significant reduction in safety has not occurred, compare the team's findings with the current assessment data to identify inconsistencies in the plant performance data.
| b. | Evaluate whether the NRC assessment process appropriately characterized licensee performance based upon the data that was provided. For example, were inspection findings appropriately screened using the Significance Determination Process (SDP) for risk significance, and was this data appropriately entered into the NRC action matrix.

### 95003-04 Resource Estimate

The resource estimates provided are for direct inspection only, based on a three week on-site inspection. Not all areas will be performed during each inspection and the hours required to compete each area may be less for plants where previously identified performance issues were isolated.

Team Leader | 120
Licensee Control Systems | 240
Design | 360
Human Performance | 120
Procedures | 120
Equipment Performance | 120
Configuration Control | 240
EP without Attachment 95003.01 | 80
EP with Attachment 95003.01 | 160
Occupational Radiation Safety | 200
Public Radiation Safety | 60
Safeguards - TBD |
Review of Assessment Process | 40 (not direct inspection)

* If a remedial exercise is included in the scope of Attachment One, it will require an additional 40 hours for a total of 200.

END

Attachments:

1.Emergency Preparedness