Collaborate on Money Receipt Design for Quality Assurance with Ease Using airSlate SignNow

Money receipt design for Quality Assurance

foreign good afternoon good evening and welcome to the enrich quality assurance Tech talk this is the first in the three-part series on quality assurance my name is Stephanie Weir and I'm deciding a regulatory strategy manager for the national reactor Innovation Center for Enric and I'll be introducing our speakers and moderating this event before we begin I would first like to go over a couple of items so that you know how best to participate in today's Tech talk for the best experience we recommend turning off the VPN or Citrix connections please submit any questions you might have by typing questions into the section the question section of the control panel you can send those questions at any time during the presentation and we will address them at the end during a q a session if you have any technical problems please put them in the chat if you have programmatic questions about Enric please feel free to email us at nric.gov this event is being recorded and will be posted on the Enric website and your attendance is consent to that recording so just to provide a little bit of background the national reactor Innovation Center was established by the U.S department of energy after authorization of the nuclear energy Innovation capabilities act and we work to accelerate the demonstration and deployment of advanced nuclear energy through partnership with the private sector enrich enables developers to harness the world-class capabilities of Doe's National Laboratory system in order to bridge the gap between concept and commercialization our vision at Enric is to support the demonstration of at least two Advanced reactors by 2025. next slide please uh so our our vision is to see that this uh demonstration to support the demonstration of at least two Advanced reactors by 2025 and then to see commercial Advanced nuclear energy available by 2030 to contribute to Abundant clean energy we work to achieve that Vision through our mission next slide please our mission is to inspire stakeholders and the public to empower innovators to test and demonstrate their Technologies and to deliver successful outcomes Through official coordination of Partners and resources next slide please we partner with the private sector National Labs DUI programs industry groups agencies and other Regulators to decrease the risks associated with new technologies and deployment we work to provide access to capabilities facilities and tools essential to the demonstration of these new technologies next slide please Advanced reactor developers will need a firm understanding of quality assurance requirements and the role they play in the successful deployment of a new reactor design this first presentation will provide some of the basics of quality assurance particularly the fundamentals of U.S nuclear regulatory commission's quality assurance requirements the importance of quality assurance and of addressing it early and some of the ways that industry approaches QA our next tech talk in this series scheduled for early November will dive deeper we will look at similarities and differences between the U.S department of energy and the U.S nuclear Regulatory Commission requirements the process for engagement with QA professionals and National Laboratories budgeting for QA and much more the final Tech talk in this series coming in early December will look at quality assurance best practices and Lessons Learned From QA case studies we're really fortunate to have three experts in this field with us today our speakers today are U.S nrc's Paul Prescott any eyes Mark Richter and new pics Roger Mills in the interest of time and we have a lot of great material to cover we're going to put the biographies on our website and I'll drop a link to that in the chat so um hopefully we will have worked out some of our technical problems and I'd like to hand the floor over to nrc's Paul Prescott Paul if you're available but the floor is yours uh Stephanie can you hear me okay Stephanie yes thank you you're on all right it was quite the journey to get here thank you for persevering uh again as as was discussed uh we're here to discuss the basics of quality assurance I'm going to try to keep it more relevant in that we'll talk about what's important I think in the in the current regulatory framework and what is necessary for you to do as an applicant or or a potential vendor who may want to supply to uh the current or the potential Fleet of advanced reactors So today we're going to discuss uh the basics of what requires a quality assurance program what the scope of the program needs to be based on the desired application and where the guidance is located um bear in mind this presentation is based on the current regulatory framework which is geared toward light water reactors and not Advanced reactors the ongoing pipe 53 rulemaking is not yet sufficiently defined to discuss here today um I will also briefly discuss the NRC position on ISO 9001 that Mark's going to discuss more and where information related to that position can be found next slide please foreign just some early history on July 17 1969 the atomic energy commission or aec published in the Federal Register a proposed amendment to Tennessee at 550 to insert appendix B which is quality assurance criteria for nuclear power plants this appendix was officially approved on June 27 1970 and published in the Federal Register appendix B is a quality assurance document for U.S nuclear facilities this document establishes 18 basic requirements to design construct and manufacture operate structures systems and components related to safety the 18 basic criteria are requirements I'm sorry describe what shall be done but not how in order to do it so in order to standardize the actions of nuclear facilities during intensity of our 50 appendix be implementation the industry has developed some documents the main ones are as me or American society mechanical engineers and qa1 which is quality assurance requirements so nuclear facility applications and the series uh the ANSI series or American National standards Institute and 45.2 which is quality assurance program requirements for nuclear facilities both documents are approved by the NRC or nuclear Regulatory Commission the NRC is the licensing body of U.S nuclear facilities so what is quality assurance as defined in appendix B it's all those planned and systematic actions necessary to provide adequate confidence that a structure system of component will perform satisfactorily in service quality assurance includes quality control which comprises those quality assurance actions related to the physical characteristics of a material structure component or system which provide a means to control the quality of the material structure component of system to predetermined requirements so next slide please so what am I what am I responsible for providing in an application for a QA program well again it depends on the scope of your activities that we went over just earlier so for a Col application say the examples of principal activities during the design phase would be the performance of analyzes by hand calculation or computer important aspects of the design phase would be controller design input data controller design outputs independent checking of analyzes verification validation of computer codes appropriate benchmarking using verified examples configuration control that is controller changes preparation of design construction drawings so those are a few examples of that additionally would also include Pro Camera controls examples include preparation of purchase specifications bid valuation vendor Audits and receipt inspection inspection so what what I'm trying to point out here is there's flexibility in what an applicant would provide in the way of a QA program the QA program only needs to cover the scope of planned activities for example an applicant coming in for design certification may not need to apply Criterion 13 handling shipping and storage or criteria nine control the special processes alternatively if an applicant wants to provide a QA program to address the design construction operations phase that is also an option and again these options are the same for a vendor who is going to do work for a licensee or an applicant they they develop or they scope their QA program to the scope of activities that they plan to do again we encourage applicants to contact the staff early in the effort of the development of a QA program with any questions or clarifications that may be beneficial before the submittal of the document the QA program is usually the first to be submitted for review and acceptance to avoid problems such as questioning how the ongoing applicants work was conducted under adequate controls and what I've given you here in this slide where you can find some of these requirements as to why why am I submitting a QA program so next slide please uh so where do I find the guidance as an applicant or a vendor on implementing a QA program um the standard review uh plan that's mentioned here new regular 800 has been prepared to establish criteria the NFC staff responsible for the review of applications to construct and operate nuclear power plants uses in evaluating whether an applicant or licensee meets the NRC regulations the SRP or standard review plan is not a substitute for the NRC regulations and compliance with it is not required however an applicant is required to identify differences between the QA program proposed for its facility and the standard review plan acceptance criteria and evaluate how the proposed alternative is to the standard review plan acceptance criteria provide an acceptable method of complying with the NRC regulations the current regulatory guide 1.28 rev 5 which is dated in October 2017 endorses Parts one and two event qa1 2011 and the addenda and 2008 2012 and 2015 as providing an adequate basis for complying with the requirements of Tennessee 550 appendix B for the implementation of quality assurance programs during the design and construction phases of nuclear power plants and fuel reprocessing plants if you go into red guide 1.28 there are there are a number of regulatory positions associated with it that provide exceptions and clarifications to pause one and two uh one has to do without a participation of prospective lead Auditors the use of I ilac or the international laboratory accreditation cooperation for laboratory calibration and testing services is acceptable as described in any i-1405 and which is the guidelines for the use of accreditation and lieu of commercial grade surveys for procurement of laboratory calibration test services in Lewis performing commercial grade surveys as part of their commercial grade dedication process for procurement of calibration testing services performed by both domestic and international labs there is guidance on the retention of Lifetime and non-permanent Records there is guidance on electronic records and Industry guidance in the nuclear information records management association or neuroma technical guides to establish appropriate quality controls to software there's guidance on Eternal audits applicable elements of a qa's organization program should be audited at least once a year or at least once during the life of an activity whichever is shorter also external audits guidance that states the following that the award contract that following the award a contract the applicant unless you may determine based on evaluation the external audits are not necessary for procuring items that are relatively simple and standard designed and are adaptable is standard automated inspections to test the end product to verify quality characteristics at the delivery audits should also be conducted on a triangular basis or a range for such an audit now the reason these regulatory positions are in there is that the staff position is that more guidance was needing these particular areas and so in order to use on qa1 you would have to supplement it with these additional regulatory positions next slide please um this okay so this slide and Mark's going to talk about this but what what all I wanted to do here was to outline what the stat position on the use of iso for nuclear power plants that was given in sekio 3117 um there were four options that were provided to the commission bear in mind that the seki was written with a singular point of view towards light water reactors not Advanced reactors the QA requirements may be modified under Pi 53 which would lead to modifications in the stats positioned outlined in the seki thus ISO as an alternative to appendix B may be found acceptable um so I wanted to make that clear because I'm listing the four options here and we had a codasil associated with option one the section up the second option provided for the use of a nuclear sector-specific ISO based program secchio3117 includes an appendix that goes over the differences between appendix B requirements that are not addressed by ISO 9001 some of the most significant differences include independent design verification provisions imposition of appropriate quality assurance Provisions by suppliers on sub suppliers inspections not to be performed by work or perform the activity and licensees audit appendix B suppliers in contrast to ISO Supply a contracted audit requirements other regulated Industries such as the Aerospace automotive and petrochemical industries utilizing ISO 9000 base quality programs and their Regulators have recognize the need for supplemental requirements due to the risk with these activities that they cover option three means the license any additional quality requirements contractually to supplement as needed what is required for the item and service finally option four would allow crediting the iso program as part of a typical commercial grade dedication process so um that was the end of my presentation I I know that was real quick and I'm really kind of looking forward to questions on where we want to go but uh I don't know if we're taking questions later uh Stephanie are we doing it now so we were going to do all of the question and answer at the very end um so if you have questions we'll have everybody put them in the the question portion of the of the panel here and then we'll Circle back at the end of the of of all three presentations um and thank you Paul so much for providing us with such great information um I guess we'll pass the Baton now to mark okay well thank you very much can you hear me we can thank you okay hey I think the way the uh presentations are lined up I think is ideal and I certainly appreciate Paul's sort of team up the iso 9001 discussion uh I think his talk was uh really outstanding uh sort of a general view of of QA programs and uh the example he provided here towards the end I think is uh certainly topical for what I'm about to share with you so uh with that next slide okay I wanted to just briefly give a quick overview of Nei for those of you that may be unfamiliar or not extremely familiar with who we are what we do you know where we're located and so forth we present ourselves as the policy organization of the nuclear energy industry and it's really more than energy although that's how we're primarily viewed and Associated we also deal with issues related to nuclear waste and transportation medicine and other r d areas uh our headquarters and our main offices are in Washington DC we are a member supported Association we currently have over 330 members our membership includes uh licensees you know generating companies uh suppliers large and small uh universities and colleges law firms consultants and I'm sure in this list I've probably overlooked the category or two of member but our membership is pretty Broad and pretty deep and we have expertise here both uh in generation and issues related uh to generating facilities we also uh look at used Fuel and decommissioning issues suppliers supply chain is very important to us we have a security group that deals with both physical and cyber security as well as emergency preparedness uh government Affairs some people think that's lobbyists but it's really much more than that it's about uh helping to shape policy and in a way that's consistent with our industry's strategy as well as our regulatory position there's sort of a number of points of tangency there that we like to be consistent with our messaging and and also with our work have a Communications Group that's our outward public facing messaging we have a legal and Regulatory group and we also have a conference and events and Member Services Group our ability to host conferences and workshops and so forth is very important to us because we really think uh the ability to convene the industry uh and that often will include Regulators uh often include uh International members and even trade press is very important uh not just for the message that the formal aspect of the meeting would provide but also for any number of those side conversations that take place you know during coffee breaks and meals and so forth we really put a lot of emphasis on and see a high value in convening the industry uh so next slide please okay I I won't dwell on this because I think every presentation in every group over the last couple years has beat this drum pretty hard you know there there's a big push and has been for developing carbon-free sources of electricity uh the graphic on the right uh sort of represents a growing and potentially diverse market for electricity and a golden opportunity uh for a new nuclear and and more specifically Advanced reactors to sort of fill that void or take advantage of those opportunities and you know as we've said before the the windmills and solar panels by themselves there's no hope of achieving what it is the market promise offers so nuclear has got to be a part of the picture going forward and uh the advanced reactor companies uh our members have some pretty aggressive plans for developing and deploying their Advanced reactors and one of the concerns that we have is that you know the license application load that The Regulators may see uh may be overwhelming I'm not going to speak to that in any greater detail because that's outside of my area but uh you know potentially it could be significant okay next slide next slide please okay so to maybe pick up a little bit uh where back one must be a lag okay right there thank you yeah picking up a little bit where Paul left off uh relative so ISO 9001 and what we are attempting to do uh here along with industry is developing a process where if you use ISO 9001 as a framework for meeting the requirements of 10 CFR fifth part 50 appendix B and you know our vision uh is that this will help support a a more Nimble and competitive supply chain offer a larger and growing potentially uh growing community of suppliers uh potentially for the operating Fleet but certainly with a focus on the new and advanced reactors and um you know you might ask well why not just use nqa1 or some other more standard approaches um if we go back to potential possibility of developing a hundred to as many as 300 new and advanced reactors in the next decade or so uh I think the historic pool of suppliers will not be uh have sufficient capacity to do that so smaller suppliers are I think really going to be a central uh part of the supply chain and if we can offer an approach where a 9001 supplier with some additional requirements imposed [Music] can supply this industry then you know that would reduce the burden of both economic and in terms of time as developing a parallel separate program uh one of the points I want to be very clear on uh because there was some confusion I think early on when we first rolled this out conceptually both to Industry and NRC we are not proposing to use lysina 9000 watt as a replacement for part 50. this would be using 9001 as an alternative means to meet the requirements of part 50. and we do know that it's employed in many other Industries and even in this industry various places around the world so there is some track record that we can point to in terms of its viability next slide please yeah and as Paul pointed out uh industry is really not starting from scratch he spoke to the seki 03 uh 117 uh for us uh that that's one of our starting points it's sort of a touch base for our effort uh we took a look at that and uh how that matched up to the then current 9001 program and we took a lot of inspiration and guidance in developing what we're doing now around that same time frame epri also did a parallel or somewhat parallel comparison uh and has published that in one of their reports and I just mentioned earlier about other regulated Industries and other Industries in general using 9001 a couple examples a lot of Our member companies New Brunswick power there in Canada they are currently using uh 9001 suppliers for some of their components now I can't share details because I've not dug below the surface but I will be reaching out to them to see you know what they're doing and how they're doing it um yeah to inform our process uh we're also looking at some I'll say relatively small or smaller suppliers that are certified to 9001 uh do not have an appendix B program as a means to test our process and I'll I'll share a little bit more on that uh here shortly so with that next slide so you know we've talked a bit here about the what in terms of what it is we're trying to do now I think we need to you know pivot into the implementation phase how are we going to do this so our Approach at least the one that we're developing for uh our Nei guidance document is starting with appendix B kind of break that down into its discrete requirements what what specifically are they sort of a line by line uh dissection and then do a similar deconstructional ISO 9001 and as and in a table format uh try to identify the comparable requirements uh in 9001 that would you know match up with appendix B and then going through that process you know we will note gaps potential gaps or clear and obvious gaps where the information or the activity is not necessarily sufficient or rigorous enough to comply with regulation and then finally to close that Loop recommendations for closing the gaps or addressing the gaps would have to be developed and implemented next slide okay and depending on your viewing device or where you're sitting this may be a bit of an eye chart so I won't read through it but this is an example of how we would undertake this process um or how a potential customer and a 9001 supplier would uh undertake the process uh in a table format something like this you'll see extracted in the left column you know verbatim excerpt of the appendix B and where we think we find the comparable uh requirements and actions in 9001. and at that point you can do basically a side by side and see where the gaps are so next slide yeah and this would be sort of a summary of the process on the previous slide and I've just written in basically a paragraph form uh discussing what it is that was compared compared uh potential gaps and then what a recommendation or set of recommendations might be now at that point that becomes a business discussion between the customer and the supplier the supplier doesn't really have a solid or rigorous 9001 program they may not be a good candidate to do this if the supplier has a pretty robust program uh they see potential opportunities to join the supply chain for the nuclear industry they may be willing to take on the work and make the resource commitments necessary to have a program that sufficiently closes the gaps that are identified in this process laughs okay next slide please so next steps there's an industry team that's working on this we started off with a white paper we're now transitioning that into an Nei uh guidance document uh Nei 2204 still very much a draft but we hope to be submitting that uh potentially by the end of this year for NRC review uh some of the activities that are taking place I alluded to earlier are performing some dry runs we've developed a checklist Tool uh we're assessing a 9001 program we've got a couple candidate companies that seem interested and willing to participate uh obviously that process is going to expose some weaknesses or deficiencies in our approach so we're going to take those Lessons Learned and use that to inform a refined tool and we need to develop some I'll say some paragraph style process step instructions uh in order to use the checklist but right now we're just trying to Simply test and challenge the process to see if it produces the kind of information that would be necessary to to both identify and then close the gaps [Music] and then again go back and look at the entire guidance document to make it consistent with our learnings and then as I said earlier we'll submit that to NRC for their review and hopefully they're subsequent endorsement so with that next slide additional considerations and and I mentioned this earlier this is not necessarily for everybody or every customer or supplier it's not a one-size-fits all it would have to be a good match on both sides of that relationship and uh in order for it to you know be successful and proceed uh you know one of the things that we simply have to focus on very hard and that's the detailed assessment of the suppliers program to look for those gaps identify you know the supplemental requirements and uh you know through periodic assessments verify that things that are required have been and are still being implemented uh consistent with the commercial and contractual commitments that would be required to close the gaps uh this question has come up from time to time the next bullet the purchaser would maintain the part 21 responsibility and uh the supplier or vendor would then be compelled to impose those reporting requirements on uh the sub-tier suppliers if they use any and again as I mentioned this is a business decision for a customer and a supplier it's not for every everyone but in cases where there's a good match and a good fit it does offer I think a great deal of potential uh potential benefit to the whole industry going forward next slide please okay I think uh Stephanie had mentioned at the top we're going to hold questions to the end but uh would welcome them uh time permitting after uh next presentation so with that I think I'm turning it over we'll carrying it over too we have Roger up next there you are Roger passing passing the virtual baton all right great thank you uh I'm Roger Mills I'm with new pic the nuclear procurement issues corporation uh we used to be a committee but uh for legal purposes we went with the corporation uh just to provide a little extra protection to uh the utilities involved and to our organization so in our corporation uh we have our website down there at the bottom you can visit at any time .newpick.com along with that if you go to our website you go down the left column of different items we have listed you can go in and you can actually look at our documents see what it is we do see the different checklists that we use and have available so it's all there it's for free you can use them at your choice the next slide so a slide I recently saw in msn.com is the nuclear powers on the brink of a one trillion dollar Resurgence that's all this new nuclear but one accident anywhere to stop that momentum uh the momentum depends on International cooperation around safety and best practices the issue how nuclear industry works and is perceived globally any accident anywhere is an accident everywhere uh really affects us because you know you look in the headlines and it's nuclear did this nuclear did that uh it isn't any one in particular they look at it as everybody so one of the things uh new pick does if we go to the next slide is we look at what all the utilities need all right nuclear procurement issues Corporation where non-profit organization and we support the utility members and as those members that are licensed by the NRC to operate nuclear plants in ance with Tennessee 450 appendix B and we provide efficiencies and consistencies in auditing so to includes sharing Manpower for performing Audits and data storage so what we're looking at is uh you have your QA program for your utility and as Paul had mentioned this flows down to your vendors we're the ones that keep that consistency with the vendors we're the ones that schedule the Audits and divide up the responsibilities evenly amongst the members our mission uh significant organization will strive to improve the supplier Assurance processes through Cooperative efforts while minimizing utility o m costs and improving plant performance right now we have 39 or 38 utilities and one extra member and the members epiary and they either act up our active plants they're in startup or they could be in a decommissioning phase and 12 of our members are international that Paul had mentioned Canada earlier we have both Canadian utilities Mexico and many others from around the world next slide new pick itself since we're a corporation we have an executive steering committee made up of different members uh chairman Vice Treasurer Vice chairman treasurer secretary and then we have various uh the four region reps representatives and an international representative the key thing to take from this slide is noticing that all different utilities are represented on our steering committee okay so it's no one utility you know because of size or anything that they have a greater Advantage everybody's offered the opportunity to run for positions and we only pick one per utility to be on our steering committee next slide we do operate operate as a non-profit Corporation so that means we're not out to make money we're out to provide the best efficient cost-effective method we can for getting audits completed we do have dues and that goes toward meetings and other different things we have a database for on the website that we have to maintain uh it goes for costs such as that and our whole goal there is maintain focus on the best interest of the members so that means every utility that's a member of new pick has a voting responsibility and they have the ability to bring up any issue they want to the entire committee so that we can discuss it and as a group determine what is correct it's a Cooperative program for the evaluation of vendor supplier performance new pick itself does not perform audits I know a lot of times you'll hear oh you're going to get new pic audited well you're going to get an audit performed that was scheduled by new pick but each lead for each audit their utility is responsible for that audit so that means uh if like for example my company PSEG if I leave the audit then it's a pseg-led audit it's done under my program okay we'll use the checklists that we develop and have stored on the new pick on the new pick database but overall that's my audit new pick schedules the audits okay we also have uh three meetings a year where it provides a forum so that we can discuss any other procurement quality assurance issues as mentioned earlier Nei 17025 for Calibration Labs was discussed at one point in time that came up in one of our meetings and we developed our checklists to respond to the new changes so we're always trying to stay on top of that and we provide an interface for procurement quality assurance activities all right next slide please nipik itself has several different uh committees and we interface with a lot of different folks so for example NRC Nei they're usually in our meetings the three meetings we have a year Nitzel will do once every couple years every is always at our meetings um and then you got Nitzel uh the nqml group nqml which is our managers uh quality forum uh they'll attend our meetings and uh then we have various owner groups that also we interact with next slide within new pick we have a variety of committees and they consist of a committee chair and then different member members from the utilities that perform and manage all the work they report to the steering committee and the utility Representatives so what happens is I'll give a quick list of the Committees that we have and all our folks from the utilities volunteer in order to be on these committees so it's it's non-paid but it's a great learning opportunity and you get to have a voice in more detailed areas of how new pic works and the different procedures that we use and share and again the benefits you get your people get to learn leadership skills then you have some Network opportunities next slide I'm not going to explain all the details on all of these but you know overall we have the steering committee because we collect news we have bills we have to rent hotels to do conferences we have a finance committee a vendor interface committee uh also meets three times a year and monitors what's happening with the vendors um I mean excuse me uh they said the meetings up the three times a year the June meeting will be our vendor meeting where we bring in all the vendors that we offer the opportunity for all vendors to come in and have a voice get to hear different speakers uh like this June I'm sure we'll have uh someone from NRC talking I've also lined up for uh some members of a department of energy the doe to come in and speak so that'll be in Denver in June we have Process Management committee and this is where we do a little bit of everything and it's all the new pick procedures and along with uh our procedures you know when we perform audits we also provide feedback on each other so the team members provide feedback on what the lead did how the lead performed and the lead will also provide feedback on how the members performed so we take this very serious and critical and we uh we audit ourselves to a point you know to make sure that we're doing the right thing and getting better and we also have uh the option for the vendors that we're auditing to provide feedback on us okay we want to take their input you know what did we do right what did we do wrong and keep us on track next slide other committees we have uh fuel is very important so we have a specific fuel committees that keep track and perform surveillances on our different fuel suppliers RIT because we have a database we have to have people involved in that we're constantly making changes to it making it better uh vendor performance monitor monitoring committee schedules all the audits it's a big event that happens once a year it's usually around the March April time frame and it sets the audits for the entire next year okay and from that point we have the options of being able to swap back and forth between members uh you know to better match up our schedules maybe do an audit closer to home maybe there's a vendor that we've had a lot of problems with and we really need to get in and see their facility so we'll swap back and forth on these vendors training committee every January meeting or what we call the winner meeting we also have two days of training one or two days of training that we provide to all the new pick Auditors and a lot of the new folks that are joining in first coming in as Auditors and we'll provide training for them to help make sure they're doing the right things so as a new nuclear utility coming into new pick you're going to get the opportunity to receive a lot of training and along with that as we keep this on our database so you've got a lot of lessons that were done before that now will apply to what you're doing next slide I mentioned earlier that uh with lilac in 17025 coming into play that uh yeah could I get yeah there we go okay that uh you know we had talked about it we had to we formed the committee to make sure that we had input on this and we did the side by side match for the 17025 2005 and the 2017 to find out the differences to ensure that we were still meeting all the requirements and making recommendations for the NRC for the acceptance of it and part of that is that new pick has the requirement of going on some of the ilac audits to ensure that they're being done to meet standards so we reach out above just the auditing process and we observe other things just to make sure that the requirements are met we have uh what's vendor Improvement groups what that is is uh you get a vendor that you know it might have been going real good for a while for them and all of a sudden they might have changed locations changed management uh done something drastic to where their performance drops off well we have the ability to do a few different things and one of them is we can increase the auditing schedule on that vendor another one is that we can develop a team in order to help make them better we don't tell them what to do but we Monitor and work with them as close we can to ensure they're doing the right things to get back on track and we found uh we've had a pretty good success rate with that it's done quite well all right next slide so why be a member of a new pick well first of all it's increased efficiencies when you look at how many audits you would have to perform ing to appendix B all your audits that provide stick related items or Services they would have to be audited and if you have a 130 suppliers on your approved suppliers list that would be 43 audits a year that you would be responsible for or something there for a month and that's uh that's a lot of folks that do all that work you break that down as a member of new pick and when we share audits that 130 suppliers now goes to a number around 13. so it's around one a month so it saves you you know four times the cost there and uh that's that's a pretty good efficiency number there next slide shared knowledge uh another good reason because we maintain the the database that contains the suppliers location their scope QA context certifications we track all the audit activities we identify overdue items we have automated email systems so QA QA company vendor changes their QA manual and sends it into new pick it automatically distributes out to all the users to let them know the changes were made so it's kind of an automated system it's pretty nice it works quite well we also have a like I had mentioned three meetings a year we have our winter meeting so that's the January meeting where we include training with that and we'll include a few interfaces with some other outside organizations at that meeting we have our June meeting where we invite all the vendors that we do that we audit and even some that don't we invite them in so that they can come in and be part of the talks and we'll spend a couple days to have discussions with them to let them know what's going on in the industry new changes anything like yeah next slide so to kind of sum this all up we can provide increased efficiencies knowledge sharing a database for scheduling tracking assignments team members and archives that's all our audits all our documents you get to uh have lessons learned for audit performance we share those uh we update on vendor performance issues every meeting the three meetings a year we discuss any problems with all of our vendors or we discuss all the vendor problems amongst ourselves we don't share information outside we have the opportunity to share in Focus oversight of troubled vendors that was the performance groups that I was mentioning and we have consistent objective Audits and survey checklists we have Circle checklists for the audits for surveys for radiological for fuels uh for the safer group we have audits uh checklists built for all of them and then access to continually improve Improvement opportunities so in other words you have an auditor goes on an audit uses a checklist he sees something isn't right he can bring that up and we can make it uh better so overall it's a nuclear industry if there's an accident or an incident it's the nuclear industry that gets put in the headlines and we're here to try to help prevent those types of headlines next slide and Stephanie I think it's back to you now thank you so much um so we have had a couple of questions come in and um I will pitch them to our presenters but in the meantime if anybody in the audience has additional questions go ahead and send them on over and um if we don't get to the questions today we will um either include some sort of response in our second Tech talk or we'll um post some responses on our our website as well um so the first question is for Paul um the question is what is nrc's expectation with regards to reactor design reactor to reactor designer and licenses quality program basis are they allowed to employ ISO 9001 as their quality program basis to comply with 10cfr 50 appendix B um okay that that's kind of a rough question from the standpoint that the pub 53 rulemaking for advanced reactors isn't out yet um so I have to give you the canned answer that the currents the current regulatory framework for your safety related sscs associated with the design would have to be done under appendix B now that's not to say as Mark pointed out and the the sucky pointed out that's not to say an iso-based program is is not doable it would at the but in the current regulatory framework you'd probably have to bolster it somehow and um the seki gives you where those areas for your particular scope of work that you would have to supplement your program now there there are examples of vendors who have um ISO slash appendix B programs those are like the GES and the Westing houses um you know your big uh architect engineering firms or NSS nuclear steam system suppliers that have uh uh joint QA programs that's because they work globally into mocks Point uh what you see globally is ISO applied in a lot of different places so uh again I think it's kind of prematurity answer that question but if you were to have a program like I said in the current framework of part 50 part 52 you'd have probably had to supplement it does that answer the question I think so and thank you for for being willing to even take a run at it um so our next question um is for Mark Mark the question is is the discussion on use of commercial quality programs for example ISO 9001 and as9 9100 targeted at designer Constructor licensee options for procurement of safety related ice items mark yeah potentially that that's part of our vision uh that suppliers um with the sufficient bolstering or augmented requirements imposed would be able to meet appendicity requirements great thank you our next question is for uh Roger Roger how can a potential supplier get onto the new pick list of suppliers to be audited foreign to get onto the new pick list requires a utility to pick up that vendor and perform an audit first that would get them entered into the new pick database in order for a new pick to schedule regular audits a vendor would have to have five users in order to be scheduled on a regular basis great thank you uh here's another question um I think it's probably for Paul but maybe Mark um is nqa1 a safe harbor for designers and licensees I think that's probably more appropriate for Paul yeah um so to to uh yes it would be a a quote-unquote safe harbor as as uh spelled out in regulatory guide 1.28 um and again it would depend on the version of nqa1 essentially almost all of the nqa1 versions have been approved for uh design and construction use um uh the only ones that come to mind are the 1997-2000 and 2002 editions were never approved by the NRC other than that it's pretty much you could even use arguably you could use the ANSI standards as one method of meeting appendix B so almost every version of nqa1 and the ANSI standards have been found as an acceptable method of meeting appendix B thank you thank you Paul yeah I have nothing else to add okay thanks Mark um let's see oh we just had another question come in um what is the expected efficiency gained with using a bolstered ISO vendor over performing cgd also how does risk of receiving unacceptable product factor into that equation yeah this is Mark I'll take a shot at least in part of that question which I think is a two-part but you know we've taken the Approach at least going in as we're developing a process and as I indicated earlier we're still working on that in terms of cost or cost savings that's not something that um you know we're not privy to a company's you know Financial uh information or their cost structure for doing something like this that's why we've presented this that is not being a one-size-fits-all it may make perfect sense for one supplier and make absolutely no sense for the next one and that's an individual sort of a business decision at that point if you get through the uh the Gap analysis and and understand what actions and requirements are needed to be implemented to close the gaps then the customer and supplier have to have the conversation in terms of resources and whether or not the customer wants to provide addition you know some support to help the supplier and so forth that gets way off uh way off the theme of what it is we're trying to do we're trying to create a process a tool that can be used and and can be used in situations where it makes sense foreign thank you um anybody else want to chime in on that one uh this this is Paul I mean I think Mike hit the nail on the head I mean you have to you it's almost uh a custom order type thing it depends on your situation and uh what may work best for you you may find commercial grade dedication to be a better option or you may find that if you bolster this this in this company's uh uh QA program ISO program with a few additional things it may in the long run be better if it's a supplier you're going to use constantly again I I think it boils down to more of a financial uh issue than than really are you able to do it the answer is yeah you you have options there and those options have been discussed today perfect thank you so much um so we're closing in on the uh the end of our presentation um but if anybody has any additional questions uh please feel free to put them in the chat or reach out to Enric enrich.inl.gov and um look for in more information about our second Tech talk which is coming up in November um and if there's anything that you've uh you're really interested in seeing Enric uh present in a tech talk please feel free to reach out and we would love to explore that with you so thank you again to all of our wonderful presenters and to everyone in the audience for joining us today um we will post this recording on our website and as long as as well as the slides so look for more from us and um thank you again and have a wonderful day thank you all thank you thank you thank you