13.5      Acceptance Test Technician Certification Provider (ATTCP)

13.5.1        Provider Qualifications

The requirements to become either a nonresidential lighting controls or mechanical Acceptance Test Technician Certification Provider (ATTCP) are very similar. Therefore,  this section will address both the lighting controls and mechanical ATTCP application requirements together, calling out specific differences when warranted. The prospective ATTCP must submit a written application to the Energy Commission that documents the following major elements:

13.5.1.1    Organizational Structure

ATTCPs shall provide written explanations of the organization type, bylaws, and ownership structure. ATTCPs shall explain in writing how their certification program meets the qualification requirements of §10-103.1(c) (or §10-103.2(c)). ATTCPs shall explain in their application to the Energy Commission their organizational structure and their procedures for independent oversight, quality assurance, supervision and support of the acceptance test training, and certification processes (§10-103.1(c) and § (c)1).

This requirement is necessary to ensure, at a minimum, that the organizations providing certification services to the building industry have a business structure that is conducive to train, certify, and oversee ATTs.

The Energy Commission has approved several ATTCP applicants and all applications included articles of incorporation, bylaws, and trust agreements. One approved application included the Section 501(c) status (with the corresponding employer identification number) of the organization. A copy of the ethics policy for the ATTCP is recommended.

This section of the application should also include a description of how the organization is conducive to providing training, certification, oversight, and support to the technicians that they will be certifying. The ATTCP may also describe what qualifications and experience the ATTCP may have to operate and oversee an accreditation program.

13.5.1.2    Certification of ATEs

The ATTCPs shall provide written explanations of their certification and oversight of acceptance test employers (ATEs) that employ ATTs. This explanation shall document how the ATTCP ensures that the ATEs are providing quality control and appropriate supervision and support for their ATTs (§ t10-103.1(c) and §10-103.2(c)2).

The ATTCP shall recertify all ATEs before implementing each adopted update to the Energy Standards as these updates affect the acceptance test requirements. Recertification requirements and procedures shall only apply to those specific elements that are new or modified in future updates to Energy Standards.

ATEs must have an understanding of what tasks the ATT is responsible to complete. Moreover, the ATE must manage and provide support to the ATTs in performing their tasks. The ATTCP is required to describe the training and requirements that they will place on the ATE for these endeavors and issue certificates to qualified ATE applicants. The requirement for the ATEs to be retrained for each new code cycle is intended to maintain the current educational level of the ATEs. The quality control that the ATEs provide to the ATTs is different from the quality control that the ATTCPs provide.

The Energy Commission recognizes that there are many roads to compliance regarding ATE training, certification, and oversight. Technical training typically consists of 4 to 24 hours of instruction. Quality control, supervision, and support requirements implemented by the ATTCP on the ATE can vary considerably. Some elements that the ATTCP might consider implementing, but that are not specifically required by the Energy Commission regulations, include the following:

      The ATTCP may develop a policy to address where a change in employment results in no ATE manager or supervisor having completed the ATE training.

      The ATTCP may adopt an ethics policy for ATEs.

      Union contracting requirements: The ATTCP may be restricted to serving unionized technicians only and as a result the ATTCP may require that the ATE be a party in good standing with a union contract. This may entail several significant requirements for the ATE.

      Third-party certificate holders: The ATTCP may require that the ATE hold a valid certificate from a third party, such as specific types of testing and air balancing (TAB) training.

      Multiple office management requirements: The ATTCP may consider how it will implement ATE training and certification requirements where an ATE has multiple offices. The ATTCP may consider requiring that an ATE with multiple offices shall ensure a middle or senior management level employee at each office has completed the ATE certification training.

      Restrictive employment practices: The ATTCP may restrict the ATE from employing an ATT that is certified by a different ATTCP. Furthermore, the ATTCP may restrict the ATE from holding certificates from multiple ATTCPs.

      Licensing, insurance, and safe practices requirements: The ATTCP may require the ATE to provide initial and ongoing proof of workers’ compensation and general liability insurance (typically a minimum dollar amount is specified), local business licenses, injury and illness prevention program, and Code of Safe Practices (typically required to be consistent with the California Code of Regulations, Sections 1509 and 3203).

      Equipment Policy: The ATTCP may require the ATE to agree to requirements for ensuring that the ATE and ATT possess and properly maintain diagnostic equipment.

13.5.1.3    Training and Certification Procedures

These requirements are the most significant of the ATTCP regulations. They encapsulate all the required training, testing, certification, and oversight for the ATTs and ATEs that the ATTCP must provide. These requirements describe the level of experience, education, professionalism, and accountability of the ATT that the Energy Commission is seeking and that the ATTCP must enforce.

ATTCPs shall include with their application a complete copy of all training and testing procedures, manuals, handbooks, and materials. ATTCPs shall explain in writing how their training and certification procedures include, but are not limited to, the following (§10-103.1(c)3 et sec and §10-103.2(c)3 et sec):

A.   Training Scope

The ATT training must include both classroom and laboratory training. In essence, the ATT must be instructed on all acceptance tests and then practice those instructions in a laboratory setting. Furthermore, the ATT must be educated on the general science regarding acceptance testing, as well as the procedure to complete and submit the correct acceptance test documents.

B.   ATT Training

i.   Curricula.

ATTCP training curricula for lighting controls and mechanical ATTs shall include, but not be limited to, the analysis, theory, and practical application of the items listed in §10-103.1(c)3Bi and §10-103.2(c)3Bi, respectively. These include training on the acceptance tests themselves.

Several approved ATTCPs require extensive classroom training to accomplish this educational requirement. One approved ATTCP requires that each applicant hold a third party certificate of training that the Energy Commission found to be equivalent to the curricula required.

ii.  Hands-on training.

The ATTCP shall describe in its application the design and technical specifications of the laboratory boards, equipment, and other elements that will be used to meet the hands-on requirements of the training and certification.

iii. Prequalification.

Participation in the certification program shall be limited to persons who have at least three years of professional experience and expertise in either lighting controls and electrical systems or mechanical systems, as determined by the ATTCP.

Professional experience is defined by the ATTCP, but generally means experience in a professional occupation that provides training and work experience related to the systems subject to lighting controls or mechanical acceptance testing. The ATTCP must clarify the process that it will use to determine what experience is considered professional and relevant to either lighting controls or mechanical acceptance testing, as well as to what extent the ATTCP will verify that experience. The following are some relevant questions that the ATTCP should consider when establishing an ATT applicant's prequalified experience, though not specifically required by regulation:

      How is the experience documented (for example, letters from employers or other written evidence), and how is it related to lighting controls or mechanical acceptance testing requirements?

      Should professional experience be demonstrated by requiring applicants to be certified in specifically identified professions, such as:

California licensed electrical contractors.

California licensed mechanical or HVAC contractors.

California certified general electricians.

California licensed air conditioning repair contractors.

California licensed professional engineers.

Lighting control manufacturer representative.

Certified commissioning professionals.

Other professional occupations that are demonstrated to provide industry- accepted training and work experience relevant to the systems subject to lighting control or mechanical acceptance testing.

For the 2019 Energy Standards, a note was added to specifically allow ATTCPs to adopt additional prequalification requirements for ATTs, such as “shall not be decertified by another ATTCP.” Any such additional requirements are at the ATTCP's discretion and not required by the Energy Commission.

iv. Instructor-to-Trainee Ratio

The ATTCP shall document in its application to the Energy Commission why its instructor-to-trainee ratio is sufficient to ensure the integrity and efficacy of the curriculum and program based on industry standards and other relevant information.

Typically, the instructor-to-student ratio for classroom training is much higher than for laboratory training. In the applications that the Energy Commission has approved, classroom instructor to student ratios were between 1:25 and 1:35. For laboratory training, the ratios were between 1:6 and 1:12. Most important, each ATTCP application included a discussion of the basis for each ratio.

v.  Tests

The ATTCP shall describe the written and practical tests used to demonstrate each certification applicant’s competence in all specified subjects. The ATTCPs shall retain all results of these tests for five years from the date of the test.

When developing and implementing both written and practical tests, the ATTCP may consider the following issues:

      Subject matter experts should validate exams by for content.

      Pilot testing and statistical analysis by qualified psychometricians can identify poor quality questions and bias, as well as validating a passing score.

      Checking exam question response option frequency and other measurements of consistency may help validate the exam rigor and justify passing scores and performance standards.

      Exam questions should be evaluated annually to confirm reliability, rigor, and lack of bias.

      Lack of bias should be Validated consistent with the Uniform Guidelines on Employee Selection Procedures (1978) Federal Register, 43(166), 38290-38315.

Measures should be adopted to ensure exam security, such as having multiple versions of exams with random question generation and at least twice the number of questions in a validated question bank than are scored on any given test.

vi. Recertification.

The ATTCP shall recertify all ATTs before implementing each adopted update to the Energy Standards when these updates affect the acceptance test requirements. Recertification requirements and procedures shall apply only to those specific elements that are new or modified in future updates to the Energy Standards.

The ATTCP shall develop recertification training curricula for ATTs consistent with training requirements in §10-103.1(c)3A and §10-103.1(c)3B  (or §10-103.2(c)3A and §10-103.2(c)3B and shall submit the proposed recertification training curricula to the Energy Commission for review and approval in the update report required under §10-103.1(c)2 (or §10-103.2(d)2 Once approved, the ATTCP will implement the recertification process.

C.   ATE Training

Training for ATEs shall consist of at least a single class or webinar consisting of at least four hours of instruction that covers the scope and process of the lighting controls or mechanical systems acceptance tests in the Energy Standards.

D.   Complaint Procedures

The ATTCPs shall describe in their applications to the Energy Commission procedures for accepting and addressing complaints regarding the performance of any ATT or ATE certified by the ATTCP and explain how building departments and the public will be notified of these proceedings.

E.   Decertification Procedures

The ATTCPs shall describe in their applications to the Energy Commission procedures for revoking their certification of ATTs and ATEs based upon poor quality or ineffective work, failure to perform acceptance tests, falsification of documents, failure to comply with the documentation requirements of these regulations, or other specified actions that justify decertification. The ATTCP shall also describe its general procedures for decertified ATTs or ATEs seeking to regain their certification status, including eligibility requirements for recertification (if any).

F.   Quality Assurance and Accountability

The quality assurance and accountability requirements for lighting controls and mechanical ATTCPs vary significantly for the 2019 Energy Standards, so they will be discussed separately.

      Lighting Controls

The ATTCP shall describe in its application to the Energy Commission its procedures for conducting quality assurance and accountability activities, including, but not limited to, the following:

The ATTCP shall include quality assurance and accountability measures, including, but not limited to, independent oversight of the certification materials, processes, and procedures; visits to building sites where certified technicians are completing acceptance tests; certification process evaluations; building department surveys to determine acceptance testing effectiveness; and expert review of the training curricula developed for Energy Standards §130.4.

The ATTCP shall review a random sample of no fewer than 1 percent of each ATT’s completed compliance forms and shall perform randomly selected on-site audits of no fewer than 1 percent of each ATT’s completed acceptance tests. Independent oversight may be demonstrated by accreditation under the ISO/IEC 17024 standard.

The consequences of failed audits should be fully described by the ATTCP. ATTCPs might consider whether to require a higher percentage of document and on-site audits the first few years of operation to ensure that any initial issues with training or compliance are identified and addressed.

For example, one ATTCP proposed the following:

For the first three years of operation, review a random sample of 6 percent of each technician's completed documents and perform on-site audits of 6 percent of acceptance tests.

For years 4 and 5 of the ATTCP operation, review a random sample of 4 percent of each technician's completed documents and perform on-site audits of 4 percent of acceptance tests.

After five years of operation, reduce a random sample of 2 percent of each ATT's completed compliance documents and perform on-site audits of 2 percent of acceptance tests.

      Mechanical Systems

The ATTCP shall describe in its applications to the Energy Commission procedures for conducting quality assurance and accountability activities, including, but not limited to, the following:

The ATTCPs shall include quality assurance and accountability measures, including, but not limited to, independent oversight of the certification materials, processes, and procedures; visits to building sites where ATTs are completing acceptance tests; certification process evaluations; building department surveys to determine acceptance testing effectiveness; and expert review of the training curricula developed for Energy Standards §120.5.

The ATTCP shall review a random sample of no fewer than 1 percent of each ATT’s completed compliance forms. The ATTCP shall also randomly select and shadow audit no fewer than 1 percent of each ATE’s overseen projects, following the assigned ATT and observing his or her performance on the job site. Independent oversight may be demonstrated by accreditation under the ISO/IEC 17024 standard.

The mechanical regulation generally follows the same requirements as lighting controls, except the focus for on-site audits is on the ATEs rather than the ATTs.

G.   Certification Identification Number and Verification of ATT and ATE Certification Status

The ATTCP shall describe in its applications to the Energy Commission procedures for recording, tracking, and communicating certification status, including but not limited to the following:

      Upon certification of an ATT or ATE, the ATTCP shall issue a unique certification identification number to the ATT or ATE.

      The ATTCP shall maintain an accurate public record of the certification status for all ATTs and ATEs that the ATTCP has certified, including any ATTs or ATEs who have been decertified as specified in §10-103.1(c)3E or §10-103.2(c)3E.

      The ATTCP shall provide verification of current ATT certification status upon request to authorized document registration provider personnel or enforcement agency personnel to determine the ATT's eligibility to sign certificate of acceptance documentation.

Energy Standards compliance will also be simplified by requiring the ATT to include its assigned certification number on the compliance documentation, thereby allowing the enforcement agency and the Energy Commission to track the effectiveness of this certification program.

The ATTCP is not required to implement an on-line presence of any kind for compliance with these regulations. However, the applications that the Energy Commission has approved all include the implementation of an online presence to contend with the ATT/ATE application processing, complaints process, certification status, and ATT/ATE contact information.

13.5.2        Requirements for ATTCPs to Provide Regular Reports

Section 10-103.1(d) and 10-103.2(d)2 require ATTCPs to submit two periodic reports to the Energy Commission. All required reports shall contain a signed certification that the ATTCP has met all requirements for this program.

These reporting requirements are intended to ensure that the Energy Commission has a reasonable level of control on the ATTCP without being unnecessarily involved in the day-to-day operations of the ATTCP.

13.5.2.1    Annual Report

The ATTCP shall provide an annual report to the Energy Commission that includes:

1.   A summary of the certification services provided over the reporting period, including the total number of ATTs and ATEs certified by the ATTCP during the reporting period and to date.

2.   A summary of all actions taken against any ATT or ATE as a result of the complaint or quality assurance procedures described by the ATTCP as required under §10-103.1(c)3D and §10-103.1(c)3F (or §10-103.2(c)3D and §10-103.2(c)3F).

3.   A summary of the quality assurance and accountability activities conducted over the reporting period, including the compliance forms reviewed and the on-site audits performed as required under §10-103.1(c)3Fii (or §10-103.2(c)3Fii) during the reporting period and to date.

4.   A summary of the number and type of acceptance tests performed in each local jurisdiction over the reporting period and to date.

5.   A signed certification to the Energy Commission that the ATTCP continues to meet the requirements of §10-103.1 (or §10-103.2).

The annual report can include adjustments that are proposed, however, these proposals must be approved according to the application amendment process in §10-103.1(f) or §10-103.2(f).

13.5.2.2    Update Report

The ATTCP shall have no less than six months following the adoption of an update to the Energy Standards to prepare an update report. The ATTCP shall submit an update report to the Energy Commission not less than six months before the effective date of any newly adopted update to the Energy Standards. The ATTCP shall report to the Energy Commission what application amendments are proposed to address changes to the Energy Standards or to ensure training reflects the variety of lighting controls (or mechanical systems) that are encountered in the field.

All required update reports shall contain a signed certification that the ATTCP continues to meet the requirements §10-103.1 (or §10-103.2). Update reports shall be approved through the amendment process provided under §10-103.1(f) (or §10-103.2(f)).

13.5.3        Amendment of ATTCP Applications

The ATTCP may amend a submitted or approved application as described in §10-103.1(f) and §10-103.2(f). The amendment process is intended to give the ATTCP an opportunity both during its initial application approval process and postapproval to modify its application or operations. This is so that ATTCPs can operate as openly as possible with the Energy Commission and address issues as they arise.

The amendment process depends on whether changes being made to an ATTCP application are substantive or nonsubstantive. Substantive amendments will require an approval from the Energy Commission at a regular business meeting. Nonsubstantive amendments can be approved by the Executive Director. The requirements and approval process for both types of amendments are discussed in detail below.

13.5.3.1    Amendment Scope

A.   Nonsubstantive Changes

A nonsubstantive change is a change that does not substantively alter the requirements of the application materials for the ATTCP, ATT, or ATE. For amendments making only nonsubstantive changes, the ATTCP shall submit:

      A letter describing the change to the Energy Commission as an addendum to the application.

      A replacement copy of the affected sections of the ATTCP application with the changes incorporated.

      A copy of the affected sections of the ATTCP application showing the changes in underline and strikeout format.

B.   Substantive Changes

A substantive change is a change that substantively alters the requirements of the application materials for the ATTCP, ATT, or ATE. For amendments making any substantive changes, the ATTCP shall submit the following:

    A document describing the scope of the change to the application, the reason for the change and the potential impact to the ATTCP, ATT, and ATE as an addendum to the application;

    A replacement copy of the affected sections of the ATTCP application with the changes incorporated; and

    A copy of the affected sections of the ATTCP application showing the changes in underline and strikeout format.

13.5.3.2    Amendment Review

Amendments submitted prior to approval of an ATTCP application shall be included in the application’s application review and determination process specified in §10-103.1(e) or §10-103.2(e).

Amendments submitted after approval of an ATTCP’s application that contain only nonsubstantive changes shall be reviewed by the Executive Director for consistency with §10-103.1 or §10-103.2. Amendments determined to be consistent with this section shall be incorporated into the approval as errata.

Amendments submitted after approval of an ATTCP’s application that contain any substantive changes shall be subject to the application review and determination process specified in §10-103.1(e) or §10-103.2(e). If the Energy Commission finds that the amended application does not meet the requirements of §10-103.1 or §10-103.2, then the ATTCP shall either abide by the terms of their previously approved application or have its approval suspended.

13.5.4        Nonresidential Mechanical Acceptance Test Training and Certification

The mechanical ATTCP still has one additional consideration compared to the lighting controls ATTCP. The lighting controls ATTCPs have satisfied the industry certification threshold requirements in §10-103.1(b), which means that only certified ATTs can perform lighting controls acceptance testing. The Mechanical ATTCPs, as of this writing, have not satisfied the following threshold requirements (§10-103.2(b)):

1.  A minimum of 300 mechanical ATTs have been trained and certified to complete the acceptance tests of §120.5 by ATTCP(s) approved by the Energy Commission.

2.  ATTCPs must provide reasonable access to the training and certification for the following industry groups: professional engineers, HVAC installers, mechanical contractors, TABB certified technicians, controls installation and startup contractors, and certified commissioning professionals who have verifiable training, experience, and expertise in HVAC systems. The Energy Commission will determine “reasonable access” by considering factors such as certification costs commensurate with the complexity of the training being provided, certification marketing materials, prequalification criteria, curriculum, and class availability throughout the state.

Until these requirements are met, field technicians can complete mechanical acceptance tests in §120.5 without being a certified mechanical ATT. When appropriate, the Energy Commission will take up the question of the threshold requirements for the nonresidential mechanical ATTCP program.