Competence Assurance - Guidelines For Building A Successful Program
Competence Assurance - Guidelines For Building A Successful Program
Competence Assurance - Guidelines For Building A Successful Program
IADC’s Workforce Development Committee comprises members who are experts in this area and
was able to leverage their insights and expertise. Their overriding objective was to help industry
colleagues to expedite the process of creating a company program that meets their needs and
that helps develop and manage the competence of industry workers.
We start at the beginning. What exactly is competence, and what are the misconceptions we
have often faced about it? How is competence determined? What terminology is particular to
this kind of program? What are the essential elements of a program? How do the programs
vary? How do we match the type of program with our objectives? How are the different types of
programs designed and built? What are the key roles within a program?
This document offers essential guidelines for building a program from scratch, but the
information can also be used to evaluate your existing program against industry-recommended
guidelines, or to combine the best elements of multiple programs.
The authors of these guidelines believe, as I do, that a future is possible in which every person,
on every rig, is competent to successfully and consistently perform his or her job role. Work
toward achieving this goal has taken place within the newly drawn boundaries of the industry’s
collaborative space. A safer work environment benefits us all, helping to sustain our societal
license to operate as an industry, not just as individual companies.
Recreating the wheel is not just undesirable, but unnecessary. However, working together, we
can make it better. We hope you agree and, therefore, take advantage of this resource to
improve the safety and effectiveness of your workers.
Regards,
Stephen Colville
President and CEO
International Association of Drilling Contractors
Africa • Asia Pacific • Europe • Latin America • Middle East • North America
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
Table of Contents
1 Purpose and Scope.......................................................................................................................... 3
2 What is Competence? ..................................................................................................................... 3
2.1 Definitions ............................................................................................................................. 3
2.2 What Competence is Not (Misconceptions) .................................................................... 4
2.2.1 Competence versus Qualifications ................................................................... 4
2.2.2 Competence versus Training ............................................................................ 4
2.2.3 Competency Assessment versus Performance Appraisal/Evaluation ........ 5
2.3 Common Components of Competency ............................................................................ 5
3 What is a Competence Assurance Program? .............................................................................. 6
3.1 Benefits of a Competence Program ................................................................................. 6
3.2 Components of a Competence Program ......................................................................... 7
4 Commitment ...................................................................................................................................... 8
4.1 Commitment of Management ............................................................................................ 8
4.2 Commitment of Program Administrators.......................................................................... 9
4.3 Commitment of Other Stakeholders ................................................................................. 9
5 Competence Framework ................................................................................................................. 9
6 Defining Competencies ................................................................................................................. 10
6.1 Process for Defining Competencies ............................................................................... 10
6.2 Competence Mapping ....................................................................................................... 11
7 Assessing Competence ................................................................................................................. 12
7.1 Process for Assessing Competence .............................................................................. 12
7.2 Competence Rating System ............................................................................................ 13
7.3 Assessment Plan Communication .................................................................................. 14
7.4 Methods of Assessment ................................................................................................... 14
7.5 Assessment Tools and Supporting Evidence ............................................................... 15
7.6 Assessor and Verifiers ...................................................................................................... 15
7.7 Assessment Decision........................................................................................................ 16
7.8 Managing the Outcome .................................................................................................... 16
7.8.1 Providing Feedback .......................................................................................... 17
7.8.2 Employee Feedback ......................................................................................... 17
7.8.3 Appeal ................................................................................................................. 17
7.9 Closing Competency Gaps .............................................................................................. 18
8 Data and Information Management ............................................................................................. 18
8.1 Documented Information .................................................................................................. 18
8.2 Recordkeeping System .................................................................................................... 19
8.3 Reporting ............................................................................................................................ 19
8.4 Confidentiality Requirements & Human Resource Legal Interfaces ......................... 19
9 Quality Assurance .......................................................................................................................... 20
9.1 What is Quality Assurance? ............................................................................................. 20
Revision 0
22 April 2015 1
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
Revision 0
2 22 April 2015
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
Current employees will better understand the company’s expectations for good or great
performance if key competencies have been defined. Knowing these standards will aid
in attaining professional growth and development within the organization. It can also aid
in the hiring and selection of new employees by matching their experiences to the
competencies that a candidate should have in order for her or him to be qualified for the
position.
Robust and successful programs have a process that helps to ensure a standardized,
valid, and reliable evaluation of employees’ competencies. These evaluations are
designed to assess proficiency and determine developmental opportunities for each
employee. Being competent provides for safer working conditions and career
opportunities, as well as a number of other benefits to both the organization and the
employee.
This document’s primary audience includes the individuals responsible for developing,
implementing, monitoring, reviewing, and ensuring sustainability of the organization’s
competence assurance program, referred to as “competence program” throughout this
document. This guidance is applicable to onshore and offshore oil- and gas-related staff,
departments, and organizations.
2 What is Competence?
If you ask 100 people to define competence, you will get 100 different definitions. In this
section, we establish a baseline to ensure that everyone has the same understanding of
competence and that we are speaking the same language, so there is no confusion. In
this section, we define “competence,” discuss what competence is and is not, and
provide examples of competence.
2.1 Definitions
Key terms contained in this document and typically used in competence programs are
defined below.
Competence: An individual’s knowledge, skills, abilities, and behavioral attributes that
enable him or her to perform his or her work consistently, precisely, and reliably.
Note: Although the definition of Knowledge, Skills, and Abilities—often referred
to as KSAs—is not exactly the same as competencies, they serve the same
purpose and are often used interchangeably.
Revision 0
22 April 2015 3
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
Competence Standard: The set of competence elements that comprises the total
expectation of an individual in a specific role or position. It defines the expected level of
performance as determined by the organization.
Skill: An employee’s ability to perform the job tasks consistently, precisely, and reliably.
Skills can be assessed.
Revision 0
4 22 April 2015
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
Revision 0
22 April 2015 5
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
Examples
Competence:
3. Distinguish colors.
A crane operator is likely to be more successful and work more safely if he or she
has a mechanical aptitude and a healthy sense of responsibility (behavior); however,
it is difficult to measure his sense of responsibility.
Revision 0
6 22 April 2015
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
Program Development:
• Define framework
• Define competencies
• Define assessment Assessment Cycle:
process • Assess
• Identify & qualify • Identify gaps
assessors & verifiers • Provide feedback/
Program
• Implementation Development plan
Management
• Record results
• Verify
Quality
Assurance &
Continuous
Improvement
Revision 0
22 April 2015 7
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
These essential components may be further subdivided into other key components
typically included in a competence program. While not limited to these components, the
following components of competence are often included in a competence program:
• A commitment to the program by all stakeholders (i.e., a statement, standard, or
policy) (See Section 4)
• Personnel trained to support the program (See Sections 11.2 and 13 and Table 3)
• A competence framework that is defined and tailored to a company’s culture (See
Section 5)
• Assessment methodologies that are matched to specific elements of competency
(See Section 7.4)
• A plan and process for closing identified competence gaps (See Section 7.9)
• Confidentiality (See Section 8.4)
• A method of verifying the quality of a program (See Section 9)
• A process to ensure quality, continuous improvement, and management of changes
to a program (See Section 9, 10, and 11)
• Methods for demonstrating competence to third parties (See Section 14)
See Sections 5 and 15 for a list of resources, plans, and systems that are commonly
used to facilitate a competence program.
4 Commitment
In this section, we will briefly discuss the commitment required to successfully design,
implement, and sustain a program.
Revision 0
8 22 April 2015
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
5 Competence Framework
A competence framework is the way a company chooses to arrange or define their
program (e.g., around positions or a product line).
This section describes optional ways to set up a competency framework. Each company
should identify the competence framework to be used for their competence assurance
program based on the company’s operational structure. Below are examples of
competence program frameworks:
It is recommended that employers refer to the job titles for rig-based personnel identified
and defined in IADC’s KSA Database. By using the same job titles and core
competencies, the industry can better track and report on performance gaps,
recommend job standards, and determine and provide information on employment
trends and needs worldwide.
Revision 0
22 April 2015 9
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
6 Defining Competencies
The following information should be considered when defining competencies:
• Define competencies simply and clearly. Anyone reading the competency should be
able to easily identify what the competency is.
• Ensure the competency includes only a single task. Do not lump tasks together. The
competency should be stated in as few words as possible, and be at most a few lines
instead of a whole paragraph.
Revision 0
10 22 April 2015
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
Revision 0
22 April 2015 11
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
7 Assessing Competence
The purpose of this section is to introduce and describe the factors influencing the
competence assessment process.
This section outlines the qualification of assessors, how assessment content and
competence ratings are defined, assessment planning, methods of assessment,
documentation of assessment results, and management of assessment outcomes.
The following events usually indicate the need for an assessment to take place:
• Initial assessment/pre-assessment
Implementation of a competence program
New hire
• Change in role or responsibilities
Promotion
Transfer to new asset class or product line
• Change in:
Defined competencies
Equipment upgrades
Operating procedures
• Reassessment
Company specific reassessment timeframes (yearly, biannually, etc.)
Based on outcome of a risk assessment, safety case, occurrence of, or potential
occurrence of an incident, etc.
Other events may also prompt or suggest the need for a reassessment.
Revision 0
12 22 April 2015
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
Competence Assessor
Date
Rating Signature
Competency (Knowledge, Skill or Ability)
Demonstrate ability to dismantle and re-assemble SPM valve. 3 EJD 10-Oct-14
0 - No Knowledge
1 - Unsatisfactory
2 - Needs Improvement
3 - Meets Competency
4 - Exceeds Expectations
5 - Significantly Exceeds Expectations
Revision 0
22 April 2015 13
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
How an organization defines, assesses, and rates employee competence may have
legal as well as business implications.
Managers and employees may need to plan assessments in line with the business
needs and/or operations.
• Observation
• Questioning or interviewing
• Written exam
• Simulation
• Third-party testimony
• Examination of work product
Many alternative methods of assessment exist. Methods that produce the highest quality
evidence of competence should be selected. Once the most appropriate and effective
method of assessment is determined, the assessors should be trained to use this
method.
Revision 0
14 22 April 2015
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
Evidence of the assessment must be gathered that supports the assessment. Without
appropriate and adequate evidence of the assessment, the effectiveness of the
assessment, the reliability of the assessment process, the development of the employee,
and the overall success of the competence program within the organization are in
jeopardy.
In many cases, the completed tool becomes the supporting documentation or evidence
of the completed assessment, as is the case of the written assessment or the completed
checklist. Other examples of documented evidence supporting the assessment process
are certificates, employee reports, and customer or third-party feedback.
Effective assessor training in the procedures, use of the tools, and required
documentation (evidence of the assessment) may be required to assure results that are
current, authentic, valid, reliable, and verifiable outcomes. Development of a guidance
document that details the methodology and the use of the tool may be required to
support the assessor in performance of the assessments.
Assessors are responsible for carrying out the assessment and utilizing the above
referenced methodologies and tools. Assessors should have the following characteristics
and qualifications:
• Knowledge in the subject/tasks they are to assess
Revision 0
22 April 2015 15
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
Verifiers ensure that the assessment process is adhered to, proper assessment methods
are consistently being used, and records of assessments are properly completed and
retained. They should have knowledge of the assessment processes and procedures to
ensure that all are followed as outlined in the program.
Evidence of assessment decisions should be recorded and made available for review.
(See Section 8 Data and Information Management for guidance on managing
assessment records.)
Revision 0
16 22 April 2015
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
7.8.3 Appeal
An appeal gives the employee the opportunity to formally dispute the outcome of the
assessment. An appeal process should be formally documented, with clearly defined
criteria for the grounds on which an appeal will be submitted, reviewed, and
accepted/rejected. To ensure a fair decision is reached, all parties participating in the
appeals process must be committed to the same level of objectivity required in the
process of assessing the employee.
The process should include steps that establish the validity of the appeal, create visibility
for the response to the appeal, and document the outcome of the appeal process.
Assessment results, the decision, feedback, and appeal (where applicable) should be
documented in a recordkeeping system.
Revision 0
22 April 2015 17
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
The purpose of this section is to describe how data and information related to the
competence program is managed. This section outlines the general requirements for
data and information management.
Tracking the creation and revision of the documentation that supports the competence
program is important.
Revision 0
18 22 April 2015
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
The recordkeeping system should be equipped with (or linked to) a document
management system, which would help to ensure that the most recent version of each
document is available to those participating in the process.
8.3 Reporting
Reports should be developed within the recordkeeping system to:
These reports should be used to measure the effectiveness of the competence program.
The recordkeeping system may also contain data that is linked to proprietary business
information or intellectual property; therefore, confidentiality may be necessary for
helping to maintain the company’s competitive advantage. Examples may include
assessment content, company-specific policies, and standards or data related to identity,
compensation, or disciplinary actions, etc.
Revision 0
22 April 2015 19
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
The data management and recordkeeping system should contain the proper controls
necessary to manage and prevent unauthorized access to this data.
9 Quality Assurance
The purpose of this section is to introduce and describe how quality assurance (QA) is
incorporated within a competence program.
Revision 0
20 22 April 2015
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
of audits may include a global audit, service delivery audit, site self-assessment, and
manufacturing audits. Evidence of audits and audit findings should be recorded and
made available for review.
10.1 Validity
Construct validity—Relates to the assessment approach taken to validate the
competence required in the context of the work environment. Simply stated, it helps you
to determine if you are measuring what you intended to measure.
10.2 Verification
Verification is the process of monitoring and assuring consistent application of
assessment tools by assessors and quality of the assessment records.
An organization should define a verification process and identify who should serve as
the verifier.
10.3 Reliability
Competence assessment relies on assessors consistently applying the assessment and
documentation process. The work of the Verifier in monitoring consistency and quality of
the assessments helps establish the reliability of the assessment process.
Revision 0
22 April 2015 21
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
11 Implementation Plan
This section is intended to communicate and reinforce the importance of an
implementation plan in ensuring that you have a successful rollout of your competence
program. The information in this section includes elements that have proven to be
integral in a successful implementation.
11.1 Purpose
The implementation plan provides a framework that ensures the competence program is
rolled out effectively. It should include a clear statement of the program’s purpose, the
process for implementation, the roles of personnel who will be involved, and
communication of the expectations.
• Improve the effectiveness (time, money) to implement the program to relevant parts
of the organization.
• Improve comprehension and adoption of the program by employees who will be
using it.
• Increase consistency of the application of the policies and procedures resulting in the
desired outcome of the competence program.
Revision 0
22 22 April 2015
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
The following success factors or indicators of success should be present in the rollout of
the new Program to identify if the implementation is meeting the program expectations:
Revision 0
22 April 2015 23
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
12 Training Strategy
Competence programs should include training for all individuals who have key
responsibilities in the program (employees, assessors, managers, etc.). (See Table 3 for
a list of program roles.) Elements of the training strategy will include:
13 Support Personnel
Additional personnel need to be identified to design, implement, and sustain the
competency assurance program. Regardless of organizational construct, the following
functional responsibilities need to be addressed:
• Project leadership
• Subject matter experts
• Human resources
• Operations
• Information technology
• Communications/Marketing personnel
See Table 3 for a listing of key roles and responsibilities for the competence program.
Revision 0
24 22 April 2015
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
• Designs the program and defines the • Provides guidance to the • Leads the continuous improvement
Program Manager elements. implementation team. of Program.
• Creates the Program framework. • Maintains Program resource
capability.
• Works with Executive Sponsor / Senior
Management to determine the
competence program impact on
business performance.
• Leads the design stage of the program.
• Defines the roles & responsibilities
required to support the Program
Revision 0
22 April 2015 25
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
• Implements communication and roll out • Leads the implementation of the • Ensures actions taken on feedback
Implementation Team: plan, highlighting the benefits of the Program. so all learnings, positive and
(This may or may not be Program; prepares to hear and discuss negative, are captured and applied
concerns, in advance of full program • Works with managers on to improving and sustaining the
the same individuals that
implementation. developing and implementing program.
are on the Project
employee development plans.
Team/Steering
• Communicates with stakeholders (two- • Ensures lessons learned and best
Committee.) • Partners with Local
way); gains engagement, trust, and practices are being incorporated.
commitment. Implementation Lead, Champion.
• Provides feedback from a business and • Ensures the infrastructure exists • Identifies improvements.
Local Implementation application perspective. for deployment.
Lead / Champion: • Forwards feedback from the line
• Provides end-user training. managers and end users to the
The “expert” assigned to Steering Committee, Operations
implement the new • Provides ongoing technical Line, and other stakeholders.
Program support.
A representative sample • Reports on progress of the
of line managers and end- implementation.
users impacted by the
Program • Provides audit support.
• Assesses the rollout plan.
Revision 0
26 22 April 2015
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
• Provides subject matter expertise during • Serves as an assessor. • Provides feedback regarding
Subject Matter content definition and development. updates to content and continuous
Experts improvement.
• Develops and reviews competence
program. • Verifies and analyzes evaluation
results, checks for quality.
• Develops assessment tools.
• Develops audit criteria. • Assesses the rollout plan and • Performs quality audits.
Quality Department / identifying improvements.
Change Management • Manages program changes.
• Provides input to ensure program • Supports record keeping system • Tracks competency results.
Human Resources / complies with legal/regulatory during implementation.
Revision 0
22 April 2015 27
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
• Receives training on records verification • Ensures processes are being • Verifies the accuracy and validity of
Verifiers process. followed and records are being records.
managed in accordance with
• Develops checklist of records to be program processes and company • Reports findings of nonconformance.
verified. policy.
Revision 0
28 22 April 2015
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
In practice, the purpose of each demonstration differs depending on its timing. The
following are examples of how the purpose depends on the timing:
Revision 0
22 April 2015 29
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
It is important to recognize and respect that: (1) an employee's competence records are
confidential, and (2) competency statements and associated materials are the
intellectual property of the company.
14.2.1 Pre-Contract
This demonstration is likely to apply during the tendering process. The purpose is to
establish that the company has the workforce capability to satisfy the proposed
partnership requirements.
Examples of evidence that may be shown to demonstrate that there are processes in
place are as follows:
• Outline of the company’s documented commitment to training and
competency development
• Detailed description of the competence program
• Detailed description of the assessment process and assessor qualification
requirements
Revision 0
30 22 April 2015
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
Examples of evidence that may be shown to demonstrate that employees apply the
competency processes are as follows:
15 Bibliography/References
The following sources were either consulted in developing these guidelines or are
recommended as resources for developing a competence program:
Revision 0
22 April 2015 31
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
presented at the SPE Offshore Europe Oil and Gas Conference and Exhibition
held in Aberdeen, UK, 3–6 September 2013. http://dx.doi.org/10.2118/166638-
MS.
• Leuro, J. and Kruger, T. Demonstrating the Competence of the Workforce. Paper
IPTC-17353 to be presented at the International Petroleum Technology
Conference held in Doha, Qatar, 20–22 January 2014.
• Halliburton’s Management of Change Process.
• API Specification Q2. “Specification for Quality Management System
Requirements for Service Supply Organizations for the Petroleum and Natural
Gas Industries.” First Edition, December 2011.
• API RP 75. “Recommended Practice for Development of a Safety and
Environmental Management Program for Offshore Operations and Facilities.”
Third Edition, May 2004.
• City & Guilds. Guidance on Internal Quality Assurance Qualifications. 23 August
2012.
• ISO 9001:2008. Quality Management Systems – Requirements (Reference
number ISO/FDIS 9001:2008[E]).
• ISO 29001:2010. Petroleum, Petrochemical, and Natural Gas Industries – Sector-
specific quality management systems – Requirements for the product and service
supply organizations (Reference number ISO/TS 29001:2010[E]).
• ISO/DIS 10018. “Quality Management: Guidelines on People Involvement and
Competences.” ISO draft, November 2011.
• ISO 10018:2012[EN] definition of competence
• OPITO. Internal Verifier Training Standard (OPITO Standard Code: 9020).
• OPITO. Competence Assessor Training Standard (OPITO Standard Code: 9018).
• SQA. Unit L&D11 Internally Monitor and Maintain the Quality of Workplace
Assessment (Publication code: FD43 04).
• SQA. Internal Verification: A Guide for Centres offering SQA Qualifications
(Publication code: FA5291).
• SQA. Unit L&D12 Externally Monitor and Maintain the Quality of Workplace
Assessment (FD44 04).
• SQA. External Verification Guide for Centres (Publication code: FA5241).
• SQA. Handbook for NQ External Verifiers (Publication code: FA2063).
• ARC Scotland Training and Assessment Centre - SVQ Sampling Strategy.
• COGNET. Guidelines for Competency Management Systems for Downstream and
Petroleum Sites.
Revision 0
32 22 April 2015
International Association of Drilling Contractors
Competence Assurance—Guidelines for Building a Successful Program
NOTICE
This document was designed by the IADC Workforce Development Committee for the purpose
of providing members guidance in developing in-house competence programs.
This document is designed for the end user, with no intention for it to be used by those offering
fee-based consulting or other services related to the development of competence programs for
sale.
The information contained in this document is a compilation of research, members’ views, and
success and failures in implementation of in-house competence programs. The content
represents the views of IADC member companies who contributed to the content’s development
and is based in part on the success and failures in implementation of in-house competence
programs.
This document may be printed from the IADC Workforce Development Committee’s website at
http://www.iadc.org/workforce-development-committee.
Revision 0
22 April 2015 33
INTERNATIONAL ASSOCIATION
OF DRILLING CONTRACTORS
P.O. Box 4287
Houston, Texas 77210-4287
PHONE: +1.713.292.1945
FAX: +1.713.292.1946
E-MAIL: competence@iadc.org
WEBSITE: http://www.iadc.org