Q: Do you know of a document that articulates competencies/capabilities of an evaluator? If you do please send me a reference or copy.
A: Lots of work has been done on this topic by various Evaluation Associations across the world. Some useful references:
King, Jean, Stevahn, Laurie, Ghere, Gail, & Minnema, Jane (2001). Toward a taxonomy of essential evaluator competencies. American Journal of Evaluation, 22, 229-247.
Mertens, Donna M. (1994). Training evaluators: Unique skills and knowledge. New Directions for Program Evaluation, 62, 17-27.
Treasure Board of
Here is the list:
Essential Competencies for Program Evaluators (ECPE)
(Stevahn and King, Ghere, & Minnema, American Journal of Evaluation, March
2005)
1.0 Professional Practice
1.1 Applies professional evaluation standards
1.2 Acts ethically and strives for integrity and honesty in conducting evaluations
1.3 Conveys personal evaluation approaches and skills to potential clients
1.4 Respects clients, respondents, program participants, and other stakeholders
1.5 Considers the general and public welfare in evaluation practice
1.6 Contributes to the knowledge base of evaluation
2.0 Systematic Inquiry
2.1 Understands the knowledge base of evaluation (terms, concepts, theories, assumptions)
2.2 Knowledgeable about quantitative methods
2.3 Knowledgeable about qualitative methods
2.4 Knowledgeable about mixed methods
2.5 Conducts literature reviews
2.6 Specifies program theory
2.7 Frames evaluation questions
2.8 Develops evaluation designs
2.9 Identifies data sources
2.10 Collects data
2.11 Assesses validity of data
2.12 Assesses reliability of data
2.13 Analyzes data
2.14 Interprets data
2.15 Makes judgments
2.16 Develops recommendations
2.17 Provides rationales for decisions throughout the evaluation
2.18 Reports evaluation procedures and results
2.19 Notes strengths and limitations of the evaluation
2.20 Conducts meta-evaluations
3.0 Situational Analysis
3.1 Describes the program
3.2 Determines program evaluability
3.3 Identifies the interests of relevant stakeholders
3.4 Serves the information needs of intended users
3.5 Addresses conflicts
3.6 Examines the organizational context of the evaluation
3.7 Analyzes the political considerations relevant to the evaluation
3.8 Attends to issues of evaluation use
3.9 Attends to issues of organizational change
3.10 Respects the uniqueness of the evaluation site and client
3.11 Remains open to input from others
3.12 Modifies the study as needed
4.0 Project Management
4.1 Responds to requests for proposals
4.2 Negotiates with clients before the evaluation begins
4.3 Writes formal agreements
4.4 Communicates with clients throughout the evaluation process
4.5 Budgets an evaluation
4.6 Justifies cost given information needs
4.7 Identifies needed resources for evaluation, such as information, expertise, personnel, instruments
4.8 Uses appropriate technology
4.9 Supervises others involved in conducting the evaluation
4.10 Trains others involved in conducting the evaluation
4.11 Conducts the evaluation in a nondisruptive manner
4.12 Presents work in a timely manner
5.0 Reflective Practice
5.1 Aware of self as an evaluator (knowledge, skills, dispositions)
5.2 Reflects on personal evaluation practice (competencies and areas for growth)
5.3 Pursues professional development in evaluation
5.4 Pursues professional development in relevant content areas
5.5 Builds professional relationships to enhance evaluation practice
6.0 Interpersonal Competence
6.1 Uses written communication skills
6.2 Uses verbal/listening communication skills
6.3 Uses negotiation skills
6.4 Uses conflict resolution skills
6.5 Facilitates constructive interpersonal interaction (teamwork, group facilitation, processing)
6.6 Demonstrates cross-cultural competence
