Module 10: Data Collection Methods

Tool 7: Expert Judgment

• Use of experts, one-on-one or as a panel
• E.g., Government task forces, Advisory Groups

• Can be structured or unstructured
• Issues in selecting experts

• IPDET © 2009

Selecting Experts

• IPDET © 2009

• Establish criteria for selecting experts not only on recognition as expert but also based on:
• areas of expertise
• diverse perspectives
• diverse political views
• diverse technical expertise

Advantages and Challenges of Expert Judgment

• IPDET © 2009

Advantages	Fast, relatively inexpensive
Challenges	Weak for impact evaluation May be based mostly on perceptions Value of data depends on how credible the experts are perceived to be

Tool 8: Delphi Technique

• IPDET © 2009

• Enables experts to engage remotely in a dialogue and reach consensus, often about priorities
• Experts asked specific questions; often rank choices
• Responses go to a central source, are summarized and fed back to the experts without attribution
• Experts can agree or argue with others’ comments
• Process may be iterative

Advantages and Challenges of Delphi Technique

• IPDET © 2009

Advantages	Allows participants to remain anonymous Is inexpensive Is free of social pressure, personality influence, and individual dominance Is conducive to independent thinking Allows sharing of information
Challenges	May not be representative Has tendency to eliminate extreme positions Requires skill in written communication Requires time and participant commitment