Table of contents:
Ch 1: Introduction
The Importance of Program Evaluation
What is a Program?
Characteristics of \”Good\” Programs
Program Evaluation Defined
Reasons Why Programs are Evaluated
Motivations for Program Evaluation
Overcoming the Subjective Perspective
Philosophical Assumptions of Program Evaluation
More on Positivism
Ch 2: Ethical Issues in Program Evaluation
The Role of Institutional Review Boards (IRBS)
How Ethical Guidelines Get Operationalized
Research with Special Populations
Ethical Issues Pertaining to Diverse Cultures and Groups
Ethical Boundaries in Participatory and Action Research
The Practitioner-Evaluator\’s Ethical Responsibilities
Concluding Thoughts on Ethics and Evaluation
Ch 3: Needs Assessment
Types of Needs Assessment
How Does a Needs Assessment Start?
What are the Steps Involved in Conducting a Needs Assessment?
How Do I Select a Needs Assessment Approach?
What Do I Need to Know about Surveys?
Special Considerations: Converging the Data
Thinking Creatively about Needs Assessment
What is a Community Readiness Study?
Ch 4: Qualitative and Mixed Methods in Evaluation
What is \”Qualitative Evaluation\”?
What is \”Mixed Methods Evaluation\”?
When is Qualitative Evaluation Useful? When is Mixed Methods Evaluation the Right Choice?
Qualitative Methods and Evaluation of Practitioners in Situ
Qualitative Methods Commonly Used in Evaluation Research
Designing a Mixed Methods Evaluation
Managing and Organizing Qualitative Data
Mixed Methods Data Analysis and Integration
Writing the Report
Dissemination and Advocacy
Examples of Qualitative Evaluations
Ch 5: What are Formative and Process Evaluation?
How Do I Develop a Logic Model?
A Realistic Scenario
Conducting a Formative Evaluation
What is Process Evaluation?
Process Evaluation: Program Description Function
Process Evaluation: Program Monitoring
Becoming a Program Monitor
Mission Statements, Goals, and Objectives
Writing Program Objectives
What Should Be Monitored?
Total Quality Management
Ch 6: Single System Research Designs
What are Single System Research Designs?
Selecting Outcome Measures
Assessing Measures over Time
Notation and General Principles
Quality Assurance Studies
Summative Evaluation Designs
Summative Experimental Designs
How to Prepare Graphs
Ethics of Single System Research Designs
How to Critically Review a SSRD
Ch 7: Client Satisfaction
The Importance of Monitoring Consumer Satisfaction
The Arguments for Client Satisfaction Studies
The Problem with Client Satisfaction Studies
A Sampling of Recent Client Satisfaction Studies
How Do Consistently High Ratings Get Explained?
Recommendations for Client Satisfaction Studies
Ch 8: Sampling
What are Nonprobability Sampling Designs?
What is Probability (Scientific) Sampling?
Considerations in Selecting a Sample
How Big Should the Sample Be?
Ch 9: Group Research Designs
What are Group Research Designs?
Starting an Outcome Evaluation
Outcome Evaluation Designs
General Principles of Group Research Designs
Pre-Experimental Research Designs
Quasi-Experimental Research Designs
Some Threats to Internal Validity
Protection against Alternative Explanations
Efficacy and Effectiveness Studies
What about Negative Outcome Studies?
A Note about the Term Experiment
Some Newer Developments in Experimental Program Evaluation
Ch 10: Cost-Effectiveness and Cost Analysis
Why Consider Cost as an Evaluative Criterion?
Example of a Cost-Effectiveness Evaluation
How Do I Begin a Cost-Effectiveness Study?
Whose Point of View?
Ch 11: Measurement Tools and Strategies
Why is Good Measurement So Important to Evaluation?
What Should We Measure?
What Do I Need to Know about Reliability?
What Do I Need to Know about Validity?
How Do I Find an Instrument for My Evaluation Project?
How Does One Construct a \”Good\” Evaluation Instrument? What Do I Need to Know about Questionnaire De
What are Some of the Commons Errors Made in Developing Questionnaires?
What Do I Need to Know about Levels of Measurement in Designing Instruments?
Ch 12: Selecting the Best Evaluation Measure for Your Project
Checklist for Selecting Evaluation Instruments
Clinical Anxiety Scale
Evaluation Self-Efficacy Scale
The Community Attitudes toward Sex Offenders (CATSO) Scale
Intimate Violence Responsibility Scale (IVRS)
The School Support Scale
Ch 13: Pragmatic Issues
What is Treatment Fidelity and Why is It So Important?
Program Drift and the Transfer of Programs
How Might Political Issues Affect a Program Evaluation?
The \”Threat\” of Evaluation
Guidelines for Evaluation in Politically Charged Arenas
Internal and External Evaluators
Culturally Sensitive Evaluation Practice
Ch 14: Writing Evaluation Proposals, Reports, and Journal Articles
Components of the Evaluation Proposal and Report
Considerations in Planning and Writing Evaluation Reports and Manuscripts
Common Mistakes Made by Students in Writing Evaluation Reports
Checklist for Writing and Assessing Evaluation Reports
The Utilization of Evaluation Reports
Writing for Professional Publication