Description
Chapter 1: The Essence of Outcome Evaluation Introduction Objectives of this Book Types of Human Service Evaluation Outcome Evaluation Other Types of Human Service Evaluation. The evaluation of human need. The evaluation of service quantity. The evaluation of service quality. The evaluation of service efficiency. The Four Main Purposes of Human Service Research. The Evaluation of Service The Description of People. The Explanation of Things. The Exploration of the Unknown. The Process of Outcome Research. Step One: Develop the Research Question and Study Purpose. Step Two: Develop a Knowledge Base for the Study Step Three: Design the Evaluation Study Step Four: Collect and Analyze Data Step Five: Draw Conclusions Step Six: Describe the Service that Was Evaluated Don’t Put the Cart Before the Horse! Evidence-based Practice as a Guide This Book Chapter Summary Chapter Test Chapter References Chapter 2: Developing Your Knowledge Base Introduction. Chapter Objectives. Steps in the Process of Developing Your Knowledge Base. Step 1 Presenting the Scope of Your Literature Review. Step 2: Finding Your Sources. Step 3: Reviewing Your Sources. Levels of Evidence. Step 4: Writing Your Literature Review. Chapter Summary. Chapter Test. References. Chapter 3: Developing the Methods for Your Outcome Study. Introduction. Chapter Objectives. Selecting Your Study Sample and Generalizing Your Findings. Types of Samples. Sampling Error. Two Ways to Generalize Your Study Results. Measuring Your Study Variables. Defining Your Study Variables. Qualitative and Quantitative Forms of Measurement. Reliability and Validity in the Measurement of Psychosocial Variables. Finding a Published Scale. Designing Your own Survey Tool. Determining Your Research Design. Causes of the Clients’ Measured Growth. Group Research Designs. One group pretest-posttest design. Comparison group design. Exhibit 3.5: Selected group designs Alternative treatment design. Single-subject Research Designs. Single-subject Designs that Fail to Control for Maturation. Single-subject Designs that Control for Maturation. Composing Your Study Hypothesis. Chapter Summary. Chapter Test. Chapter References. Chapter 4: Collecting and Analyzing Your Data. Introduction. Chapter Objectives. Collecting Data. Collecting Data from Human Subjects in an Ethical Manner. Recording Your Data. Developing Your Data Plan Selecting the Statistic for Your Outcome Study. Preliminary Steps for Testing Your Study Hypothesis The Six Data Situations for Evaluative Research. Data Situations that Do not Fit Selecting a Statistic for Describing Clients Common Descriptive Statistics when Data Are Recorded Numerically. Common Descriptive Statistics for Categorical Data. Selecting a Statistic for Explaining Client Gain. Analyzing Your Data. Reporting Your Results. Chapter Summary. Chapter Test. References. Chapter 5: Using the Internet to Analyze Your Outcome Data. Introduction. Objectives. Preliminary Steps. Organizing Your Data The Six Data Situations for Outcome Evaluation Research Comparing Matched Pretest and Posttest Scores Example Steps in the Process of Comparing Matched Scores Comparing a Single Score to a Set of Scores Example Steps in the Process of Comparing a Set of Scores to a Single Score Comparing the Gain Scores of Two Groups Example Steps in Comparing a Set of Scores for Two Groups Comparing Two Groups on the Basis of a Dichotomous Variable. Example Comparing Multiple Treatment Scores to a Single Baseline Score for a Single Client. Example. Steps in the Comparison of Multiple Scores to a Single Scores Comparing Multiple Treatment Scores to Multiple Baseline Scores for a Single Client Example. Steps in Comparing Multiple Treatment Scores to Multiple Baseline Scores for a Single Client. Chapter Summary Practice Assignment. Chapter 6: Using SPSS to Analyze Your Outcome Data. Introduction. Chapter Objectives. Preliminary Steps. Organizing Your Data Selecting Your Data Situation. Comparing Matched Pretest and Posttest Scores Example Comparing a Single Score to a Set of Scores for One Group of Clients Example Steps in the Comparison of a Set of Scores to a Single Score. Comparing the Gain Scores of Two Groups Example Comparing Two Groups on the Basis of a Dichotomous Variable. Example Steps in the Comparison of Two Groups on the Basis of a Dichotomous Variable. Comparing Multiple Treatment Scores to a Single Baseline Score for a Single Client. Example. Steps in the Comparison of Multiple Scores to a Single Scores Comparing Multiple Treatment Scores to Multiple Baseline Scores for a Single Client Example Steps in the Comparison of Multiple Treatment Scores to Multiple Baseline Scores for One Client Chapter Summary Chapter Assignment Chapter 7: Using Special Excel Files to Analyze Your Outcome Data. Introduction. Chapter Objectives. Preliminary Steps. Organizing Your Data Selecting Your Data Situation Comparing Matched Pretest and Posttest Scores Example Steps in Comparing Matched Scores Comparing a Set of Scores to a Single Score for a Group of Clients Example Steps in Comparing a Set of Scores to a Single Score. Comparing the Gain Scores of Two Groups Example Steps in Comparing a Set of Scores for Two Groups Comparing Two Groups on the Basis of a Dichotomous Variable. Example Steps in the Comparison of Two Groups on the Basis of a Dichotomous Variable. Comparing Multiple Treatment Scores to a Single Baseline Score for One Client. Example. Steps in the Comparison of Multiple Scores to a Single Score. Comparing Multiple Treatment Scores to Multiple Baseline Scores for One Client. Example. Steps in the Comparison of Multiple Scores to a Single Score. Chapter Summary Practice Assignment Chapter 8: Describing Clients Introduction. Chapter Objectives. The Process of Describing Clients. Step 1: Determining the Purpose of Your Study. Step 2: Selecting a Study Sample. Step 3: Deciding What to Describe Step 4: Collecting Data Step 5: Selecting a Descriptive Statistic for Each Variable Analyzing Descriptive Data Using the Internet to Analyze Descriptive Data. Reporting the Results of the Descriptive Study. Chapter Summary Chapter Test. References Chapter 9: Explaining Client Outcome Introduction Objectives The Issue of Causation The Steps in the Explanatory Research Process. Step 1: Determining the Purpose, Knowledge Base, Research Question. Step 2: Developing Your Explanatory Research Hypothesis. Step 3: Collecting and Recording Your Data. Step 4: Analyzing Your Data Step 5: Reporting Your Results Analyzing Your Explanatory Data. Data Situations Previously Addressed in this Book. Additional Data Situations for Explanatory Research. Data Situation A: Using the Correlation Coefficient to Examine the Relationship Between Two Interval Variables. Data Situation B: Using ANOVA when You Are Comparing the Scores of Several Groups. Reporting the Results of Your Data Using ANOVA. Chapter Summary Chapter Test Chapter References Chapter 10: Getting Ideas on How to Improve Service Using Qualitative Surveys. Introduction. Chapter Objectives. Qualitative and Quantitative Measurement The Social Survey Steps in the Process of Conducting a Social Survey. Step 1: Determine the Purpose of the Survey. Step 2: Select Your Study Sample. Step 3: Design Your Measurement Tool. Step 4: Administer the Survey Step 5: Analyze Data Step 6: Draw Conclusions One Model for Content Analysis of Qualitative Data. Step 1: First Level Coding Step 2: Credibility Assessment of First Level Codes Step 3: Second Level Coding Step 4: Enumeration of Second Level Codes. Other Steps Drawing Conclusions. An Exercise in the Content Analysis of Qualitative Data Description of the Study The 2019 Cohort The 2022 Cohort Tasks in the Content Analysis of These Data Chapter Summary. Chapter Test. Chapter 11: Writing Your Research Report. Introduction. Chapter Objectives. Reporting the Purpose of Your Study and the Knowledge Base. Reporting Your Study Purpose and Research Question. Reporting Your Knowledge Base. Reporting Your Study Methods Reporting Your Study Sample. Describing Your Measurement Tools. Stating Your Study Hypothesis. Reporting Your Research Design. Reporting Your Results and Conclusions. Describing the Service Being Evaluated. Describing the Objectives of the Service. Describing the Structure of the Service. Describing the Personnel of the Service. Describing the Model of the Service. Summary of the Description of the Service Chapter Summary Chapter Test Chapter References. Chapter 12: Facing the Challenges of Outcome Evaluation Chapter Introduction Chapter Objectives How Can We Justify the Resources Expended for the Service? Is Our Knowledge Base Sufficient to Build Our Outcome Study? Can We Generalize Our Findings on a Logical Basis? Does Our Measurement Tool Pass the Test of Face Validity? Do We Know that Our Service Was Delivered According to Promise? Does Our Research Design Have to Control for Normal Growth over Time? Why Should We Be Concerned with Statistical Significance? How Do We Know if We Have Practical Significance? Are Our Conclusions Consistent with Our Data? Did We Put the Cart Before the Horse? Chapter Summary Chapter Test. Chapter References. Appendix: Inventory of Critical Research Concepts
