Writing Outcome Summaries Jeff Ripley and Megan Wright Organizational Development Unit Improving Lives. Improving Texas. One / Two Page Summaries Tell the story of your outcome program Min. 3 per county (4-H, ANR, FCS) Should be copied and pasted into the TExAS system or uploaded as pdf Use with stakeholders (committees, participants, county commissioners, Midmgt, etc.) Are also important in moving up the career ladder. RELEVANCE RESPONSE RESULTS 1
Step 1 - Relevance/Issue Description Relevance reason the educational program was implemented. A short paragraph revealing the importance of the issue and how education can help fix it. Step 1 - Relevance/Issue Description One sentence on the importance of the topic to the county. This can include $ figures, number impacted, etc. Examples: The main agriculture income receipts in Eastland County are beef and forage production. According to DSHS,18% of Cochran County residents receive food stamps. Teen drivers have the highest crash risk of any age group. Per mile traveled they have the highest involvement rates in all types of crashes (National Highway Transportation Safety Agency, 2002) Step 1 - Relevance/Issue Description One sentence on the role education can play in addressing this issue. Examples: In order to increase profitability, it is important to educate our livestock and forage producers about current practices and technologies associated with these topics. Early detection education is an important way to reduce the impact of cancer. With limited resources of a small community/city it is important that Extension offers support and enrichment to students. 2
Step 1 - Relevance/Issue Description One sentence on where the issue was identified. Examples: The Eastland County Ag & Natural Resources Program Area Committee and subject matter specialist suggested that educating agricultural producers in Eastland County would help increase profitability in livestock and forage production. Young County citizens involved in the 2004Texas Community Futures Forum identified the need to promote tourism to increase the local economy. The trend of childhood obesity is realized as the percentage of young people who are overweight has more than doubled in the last 20 years. Step 2 Target Audience One or two sentences on the target audience. Some folks want to talk a little more about the target audience here. That is fine. You may want to provide some demographic information here as well. That is up to you. Examples: This program was targeted towards approximately 500 purebred and commercial beef cattle producers. This program targeted senior citizens with Type 2 diabetes at Pampa congregate meal sites in Wheeler County. The program was targeted to at risk and economically disadvantaged youth at the Vernon Boys and Girls Club. Relevance Example 3
Step 3 - Response Events / Activities One or two sentences that discusses the program that was developed. Then, you will want to list the activities that made up the program or a list of topics covered. You may also want to provide a brief narrative of each activity. Example: Texas Cooperative Extension in Eastland County developed the following activities to address this relevant issue: Eastland County Livestock Field Day (April, 2005) Multi county Forage Field Day (February, 2005) Heart of Texas Cow Calf Clinic (May, 2005) Brush Control Clinic (October, 2005) Pasture to Packer Program (year round) Step 4 Partnerships & Collaborators One sentence that discusses partnerships & collaborators with the program. Example: The Non-profit management Center of Wichita Falls spearheads the Teens Make A Difference Day which contributed greatly to the success of this youth outcome. OPTIONAL Response Example 4
Step 5 - Evaluation Strategy One sentence on the evaluation strategy. Example: An evaluation instrument (retrospective post approach) was utilized to measure knowledge gained and adoptions of best practices. One sentence on the response rate. Example: A total of 17 of 25 (68.0%) returned on the retrospective post instrument. Step 6 Results Bullet statements / tables revealing results. This is the tough part, but most important part of document. Here are a couple of points to keep in mind: Try to list most significant changes first List totals and percentages You don t have to include everything Step 6 Order of Results Behavior Knowledge Open-ended Demographics Satisfaction What s next 5
DATA ANALYSIS of NON SCAN SURVEYS Coding & Entering Quantitative Data 1-Code all surveys with a number upper right hand corner 1 Code Coding & Entering Data 2- Circle or highlight answer that needs to be placed into the database (in different color). 6
Coding & Entering Data 3-Place a numeric value for each statement. Coding & Entering Data 4-Enter data into a spreadsheet (one survey at a time). 7
Coding & Entering Data 5-Continue entering data until all surveys are entered. Setting up a spreadsheet like this allows me to run frequencies, percentages, means, etc. 8
EZ Analyze for Simple Statistics 9
10
Now What? EZ Analyze gives you some statistical data It is not complete, however Back to Excel to summarize Frequencies Percent Change INTERPRETING SCAN FORM RESULTS FOR SUMMARY Website Examples http://od.tamu.edu/accountability/tellingyour-story-interpreting-extensionprograms/interpretation-resources/ 11
Key Points You will get LOTS of data back from OD Choose the way to report that tells the best story Don t try to include too much information OVERLOAD Do not copy and paste the tables from OD into your report, customize your own tables and make them more attractive. Step 6 Results - Behavior Forty participants responded to the instrument (100% response rate) 36 of 40 respondents (90%) said they will reduce illicit use of pesticides in predator control. 20 of 40 respondents (50%) said they will definitely adopt non-lethal approaches. 12 of 40 respondents (30%) said they will definitely use foothold traps and snares. 8 of 40 respondents (20%) said they will definitely use aerial gunning and calling techniques. Step 6 Results - Knowledge 7 out of 15 (46.7%) said they understood proper spray conditions at a good or excellent level before the program 14 out of 15 (93%) said they understood proper spray conditions at a good or excellent level after the program. Percent Change = (percent after percent before) / percent before * 100 (93% - 46.7%) / 46.7% * 100 = 100% Fifteen participants noted a 100% increase in knowledge related to understanding spray conditions (7 of 15 before program vs. 14 of 15 after program). 12
Step 6 - Results (Tables) Topics Understanding of new herd cow/calf nutrition & health management strategies Understanding of new herd replacements and cattle breeding principles. Knowledge of mineral supplementation Understanding of strategies to control flies Knowledge of new strategies to control for weeds in pastures Before After Change % Change 2.42 3.69 1.27 52.48% 2.58 3.77 1.19 46.12% 2.58 3.69 1.11 43.02% 2.75 3.92 1.17 42.55% 2.75 3.77 1.02 37.09% Step 6 - Results (Tables) TITLE Table 1. Mean score differences using a Likert scale to reveal perceptual p knowledge concerning the Sample County Livestock Field Day increases using a retrospective post evaluation strategy. Step 6 - Results (Tables) TITLE Table 1. Perceived knowledge increase resulting from Sample County Livestock Field Day 13
Step 6 - Results (Open Ended Responses) Place all answers under the question Color code responses Ordering responses Summarize responses based on colored themes What is one thing you will go home and implement? Washing my hands Wash vegetables Cook hamburger meat thoroughly Rinse vegetables Sanitize hands Clean vegetables Don t cross contaminate meat with vegetables Cook ground beef to well done Wash hands completely Cook ground meat to at least 163 degrees What is one thing you will go home and implement? Washing my hands Wash vegetables Cook hamburger meat thoroughly Rinse vegetables Sanitize hands Clean vegetables Don t cross contaminate meat with vegetables Cook ground beef to well done Wash hands completely Cook ground meat to at least 163 degrees 14
Ordering Responses Sanitize and wash hands (Frequency 3) Clean and wash vegetables (Frequency 3) Cook ground beef thoroughly (Frequency 3) Don t cross contaminate meat with vegetables (Frequency 1) Results - Satisfaction 22 of 22 (100%) respondents stated they were mostly or completely satisfied with the information being easy to understand. 20 of 21 (95.24%) respondents stated they were mostly or completely satisfied with the helpfulness of the information in decisions about your own situation. 20 of 22 (90.91%) respondents stated they were mostly or completely satisfied with the timeliness of information. 19 of 22 (86.36%) respondents stated they were mostly or completely satisfied with the completeness of information given on each topic. Results - Other Pictures complete the story ADD THEM!!! Self testimonials Add a few if you have them 15
Results Example Summary of Results Summary sentence (or two) of results. Example: Results indicate that the Livestock & Forage Profitability Program in Sample County met its objectives of increasing knowledge of livestock producers. The greatest perceptual knowledge change was for the topics associated with the length of time to control brush, importance of timing of herbicide applications, not to over apply herbicide, conditions for proper herbicide spraying, and carriers of herbicide application. Acknowledgements Some folks like to list speakers that helped. They also like to show appreciation for groups and others that helped with the program. Example: Special thanks to the following experts for presenting at these activities: Dr. Larry Redmon, Dr. Ron Gill, Jay Harris, Shannon Thompson, Dr. Buddy Faries, Dr. Jason Cleere, Matt Brockman, Dr. Gerald Evers, and Dr. David Anderson. Additional thanks are due to the developers of the Youth County Government Curriculum and the resources they provided, and to Miami Independent School District for their cooperation and assistance in promoting and implementing this program. 16
Acknowledgements Don t forget!!! Send this summary to the people that supported the program!!! Future Program Actions Add one sentence on how these results will be beneficial in the future. Based on the results of this program and feedback from participants, the PAC will continue to plan and provide activities iti around this issue Examples Using New Templates Single Program OR Issue Based Annual Reports vs. Outcome Summaries 17
Outcome Summaries 18
19
County Annual Reports 20
21
22
23
Uploading PDF to TExAS 24
25
Summary Write toward the Three R s!!! Impact statements are what makes us accountable. Excellent programs are not excellent if no one knows about them Let us help Call or e-mail with questions or needs. 26