Instructions for Using the CW Pre/Post Template These instructions will walk you through the process of submitting your Collaborative Work pre/post-tests and satisfaction surveys using the Excel template provided. These instructions are also available as a tutorial video, which is accessible at http://www.youtube.com/watch?v=kalp09zpdf0&fmt=22. 1. Administer the appropriate pre-test for your training topic, being sure to use the revised pre-test from January 2014. 2. Administer the training, noting the date, location, number of participants, and districts/buildings attending. 3. Administer the appropriate post-test for your training topic, being sure to use the revised post-test from January 2014, and also administer the satisfaction survey. The satisfaction survey is the same regardless of training topic. 4. After the training, you should have three stacks of paper: the pre-tests, the post-tests, and the satisfaction surveys. You should also have an answer key for the pre/post-tests.
5. Use the answer key to score each pre/post-test. Each person has their own unique style of marking tests, but one common way to score tests is to put a large X through questions with incorrect answers. Regardless of what marking strategy you choose, make sure that it is easy to identify questions as correct or incorrect with minimal effort. 6. Once you have scored the pre/post-tests, go through each of the three stacks (pre-tests, post-tests, and satisfaction surveys) and number each sheet in the upper right hand corner. By numbering the sheets in each stack, you can easily make sure you are on-track during data entry and you haven t skipped any sheets during your work.
7. Once the pre/post-tests are scored and numbered, open the template in Excel. 8. Before you begin entering data, you probably want to save the template under a different filename so that you don t overwrite your blank version. Click File, then Save As, choose an appropriate location to save your data, and give the workbook an appropriate file name. A good naming convention is your last name, the training topic, and the training date (e.g. Brussow CFA 1-22-14.xlsx). 9. Step 1 is to choose the worksheet corresponding to the appropriate training topic from the tabs at the bottom of the workbook.
a. If you cannot see the worksheet tabs, you may need to change your view settings in Excel. In Excel 2010 or 2013, this can be accomplished by choosing File, then Options, then the Advanced section. In this window, make sure the Show sheet tabs option is checked. b. If you are using an older version of excel, use Google to look up show sheet tabs in Excel, followed by the version you are using (e.g. show sheet tabs in Excel 2007 ), 10. Once you have chosen the appropriate training topic, you will notice that the questions and answers in the worksheet correspond to the questions and answers on the paper version. The Excel template matches the pre/post questions on the January 2014 revisions. If your questions and answers do not align to the worksheet, you are likely using an outdated version of the pre/post-test. Please switch to the revised versions immediately.
11. Before you begin to enter data, notice this template only includes spaces for 30 responses. If you have more than 30 responses to record, you will need to add rows in Excel. You will want to add these rows in the middle of the sheet in order to preserve the formatting and formulas. a. You can do this by selecting the number of rows you need to insert. For example, if you have 35 respondents, select five rows in the middle of the sheet. Right click anywhere within your selection and select insert from the drop down menu.
b. Inserting rows will affect the numbering that helps you keep track of where you are in your stack of responses, so you will need to redo that numbering, as well. One easy way to do this is to use Excel s autofill function. i. Select at least two rows from the space ABOVE where you inserted the new rows. ii. Place your cursor over the black square in the bottom left corner of your selection until a black crosshairs appear.
iii. You can then drag the selection down which will correctly update the numbers in the respondent column. 12. Once you have enough rows to enter in all of your pre/post-tests and surveys, you can begin filling out the template. Along the left side of the Excel sheet, you can see that there are fields to enter demographic data. Please enter: a. The presenter s name (that s you!), b. The date of the training, c. The location of the training, d. The number of participants at the training, and e. The districts and buildings attending. If there are multiple buildings attending from one district, please leave the appropriate amount of space in the district column before inputting the next district. f. You may also enter other information you wish to share, such as additions to the learning package, specific activities you did, or candid observations of how the training went. 13. Now that you have entered the demographic data about the training, it s time to turn to your stack of scored pre-tests. As you can see, the instructions for this template ask you to enter a 1 for each correct response and a 0 for each incorrect response.
a. You will notice that the entry rows are labeled Repondent 1, Respondent 2, Respondent 3, and so on. These numbers should correspond to the numbering you did in the upper right-hand corner of each sheet after scoring the tests. Refer to these numbers throughout the data entry process to make sure you have not skipped any records. b. For each pre-test, enter the participant s district and school from the top of the test. Then, code the responses as 1 or 0 to indicate whether the respondent answered correctly.
c. Repeat this step for as many pre-tests as you have. This template only includes spaces for 30 responses; if you need more, you can add rows in Excel. 14. Once you have processed all the pre-tests, repeat the process for the post-tests. Be sure to enter each respondent s district and school for this step, as well it is very unlikely that your participants turned in their sheets in the same order for both the pre- and the post-test! 15. Once all the pre- and post-test data has been entered, the template will automatically graph your results below your data. For each question, you can view the pre-test average, the post-test average, and the difference between these averages. This information can help you gauge how effective your training was and determine areas of strength and need for your trainees.
16. Once you have entered the pre- and post-test data, you also need to enter the data from the satisfaction survey. a. You will notice that the satisfaction survey contains seven quantitative questions and three open-ended questions. This template only asks for the data from the first seven items, though you should certainly consider any feedback given in the open-ended responses. b. For this section, the instructions are slightly different. For each item, you will need to code the response as you enter it into the template. As the instructions say, 1 = Strongly Disagree, 2 = Disagree, 3 = Neutral, 4 = Agree, and 5 = Strongly Agree. c. For each sheet, enter the participant s district and school, just like you did for the pre- and post-tests. d. Then, enter the appropriate value for each item using the coding given in the instructions. For example, this respondent indicated that she strongly agrees with the first item, so you would enter a 5. On the next item, she has selected Agree, so you would enter a 4. e. Continue entering data until you have entered all responses.
f. As with the pre/post-tests, this data will automatically graph for you at the bottom of the template. This graph displays the percentage of respondents answering Agree or Strongly Agree on each question remember, that means you would have entered a 4 or a 5 for their responses. 17. You are now done entering data, and you have gotten an idea of how effective your presentation was from the pre/post-test scores and how satisfied participants were from their satisfaction survey scores. Now, you just need to submit your data. To submit data, locate your saved file (remember, you saved this version in a different place in order to preserve your blank template), then e-mail that file to researchcollab@ku.edu. Your submission will be checked within 72 hours of receipt, and we will let you know if there are any problems or missing data. 18. Thank you for using the template! Remember, you can also use the training registration and pre/post-testing system at www.mospdgdata.org. If you have any problems with data entry using this template, please contact Jennifer Brussow at jbrussow@ku.edu.