Benchmarking Instruction in the Research University Tools and Techniques to keep a focus on teaching in a performance-driven research environment Bryan C. Harvey Associate Provost for Planning and Assessment Marilyn H. Blaustein Director of Institutional Research Martha L. A. tassen Director of Assessment
Change in Tenure ystem Faculty and FTE tudents, Fall 1989-2004 1,200 25,000 1,150 24,000 23,000 1,100 22,000 1,050 21,000 Faculty 1,000 950 Faculty 20,000 19,000 FTE tudents 18,000 900 17,000 850 16,000 800 1989 1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 15,000
Change in Tenure ystem Faculty and FTE tudents, Fall 1989-2004 1,200 25,000 1,150 24,000 23,000 1,100 FTE tudents 22,000 1,050 21,000 Faculty 1,000 950 Faculty 20,000 19,000 18,000 FTE tudents 900 17,000 850 16,000 800 1989 1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 15,000
Change in Tenure ystem Faculty and tudent Credit Hours by College, 1996-2004 30% 20% 10% 0% -10% -20% NUR OM EDU B PUB ENG NM Campus NRE HFA Faculty tudents -30%
Change in Tenure ystem Faculty and tudent Credit Hours by College, 1996-2004 30% 20% 10% 0% -10% -20% NUR OM EDU B PUB ENG NM Campus NRE HFA Faculty tudents -30%
Amherst 250 Plan Net increase of 250 tenure system faculty in 5 years Winners Only Transparent and consultative process Question: How to allocate positions? Obvious pressure for research Also obvious instructional needs On research side, elaborate benchmarking effort launched How to benchmark teaching?
Designing the Tool Differentiate between instructional capacity and instructional quality Process of informed judgment Given available resources, identify most urgent and obvious needs Departmental level Focus on current needs, not past glory External reference, multiple measures
Projected CH Demand 2005-06 Afro-American tudies 1,839 Art 5,440 Classics 3,495 English 8,356 History 8,634 Judaic and Near Eastern tudies 1,680 Languages, Literatures and Cultures 19,377 Linguistics 2,260 Music and Dance 5,831 Philosophy 4,945 Theater 2,213 Women's tudies 1,565 HFA Total 65,635 Astronomy 3,359 Biochemistry and Molecular Biology 1,667 Biology 9,131 Chemistry 8,505 Computer cience 5,678 Geosciences 4,764 Mathematics and tatistics 16,629 Physics 6,189 Polymer cience and Engineering 582 NM Total 56,504 Anthropology 5,148 Communication 11,146 Economics 9,964 Labor tudies 726 Legal tudies 2,907 Political cience 7,556 Psychology 15,091 Public Policy and Administration 26 ocial Thought and Political Economy 96 ociology 10,893 B Total 63,553
INTRUCTIONAL CAPACITY Projected CH Demand 2005-06 Total Capacity Net urplus/ (Deficit) Percent of Capacity PRODUCTIVITY CH/FAC FTE (UMA vs. R1 Norm) T/TT NTT Afro-American tudies 1,839 Art 5,440 Classics 3,495 English 8,356 History 8,634 Judaic and Near Eastern tudies 1,680 Languages, Literatures and Cultures 19,377 Linguistics 2,260 Music and Dance 5,831 Philosophy 4,945 Theater 2,213 Women's tudies 1,565 HFA Total 65,635 2,429 5,669 2,238 8,735 9,639 2,433 18,289 2,400 6,167 4,116 2,521 1,817 66,455 590 24% 229 4% (1,257) -56% 379 4% 1,005 10% 753 31% (1,088) -6% 140 6% 336 5% (829) -20% 308 12% 252 14% 820 96% 42% 78% 155% 170% 56% 109% 79% 97% 104% 61% 75% 120% 114% 109% 37% 111% 65% 123% 379% 88% 63% 93% 82% Astronomy 3,359 Biochemistry and Molecular Biology 1,667 Biology 9,131 Chemistry 8,505 Computer cience 5,678 Geosciences 4,764 Mathematics and tatistics 16,629 Physics 6,189 Polymer cience and Engineering 582 NM Total 56,504 3,519 2,278 11,324 13,682 7,574 6,929 18,841 6,186 1,490 71,824 160 5% 611 27% 2,193 19% 5,177 38% 1,896 25% 2,165 31% 2,212 12% (3) 0% 908 61% 15,320 83% 421% 80% 428% 67% 113% 43% 77% 63% 194% 52% 34% 107% 65% 99% 41% 43% 9% Anthropology 5,148 Communication 11,146 Economics 9,964 Labor tudies 726 Legal tudies 2,907 Political cience 7,556 Psychology 15,091 Public Policy and Administration 26 ocial Thought and Political Economy 96 ociology 10,893 B Total 63,553 5,070 9,041 9,163 992 3,744 6,904 20,558 58 374 8,140 64,044 (78) -2% (2,105) -23% (801) -9% 266 27% 837 22% (652) -9% 5,467 27% 32 55% 278 74% (2,753) -34% 491 97% 365% 135% 106% 93% 134% 61% 51% 99% 65% 94% 318% 72% 77% 0% 31% 0% 36% 147% 63%
MAJOR LOAD Headount Percent Majors Majors per of Campus Fall 2004 T/TT FAC Mean Afro-American tudies Art Classics English History Judaic and Near Eastern tudies Languages, Literatures and Cultures Linguistics Music and Dance Philosophy Theater Women's tudies HFA Total Astronomy Biochemistry and Molecular Biology Biology Chemistry Computer cience Geosciences Mathematics and tatistics Physics Polymer cience and Engineering NM Total Anthropology Communication Economics Labor tudies Legal tudies Political cience Psychology Public Policy and Administration ocial Thought and Political Economy ociology B Total 58 7.7 36% 346 15.1 70% 82 11.7 54% 971 27.7 128% 528 19.2 89% 20 3.3 15% 523 13.2 61% 96 8.3 39% 280 14.7 68% 139 13.2 61% 206 22.9 106% 31 7.0 33% 3,280 16.4 76% 88 6.8 31% 216 19.6 91% 909 34.3 158% 252 12.2 56% 565 17.0 78% 135 6.9 32% 356 9.2 43% 185 7.1 33% 93 7.3 34% 2,799 13.9 64% 215 14.1 65% 1183 49.1 226% 567 27.3 126% 32 10.7 49% 390 66.1 305% 703 35.2 162% 1240 32.5 150% 41 134 705 32.9 152% 5,210 35.0 162%
Afro-American tudies Art Classics English History Judaic and Near Eastern tudies Languages, Literatures and Cultures Linguistics Music and Dance Philosophy Theater Women's tudies HFA Total Astronomy Biochemistry and Molecular Biology Biology Chemistry Computer cience Geosciences Mathematics and tatistics Physics Polymer cience and Engineering NM Total Anthropology Communication Economics Labor tudies Legal tudies Political cience Psychology Public Policy and Administration ocial Thought and Political Economy ociology B Total CLA IZE Instr. in Classes ³100 CH/OC as % of R1 Lower Upper Lower Upper Division Division Division Division 40% 0% 83% 93% 40% 0% 34% 26% 77% 0% 155% 69% 16% 15% 121% 107% 59% 10% 114% 95% 0% 0% 30% 59% 16% 9% 115% 105% 37% 0% 102% 153% 50% 0% 59% 48% 71% 0% 192% 102% 60% 0% 103% 84% 67% 0% 112% 97% 39% 7% 95% 0% 77% 83% 100% 27% 105% 75% 90% 9% 90% 64% 86% 0% 81% 28% 47% 0% 68% 62% 91% 0% 84% 56% 59% 0% 128% 101% 82% 0% 23% 74% 0% 223% 77% 4% 79% 0% 88% 77% 85% 22% 180% 85% 84% 6% 83% 104% 45% 0% 111% 9% 79% 0% 56% 74% 61% 0% 92% 107% 84% 70% 93% 167% 0% 82% 12% 147% 92% 79% 31% CLA AVAILABILITY Percent of eniors Dissatisfied Rank * * 29.5% 7 7.1% 31 40.0% 3 15.0% 17 0.0% 45 24.3% 9 * * 6.3% 36 10.5% 22 36.7% 5 7.1% 31 0.0% 45 3.0% 40 36.6% 6 0.0% 45 18.8% 13 6.7% 34 17.9% 14 0.0% 45 NA NA 27.9% 8 38.3% 4 50.7% 1 NA NA 15.0% 16 21.4% 12 23.1% 10 NA NA 9.5% 24 22.0% 11
UNDERGRADUATE DEMAND 2005 Applications 2004 ACE urvey UGrad Degrees Percent Rank Percent Rank Percent Rank Afro-American tudies Art Classics English History Judaic and Near Eastern tudies Languages, Literatures and Cultures Linguistics Music and Dance Philosophy Theater Women's tudies HFA Total Astronomy Biochemistry and Molecular Biology Biology Chemistry Computer cience Geosciences Mathematics and tatistics Physics Polymer cience and Engineering NM Total Anthropology Communication Economics Labor tudies Legal tudies Political cience Psychology Public Policy and Administration ocial Thought and Political Economy ociology B Total 0.0% 44 0.1% 38 0.0% 50 2.6% 12 1.8% 14 2.2% 17 0.2% 38 1.0% 21 0.3% 45 3.1% 9 3.7% 8 4.7% 5 2.3% 13 2.1% 12 3.1% 10 0.2% 36 0.1% 39 0.1% 49 1.5% 16 3.0% 11 2.3% 14 0.3% 33 1.0% 22 0.4% 44 2.8% 10 2.0% 13 1.1% 32 0.4% 32 0.4% 36 0.6% 38 1.3% 19 1.2% 19 1.1% 30 0.1% 43 0.0% 42 0.3% 45 0.3% 34 0.7% 27 0.2% 47 2.1% 14 1.2% 20 1.2% 28 8.1% 3 4.6% 7 3.1% 9 1.0% 22 0.9% 24 0.5% 43 2.7% 11 1.4% 15 2.2% 15 0.1% 39 0.1% 40 0.6% 40 1.0% 24 1.4% 16 1.0% 33 0.7% 26 0.9% 25 0.7% 36 0.5% 29 0.5% 31 1.1% 30 7.1% 5 6.9% 4 9.1% 1 1.0% 21 0.7% 28 4.8% 4 1.2% 20 1.0% 23 2.3% 13 4.2% 7 4.8% 6 3.9% 6 7.2% 4 8.6% 3 8.8% 2 0.3% 35 0.7% 36 1.4% 18 1.3% 18 6.2% 3
Instructional Deficit/urplus Humanities and Fine Arts Afro-American tudies Art Classics English History Judaic and Near Eastern tudies Languages, Literatures and Cultures Linguistics Music and Dance Philosophy Theater Women's tudies Tenure Track Issue Majors Load Class ize (LD) Class ize (UD) Class Availability * * UGrad Demand Natural ciences and Mathematics Astronomy Biochemistry and Molecular Biology Biology Chemistry Computer cience Geosciences Mathematics and tatistics Physics Polymer cience and Engineering ocial and Behavioral ciences Anthropology Communication Economics Labor tudies Legal tudies Political cience Psychology ociology Highest deficit (³10% of total capacity) More modest deficit (<10% of capacity) Capacity between 90% and 100% of norm Greatest difference from norm (red on Table 1) More modest difference from norm (pink on Table 1) Near norm
Group Capacity TT Need Majors 1 2 Red (³10 % Class ize/ Availability Demand hortfall) Red, Pink (<10% shortfall) 3 Red, Pink 4 5 6 7 8 Grey (³90 % of norm) Red, Pink, Grey urplus (10-25%) urplus (>25%) urplus (10-25%)
Tenure Class Class Class Track Majors ize ize Avail- UGrad Need? Load (LD) (UD) ability Demand GROUP Communication 1 Political cience 1 ociology 1 Economics 2 Exercise cience 2 Languages, Literatures and Cultures 2 Philosophy 2 EDU Total 3 Anthropology 3 Classics 3 Landscape Architecture and Regional Planning 3 Nutrition 3 Plant, oil and Insect ciences 3 Communication Disorders 4 English 4 History 4 Linguistics * 4 Music and Dance 4 Physics 4 Art 5 Astronomy 5 Hospitality and Tourism Management 5 Marketing 5 Microbiology 5 Nursing 5 Public Health 5 Resource Economics 5
Tenure Class Class Class Track Majors ize ize Avail- UGrad Need? Load (LD) (UD) ability Demand GROUP Accounting and Information ystems 6 Biology 6 Computer cience 6 Finance and Operations Management 6 Legal tudies 6 Mechanical and Industrial Engineering 6 port Management 6 Biochemistry and Molecular Biology 7 Electrical and Computer Engineering 7 Management 7 Psychology 7 Veterinary and Animal ciences 7 Afro-American tudies * 8 Chemical Engineering 8 Chemistry 8 Civil and Environmental Engineering 8 Food cience 8 Geosciences 8 Judaic and Near Eastern tudies 8 Labor tudies 8 Mathematics and tatistics 8 Natural Resources Conservation 8 Polymer cience and Engineering 8 Theater 8 Women's tudies 8
AMHERT 250 ALLOCATION Instructional Need Research upport Available Available Research Teaching/ Life Amherst for TT in for TT in Grant/Gift Performance/ Research ciences 250 AY06-07 AY 07-08 Match Growth Performance Initiative Total Afro-American tudies 0 Art 0 Classics 1 1 English 0 History 0 Judaic and Near Eastern tudies 0 Languages, Literatures and Cultures 2 2 Linguistics 0 Music and Dance 3 3 Philosophy 2 2 Theater 0 Women's tudies 0 College of Humanities and Fine Arts (TBD) 2 2 HFA Total 3 7 0 0 0 0 10 Astronomy 1 1 Biochemistry and Molecular Biology 1 1 Biology 3 3 Chemistry 2 2 Computer cience 0 Geosciences 0 Mathematics and tatistics 0 Physics 2 2 Polymer cience and Engineering 1 1 NM Total 0 0 0 1 3 6 10 Anthropology 1 1 Communication 3 3 Economics 1 1 Labor tudies 0 Legal tudies 0 Political cience 2 2 Psychology 1 1 ociology 2 2 B Total 9 0 1 0 0 0 10
AMHERT 250 ALLOCATION Instructional Need Research upport Available Available Research Teaching/ Life Amherst for TT in for TT in Grant/Gift Performance/ Research ciences 250 AY06-07 AY 07-08 Match Growth Performance Initiative Total Education Policy Research and Administration 1 tudent Development and Pupil Personnel ervices Teacher Education and Curriculum tudies 1 EDU Total 2 0 0 0 0 0 2 Chemical Engineering 1 1 Civil and Environmental Engineering 1 1 Electrical and Computer Engineering 0 Mechanical and Industrial Engineering 0 ENG Total 0 0 2 0 0 0 2 Food cience 0 Landscape Architecture and Regional Planning 1 1 Microbiology 1 1 Natural Resources Conservation 0 Plant, oil and Insect ciences 0 Resource Economics 1 1 Veterinary and Animal ciences 2 2 NRE Total 2 0 0 2 1 0 5 Accounting and Information ystems 0 Finance and Operations Management 0 Hospitality and Tourism Management 0 Management 0 Marketing 0 port Management 0 chool of Management (TBD) 3 3 IOM Total 0 3 0 0 0 0 3 Nursing 0 0 0 0 0 0 0 Communication Disorders 0 Exercise cience 2 2 Nutrition 1 1 2 Public Health 2 2 PUB Total 5 0 0 1 0 0 6 TOTAL 21 10 3 4 4 6 48
Teaching Benchmarks Data enior urvey One page survey, focused on students experiences in the major tudent Response to Instruction (RTI) Campus-wide course evaluation data National tudy of tudent Engagement (NE) 100% ample of eniors
atisfaction with your major: Item Means Department The InstructorÉ Overall rating... Overall experience 3.69 3.52 Quality of teaching Faculty accessibility Faculty concern for progress Writing preparation Academic Advising 3.67 3.78 3.46 3.42 3.42 3.45 3.54 3.19 3.23 3.09 3.35 3.24 3.31 2.93 3.03 2.76 Access to classes 3.71 3.41 3.11 3.83 3.74 3.79 3.55 3.43 3.57 3.71 3.72 3.76 3.81 3.59 3.30 3.47 3.73 3.85 3.82 3.75 3.50 3.48 3.43 3.61 3.70 3.75 3.85 3.70 3.40 3.70 3.65 3.90 3.60 4.00 3.60 3.20 3.80 3.70 3.84 3.84 3.95 3.47 3.21 3.39 3.58 3.72 3.76 3.79 3.34 3.31 3.03 3.79 3.65 3.68 3.77 3.55 3.48 3.45 3.68 3.77 3.60 3.84 3.42 3.18 3.10 3.74 3.65 3.58 3.48 3.47 3.48 3.16 3.53 3.62 3.64 3.74 3.42 3.43 3.55 3.62 3.57 3.51 3.56 3.20 3.51 3.08 3.74 3.53 3.43 3.72 3.48 3.09 3.62 3.60 3.53 3.57 3.72 3.47 3.26 3.34 3.83 3.63 3.63 3.66 3.28 3.46 3.28 3.44 3.63 3.71 3.71 3.34 3.27 2.81 3.39 3.55 3.38 3.62 3.38 3.17 3.55 3.60 3.52 3.56 3.60 3.19 3.46 3.13 3.46 3.40 3.44 3.68 3.04 3.36 3.48 3.44 3.57 3.53 3.66 3.31 3.61 3.33 3.10 3.54 3.69 3.67 3.16 2.86 3.14 3.48 3.36 3.26 3.39 3.04 3.13 2.67 3.74 3.41 3.42 3.46 3.03 3.55 2.72 2.86 3.61 3.60 3.71 3.31 3.36 3.21 3.54 3.59 3.56 3.66 3.21 3.36 3.14 3.52 3.54 3.51 3.59 3.28 3.13 3.21 3.44 3.50 3.55 3.56 3.18 3.24 3.15 3.26 3.49 3.29 3.52 3.16 3.25 2.97 3.34 3.47 3.25 3.40 2.98 3.14 2.82 3.32 3.42 3.36 3.51 3.09 3.21 3.02 3.53 3.40 3.36 3.31 2.99 3.31 2.92 3.16 3.55 3.53 3.69 3.37 3.41 3.16 2.75 3.45 3.20 3.45 3.01 3.14 3.19 3.30 3.44 3.18 3.53 3.35 3.24 3.26 3.50 3.42 3.26 3.42 2.96 2.89 2.82 3.46 3.32 3.27 3.48 3.02 3.05 2.78 3.30 3.53 3.35 3.44 3.08 3.02 2.76 3.68 3.38 3.44 3.36 2.91 3.19 2.82 2.84 3.35 3.38 3.34 2.87 3.15 2.76 3.23 3.40 3.20 3.40 3.29 2.97 2.74 3.64 3.39 3.32 3.27 2.76 3.06 2.86 3.06 3.34 2.98 3.21 2.97 3.20 2.97 3.56 3.33 3.39 3.18 2.71 3.11 2.54 3.13 3.32 3.27 3.39 2.91 2.95 2.69 3.47 3.42 3.00 3.08 2.67 3.00 2.42 3.36 3.29 3.26 2.98 3.15 2.98 2.71 3.01 3.28 3.22 3.30 2.91 2.77 3.11 2.90 3.10 3.19 2.98 2.61 3.05 2.56 2.54 1 D above departmental mean Mean for all departments 1 D below departmental mean Department GG Department KK Department Z Department L Department DD Department C Department X Department II Department RR Department Department CC Department VV Department I Department QQ Department E Department PP Department HH Department P Department J Department YY Department WW Department BB Department D Department OO Department NN Department JJ Department M Department MM Department Y Department LL Department G Department K Department FF Department XX Department AA Department TT Department EE Department N Department Q Department UU Department T Department V Department R Department Department U Department B Department W Department O howed Provided Inspired interest in useful timulated Of how much Of the interest in the helping feedback on participation in was learned in instructor's subject matter students learn tests & papers class class teaching Of the course 4.40 4.57 4.28 4.36 4.04 4.41 4.07 4.17 4.39 4.03 4.10 3.83 4.21 3.86 3.94 4.21 3.77 3.84 3.63 4.01 3.64 4.49 4.63 4.30 4.37 4.08 4.45 4.13 4.12 4.56 4.17 4.24 4.03 4.28 3.90 4.36 4.61 4.25 4.28 3.90 4.38 3.98 4.25 4.52 4.19 4.34 3.83 4.20 3.86 4.24 4.43 4.03 3.94 4.06 4.36 4.02 4.35 4.49 4.16 4.45 3.97 4.45 4.03 4.13 4.52 4.11 4.04 3.91 4.33 3.86 4.19 4.49 4.16 4.17 3.88 4.28 3.95 4.07 4.36 4.09 3.91 3.77 4.10 3.74 4.42 4.57 4.13 4.24 4.02 4.43 4.06 4.18 4.36 4.01 3.99 3.79 4.18 3.67 4.36 4.61 4.42 4.48 4.01 4.36 4.04 4.12 4.40 4.12 4.05 3.87 4.25 3.93 4.52 4.59 4.23 4.49 4.19 4.46 4.27 4.39 4.51 4.11 4.09 3.97 4.33 4.02 4.18 4.51 4.31 4.17 3.87 4.38 3.95 4.49 4.63 4.38 4.56 4.11 4.45 4.22 4.33 4.44 3.87 4.32 4.02 4.36 3.98 4.32 4.54 4.35 4.34 3.83 4.32 3.97 4.21 4.41 3.95 4.27 3.79 4.22 3.91 4.29 4.51 4.17 4.39 3.89 4.32 3.95 4.51 4.59 4.37 4.36 4.19 4.51 4.23 4.20 4.39 4.07 4.06 3.82 4.23 3.81 4.03 4.21 3.82 4.05 3.68 3.99 3.68 3.99 4.25 3.77 3.89 3.79 4.10 3.78 3.72 4.21 3.72 3.75 3.57 3.80 3.49 4.09 4.26 3.80 3.93 3.78 4.04 3.75 4.17 4.23 4.02 4.04 3.77 4.13 3.62 3.77 4.06 3.69 3.77 3.51 3.89 3.54 4.16 4.32 3.86 3.96 3.84 3.96 3.80 4.14 4.26 4.08 3.96 3.84 4.18 3.86 4.27 4.43 4.14 4.32 3.86 4.19 3.90 4.10 4.31 3.91 4.05 3.69 4.12 3.72 3.77 4.02 3.72 3.57 3.56 3.92 3.48 4.20 4.46 3.94 4.10 3.87 4.27 3.86 3.86 4.06 3.66 3.67 3.66 3.94 3.72 3.93 4.19 3.41 3.71 3.34 3.96 3.47 4.04 4.29 3.81 3.80 3.71 4.09 3.73 3.96 4.20 3.91 3.87 3.69 4.07 3.70
enior urvey Department Educational Experiences Participation (%) HF A B N M N R E O M E N G P U B 1 D above departmental mean Mean for all departments 1 D below departmental mean Department A Department B Department C Department D Department E Department F Department G Department H Department I Department J Department K Department L Department M Department N + Department YY Department O Department P Department Q Department R Department Department T Department U Department V Department W Department X Department Y Department Z Department AA Department BB Department CC Department DD Department EE Department FF Department GG Department HH Department II Department JJ Department KK Department LL Department MM Department NN Department OO Department PP Department QQ Department RR Department Department TT Department UU Department VV Department WW Department XX HF A B N M N R E O M E N G P U B Practicum, internship, field experience 72% 56% 40% Community service or volunteer work 69% 55% 42% Research project with faculty member Culminating senior 50% tudy abroad 31% experience 54% 35% 18% 38% 19% 5% 23% 47% 39% 25% 33% 58% 6% 33% 29% 39% 24% 44% 56% 19% 25% 34% 44% 51% 24% 24% 26% 48% 59% 35% 71% 30% 48% 50% 17% 8% 69% 38% 54% 29% 25% 39% 46% 33% 39% 19% 24% 65% 75% 35% 20% 37% 57% 63% 26% 43% 38% 63% 63% 20% 27% 19% 44% 55% 20% 14% 18% 47% 61% 30% 14% 31% 52% 61% 27% 28% 33% 64% 69% 41% 22% 26% 94% 83% 40% 34% 53% 57% 63% 19% 18% 27% 73% 60% 64% 0% 40% 49% 57% 66% 13% 72% 44% 67% 48% 20% 46% 63% 50% 87% 3% 67% 41% 21% 37% 11% 28% 64% 39% 41% 19% 37% 38% 44% 32% 14% 39% 48% 52% 70% 13% 52% 59% 45% 44% 24% 25% 60% 44% 30% 0% 56% 47% 45% 19% 11% 49% 51% 65% 60% 16% 45% 64% 50% 35% 16% 41% 93% 38% 40% 5% 7% 36% 48% 27% 21% 42% 67% 59% 39% 11% 26% 67% 76% 14% 17% 34% 59% 61% 24% 25% 46% 75% 53% 18% 24% 21% 39% 50% 11% 11% 37% 67% 58% 25% 27% 36% 67% 70% 20% 7% 22% 56% 32% 47% 4% 44% 56% 66% 41% 12% 70% 40% 44% 37% 2% 67% 57% 45% 39% 5% 64% 97% 67% 21% 8% 35% 53% 72% 48% 17% 22% 65% 61% 37% 14% 22% 59% 85% 29% 0% 29%
National urvey of tudent Engagement (NE) Department Instructional Practices Outcomes/Gains 1 D above departmental mean Mean for all departments 1 D below departmental mean Coursework: memorizing 3.07 2.68 2.28 Coursework: analyzing Coursework: synthesizing Coursework: making judgments 3.50 3.34 3.19 3.23 3.03 2.89 2.96 2.73 2.59 Coursework: applying theories Writing clearly and effectively peaking clearly and effectively Thinking critically and analytically Analyzing quantitative problems Using computing technology Working effectively with others Learning effectively on your own olving realworld complex problems 3.46 3.18 3.12 3.51 3.40 3.39 3.29 3.28 2.96 3.12 2.87 2.72 3.19 2.93 2.99 2.94 2.99 2.65 2.78 2.57 2.32 2.87 2.46 2.59 2.58 2.70 2.33 Department A Department B 3.24 3.00 3.29 2.47 2.59 3.00 2.63 3.25 2.69 2.94 3.06 3.13 2.56 Department C Department D 2.36 3.31 3.20 3.05 3.02 3.30 2.76 3.35 2.35 2.73 2.76 3.00 2.46 HF A Department E Department F Department G HF A 2.75 3.29 3.04 3.17 2.75 3.27 3.09 3.32 2.77 2.73 2.95 3.14 2.73 2.33 3.50 3.08 3.08 2.83 3.17 2.67 3.50 2.25 2.83 3.00 3.25 3.00 Department H 2.17 3.00 2.67 2.67 2.67 2.83 1.83 3.00 2.33 2.33 2.33 2.00 2.17 Department I 2.64 3.21 2.96 2.96 3.24 2.56 2.68 3.20 2.40 2.44 3.04 3.36 2.68 Department J 2.86 3.29 2.71 3.00 2.71 3.29 3.14 3.57 3.14 1.71 1.71 2.71 2.29 Department K 2.18 3.18 3.18 2.82 3.27 2.91 2.82 2.73 2.00 2.73 3.18 3.27 2.09 Department L Department M 2.13 3.38 3.25 2.88 3.38 3.00 2.25 3.13 2.25 2.88 2.88 3.13 2.50 Department N + Department YY 2.47 3.14 2.98 2.90 3.09 3.16 3.00 3.28 2.56 2.70 2.84 3.23 2.74 B Department O Department P Department Q Department R B 2.53 3.21 2.53 2.68 2.68 2.76 2.06 2.88 2.76 2.65 2.35 2.65 2.29 2.71 3.41 3.06 3.00 3.00 2.93 2.67 3.27 2.60 2.80 2.80 2.87 2.53 2.60 3.23 3.17 3.07 3.20 2.88 2.65 3.35 2.85 2.88 2.77 3.23 2.81 3.13 3.28 2.97 2.96 3.01 3.00 2.57 3.24 2.55 2.87 2.97 3.01 2.58 Department 2.08 3.50 3.58 3.25 3.17 2.83 2.75 3.67 3.00 2.50 3.08 3.33 2.92 Department T 2.85 3.04 2.88 2.92 2.81 2.96 2.83 3.26 2.65 2.83 2.96 3.35 2.83 Department U 2.33 3.83 3.67 2.83 3.33 2.33 2.33 3.67 3.67 3.17 3.00 3.67 3.00 Department V 2.76 3.06 2.76 2.71 3.06 2.47 2.53 3.00 3.06 2.88 2.88 2.88 2.59 N M Department W Department X Department Y Department Z N M 3.07 3.13 2.98 2.76 2.96 2.42 2.37 2.88 2.84 2.86 2.56 2.98 2.42 2.88 3.13 3.00 2.25 3.63 2.71 3.00 3.43 3.71 3.43 3.00 3.00 2.43 2.56 3.06 3.11 2.61 2.72 2.24 2.06 3.06 3.24 3.76 2.88 2.41 2.65 3.00 3.60 3.20 2.40 3.00 3.20 3.00 3.60 3.60 3.40 3.20 3.00 2.80 Department AA 2.35 2.75 2.80 2.45 3.25 2.45 2.35 3.00 3.30 3.00 2.65 3.00 2.60 Department BB 2.22 3.33 3.22 2.78 3.56 2.88 2.88 3.38 3.50 3.00 3.00 2.75 2.88 Department CC 3.22 2.56 2.33 2.22 2.44 2.56 2.22 2.44 2.22 2.78 2.56 3.00 2.11 Department DD N R E Department EE Department FF Department GG Department HH N R E 2.22 3.44 3.11 3.00 3.44 2.78 3.33 3.33 2.56 2.78 2.78 2.56 2.78 3.17 2.91 2.91 2.74 3.00 2.77 2.59 3.14 3.00 3.14 2.68 3.18 2.77 3.11 3.22 3.00 3.22 2.89 2.89 2.78 2.89 2.89 3.00 2.67 2.67 2.33 3.25 2.75 2.50 3.25 3.00 3.00 3.25 2.50 3.00 3.00 3.50 3.25 2.25 Department II 2.33 3.50 3.33 3.17 3.50 3.33 3.50 3.17 3.17 3.67 3.00 3.00 2.83 Department JJ 3.53 2.82 2.53 2.47 2.65 2.41 1.94 2.35 2.24 2.65 2.35 2.76 2.24 Department KK 2.77 3.13 2.83 3.03 3.07 2.96 2.96 3.29 3.11 3.21 3.32 2.89 2.68 O M Department LL Department MM Department NN Department OO O M 2.54 3.24 3.19 2.95 3.38 3.39 3.31 3.61 3.53 3.47 3.44 3.17 3.03 2.64 3.08 2.84 2.80 3.12 2.88 2.84 3.12 2.80 3.24 3.40 2.92 2.80 2.53 3.18 2.94 3.06 2.94 2.88 2.76 2.94 2.94 2.76 2.94 2.94 2.59 2.63 3.44 2.94 3.13 3.38 3.00 3.13 3.25 3.31 3.25 3.38 2.56 2.69 Department PP 2.68 3.27 2.82 2.73 3.18 3.05 3.18 3.27 2.68 2.73 3.27 3.05 2.91 E N G Department QQ Department RR Department Department TT E N G 2.30 3.70 3.50 3.60 3.70 3.00 2.90 3.50 3.50 3.50 3.10 3.10 3.20 2.56 3.56 3.33 3.33 3.89 3.44 3.33 3.67 3.78 3.67 3.67 3.22 3.56 2.26 3.36 3.18 2.74 3.51 2.42 2.61 3.39 3.58 3.72 3.28 3.03 3.00 2.14 3.76 3.60 3.29 3.81 2.84 2.84 3.63 3.74 3.47 3.32 3.26 3.26 P U B Department UU Department VV Department WW Department XX P U B 3.10 3.50 3.60 3.25 3.60 2.55 2.50 3.20 2.95 2.75 3.00 2.75 2.50 3.00 3.00 2.89 2.89 3.00 3.22 2.78 3.11 3.00 3.11 2.78 3.11 2.56 2.64 3.29 3.14 3.00 3.29 3.00 2.77 3.08 3.23 3.31 3.08 2.85 2.31 3.71 2.86 2.71 2.43 2.71 2.43 2.00 2.71 2.57 3.14 2.71 3.14 2.29
Next teps Conversations with Deans and Departments Assessment consultation regarding next steps Incorporate departmental response to results in Program Review process
For more information www.umass.edu/budget/ www.umass.edu/oapa/presentations/air2006 (Powerpoint presentation) Bryan Harvey harvey@provost.umass.edu Marilyn Blaustein blaustein@oirp.umass.edu Martha tassen mstassen@acad.umass.edu