Kansas State Assessments A Footprint Fall 2015 Brad Neuenswander, Deputy Commissioner, KSDE
History of Assessments In the late 1970 s, the Legislature directed the State Board of Education to develop and administer minimum competency tests in reading and math. The Center for Educational Testing and Evaluation (CETE) at the University of Kansas won the bid, and continued administering the assessments until the late 1980 s.
History of Assessments In 1992, the Kansas Legislature passed State Statute 72-6439. The state board shall establish curriculum standards which reflect high academic standards for the core academic areas of mathematics, science, reading, writing and social studies. The state board shall provide for statewide assessments in the core academic areas of mathematics, science, reading, writing and social studies.
History of Assessments Early 1990 s and Quality Performance Accreditation (QPA). New standards written, with new assessments developed to replace minimum competency exams. Still traditional paper/pencil tests in math, reading, writing, science and history/government.
History of Assessments 2001 Elementary and Secondary Education Act (ESEA) or No Child Left Behind (NCLB). Assessments became part of Federal Accountability in Math and Reading. Also requires states to administer Science. 100% proficiency by 2014 Kansas is an early state to begin administering the state assessment computerized in the early 2000 s.
Current State Assessments New assessments in the Spring of 2015, developed and administered by CETE. Current CETE contract of $5.8 million (less than one million is state general fund $) Assessments include; Math, English Language Arts, Science, History/Government, English Language Proficiency, Career/Tech Ed. Average per/pupil cost of $5-7 2011 Brookings study, Kansas ranks 2 nd lowes per pupil cost in the nation.
Kansas Student Population Trends (Percent of K-12, September Unaudited Enrollment, Public Schools) 7
Details of Student Population Trends 8 year Free & Reduced Students w/ Disabilities 2000 32.2 10.6 2001 33.2 10.8 2002 34.1 11.0 2003 35.9 11.6 English Language Learners 2004 37.4 12.4 5.1 2005 38.5 12.8 5.5 2006 38.7 12.9 5.5 2007 38.9 12.4 7.1 2008 39.7 12.3 7.7 2009 42.7 12.7 8.0 2010 45.6 12.6 8.7 2011 47.4 12.6 9.4 2012 48.9 12.6 9.6 2013 49.6 12.7 10.0
Five Performance Levels Exemplary Exceeds Standard Meets Standard Approaches Standard Academic Warning 9
Reporting Standard & Above Reported percentages are totals of all students in the top three performance levels. Example from Reading, All Students: Exemplary....... 29.9 Exceeds Standard.. 29.5 Meets Standard... 25.3 % at Standard or Above = 84.7 10
Reading Trends by Percent Proficient, All Students, Report Card Population 11
Disaggregated Groups All students Males & females Ethnic groups Free & reduced lunch Students with disabilities English Language Learners 12
Reading Gap by Percent Proficient, SES levels, 2000 2013, (report card population) 13
Reading Gaps by Percent Proficient & Ethnicity: 2000 2013 (percent proficient, all grades, report card population) 14
Math Percent Proficient, All Students, Report Card Population 15
Math Gap by Percent Proficient, SES levels, 2000 2013, (report card population) 16 16
Math Gap by Percent Proficient & Ethnicity, 2000 2012 (report card population) 17
New 2015 Kansas CCR Assessments New Assessments in Math and English Language Arts (ELA) 4 new Performance Levels instead of 5 Level 4: indicates that the student is performing above expectations for that grade level and is on track to being college ready. Level 3: indicates that the student is performing at academic expectations for that grade level and is on track to being college ready. Level 2: indicates that the student is doing grade-level work found in the standards but not at the depth or level of rigor to be considered on-track for college readiness. Level 1: indicates that a student is not performing at grade level standards, and additional supports are needed.
Moving in a New Direction Old State Assessment 2002-2013 Exemplary Exceeds New College and Career Ready Assessment 2014-2015 4 3 Meets 2 Approaching Warning 1 The best way to understand the 4-point scale is to look at the descriptions Kansas teachers used when developing the scale. One-word summaries as Kansas had in the past are misleading and imprecise. Such summaries are not valuable for teachers, parents, and students.
Grade 8 Mathematics: Excerpt from Performance Level Descriptor (PLD) New College and Career Ready Assessment 2014-2015 4 3 2 1 Level 2 students should be able to identify and calculate the cube root of familiar perfect cubes and calculate the cube of integers. They should be able to work with and apply the properties of integer exponents of degree 2 or less to produce or identify equivalent numerical expressions
Grade 5 Language Arts: Excerpt from Performance Level Descriptor New College and Career Ready Assessment 2014-2015 4 3 2 1 Level 2 Students can identify the interaction between elements of a text (e.g., events, people, ideas, and topics) using explicit details within a text; and identify conflicting information within a text.
Kansas College and Career Ready Academic Assessment: State ELA Results, 2015 Level 1 Level 2 Level 3 Level 4 100% 90% 13.0 10.1 13.8 3.5 2.9 2.0 2.0 80% 33.9 38.6 27.8 28.9 70% 60% 34.4 45.9 36.8 50% 40% 30% 32.7 32.4 32.0 36.3 35.2 50.8 45.7 20% 10% 19.9 11.6 17.4 26.3 23.3 19.4 23.4 0% Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 10
Kansas College and Career Ready Academic Assessment: State Math Results, 2015 Level 1 Level 2 Level 3 Level 4 100% 90% 80% 16.4 5.0 3.2 3.8 4.6 8.1 10.3 20.0 20.3 26.3 28.5 23.7 32.3 70% 60% 50% 35.9 41.0 39.3 40% 50.3 43.0 42.3 55.4 30% 35.7 20% 35.2 35.8 10% 12.0 13.1 23.0 20.4 15.1 0% Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 10
NAEP 2015 Mathematics and Reading Results
What is NAEP? The National Assessment of Educational Progress (NAEP) is the largest continuing and nationally representative assessment of what our nation s students know and can do in core subjects. A survey designed to produce national, state, and select urban district level results. NAEP results are for populations of students, not for individual students nor schools. Measures student performance nationally and reports changes over time. Allows comparisons between states and the nation. 25
NAEP School and Student Selection NAEP uses a carefully designed sampling procedure for the assessment to be representative of the geographical, racial, ethnic, and socio-economic diversity of schools and students in the state. First, a sample of schools is selected. Then, within each chosen school students are randomly selected to participate. Each participating student represents hundreds of other similar students. 26
Grade 4 NAEP Mathematics 260 Results Average Scale Scores National Public Kansas 255 250 245 242 246 248 245 246 246 241 Proficie nt 240 235 230 234 237 239 239 240 241 240 225 220 215 Basic 210 2003 2005 2007 2009 2011 2013 2015 NOTE: Observed differences are not necessarily statistically significant. 27
Grade 4 Mathematics Results Score Gaps 260 250 240 230 220 254 252 253 248 249 250 249 244 23 225 222 22 22 22 23 24 24 18 237 235 236 227 228 229 230 229 231 254 255 254 255 256 253 National Public Kansas 19 18 18 17 19 22 238 237 231 210 Not Eligible Eligible 200 2003 2005 2007 2009 2011 2013 2015 2003 2005 2007 2009 2011 2013 2015 NOTE: Observed differences are not necessarily statistically significant. Score gaps are calculated based on differences between unrounded average scale scores. 28
Grade 4 Mathematics Results Score Changes Since 2013 29
Grade 8 NAEP Mathematics 310 Results Average Scale Scores National Public Kansas 300 290 284 284 290 289 290 290 284 Proficie nt 280 270 276 278 280 282 283 284 281 260 Basic 250 2003 2005 2007 2009 2011 2013 2015 NOTE: Observed differences are not necessarily statistically significant. 30
Grade 8 Mathematics Results Score Gaps 310 300 290 280 270 260 250 240 230 220 287 288 291 293 295 297 296 291 293 23 22 261 258 22 22 23 24 # 21 23 299 298 300 301 295 24 22 24 25 23 275 276 276 276 265 266 269 270 268 270 270 272 National Public Kansas Not Eligible Eligible 2003 2005 2007 2009 2011 2013 2015 2003 2005 2007 2009 2011 2013 2015 NOTE: Observed differences are not necessarily statistically significant. Score gaps are calculated based on differences between unrounded average scale scores. 31
Grade 8 Mathematics Results Score Changes Since 2013 32
Grade 4 NAEP Reading 250 Results Average Scale Scores National Public Kansas 245 240 235 Proficie nt 230 225 220 215 210 220 220 216 217 225 224 224 223 221 220 220 220 221 221 Basic 205 200 2003 2005 2007 2009 2011 2013 2015 NOTE: Observed differences are not necessarily statistically significant. 33
Grade 4 Reading Results Score Gaps 240 230 229 230 232 232 234 236 236 229 230 232 232 234 236 236 220 210 23 22 22 22 23 24 # # # # # # # # 200 190 201 203 205 206 207 207 207 National Public 201 203 205 206 207 207 207 State 180 Not Eligible Eligible 170 2003 2005 2007 2009 2011 2013 2015 2003 2005 2007 2009 2011 2013 2015 NOTE: Observed differences are not necessarily statistically significant. Score gaps are calculated based on differences between unrounded average scale scores. 34
Grade 4 Reading Results Score Changes Since 2013 35
Grade 8 NAEP Reading 290 Results Average Scale Scores National Public Kansas 280 Proficie nt 270 266 267 267 267 267 267 267 260 261 260 261 262 264 266 266 250 240 Basic 230 2003 2005 2007 2009 2011 2013 2015 NOTE: Observed differences are not necessarily statistically significant. 36
Grade 8 Reading Results Score Gaps 290 280 270 260 278 278 271 270 271 273 275 24 # 23 22 22 22 23 271 270 271 273 # # # # 275 # 278 278 # # 250 240 246 247 247 249 251 National Public 254 254 246 247 247 249 State 251 254 254 230 Not Eligible Eligible 220 2003 2005 2007 2009 2011 2013 2015 2003 2005 2007 2009 2011 2013 2015 NOTE: Observed differences are not necessarily statistically significant. Score gaps are calculated based on differences between unrounded average scale scores. 37
Grade 8 Reading Results Score Changes Since 2013 38
ACT Results 2015
How Does ACT Determine if Students Are College Ready? The ACT College Readiness Benchmarks are scores on the ACT subject area tests that represent the level of achievement required for students to have a 50% chance of obtaining a B or higher or about a 75% chance of obtaining a C or higher in corresponding credit-bearing firstyear college courses. Based on a nationally stratified sample, the Benchmarks are median course placement values for these institutions and represent a typical set of expectations. ACT College Readiness Benchmarks were revised for 2013 graduating class reporting.
The ACT College Readiness Benchmarks are: College Course Subject Area Test Original ACT College Readiness Benchmark English Composition English 18 18 Social Sciences Reading 21 22 College Algebra Mathematics 22 22 Biology Science 24 23 Revised ACT College Readiness Benchmark
ACT: Kansas vs. Nation
Caution with Comparing States using ACT Not every state assesses all students with ACT Colorado: 100% tested & 20.7 avg. score Kansas: 74% tested & 21.9% avg. score Massachusetts: 28% tested & 24.4 avg. score
Concluding Thoughts Drop-out and remediation rates at Kansas College at Universities are over 50%. This is unacceptable and addressed in part by raising expectations in high school. The KCCR standards raise expectations. The cut scores for the College and Career ready Assessments were established by 160 teachers representing all of Kansas, and they have raised the bar on student academic success. Kansas teachers setting cut scores value the high standards and want to see them in place long enough to align instruction with the assessment. Kansas needs to have a higher level of post-secondary completion, so it begins with higher standards and the state boards new vision.
Questions?