State of Assessment: How Does Texas Measure Up? PAUL GRAY CAMT 2017 SESSION 2222, JULY 11, 2017 @texmathguy #TXAlgReas
Overview Texas Journey of Math Assessment National Story of Math Assessment International Story of Math Assessment Sightseeing: STAAR, other states tests, NAEP, TIMSS Items Analysis and Implications
Texas Journey of Math Assessment
Texas Assessment of Academic Skills (TAAS) 100 90 80 70 60 50 40 30 20 10 0 Student Performance, TAAS Math (Grade 5) 1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 All African-American Hispanic White Low SES
Texas Assessment of Academic Skills (TAAS) 100 90 80 70 60 50 40 30 20 10 0 Student Performance, TAAS Math (Grade 8) 1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 All African-American Hispanic White Low SES
Texas Assessment of Academic Skills (TAAS) 100 90 80 70 60 50 40 30 20 10 0 Student Performance, TAAS Math (Exit Level) 1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 All African-American Hispanic White Low SES
Texas Assessment of Knowledge and Skills (TAKS) 100 90 80 70 60 50 40 30 20 10 0 Student Performance, TAKS Math (Grade 5) 1 st Admin only 2003 2004 2005 2006 2007 2008 2009 2010 All African-American Hispanic White Low SES
Texas Assessment of Knowledge and Skills (TAKS) 100 90 80 70 60 50 40 30 20 10 0 Student Performance, TAKS Math (Grade 8) 1 st Admin only 2003 2004 2005 2006 2007 2008 2009 2010 All African-American Hispanic White Low SES
Texas Assessment of Knowledge and Skills (TAKS) 100 90 80 70 60 50 40 30 20 10 0 Student Performance, TAKS Math (Grade 11) 2003 2004 2005 2006 2007 2008 2009 2010 All African-American Hispanic White Low SES Primary Admin only
State of Texas Assessment of Academic Readiness (STAAR) 100 90 80 70 60 50 40 30 20 10 0 Student Performance, STAAR Math (Grade 5) 2012 2013 2014 2015 2016 2017 1 st Admin only All African-American Hispanic White Low SES
State of Texas Assessment of Academic Readiness (STAAR) 100 90 80 70 60 50 40 30 20 10 0 Student Performance, STAAR Math (Grade 8) 2012 2013 2014 2015 2016 2017 1 st Admin only All African-American Hispanic White Low SES
State of Texas Assessment of Academic Readiness (STAAR) 100 90 80 70 60 50 40 30 20 10 0 Student Performance, STAAR Math (Algebra 1) 2012 2013 2014 2015 2016 2017 Spring admin only All African-American Hispanic White Low SES
National Story of Math Assessment
National Assessment of Educational Progress (NAEP) Grade 4
Alabama New Mexico District of Columbia California Nevada Mississippi Louisiana West Virginia Arkansas Michigan Alaska Georgia New York South Carolina Illinois Arizona Oregon Hawaii Rhode Island Delaware Idaho Missouri Maryland South Dakota Oklahoma Connecticut National Tennessee Kansas Montana Colorado Kentucky Maine Utah Florida Vermont Wisconsin Pennsylvania Iowa Ohio North Carolina Nebraska Texas North Dakota Washington New Jersey Virginia Wyoming DoDEA Indiana New Hampshire Minnesota Massachusetts NAEP Grade 4 State by State 255 250 245 240 235 230 225 220 NAEP Average Scale Score, Grade 4
NAEP Grade 4 260 NAEP Comparison: Texas, National, and High-Performing States 250 240 230 220 210 200 190 1990 1992 1996 2000 2003 2005 2007 2009 2011 2013 2015 National Massachusetts Minnesota New Hampshire Indiana Texas
National Assessment of Educational Progress (NAEP) Grade 8
District of Columbia Alabama Louisiana Mississippi New Mexico West Virginia Oklahoma Arkansas Nevada Florida California South Carolina Kentucky Michigan Tennessee Georgia Hawaii Delaware New York Alaska Missouri North Carolina Rhode Island Illinois National Oregon Arizona Maryland Pennsylvania Idaho Texas Kansas Connecticut South Dakota Maine Ohio Colorado Utah Iowa Nebraska Washington Wyoming Indiana Montana Virginia North Dakota Wisconsin Vermont DoDEA New Jersey Minnesota New Hampshire Massachusetts NAEP Grade 8 State by State 300 290 280 270 260 250 240 230 220 NAEP Average Scale Score, Grade 8
NAEP Grade 8 310 NAEP Comparison: Texas, National, and High-Performing States 300 290 280 270 260 250 240 230 1990 1992 1996 2000 2003 2005 2007 2009 2011 2013 2015 National Massachusetts Minnesota New Hampshire New Jersey Texas
International Story of Math Assessment
TIMSS Trends in International Mathematics and Science Studies Administered at Grade 4, 8, and 12 Every 4 years, most recently in 2015 57 countries and 7 regions participated
Kuwait Morocco Saudi Arabia Jordan Indonesia Abu Dhabi-UAE Oman Iran, Islamic Rep. of Buenos Aires-ARG Qatar Bahrain United Arab Emirates Chile Georgia Turkey France New Zealand Slovak Republic Croatia Spain Italy Canada Dubai-UAE Ontario-CAN Australia Serbia Sweden Slovenia Germany Cyprus Bulgaria Czech Republic Hungary Netherlands Poland Finland Lithuania Quebec-CAN Denmark United States Portugal Kazakhstan Belgium (Flemish)-BEL Florida-USA England-GBR Ireland Norway Russian Federation Northern Ireland-GBR Japan Chinese Taipei-CHN Korea, Rep. of Hong Kong-CHN Singapore 700 600 500 400 300 200 100 0 TIMSS 2015, Grade 4 Texas and Florida 4 th grade NAEP scores were similar, Average Scale Score by Country or Jurisdiction so Texas would be with Florida.
Saudi Arabia Morocco Jordan Kuwait Egypt Buenos Aires-ARG Oman Chile Thailand Iran, Islamic Rep. of Qatar Abu Dhabi-UAE Lebanon Georgia Bahrain Turkey United Arab Emirates Malaysia New Zealand Florida-USA Malta Italy Sweden Australia Israel Lithuania Norway Dubai-UAE Hungary Slovenia England-GBR United States Ontario-CAN Ireland Canada Kazakhstan Russian Federation Quebec-CAN Japan Hong Kong-CHN Chinese Taipei-CHN Korea, Rep. of Singapore 700 600 500 400 300 200 100 0 Based on NAEP scores with Texas, Florida, and US avg., Texas would Average Scale Score by Country or Jurisdiction probably go here. TIMSS 2015, Grade 8
PISA Program for International Student Assessment Organization for Economic Cooperation and Development (OECD) Administered to 15-year-olds (Grade 10 in US) Every 3 years, most recently in 2015 Over 70 countries and regions participated
Dominican Republic Algeria Kosovo Tunisia Macedonia Brazil USA: Puerto Rico Jordan Indonesia Peru Colombia Lebanon Costa Rica Qatar Georgia Mexico Albania Thailand Trinidad and Tobago Montenegro Uruguay Moldova Turkey Chile United Arab Emirates Cyprus Bulgaria Romania Greece Buenos Aires - Argentina Croatia United States Israel USA: North Carolina Slovak Republic Hungary Lithuania Malta Latvia Luxembourg Spain Iceland Italy International Average Portugal Czech Republic United Kingdom France Australia Sweden Russian Federation Vietnam New Zealand Austria USA: Massachusetts Norway Ireland Poland Germany Belgium Slovenia Finland Denmark Netherlands Canada Estonia Switzerland Korea, Republic of B-S-J-G (China) Japan Chinese Taipei Macao - China Hong Kong - China Singapore 600 500 400 300 200 100 PISA 2015, Grade 10 There is no direct comparison with high school scores in the US. Based on 8 Average Mathematics th grade NAEP, Scale Score Texas might go here. 0
No one ever says to a teacher, Wow, I remember that really cool worksheet we did! --Karen Karp, CAMT 2016 Opening Session Sightseeing: STAAR, state test, NAEP, TIMSS Assessment Items
Grade 4: Perimeter Texas: STAAR 2016 Massachusetts, 2015 Minnesota, Grade 3
Grade 4: Perimeter Texas: STAAR 2016 NAEP NAEP
Grade 4: Perimeter Texas: STAAR 2016 TIMSS 2011
Grades 6-8: Equivalent Expressions Texas: Grade 6 STAAR 2016 Massachusetts, Grade 6, 2015 Minnesota, Grade 8
Grades 6-8: Equivalent Expressions Texas: Grade 6 STAAR 2016 TIMSS, Grade 8 NAEP, Grade 8
Grade 8: Angle Measures in Triangles Texas: STAAR 2016 Massachusetts, 2014 (no calculator)
Grade 8: Angle Measures in Triangles Texas: STAAR 2016 TIMSS 2011
Grade 8: Simultaneous Linear Functions Texas: STAAR 2016 Florida: FCAT 2.0 Sample Item
Grade 8: Simultaneous Linear Functions Texas: STAAR 2016 Massachusetts, 2016 (no calculator) North Carolina (calculator)
Analysis and Implications
Comparing Texas Students with Other States Texas students, at Grades 4 and 8, perform above the national average. At Grade 8, that difference is not significant. States such as Massachusetts, Minnesota, and New Hampshire consistently outperform Texas. What are they doing that we aren t? Emphasizing problem-solving Balancing conceptual development with skills development
Comparing Texas Students with Other States Since 2011, there has been a national downward trend in NAEP math scores. For Texas, Grade 8 scores are falling faster than the nation s. 2011: $5.4 billion budget cut for schools State funding increases aren t keeping pace with enrollment growth reduction in spending per student Personnel reduction (specialists and other human resources)
Comparing Texas Students with Other Nations At Grades 4 and 8, Texas is like the United States not performing well, but not performing poorly. At Grade 10, Texas, like the United States, performs lower than the OECD average. What are the consistently high-performing countries (Singapore, South Korea, Japan, Taiwan, certain Chinese areas) doing that we aren t? What can we learn from them? What mathematical processes (such as problem-solving) are high-performing countries using that we aren t?
Thank You! Dr. Paul Gray, paul@cosenzaassociates.com Cosenza & Associates, LLC @texmathguy #TXAlgReas