ACTRC Research Forum 18th July 2015 The Philippines approach to assessment of 21st century skills This presentation represents the activity undertaken by the Department of Education of the Government of the Philippines. Collaborating with the Department are academics and educators who are staff in the Assessment and Technology Research Centre (ACTRC), and in the Assessment Research Centre of the University of Melbourne. Contributors to this presentation include: Dr Nelia Vargas-Benito, Dr Dina Ocampo Efren De La Cruz, Danilyn Joy Pangilinan, Januario Cortes Vicenta Opina, Bernadette Reyes, Claire Scoular, Yasotha V Esther Care Joesal Marabe Global Framework of Learning Domains The process undertaken Review of 21st century frameworks Review of national frameworks Identification of common themes Alignment with the Philippines core educational goals From Report No 1 of the Learning Metrics Task Force, p. 4 Frameworks Frameworks OECD UNESCO Learning to know Use tools interactively Learning to do Act autonomously Learning to be Interact in heterogeneous Learning to live together ACTRC 2015 Partnerships21 groups 1
life = decontextualized prac3ce Selected skills content knowledge Life and Career Skills media and techology Learning and innovation Technology Critical thinking contextualized prac3ce study and thinking strategies Problem solving Innovation Collaboration Initial audit steps ASSESSMENT CUBE Mother Tongue Filipino English Science Math Araling Panlipunan TLE Edukasyon sa Pagpapakatao Math Communica3on Skills K to 6 InformaNon, Media and Technology Skills 1. Represent numbers using models, diagrams and symbols Learning and InnovaNon Skills 2. Represent operanons using models, diagrams and symbols CommunicaNon Skills 3. Display data 4. Interpret 5. Give descripnve InformaNon, informanon Media and Technology Skills 6. Make connecnons Learning and InnovaNon Skills 7. Communicate results CommunicaNon Skills Math Communica3on InformaNon, Media Skills Grades and Technology 7 to 12 Skills 1. RepresenNng Learning and communicanng and InnovaNon Skills 2. Visualizing and CommunicaNon modeling Skills 3. Applying and connecnng InformaNon, Media and Technology Skills Learning and InnovaNon Skills CommunicaNon Skills MAPEH K to 3 Grades 4 to 6 Grades 7 to 10 Grades 11 to 12 Criteria for selection of skills 1 2 3 Are the skills teachable and learnable? Can the skills be embedded through the subject studies to demonstrate generalisability? Will enhancement of these skills enhance student learning outcomes in subject studies? ICT Literacy Across Selected Disciplines Joesal Jan Marabe Januario Cortes The Assessment, and Technology Research Centre is a partnership between the University of Melbourne and the University of the Philippines supported by Australian Aid. ACTRC 2015 2
media and technology Learning and innovation Technology Critical thinking Problem solving Innovation Collaboration Global measures routine and non-routine task input 2000-2011, Global Employment Trends (2013) Data derived from Key Indicators of the Labour Market, 7th ed., International Labour Organization Jaimovich & Siu (2012); Autor, Levy & Murnane (2003) 13 Technology Literacy Technology Literacy is the ability to responsibly use appropriate technology to: communicate, solve problems, access, manage, integrate, evaluate, design and create information to improve learning in all subject areas. (Colorado Department of Education (CDE)) Technological Literacy is the ability to use, manage, assess and understand technology. (ITEA Standards for Technological Literacy, 2007) ICT Literacy is using digital technology, communications tools, and/or networks to access, manage, integrate, evaluate and create information in order to function in a knowledge society. (Int l ICT Literacy Panel, 2002) Literacy should be conceived more broadly as a new liberal art that extends from knowing how to use computers and access information to critical reflection on the nature of information itself, its technical infrastructure, and its social, cultural and even philosophical context and impact. (Shapiro and Hughes, 1996) is the ability to gather, use, manage, synthesise and create information and data in an ethical manner and the information skills to do so effectively. (SCONUL, 2011). IMT Literacy Process The ability to create, evaluate, and effectively use information, media, and technology Construct Assessment Literacy the ability to access, manage, use and evaluate information Technology Literacy the ability to use of technology to access, manage, and communicate information Concept definition Description Hypothetical Audit across subjects Assessment cube Item development Panel and pilot Build empirical Develop teacher materials ACTRC 2015 3
Challenges in organizing competencies From curriculum competencies to skills Creates an audio-video art/animation promoting a product. [CG, Arts] Can (safely) use computer, internet and e-mail [CG, EPP] Can use computer and internet to compile, search and organize information [CG, EPP] Audit of K to 12 Identification of Similar Competencies Identification of the Underlying IMT Skills Can use Online Public Access Catalogue (OPAC) [CG, F] Use computers for collection, summary and display of evidence [CG, S] Can use Online Public Access Catalogue (OPAC) [CG, F] Can use technology to find sources of information [CG, AP] Use computers for collection, summary and display of evidence [CG, S] Can use computer and internet to compile, search and organize information [CG, EPP] Use computers for collection, summary and display of evidence [CG, S] Creates an audio-video art/ animation promoting a product [CG, Ar] Use computers for collection, summary and display of evidence [CG, S] Creates advertisement, documentary, short film or blog about a movie [CG, F] Can identify source of information [CG, AP] Can distinguish facts from fabrications from newspapers, radio, television programs and articles from the internet [CG, EsP] Synthesize overall knowledge about different information and media sources by producing and subsequently evaluating a creative multimedia form and media sources.[cg, E] ACTRC 2015 4
Januario Cortes Department of Education Philippines Joesal Marabe ACTRC j.marabe@actrc.org Yasotha V University of Melbourne Literacy in Science Esther Care www.actrc.org @ACTRC_edu www.facebook.com/actrc.org The Assessment, and Technology Research Centre is a partnership between the University of Melbourne and the University of the Philippines supported by Australian Aid. 21 st Century Skills in Science With acknowledgement of the special contributions of: - Vicenta Opina - Bernadette Reyes - Efren De La Cruz - Joy Pangilinan - Claire Scoular (University of Melbourne) Domain-specific and domain-general skills The ability to solve problems depends on more than just domain-specific knowledge (Mayer, 1998) Domain general Domain specific There is value in focusing on identifying possible instructional measures to teach skills in various subject areas in a way that might allow more flexible transfer (Dimitru, 2012) Process Science and 21 st Century Skills Skills Concept definition Description Audit across subjects Assessment Assessment cube Item development Panel and pilot In the context of science education, 21 st Century Skills offer some new ways of framing what have long been a valued approached in the science classroom The inverse is also true, science contributes its rich traditions of critical and creative thinking, applied technologies, and collaborative work- along with high standards for communication and personal responsibility to the benefit of all discipline areas Hypothetical Build empirical Develop teacher materials Partnership for 21 st Century Skills ACTRC 2015 5
21 st Century Skills in the Science Skills - Ask for clarification Communicate Build persuasive arguments Flexibility to adapt to an audience - Collaboration Planning Respect the views of others Respond to others Adapt or modify Reflecting Share responsibility 21 st Century Skills in the Science, Media & Technology Skills - Literacy Ability to manage information Determine relationships between information Categorise and classify information Understand ethical practices Assess reliability of sources Identify relevance of information - Technology Literacy Use technology to communicate ideas Illustrate designs Operate equipment Search the internet 21 st Century Skills in the Science Item development Learning & Innovation Skills - Creativity Creating using a variety of methods Identifying original ideas - Critical Thinking Critically analyse information Critique procedures - Problem Solving Make inferences from gathered information Design an investigation to solve a problem Execute a strategy or method Generalise Verify solution Identify and define the domain to be assessed List capabilities for the domain For each capability, derive observable behaviours - low, medium, high Identify the link to curriculum for each behaviour Develop assessment items to test competency Conclusion The Science curriculum provides a good platform for assessing many of the 21 st century skills Sets of items can be constructed within science curriculum topics that allow for assessment of level of competence within a skill area Sets of items relating to the same topic can allow a hierarchy of difficulty in which students can demonstrate varying levels of competence Therefore, we can determine not just whether or not the student has the skill but to what extent they can demonstrate the skill within a particular content area e.care@actrc.org j.marabe@actrc.org www.actrc.org www.facebook.com/actrc.org @ACTRC_edu ACTRC 2015 6