Tuesday, March 03, 2015, 2:30 PM – 3:15 PM (PST)

IGNITE SESSIONS

Moderated By:
Ashok Sarathy, Innovations in Testing Program Chair
Rachel Schoenig, Innovations in Testing Program Vice Chair

IGNITE 3 - Don’t Ignore What is Already There: Can Auxiliary Information Improve Formal Assessments?

Practice Area Division(s): Certification/Licensure, Industrial/Organizational, Education
Topic: Program Design

New types of data collected during learning and training can seriously change the nature of formal assessments in the near future. Think about: speed data of the responses in a test, diagnostic information, data from dynamic learning systems, behavior in serious games, and feedback data from tasks and performance evaluations, prior test performances and background data from the respondent. All of these sources of information and data are related to the performance level but are often ignored in formal evaluation of students and employees. Using this information and enhancing and verifying it in a formal assessment could enhance the efficiency and effectiveness of the assessment and its reports.

This ignite session aims to present an overview of potential routes to aggregate information from multiple sources into the reporting of formal assessments. This session describes the characteristics of these types of data and especially how these sources of information can be combined in such a way that richer reports can be delivered about the performance of test takers, decisions are improved and formal assessments times can be reduced. IT and psychometric requirements of the aggregation of data are discussed as well as potential pitfalls in the use of combined data.

Test professionals and those responsible for program design could pick-up ideas for enhancing their assessments and a general audience will get a wider picture of future developments in assessment and the role of more formal and summative assessment in it.

PRESENTER:
Anton Beguin, Cito