Assessment Literacy Self-Study Quiz #9
by Tim Newfields
This ongoing column features questions about testing, statistics, and assessment in a quiz format to promote greater assessment literacy.
Suggested answers to the problems below are online at http://jalt.org/test/SSA9.htm.
Part I: Open Questions
What does the term effect size actually mean? How is it commonly measured?
Also, when can an effect size be justifiably regarded as "large"?
What is the difference between the basket and Angoff rating methods?
What are the pros and cons of each procedure? When should they be employed?
What is the university entrance exam item below probably attempting to measure?
How could this item be improved?
Source: Waseda University Faculty of Social Science (2010, February 22). 2010 Waseda Daigaku Shakai
Gakubu Eigo Nyuushi: Dai Ikka. [2010 Waseda University Faculty of Social Science English Entrance Exam,
Section I]. Retrieved on March 1, 2010 from http://nyushi.yomiuri.co.jp/10/sokuho/
What is the John Henry effect? How does it differ from the Hawthorne effect?
How can researchers minimize both these effects?
What steps could be taken to improve the differential validity of a school entrance exam?
How often are such steps seldom taken at institutions that you are familiar with?