Adaptation Within a Language: Considerations for Standard Setting

Chad W. Buckendahl, Buros Center for Testing, University of Nebraska, Lincoln, Andrew Blackhurst, University of Cambridge ESOL, and Elaine Rodeck, Buros Center for Testing, University of Nebraska, Lincoln

5/30/2008
(Original Publish Date: 7/8/2006)

Standard setting methods applied to constructed response items often utilize examinee anchor performances as part of the procedures. When implementing these methods, researchers have recommended the importance of representing the range of score points for panelists. However, if there are a variety of ways that a score point might be attained, multiple representations of the score point are likely necessary to illustrate this variation to panelists. This paper describes factors that were considered for a standard setting study that included selecting anchor performances for an English literacy test that is being used as a component of immigration eligibility. The sampling of the performances and other considerations for standard setting are discussed in the context of the Guidelines for Test Adaptation and Translation (International Test Commission, 2000).