评价与测量基本课件20116TestDevelopment.pptVIP

VI) Test Development Stage 1: Design Describing, Identifying, Selecting, Defining, Developing, Allocating, Managing; Stage 2: Operationalization Selecting, Specifying, Writing; Stage 3: Administration Administering, Collecting feedback, Analyzing, Archiving; STAGES/ PRODUCTS ACTIVITIES Test Development Considerations of design components qualities of usefulness in developing test task Design Statement To ensure that performance on the test task will correspond as closely as possible to language use, and that the test scores will be maximally useful for their intended purposes. A design statement is a document that provides us with a principle basis and it includes the following components: 1) a description of the purpose(s) of the test, 2) a description of the TLU domain and task types; 3) a description of the test takers for whom the test is intended; 4) a description of the construct(s) to be measured; 5) a plan for evaluating the qualities of usefulness; 6) an inventory of required available resources and a plan for their allocation management. Operationalization Blueprint Operationalization involves developing test task specifications for the types of test tasks to be included in the test, and developing a blueprint that describes how test task will be organized for actual tests; It also involves developing and writing the actual test tasks, writing instructions, and specifying the procedures for scoring the test. The blueprint differs from the design statement primarily in terms of the narrowness of the focus it is a detailed plan; A blueprint describes how the test tasks are to be arranged to form the test it include two parts: 1) The task specifications for each type of task that is to be included in the test; 2) The characteristics that pertain to the structure of the test: the number of parts / tasks, the salience of parts/task