Context-Dependent Item Sets

The phrase "Context-dependent item sets" may be fairly new to you, but I'm sure you've seen this type of question before. By way of definition, let me provide you with an example:

Using the picture below, identify the type of weather pictured and label its parts on the lines provided. (4 pts.)

7. Type of weather: ______________

In short, a context-dependent item set consists of a series of questions (2 or more) that make use of a provided context. In order for it to be a true context-dependent item set, students should need to use the display in order to answer the questions. All question types can be used as part of a context-dependent item set. Here are some guidelines for creating these exercises:

1. Define the intended learning outcome(s) that the exercise will be designed to assess.

2. Select or create a display consisting of information that is—
Directly relevant to the intended learning outcome, and
Novel to the students

3. Construct a series of test items that require students to reason with their knowledge and understanding of the subject by analyzing, interpreting, evaluating, and/or drawing inferences from the information in the display.

4. Write each item so that it complies with accepted principles of effective test item construction.

5. Design the page layout so that it calls students’ attention to the dependent relationship between the display and each accompanying test item.

6. Provide adequate directions which describe the tasks the examinees are expected to perform. Students should not be expected to infer what is expected of them.

7. Define the criteria which will be used to evaluate students’ responses.

8. Ask a knowledgeable colleague to review the exercise in terms of—
How well the tasks and content of the exercise match the task and content of the intended learning outcome.
The accuracy, completeness, and relevance of the scoring criteria.

9. Revise the exercise as needed.

10. Use the exercise on a trial basis. Analyze students’ responses and make further refinements.