Identifying Flawed Matching Items

Determine what is wrong with the question below. When you have come to a conclusion, "hover" your mouse button over the center of the blue rectangle below the question. If the answer isn't revealed, see the answers at the bottom of the page.

Question: Below on the right side is a list of four examples of validity evidence. Correctly match each of these examples with the type of evidence listed on the left that best defines each example. [For example: 1A, 2D, etc.] Use each type of evidence only once.

1. Reliability	A. Scores on an exercise survey are correlated with results of a stress test.
2. Internal	B. Compare test’s tasks to school’s curriculum goals and textbook series to see if they match.
3. External	C. Test X provides three subscores to emotional stability. The test was administered and a factor analysis was performed on the items.
4. Content	D. Three different teachers are asked to score a subjective history test to see if they could accurately apply the scoring keys.

[Answers: 1D, 2C, 3A, 4B]

What is wrong with the question?

Longer phrases are on right and the same number of items are in both columns, giving perfect matching.

ANSWER KEY

The longer phrases are on right (should be on the left), and there is perfect matching (4 choices in each list).