Question 1

For criterion-referenced tests,which of the following reliability estimates is recommended?

Accepted Answer

A)   test-retest reliability estimates
B)   alternate-form reliability estimates
C)   split-half reliability estimates
D)   None of these

Question 2

The term coefficient of generalizability refers to

Accepted Answer

A)   how generalizable scores obtained in one situation are to other situations.
B)   test-retest reliability estimates with respect to different "universes."
C)   split-half reliability estimates with respect to different "universes."
D)   None of these

Question 3

The standard error of the difference between two scores is larger than the standard error of measurement for either score because the standard error of the difference between the two scores is affected by

Accepted Answer

A)   the true score variance of each score.
B)   the standard deviation of each score summed.
C)   the measurement error inherent in both scores.
D)   All of these

Question 4

Why might ability test scores among testtakers most typically vary?

Accepted Answer

A)   because of the true ability of the testtaker
B)   because of irrelevant, unwanted influences
C)   Both because of the true ability of the testtaker and because of irrelevant, unwanted influences
D)   None of these

Question 5

Which of the following statements is TRUE regarding the differences between a power test and a speed test?

Accepted Answer

A)   Power tests involve physical strength; speed tests do not.
B)   In a power test, the testtaker has time to complete all items; in a speed test, a specific time limit is imposed.
C)   In a power test, a broad range of knowledge is assessed; in a speed test, a narrower range of knowledge is assessed.
D)   Both in a power test, the testtaker has time to complete all items; in a speed test, a specific time limit is imposed and in a power test, a broad range of knowledge is assessed; in a speed test, a narrower range of knowledge is assessed.

Question 6

The fact that cultural factors may be operating to weaken an item's ability to discriminate between groups is evident from

Accepted Answer

A)   a general lack of reliability in culture-specific tests.
B)   latent trait theory.
C)   Georg Rasch's unauthorized biography, You Can Never Be Too Rich or Too "Rasch."
D)   None of these

Question 7

Which of the following is TRUE about systematic and unsystematic error in the assessment of physical and psychological abuse?

Accepted Answer

A)   Few sources of unsystematic error exist, due to the nature of what is being assessed.
B)   Few sources of systematic error exist.
C)   Gender represents a source of systematic error.
D)   None of these

Question 8

Which of the following factors may influence a split-half reliability estimate?

Accepted Answer

A)   fatigue
B)   anxiety
C)   item difficulty
D)   All of these

Question 9

When more than two scorers are used to determine inter-scorer reliability,the statistic of choice is

Accepted Answer

A)   Pearson r.
B)   Spearman's rho.
C)   KR-20.
D)   coefficient alpha.

Question 10

If items on a test are measuring very different traits,estimates of reliability yielded from split-half methods will typically be ________ as compared with estimates from KR-20.

Accepted Answer

A)   higher
B)   lower
C)   similar
D)   approximately the same

Question 11

Which of the following statements is TRUE about coefficient alpha?

Accepted Answer

A)   Kuder thought it to be single best measure of reliability.
B)   It was first conceived by Alfalfa Alpha.
C)   It is a characteristic of a particular set of scores, not of the test itself.
D)   None of these

Question 12

Which source of error variance affects parallel- or alternate-form reliability estimates but does not affect test-retest estimates?

Accepted Answer

A)   fatigue
B)   learning
C)   practice
D)   item sampling

Question 13

Item response theory (IRT) focuses on the

Accepted Answer

A)   circumstances that inspired the development of the test.
B)   test administration variables.
C)   individual items of a test.
D)   "how and why" of the Interborough Rapid Transit line.

Question 14

The more homogeneous a test is,the

Accepted Answer

A)   less inter-item consistency it can be expected to have.
B)   more utility the test has for measuring multifaceted variables.
C)   more inter-item consistency it can be expected to have.
D)   None of these

Question 15

Generalizability theory is most closely related to

Accepted Answer

A)   developing norms.
B)   item analysis.
C)   test reliability.
D)   the way things are "in general."

Question 16

A score earned by a testtaker on a psychological test may BEST be viewed as equal to

Accepted Answer

A)   the raw score plus the observed score.
B)   the error score.
C)   the true score.
D)   the true score plus error.

Question 17

Which of the following is TRUE for parallel forms of a test?

Accepted Answer

A)   The means of the observed scores are equal for the two forms.
B)   The variances of the estimated scores are equal for the two forms.
C)   The means and variances of the observed scores are equal for the two forms.
D)   The means and variances of the estimated scores are equal for the two forms.

Question 18

Different types of reliability coefficients

Accepted Answer

A)   all reflect the same sources of error variance.
B)   may reflect different sources of error variance.
C)   never reflect the same source of error variance.
D)   reflect on error variance during leisure activities.

Question 19

If a student received a score of 50 on a math test with a standard error of measurement of 3,which of the following statements would be TRUE of the "true score"?

Accepted Answer

A)   In 68% of the cases, the "true score" would be expected to be between 44 and 56.
B)   In 68% of the cases, the "true score" would be expected to be between 47 and 53.
C)   In 95% of the cases, the "true score" would be expected to be between 47 and 53.
D)   In 95% of the cases, the "true score" would be expected to be between 44 and 56.

Question 20

In classical test theory,there exists only one true score.In Cronbach generalizability theory,how many "true scores" exist?

Accepted Answer

A)   one
B)   as many as the number of times the test is administered to the same individual
C)   many, depending on the number of different universes
D)   None of these

Exam 5: Reliability

When more than two scorers are used to determine inter-scorer reliability,the statistic of choice is

Correct AnswerverifiedShow Answer

A score earned by a testtaker on a psychological test may BEST be viewed as equal to

Correct AnswerverifiedShow Answer

Different types of reliability coefficients

Correct AnswerverifiedShow Answer

Which source of error variance affects parallel- or alternate-form reliability estimates but does not affect test-retest estimates?

Correct AnswerverifiedShow Answer

In classical test theory,there exists only one true score.In Cronbach generalizability theory,how many "true scores" exist?

Correct AnswerverifiedShow Answer

For criterion-referenced tests,which of the following reliability estimates is recommended?

Correct AnswerverifiedShow Answer

The more homogeneous a test is,the

Correct AnswerverifiedShow Answer

If a student received a score of 50 on a math test with a standard error of measurement of 3,which of the following statements would be TRUE of the "true score"?

Correct AnswerverifiedShow Answer

Which of the following statements is TRUE regarding the differences between a power test and a speed test?

Correct AnswerverifiedShow Answer

Which of the following statements is TRUE about coefficient alpha?

Correct AnswerverifiedShow Answer

If items on a test are measuring very different traits,estimates of reliability yielded from split-half methods will typically be ________ as compared with estimates from KR-20.

Correct AnswerverifiedShow Answer

The fact that cultural factors may be operating to weaken an item's ability to discriminate between groups is evident from

Correct AnswerverifiedShow Answer

Generalizability theory is most closely related to

Correct AnswerverifiedShow Answer

Which of the following is TRUE about systematic and unsystematic error in the assessment of physical and psychological abuse?

Correct AnswerverifiedShow Answer

The term coefficient of generalizability refers to

Correct AnswerverifiedShow Answer

The standard error of the difference between two scores is larger than the standard error of measurement for either score because the standard error of the difference between the two scores is affected by

Correct AnswerverifiedShow Answer

Why might ability test scores among testtakers most typically vary?

Correct AnswerverifiedShow Answer

Which of the following is TRUE for parallel forms of a test?

Correct AnswerverifiedShow Answer

Which of the following factors may influence a split-half reliability estimate?

Correct AnswerverifiedShow Answer

Item response theory (IRT) focuses on the

Correct AnswerverifiedShow Answer

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified

Correct Answer
verified