Advertisement

Evidence Based on Test Content

  • D. Betsy McCoachEmail author
  • Robert K. Gable
  • John P. Madura
Chapter
  • 1.7k Downloads

Abstract

The previous chapter focused on the need for latent constructs in the study of affective characteristics and the array of scaling and measurement issues that need to be addressed in order to justify their treatment as mathematical structures in affective instruments. In this chapter, we introduce the most fundamental concept in instrument development: validity. While validity has no single agreed definition in the larger scientific community, in the area of instrument development it does refer to a very specific evidence gathering process for inferences made about latent quantities of latent constructs. As a result, Chapter 3 can be seen as an extension of the latent construct operationism started in Chapter 2. This evidence gathering process is a recurring one with elements discussed also in Chapters 4, 5, and 6. The test content validity discussed in this chapter is part of a non-statistical judgmental process done by content experts before it is present to respondents. As a result, the chapter is devoted to the methods involved in helping instrument developers translate their conceptual understanding of the affective characteristic into a well-functioning operational construct. This chapter introduces the researchers to the most commonly employed approaches to the process of establishing validity through the test content

Keywords

Validity Judgmental evidence Empirical evidence Instrument content Content validity Conceptual definition of a construct Operational definition of a construct Construct irrelevant variance Construct underrepresentation Unidimensional Index of content validity (CVI) 

References

  1. American Educational Research Association (AERA), American Psychological Association (APA) and National Council on Measurement in Education (NCME). (1999). The standards for educational and psychological testing. Washington, DC: American Educational Research Association.Google Scholar
  2. Beck, C. T., & Gable, R. K. (2001). Ensuring content validity: An illustration of the process. Journal of Nursing Measurement, 9(2), 201–215.PubMedGoogle Scholar
  3. Beck, C. T. (1992). The lived experience of postpartum depression: A phenomenological study. Nursing Research, 41, 166–170.PubMedCrossRefGoogle Scholar
  4. Beck, C. T. (1993). Teetering on the edge: A substantive theory of postpartum depression. Nursing Research, 42, 42–48.PubMedCrossRefGoogle Scholar
  5. Beck, C. T. (1996). Postpartum depressed mothers’ experiences interacting with their children. Nursing Research, 45, 98–104.PubMedCrossRefGoogle Scholar
  6. Beck, C. T., & Gable, R. K. (2000). Postpartum depression screening scale: Development and psychometric testing. Nursing Research, 49, 272–282.PubMedCrossRefGoogle Scholar
  7. Beck, C. H., & Gable, R. K. (2002). Postpartum depression screening scale. Los Angeles: Western Psychological Services.Google Scholar
  8. Borsboom, D., Mellenbergh, G. J., & Van Heerden, J. (2003). Validity and truth. In H. Yanai, A. Okada, K. Shingemasu, Y. Kano, & J. J. Meulman (Eds.), New developments in psychometrics: Proceedings of the international psychometrics society 2001 (pp. 321–328). Tokyo: Springer.Google Scholar
  9. Borsboom, D., Mellenbergh, G. J., & Van Heerden, J. (2004). The concept of validity. Psychological Review, 111, 1061–1071.PubMedCrossRefGoogle Scholar
  10. Clark, L. A., & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7(3), 309–319.CrossRefGoogle Scholar
  11. Colaizzi, P. (1978). Psychological research as the phenomenologist views it. In R. Valle & M. King (Eds.), Existential phenomenological alternative for psychology (pp. 48–71). New York: Oxford University Press.Google Scholar
  12. Cronbach, L. J. (1971). Test validation. In R. L. Thomdike (Ed.), Educational measurement (2nd ed., pp. 443–507). Washington, DC: American Council on Education.Google Scholar
  13. Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281–302.PubMedCrossRefGoogle Scholar
  14. Haynes, S. N., Richard, D. C., & Kubany, E. S. (1995). Content validity in psychological assessment: A functional approach to concepts and methods. Psychological Assessment, 7(3), 238–247.CrossRefGoogle Scholar
  15. Hood, S. B. (2009). Validity in psychological testing and scientific realism. Theory and Psychology, 19(4), 451–473.CrossRefGoogle Scholar
  16. Kane, M. T. (1992). An argument-based approach to validity. Psychological Bulletin, 112(3), 527–535.CrossRefGoogle Scholar
  17. Kane, M. T. (2009). Validating the interpretations and uses of test scores. In R. W. Lissitz (Ed.), The concept of validity: Revisions, new directions, and applications (pp. 39–64). Charlotte: Information Age Publishing.Google Scholar
  18. Loevinger, J. (1957). Objective tests as instruments of psychological theory. Psychological Reports, 3, 635–694.Google Scholar
  19. McKenzie, J. F., Wood, M. L., Kotecki, J. E., Clark, J. K., & Brey, R. A. (1999). Establishing content validity: Using qualitative and quantitative steps. American Journal of Health Behavior, 23, 311–318.CrossRefGoogle Scholar
  20. Messick, S. (1989). Meaning and values in test validation: The science and ethics of assessment. Educational Researcher, 18(2), 5–11.CrossRefGoogle Scholar
  21. Messick, S. (1995). Validity of psychological assessment: Validation of inferences as scientific inquiry into score meaning. American Psychologist, 50, 741–749.CrossRefGoogle Scholar
  22. Popham, W. J. (1978). Criterion-reference measurement. Englewood Cliffs: Prentice Hall.Google Scholar
  23. Sireci, S. G. (2009). Packing and unpacking sources of validity evidence: History repeats itself again. In R. W. Lissitz (Ed.), The concept of validity: Revisions, new directions, and applications (pp. 19–37). Charlotte: Information Age Publishing.Google Scholar
  24. Vogt, D. S., King, D. W., & King, L. A. (2004). Focus groups in psychological assessment: Enhancing content validity by consulting members of the target population. Psychological Assessment, 16(3), 231–243.PubMedCrossRefGoogle Scholar
  25. Waltz, C., Strickland, O., & Lenz, E. (1991). Measurement in nursing research (2nd ed.). Philadelphia: F. A. Davis.Google Scholar
  26. Wilson, H. S., & Hutchinson, S. A. (1991). Triangulation of qualitative methods: Heideggerian hermeneutics and grounded theory. Qualitative Health Research, 1(2), 263–276.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  • D. Betsy McCoach
    • 1
    Email author
  • Robert K. Gable
    • 2
  • John P. Madura
    • 3
  1. 1.Educational Psychology DepartmentUniversity of ConnecticutStorrsUSA
  2. 2.Alan Shawn Feinstein Graduate SchoolJohnson and Wales UniversityStorrsUSA
  3. 3.Department of Educational PsychologyUniversity of ConnecticutStorrsUSA

Personalised recommendations