Orthogonality of IAT and GATA Results: The Worse, the Better?

Authors

DOI:

https://doi.org/10.14515/monitoring.2023.6.2478

Keywords:

social action theory, structural theory of attitude, dual process, dual system theory, reasoned action approach, theory of cultural evolution, graphical association test of attitude, DST, RAA, GATA, IAT

Abstract

In the previous article “Comparative Analysis of Implicit GATA and IAT Measures: Unity in Diversity” (No. 5 / 2023 of the journal “Monitoring of Public Opinion: Economic and Social Changes”), the authors presented a rationale for theoretical relevance and described in detail the tools of the methodological experiment on assessing the convergent validity of the two methods for measuring implicit factors of social action, Graphical Association Test of Attitude (GATA) and Implicit Association Test (IAT). This study elaborates this work and is aimed, firstly, at checking the reproducibility of previously identified differences between the measurement results of these two methods, and secondly, at studying the connection of the detected differences with the characteristics of the GATA and its validity. The results show that differences in test scores are reproducible, but are explained not by “bad” but by “good” GATO performance: the authors show that GATO scores that are more inadequate in terms of internal validity are associated with greater similarity between them and IAT scores.

Author Biographies

Oleg L. Chernozub, Institute of Sociology of FCTAS RAS

  • Institute of Sociology of FCTAS RAS, Moscow, Russia
    • Cand. Sci. (Soc.), Leading Researcher

Larisa Yu. Shuraeva, State University of Management

  • State University of Management, Moscow, Russia
    • Cand. Sci. (Psych.), Associate Professor at the Department of Sociology, Psychology of Management and History

References

Чернозуб О.Л. К вопросу о локализации источников эрозии валидности современных электоральных исследований // Мониторинг общественного мнения: Экономические и социальные перемены. 2017. № 5. С. 31—48. https://doi.org/10.14515/monitoring.2017.5.03.

Chernozub O. L. (2017) Detection of Validity-Related Faults in the Modern Electoral Studies. Monitoring of Public Opinion: Economic and Social Changes. No. 3. P. 31—48. https://doi.org/10.14515/monitoring.2017.5.03.

Чернозуб О. Л. (2018) Выявление аффективной компоненты электоральной установки: создание и валидизация графического ассоциативного теста отношения // Мониторинг общественного мнения: Экономические и социальные перемены. No 3. С. 3—28. https://doi.org/10.14515/monitoring.2018.3.01

Chernozub O. L. (2018) Affective Components of Electoral Behavior: Design and Validity of Visual Association Test of Attitude. Monitoring of Public Opinion: Economic and Social Changes. No. 3. P. 3—28. https://doi.org/10.14515/monitoring.2018.3.01.

Чернозуб О. Л., Белоножко М. Л. Сравнительный анализ имплицитных измерений ГАТО и IAT: единство в многообразии // Мониторинг общественного мнения: экономические и социальные перемены. 2023. № 5. С. 221—239. https://doi.org/10.14515/monitoring.2023.5.2413.

Chernozub O. L., Belonozhko M. L. (2023) Comparative Analysis of Implicit GATA and IAT Measures: Unity in Diversity. Monitoring of Public Opinion: Economic and Social Changes. No. 3. P. 221—239. https://doi.org/10.14515/monitoring.2023.5.2413.

Ajzen I. (1991) The Theory of Planned Behavior. Organizational Behavior and Human Decision Processes. Vol. 50. No. 2. P. 179-211.

Bandura A. (1986) Social Foundations of Thought and Action: A Social Cognitive Theory. Englewood Cliffs, N.J.: Prentice-Hall.

Bourdieu P. (1980) The Logic of Practice. Stanford, CA: Stanford University Press.

Chernozub O. L. (2020) Implicit Factors and Voting Behaviour Inconsistency: From Theoretical Concept to Empirical Phenomenon. Monitoring of Public Opinion: Economic and Social Changes. No. 4. P. 17—40. https://doi.org/10.14515/monitoring.2020.4.1584.

Chernozub O. L. (2022a) The Two-Component Model of Behavior Factors: Evidences of Orthogonality of Explicit and Implicit Factors. RUDN Journal of Sociology. Vol. 22. No. 1. P. 70-83. https://doi.org/10.22363/2313-2272-2022-22-1-70-83.

Chernozub O. L. (2022b) Theory of (Un)Planned Behavior? How our behavioral predictions suffer from “unplanned” actions. The Russian Sociological Review. Vol. 21. No. 4. P. 82-105. https://doi.org/10.17323/1728-192x-2022-4-82-105.

Chernozub O.L. (2023) Graphic Associative Test of Attitudes as a Convenient Implicit Measurement Tool for Mass Polls. RUDN Journal of Sociology. Vol. 23. No. 1. P. 122-141. https://doi.org/10.22363/2313-2272-2023-23-1-122-141.

Collins R. (1981) On the Microfoundations of Macrosociology. The American Journal of Sociology. Vol. 86. No. 5. P. 984-1014.

Dew I., Cabeza R. (2011) The Porous Boundaries between Explicit and Implicit Memory: Behavioral and Neural Evidence. The Year in Cognitive Neuroscience. Vol. 1224. No. 1. P. 174-190. https://doi.org/10.1111/j.1749-6632.2010.05946.x.

Evans J. (2008) Dual-Processing Accounts of Reasoning, Judgment, and Social Cognition. Annual Review of Psychology. Vol. 59. P. 255-278.

Evans J. (2008) Dual-Processing Accounts of Reasoning, Judgment, and Social Cognition. Annual Review of Psychology. Vol. 59. P. 255-278. https://doi.org/10.1146/annurev.psych.59.103006.093629.

Evans J. (2003) In Two Minds: Dual Process Accounts of Reasoning. Trends in Cognitive Science. Vol. 7. No. 10. P. 454-459.

Fazio R. (1990). The Role of Attitudes in Memory-Based Decision Making. Journal of Personality and Social Psychology. Vol. 59. No. 4. P.614-22. https://doi.org/10.1037/0022-3514.59.4.614.

Fazio R. (2007) Attitudes as Object-Evaluation Associations of Varying Strength. Social Cognition. Vol. 25. No. 5. P. 603–637. https://doi.org 10.1521/soco.2007.25.5.603.

Fishbein M. (1967). Attitude and the Prediction of Behavior. In: Readings in Attitude Theory and Measurement. New York: Wiley. P. 477–492.

Fishbein M., Ajzen I. (1975) Belief, Attitude, Intention, and Behavior: An Introduction to Theory and Research. Reading, MA: Addison-Wesley.

Fishbein M., Ajzen I. (2011) Predicting and Changing Behavior: The Reasoned Action Approach. New York, NY: Psychology Press.

Friedman M., Savage L.J. (1948) Utility Analysis of Choices Involving Risk. Journal of Political Economy. Vol. 56. No. 4. P. 279—304.

Gibbons F., Gerrard M., Blanton H., Russell D. (1998) Reasoned Action and Social Reaction: Willingness and Intention as Independent Predictors of Health Risk. Journal of Personality and Social Psychology. Vol. 74. No. 5. P. 1164–1180. https://doi.org/10.1037/0022-3514.74.5.1164.

Gilovich T., Griffin D. (2002) Introduction—Heuristics and Biases: Then and Now. In: T. Gilovich, D. Griffin, D. Kahneman (eds.) Heuristic and Biases: The Psychology of Intuitive Judgment. New York, NY: Cambridge University Press. P. 1–18.

Graefe A. (2014) Accuracy of Vote Expectation Surveys in Forecasting Elections. Public Opinion Quarterly. Vol. 78. P. 204—232. https://doi.org/10.1093/poq/nfu008.

Greenwald A., McGhee D. E., Schwartz J. L. K. (1998) Measuring Individual Differences in Implicit Cognition: The Implicit Association Test. Journal of Personality and Social Psychology. Vol. 74. No. 6. 1464-1480.

Greenwald A.G., Poehlman T. A., Uhlmann E. L., Banaji M. R. (2009a). Understanding and Using the Implicit Association Test: Iii. Meta-Analysis of Predictive Validity. Journal of Personality and Social Psychology. Vol. 97. No. 1. P. 17-41.

Greenwald A.G., Smith C.T., Sriram N., Bar-Anan Y., Nosek B.A. (2009b) Implicit Race Attitudes Predicted Vote in the 2008 U.S. Presidential Election. Analyses of Social Issues and Public Policy. Vol. 9. No. 1. P. 241-253. https://psycnet.apa.org/doi/10.1111/j.1530-2415.2009.01195.x.

Hofmann W., Friese M., Strack F. (2009) Impulse and Self-Control from a Dual-Systems Perspective. Perspectives on Psychological Science. Vol. 4. No. 2. P. 162-176.

Janz N., Becker M. (1984) The Health Belief Model: A Decade Later. Health Education & Behavior. Vol. 11. No. 1. P. 1–47. https://doi.org/10.1177/109019818401100101.

Joas H. (1996) The Creativity of Action. Chicago, IL: University of Chicago Press.

Kahneman D., Frederick S. (2002) Representativeness Revisited: Attribute Substitution in Intuitive Judgment. In: T. Gilovich, D. Griffin, D. Kahneman (eds.) Heuristic and Biases: The Psychology of Intuitive Judgment. New York, NY: Cambridge University Press. P. 49–81.

Kahneman D. (2011) Thinking, Fast and Slow. New York, NY: Farrar, Straus and Giroux.

Leschziner V., Green A. (2013) Thinking about Food and Sex: Deliberate Cognition in the Routine Practices of a Field. Sociological Theory. Vol. 31. P. 116—144.

Lizardo O., Strand M. (2010) Skills, Toolkits, Contexts and Institutions: Clarifying the Relationship between Different Approaches to Cognition in Cultural Sociology. Poetics. Vol. 38. No. 2. P. 205–228. https://doi.org/10.1016/j.poetic.2009.11.003.

Metcalfe J., Mischel W. (1999) A Hot/Cool-System Analysis of Delay of Gratification: Dynamics of Willpower. Psychological Review. Vol. 106. No. 1. P. 3–19. https://doi.org/10.1037/0033-295X.106.1.3.

Moors A., Spruyt A., De Houwer J. (2010) In Search of a Measure That Qualifies as Implicit: Recommendations Based on a Decompositional View of Automaticity. In: B. Gawronski, K. B. Payne (eds.) Handbook of Implicit Social Cognition: Measurement, Theory, and Applications. The Guilford Press. P. 19-37.

Moors A. (2016) Automaticity: Componential, Causal, and Mechanistic Explanations. Annual Review of Psychology. Vol. 67. No. 263-287.

Newson R. (2002) Parameters behind “Nonparametric” Statistics: Kendall’s Tau, Somers’ D and Median Differences. Stata Journal. Vol. 2. No. 1. P. 45—64.

Patterson O. (2014) Making Sense of Culture. Annual Review of Sociology. Vol. 40. P. 1—30.

Perugini M., Richetin J., Zogmaister C. (2010) Prediction of Behavior. In: Handbook of Implicit Social Cognition: Measurement, Theory, and Applications. New York, NY: Guilford Press. P. 255-278.

Roccato M., Zogmaister C. (2010) Predicting the Vote through Implicit and Explicit Attitudes: A Field Research. Political Psychology. Vol. 31. No. 2. P. 249-274. https://doi.org/10.1111/j.1467-9221.2009.00751.x.

Rogers R. (1975) A Protection Motivation Theory of Fear Appeals and Attitude Change. The Journal of Psychology. Vol. 91. No. 1. P. 93-114. https://doi.org/10.1080/00223980.1975.9915803.

Rogers T. (2012) Why Bother Asking? The Limited Value of Self-Reported Vote Intention. Harvard Kennedy School of Government. Faculty Research Working Paper Series. URL: http://EconPapers.repec.org/RePEc:hrv:hksfac:7779639 (accessed: 05.04.2022).

Rothschild D., Wolfers J. (2011) Forecasting Elections: Voter Intentions versus Expectations. SSRN. URL: http://stat.columbia.edu/~gelman/surveys.course/RothschildWolfers2011.pdf (accessed: 24.05.2022).

Savage M., Burrows R. (2007) The Coming Crisis of Empirical Sociology. Sociology. Vol. 41. No. 5. P. 885—899. https://doi.org/10.1177/0038038507080443.

Schimmack U. (2021). The Implicit Association Test: A Method in Search of a Construct. Perspectives on Psychological Science. Vol. 16. No. 2. P. 396—414. https://doi.org/10.1177/1745691619863798.

Shah A. K., Oppenheimer D. M. (2008) Heuristics Made Easy: An Effort-Reduction Framework. Psychological Bulletin. Vol. 134. No. 2. P. 207—222. https://doi.org/10.1037/0033-2909.134.2.207.

Somers R. H. (1962) A New Asymmetric Measure of Association for Ordinal Variables. American Sociological Review. Vol. 27. No. 6. https://doi.org/10.2307/2090408.

Thaler R. H. (2015) Misbehaving: The Making of Behavioral Economics. New York, NY: W. W. Norton & Company.

Published

2023-12-30

How to Cite

Chernozub О. Л., & Shuraeva Л. Ю. (2023). Orthogonality of IAT and GATA Results: The Worse, the Better?. Monitoring of Public Opinion: Economic and Social Changes (ISSN 2219-5467), (6). https://doi.org/10.14515/monitoring.2023.6.2478

Issue

Section

THEORY AND METHODOLOGY

Most read articles by the same author(s)