Study of Emotions in a Cognitive Breakthrough Process Through Facial Recognition
Abstract
The emotions that arise in the processes of teaching and learning in experimental sciences still pose unresolved questions. In this article, we have employed a parametric method that utilizes facial recognition, allowing the real-time identification of emotions and their linkage to specific educational actions. An activity was designed to elicit emotions in a process where initial conjectures collided with facts. The analysis reveals highly intense changes in students’ emotional expressions and the existence of three types of behavior in the face of this dissonance between predictions and observation: 1) surprise; 2) anger; and 3) overlapping of surprise and anger. It seems particularly interesting to consider the specific emotions each learning situation generates for each individual.
Keywords
Facial emotion recognition (FER), Emotions, Artificial intelligence, Hot conceptual change, Cognitive breakthroughReferences
Adegun, I. P. y Vadapalli, H. B. (2020). Facial micro-expression recognition: A machine learning approach. Scientific African, 8, e00465. https://doi.org/10.1016/j.sciaf.2020.e00465
Azari, B., Westlin, C., Satpute, A. B., Hutchinson, J. B., Kragel, P. A., Hoemann, K., Khan, Z., Wormwood, J. B., Quigley, K. S., Erdogmus, D., Dy, J., Brooks, D. H. y Barrett, L. F. (2020). Comparing supervised and unsupervised approaches to emotion categorization in the human brain, body, and subjective experience. Scientific Reports, 10(1), 20284. https://doi.org/10.1038/s41598-020-77117-8
Barrett, L. F. (2017). The theory of constructed emotion: an active inference account of interoception and categorization. Social Cognitive and Affective Neuroscience, 12(1), 1-23. https://doi.org/10.1093/scan/nsw154
Barrett, L. F., Adolphs, R., Marsella, S., Martinez, A. M. y Pollak, S. D. (2019). Emotional Expressions Reconsidered: Challenges to Inferring Emotion From Human Facial Movements. Psychological Science in the Public Interest, 20(1). https://doi.org/10.1177/1529100619832930
Barrett, L. F., Mesquita, B. y Gendron, M. (2011). Context in Emotion Perception. Current Directions in Psychological Science, 20(5), 286-290. https://doi.org/10.1177/0963721411422522
Bellocchi, A. (2019). Early career science teacher experiences of social bonds and emotion management. Journal of Research in Science Teaching, 56(3), 322-347. https://doi.org/10.1002/tea.21520
Bellocchi, A. y Ritchie, S. M. (2015). «I Was Proud of Myself That I Didn’t Give Up and I Did It»: Experiences of Pride and Triumph in Learning Science. Science Education, 99(4), 638-668. https://doi.org/10.1002/sce.21159
Black, J. B., Segal, A., Vitale, J. M. y Fadjo, C. L. (2012). Embodied cognition and learning environment design. En S. Land y D. Jonassen (Eds.), Theoretical foundations of learning environments (pp. 198-223). Routledge. https://doi.org/10.4324/9781410603203
Borrachero, A. B., Brígido, M., Mellado, L., Costillo, E. y Mellado, V. (2014). Emotions in prospective secondary teachers when teaching science content, distinguishing by gender. Research in Science and Technological Education, 32(2), 182-215. https://doi.org/10.1080/02635143.2014.909800
Brun, G., Doguoglu, U. y Kuenzle, D. (2016). Epistemology and Emotions. Routledge. https://doi.org/10.4324/9781315580128
Coppin, G. y Sander, D. (2021). Theoretical approaches to emotion and its measurement. En H. Meiselman (Ed.), Emotion Measurement (pp. 3-37). Elsevier. https://doi.org/10.1016/B978-0-12-821124-3.00001-6
Darvishi, A., Khosravi, H., Sadiq, S. y Weber, B. (2022). Neurophysiological Measurements in Higher Education: A Systematic Literature Review. International Journal of Artificial Intelligence in Education, 32(2), 413-453. https://doi.org/10.1007/s40593-021-00256-0
Dávila-Acedo, M. A., Cañada, F., Sánchez-Martín, J., Airado-Rodríguez, D. y Mellado, V. (2021). Emotional performance on physics and chemistry learning: the case of Spanish K-9 and K-10 students. International Journal of Science Education, 43(6), 823-846. https://doi.org/10.1080/09500693.2021.1889069
De Gelder, B. (2006). Towards the neurobiology of emotional body language. Nature Reviews Neuroscience, 7(3), 242-249. https://doi.org/10.1038/nrn1872
Delors, J. (1996). Learning: the treasure within. Report to UNESCO of the international commission on education for the twenty-first century.
Dolan, R. J. (2002). Emotion, Cognition, and Behavior. Science, 298(5596). https://doi.org/10.1126/science.1076358
Driver, R. y Easley, J. (1978). Pupils and paradigms: A review of literature related to concept development in adolescent science students. Studies in Science Education, 5(1). https://doi.org/10.1080/03057267808559857
Driver, R., Guesne, E. y Tiberghein, A. (1985). Children’s ideas in science. Open University Press.
Duit, R. (1999). Conceptual Change Approaches in Science Education. En New perspectives on conceptual change.
Ekman, P. y Friesen, W. V. (1978). Facial Action Coding System. Palo Alto CA Consulting, (2). Consulting Psychologists Press.
Ekman, P., Friesen, W. V. y Hager, J. C. (2002). The facial action coding system CD-ROM. Research Nexus.
Engelmann, K. y Bannert, M. (2021). Analyzing temporal data for understanding the learning process induced by metacognitive prompts. Learning and Instruction, 72(2021), 101205. https://doi.org/10.1016/j.learninstruc.2019.05.002
Ezquerra, A., Agen, F., Rodríguez-Arteche, I. y Ezquerra-Romano, I. (2022). Integrating Artificial Intelligence into Research on Emotions and Behaviors in Science Education. Eurasia Journal of Mathematics, Science and Technology Education, 18(4), em2099. https://doi.org/10.29333/ejmste/11927
Ezquerra, A., Agen, F., Toma, R. B. y Ezquerra-Romano, I. (2023). Using applying facial emotion recognition to research emotional phases in an inquiry-based science activity. Research in Science & Technological Education, 1-24. https://doi.org/10.1080/02635143.2023.2232995
Fernández-Carro, R., Vílchez, J. E., Vílchez-González, J. M. y Ezquerra, A. (2023). Multivariate Analysis of Beliefs in Pseudoscience and Superstitions Among Pre-service Teachers in Spain. Sci & Educ, 32(4), 909-925. https://doi.org/10.1007/s11191-022-00354-y
Fredricks, J. A. (2011). Engagement in School and Out-of-School Contexts: A Multidimensional View of Engagement. Theory Into Practice, 50(4), 327-335. https://doi.org/10.1080/00405841.2011.607401
Graesser, A. C. (2020). Emotions are the experiential glue of learning environments in the 21st century. Learning and Instruction, 70(2020), 101212. https://doi.org/10.1016/j.learninstruc.2019.05.009
Jeong, J. S., González-Gómez, D. y Cañada-Cañada, F. (2016). Students’ Perceptions and Emotions Toward Learning in a Flipped General Science Classroom. Journal of Science Education and Technology, 25(5), 747-758. https://doi.org/10.1007/s10956-016-9630-8
Ko, B. C. (2018). A brief review of facial emotion recognition based on visual information. Sensors (Switzerland), 18(2), 401. https://doi.org/10.3390/s18020401
Lämsä, J., Hämäläinen, R., Koskinen, P. y Viiri, J. (2018). Visualising the temporal aspects of collaborative inquiry-based learning processes in technology-enhanced physics learning. International Journal of Science Education, 40(14), 1697-1717. https://doi.org/10.1080/09500693.2018.1506594
Laukenmann, M., Bleicher, M., Fu, S., Gläser-Zikuda, M., Mayring, P. y von Rhöneck, C. (2003). An investigation of the influence of emotional factors on learning in physics instruction. International Journal of Science Education, 25(4), 489-507. https://doi.org/10.1080/09500690210163233
Liaw, H., Yu, Y. R., Chou, C. C. y Chiu, M. H. (2021). Relationships between Facial Expressions, Prior Knowledge, and Multiple Representations: a Case of Conceptual Change for Kinematics Instruction. Journal of Science Education and Technology, 30(2), 227-238. https://doi.org/10.1007/s10956-020-09863-3
Loderer, K., Pekrun, R. y Plass, J. L. (2019). Emotional Foundations of Game-based Learning. En J. L. Plass, E. Richard, R. E. Mayery B. D. Homer (Eds.), The Handbook of Game-based Learning (pp. 111-151). MIT Press.
Lombardi, D. y Sinatra, G. M. (2013). Emotions about teaching about human-induced climate change. International Journal of Science Education, 35(1), 167-191. https://doi.org/10.1080/09500693.2012.738372
Marcos-Merino, J. M. (2019). Análisis de las relaciones emociones-aprendizaje de maestros en formación inicial con una práctica activa de Biología. Revista Eureka sobre enseñanza y divulgación de las ciencias, 16(1), 1603. https://doi.org/10.25267/rev_eureka_ensen_divulg_cienc.2019.v16.i1.1603
Marcos-Merino, J. M., Esteban Gallego, M. R. y Gómez Ochoa de Alda, J. A. (2022). Conocimiento previo, emociones y aprendizaje en una actividad experimental de ciencias. Enseñanza de las Ciencias. Revista de investigación y experiencias didácticas, 40(1). https://doi.org/10.5565/rev/ensciencias.3361
Matusovich, H. y McCord, R. (2012). Work in progress: Does motivation matter for conceptual change? exploring the implications of «hot cognition» on conceptual learning. Proceedings - Frontiers in Education Conference, FIE. https://doi.org/10.1109/FIE.2012.6462394
McCloskey, M. (1983). Intuitive physics. Scientific American, 284(4), 122-130.
McLeod, D. B. (1992). Research on affect in mathematics education: A reconceptualization. En D. A. Grouws (Ed.), Handbook of research on mathematics teaching and learning (pp. 575-595). Macmillan.
Mellado Jiménez, V., Borrachero, A. B., Brígido, M., Melo, L. V., Dávila, M. A., Cañada, F., Conde, M. C., Costillo, E., Cubero, J., Esteban, R., Martínez, G., Ruiz, C., Sánchez, J., Garritz, A., Mellado, L., Vázquez, B., Jiménez, R. y Bermejo, M. L. (2014). Las emociones en la enseñanza de las ciencias. Enseñanza de las Ciencias. Revista de investigación y experiencias didácticas, 32(3). https://doi.org/10.5565/rev/ensciencias.1478
Murphy, P. K. y Alexander, P. A. (2008). The role of knowledge, beliefs, and interest in the conceptual change process: A synthesis and meta-analysis of the research. En International handbook of research on conceptual change.
Novak, J. y Mintzes, J. J. (1988). Enseñanza de las Ciencias para Entendimiento. Academic Press.
Pekrun, R. (2006). The control-value theory of achievement emotions: Assumptions, corollaries, and implications for educational research and practice. Educational Psychology Review, 18(4), 315-341. https://doi.org/10.1007/s10648-006-9029-9
Pekrun, R., Goetz, T., Frenzel, A. C., Barchfeld, P. y Perry, R. P. (2011). Measuring emotions in students’ learning and performance: The Achievement Emotions Questionnaire (AEQ). Contemporary Educational Psychology, 36(1), 36-48. https://doi.org/10.1016/j.cedpsych.2010.10.002
Pekrun, R. y Linnenbrink-Garcia, L. (2014). International handbook of emotions in education. En International Handbook of Emotions in Education. https://doi.org/10.4324/9780203148211
Piaget, J. y García, R. (1973). Las explicaciones causales. Barral Editores.
Pintrich, P. R., Marx, R. W. y Boyle, R. A. (1993). Beyond Cold Conceptual Change: The Role of Motivational Beliefs and Classroom Contextual Factors in the Process of Conceptual Change. Review of Educational Research, 63(2). https://doi.org/10.3102/00346543063002167
Posner, G. J., Strike, K. A., Hewson, P. W. y Gertzog, W. A. (1982). Accommodation of a scientific conception: Toward a theory of conceptual change. Science Education, 66(2). https://doi.org/10.1002/sce.3730660207
Pozo, J. I. y Carretero, M. (1987). Del Pensamiento Formal a las Concepciones Espontáneas: ¿Qué Cambia en la Enseñanza de la Ciencia?». Infancia y Aprendizaje, 10(38), 35-52. https://doi.org/10.1080/02103702.1987.10822161
Pozo, J. I., del Puy Pérez, M., Sanz, A. y Limón, M. (1992). Las ideas de los alumnos sobre la ciencia como teorías implícitas. Infancia y Aprendizaje, 15(57). https://doi.org/10.1080/02103702.1992.10822321
Pozo, J. I. y Gómez Crespo, M. Á. (1998). Aprender y enseñar ciencia. Ediciones Morata.
Rivière, A. (1991). Objetos con mente. Alianza.
Rowlands, M. (2010). The new science of the mind. The MIT Press.
Schiller, D. (2020). For Now We See through an AI Darkly; but Then Face-to-Face: A Brief Survey of Emotion Recognition in Biometric Art. Przegląd Kulturoznawczy, 3(45), 230-260. https://doi.org/10.4467/20843860PK.20.025.12585
Schnotz, W., Vosniadou, S. y Carretero, M. (Eds.). (1999). New perspectives in conceptual change research. Elsevier.
Sinatra, G. M. y Taasoobshirazi, G. (2018). The Self-Regulation of Learning and Conceptual Change in Science. En D. H. Schunk y J. A. Greene (Eds.), Handbook of Self-Regulation of Learning and Performance (pp. 153-165). Routledge. https://doi.org/10.4324/9781315697048-10
Stöckli, S., Schulte-Mecklenbeck, M., Borer, S. y Samson, A. C. (2018). Facial expression analysis with AFFDEX and FACET: A validation study. Behavior Research Methods, 50(4), 1446-1460. https://doi.org/10.3758/s13428-017-0996-1
Taber, K. S. (2017). The Nature of Student Conceptions in Science. En K. S. Taber y B. Akpan (Eds.), Science Education (pp. 119-131). SensePublishers. https://doi.org/10.1007/978-94-6300-749-8_9
Tomasello, M. (2019). The Cultural Origins of Human Cognition. En The Cultural Origins of Human Cognition. Harvard University Press. https://doi.org/10.2307/j.ctvjsf4jc
Tytler, R. y Osborne, J. (2012). Student attitudes and aspirations towards science. En Second International Handbook f Science Education (pp. 597-625).
Vaessen, M., Van der Heijden, K. y de Gelder, B. (2019). Decoding of emotion expression in the face, body and voice reveals sensory modality specific representations. bioRxiv, 869578. https://doi.org/10.1101/869578
Vázquez Alonso, A. y Manassero Mas, M. A. (2009). Expectativas sobre un trabajo futuro y vocaciones científicas en estudiantes de educación secundaria. Revista electrónica de investigación educativa, 11(1), 1-20.
Viennot, L. (1979). Spontaneous reasoning in elementary dynamics. European Journal of Science Education, 1(2). https://doi.org/10.1080/0140528790010209
Vosniadou, S. (Ed.). (2008). International Handbook of Research on Conceptual Change. Routledge. https://doi.org/10.4324/9780203874813
Vosniadou, S., Vamvakoussi, X. y Skopeliti, I. (2008). The framework theory approach to the problem of conceptual change. En International handbook of research on conceptual change (February 2019).
West, L. H. T. y Pines, A. L. (1985). Cognitive structure and conceptual change. En Educational Psychology. Academic Press.
Published
Downloads
Copyright (c) 2024 Ángel Ezquerra, Sonia Pamplona, Amalia Casas-Mas, Iván Nieto-Gómez
This work is licensed under a Creative Commons Attribution 4.0 International License.
