Neuroscientists from HSE University Learn to Predict Human Behaviour by Their Facial Expressions
Willingness to donate to charity is written all over the face.
Researchers at the Institute for Cognitive Neuroscience at HSE University are using automatic emotion recognition technologies to study charitable behaviour. In an experiment, scientists presented 45 participants with photographs of dogs in need and invited them to make donations to support these animals. Emotional reactions to the images were determined through facial activity using the FaceReader program. It turned out that the stronger the participants felt sadness and anger, the more money they were willing to donate to charity funds, regardless of their personal financial well-being. The study was published in the journal Heliyon.
The research was supported by a mega-grant from the Russian government as part of the national project ‘Science and Universities.’
Charitable behaviour is a complex psychological process with motives that are not fully understood. Emotional state is one of the key factors influencing the willingness to give one's resources to another. However, the question of how specific emotions are related to donations remains a subject of debate, as previous studies on this topic have yielded conflicting results.
One of the main reasons is methodological limitations in data collection. Most studies on charitable behaviour use subjective methods: volunteers themselves report their emotions and how they affect donations. However, participants do not always understand their feelings or are not willing to speak about them openly. Moreover, depending on the direction of charitable activity (helping sick people, helping animals, supporting environmental initiatives, and others), the same emotions can differently influence the willingness to donate. Therefore, to develop effective charity advertising, it is important to have objective data on the influence of emotions on the willingness to donate, taking into account the goals of fundraising.
Researchers Anna Shepelenko, Vladimir Kosonogov, and Anna Shestakova from the HSE Institute for Cognitive Neuroscience were the first in the world to use an automatic emotion recognition program to evaluate the effectiveness of charity appeals. In the experiment, scientists used FaceReader to record the facial expressions of volunteers while viewing photos of dogs in various conditions, including homeless, domestic, sick, healthy, adult, and puppies. Participants were given 320 rubles, which they could fully or partially donate to the animal aid fund during the experiment. The remaining amount could be kept for themselves.
Dogs were specifically chosen for the study because society's attitude towards them is ambiguous: they can be perceived as both victims and threats. In these conditions, charity appeals can evoke contradictory or hidden emotions that are difficult to detect through surveys or focus groups but can be recognised by facial expressions.
Co-author of the study, Junior Research Fellow at the Centre for Cognition & Decision Making at the Institute for Cognitive Neuroscience, HSE University
Currently, affective computing is still in the early stages of its development and is not widely used in the industry. However, in the coming years, its widespread implementation in various business and scientific fields can be expected. Technologies like FaceReader are already being used for diagnosing mental disorders, improving the quality of online education, assessing customer satisfaction, and in some other areas. Our study clearly shows the prospects of using affective computing to predict the effectiveness of social advertising, creating a basis for further research and practical application.
The main results of the study showed that people are inclined to donate more when charity appeals provoke unpleasant emotions in them. In particular, participants gave larger amounts to animals whose images evoked sadness and anger. These results are confirmed by both self-reports of emotions and affective computing data.
At the same time, for some other emotions, researchers found differences between survey data and FaceReader data. According to self-reports, surprise, disgust, and fear also contributed to increased donations, but FaceReader data did not confirm this. According to the authors, these differences may have arisen due to the timing of emotion recording: the program analysed reactions during the first presentation of pictures and immediately before the donation decision, whereas self-reports were made after a second viewing of the images. This time gap could have changed participants' perception of their emotions.
Additionally, the formulation of questions about specific emotions could have caused cognitive biases and influenced respondents' answers so that they indicated not only the emotions they experienced but also those they considered appropriate depending on the context of the image. Based on this, researchers conclude that affective computing complements self-report data, allowing for a more accurate identification of emotions at the moment of decision-making and reducing the influence of experimental procedures or cognitive biases on research results.
It is noteworthy that donations were associated with the individual perception of the value of money: the higher the subjective significance of the reward for participating in the experiment (320 rubles), the less willing participants were to donate to charity, while their personal level of financial well-being did not affect the amount of donations. This data clarifies the results of earlier publications, which showed contradictions regarding the relationship between financial well-being and the willingness to make donations.
Co-author of the study, Junior Research Fellow at the Centre for Cognition & Decision Making at the Institute for Cognitive Neuroscience, HSE University
This study contributes to the understanding of charitable behaviour, and we hope that the obtained results will be useful for non-profit organisations. At the same time, it is important to note some limitations: our results do not take into account the long-term impact of charity advertising on the audience.
Indeed, unpleasant emotions can increase the amount of donations during initial contact, but regularly repeated negative charity appeals can provoke empathy fatigue or avoidance—people may simply exclude such messages from their information field. Thus, to further study the impact of emotions on charity, longitudinal studies should be conducted, in which changes in donors' behaviour can be registered over several months or even years.
See also:
See, Feel, and Understand: HSE Researchers to Explore Mechanisms of Movement Perception in Autism
Scientists at the HSE Cognitive Health and Intelligence Centre have won a grant from the Russian Science Foundation (RSF) to investigate the mechanisms of visual motion perception in autism. The researchers will design an experimental paradigm to explore the relationship between visual attention and motor skills in individuals with autism spectrum disorders. This will provide insight into the neurocognitive mechanisms underlying social interaction difficulties in autism and help identify strategies for compensating for them.
Scholars Disprove Existence of ‘Crisis of Trust’ in Science
An international team of researchers, including specialists from HSE University, has conducted a large-scale survey in 68 countries on the subject of trust in science. In most countries, people continue to highly value the work of scientists and want to see them take a more active role in public life. The results have been published in Nature Human Behaviour.
Education System Reforms Led to Better University Performance, HSE Researchers Find
A study by researchers at the HSE Faculty of Economic Sciences and the Institute of Education have found that the number of academic papers published by research universities in international journals has tripled in the past eight years. Additionally, universities have developed more distinct specialisations. Thus, sectoral universities specialising in medical, pedagogical, technical, and other fields are twice as likely to admit students to target places. The study has been published in Vocation, Technology & Education.
Scientists Record GRB 221009A, the Brightest Gamma-Ray Burst in Cosmic History
A team of scientists from 17 countries, including physicists from HSE University, analysed early photometric and spectroscopic data of GRB 221009A, the brightest gamma-ray burst ever recorded. The data was obtained at the Sayan Observatory one hour and 15 minutes after the emission was registered. The researchers detected photons with an energy of 18 teraelectronvolts (TeV). Theoretically, such high-energy particles should not reach Earth, but data analysis has confirmed that they can. The results challenge the theory of gamma radiation absorption and may point to unknown physical processes. The study has been published in Astronomy & Astrophysics.
Chemists Simplify Synthesis of Drugs Involving Amide Groups
Chemists from HSE University and the Nesmeyanov Institute of Organoelement Compounds of the Russian Academy of Sciences (INEOS RAS) have developed a new method for synthesising amides, essential compounds in drug production. Using a ruthenium catalyst and carbon monoxide under precisely controlled reaction conditions, they successfully obtained the target product without by-products or complex purification steps. The method has already been tested for synthesising a key component of Vorinostat, a drug used to treat T-cell lymphoma. This approach could lower the cost of the drug by orders of magnitude. The paper has been published in the Journal of Catalysis. The study was supported by the Russian Science Foundation.
Scientists Examine Neurobiology of Pragmatic Reasoning
An international team including scientists from HSE University has investigated the brain's ability to comprehend hidden meanings in spoken messages. Using fMRI, the researchers found that unambiguous meanings activate brain regions involved in decision-making, whereas processing complex and ambiguous utterances engages regions responsible for analysing context and the speaker's intentions. The more complex the task, the greater the interaction between these regions, enabling the brain to decipher the meaning. The study has been published in NeuroImage.
Scientists Present New Solution to Imbalanced Learning Problem
Specialists at the HSE Faculty of Computer Science and Sber AI Lab have developed a geometric oversampling technique known as Simplicial SMOTE. Tests on various datasets have shown that it significantly improves classification performance. This technique is particularly valuable in scenarios where rare cases are crucial, such as fraud detection or the diagnosis of rare diseases. The study's results are available on ArXiv.org, an open-access archive, and will be presented at the International Conference on Knowledge Discovery and Data Mining (KDD) in summer 2025 in Toronto, Canada.
Hi-Tech Grief: HSE Researchers Explore the Pros and Cons of Digital Commemoration
Researchers at HSE University in Nizhny Novgorod have explored how technological advancements are transforming the ways in which people preserve the memory of the deceased and significant events. Digital technologies enable the creation of virtual memorials, the preservation of personal stories and belongings of the deceased, interaction with their digital footprint, and even the development of interactive avatars based on their online activity. However, these technologies not only evoke nostalgia and provide a sense of relief but can also heighten anxiety and fear, and delay the process of accepting loss. The study has been published in Chelovek (The Human Being).
Scientists Find Out Why Aphasia Patients Lose the Ability to Talk about the Past and Future
An international team of researchers, including scientists from the HSE Centre for Language and Brain, has identified the causes of impairments in expressing grammatical tense in people with aphasia. They discovered that individuals with speech disorders struggle with both forming the concept of time and selecting the correct verb tense. However, which of these processes proves more challenging depends on the speaker's language. The findings have been published in the journal Aphasiology.
Implementation of Principles of Sustainable Development Attracts More Investments
Economists from HSE and RUDN University have analysed issues related to corporate digital transformation processes. The introduction of digital solutions into corporate operations reduces the number of patents in the field of green technologies by 4% and creates additional financial difficulties. However, if a company focuses on sustainable development and increases its rating in environmental, social, and governance performance (ESG), the negative effects decrease. Moreover, when the ESG rating is high, digitalisation can even increase the number of patents by 2%. The article was published in Sustainability.