HSE Team Wins International Hackathon with BCI Game
A team of post-graduate students and researchers from the HSE Centre for Cognition & Decision Making have invented a multiplayer BCI game, which is won by the player who best controls a robot with their mind.
The IEEE International Symposium on Video and Audio Signal Processing in the Context of Neurotechnologies took place in St. Petersburg, Russia, on June 26th and 27th and featured a hackathon, also called the IEEE Brain Data Bank Challenge. Representing HSE at the hackathon were Dmitry Altukhov, Nikolay Smetanin, and Alexandra Kuznetsova, all researchers with the HSE Centre for Cognition & Decision Making. The three are also part of a neurovisualization methods group headed by Alexey Ossadtchi.
The team developed a game in which two people compete to control a robot that is made from Legos and pours drinks into two glasses. After receiving commands from a player, the robot tilts the bottle over a glass. If the bottle is tipped enough, the drink is poured into the glass. The player’s goal is to pour the entire contents of the bottle into their glass. Players can send the robot three different commands: left, right, or stop.
The commands are given to the robot through a brain-computer interface that recognises imaginary movements of the left or right arm. For example, in order to command the robot to tilt the bottle to the left, the players have to think of themselves moving their left arm. In order to move to the right, the players think of moving their right arm, and in order to stop they just have to relax. The player who best concentrates on the thought-up movements pulls the bottle in their direction with the most strength and, as a result, wins.
HSE’s team placed first and took home the grand prize of $500.
Alexandra Kuznetsova
Despite the fact that the task is presented in the form of a game, multiplayer BCIs open up new areas of research and allow for important applications to be created.
By analysing the process of a game in which users can both compete against and cooperate with one another (by trying to tilt a glass fastest, for instance), we can study mechanisms of social collaboration from a new angle. And from a technical point of view, having several users allows for a larger number of distinct commands to be given and for complex devices to be co-controlled.
In our opinion, the most promising application lies in therapy for those whose motor functions have been impaired as a result of brain damage. As demonstrated in recent studies, using games to rehabilitate patients after a stroke leads to a quicker recovery of motor activity. Further, using a multiplayer BCI for rehabilitation not only requires significant involvement of the patient’s sensorimotor system in carrying out tasks, but it also fosters social collaboration among several patients in the form of a game, thereby positively impacting recovery.
Dmitry Altukhov
Nikolay Smetanin
See also:
‘Scientists Work to Make This World a Better Place’
Federico Gallo is a Research Fellow at the Centre for Cognition and Decision Making of the HSE Institute for Cognitive Research. In 2023, he won the Award for Special Achievements in Career and Public Life Among Foreign Alumni of HSE University. In this interview, Federico discusses how he entered science and why he chose to stay, and shares a secret to effective protection against cognitive decline in old age.
Engine for Game Development Created at HSE University
The ‘Game Engineering and Interactive Systems’ workshop team of the HSE Tikhonov Moscow Institute of Electronics and Mathematics (MIEM) invites everyone to participate in testing the Claw Engine, the first version of their game development program. This new tool allows for processing three-dimensional images and programming one’s own scripts.
'Science Is Akin to Creativity, as It Requires Constantly Generating Ideas'
Olga Buivolova investigates post-stroke language impairments and aims to ensure that scientific breakthroughs reach those who need them. In this interview with the HSE Young Scientists project, she spoke about the unique Russian Aphasia Test and helping people with aphasia, and about her place of power in Skhodnensky district.
Neuroscientists from HSE University Learn to Predict Human Behaviour by Their Facial Expressions
Researchers at the Institute for Cognitive Neuroscience at HSE University are using automatic emotion recognition technologies to study charitable behaviour. In an experiment, scientists presented 45 participants with photographs of dogs in need and invited them to make donations to support these animals. Emotional reactions to the images were determined through facial activity using the FaceReader program. It turned out that the stronger the participants felt sadness and anger, the more money they were willing to donate to charity funds, regardless of their personal financial well-being. The study was published in the journal Heliyon.
Spelling Sensitivity in Russian Speakers Develops by Early Adolescence
Scientists at the RAS Institute of Higher Nervous Activity and Neurophysiology and HSE University have uncovered how the foundations of literacy develop in the brain. To achieve this, they compared error recognition processes across three age groups: children aged 8 to 10, early adolescents aged 11 to 14, and adults. The experiment revealed that a child's sensitivity to spelling errors first emerges in primary school and continues to develop well into the teenage years, at least until age 14. Before that age, children are less adept at recognising misspelled words compared to older teenagers and adults. The study findings have beenpublished in Scientific Reports .
Meditation Can Cause Increased Tension in the Body
Researchers at the HSE Centre for Bioelectric Interfaces have studied how physiological parameters change in individuals who start practicing meditation. It turns out that when novices learn meditation, they do not experience relaxation but tend towards increased physical tension instead. This may be the reason why many beginners give up on practicing meditation. The study findings have been published in Scientific Reports.
Processing Temporal Information Requires Brain Activation
HSE scientists used magnetoencephalography and magnetic resonance imaging to study how people store and process temporal and spatial information in their working memory. The experiment has demonstrated that dealing with temporal information is more challenging for the brain than handling spatial information. The brain expends more resources when processing temporal data and needs to employ additional coding using 'spatial' cues. The paper has been published in the Journal of Cognitive Neuroscience.
Neuroscientists Inflict 'Damage' on Computational Model of Human Brain
An international team of researchers, including neuroscientists at HSE University, has developed a computational model for simulating semantic dementia, a severe neurodegenerative condition that progressively deprives patients of their ability to comprehend the meaning of words. The neural network model represents processes occurring in the brain regions critical for language function. The results indicate that initially, the patient's brain forgets the meanings of object-related words, followed by action-related words. Additionally, the degradation of white matter tends to produce more severe language impairments than the decay of grey matter. The study findings have been published in Scientific Reports.
New Method Enables Dyslexia Detection within Minutes
HSE scientists have developed a novel method for detecting dyslexia in primary school students. It relies on a combination of machine learning algorithms, technology for recording eye movements during reading, and demographic data. The new method enables more accurate and faster detection of reading disorders, even at early stages, compared to traditional diagnostic assessments. The results have been published in PLOS ONE.
HSE University and Adyghe State University Launch Digital Ethnolook International Contest
The HSE Centre for Language and Brain and the Laboratory of Experimental Linguistics at Adyghe State University (ASU) have launched the first Digital Ethnolook International Contest in the Brain Art / ScienceArt / EtnoArt format. Submissions are accepted until May 25, 2024.