Tech Project

GOPROSOCIAL
BrainHuman-machine interactionNeurocinema
Open Call
In Residency
Residency Outcome
An interactive neurocinematic system that uses media for assessing and training emotional dynamics
From Jan. 1, 2017 to Dec. 31, 2020
  • GOPROSOCIAL  A student project from Neurotheatre EID summer school 2018, image by Svetlana Degtyareva
    GOPROSOCIAL Credits: A student project from Neurotheatre EID summer school 2018, image by Svetlana Degtyareva
  • GOPROSOCIAL  Neurocinema architecture, image by Aleksander Valjamae
    GOPROSOCIAL Credits: Neurocinema architecture, image by Aleksander Valjamae
  • GOPROSOCIAL  DEMULTIPLEXIA performance in Brussels, image by Erik Norkroos
    GOPROSOCIAL Credits: DEMULTIPLEXIA performance in Brussels, image by Erik Norkroos

Description of the challenges faced by the Tech Project

What motivates people to help? Dual-process theories of cognition, characterized by Kahneman as “thinking fast and slow” represent an important advance in our understanding of the roles of emotion and reason in motivating human prosocial behavior and empathy. GOPROSOCIAL project a) studies affective chronometry underpinnings of empathic reactions using subjective, behavioral and physiological measures, b) designs, validates and optimizes a novel interactive physiology-based neurocinematic system that uses videos, pictures, sound or virtual reality for assessing and training prosocial behavior based latest neurofeedback research, c) explores other application areas including clinical (mood disorders) and art domains.

Brief description of technology

In an interactive neurocinematic system changes in the psychophysiological reactions of participants (enactors) that are assumed to represent implicit and unconscious reactions of the mind, determine the changes made to the narrative presentation of media in real-time. GOPROSOCIAL will follow database cinema approach (Manovich, 1998) creating a novel audio-visual content to explore emotional narratives for diagnostics of and, ultimately, changes in emotional processing. We will use wireless EEG systems (2 gtec Nautilus systems) and peripheral physiology (EDA, ECG - bitalino) signals to monitor users emotional states. Eye-tracking technology (Tobii Pro Glasses) could be used to determine most effective visual features of videos. Multisensory media effectiveness, narrative structures, individual differences in physiological responses are all open questions ready for artistic exploration. Latest neurocinema development was part of the neurotheatre performance at Bozar Electronic Arts Festival, BEAF'17 in Brussels (http://www.bozar.be/en/activities/129199-neurotheatre-collective-demultiplexia)

What the project is looking to gain from the collaboration and what kind of artist would be suitable

The project is looking for media artists, theatre directors or filmmakers who will experiment with the concept of neurocinema/neuroart. We expect our residents to have technical skills, especially in processing audio-visual media, filmmaking/editing, and/or interactive music/video, algorithmic composing etc. We are interested in exploring different emotional narrative structures within installations, experimental cinema formats, theatre performances etc. We are aiming for a high-impact performance/installation to be shown at a major media art venue or a festival. This should involve audience collective experience that will be interactively driving the dynamics of the performance/film/installation. This work should allow envisioning and reflection on technology-infused futures, questioning the societal and ethical implications of soon-to-be-prevalent technologies such as AI, brain-to-brain communication; and technology-enabled scenarios such as collective minds and decision making.

Resources available to the artist

HCI@TLU group is located in a brand new building in the centre of Tallinn. HCI@TLU has a number of labs. Interaction Design Laboratory is equipped with state of the art hardware and software and has numerous types of input devices. User Experience evaluation lab has hardware and software (a number of wearable EEG systems – g.Nautilus, Tobii Pro Glasses 2 wearable eyetracker, various physiology sensors, behaviour analysis software) and a comprehensive set of alternative input-output devices (Phidgets, Arduino, Sifteo, OpenBCI). Wide network of contacts with local artists groups (e.g., www.mimproject.org) and theatres (NO99, Vaba Lava) will enforce artist residence work.