The project addresses scientific, pedagogical, and technological challenges. Scientific challenges include gaining a deeper understanding of multisensory integration in typically developed and impaired children and identifying the most suitable modalities to teach specific concepts. Pedagogical challenges include the definition of a multisensory embodied and enactive pedagogical framework for teaching and learning arithmetic and geometric concepts, to be applied in a similar way to both typically developed and impaired children. Technological challenges include the development of software modules for real-time analysis of nonverbal motoric affective and social interaction, of software modules for sonification and active listening to sound and music content, and for visual and haptic feedback, of an integration platform and of prototypes of serious games.
Transhuman Expression; Human-Machine Interaction as a Neutral Base for a New Artistic and Creative Practice
Transhuman Expression investigate the relation between the physical actions and the visual representation with the goal to create a new artistic toll to teach kids concepts of arithmetic and geometry. This is achieved by exploring behavioural and decision-making patterns through extracting them from the underlining logic of our physical behaviour, revealing mathematical and geometrical components. The work assist in the understanding and discovery of patterns, and the creation of rules when repeating a certain act— making the act itself the subject matter of the work.
Liat Grayver
Liat Grayver (Israel 1986) graduated in 2015 with her MFA (Diplom, painting, class of Heribert. C. Ottersbach) and in 2017 from the post-graduate program (Meisterschülerin, painting, class of Heribert. C. Ottersbach) from the Art Academy of Leipzig. At the moment she is doing an extensive year in the Meistersklasse of Joachim Blank (Media Art, HGB Leipzig). Since January 2016, Grayver has been collaborating with the University of Konstanz on the e-David Project, exploring various approaches to integrate robotic and computer languages in the processes of painting and creative image-making.
Various institutions, including ELES Studienwerk, Leonardo Scholarship and the DAAD, have supported Grayver’s work and studies. Her works have been exhibited in galleries, art fairs and museums in Germany, Israel, Switzerland and South Korea. Since 2014, Liat Gravyer is based in Berlin, and works in Berlin, Leipzig, Konstanz and Tel Aviv.
During this residency Liat Grayver collaborated with the weDRAW project that develops multisensory technology to learn maths combined with arts and improve creativeness of children. The artist produced a series of visual imagery in the form of paintings, as well as digital- and video-based materials created by the interaction between human, computer and robotics — investigating the relation between the physical actions (manipulation of materials) and the visual outcome, namely a painting. Liat also collaborated with the University of Konstanz on the e-David Project, exploring various approaches to integrate robotic and computer languages in the processes of painting and creative image-making, and that experience supported the co-creation process within the residency.