Type ······· Thesis, MArch Design for Performance and Interaction, The Bartlett School of Architecture.
Role ······· Hexx’s parent, Design, Programme, Fabrication Robot Arm Operation
Year ······· 2018-2019

Team······· Me, Sana Yamaguchi and Parvin Farahzade


Ars Electronica 2018, Linz, Austria
Fifteen Exhibition, The bartlett, London
Ars Electronica 2020 (Online Exhibition)

@heyhexx is an interactive social media responsive robot puppet theatre. The theatre is designed to be viewed through social media platforms. It acts as an intermediary between the digital and physical worlds, The robot and HexxWorld. It aims to make the abstract concept of emotions, in the context of social media interaction, easily understandable by translating it into puppet theatre in the physical space.

The project combines elements of puppet theatre, robotics, real-time interaction, and data analytics.
People can interact with Hexx the robot by sending it a tweet, which Hexx will analyse for the emotion contained within it.

Hexx and the environment that it lives in (the set) will display physical behaviour in response to this emotion in real-time. At the same time, a video is taken of Hexx and its environment, and this video gets sent to the person who originally sent the tweet.

Interaction System

For the interaction system, we have built automated software to stream incoming tweets that mention the twitter handle @heyhexx, and we then analyse these tweets for their emotion using IBM Watson. The emotion then gets sent to the physical installation, and the software records a video in real time of the short theatre piece, and sends the video back through twitter.
Physical Installation

Puppetry, theatre, mechanics, and paper craft are the main elements of the concept. The set is comprised of dynamic origami structures that can move and be animated to display different emotive behaviours through use of various mechanical techniques.