Digital Body Language
2017, data visualisation, speculative design, ux/ui design
In face-to-face conversations our body sends signals that go beyond the simple choice of words. Tone of voice, gestures and body language are signals that affect how the message is conveyed, whether it’s intentional or not. However, text tools today filter all those signals and leave the receiver with perfectly polished text.
A love letter is no different from a job application if you only squint your eyes. Focusing on the keyboard and the embodied behaviour dependent on its form, we created Digital Body Language, an experiment that speculates on ways technology could mediate human communication.
Try out the experience here
Digital Body Language is a text processor that leaves visible trails of the typing process as part of written text. An algorithm interprets the user’s typing behaviour such as typing speed, pauses, and deletions and translates them into typographical distortions. By manifesting the embodied behaviour into the static text, we aim to bring attention to the human behind the screen and encourage reflection on the way technology shapes the way we communicate.
This experiment takes the form of a web experience where a conversational interface asks the user to answer one personal question, with topics ranging from their family, to relationships, childhood memories and life regrets. Their answer is rendered by the algorithm, and the new text acts as data visualisation that reveals their hesitations, breaks, regrets, and typing habits. All the answers are gathered and displayed in a gallery of anonymous confessions, where readers can engage with the texts in a novel way.
The text distortions add a visual dimension to the text, that together with the words supports the viewer in (over)interpreting the meaning and generating narratives around the process, the context and the person behind the text.
Digital Body Language is not meant to be a tool that facilitates communication, but rather an insightful experience and data visualization that allows us to speculates on digitally mediated communication. We want to encourage reflection on the way technology shapes the way we communicate by embracing the embodied interaction in a digital reality.
A long break between two words increases the spacing between them. A pause inside a word decreases its opacity. The typing speed affects the tracking: a fast phase makes the tracking tight, and a slow phase makes it loose. Deleting a word increases the font size of the next word that will be written.