Open Research Newcastle
Browse

Contact/Sense

composition
posted on 2025-05-12, 11:02 authored by Rewa Wright, Simon Howden
When we feel and sense through machines, are we still ourselves? In a mixed reality where embodied actions and blinding visions are part woman/part machine, the tactile surface of plants is a portal that conjures augmented materialities into existence. At the beginning of the Contact/Sense performance, a single performer sits at an agave attenuata plant, modulating its bio-electrical impulses that have been transposed to audible sound via MIDI. In synchronicity with, and activated by the performer’s hand gestures, bespoke software causes digital augments (designed using augmented reality and computer vision techniques) to fill two large screens, making the HMD display worn by the performer visible to the audience. Negotiating their new and de-limited VR infrared vision, the performer gets up from the agave and walks toward a row of reactive plants, whose leaves they similarly ‘play’ to visually trigger digital augments in combination with a real-time sound scape. The head mounted configuration (VR headset plus Leap Motion) investigates the potential for using the Leap Motion gestural interface attached to a VR headset to produce a new style of performance in mixed reality.

History

Start date

2019-11-17

End date

2019-11-20

Publisher

Association for Computing Machinery (ACM)

Place published

Brisbane

NTRO type of work

  • Original Creative Works | Visual Art

Standalone work/Portfolio

  • Standalone

Language

  • en, English

College/Research Centre

Faculty of Education and Arts

School

School of Creative Industries

Usage metrics

    NTROs

    Categories

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC