Please enable JavaScript in your browser.

Olivia Ting - Song Without Words

Abstract blurred image of a person in motion with a trail of letters from dynamic markings used in musical notation suggesting movement, set against a dark background with some regions illuminated in reddish hues.

Above: Cover image: Song without Words

Reflection On Process

In this short documentary interview, Olivia Ting reflects on the creative works produced through the CripTech Incubator.

Above: Debrief Interview

Artist Statement

Olivia Ting is a hard of hearing visual artist, designer, photographer, video projectionist, and pianist. She explores audial perception without hearing and the intersections of sound perception interpreted as speech, noise, and music (organized sound). Without her hearing aid and cochlear implant, she perceives nearly no sounds, so visuals stand in for the audio that she is familiar with, but hears and not hears. Formerly a pre-med major at Pomona College, she went on to a second degree in graphic design at Art Center College of Design in Los Angeles. She worked for design and branding agencies in New York City for several years before returning to San Francisco, where her work expanded to collaborative video projections with dance choreographers and museum exhibits. She received her MFA Art Practice from U.C. Berkeley and is currently freelancing and developing new work reconnecting with her music background.

Above: Voice comprehension flow chart (Vertical version)

View embedded content at: /ting/lipreading/index.html

Above: Lip Reading - Interactive Flowchart

Project Description

An immersive multi-channel projection, Song Without Words renders the gestural continuities between piano, musical conducting and sign language to redefine the phenomenological experience of listening. Inspired by Beethoven’s ‘Choral’ Symphony No. 9, which he composed when he was deaf, Ting’s work comprises three movements (allegro, scherzo, rondo) that layer visual and audio compositions like notes in a chord. Projected on translucent panels arrayed as hanging fragments, the videos signal an environment of splintered audial and visual cues that Deaf and hard of hearing individuals inhabit daily.

Each movement contemplates the technical and ability scripts of Ting’s performances as a pianist, conductor, signer, and listener. Referencing the vibroacoustic method that Helen Keller employed to listen to music, vintage radios introduce a haptic translation of the fourth and final movement of “Ode to Joy” from Symphony No. 9. The installation animates sound as movement, inviting gallery visitors to participate in and reflect on these choreographies and soundscapes. The instruments we listen to and with—from our fingertips to our assistive listening devices—share a special kinship.

Process

Example of projection and fabric setup

View container

Set/video projection design: The Tip of My Tongue with David Herrera Performance Group at Z Space
Artist: Olivia Ting. image
Set/video projection design: The Tip of My Tongue with David Herrera Performance Group at Z Space
Artist: Olivia Ting. image

CripTech Incubator Exhibition, Beall Center for Art and Technology, UC Irvine

View container

image
Artist: Olivia Ting. image
interior of beall
Artist: Olivia Ting. image
OliviaTing_space schematic2B
Artist: Olivia Ting. image
floor plan of beall
Artist: Olivia Ting. image
OliviaTing_space schematic2C
Artist: Olivia Ting. image

Haptic option 1: WEARABLE Around neck and shoulder

Raspberry pi Transducer Sensors

View container

Transducer_1
Artist: Olivia Ting. image
Wearable prototype substrate
Artist: Olivia Ting. image
Grove Haptic Motor
Artist: Olivia Ting. image

Video Development: Movements

1st movement: body and piano 2nd movement: disruptive hearing and missed meaning 3rd movement: Breaking through sound barrier — haptic and visual translation of Beethoven’s 9th Symphony

View container

1stmvmt_projection test
Artist: Olivia Ting. video
IMG_0176
Artist: Olivia Ting. video
2ndmvmt projection test
Artist: Olivia Ting. video
Justin_walkthru
Artist: Olivia Ting. video
IMG_0175
Artist: Olivia Ting. video
2nd movement_5.10.23
Artist: Olivia Ting. video
3rd mvmt_Ode_to_Joy projection test
Artist: Olivia Ting. video
3rd mvmt_3.07.23_sign+conductB
Artist: Olivia Ting. video
1st movement B_5.10.23
Artist: Olivia Ting. video
panels_walking through projection
Artist: Olivia Ting. video

Video Development: Piano as a Body

Looking dynamic notations What sounds that are crucial for comprehension that I cannot hear. Some phonemes are softer than other: consonants. photograph/animations of piano interiority

View container

Piano as a body
Artist: Olivia Ting. image
Piano as a body
Artist: Olivia Ting. animated_image

Audiovisual Installation - Using spatial projection

Projection video is visual exploration of my experiences comparing speech and music and sound The installation is a walk-through where projections are projected on translucent fabric panels that allow projections to fracture and echo on adjacent fabric

View container

Overhead view of proposed installation
Artist: Olivia Ting. image
Side view of installation
Artist: Olivia Ting. image

Video development: Notations of volume and discernment

Looking dynamic notations What sounds that are crucial for comprehension that I cannot hear. Some phonemes are softer than other: consonants. Rests are complete silences - or breaths

View container

Dynamic Notation Chart
Artist: Olivia Ting. image
Phonemes and dynamics . ai
Artist: Olivia Ting. image
English-Phonemic-Chart
Artist: Olivia Ting. image
music-rests-symbols-and-lengths-american-and-british-english-labeling-interval-of-silence-in-a-piece-of-music-marked-by-a-symbol
Artist: Olivia Ting. image

Haptic option 2: Object

Inspired by Helen Keller’s connection through radio Smaller version of a haptic object - conduit through hands, can be carried, placed anywhere on body A loop to hang around neck if needs be

View container

Helen Keller’s connection through radio
Artist: Olivia Ting. image
2.Justin_proximitysound
Artist: Olivia Ting. video
“sonic hack” Spatially designated layers of sound
Artist: Olivia Ting. image
“sonic hack” Spatially designated layers of sound
Artist: Olivia Ting. image

Video development: Visual translation of signing and conducting

Extension of movements in gesture calligraphy Montaged with other images to form a visual conversation

View container

Extension of movements into gesture calligraphy
Artist: Olivia Ting. image
Extension of movements into gesture calligraphy
Artist: Olivia Ting. image
Montaged with other images to form a visual conversation
Artist: Olivia Ting. image
Extension of movements into gesture calligraphy
Artist: Olivia Ting. image
Montaged with other images to form a visual conversation
Artist: Olivia Ting. image
Extension of movements into gesture calligraphy
Artist: Olivia Ting. image
Montaged with other images to form a visual conversation
Artist: Olivia Ting. image
Montaged with other images to form a visual conversation
Artist: Olivia Ting. image
Montaged with other images to form a visual conversation
Artist: Olivia Ting. image
Extension of movements into gesture calligraphy
Artist: Olivia Ting. image
Extension of movements into gesture calligraphy
Artist: Olivia Ting. image
Extension of movements into gesture calligraphy
Artist: Olivia Ting. image
Montaged with other images to form a visual conversation
Artist: Olivia Ting. image
Extension of movements into gesture calligraphy
Artist: Olivia Ting. image
Montaged with other images to form a visual conversation
Artist: Olivia Ting. image
Montaged with other images to form a visual conversation
Artist: Olivia Ting. image

Process Archive

Credits

  • Audio technical support by Luke Dzwonczyk

  • Haptics designed by Lloyd May

  • Music conducting by Wei Cheng

  • ASL signing by Zahna Simon

  • Audio description by Social Audio Description Collective, written & narrated by Oliver Baker

Notes