!
!
!
!
!
ICAD!2014!
!
!
20th!International!Conference!on!Auditory!Display!
!
!
!
!
!
!
!
!
!
New!York!University!
!
July!22!–!25,!2014!
!
New!York,!NY
!
2!
!
SCHEDULE!
!
Sunday!June!22,!2014!
Registration!........................................................................................................................................!8:30J14:00!
Workshop!1:!Sonic!Information!Design:!Framework,!Approach,!and!Application!.....................!13:00J17:00!
Workshop!2:!Sonification!for!Sports!and!Performance!..................................................................!9:00J12:00!
Workshop!3:!Collaborative!Sonification!Design!to!Sonify!Scientific!Data!...................................!12:30J15:30!
Workshop!4:!Citygram!Workshop:!Music!via!SpatioJAcoustic!Big!Data!.....................................!15:30J18:00!
Installations!.......................................................................................................................................!14:00J21:30!
Reception!and!Think!Tank!Posters!................................................................................................!18:00J20:30!
!
Monday!June!23,!2014!
Registration!........................................................................................................................................!9:00J15:00!
Opening!Ceremony/Keynote!Presentation!.....................................................................................!9:30J10:30!
Poster!Craze!......................................................................................................................................!10:30J10:50!
Coffee!.................................................................................................................................................!10:50J12:00!
Poster!Presentations!–!Session!1!.......................................................................................................!11:00J12:00!
Concert!Rehearsal!&!Sound!Check!..................................................................................................!11:30J19:00!
Lecture!Presentations!–!Session!1!....................................................................................................!12:00J12:40!
Lunch!................................................................................................................................................!12:40J14:00!
Lecture!Presentations!–!Session!2!...................................................................................................!14:00J15:00!
Poster!Presentations!–!Session!1!......................................................................................................!15:00J16:00!
Coffee!................................................................................................................................................!15:00J16:00!
Lecture!Presentations!–!Session!3!...................................................................................................!16:00J16:40!
Award!Ceremony!&!Concert!............................................................................................................!19:30J21:00!
!
!
!
!
!
3!
Tuesday!June!24,!2014!
Registration!........................................................................................................................................!9:00J15:00!
Lecture!Presentations!–!Session!4!.....................................................................................................!9:30J10:10!
Poster!Craze!.......................................................................................................................................!10:10J10:30!
Poster!Presentations!–!Session!2!......................................................................................................!10:30J11:30!
Coffee!.................................................................................................................................................!10:50J12:00!
Lecture!Presentations!–!Session!5!.....................................................................................................!11:30J12:30!
Lunch!.................................................................................................................................................!12:30J14:00!
Lecture!Presentations!–!Session!6!...................................................................................................!14:00J15:00!
Poster!Presentations!–!Session!2!.....................................................................................................!15:00J16:00!
Coffee!................................................................................................................................................!15:00J16:00!
Lecture!Presentations!–!Session!7!...................................................................................................!16:00J16:40!
Banquet!–!Dinner!Cruise!.................................................................................................................!18:30J22:00!
!
Wednesday!June!25,!2014!
Registration!........................................................................................................................................!9:00J15:00!
Lecture!Presentations!–!Session!8!.....................................................................................................!9:30J10:10!
Poster!Craze!.......................................................................................................................................!10:10J10:30!
Poster!Presentations!–!Session!3!......................................................................................................!10:30J11:30!
Coffee!................................................................................................................................................!10:50J!12:00!
Lecture!Presentations!–!Session!9!....................................................................................................!11:30J12:30!
Lunch!.................................................................................................................................................!12:30J14:00!
Lecture!Presentations!–!Session!10!..................................................................................................!14:00J15:00!
Poster!Presentations!–!Session!3!.....................................................................................................!15:00J16:00!
Coffee!................................................................................................................................................!15:00J16:00!
Open!Mic!&!Closing!Ceremony!......................................................................................................!16:00J16:40!
Earthquake!Sonification!...................................................................................................................!19:30J21:30!
!
!
!
!
4!
A!NOTE!FROM!THE!PRESIDENT!
!
!
Greetings! and! a! very! warm! welcome! to! the! 20th! annual! conference! of! the! ICAD.! We! are! indeed!
fortunate! this! year! in! our! venue,! the! Steinhardt! School! of! Culture,! Education,! and! Human!
Development,!which!promises!to!provide!a!stimulating!and!inspiring!environment!for!our!meeting.!!
It! is! gratifying! that! this! year’s! theme! of! “Big! Data”! reflects! one! of! the! major! issues! not! just! for! our!
Community,!but!of!the!scientific!and!commercial!world!as!a!whole.!Correspondingly,!examples!where!
sonification! provides! demonstrable! and! repeatable! advantages! in! Data! Analytics! are! likely! to! be!
important!in!promoting!wider!recognition!of!our!field.!!
The! ongoing! growth! of! Mobile! Computing,! where! increasing! processing! power! is! being! applied! to!
larger!volumes!of!information!on!devices!with!small!screens,!presents!another!major!area!where!good!
auditory!display!design!can!reduce,!and!in!some!cases!replace!the!heavy!demands!continually!being!put!
upon!the!overloaded!visual!channel.!!
I!believe!that!this!combination!of!Data!Analytics!and!Mobile!Computing!together!present!unparalleled!
opportunities!for!auditory!display!and!sonification!research,!making!this!a!wonderfully!exciting!time!to!
be!a!part!of!this!Community.!At!the!same!time,!if!these!opportunities!bring!increased!recognition,!they!
will!also!bring!increased!visibility!and!scrutiny!of!our!work.!At!last!year’s!ICAD!conference,!and!at!the!
Interactive! Sonification! workshop! that! took! place! at! Fraunhofer! IIS,! Erlangen,! Germany! in! December!
2013,!we!held!significant!discussions!about!ways!to!improve!the!rigor,!transparency!and!repeatability!of!
our!research.!I!believe!these!discussions!are!crucial!to!the!ongoing!reputation!of!our!Community,!and!
look!forward!to!their!further!development!at!this!conference.!It!remains!only!for!me!to!offer!my!sincere!
thanks!to!the!organising!committee,!led!by!Agnieszka!Roginska!and!Tae!Hong!Park!(conference!Chairs)!
and!Norberto!Degara!and!Areti!Andreopoulou!(papers!Chairs),!along!with!many!others,!for!their!hard!
work!in!bringing!this!event!together.!I!wish!you!all!a!highly!successful!and!enjoyable!ICAD!2014.!!
!!!!!!!!
Dr.!Tony!Stockman!
ICAD!President!!
5!
!
6!
!
A!NOTE!FROM!THE!DIRECTOR!OF!NYU’S!DEPARTMENT!OF!MUSIC!AND!PERFORMING!
ARTS!PROFESSSIONS!
!
!
!
!
!
We!are!delighted!with!the!presence!of!the!ICAD!conference!at!NYU!Steinhardt,!which!shares!our!goals!
as!a!research!university!and!our!department's!embrace!of!auditory!display!research!and!sonification!as!
part!of!data!display!of!Big!Data.!!!
Through! our! involvement! in! Big! Data! science/music! we! embrace! urban! science,! sports,! medical,! and!
other!multiJdimensional!data!representation!in!our!own!research!in!this!field!JJ!via!Citygram!and!our!
collaboration!with!CUSP.!!We!address!urban!soundscapes!and!their!complexities!with!respect!to!noise!
pollution,! soundmaps,! and! citizenJscience! efforts! in! getting! community! involved! in! environment!
awareness! through! sensor! networks,! sonification,! telematic! performance! etc.! ! Much! akin! to! music's!
unique!capacity!to!express!the!ineffable,!sound!is!the!representative!core!to!translate!and!represent!data!
that!is!difficult!to!be!visualized.!
!
Dr.!Ronald!Sadoff!
Director,!Music!and!Performing!Arts!Professions!Department,!NYU!Steinhardt!
!
!
!
!
7!
!
8!
!
A!NOTE!FROM!THE!2014!ICAD!CHAIRS!
!
!!!!!!!!!!!!!!!!!!
!
!
Welcome! to! the! 20th! International! Conference! on! Auditory! Display! (ICAD)!! This! year! we! have! the!
pleasure! of! hosting! ICAD! at! New! York! University’s! Steinhardt! School! of! Education! and! Human!
Development! in! the! heart! of! the! historic! Greenwich! Village! –! the! home! of! a! vibrant! community! of!
musicians,!composers,!artists,!and!researchers.!
The! ICAD! conference! is! a! place! where! our! community! comes! together! to! discover! groundJbreaking!
research,! share! their! experiences,! exchange! ideas! and! inspirations,! make! connections,! and! lifeJlong!
friendships! and! collaborations.! This! conference! isn’t! only! about! specific! events,! it’s! about! the!
experience!of!immersing!oneself!in!all!aspect!related!to!auditory!displays.!It’s!about!connecting!with!the!
unbelievably! creative,! talented,! and! innovative! auditory! display! community,! in! one! the! most!
stimulating!cities!in!the!world,!New!York.!!
The!theme!of!the!2014!Big!Apple!ICAD!is!appropriately!Big!Data;!and!the!organizing!committee!has!put!
together!a!stellar!program!with!an!unprecedented!depth!and!breadth!of!technical!sessions,!a!concert,!
installations,!and!a!series!of!fun!evening!activities!that!explore!numerous!facets!of!Big!Data!and!other!
topics! relevant! to! the! filed! of! auditory! display.! Regardless! of! whether! you! are! an! experienced!
professional,! researcher,! or! a! student,! we! are! confident! that! you! will! leave! the! 20th! ICAD! feeling!
inspired,!educated,!and!energized.!!
We!are!happy!to!welcome!composer,!filmmaker,!Dean!of!the!School!of!Media!Arts!at!Columbia!College!
Chicago,!and!longJtime!friend!of!ICAD!Dr.!Robin!Bargar!as!this!year’s!Keynote!speaker.!!
On!behalf!of!the!entire!Organizing!Committee,!we!wish!you!a!wonderful!time!at!the!ICAD!XX.!Let!the!
sound!begin!!
!
Dr.!Agnieszka!Roginska!&!Dr.!Tae!Hong!Park!
Conference!Committee!CoJChairs!
9!
!
10!
!
COMMITTEE!MEMBERS!
!
Conference!CoJChairs!
Agnieszka!Roginska,!New!York!University,!USA!
Tae!Hong!Park,!New!York!University,!USA!
Papers!CoJChairs:!
Areti!Andreopoulou,!New!York!University,!USA!
Norberto!Degara,!Fraunhofer!IIS,!Germany!
Papers*Area*Chairs:!
Gyorgy!Wersenyi,!Széchenyi!István!University!
Bruce!Walker,!Georgia!Institute!of!Technology!
Camille!Peres,!Texas!A&M!University!
Tony!Stockman,!Queen!Mary!University!of!London!
Thomas!Hermann,!Bielefeld!University!
Nina!Schaffert,!Universität!Hamburg!
Workshops!Chair:!
Derek!Brock,!Naval!Research!Laboratory,!USA!
Concert!and!Competition!Committee:!
Tae!Hong,!Park,!New!York!University,!USA!
Michael!Musick,!New!York!University,!USA!
Tom!Beyer,!New!York!University,!USA!
Luke!Dubois,!New!York!University,!USA!
Student!Think!Tank!Chair:!
Alex!Ruthmann,!New!York!University,!USA!
Steering!Committee!Chair!
Matti!Gröhn,!Finnish!Institute!of!Occupational!Health,!Finland!
Sponsorship!Chair!
Braxton!Boren,!New!York!University,!USA!
11!
Website!Development!Chair!
Devin!Visslailli,!New!York!University,!USA!
Staff!
Adriana!Madden,!New!York!University,!USA!!
Samuel!Nacach,!New!York!University,!USA!!
Charles!Deluga,!New!York!University,!USA!!
12!
!
TABLE!OF!CONTENTS!
Opening!Ceremony!and!Keynote!......................................................................................!15!
Lecture!Session!Papers!.................................................................................................!17J28!
Auditory!Displays!Applications:!Aiding!Movement!–!Part!1!............................................................!19!
Auditory!Displays!Applications:!Aiding!Movement!–!Part!2!...........................................................!20!
Spatial!Audio!and!Auditory!Displays!–!Part!1!....................................................................................!21!
Auditory!Display!Applications:!Spatial!Navigation!..........................................................................!22!
Spatial!Audio!and!Auditory!Displays!–!Part!2!...................................................................................!23!
Auditory!Display!Evaluation!..............................................................................................................!24!
Auditory!Display!Application:!Biomedicine!–!Part!1!........................................................................!25!
Auditory!Display!Application:!Biomedicine!–!Part!2!.......................................................................!26!
Psychoacoustics,!Perception!and!Cognition!.....................................................................................!27!
Sonification!for!the!Arts!.....................................................................................................................!28!
Poster!Session!Papers!...................................................................................................!29J39!
!!!!
Session!1:!Mon.!6/23!........................................................................................................................!31J33!
!!!!
Session!2:!Tue.!6/24!.......................................................................................................................!34J36!
!!!!
Session!3:!Wed.!6/25!......................................................................................................................!37J39!
Student!Think!Tank!Posters!........................................................................................!40J44!
Concert!.........................................................................................................................!45J49!
Installations!..................................................................................................................!50J51!!
Workshops!....................................................................................................................!52J53!
Special!Events!....................................................................................................................!54!
Local!Information!........................................................................................................!55J60!
!!!
Maps!...............................................................................................................................................!55J56!
!!!
Transportation!...............................................................................................................................!57J58!
!!!
Food!&!Dining!...............................................................................................................................!59J60!
Fun!&!Games!.................................................................................................................!61J63
13!
!
14!
!
OPENING!CEREMONY!AND!KEYNOTE!
Monday!June!23rd!9:30am!
Kimmel!Center,!Rosenthal!Pavilion,!60!Washington!Square!South!
!
Dr.!Robin!Bargar!
ICAD!2014!Keynote!Speaker!
Situated!Sound:!Modeling!Hearabilty!!
A! “Big! Data”! culture! may! be! inclined! to! adopt! Auditory! Displays! that! demand! the! least! amount! of!
listening!to!convey!the!most!significant!information.!Such!designs!converge!around!identifying!where!
and!when!sound!is!heard,!irrespective!of!what!data!represents!or!how!data!is!analyzed.!As!the!quantity!
of!data!increases,!more!listening!may!not!be!feasible,!but!more!hearing!will!be!essential.!!Hearbility!may!
be!considered!a!design!principle!distinct!from!audibility:!Continuous!immersion!in!sound!as!a!human!
condition!may!lend!insights!to!the!prospects!of!continuous!immersion!in!data.!
Robin!Bargar!has!a!research!and!creative!background!in!digital!media!and!software!development,!with!a!
focus! on! systems! integration! and! interaction! design! for! creative! applications.! In! April! 2011! Robin! was!
named! Dean! of! the! School! of! Media! Arts,! and! Professor! of! Interactive! Arts! and! Media! at! Columbia!
College!Chicago,!the!nation’s!largest!private!nonJprofit!college!for!media,!communication!and!the!arts.!
Previously! Robin! was! Dean! of! the! School! of! Technology! and! Design! and! Professor! of! Entertainment!
Technology!at!the!New!York!City!College!of!Technology,!City!University!of!New!York.!!
Trained!as!a!pianist,!composer!and!filmmaker,!Robin!received!a!DMA!in!composition!from!the!School!
of!Music,!University!of!Illinois!at!UrbanaJChampaign,!served!briefly!on!the!faculty!and!as!a!researcher!
at! the! National! Center! for! Supercomputing! Applications! and! the! Beckman! Institute! for! Advanced!
Science! and! Technology.! From! 1992J2000! he! led! the! Audio! Development! Group! in! software!
development! and! prototyping! media! performance! in! the! CAVE! virtual! environment.! In! the! Beckman!
Institute! Robin! also! served! as! Director! of! the! Integrated! Systems! Laboratory,! an! interdisciplinary!
environment!for!simulation,!prototyping!and!visualization.!Robin!later!served!as!Director!of!Hexagram,!
the! Institute! for! Research! and! Creation! in! Media! Arts! and! Technologies,! Montréal.! His! creative! work!
has! been! presented! on! MTV! and! in! theatrical! cinema! release,! and! at! international! venues! including!
SIGGRAPH! and! Ars! Electronica.! He! holds! two! US! Patents! and! received! an! Oscar! coJnomination! for!
Best!
Short!
Film!
(Animated).
15!
!
!
16!
!
PAPER!SESSION!TABLE!OF!CONTENTS!
Paper!Session!1:!Auditory!Displays!Applications:!Aiding!Movement!–!Part!1!..................!19!
A!Mobile!Sonification!System!for!Stroke!Rehabilitation!!!!
Specifying!Rhythmic!Auditory!Stimulation!for!RobotJAssisted!Hand!Function!Training!in!Stroke!
Therapy!!
!
Paper!Session!2:!Auditory!Displays!Applications:!Aiding!Movement!–!Part!2!................!20!
Invited!Paper:!A!Priori!Attunement!for!Two!Cases!of!Dynamical!Systems!
Mobile!Sonification!for!Athletes:!A!Case!Study!in!Commercialization!of!Sonification!!
The!Sonification!and!Learning!of!Human!Motion!
!
Paper!Session!3:!Spatial!Audio!and!Auditory!Displays!–!Part!1!.........................................!21!
Performance!Evaluation!of!Blind!Persons!in!Listening!Tests!in!Different!Environmental!
Conditions!
Hearing!Without!Ears!
!
Paper!Session!4:!Auditory!Display!Applications:!Spatial!Navigation!..............................!22!
Fast!and!Accurate!Guidance!J!Response!Times!to!Navigational!Sounds!
Use!of!Geospatial!Data!Sonification!for!Mobile!Augmented!Reality!Audio!Navigation!
!!!!!!!! !
Paper!Session!5:!Spatial!Audio!and!Auditory!Displays!–!Part!2!........................................!23!
Effects!of!Visual!Augmentation!on!the!Memory!of!Spatial!Sounds!
Spatial!Auditory!Displays:!Substitution!and!Complementarity!to!Visual!Displays!
Source!Directivity!and!Spatial!Audio!for!Interactive!WaveJBased!Sound!Propagation!
!!!!!!!! !
Paper!Session!6:!Auditory!Display!Evaluation!.................................................................!24!
A!Method!for!Comparative!Evaluation!of!Listening!to!Auditory!Displays!by!Designers!and!Users!
A!Generic!Evaluation!Model!for!Auditory!Feedback!in!Complex!Visual!Searches!
CAVEJbased!Virtual!Prototyping!of!an!Audio!Radiogoniometer:!Ecological!Validity!Assessment!!
17!
!!!!!!!!! !
Paper!Session!7:!Auditory!Display!Application:!Biomedicine!–!Part!1!.............................!25!
Sonification!Method!to!Enhance!the!Diagnosis!of!Dementia!
Electroencephalogram!Steady!State!Response!Sonification!Focused!on!the!Spatial!and!Temporal!
Properties!
!!!!!!!! !
Paper!Session!8:!Auditory!Display!Application:!Biomedicine!–!Part!2!............................!26!
Skin!Pattern!Sonification!Using!NMFJbased!Visual!Feature!Extraction!and!LearningJbased!
PMSon!
Volatiles!that!Sound!Bad:!Sonification!of!Defensive!Chemical!Signals!from!Insects!Against!
Insects!
!
Paper!Session!9:!Psychoacoustics,!Perception!and!Cognition!.........................................!27!
Collaboratively!Identifying!and!Referring!to!Sounds!with!Words!and!Phrases!
EPIC!Modeling!of!a!TwoJTalker!CRM!Listening!Task!
Auditory!and!Visual!Evaluation!of!FixedJFrequency!Events!in!TimeJVarying!Signals!
!!!!!!!!!!!!!!!!!!!! !
Paper!Session!10:!Sonification!for!the!Arts!.......................................................................!28!
Audiovisual!and!Pedagogical!Network!Installation!
Sonification!Strategies!for!the!Film!Rhythms!of!the!Universe!
CrossJModal!Soundscape!Mapping:!Integrating!Ambisonic!Environmental!Audio!Recordings!and!
High!Dynamic!Range!Spherical!Panoramic!Photography!
!
!
!
!
18!
!
MONDAY,!JUNE!23,!12:00!J!12:40!
!
!
Paper!Session!1:!Auditory!Displays!Applications:!Aiding!Movement!–!Part!1!
Session!Chair!:!Matti!Grohn!
A!Mobile!Sonification!System!for!Stroke!Rehabilitation!
Gerd*Schmitz,*Daniela*Kroeger,*Alfred*Effenberg*
Growing! evidence! suggests! that! sonification! supports! movement! perception! as! well! as! motor! functions.! It! is!
hypothesized! that! realJtime! sonification! supports! movement! control! in! patients! with! sensorimotor! dysfunctions!
efficiently! by! intermodal! substitution! of! sensory! loss.! The! present! article! describes! a! sonification! system! for! the!
upper! extremities! that! might! be! used! in! neuromotor! rehabilitation! after! stroke.! A! keyJfeature! of! the! system! is!
mobility:! Arm! movements! are! captured! by! intertial! sensors! that! transmit! their! data! wirelessly! to! a! portable!
computer.!Hand!position!is!computed!in!an!egocentric!reference!frame!and!mapped!onto!four!acoustic!parameters.!
A!pilot!feasibility!study!with!acute!stroke!patients!resulted!in!significant!effects!and!is!encouraging!with!respect!to!
ambulatory!use.!
Specifying!Rhythmic!Auditory!Stimulation!for!RobotJAssisted!Hand!Function!Training!in!
Stroke!Therapy!
Florina*Speth,*Michael*Wahl*
Following!a!stroke!90%!of!all!patients!suffer!from!a!loss!of!arm!and!hand!function,!whereby!30J40%!of!them!never!
regain! full! functionality! ever! again.! RobotJassisted! hand! function! training! (RT)! intensifies! and! complements!
common! ergoJtherapeutic! treatment! effectively.! Most! of! robotic! rehabilitation! devices! are! connected! to!
multimediaJenvironments!offering!playful!training!to!promote!motivation.!“Rhythmic!Acoustic!Stimulation”!(RAS),!
an!effective!therapeutic!technique!for!postJstrokeJtreatment,!was!never!specified,!applied!nor!evaluated!for!RT.!!
This! paper! suggests! specified! sound! designs! with! rhythmic! stimuli! for! RT! that! aim! to! enhance! function! and!
motivation.! Four! pilot! experiments! are! described! evaluating,! if! specified! rhythmic! stimulation! designs! applied!
during! a! fine! motor! task! influence! motivation! and! function! in! comparison! to! no! stimulation.! As! results! of! these!
experiments!indicate!that!rhythmic!stimulation!designs!may!enhance!function!and!motivation,!they!are!discussed!
for!further!observations!applied!in!RT!with!strokeJpatients.!!
19!
!
MONDAY,!JUNE!23,!14:00!J!15:00!
Paper!Session!2:!Auditory!Displays!Applications:!Aiding!Movement!–!Part!2!
Session!Chair:!Tony!Stockman!
A!Priori!Attunement!for!Two!Cases!of!Dynamical!Systems!(Invited!Paper)!
Insook*Choi*
An!application!of!a!tuning!function!adopts!a!space!metaphor!in!scientific!methods!for!representing!state!space!of!
nonJlinear!dynamical!systems.!To!achieve!an!interactive!exploration!of!the!systems!through!sounds,!attunement!is!
defined!as!an!a!priori!process!for!conditioning!a!playable!space!for!an!auditory!display.!To!demonstrate!this!process,!
two!cases!of!dynamical!systems!are!presented.!The!first!case!employs!Chua’s!circuit,!in!which!system!parameters!are!
defined!as!energy!introduction!to!the!system!and!energy!governance!within!the!system.!The!second!case!employs!a!
swarm!simulation,!defined!as!a!set!of!rules!to!dictate!social!agents’!behaviors.!Both!cases!exhibit!complex!dynamics!
and! emergent! properties.! The! paper! synthesizes! a! comparative! review! of! auditory! display! for! the! two! cases! while!
defining!playable!space!with!generalizable!tuning!functions.!The!scope!of!the!discussion!focuses!on!the!relationship!
between! playable! space! as! a! canonical! architecture! for! auditory! display! workflow! and! its! realization! through!
attunement!in!applications!of!dynamical!systems.!
Mobile!Sonification!for!Athletes:!A"Case"Study"in"Commercialization"of"Sonification!
Andrew*Godbout,*Chris*Thornton,*Jeffrey*Boyd*
Several! companies,! including! Under! Armour,! Nike! and! Adidas,! are! taking! advantage! of! advances! in! sensor!
technology!to!sell!wearable!systems!that!measure,!record,!and!analyze!the!motion!of!athletes.!To!date,!these!systems!
make! little,! if! any! use! of! sonification.! Therefore,! there! is! an! opportunity! for! sonification! methods! in! this! domain,!
including! the! potential! to! reach! a! mass! market.! In! the! fall! of! 2013,! Under! Armour! and! NineSigma! created! the!
Armour39! Challenge,! an! open! call! for! proposals! to! build! new! technology! for! the! Armour39,! Under! Armour's!
wearable! motion! and! heartJrate! sensor.! The! authors! of! this! paper! responded! to! the! challenge,! proposing! novel!
sonification! systems! to! exploit! the! data! from! the! Armour39.! This! paper! presents! these! systems,! including! issues,!
solutions,! and! tools! for! sonification! performed! on! a! mobile! device! with! a! wearable! sensor.! The! sonifications! are!
rhythmic,! exploiting! the! periodicity! of! human! motion,! and! are! demonstrated! by! sonifying! athletic! performance!
metrics!in!realJtime!for!speed!skating!and!running.!
The!Sonification!and!Learning!of!Human!Motion!
Kevin*Smith,*David*David*Claveau*
This!paper!examines!how!sonification!can!be!used!to!help!a!student!emulate!the!complex!motion!of!a!teacher!with!
increasing!spatial!and!temporal!accuracy.!The!system!captures!a!teacher’s!motion!in!realJtime!and!generates!a!3JD!
motion!path,!which!is!recorded!along!with!a!reference!sound.!A!student!then!attempts!to!perform!the!motion!and!
thus! recreate! the! teacher’s! reference! sound.! The! student’s! synthesized! sound! will! dynamically! approach! the!
teacher’s! sound! as! the! student’s! movement! becomes! more! accurate.! Several! types! of! sound! mappings! which!
simultaneously! represent! time! and! space! deviations! are! explored.! For! the! experimental! platform,! a! novel! system!
that!uses!lowJcost!cameraJbased!motion!capture!hardware!and!open!source!software!has!been!developed.!This!work!
can!be!applied!to!diverse!areas!such!as!rehabilitation!and!physiotherapy,!performance!arts!and!aiding!the!visually!
impaired.!
20!
!
MONDAY,!JUNE!23,!16:00!J!16:40!
!
Paper!Session!3:!Spatial!Audio!and!Auditory!Displays!–!Part!1!
Session!Chair:!Elizabeth!Wenzel!
Performance!Evaluation!of!Blind!Persons!in!Listening!Tests!in!Different!Environmental!
Conditions!
György*Wersényi,*József*Répás*
Visually! impaired! people! are! often! in! target! groups! of! various! investigations,! including! basic! research,! applied!
research,!research!and!development!studies.!Experiments!in!the!development!of!assistive!technologies!J!navigation!
aids!or!computer!interfaces!(auditory!displays)!J!aim!to!incorporate!the!results!of!testing!with!blind!subjects!during!
development.!Listening!tests!concerning!the!localization!performance!of!blind!subjects!can!be!installed!in!various!
environments! using! different! excitation! signals.! Generally,! results! can! be! collected! only! from! a! small! number! of!
participants! and! they! are! compared! with! results! of! blindfolded! sighted! subjects.! The! goal! of! this! study! was! to!
include! different! environmental! conditions! (virtual! reality,! real! life,! freeJfield),! different! localization! tasks! and! a!
larger! number! of! participants! both! blind! and! sighted! for! comparison.! Results! indicate! that! blind! subjects’!
performance! is! generally! not! superior! to! sighted! subjects’! performance! from! the! engineering! point! of! view,! but!
further!psychological!evaluation!is!recommended.!
Hearing!Without!Ears!
Peter*Lennox,*Bruce*Wiggins,*Ian*McKenzie,**
We! report! on! onJgoing! work! investigating! the! feasibility! of! using! tissue! conduction! to! evince! auditory! spatial!
perception.! Early! results! indicate! that! it! is! possible! to! coherently! control! externalization,! range,! directionality!
(including!elevation),!movement!and!some!sense!of!spaciousness!without!presenting!acoustic!signals!to!the!outer!
ear.!Signal!control!techniques!so!far!have!utilised!discrete!signal!feeds,!stereo!and!1st!order!Ambisonic!hierarchies.!
Some!deficiencies!in!frontal!externalization!have!been!observed.!We!conclude!that,!whilst!the!putative!components!
of!the!head!related!transfer!function!are!absent,!empirical!tests!indicate!that!coherent!equivalents!are!perceptually!
utilisable.! Some! implications! for! perceptual! theory! and! technological! implementations! are! discussed! along! with!
potential!practical!applications!and!future!lines!of!enquiry.!
!
21!
!
TUESDAY,!JUNE!24,!9:30!J!10:10!
Paper!Session!4:!Auditory!Display!Applications:!Spatial!Navigation!
Session!Chair:!Brian!Katz!
Fast!and!Accurate!Guidance!J!Response!Times!to!Navigational!Sounds!
Frederik*Nagel,*FabianSRobert*Stöter,*Norberto*Degara,*Stefan*Balke,*David*Worrall*
Route! guidance! systems! are! used! every! day! by! both! sighted! and! visually! impaired! people.! Systems,! such! as! those!
built! into! cars! and! smart! phones,! usually! using! speech! to! direct! the! user! towards! their! desired! location.! Sounds!
other! than! functional! and! speech! sounds! can,! however,! be! used! for! directing! people! in! distinct! directions.! The!
present! paper! compares! response! times! with! different! stimuli! and! error! rates! in! the! detection.! Functional! sounds!
are!chosen!with!and!without!intrinsic!meanings,!musical!connotations,!and!stereo!locations.!Panned!sine!tones!are!
identified! as! the! fastest! and! most! correctly! identified! stimuli! in! the! test! while! speech! is! not! identified! faster! than!
arbitrary!sounds!that!have!no!particular!meaning.!
Use!of!Geospatial!Data!Sonification!for!Mobile!Augmented!Reality!Audio!Navigation!
Mark*Anderson*
This!paper!presents!MeanderMaps:!a!nonJspeech!Augmented!Reality!Audio!(ARA)!application!for!Apple!iPhone!that!
aids!in!navigation!purposes!by!sonifying!geospatial!data.!Users!request!directions!to!a!specified!location!on!a!Google!
Map!overlay,!and!MeanderMaps!uses!spatial!auditory!cues!such!as!distance!and!direction!to!guide!him/her!to!the!
destination.!As!the!user!travels!to!consecutive!waypoints!known!as!path!nodes,!auditory!cues!indicate!whether!an!
incorrect! turn! has! been! made! or! if! the! user! is! traveling! in! the! wrong! direction.! Preliminary! findings! are! reported!
using!qualitative!and!quantitative!methods,!evaluating!the!overall!sonification!model!in!addition!to!individual!audio!
cues! that! (a)! worked,! (b)! worked! somewhat! well,! and! (c)! needed! to! be! improved.! Future! improvements! and!
modifications!to!MeanderMaps!are!presented.!
22!
!
TUESDAY,!JUNE!24,!11:30!J!12:30!
Paper!Session!5:!Spatial!Audio!and!Auditory!Displays!–!Part!2!
Session!Chair!:!Gyorgy!Wersenyi!
Effects!of!Visual!Augmentation!on!the!Memory!of!Spatial!Sounds!
Kyla*McMullen,*Gregory*Wakefield*
Spatial! audio! displays! are! created! by! processing! digital! sounds! such! that! they! convey! a! spatial! location! to! the!
listener.!These!displays!are!used!as!a!supplementary!channel!when!the!visual!channel!is!overloaded!or!when!visual!
cues! are! absent.! This! technology! can! be! used! to! aid! decisionJmakers! in! complex,! dynamic! tasks! such! as! urban!
combat! simulation,! flight! simulations,! mission! rehearsals,! air! traffic! control,! military! command! and! control,! and!
emergency! services.! Accurate! spatial! sound! rendering! is! a! primary! focus! in! this! research! area,! with! spatial! sound!
memory! receiving! less! attention.! The! present! study! assesses! the! effects! of! visual! augmentation! on! spatial! sound!
location! and! identity! memory.! The! chosen! visual! augmentations! were! a! Cartesian! and! polar! grid.! The! work!
presented!in!this!paper!discovered!that!the!addition!of!visual!augmentation!improved!location!and!identity!memory!
without!degrading!search!time!performance.!
Spatial!Auditory!Displays:!Substitution!and!Complementarity!to!Visual!Displays!
Elizabeth*Wenzel,*Martine*GodfroySCooper,*Joel*Miller*
The! primary! goal! of! this! research! was! to! compare! the! performance! in! localization! of! stationary! targets! during! a!
simulated!extraJvehicular!exploration!of!a!planetary!surface.!Three!different!types!of!displays!were!tested!for!aiding!
orientation!and!localization:!a!3D!spatial!auditory!display,!a!2D!NorthJup!visual!map,!and!the!combination!of!the!
two! in! a! bimodal! display.! Localization! performance! was! compared! under! four! different! environmental! conditions!
combining! high! and! low! levels! of! visibility! and! ambiguity.! In! a! separate! experiment! using! a! similar! protocol,! the!
impact! of! visual! workload! on! performance! was! also! investigated! contrasting! high! (DualJTask! paradigm)! and! low!
workload! (Single! Orientation! task).! A! synergistic! presentation! of! the! visual! and! auditory! information! (bimodal!
display)! lead! to! a! significant! improvement! in! performance! (higher! percent! correct! orientation! and! localization,!
shorter! decision! and! localization! times)! compared! to! either! unimodal! condition,! in! particular! when! the! visual!
environmental! conditions! were! degraded.! Preliminary! data! using! the! dualJtask! paradigm! suggest! that! the!
performance! with! displays! utilizing! auditory! cues! was! less! affected! by! the! extra! demands! of! additional! visual!
workload!than!a!visualJonly!display.!
Source!Directivity!and!Spatial!Audio!for!Interactive!WaveJBased!Sound!Propagation!
Ravish*Mehra,*Lakulish*Antani,*Dinesh*Manocha*
This!paper!presents!an!approach!to!model!timeJvarying!source!directivity!and!HRTFJbased!spatial!audio!for!waveJ
based! sound! propagation! at! interactive! rates.! The! source! directivity! is! expressed! as! a! linear! combination! of!
elementary! spherical! harmonic! sources.! The! propagated! sound! field! due! to! each! spherical! harmonic! source! is!
precomputed! and! stored! in! an! offline! step.! At! runtime,! the! timeJvarying! source! directivity! is! decomposed! into!
spherical!harmonic!coefficients.!These!coefficients!are!combined!with!precomputed!spherical!harmonic!sound!fields!
to! generate! propagated! sound! field! at! the! listener! position! corresponding! to! the! directional! source.! In! order! to!
compute!spatial!audio!for!a!moving!and!rotating!listener,!an!efficient!planeJwave!decomposition!approach!based!on!
the! derivatives! of! the! sound! field! is! presented.! The! source! directivity! and! spatial! audio! approach! have! been!
integrated!with!the!HalfJLife!2!game!engine!and!the!Oculus!Rift!headJmounted!display!to!enable!realistic!acoustic!
effects!for!virtual!environments!and!games.!
23!
TUESDAY,!JUNE!24,!14:00!J!15:00!
Paper!Session!6:!Auditory!Display!Evaluation!
Session!Chair:!Gregory!Wakefield!
A!Method!for!Comparative!Evaluation!of!Listening!to!Auditory!Displays!by!Designers!and!Users!
Milena*Droumeva,*Iain*McGreggor*
The!process!of!designing!and!testing!auditory!displays!often!includes!evaluations!only!by!experts,!and!where!nonJ
experts!are!involved,!training!is!commonly!required.!This!paper!presents!a!method!of!evaluating!sound!designs!that!
does! not! require! listener! training! thus! promoting! more! ecological! practices! in! auditory! display! design.! Complex!
sound!designs!can!be!broken!down!into!discrete!sound!events,!which!can!then!be!rated!using!attributes!of!sound!
that!are!meaningful!to!both!designers!and!listeners.!The!two!examples!discussed!in!this!paper!include!an!auditory!
display!for!a!commercial!vehicle,!and!a!set!of!sound!effects!for!a!video!game.!Both!are!tested!using!a!repertory!grid!
approach.! The! paper! shows! that! the! method! can! highlight! similarities! and! differences! between! designer! and! user!
listening!experiences.!Comparing!listening!experiences!could!allow!designers!to!be!confident!with!the!reception!of!
their!sound!designs.!
A!Generic!Evaluation!Model!for!Auditory!Feedback!in!Complex!Visual!Searches!
Timothy*Neate,*Norberto*Degara,*Andy*Hunt,*Frederik*Nagel*
This! paper! proposes! a! method! of! evaluating! the! effect! of! auditory! display! techniques! on! a! complex! visual! search!
task.! The! approach! uses! a! preJexisting! visual! search! task! (conjunction! search)! to! create! a! standardized! model! for!
audio,!and!nonJaudio!assisted!visual!search!tasks.!A!preJexisting!auditory!display!technique!is!evaluated!to!test!the!
system.!Using!randomly!generated!images,!participants!were!asked!to!undertake!a!series!of!visual!search!tasks!of!set!
complexities,! with! and! without! audio.! It! was! shown! that! using! the! auditory! feedback! improved! the! participant’s!
visual! search! times! considerably,! with! statistically! significant! results.! Additionally,! it! was! shown! that! there! was! a!
larger! difference! between! audio! and! nonJaudio! when! the! complexity! of! the! images! was! increased.! The! same!
auditory! display! techniques! were! then! applied! to! an! example! of! a! real! complex! visual! search! task,! the! results! of!
which!imply!a!significant!improvement!in!visual!search!efficiency!when!using!auditory!feedback.!
CAVEJbased!Virtual!Prototyping!of!an!Audio!Radiogoniometer:!Ecological!Validity!Assessment!
David*PoirierSQuinot,*Brian*Katz*
This!paper!is!part!of!a!project!concerned!with!the!improvement!of!audio!radiogoniometer!design!ergonomics!and!
sound! aesthetic.! It! introduces! a! virtual! prototyping! implementation! of! a! simple! radiogoniometer! along! with! a!
methodology! to! assess! its! ecological! validity.! Said! methodology! involves! a! performance! comparison! between! two!
different! radiogoniometer! designs,! both! implemented! as! virtual! prototypes.! While! suggested! assessment!
achievement!supposes!a!companion!study!in!a!real!environment!(based!on!a!physical!prototype),!significant!results!
have!already!been!gathered!regarding!the!impact!of!the!virtual!environment!on!the!virtual!prototype!validity.!
24!
!
TUESDAY,!JUNE!24,!16:00!J!16:40!
Paper!Session!7:!Auditory!Display!Applications:!Biomedicine!–!Part!1!
Session!Chair:!Thomas!Herman!
Sonification!Method!to!Enhance!the!Diagnosis!of!Dementia!
Agnieszka*Roginska,*Hariharan*Mohanraj,*James*Keary,*Kent*Friedman*
Positron! emission! tomography! (PET)! scans! of! brains! result! in! large! datasets! that! are! traditionally! analyzed! using!
visual!displays!and!statistical!analyses.!Due!the!complexity!and!multiJdimensionality!of!the!data,!there!exist!many!
challenges! in! the! interpretation! of! the! scans.! This! paper! describes! the! use! of! a! sonification! method! to! assist! in!
improving! the! diagnosis! of! patients! with! different! levels! of! Alzheimer’s! dementia.! A! tripleJtone! method! is!
introduced,!and!the!audible!beating!patterns!resulting!from!the!interaction!of!the!three!tones!is!explored!as!a!metric!
to! interpret! the! data.! The! sonification! method! is! presented! and! evaluated! using! subjective! listening! tests.! Results!
show! the! tripleJtone! sonification! method! is! effective! at! evaluting! PET! scan! brain! data,! even! for! listeners! with! no!
medical!background.!
Electroencephalogram!Steady!State!Response!Sonification!Focused!on!the!Spatial!and!
Temporal!Properties!
Teruaki*Kaniwa,*Hiroko*Terasawa,*Masaki*Matsubara,*Shoji*Makino,*Tomasz*Rutkowski*
This! paper! describes! a! sonification! approach! of! multichannel! electroencephalogram! (EEG)! steadyJstate! responses!
(SSR).!The!main!purpose!of!this!study!is!to!investigate!the!possibility!of!sonification!as!an!analytic!tool!for!SSR.!The!
proposed! sonification! approach! aims! to! observe! the! spatial! property! (i.e.! location! of! strong! brain! activities)! and!
temporal! property! (i.e.! synchrony! of! wave! forms! across! channels)! of! brain! activity.! We! expect! to! obtain! useful!
information! on! brain! activity! locations! and! their! dynamic! transitions! by! taking! advantage! of! spatial! sound! with!
multichannel!loudspeakers!that!represent!EEG!measurement!positions,!while!expressing!the!temporal!property!of!
multiple! EEG! channels! with! timbre! by! integrating! respective! auditory! streams.! Our! final! sonification! evaluation!
experiment!suggests!the!validity!of!the!proposed!approach.!
25!
!
WEDNESDAY,!JUNE!25,!9:30!J!10:10!
Paper!Session!8:!Auditory!Display!Applications:!Biomedicine!–!Part!2!
Session!Chair:!Hiroko!Terasawa!
Skin!Pattern!Sonification!Using!NMFJbased!Visual!Feature!Extraction!and!LearningJbased!
PMSon!
Yoon*Chung*Han,*ByeongSjun*Han*
This!paper!describes!the!use!of!sonification!to!represent!the!scanned!image!data!of!skin!pattern!of!the!human!body.!
Skin! Patterns! have! different! characteristics! and! visual! features! depending! on! the! positions! and! conditions! of! the!
skin! on! the! human! body.! The! visual! features! are! extracted! and! analyzed! for! sonification! in! order! to! broaden! the!
dimensions!of!data!representation!and!to!explore!the!diversity!of!sound!in!each!human!body.!NonJnegative!matrix!
factorization! (NMF)! is! employed! to! parameterize! skin! pattern! images,! and! the! represented! visual! parameters! are!
connected!to!sound!parameters!through!support!vector!regression!(SVR).!We!compare!the!sound!results!with!the!
data!from!the!skin!pattern!analysis!to!examine!how!much!each!individual!skin!patterns!are!effectively!mapped!to!
create! accurate! sonification! results.! Thus,! the! use! of! sonification! in! this! research! suggests! a! novel! approach! to!
parameter!mapping!sonification!by!designing!personal!sonic!instruments!that!use!the!entire!human!body!as!data.!
Volatiles!that!Sound!Bad:!Sonification!of!Defensive!Chemical!Signals!from!Insects!Against!
Insects!
JeanSLuc*Boevé,*Rudi*Giot*
Defensive!chemicals!such!as!volatiles!are!essential!for!many!insects!against!the!attack!of!predatory!insects,!but!in!
the!research!domain!of!chemical!ecology!there!remains!a!need!to!better!understand!how!intrinsic!physicochemical!
constants! of! volatiles! determine! the! intraJ! and! interspecific! diversification! of! such! compounds! produced! by! prey!
insects,! knowing! that! many! predatory! insects! primarily! rely! on! chemical! cues! during! foraging.! To! apprehend! and!
explore!the!diversity!of!emitted!chemicals!as!related!to!the!receiver’s!perception,!here!we!aim!to!transform!chemical!
into! acoustic! signals! by! a! process! of! sonification,! because! propagating! odours! and! sounds! are! similar! in! their!
spatiotemporal! dynamics.! Since! insects! often! emit! a! complex! mixture! of! repellents,! we! prototyped! a! sonification!
software! to! process! physicochemical! parameters! of! individual! molecules,! prior! mixing! these! sonified! data! by!
following!the!chemical!profile!of!specific!insect!defensive!secretions.!In!a!fruitful!proof!of!concept,!the!repellence!of!
insectivorous!ants!towards!single!chemicals!was!compared!with!the!repulsive!response!of!humans!towards!the!same!
but!auditory!translated!signals.!Expected!outreaches!of!our!ongoing!project!called!‘SonifChem’!are,!among!others,!to!
explore!the!repulsive!and!even!the!attractive!bioactivities!of!chemicals!emanating!from!any!(biological)!source.!
26!
!
WEDNESDAY,!JUNE!25,!11:30!J!12:30!
Paper!Session!9:!Psychoacoustics,!Perception!and!Cognition!
Session!Chair:!Camille!Peres!
Collaboratively!Identifying!and!Referring!to!Sounds!with!Words!and!Phrases!
Derek*Brock,*Charles*Gaumond,*Christina*Wasylyshyn,*Brian*McClimens*
Machine!classification!of!underwater!sounds!remains!an!important!focus!of!U.S.!Naval!research!due!to!physical!and!
environmental! factors! that! increase! false! alarm! rates.! Human! operators! tend! to! be! reliably! better! at! this! auditory!
task! than! automated! methods,! but! the! attentional! properties! of! this! cognitive! discrimination! skill! are! not! well!
understood.! In! the! study! presented! here,! pairs! of! isolated! listeners,! who! were! only! allowed! to! talk! to! each! other,!
were! given! a! collaborative! soundJordering! task! in! which! only! words! and! phrases! could! be! used! to! refer! to! and!
identify!a!set!of!impulsive!sonar!echoes.!The!outcome!supports!the!premise!that!verbal!descriptions!of!unfamiliar!
sounds! are! often! difficult! for! listeners! to! immediately! grasp.! The! method! of! “collaborative! referring”! used! in! the!
study!is!proposed!as!new!technique!for!obtaining!a!verified!perceptual!vocabulary!for!a!given!set!of!sounds!and!for!
studying!human!aural!identification!and!discrimination!skills.!
EPIC!Modeling!of!a!TwoJTalker!CRM!Listening!Task!
Gregory*Wakefield,*David*Kieras,*Nandini*Iyer,*Brian*Simpson,*Eric*Thompson*
An!extension!of!the!auditory!module!in!EPIC!is!introduced!to!model!the!twoJspeaker!coordinate!response!measure!
(CRM)! listening! task.! The! construct! of! an! auditory! stream! is! employed! as! an! object! in! the! working! memory! of!
EPIC's! cognitive! processor.! Production! rules! are! developed! that! execute! the! twoJspeaker! CRM! task.! Analysis! of!
these!rules!reveal!two!sources!of!possible!error!in!the!output!of!the!auditory!processor!to!working!memory.!Each!is!
explored! in! turn! and! the! production! rules! modified! to! provide! a! corpusJdriven! model! that! accounts! for! human!
performance!in!the!listening!task.!
Auditory!and!Visual!Evaluation!of!FixedJFrequency!Events!in!TimeJVarying!Signals!
Robert*Alexander,*Sile*O'Modhrain,*Jason*Gilbert,*Thomas*Zurbuchen*
This! study! directly! compares! the! auditory! and! visual! analysis! capabilities! of! participants! in! a! structured! data!
analysis!task.!This!task!involved!the!identification!of!transient!fixedJfrequency!sinusoid!events!that!were!embedded!
within!white!noise!and!noise!derived!from!solar!wind!time!series.!It!was!hypothesized!that!participants!would!be!
able!to!identify!the!number!of!embedded!events!more!quickly!and!accurately!through!auditory!data!analysis!than!
through! visual! analysis.! While! visual! analysis! outperformed! auditory! analysis! overall,! additional! investigation!
revealed!that!auditory!analysis!outperformed!vision!in!instances!where!these!events!were!embedded!in!solar!wind!
data.! This! task! J! involving! the! detection! of! transient! periodic! activity! occurring! within! background! turbulence! J!
closely!mirrors!a!type!of!spectral!analysis!conducted!by!heliospheric!scientists.!Additionally,!several!data!examples!
contained! embedded! events! that! were! correctly! identified! through! audition! while! being! consistently! overlooked!
through!visual!inspection.!The!largest!disparity!between!visual!and!auditory!performance!was!found!in!the!analysis!
of!white!noise!spectra!that!contained!no!embedded!events.!In!these!instances,!auditory!analysis!regularly!resulted!in!
the!identification!of!events!when!none!were!present;!a!potential!reasoning!for!these!false!positives!is!discussed.!The!
results!of!this!study!suggest!that!the!analysis!capabilities!of!each!modality!may!vary!based!largely!on!the!complexity!
of!the!masking!stimuli!that!are!present.!
27!
!
WEDNESDAY,!JUNE!25,!14:00!J!15:00!
Paper!Session!10:!Sonification!for!the!Arts!
Session!Chair:!David!Worrall!
Audiovisual!and!Pedagogical!Network!Installation!
Ludovic*Laffineur,*Rudi*Giot,*Louis*Commère*
This! paper! presents! an! interactive! installation! designed! to! inform! visitors! of! the! network! flow! and! the! risks! to!
connect! their! devices! to! any! WiJFi! hotspots.! The! system! developed! in! C++! grabs! packets! using! LibPCap,! analyses!
them! at! low! level! (e.g.,! packet! length)! and! also! provides! highJlevel! information! (e.g.,! port! number).! This! new!
approach!is!based!on!the!network!flow!analysis!as!well!as!on!network!services!analysis.!The!software!communicates!
with! ChucK! through! the! OSC! protocol! and! is! developed! with! the! OpenJ! Frameworks! library! in! order! to! create!
unique!visualisation.!Users!can!actively!take!part!to!an!interactive!and!didactic!audiovisual!exhibition!system!using!
their!mobile!device!to!send!eJmails,!listen!to!a!web!radio,!surf!on!a!website,!read!RSS!feeds,!in!short,!the!experience!
begins!once!visitors!exchange!data!with!the!network.!
Sonification!Strategies!for!the!Film!Rhythms!of!the!Universe!
Mark*Ballora*
Design!strategies!are!discussed!for!sonifications!that!were!created!for!the!short!film!Rhythms!of!the!Universe,!which!
was! conceived! by! a! cosmologist! and! a! musician,! with! multiJmedia! contributions! from! a! number! of! artists! and!
scientists.!Sonification!functions!as!an!engagement!factor!in!this!scientific!outreach!project,!along!with!narration,!
music,!and!visualization.!This!paper!describes!how!the!sonifications!were!created!from!datasets!describing!pulsars,!
the!planetary!orbits,!gravitational!waves,!nodal!patterns!in!the!sun’s!surface,!solar!winds,!extragalactic!background!
light,!and!cosmic!microwave!background!radiation.!!
CrossJModal!Soundscape!Mapping:!Integrating!Ambisonic!Environmental!Audio!Recordings!
and!High!Dynamic!Range!Spherical!Panoramic!Photography!
J.*Parkman*Carter,*Jonas*Braasch*
We!cannot!‘measure’!the!soundscape!any!more!than!we!can!‘measure’!the!ocean,!the!city,!or!the!wilderness.!Being!
comprised!of!myriad!complex!elements,!conditions!and!relationships!between!sound!sources!and!sound!perceivers,!
the! soundscape—and! any! sufficient! description! of! it—must! account! for! several! different,! but! significantly!
interrelated,! dimensions:! physical,! spatial,! temporal,! perceptual,! cultural,! and! historical.! How,! then,! are! we! to!
meaningfully!document!the!soundscape?!If!we!are!to!begin!to!understand!the!soundscape’s!impact!on!us—and!our!
impact!upon!it—we!need!new!methods!to!capture!and!represent!the!multisensory!extents!of!a!soundscape!without!
reverting!to!oneJdimensional!quantitative!abstractions.!This!project!proposes!an!interdisciplinary!method!to!record!
a!soundscape’s!multisensory!attributes!by!combining!aural!and!visual!information!in!a!structured!way!which!links!
the!directionality!of!view!and!sound!arrival.!This!method!integrates!multiJdirectional!Ambisonic!audio!recordings!
with!high!dynamic!range!(HDR)!spherical!panoramic!photography!in!the!form!of!interactive!maps!and!virtual!tours.!
Case!studies!using!the!crossJmodal!soundscape!mapping!method!will!be!presented.!
28!
!
POSTER!SESSION!TABLE!OF!CONTENTS!
Session!1:!Monday,!June!23!.................................................................................................!31!
Assisted!Differentiated!Stem!Cell!Classification!in!Infrared!Spectroscopy!Using!Auditory!
Feedback!
DataSonification!Open!Source!Project!for!RealJTime!Data!Sonification!!
Sonification!of!Symbolic!Music!in!the!ELVIS!Project!
Making!Information!Flows!in!Hybrid!Space!Tangible:!an!Analog!RF!Power!Detector!for!
Sonification!of!Wireless!Network!Traffic!
Isotopic!Data!Sonification:!Shale!Hills!Critical!Zone!Observatory!
Complex:!Physical!ReJSonification!of!Urban!Noise!
Detecting!Components!of!an!ECG!Signal!For!Sonification!!
An!Enhanced!Data!Transformation!Framework!for!the!Sonification!of!Simulated!Rigid!Bodies!
Comprehension!of!Sonified!Weather!Data!Across!Multiple!Auditory!Streams!
Weather!to!Go!–!a!Blended!Sonification!Application!
Session!2:!Tuesday,!June!24!...............................................................................................!34!
Auditory!Display!of!Coarse!Optical!Imagery:!Concept!for!a!Rehabilitation!Aid!for!Blind!Spatial!
Orientation!
Handheld!Device!for!Substitution!from!Vision!to!Audition!
“Listen2dRoom”:!Helping!Visually!Impaired!People!Navigate!Indoor!Environments!Using!an!
Ultrasonic!SensorJBased!Orientation!Aid!
I!Hear!Bangalore3D:!Capture!and!Reproduction!of!Urban!Sounds!of!Bangalore!Using!an!
Ambisonic!Microphone!
Interactive!Auditory!Display!of!Urban!SpatioJAcoustics!
I!Hear!NY4D:!Hybrid!Acoustic!and!Augmented!Auditory!Display!for!Urban!Soundscapes!!
ListenTree:!AudioJHaptic!Display!in!the!Natural!Environment!
Design!and!Evaluation!of!Lyricons!(Lyrics!+!Earcons)!for!Semantic!and!Aesthetic!Improvements!
of!Auditory!Cues!
How!Many!Auditory!Icons,!in!a!Control!Room!Environment,!Can!You!Learn?!
Prototype!Auditory!Displays!for!a!Fuel!Efficiency!Driver!Interface!
!
29!
Session!3:!Wednesday,!June!25!..........................................................................................!37!
Binaural!Reproduction!over!Loudspeakers!Using!a!Modified!Target!Response!
iEAR:!Immersive!Environmental!Audio!for!Photorealistic!Panoramas!
Localization!Accuracy!in!Presenting!Measured!Sound!Fields!via!Higher!Order!Ambisonics!
Using!Published!HRTFs!with!Slab3d:!MetricJBased!Database!Selection!and!Phenomena!
Observed!
SonicTaiji:!A!Mobile!Instrument!For!Taiji!Performance!
Sonification!Synthesizer!for!Surface!Electromyography!
A!Verification!Task!with!Lateralized!Tones!and!Accelerated!Speech!
Using!VocalJBased!Sounds!to!Represent!Sentiment!in!Complex!Event!Processing!
Relationships!Between!Acoustic!Features!and!Perceptual!Segmentation!of!Music!Audio!
On!the!Importance!of!Correspondence!Between!Shapes!and!Timbre!
Comparing!Auditory!Stimuli!for!Sleep!Enhancement:!Mimicking!a!Sleeping!Situation!
30!
!
MONDAY,!JUNE!23,!11:00!–!12:00!AND!15:00!J!16:00!
!!!
Poster!Session!1!
Assisted!Differentiated!Stem!Cell!Classification!in!Infrared!Spectroscopy!Using!Auditory!
Feedback!
Domenico*Vicinanza,*Ryan*Stables,*Graeme*Clemens,*Matthew*Baker*
In!this!study!we!investigate!ways!in!which!data!sonification!can!improve!standard!data!analysis!techniques!currently!
employed! in! the! analysis! of! stemJcells! using! Fourier! Transform! Infrared! (FTIR)! Spectroscopy.! Four! different!
sonification! methods! have! been! evaluated! and! their! effectiveness! has! been! evaluated! through! listening! tests,!
designed! to! assess! the! discriminating! capability! of! the! auditory! technique.! We! identify! FM! synthesis! driven! by!
feature! extraction! as! the! most! perceptually! relevant! technique! for! the! auditory! classification! of! FTIR! data.! Whilst!
this!technique!is!not!commonly!used!in!sonification!research,!it!allows!us!to!utilise!the!most!salient!characteristics!
of! the! absorption! spectra,! leading! to! an! improved! classification! accuracy! with! a! clear! timbral! differences! between!
differentiated!and!nonJdifferentiated!cellJtypes.!
dataSonification!Open!Source!Project!for!RealJTime!Data!Sonification!
Edward*Childs,*John*Stephens,*Benjamin*Childs*
A! software! platform! for! realJtime! data! sonification! is! described! in! detail.! The! platform! is! designed! primarily! to!
process!multiple!realJtime!data!streams!simultaneously.!The!system!was!originally!designed!for!processing!financial!
data!with!the!general!goal!to!be!able!to!monitor!up!to!20!different!securities!as!their!values!were!changing!during!a!
trading!session.!The!sonifications!were!designed!to!make!it!easy!to!distinguish!between!different!securities,!and!to!
convey!as!much!information!about!each!security’s!activity!using!the!shortest!possible!sound!duration.!The!software!
platform! was! designed! using! multiple! threads! with! a! gatekeeper! function! to! manage! simultaneous! sonifications!
events! without! confusion! or! system! failure.! This! paper! announces! the! release! of! this! software! together! with! its!
financial! data! stream! implementation! to! the! open! source! community.! It! is! hoped! that! sonification! researchers!
particularly!interested!in!realJtime!data!will!use!and!adapt!the!software!to!their!needs.!
Sonification!of!Symbolic!Music!in!the!ELVIS!Project!
Raymond*Winters,*Julie*Cumming*
This! paper! presents! the! development! of! sonification! in! the! ELVIS! project,! a! collaboration! in! interdisciplinary!
musicology! targeting! large! databases! of! symbolic! music! and! tools! for! their! systematic! analysis.! An! sonification!
interface! was! created! to! rapidly! explore! and! analyze! collections! of! musical! intervals! originating! from! various!
composers,!genres,!and!styles.!The!interface!visually!displays!imported!musical!data!as!a!soundJfile,!and!maps!data!
events! to! individual! short,! discrete! pitches! or! intervals.! The! user! can! interact! with! the! data! by! visually! zoom! in,!
making!selections,!playing!through!the!data!at!various!speeds,!and!adjusting!the!transposition!and!frequency!spread!
of! the! pitches! to! maximize! acoustic! comfort! and! clarity.! A! study! is! presented! in! which! rapid! pitchJmapping! is!
applied! to! compare! differences! between! similar! corpora.! A! group! of! 11! participants! were! able! to! correctly! order!
collections!of!sonifications!for!three!composers!(Monteverdi,!Bach,!and!Beethoven)!and!three!presentation!speeds!
(100,! 1000,! and! 10000! notes/second).! Benefits! of! sonification! are! discussed! including! the! ability! to! quickly!
differentiate!composers,!find!nonJobvious!patterns!in!the!data,!and!'direct!mapping'.!The!interface!is!made!available!
as!a!MacOSX!standalone!application!written!in!SuperCollider.!
!
31!
Making!Information!Flows!in!Hybrid!Space!Tangible:!an!Analog!RF!Power!Detector!for!
Sonification!of!Wireless!Network!Traffic!
Adam*Łutkowski,*Michał*Bujacz,*Maciej*Ożóg*
The!paper!presents!a!fully!analog!prototype!device!for!sonification!of!electromagnetic!power!in!the!radio!frequency!
range.! The! RF! power! detector! was! designed! specifically! for! use! in! artistic! performances,! which! attempt! to! make!
listeners! aware! of! the! hybrid! space! surrounding! them,! filled! with! information! flows! from! wireless! networks.! The!
device! is! tuned! to! the! RF! range! of! 800Hz! to! 2.7GHz,! to! detect! GSM,! Bluetooth! and! WiFi! network! traffic.! The!
modular!design!allows!sonification!using!the!power!reading!directly!or!through!voltage!to!frequency!converters,!as!
well!as!leaves!room!for!expansion!using!other!signal!processing!circuits.!
Isotopic!Data!Sonification:!Shale!Hills!Critical!Zone!Observatory!
Matthew*Kenney,*Mark*Ballora,*Susan*Brantley*
Each!precipitation!event!has!a!unique!fingerprint.!This!fingerprint!is!recorded!in!the!duration!of!the!event!and!the!
isotopic!composition!of!the!rainfall,!as!a!result!of!differing!proportions!of!oxygen!isotopes.!The!ratio!of!O16!to!O18!is!
crucial!in!identifying!origin!and!movement!of!water!within!the!hydrologic!cycle.!In!some!investigated!watersheds,!as!
rainwater! flows! through! the! ecosystem,! it! is! continually! recorded! by! a! series! of! inJground! instruments! and!
examined! as! a! means! of! understanding! the! responsiveness! of! the! hydrologic! system! of! a! particular! region.!
Sonification! of! the! unique! fingerprints! of! each! storm! as! it! passes! through! the! hydrologic! system! offers! an!
opportunity!to!sonically!represent!fluctuations!in!rainwater!hydrology!over!an!extended!period!of!time,!allowing!for!
a! deeper! understanding! of! the! hydrologic! cycle! of! the! region.! Sonification! of! a! watershed! can! include! data! for!
groundwater,! stream! water,! and! precipitation! data.! Transformation! of! the! data! into! sound! creates! a! uniquely!
informative!representation!of!the!data,!removed!from!the!constraints!of!static!visualizations!such!as!the!line!graph,!
and!–!if!the!datasets!are!long!time!duration!–!can!provide!a!unique!look!at!both!single!weather!events!and!larger!
global!warming!patterns!within!a!particular!geographical!region.!
Complex:!Physical!ReJSonification!of!Urban!Noise!
Mo*Zareei,*Dugal*McKinnon,*Ajay*Kapur,*Dale*Carnegie*
This!paper!explores!the!aesthetic!and!social!values!of!the!noises!of!modern!urban!soundscapes!and!discusses!some!
strategies!for!boosting!the!accessibility!and!appreciation!of!works!of!sound!art!and!experimental!music!that!employ!
them.! A! proposed! audiovisual! installation––entitled! complex––is! outlined! as! a! practical! application! of! techniques!
designed! to! reveal! the! sonic! aesthetics! of! urban! technological! noise,! primarily! through! reJsonification! and!
visualization.!This!will!be!achieved!sonically!and!physically,!by!mapping!sonic!data!collected!from!New!York!City!
soundscape!(using!the!Citygram!project)!onto!customJdesigned!mechatronic!soundsculptures.!
Detecting!Components!of!an!ECG!Signal!For!Sonification!
David*Worrall,*Balaji*Thoshkahna,*Norberto*Degara*
In!recent!stateJofJtheJart!electocardiogram!(ECG)!studies,!many!authors!mention!that!they!had!to!manually!correct!
automatically!detected!peaks!or!exclude!artifactJloaded!segments!from!the!automatically!annotated!data!they!were!
studying.!Given!the!importance!of!accurate!feature!detection!for!signal!analysis,!this!is!clearly!a!limiting!factor.!Our!
investigation! into! the! use! of! sonification! for! analysis! of! ECG! data! for! medical! and! diagnostic! purposes! is! also!
hampered! by! the! lack! of! such! a! reliable! ground! truth.! In! order! to! be! able! to! undertake! a! comparative! analysis! of!
sonification! and! numerical! techniques,! we! are! investigating! ways! to! improve! algorithmic! feature! detection,!
particularly!more!robust!algorithms!for!the!detection!of!important!landmarks!in!the!signal!in!the!presence!of!noise,!
whilst!accounting!for!the!variability!in!the!very!nature!of!the!signal.!This!paper!is!a!workJinJprogress!report!of!our!
efforts!to!date.!
32!
!
An!Enhanced!Data!Transformation!Framework!for!the!Sonification!of!Simulated!Rigid!Bodies!
Rhys*Perkins*
While! simulated! rigid! bodies! hold! a! wealth! of! information! that! can! be! understood! through! sound,! current!
interpretive! methods! will! often! overlook! important! features! of! their! data.! This! proves! to! be! detrimental! when!
placing!the!same!data!in!the!context!of!an!auditory!display!where!the!user!might!wish!to!analyse!or!express!specific!
dimensions!under!a!range!of!circumstances.!The!following!investigation!describes!a!framework!for!a!modelJinduced!
parameter!mapping!technique!which!allows!for!an!explicit!level!of!control!over!the!flow!of!information,!supported!
by!a!number!of!key!conditions!in!both!the!auditory!and!visual!channels.!Given!that!the!formative!decisions!behind!
this!design!tailors!the!data!to!meet!the!purposes!of!sonification,!the!user!is!presented!with!a!viable!alternative!that!
overcomes!a!number!of!limitations!inherent!to!employing!a!more!conventional!physical!modeling!approach.!
Comprehension!of!Sonified!Weather!Data!Across!Multiple!Auditory!Streams!
Jonathan*Schuett,*Riley*Winton,*Bruce*Walker*
Weather!data!has!been!one!of!the!mainstays!in!sonification!research.!It!is!readily!available,!and!every!listener!has!
presumably!had!some!form!of!experience!with!meteorological!events!to!draw!from.!When!we!want!to!use!this!type!
of! complex! data! in! a! scenario! such! as! in! a! classroom,! we! need! to! be! sure! that! listeners! are! able! to! correctly!
comprehend!the!intended!information.!The!current!study!proposes!a!method!for!evaluating!the!usability!of!complex!
sonifications! that! contain! multiple! data! sets,! especially! for! tasks! that! require! inferences! to! be! made! through!
comparisons! across! multiple! data! streams.! This! extended! abstract! outlines! a! study! that! will! address! this! issue! by!
asking! participants! to! listen! to! sonifications! and! then! respond! with! a! description! of! general! understanding! about!
what!variables!changed,!and!how!said!changes!would!physically!be!represented!by!real!weather!conditions.!
Weather!to!Go!–!a!Blended!Sonification!Application!
René*Tünnermann,*Sebastian*Zehe,*Jacqueline*Hemminghaus,*Thomas*Hermann*
People! often! stay! in! touch! with! the! weather! forecast! for! various! reasons.! We! depend! on! knowing! the! upcoming!
weather!conditions!in!order!to!plan!activities!outside!or!even!just!to!decide!what!to!wear!on!our!way!to!work.!With!
weather!to!go!we!present!an!auditory!weather!report!which!informs!the!user!about!the!future!or!current!weather!
situation!when!leaving!home!in!the!morning!or!the!office!in!the!evening.!The!sonification!is!designed!to!be!calm,!
coherent! and! expectable! so! that! it! can! blend! well! into! the! user’s! familiar! environment.! In! this! work! the! auditory!
display!is!activated!when!somebody!leaves!through!the!door.!The!activity!is!sensed!by!a!multiJpurpose!sensor!unit!
mounted! at! the! door.! When! the! door! is! opened,! weather! to! go! renders! and! plays! sounds! that! characterize! the!
weather! forecast! for! the! region! where! the! system! is! located.! That! way,! the! system! raises! the! user’s! awareness! for!
suitable!clothes,!transportation!or!route!to!take!to!the!destination!in!the!right!moment.!
33!
!
TUESDAY,!JUNE!24,!10:30!J!11:30!AND!15:00!J!16:00!
!
Poster!Session!2!
Auditory!Display!of!Coarse!Optical!Imagery:!Concept!for!a!Rehabilitation!Aid!for!Blind!Spatial!
Orientation!
Aries*Arditi*
We!describe!a!concept!for!a!rehabilitation!aid!for!blind!persons!that!will!present,!on!a!sonic!display,!coarse!optical!
information!obtained!from!a!spectacleJmounted!camera.!The!aid!will!serve!blind!persons!who!have!no!light!sense!or!
who!can!at!most!detect!ambient!light.!The!approach!is!to!map!luminous!intensity!to!loudness!of!continuous!tones!
of!distinct!timbre!representing!a!small!number!of!directions!relative!to!that!of!the!user’s!head.!
Handheld!device!for!substitution!from!vision!to!audition!
Jean*Rouat,*Damien*Lescal,*Sean*Wood*
Sensorial!substitution!has!great!potential!in!rehabilitation,!education,!games,!and!in!the!creation!of!music!and!art.!
Current!technologies!allow!us!to!develop!sensorial!substitution!and!sonification!systems!that!would!not!have!been!
imaginable! two! decades! ago.! It! is! desirable! to! let! a! large! audience! use! and! test! sonification! systems! to! provide!
feedback! and! improve! their! design.! Handheld! devices! like! smartphones! or! tablets! include! network! connectivity!
(WIFI! and/or! Cellular! radio)! that! can! be! used! to! transmit! anonymous! information! about! the! configuration! and!
strategies! adopted! by! users.! It! is! now! feasible! to! obtain! feedback! from! any! user! of! substitution! and! sonification!
technology! and! not! only! from! a! limited! number! of! subjects! in! the! laboratory.! Testing! in! the! field! with! a! large!
number!of!users!is!now!possible!thanks!to!telecommunication!networks!and!machine!learning!tools!to!analyze!big!
data.! This! work! presents! a! handheld! implementation! of! a! simple! video! sonification! system! designed! to! test! the!
acceptability!of!vision!to!audition!substitution!systems!and!in!the!near!future!to!provide!feedback!from!users.!A!first!
beta! version! was! publicly! released! in! November! 2013! as! an! iOS! application! for! large! scale! testing.! The! extended!
abstract!introduces!the!interface!and!the!underlying!technology.!
!“Listen2dRoom”:!Helping!Visually!Impaired!People!Navigate!Indoor!Environments!Using!an!
Ultrasonic!SensorJBased!Orientation!Aid!
Maryam*Hosseini,*Andreas*Riener,*Rahul*Bose,*Myounghoon*Jeon*
People! with! visual! impairments! face! considerable! limitations! with! their! mobility,! but! still! there! is! little!
infrastructure!in!place!to!help!them.!In!this!study,!we!present!a!new!wearable!electronic!travel!aid!(ETA),!“Personal!
Radar”,! which! assists! blind! people! in! navigating! in! indoor! environments! using! ultrasonic! sensors.! After! briefly!
describing! our! initial! system! design,! we! report! the! improvements! from! the! pilot! study.! Then,! we! introduce! our!
experiment!in!progress.!In!the!experiment,!blind!folded!students!and!visually!impaired!people!will!navigate!through!
a!maze!and!an!empty!room!based!on!auditory!and!vibrotactile!feedback!of!the!device.!This!system!could!serve!as!an!
effective! research! platform! for! obstacle! detection,! current! location! awareness,! and! direction! suggestion! for! the!
blind.!
I!Hear!Bangalore3D:!Capture!and!Reproduction!of!Urban!Sounds!of!Bangalore!Using!an!
Ambisonic!Microphone!
Shashank*Aswathanarayana,*Agnieszka*Roginska*
This!paper!describes!the!project,!I!Hear!Bangalore3D,!which!is!an!attempt!to!capture!and!render!3D!recordings!of!
various!iconic!locations!of!the!city!of!Bangalore.!First!order!Ambisonic!recordings!were!done!and!processed!so!that!
34!
they! can! be! played! back! using! a! speaker! array! configuration! through! real! time! matrixing! or! using! headphones!
through!binaural!renderings!of!the!recordings.!This!project!has!both!aesthetic!and!informational!use!to!it.!Coming!
off!a!sister!project,!I!Hear!NY3D,!which!took!a!similar!route!in!Manhattan,!this!project!also!aims!at!comparing!the!
noise!levels!and!other!information!of!different!cities!in!different!parts!of!the!world.!
Interactive!Auditory!Display!of!Urban!SpatioJAcoustics!
Michael*Musick,*Tae*Hong*Park,*Jonathon*Turner*
This! paper! presents! an! interactive! exploration! platform! and! toolset! for! spatial,! bigJdata! auditory! display.! The!
exploration!platform!is!part!of!the!Citygram!project,!which!focuses!on!geospatial!research!through!a!cyberJphysical!
system!that!automatically!streams,!analyzes,!and!maps!urban!environmental!acoustic!energies.!Citygram!currently!
concentrates!on!dynamically!capturing!geoJtagged,!lowJlevel!audio!feature!vectors!from!urban!soundscapes.!These!
various! feature! vectors! are! measured! and! computed! via! AndroidJbased! hardware,! traditional! personal! computers,!
and! mobile! computing! devices! that! are! equipped! with! a! microphone! and! Internet! connection.! The! lowJlevel!
acoustic!data!streams!are!then!transmitted!to,!and!stored!in,!the!Citygram!database.!This!data!can!then!be!used!for!
auditory!display,!sonification,!and!visualization!by!external!clients!interfacing!with!the!Citygram!server.!Client!users!
can!stream!data!biJdirectionally!via!custom!software!that!runs!on!Cycling!‘74’s!Max!and!SuperCollider,!allowing!for!
participatory!citizenJscience!engagement!in!auditory!display.!
I!Hear!NY4D:!Hybrid!Acoustic!and!Augmented!Auditory!Display!for!Urban!Soundscapes!
Braxton*Boren,*Michael*Musick,*Jennifer*Grossman,*Agnieszka*Roginska*
This!project,!I!Hear!NY4D,!presents!a!modular!auditory!display!platform!for!layering!recorded!sound!and!sonified!
data!into!an!immersive!environment.!Our!specific!use!of!the!platform!layers!Ambisonic!recordings!of!New!York!City!
and!a!palette!of!virtual!sound!events!that!correspond!to!various!static!and!realtime!data!feeds!based!on!the!listener’s!
location.!This!creates!a!virtual!listening!environment!modeled!on!an!augmented!reality!stream!of!sonified!data!in!an!
existing!acoustic!soundscape,!allowing!for!closer!study!of!the!interaction!between!real!and!virtual!sound!events!and!
testing!the!limits!of!auditory!comprehension.!
ListenTree:!AudioJHaptic!Display!in!the!Natural!Environment!
Gershon*Dublon,*Edwina*Portocarrero*
In!this!paper,!we!present!ListenTree,!an!audioJhaptic!display!embedded!in!the!natural!environment.!A!visitor!to!our!
installation!notices!a!faint!sound!appearing!to!emerge!from!a!tree,!and!might!feel!a!slight!vibration!under!their!feet!
as!they!approach.!By!resting!their!head!against!the!tree,!they!are!able!to!hear!sound!through!bone!conduction.!To!
create! this! effect,! an! audio! exciter! transducer! is! weatherproofed! and! attached! to! the! tree! trunk! underground,!
transforming!the!tree!into!a!living!speaker!that!channels!audio!through!its!branches.!Any!source!of!sound!can!be!
played!through!the!tree,!including!live!audio!or!preJrecorded!tracks.!For!example,!we!used!the!ListenTree!to!display!
live! streaming! sound! from! an! outdoor! ecological! monitoring! sensor! network,! bringing! an! urban! audience! into!
contact! with! a! faraway! wetland.! Our! intervention! is! motivated! by! a! need! for! forms! of! display! that! fade! into! the!
background,! inviting! attention! rather! than! requiring! it.! ListenTree! points! to! a! future! where! digital! information!
might!become!a!seamless!part!of!the!physical!world!
Design!and!Evaluation!of!Lyricons!(Lyrics!+!Earcons)!for!Semantic!and!Aesthetic!Improvements!
of!Auditory!Cues!
Myounghoon*Jeon,*Yuanjing*Sun*
Auditory!researchers!have!developed!various!nonJspeech!cues!in!designing!auditory!user!interfaces.!A!preliminary!
study!of!“Lyricons”!(lyrics!+!earcons)!has!provided!a!novel!approach!to!devising!auditory!cues!in!electronic!products,!
by!combining!the!concurrent!two!layers!of!musical!speech!and!earcons!(short!musical!motives).!The!purpose!of!the!
35!
present! study! is! to! introduce! iterative! design! processes! and! to! validate! the! effectiveness! of! lyricons! compared! to!
earcons,! whether! people! can! more! intuitively! grasp! functions! that! lyricons! imply! than! those! of! earcons.! Results!
favor!lyricons!over!earcons.!Future!work!and!practical!application!directions!are!also!discussed.!
How!Many!Auditory!Icons,!in!a!Control!Room!Environment,!Can!You!Learn?!
Ronja*Frimalm,*Johan*Fagerlönn,*Stefan*Lindberg,*Anna*Sirkka*
Previous!research!has!shown!that!auditory!icons!can!be!effective!warnings.!The!aim!of!this!study!was!to!determine!
the!number!of!auditory!icons!that!can!be!learned,!in!a!control!room!context.!The!participants!in!the!study!consisted!
of!14!control!room!operators!and!15!people!who!were!not!control!room!operators.!The!participants!were!divided!into!
three! groups.! Prior! to! the! testing! the! three! groups! practiced! on! 10,! 20! and! 30! different! sounds.! Each! group! was!
tested!using!the!sounds!that!they!had!practiced.!The!results!support!the!potential!for!learning!and!recalling!a!large!
number!of!auditory!icons,!as!many!as!30.!The!results!also!show!that!sounds!with!similar!characteristics!are!easily!
confused.!
Prototype!Auditory!Displays!for!a!Fuel!Efficiency!Driver!Interface!
Michael*Nees,*Thom*Gable,*Myounghoon*Jeon,*Bruce*Walker*
We!describe!workJinJprogress!prototypes!of!auditory!displays!for!fuel!efficiency!driver!interfaces!(FEDIs).!Although!
research!has!established!that!feedback!from!FEDIs!can!have!a!positive!impact!on!driver!behaviors!associated!with!
fuel! economy,! the! impact! of! FEDIs! on! driver! distraction! has! not! been! established.! Visual! displays! may! be!
problematic! for! providing! this! feedback;! it! is! precisely! during! fuelJconsuming! behaviors! that! drivers! should! not!
divert! attention! away! from! the! driving! task.! Auditory! displays! offer! a! viable! alternative! to! visual! displays! for!
communicating!information!about!fuel!economy!to!the!driver!without!introducing!visual!distraction.!
36!
!
WEDNESDAY,!JUNE!25,!10:30!J!11:30!AND!15:00!J!16:00! !!!
Poster!Session!3!
Binaural!Reproduction!over!Loudspeakers!Using!a!Modified!Target!Response!
Ismael*Nawfal,*Josh*Atkins*
Crosstalk! cancellation! (XTC)! is! a! technique! that! can! be! used! to! play! binaural! content,! typically! meant! for!
headphone!playback,!over!two!or!more!loudspeakers.!Though!effective!at!creating!a!binaural!spatial!sound!field!at!
the!listening!position,!many!XTC!algorithms!introduce!spectral!coloration,!suffer!from!spatial!robustness!issues!and!
create! filters! that! are! unrealizable! in! practice.! Past! approaches! to! dealing! with! this! issue! rely! heavily! on!
regularization.! In! this! work! we! propose! a! new! topology! for! loudspeaker! binaural! rendering! (LBR)! that! performs!
better! than! conventional! techniques! without! the! need! for! regularization! commonly! associated! with! crosstalk!
cancellation! based! binaural! renderers! (XTCJBR).! We! then! explore! the! use! of! a! proposed! LBR! in! the! context! of!
multiple! output! channels.! A! method! is! investigated! to! further! optimize! the! filter! design! process! by! selecting! an!
appropriate!modeling!delay!and!filter!length!using!methods!practiced!in!XTC!filter!design.!
iEAR:!Immersive!Environmental!Audio!for!Photorealistic!Panoramas!
Paul*Riker*
This! paper! presents! iEAR,! a! flexible! spatial! audio! rendering! tool! for! use! with! photorealistic! monoscopic! and!
stereoscopic! panoramas! across! various! display! systems.! iEAR! allows! users! to! easily! present! multichannel! audio!
scenes! over! variable! speaker! arrangements,! while! maintaining! tight! integration! with! the! corresponding! visual!
elements! of! the! display! media.! Built! in! the! Max/MSP! Audio! Programming! Environment,! iEAR! utilizes! wellJ
established! panning! methods! to! accommodate! a! wide! range! of! speaker! configurations.! Audio! scene! orientation! is!
tied! to! the! visual! scene! using! an! OSC! connection! with! the! visualization! software,! allowing! users! to! render! and!
spatialize! multichannel! environmental! audio! recordings! in! tandem! with! the! changing! perspective! in! the! visual!
scene.!
Localization!Accuracy!in!Presenting!Measured!Sound!Fields!via!Higher!Order!Ambisonics!
Samuel*Clapp,*Anne*Guthrie,*Jonas*Braasch,*Ning*Xiang*
A!spherical!microphone!array!can!encode!a!measured!sound!field!into!its!spherical!harmonic!components.!Such!an!
array!will!be!subject!to!limitations!on!the!highest!spherical!harmonic!order!it!can!encode!and!encoding!accuracy!at!
different! frequencies.! Ambisonics! is! a! system! designed! to! reproduce! the! spherical! harmonic! components! of! a!
measured! or! virtual! sound! field! using! multiple! loudspeakers.! In! Ambisonic! systems,! the! size! of! the! sweet! spot! is!
wavelength! dependent,! and! thus! decreases! in! size! with! an! increase! in! frequency.! This! paper! examines! how! to!
reconcile!the!limitations!of!the!recording!and!playback!stages!to!arrive!at!the!optimum!Ambisonic!decoding!scheme!
for!a!given!spherical!array!design.!In!addition,!binaural!models!are!used!to!evaluate!these!systems!perceptually.!
!
Using!Published!Hrtfs!with!Slab3d:!MetricJBased!Database!Selection!and!Phenomena!Observed!
Joel*Miller,*Martine*GodfroySCooper,*Elizabeth*Wenzel*
In!this!paper,!two!publicly!available!headJrelated!transfer!function!(HRTF)!database!collections!are!analyzed!for!use!
with!the!openJsource!slab3d!rendering!system.!After!conversion!to!the!slab3d!HRTF!database!format!(SLH),!a!set!of!
visualization!tools!and!a!fiveJstep!metricJbased!process!are!used!to!select!a!subset!of!databases!for!general!use.!The!
37!
goal!is!to!select!a!limited!subset!least!likely!to!contain!anomalous!behavior!or!measurement!error.!The!described!set!
of!openJsource!tools!can!be!applied!to!any!HRTF!database!converted!to!the!slab3d!format.!
SonicTaiji:!A!Mobile!Instrument!For!Taiji!Performance!
Jianyu*Fan,*Spencer*Topel*
SonicTaiji!is!a!mobile!instrument!designed!for!the!Android!Platform.!It!utilizes!accelerometer!detection,!realJtime!
sound! synthesis,! and! data! communication! techniques! to! achieve! realJtime! Taiji! sonification.! Taiji! (Tai! Chi)! is! an!
innerJstrength!martial!art!aimed!at!inducing!meditative!states.!In!this!mobile!music!application,!Taiji!movements!
are!sonified!via!gesture!detection,!connecting!listening!and!movement.!This!instrument!is!a!tool!for!practitioners!to!
enhance! the! meditative! experience! of! performing! Taiji.! We! describe! the! implementation! of! gesture! position!
selection,!realJtime!synthesis!design,!and!data!mapping.!We!then!describe!outcomes!of!subjective!evaluations!of!the!
user!experience.!
Sonification!Synthesizer!for!Surface!Electromyography!
Camille*Peres,*Cody*Faisst,*Nathan*Slota,*Daniel*Verona,*Chase*Williams,*Paul*Ritchey*
Surface!electromyography!(sEMG)!is!a!means!for!measuring!muscular!activity!beneath!the!surface!of!the!skin.!It!is!
used!as!a!biofeedback!tool!and!also!as!a!means!for!studying!the!biomechanics!of!human!movement.!sEMG!data!are!
typically!displayed!graphically!on!a!computer!screen!and!while!this!can!be!a!useful!way!to!display!the!data,!it!is!not!
always! ideal.! This! extended! abstract! proposes! the! development! of! a! sonification! tool! that! allows! users! to! sonify!
sEMG!data!for!scientific!purposes!and!have!realJtime!control!over!the!sounds!that!the!tool!generates.!The!tool!will!
consist!of!two!parts:!a!graphical!user!interface!(GUI)!that!allows!the!user!to!independently!control!the!sound!of!each!
channel!as!the!front!end!and!sonification!code!as!the!back!end,!similar!to!a!software!synthesizer.!Independent!realJ
time!control!of!each!channel!will!allow!the!user!to!create!sonification!models,!which!are!mappings!of!certain!sounds!
to! specific! muscle! groups.! The! GUI! will! allow! the! user! to! save! and! access! sonification! models! for! later! use.! A!
prototype! of! the! tool! is! currently! being! developed! using! NI! LabVIEW! in! parallel! with! a! Delsys! Trigno! Wireless!
sEMG! system.! However,! various! issues! with! LabVIEW! are! forcing! the! design! team! to! consider! moving! to! a! more!
conventional!programming!environment!such!as!C++!or!Java.!It!is!anticipated!that!different!sonification!models!will!
be!better!suited!to!different!tasks,!e.g.!one!model!may!be!more!ideal!for!data!analysis!and!data!exploration!while!
another! model! may! be! better! suited! for! biofeedback.! This! tool! will! allow! the! user! to! easily! explore! these! various!
kinds!of!sonification!models!and!test!them!for!intuitiveness!and!accuracy.!
A!Verification!Task!with!Lateralized!Tones!and!Accelerated!Speech!
Michael*Nees,*Kathryn*Best*
Research! has! suggested! that! the! left! hemisphere! of! the! brain! may! be! specialized! for! processing! auditory! speech,!
whereas!the!right!hemisphere!may!be!specialized!for!processing!nonspeech!auditory!stimuli.!Due!to!contralaterality!
in!auditory!pathways,!this!functional!specialization!has!been!reflected!in!behavioral!advantages!for!speech!stimuli!
presented! to! the! right! ear! and! for! nonspeech! stimuli! presented! to! the! left! ear.! We! used! a! verification! task! with!
lateralized!presentations!of!brief!tonal!stimuli!(sonifications)!and!accelerated!speech!stimuli!(spearcons)!to!examine!
performance!as!a!function!of!the!presentation!ear!and!the!type!of!auditory!display.!The!general!pattern!of!results!
showed! that! reaction! time! and! accuracy! were! facilitated! when! two! accelerated! speech! stimuli! were! compared! to!
each!other.!Based!on!the!results!of!this!study,!reported!effects!of!left!and!right!ear!advantages!do!not!seem!to!be!
robust!enough!to!warrant!general!ergonomic!recommendations!(i.e.,!left!ear!presentation!of!nonspeech!sounds!and!
right!ear!presentation!of!speech!sounds)!for!auditory!display!design.!
38!
Using!VocalJBased!Sounds!to!Represent!Sentiment!in!Complex!Event!Processing!
Jeff*Rimland,*Mark*Ballora*
There! is! an! intricate! and! evolving! relationship! between! sonification! and! Complex! Event! Processing! (CEP)! for!
improved!situational!awareness.!In!a!paper!presented!at!ICAD!2013![1],!we!introduced!a!series!of!techniques!using!
CEP!for!simultaneous!sonification!of!both!quantitative!“hard”!data!and!humanJderived!“soft”!data!in!the!context!of!
assistive!technology.!The!connection!of!CEP!and!sonification!was!explored!further!in!the!context!of!a!severe!weather!
tracker! that! relies! on! fusion! of! quantitative! (sensorJbased)! weather! data! along! with! human! observations! about!
storms! and! related! conditions! [2].! An! area! of! shortcoming! in! both! of! these! earlier! works! was! the! difficulty! in!
creating! sounds! that! represented! human! sentiment! about! observed! conditions! (e.g.! unanticipated! obstacles! for! a!
blind!person!crossing!a!busy!street,!or!impending!dangerous!weather!conditions)!in!a!format!that!enabled!intuitive!
listening!for!improved!situational!awareness.!This!extended!abstract!provides!an!update!on!that!continuing!research!
by!representing!human!sentiment!data,!via!the!use!of!vocal!synthesis!that!is!driven!by!Complex!Event!Processing.!
Relationships!Between!Acoustic!Features!and!Perceptual!Segmentation!of!Music!Audio!
Roger*Dean*
For! a! successful! practical! sonification,! boundaries! where! the! information! state! changes! need! to! be! made! readily!
apparent!perceptually.!I!describe!time!series!analysis!techniques!for!the!detection!of!segments!perceived!implicitly!
during! continuous! music! audio.! The! detected! segments! are! compared! with! those! measured! computationally,! or!
determined!musicologically,!on!the!input!audio.!The!degree!to!which!perceptual!segmentation!can!be!predicted!is!
discussed,! together! with! some! of! the! factors! apparently! responsible.! This! may! give! useful! cues! as! to! how! best! to!
structure!sonifications!for!informational!purposes.!!
On!the!Importance!of!Correspondence!Between!Shapes!and!Timbre!
Mohammad*Adeli,*Jean*Rouat,*Stéphane*Molotchnikoff*
The!results!of!a!preliminary!study!of!the!audioJvisual!correspondence!between!musical!timbre!and!visual!shapes!are!
reported.!22!participants!had!to!play!20!musical!sounds!and!choose!a!shape!for!each.!An!association!between!timbre!
and! visual! shapes! emerged.! Soft! timbres! seem! to! match! with! rounded! shapes,! harsh! timbres! with! sharp! angular!
shapes!and!timbres!having!elements!of!softness!and!harshness!together!with!a!mixture!of!the!two!previous!shapes.!
The!correspondence!between!timbres!and!shapes!should!lend!itself!to!the!development!of!perceptually!supported!
musical! interfaces! and! substitution! systems.! A! larger! scale! experiment! with! more! sounds! and! participants! is!
underway!and!confirms!the!preliminary!results!reported!in!this!paper.!
Comparing!Auditory!Stimuli!for!Sleep!Enhancement:!Mimicking!a!Sleeping!Situation!
Matti*Gröhn,*Miika*Leminen,*Minna*Huotilainen,*Tiina*Paunio,*Jussi*Virkkala,*Lauri*Ahonen*
Recently,! two! research! groups! have! reported! that! the! depth! and/or! duration! of! Slow! Wave! Sleep! (SWS)! can! be!
increased!by!playing!short!sounds!with!approximately!1!second!intervals!during!or!prior!to!SWS.!These!studies!have!
used!sounds!with!neutral!or!negative!valence:!sinusoidal!1JkHz!tones!or!short!pink!noise!bursts.!Since!music!therapy!
research! shows! beneficial! effects! of! pleasant,! natural! sounds! and! music,! the! sounds! in! the! experiments! may! have!
been!suboptimal.!Thus,!we!aimed!at!choosing!optimal!sounds!such!that!they!could!be!used!in!increasing!the!depth!
or!duration!of!SWS!taking!into!account!both!the!need!of!fast!rise!times,!short!duration,!and!pleasantness.!Here!we!
report! results! of! a! listening! test! mimicking! a! sleeping! situation! in! which! the! subjects! compared! how! pleasant,!
relaxing,!and!imageJevoking!they!found!3!natural,!short!instrument!sounds!with!fast!rise!times!compared!to!a!short!
pink! noise! burst! used! in! the! previous! experiments.! The! natural! sounds! were! selected! from! our! previous! listening!
test!as!the!most!pleasant!ones.!The!results!will!be!used!as!the!basis!for!choosing!the!optimal!sounds!for!the!sleep!
studies.!
39!
!
STUDENT!THINK!TANK!POSTERS!
!
Sonification!of!Astronomy!for!Supplementing!Space!Science!Learning!
Brianna*Tomlinson*S*Georgia*Tech*
Astronomy! is! a! field! that! is! inherently! visual,! since! much! of! what! we! have! observed! in! space! occurred! through!
normal!or!assisted!visual!searching.!However,!even!though!astronomy!is!visual,!it!also,!uniquely!separate!from!any!
other!STEM!field,!naturally!contains!an!auditory!component!through!projects!like!SETI!(Search!for!Extraterrestrial!
Intelligence)! and! other! types! of! radio! astronomy.! As! unique! as! astronomy! is! in! occupying! both! these! forms! of!
presentation,!even!the!auditory!information!is!frequently!transformed!into!a!visual!medium.!Even!with!its!inherent!
auditory!content,!astronomy!(and!astronomical!concepts)!are!not!often!taught!or!presented!through!sound.!I!want!
to! explore! and! develop! a! method! to! sonify! astronomy! concepts! and! information! as! a! supplement! to! traditional!
methods!of!formal!and!informal!astronomy!and!space!science!education,!focusing!initially!on!the!Solar!System!and!
the!planets!within!it.!Some!challenges!include!how!to!provide!orientation,!what!important!characteristics!should!be!
sonified!(mass,!rotation,!rings,!color,!composition,!etc.),!and!how!to!sonify!empty!space.!
Auditory!Response!Code!
Yunhao*(Chris)*Wan*S*Clemson*University*
In! this! proposal,! I! present! a! concept! called! ”Auditory! Response! Code”! in! which! each! sound! clip! can! contain! URL!
address! information! that! can! be! extracted! by! the! monaural! microphone! on! a! cellphone,! tablet,! or! other! mobile!
device.!To!implement!this!concept!and!make!it!practically!feasible,!we!plan!to!incorporate!audio!watermarking,!URL!
shortening/compressing!services.!
Design!of!an!Accessible!and!Portable!System!for!Soccer!Players!with!Visual!Impairments!
Alireza*Zare*S*Clemson*University*
Many!people!with!visual!impairments!actively!play!soccer,!however!the!task!of!making!the!game!accessible!is!met!
with!significant!challenges.!These!challenges!include:!the!need!to!constantly!talk!to!signify!location!and!detecting!
the! positions! of! silent! objects! on! the! field.! Our! work! aims! to! discover! methods! to! help! persons! with! visual!
impairments!play!soccer!more!efficiently!and!safely.!The!proposed!system!uses!headphoneJrendered!spatial!audio,!
an!onJperson!computer,!and!sensors!to!create!3D!sound!that!represents!the!objects!on!the!field!in!realJtime.!This!
depiction!of!the!field!will!help!players!to!more!accurately!detect!the!locations!of!objects!and!people!on!the!field.!The!
present!work!describes!the!design!of!such!a!system!and!discusses!perceptual!challenges.!Broadly,!our!work!aims!to!
discover!ways!to!enable!people!with!visual!impairments!to!detect!the!position!of!moving!objects,!which!will!allow!
them!to!feel!empowered!in!their!personal!lives!and!give!them!the!confidence!to!navigate!more!independently.!
GraphJBased!Representation!and!Interaction!of!LargeJScale!Musical!Structure!
Mingfeng*Zhang*S*University*of*Rochester*
This! research! project! investigates! largeJscale! musical! structures! using! graphJbased! representation! and! interaction!
for!musicology!research!and!multimedia!applications.!The!largeJscale!musical!structures!refer!to!complex!musical!
structures! that! have! a! long! time! span! or! complex! internal! connections.! We! form! a! computational! analysis!
framework! that! represents! music! objects! as! network! nodes! and! their! connections! as! network! edges.! This! analysis!
framework!forms!complex!graphical!structures!that!can!be!treated!as!complex!networks!for!inJdepth!computational!
processing! and! manual! interactions.! The! graphJbased! representation! we! implemented! here! is! based! on! musical!
reductive!analysis,!which!is!a!musicology!analysis!that!sort!complex!musical!structure!into!hierarchical!levels,!with!
40!
simpler! or! more! reduced! structure! at! the! higher! analysis! levels.! Based! on! the! graphical! representation! of! musical!
reductive!analysis,!we!attempt!to!validate!its!musical!interpretations!and!elicit!additional!musical!concepts!from!the!
topological!descriptors.!We!also!explore!the!combinatorial!properties!of!the!proposed!representation!framework!to!
elucidate!the!“big!data”!complexity!associated!with!largeJscale!graphical!analysis!and!interactions.!!
Universal!Synchrony!Music!
Sarah*Weaver*S*Stony*Brook*University*
Universal! Synchrony! Music! (USM)! is! a! cosmic! multiJyear! telematic! music! project! conceived! and! directed! by!
composer! Sarah! Weaver! in! collaboration! with! the! NASA! Kepler! Mission! and! NASA! ArtSpace! exploring! musical,!
technological,!and!metaphorical!realizations!of!synchrony.!Sonification!of!data!from!the!Kepler!Mission!on!stars!and!
planets! 1000J3000! light! years! away! is! utilized! for! presence! and! interaction! for! synchrony.! Synchrony! is! defined! as!
perception! of! alignment! of! distributed! time! and! space! components.! USM! Volume! 1! premiered! April! 2013! “Virtual!
Tour:!A!ReducedJCarbon!Footprint!Concert!Series”!coordinated!by!Mark!Dresser!and!Michael!Dessen!at!University!
of! California! San! Diego,! Rensselaer! Polytechnic! Institute,! and! Simons! Center! for! Geometry! and! Physics! at! Stony!
Brook!University!with!support!from!Consortium!for!Digital!Arts,!Culture,!and!Technology!(cDACT).!USM!Volume!2!
premiered!April!2014!as!its!own!concert!at!Center!for!Computer!Research!in!Music!and!Acoustics!(CCRMA)!Stanford!
University!directed!by!Chris!Chafe!and!Simons!Center!at!Stony!Brook!University!with!support!from!cDACT.!USM!
Volume! 3! is! planned! for! 2015.! The! electroacoustic! telematic! ensemble! is! comprised! of! renowned! experimental!
musicians!utilizing!their!individual!innovative!musical!languages!in!manifestation!of!the!piece.!Telematic!music!is!
live!performance!via!the!internet!by!musicians!in!different!geographic!locations.!The!network!technology!involves!
JackTrip! audio! software,! HD! videoconferencing,! and! Internet2.! The! presentation! will! show! documentation! from!
USM!and!discuss!the!sonification!strategies!from!artistic!and!technological!perspectives.!
Collaborative!Sonification!Design!to!Sonify!Climate!Data!
Visda*Goudarzi*S*Institute*of*Electronic*Music*and*Acoustics,*University*of*Music*and*Performing*Arts*Graz*
Climate!data!provide!a!challenging!working!basis!for!sonification.!Both!model!data!and!measured!data!are!assessed!
in! collaboration! with! the! Wegener! Center! for! Climate! and! Global! Change.! The! multi! dimensionality! and! multi!
variety!of!climate!data!has!a!great!potential!for!auditory!displays.!Furthermore,!there!is!consensus!on!global!climate!
change! and! the! necessity! of! intensified! climate! research! today! in! the! scientific! community! and! general! public.!
Sonification!provides!a!new!means!to!communicate!scientific!results!and!inform!a!wider!audience.!SysSon!is!a!user!
centered! auditory! platform! for! climate! scientists! to! analyze! data.! It! gives! scientists! broader! insights! by! extracting!
hidden! patterns! and! features! from! data! that! is! not! possible! using! a! single! modal! visual! interface.! Through!
collaborative!design!of!the!SysSon!platform,!a!variety!of!sonifications!and!soundscapes!are!created!for!the!users!to!
choose! from! which! lessens! the! fatigue! that! comes! with! repeated! and! sustained! listening! to! long! streams! of! data.!
SysSon! presents! a! novel! interactive! sonification! tool,! which! combines! a! workspace! for! the! scientists! with! a!
development!environment!for!sonification!models.!In!the!standalone!desktop!application,!multiple!data!sources!can!
be! imported,! navigated! and! manipulated! either! via! text! or! a! graphical! interface,! including! traditional! plotting!
facilities.! Sound! models! are! built! from! unit! generator! graphs,! which! are! enhanced! with! matrix! manipulation!
functions.!They!allow!us!to!systematically!experiment!with!elements!known!from!the!visual!domain,!such!as!range!
selections,!scaling,!thresholding,!markers!and!labels.!The!models!are!organized!in!an!extensible!library,!from!which!
the! user! can! choose! and! parametrize.! Importance! is! given! to! the! persistence! of! all! configurations,! in! order! to!
faithfully!reproduce!sonification!instances.!!
Comprehension!of!Sonifications!That!Contain!Multiple!Information!Streams!
Jonathan*Schuett*S*Georgia*Institute*of*Technology*
When!sonifications!are!used!in!place!of!visual!displays,!it!is!important!that!listeners!are!able!to!correctly!understand!
the!messages!being!conveyed.!This!is!especially!the!case!for!complex!sonifications!that!may!require!multiple!streams!
41!
of! information! to! be! presented! simultaneously.! If! this! is! done! properly,! the! sonification! will! leverage! emergent!
properties!of!the!audio!streams!that!can!be!experienced!when!multiple!pieces!of!information!are!displayed!together!
in!order!to!enhance!comprehension!and!overall!user!experience.!This!creates!an!interesting!research!opportunity!to!
explore! how! comprehension! occurs! in! multiJstream! sonifications,! and! more! importantly,! creates! a! need! for!
methodology!that!can!be!used!to!assess!listeners’!overall!comprehension!of!these!displays.!This!has!been!the!focus!
of! my! current! research! and! should! help! inform! the! ICAD! community! about! ways! of! evaluating! listener!
comprehension!of!sonifications!containing!multiple!information!streams.!
Designing!Intuitive!Auditory!Signals!for!InJvehicle!Information!Systems!
Bridget*Lewis*S*George*Mason*University*
The!current!investigation!details!a!set!of!experiments!designed!to!evaluate!acoustic!characteristics!that!contribute!
to!the!perceptions!of!a!sound!as!being!intuitively!unimportant!(specifically,!socially!related)!in!the!context!of!an!inJ
vehicle!interface.!Using!a!categorization!task,!sounds!were!sorted!into!categories!including!highly!urgent!“alarms”,!
vehicle! status! sounds! and! social! notifications! for! inJvehicle! entertainment! systems.! Results! indicated! that! four!
criteria!(onset!time,!burst!duration,!total!on!time!and!interJpulse!interval)!explained!87%!of!the!variance!in!social!
alert! categorization.! From! these! criteria,! cutoffs! were! created! in! order! to! further! investigate! the! impact! of! these!
criteria!on!perceptions!of!importance!or!unimportance!and!were!tested!further!using!the!same!methodology.!In!a!
final!rapid!categorization!experiment,!sounds!which!met!no!criteria!or!only!one!criteria!were!responded!to!slower!
than!sounds!which!met!most!or!all!criteria!indicating!that!sounds!which!do!not!meet!our!criteria!may!be!considered!
more! ambiguous! by! users! and! harder! to! immediately! categorize! or! dismiss.! These! results! indicate! that! it! may! be!
possible!to!use!these!types!of!categorization!tasks!to!define!important!acoustic!characteristics!of!a!sound!in!order!to!
better!facilitate!the!design!of!intuitive,!unambiguous!signals!
The!Mitigating!Effects!of!Music!on!Angry!Driving!
S.*Maryam*Fakhrhosseini*S*Michigan*Technological*University*
Most!studies!regarding!the!influence!of!music!on!driving!focus!on!music’s!impairment!on!the!driver’s!attention,!and!
ignore!the!possibility!of!using!music!to!reduce!the!detrimental!effects!of!driving.!In!the!present!study,!we!investigate!
how! music! can! mitigate! the! driving! performance! deficits! associated! with! angry! driving.! To! this! end,! fiftyJthree!
drivers!participated!in!a!simulated!driving!with!and!without!induced!anger.!Two!groups!induced!an!angry!affective!
state.! Then,! they! listened! to! happy! or! sad! music! pieces! while! they! drove! in! a! simulator.! Two! remaining! groups!
including!angry!and!neutral!drivers!did!not!listen!to!music!during!driving.!The!results!show!that!participants!who!
listened!to!either!happy!or!sad!music!had!significantly!fewer!driving!errors!than!those!who!did!not!listen!to!music.!
However,!no!significant!differences!were!found!between!happy!and!sad!music!conditions.!Results!are!discussed!with!
an!affect!regulation!model!and!future!research.!
SoundscapeJdriven!Sonification!Design!
KatieAnna*Wolf*S*Princeton*University*
Interactivity! plays! a! key! role! in! making! sonifications! useful,! and! giving! users! the! ability! to! design! their! own!
sonification! has! many! benefits.! However,! creating! the! dataJtoJsound! mappings! is! not! an! easy! task.! There! are!
individual!preferences!as!to!what!is!aesthetically!pleasing,!multiple!dimensions!of!sound!that!can!be!manipulated!to!
convey! information,! as! well! as! theoretical! foundations! for! how! to! convey! temporal! and! spatial! information! using!
sound.!We!hope!to!address!these!challenges!by:!(1)!using!natural!acoustic!soundscapes!from!the!environment,!that!
have! already! been! shown! to! have! a! pleasant! aesthetic! for! conveying! information,! and! (2)! creating! a! method! for!
automatically!generating!mappings!from!constraints!that!can!be!interactively!applied.!The!main!goal!of!our!work!is!
to! create! dataJdriven! algorithms! and! interfaces! to! improve! the! sonification! design! process.! We! intend! to! explore!
how!users!can!be!involved!in!the!customization!of!sonification!design!through!the!sound!and!data!selection!process!
and! the! creation! and! exploration! of! dataJtoJsound! mappings.! Here! we! present! out! initial! implementation! of! our!
42!
method! for! dataJdriven,! interactive! soundscape! sonification! in! a! custom! built! interface! that! allows! end! users! to!
sonify! data! from! Twitter.! We! address! a! number! of! questions! related! to! user! interaction! with! the! system! and! our!
ideas!for!future!work.!
Audification!of!Lightcurves!of!Space!Debris!Objects!
Monika*Hager*S*Astronomical*Institute*of*the*University*of*Bern*(AIUB)**
A!lightcurve!consists!of!a!sequence!of!optical!observations!of!an!extraterrestrial!object.!NonJoperational!satellites,!
spacecraft!as!well!as!their!individual!components!are!called!space!debris.!Space!debris!is!one!of!the!major!areas!of!
research! of! the! AIUB,! and! lightcurves! ar! the! primary! data! source.! As! space! debris! object! have! some! attitude! and!
rotation! status,! the! lightcurves! are! in! principle! periodic! and! thus! acccessible! to! audiification.! I! will! focus! on! the!
relation!between!the!ideal!and!the!effecively!acquired,!real!lightcurve.!The!ideal!lightcurve!has!many!thousands!of!
data!points!at!equal!temporal!distances.!The!real!lightcurve!is!sometimes!short,!interrupted!or!distorted!in!the!sense!
that! data! points! are! missing! or! not! equally! spaced.! I! present! sound! examples! of! an! ideal,! artificial! (simulated)!
lightcurve!that!undergoes!distorting!manipulations.!I!will!also!present!a!short!soundexample!of!a!real!lightcurve.!
GSM!Signal!Sonification!for!Crisis!Resilience!
David*PoirierSQuinot*S*Laboratoire*d'Informatique*pour*la*Mécanique*et*les*Sciences*de*l'Ingénieur*(LIMSI)*
Radio! goniometry,! i.e.! the! estimation! of! azimuth! and! elevation! of! received! radio! waves! is! often! used! for! civilian!
rescue! operations! (e.g.! avalanche! victim! rescue).! While! mature! studies! have! been! conducted! on! antenna! array!
geometry!and!algorithmic!optimization!(of!estimated!azimuth!/!elevation!/!distance),!only!a!few!industrials!tackled!
the! ergonomics! and! sound! design! of! such! apparatus.! A! recursive! optimization! of! ergonomics! and! sound! design!
requires!the!prototyping!of!a!Direction!Finder!(e.g.!Radio!goniometer),!given!the!complexity!of!the!humanJmachine!
interface!involved.!To!ease!this!process,!one!can!design!a!virtual!prototype!(e.g.!in!a!CAVE!environment).!It!makes!
the! study! cheaper,! faster! and! more! reproducible! (given! one! characterize! the! ecological! validity! of! the! virtual!
prototype!implementation).!Research!Problem:!What!kind!of!sonification!paradigm/metaphor/mapping!could!allow!
an! endJuser! to! be! able! to! perceive! huge! variations! (between! r! and! 2r)! AND! small! variations! (9r! and! 10r)! without!
having!anything!like!sensitivity!level!applied!on!the!sonification?!Radio!goniometry,!i.e.!the!estimation!of!azimuth!
and! elevation! of! received! radio! waves! is! often! used! for! civilian! rescue! operations! (e.g.! avalanche! victim! rescue).!
While!mature!studies!have!been!conducted!on!antenna!array!geometry!and!algorithmic!optimization!(of!estimated!
azimuth!/!elevation!/!distance),!only!a!few!industrials!tackled!the!ergonomics!and!sound!design!of!such!apparatus.!
A!recursive!optimization!of!ergonomics!and!sound!design!requires!the!prototyping!of!a!Direction!Finder!(e.g.!Radio!
goniometer),!given!the!complexity!of!the!humanJmachine!interface!involved.!To!ease!this!process,!one!can!design!a!
virtual! prototype! (e.g.! in! a! CAVE! environment).! It! makes! the! study! cheaper,! faster! and! more! reproducible! (given!
one!characterize!the!ecological!validity!of!the!virtual!prototype!implementation).!Research!Problem:!What!kind!of!
sonification!paradigm/metaphor/mapping!could!allow!an!endJuser!to!be!able!to!perceive!huge!variations!(between!r!
and!2r)!AND!small!variations!(9r!and!10r)!without!having!anything!like!sensitivity!level!applied!on!the!sonification?!
Sonification!of!Urban!Soundscape!Data!with!the!Goal!of!Creating!Immersive!Environments!for!
Naïve!Exploration!
Michael*Musick*S*New*York*University*
My! primary! area! of! interest! is! in! immersive! interactive! installations! that! allow! naïve! participants,! goal! oriented!
researchers,! or! skilled! musicians! to! explore,! discover,! and! play.! In! the! last! two! years! this! guiding! interest! has!
allowed!me!to!work!on!a!number!of!interesting!projects!with!the!capture!and!sonification!of!spatioJtemporal!nonJ
ocular! data,! layers! of! sonification! for! various! types! of! social! media! data,! and! representations! of! balance! and!
evolution! in! dynamical! sonic! ecosystems.! My! interest! in! the! think! tank! is! to! present! the! work! I! have! done! with!
sonifications! of! urban! soundscape! data.! In! particular,! I! have! started! focusing! on! compositional! uses! of! this! data,!
potentials!for!shared!experiences!between!connected!urban!soundscapes,!and!sonifications!that!illuminate!general!
43!
characteristics! of! distinction! between! large! urban! soundscapes.! The! goal! of! this! work! is! to! create! immersive!
environments! that! allow! participants! to! understand! these! differences! or! similarities,! and! to! drive! the! experience!
they!have!with!this!explorative!process.!
Introducing!Semantic!Information!in!the!Auditory!Alarms!of!Medical!Equipment!to!Reduce!
Alarm!Fatigue!
Steven*Landry*S*Michigan*Technological*University*
Alarm!fatigue!is!a!serious!problem!in!America!as!well!as!the!rest!of!the!world.!Medical!professionals!in!a!hospital!
setting!can!be!exposed!to!as!many!as!700!physiological!monitoring!alarms!per!patient!per!day!(Cvach,!2012).!Alarm!
fatigue! was! also! named! the! biggest! problem! in! medical! equipment! technologies! in! 2012.! Surveys! of! healthcare!
professionals! indicate! that! an! outrageously! high! percentage! of! these! warnings! are! false! alarms! (86%J99%)! (Clark,!
David,!&!Korniewicz,!2008).!The!high!rate!of!false!alarm!leads!to!alarm!fatigue,!which!contributes!to!mistrust!of!the!
equipment.!This!mistrust!manifests!in!doctors!and!nurses!ignoring!alarms,!decreasing!the!volume,!or!even!muting!
the!audio!of!an!instrument.!This!annoyance!avoidance!behavior!results!in!costly!mistakes.!An!FDA!database!reports!
566! patient! deaths! related! to! monitoring! device! alarms! between! the! years! of! 2005! and! 2008! (Cvach,! 2012).! In!
addition!to!annoyance!and!mistrust,!there!is!a!missed!opportunity!to!present!condensed!information!through!the!
auditory! medium.! For! instance,! one! instrument! often! is! responsible! for! warning! listeners! to! a! range! of! different!
warnings.! The! standard! cardiorespiratory! monitors! are! set! to! display! warnings! for! low! and! high! heart! rate! levels,!
low!and!high!blood!pressure,!low!02!saturations,!EKG!signals,!tachycardia,!and!even!a!disconnected!electrode,!just!
to! name! a! few.! Little! information! about! warning! type! is! presented! in! the! current! system.! Each! of! these! warnings!
falls! along! a! continuum! from! low! to! high! urgency,! however,! often! there! is! no! difference! in! the! audio! alarm! to!
discriminate! between! low! and! high! urgency! events! (Clark! et! al.,! 2008;! Cvach,! 2012).! Besides! the! lack! of! urgency!
information,!the!warning!type!(BP,!HR,!Temperature,!02!levels)!is!also!left!out!of!the!audio!warning!design.!Most!
often,! healthcare! professionals! will! hear! a! beep,! then! they! have! to! determine! which! of! the! 20! instruments! in! the!
room!made!the!beep,!then!finally!read!the!display!screen!to!determine!what!the!beep!was!intended!to!indicate.!This!
3! step! process! is! not! only! taxing! on! attentional! resources,! it! also! requires! the! caregiver! to! repeatedly! break! eye!
contact!with!the!critical!area!for!a!few!seconds.!!
Sonification!Synthesizer!for!sEMG!Data!Analysis!and!Biofeedback!
Daniel*Verona*S*Texas*A&M*University*
The! Sonification! Synthesizer! for! sEMG! Data! Analysis! and! Biofeedback! project! focuses! on! developing! a! software!
synthesizer!that!can!generate!customizable!sonifications!of!sEMG!data!and!then!using!this!tool!to!perform!research!
that! will! determine! if! sonifying! sEMG! data! is! an! intuitive,! effective,! and! accurate! means! for! data! analysis! and!
biofeedback.!!Currently,!sEMG!data!are!displayed!graphically!on!a!computer!monitor!during!a!sEMG!exam.!When!it!
comes!to!data!analysis,!the!graphs!that!represent!the!data!are!useful!but!they!are!too!complex!to!be!analyzed!in!real!
time.! Additionally,! visual! graphs! force! analysts! to! focus! their!attention! on! the! computer! monitor! and! not! on! the!
subject!of!the!test.!When!sEMG!is!being!used!as!a!biofeedback!tool!(e.g.!for!athlete!training),!the!graphs!are!difficult!
for! the! subject! to! read! since! he! or! she! is! performing! actions! such! as! running! or! jumping! and! cannot! adequately!
focus!on!the!monitor!for!biofeedback.!
!
!
!
44!
CONCERT!
MONDAY,!JUNE!23RD!19:30!!
Frederick!Lowe!Theatre,!35!West!4th!Street!
!
Program!
!
Adam!Wilson!–!Borough"Scaipthe!(tape)!2014!
In!BoroughJScaipthe,!similarity!matrices!are!used!to!select!transitions!between!variableJlength!segments!of!music!in!
a!roundJrobin!fashion!from!each!of!the!available!Citygram!sound!file!recordings.!The!beginning!of!each!segment!of!
music!is!chosen!by!calculating!similarity!scores!for!the!last!analysis!frame!of!the!previous!segment!and!all!frames!in!
the! next! sound! file! using! Euclidean! distances! between! audio! features! stored! by! the! Citygram! project;! the! most!
similar! frame! in! the! next! sound! file! is! chosen! as! the! beginning! of! the! next! segment.! ZeroJ! crossings! are! used! to!
generate! dyadic! harmonies! that! appear! in! crossJpulses! over! top! of! two! differently! paced! layers! of! music! derived!
from!the!Citygram!audio!data.!
Antonio!D'Amato!–!Crowds!(tape)!2012!
Crowds! is! an! acousmatic! piece! freely! inspired! by! the! observation! of! crowd! movements! in! a! limited! space! as! a!
crossroad!or!a!square.!A!photo!sequence!of!a!square!was!taken!from!the!top!floor!of!a!building!during!a!day,!then!in!
each!photo!I!divided!most!of!the!people!in!groups!(i.e.!people!getting!off!from!a!bus,!people!coming!out!of!a!cinema,!
students,! walking! people,! bench! sitting! people,! woman,! men,! adults,! children! and! so! on).! Then! each! group! was!
associated!with!a!kind!of!sound!or!a!complex!event!as!a!sequence!or!a!pattern.!The!essential!scheme!of!the!piece!is!
given!by!the!analysis!of!the!photos,!observing!if!and!how!many!people!of!each!group!are!visible!in!each!photo.!
J.!Parkman!Carter!and!Brian!Cook!J!Tethyian"Harp!(realJtime!sonification,!with!video)!2013!
Inspired!by!the!Aeolian!harp—a!stringed!instrument!played!by!the!wind—the!Tethyian!Harp!is!a!digital!instrument!
played!by!data!streaming!from!the!confluence!of!the!Mohawk!and!Hudson!Rivers.!Located!just!north!of!Troy,!this!
gateway!to!the!Erie!Canal!is!one!of!the!most!important!natural!and!manJmade!river!systems!in!American!history.!
The!merging!of!the!Mohawk!River’s!hydraulic!power,!the!Waterford!Flight!of!Locks!(the!steepest!canal!system!in!
the!world),!and!the!Hudson!River’s!tidal!estuary!marks!the!natural!fortuity!and!industrial!ingenuity!that!connected!
the!Atlantic!Ocean!and!New!York!City!to!the!Great!Lakes!and!the!American!Midwest.!The!Tethyian!Harp!taps!into!
massive!amounts!of!numerical!data!over!long!spans!of!time!and!uses!harmonic!material!from!an!old!Erie!Canal!work!
song!to!give!voice!to!the!present!conditions!of!these!rivers!in!real!time.!We!can!tune!into!this!flow!of!river!music!at!
any!time,!whether!for!environmental!information,!serene!reconnection,!or!both.!
Dennis!Deovides!A.!Reyes!III!<"NYC"10001!(tape)!2014!
NYC! 10001! is! an! 8.1! channel! electroJacoustic! composition,! which! has! been! created! in! the! Experimental! Music!
Studios!of!the!University!of!Illinois!at!UrbanaJChampaign.!The!main!materials!in!the!piece!have!been!derived!from!
the! Citygram! project! data! and!files.! These! data! have! been! used! to! create! the! different! sonic! gestures! and! timbres!
occurring!in!the!music.!!NYC!10001!utilizes!the!Citygram!mono!audio!files,!containing!recordings!from!the!different!
notable! locations! of! New! York! City,! including! Times! Square,! Central! Park,! Union! Station,! and! the! Rockefeller!
Center.! ! Additional! materials! also! come! from! the! Max! MSP! and! Super! Collider! Citygram! files! that! have! been!
provided!by!the!organizing!committee.!The!composer!tries!to!unify!the!diverse!sounds!and!timbres!of!the!different!
locations! in! New! York! City! through! the! piece,! thus! creating! a! unique! musical! creation! that! demonstrates! the!
numerous!possibilites!of!sonification!from!its!data.!
45!
Michael!Musick!J!Sonic"Space"No."5!(live!electroincs)!2013!
Sonic!Space!No.!5!is!part!of!the!Sonic!Spaces!Project.!!These!compositions!are!interactive!systems!that!analyze!the!
sonic!energy!present!in!a!space!and!use!that!data!to!drive!“digital!agents.”!!These!digital!agents!have!been!composed!
with! a! set! of! rules! that! allows! them! to! come! alive! only! when! specific! types! of! sonic! energy! are! present.! ! If! the!
conditions! exist,! which! allow! these! agents! to! live,! then! they! consume! that! sonic! energy,! transforming! and!
processing!it!according!to!the!data!that!describes!the!space,!and!playing!it!back!into!the!space.!!This!reJintroduction!
of! processed! sonic! energy! may! then! create! the! conditions! for! additional! agents! to! come! alive! and! join! in.! ! All!
analysis! of! data,! and! exchange! of! energy! occur! through! the! medium! of! the! physical! space.! ! Additionally,! the!
progression!of!this!system!is!mapped!to!the!cycle!of!a!day,!with!certain!agents!tending!to!be!active!during!specific!
times!in!this!cycle,!and!tending!to!sleep!during!others.!!This!performance!will!have!its!daily!cycle’s!time!length!set!so!
as! to! allow! the! audience! to! experience! an! entire! cycle.! This! piece! has! been! presented! as! both! an! installation! and!
concert!work,!with!today’s!presentation!having!the!system!tuned!for!a!concert!experience.!
Irad!Lee!J!Spamology"II!(tape)!2014!
Spamology! II! is! a! sequel! to! a! research! project! developed! during! a! residency! at! MediaLabJPrado! Madrid! in! 2007,!
which!dealt!with!interactive!audiovisual!representation!of!popular!words!in!spam!email!messages.!Spamology!II!is!a!
sound!composition!primarily!focused!on!exploring!new!sonification!methods!for!revealing!meaningful!patterns!in!
spam.! Based! on! analysis! of! a! gigantic! archive! of! spam! email! messages,! collected! since! 1997! by! computer! scientist!
Bruce!Guenter,!the!composition!was!driven!by!attributive!data!extracted!from!the!archive,!such!as!popular!words,!
geographical! origin,! sender's! name,! message! length,! and! more.! With! the! aid! of! an! accompanied! score,! the! work!
aims!at!proposing!a!new!way!to!analyze!spam!data!by!sonic!means,!potentially!useful!for!the!purposes!of!researching!
behavior! of! spammers,! revealing! patterns! which! may! reflect! cultural! and! social! trends! as! well! as! development! of!
new!spam!management!techniques.!
Yoon!Chung!Han!and!Qian!Liu!J!Cloud"Bridge"(nonJinteractive!demo!with!a!video!and!picture!
frames)!2013!
Cloud! Bridge! is! an! immersive! interactive! auJdiovisual! artwork! for! both! data! exploration! and! artistic! creation.! It!
explores! how! information! can! be! visualized! and! then! sonified! to! faciliJtate! findings,! and! eventually! become!
interacJtive! visualization! and! sonification.! The! basic! concept! of! this! project! is! to! give! any! dataset! timeJbased,!
innovative!presentation.!Cloud!Bridge!functions!in!two!modes:!exploration!and!interaction.!Exploration!is!designed!
to! discover! interesting! patterns,! shapes! and! relationships! in! between! the! dataset.! Different! colors! are! mapped! to!
keywords! for! users! to! explore.! Interaction! is! for! targeting! group! interaction.! A! group! of! users! functioning! as! a!
performance! ensemble! participate! in! the! piece! by! interacJtively! querying! the! database! using! Android! and! iOS!
devices.!Each!device!is!associated!with!a!unique!timbre!and!color!for!contributing!to!the!piece,!which!appears!on!
large!shared!screens!and!a!surroundJsound!system!for!all!participants!and!observers.!Cloud!Bridge!leads!to!a!new!
interactive!experience!utilizing!data!as!medium!to!create!visualization,!sonification!and!realJtime!interaction.!
Tae!Hong!Park!J!48!13!N,!16!20!O!(tape)!2003!
48! 13! N,! 16! 20! O! is! the! first! of! a! series! of! pieces! that! deals! with! sonic! attributes! of! a! particular! place,! specific!
geographical!location,!and!regional!auditory!entities.!The!myriad!of!sonic!data!that!was!collected!during!a!period!of!
approximately!one!month!,in!one!city,!in!the!summer!of!2002,!comprise!the!basis!of!the!piece.!
Jaesong!You!J!Dance"Music"017"(tape)!2014!
Dance!Music!017!is!designed!to!capture!16!minutes!of!various!New!York!City!soundscapes,!starting!from!12:00!pm!on!
Jan!31st,!2014.!Through!the!bigJdataJgathering!medium,!Citygram,!the!composer!attempted!to!design!a!transcendent!
egoJassimilating!process!via!metaJexperiencing!of!the!collective!soundscape.!
!
46!
Composer!Biographies!
J.!Parkman!Carter!is!currently!a!PhD!student!in!Architectural!Acoustics!at!Rensselaer!Polytechnic!Institute,!J.!Parkman!
Carter!holds!two!Masters!Degrees!in!Architecture!and!Lighting!Design!from!Parsons!and!a!BA!in!Integrated!Arts!from!Bard!
College.!He!was!trained!as!a!luthier!in!the!UK!and!has!built!many!stringed!and!electronic!instruments,!as!well!as!custom!
speaker!systems!and!studio!spaces.!His!current!research!focuses!on!crossJmodal!soundscape!mapping!and!data!sonification!
for!raising!awareness!of!ecological!acoustics!in!the!constructed!environment.!!
Brian!Cook!is!an!electroacoustic!composer,!media!artist,!improviser,!and!programmer!based!out!of!Troy,!NY.!He!holds!a!
Bachelor’s!of!Music!degree!in!Music!Composition!from!The!Hartt!School,!and!is!currently!pursuing!an!MFA!in!Integrated!
Electronic!Arts!at!Rensselaer!Polytechnic!Institute.!His!art,!music,!and!code!have!been!featured!at!numerous!national!and!
international! festivals! and! events.! Cook’s! current! work! focuses! on! an! exploration! of! the! natural! environment! through!
technology,!and!the!development!of!new!music!interfaces!and!instruments.!
Antonio!D'Amato!is!intoxicated!by!music.!He!graduated!at!conservatory!in!Piano,!Harpsichord,!Music!for!multimedia,!
Instrumental! music! teaching! and! Electronic! music.! He! also! studied! composition! for! eight! years,! bassoon! for! three! years,!
baroque!organ!and!audio!engineering.!In!2010!he!was!Ondes!Martenot!student!in!Strasbourg!and!Paris.!At!university!he!was!
student!in!Media!and!Communication.!At!the!moment!his!main!interest!is!joining!traditional!composition!procedures!and!
the!wide!opportunities!of!computerJbased!music.!Some!of!his!instrumental!works!are!published!by!Forton!Music,!U.K.!His!
first!electronic!composition!was!selected!for!a!performance!during!the!ICMC!2012!Conference.!Other!works!were!performed!
in!Australia,!Brazil,!Italy,!Taiwan!and!USA.!
Dennis!Deovides!A.!Reyes!III!has!studied!music!composition!in!his!native!Manila,!Philippines,!before!moving!to!the!
United!States!in!2006,!where!he!studied!composition!with!Jorge!Villavicencio!Grossmann!in!the!University!of!Nevada!in!Las!
Vegas.! ! He! is! currently! pursuing! his! doctorate! degree! in! music! composition! in! the! University! of! Illinois! in! UrbanaJ
Champaign! under! Scott! Wyatt,! Heinrich! Taube,! and! Sever! Tipei.! ! His! music! has! been! performed! throughout! the! United!
States,!Europe,!and!in!Asia.!!Dennis’!most!recent!electroacoustic!composition!Motions!of!Maria!Makiling!has!been!selected!
for!a!concert!performance!in!the!2014!Society!of!ElectroJAcoustic!Music!in!the!United!States!(SEAMUS)!National!Conference!
at!Wesleyan!University!in!Middletown,!Connecticut.!!Dennis’!works!find!inspiration!in!a!wide!range!of!subjects,!from!Asian!
music!to!Modern!art,!and!incorporates!Philippine!tradition!in!his!musical!creations.!
Yoon! Chung! Han! is! an! interaction! designer,! multimedia! artist,! and! researcher.! Her! researches! include! data!
visualization,! biometric! data! visualization! and! sonification,! new! interface! for! musical! expression,! and! mobile! user!
experience! design.! She! studied! Graphic! Design! and! Interaction! Design! at! Seoul! National! University! (under! Prof.! Suzung!
Kim),!and!achieved!two!Master!degrees!at!SNU!and!Design!|!Media!Arts!in!UCLA!(under!Prof.!Casey!Reas)!Recently!she!was!
a! graduate! student! researcher! and! teaching! assistant! at! Experimental! Visualization! Labunder! Prof.! George! Legrady.!
Currently!she!is!a!PhD!candidate!at!Media!Arts!and!Technology,!UC!Santa!Barbara,!and!a!Visiting!Researcher!/!PhD!Student!
at!SENSEable!City!Lab!at!MIT!in!Cambridge,!MA.!
Irad! Lee! is! a! sound! and! interaction! designer! based! in! Tel! Aviv.! With! both! artistic! and! commercial! work! experience! in!
sound,! media! arts! and! interaction! design,! his! current! practice! is! concerned! with! the! expressive! abilities! of! sound! to!
communicate! complex! spatial! information,! cultural! ideas! and! artifacts.! In! particular,! his! work! is! focused! on! exploring!
mechanisms! of! auditory! perception,! the! relationship! between! sounds! and! their! geographical! sources,! and! experimental!
forms!of!humanJobject!interaction!mediated!by!sound.!As!an!awardJwinning!sound!designer!and!sonic!branding!specialist,!
he! continuously! collaborates! with! top! international! brands,! motion! design! studios,! architects,! filmmakers! and!
choreographers.!Lee!received!his!dual!bachelor's!degrees!in!Sonology!and!Interaction!Design!from!the!Institute!of!Sonology!
and!the!Royal!Academy!of!Art!in!The!Hague,!The!Netherlands,!in!2010.!He!is!currently!a!research!associate!at!the!Interaction!
Lab!in!Holon!Institute!of!Technology,!where!he!is!conducting!research!dealing!with!urban!noise!and!its!role!in!maintaining!
and!negotiating!social!interaction!within!shared!public!spaces.!
47!
Qian! Liu! is! a! multimedia! artist,! researcher,! and! designer! who! enjoy! engaging! natural! phenomenal,! patterns! and!
technology!in!her!work.!She!likes!to!stand!in!the!interdisciplinary!area!to!observe!the!world!and!develop!her!work!with!such!
perspective.!!As!a!believer!of!"merging!technology",!most!of!her!work!involves!concepts,!algorithms,!formats!from!different!
communities.!She!has!always!been!interested!in!adding!elements!from!different!cultures,!fields!to!create!multidisciplinary!
projects,!and!has!always!been!fascinated!by!what!they!could!possibly!lead!to.!Data!is!one!of!the!most!important!materials!of!
her! research.! Her! general! body! of! work! focuses! on! redefining,! reformatting,! and! representing! data! and! how! human!
perception! reacts! to! it.! The! material! she! works! with! varies,! from! the! most! basic! medium,! paper! and! prints,! to! more!
technological!formats,!such!as!visualization,!signification!and!realJtime!interaction.!She!is!passionate!about!finding!methods!
to!revealing!the!nature!through!a!digital!format!and!creating!transparency!between!the!great!nature!and!the!virtual!world.!
During!the!past!couple!of!years,!she!focused!her!research!on!data!visualization,!and!has!accomplished!varies!of!projects.!Her!
recent! collaborative! work! "TAKE! FLIGHT",! which! is! a! data! visualization! project! about! flight! patterns,! won! the! People's!
Choice! Price! of! Visualizing! Global! Marathon! 2012.! Most! of! her! projects! and! pieces! are! designed! to! work! equally! well!
regardless!of!venue,!from!laptops!and!desktops!to!galleryJstyle!installations!with!mobile!device!control!and!even!largeJscale!
immersive!stereoscopic!environments.!Qian!obtained!her!Master's!Degree!from!Media!Arts!and!Technology!department!at!
University!of!California,!Santa!Barbara.!!
Michael!Musick!is!a!media!artist,!technologist,!composer,!performer!and!improviser.!!His!current!work!focuses!on!the!
creation! of! and! research! into! interactive! performance! systems.! ! The! Sonic! Spaces! project,! which! is! a! series! of! dynamic!
interactive! sonic! ecosystem! installations,! is! the! most! recent! example! of! this! work.! Michael! has! been! a! Music! Technology!
Ph.D.!student!at!NYU!since!2012!and!is!part!of!the!Computer!Music!Group!at!MARL.!!Prior!to!NYU,!he!earned!an!M.A.!in!
Media!Arts!from!the!University!of!Michigan,!where!he! began!his!work!with!performance!systems.!In!addition,!he!studied!
creative!improvisation!and!multiJmedia!performance.!!Michael!has!a!strong!background!in!tuba!performance!and!recording!
arts.!!He!holds!performance!degrees!from!The!University!of!Southern!California!(M.Mus!’09)!and!The!University!of!Colorado!
(B.Mus!’07).!!While!earning!his!Bachelor’s!and!Masters’!degrees,!Michael!was!highly!engaged!within!his!communities!as!a!
freelance! musician,! educator! and! recording! engineer! in! the! Southern! California! and! Denver! Metro! areas.! Originally! from!
Arvada,! Colorado,! Michael! is! a! lover! of! the! mountains,! snow,! and! wandering! among! the! aspen! or! pine! trees.! ! For! more!
information!please!visit!his!personal!site!at!michaelmusick.com.!
Tae!Hong!Park!is!a!composer,!music!technologist,!and!bassist.!His!work!focuses!on!composition!of!electroJacoustic!and!
acoustic!music,!machine!learning!and!computerJaided!music!analysis,!research!in!multiJdimensional!aspects!of!timbre,!and!
audio! digital! signal! processing.! Dr.! Park! has! presented! his! music! at! national! and! international! conferences! and! festivals!
including!Bourges,!ICMC,!MATA,!SCIMF,!and!SEAMUS.!Among!the!ensembles!and!performers!that!have!played!his!work!
are!the!Brentano!String!Quartet,!California!E.A.R.!Unit,!Edward!Carroll,!Ensemble!Surplus,!Zoe!Martlew,!Nash!Ensemble!of!
London,! and! the! Tarab! Cello! Ensemble.! Professor! Park! is! author! of! Introduction! to! Digital! Signal! Processing:! Computer!
Musically!Speaking!(World!Scientific,!2010).!He!is!the!Chief!Editor!of!Journal!SEAMUS!and!serves!as!Editorial!Consultant!for!
Computer!Music!Journal.!He!is!Associate!Professor!of!Music!Technology!and!Director!of!the!Composition!Program!at!NYU!
Steinhardt.!He!received!his!Ph.D.!from!Princeton!University.!
Dr.!Adam!J.!Wilson!is!an!Assistant!Professor!of!Emerging!Media!Technologies,!specializing!in!Media!Computation,!in!
the!Entertainment!Technology!Department!at!CUNY!City!Tech!in!Brooklyn.!Dr.!Wilson!holds!a!Ph.D.!in!Music!Composition!
from! the! University! of! California,! San! Diego,! where! he! developed! software! to! facilitate! realJtime! musical! collaboration!
between!computers!and!human!performers.!Dr.!Wilson!earned!a!Master!of!Music!degree!from!the!University!of!Illinois!at!
UrbanaJChampaign,! and! a! Bachelor! of! Arts! from! Oberlin! College.! He! is! also! permanently! certified! as! a! secondary! school!
teacher! by! the! University! of! the! State! of! New! York,! and! taught! for! several! years! in! the! public! schools! in! the! Bronx.! Dr.!
Wilson's!research!involves!creating!software!for!automatic!music!improvisation!and!realJtime!humanJcomputer!interaction!
in! live! music! performance.! His! work! in! this! domain! has! led! to! or! incorporated! the! development! of! software! for! music!
information! retrieval,! algorithmic! music! composition,! and! data! sonification.! Dr.! Wilson! frequently! performs! with! his!
software! experiments! on! the! fretless! electric! guitar,! an! instrument! that! caters! to! his! penchant! for! microtonality.! Prior! to!
joining!the!faculty!at!City!Tech!and!between!stints!in!academia,!Dr.!Wilson!accumulated!eight!years!of!industry!experience!
48!
as! a! software! engineer,! working! primarily! in! web! programming! and! cloud! applications! for! both! startJups! and! established!
companies!in!Boston!and!New!York!City.!
Jaeseong! You! is! a! New! York! CityJbased! composer.! Earning! his! B.A.! in! Music! and! Political! Science! from! New! York!
University! and! enJroute! M.A.! in! Music! Composition! from! City! University! of! New! York! Graduate! Center,! he! is! currently! a!
doctoral! student! of! Music! Composition! and! Music! Technology! at! New! York! University,! Steinhardt.! You! is! serving! as!
Editorial! Manager! at! Journal! SEMAUS! and! as! researcher! at! Electro! Acoustic! Music! Mine! project! and! Citygram! project,!
focusing!on!Acoustic!Event!Classification!(AEC).!
49!
!
INSTALLATIONS!!
Sunday!22nd!June!–!Wednesday!25th!June!!
NYU!MAGNET!J!2!MetroTech!Center,!8th!Floor,!Brooklyn!
Complex!(mechatronic!sound!sculpture)!!
!
!
!
!
!
!
!!!!!Mo!Zareei!
Complex! is! an! audiovisual! installation! proposed! to! enhance! awareness! of! the! audiovisual! phenomena! characterizing! our!
daily! urban! lives.! The! work! involves! mechatronic! soundsculptures! entitled! Rasper,! which! employ! objects! from! everyday!
urban! technological! life! and! shift! the! context! in! which! they! normally! exist,! while! formalizing! them! through! rhythmic!
patterns! that! are! derived! from! Citygram! database.! Sharing! a! take! on! urban! soundscape,! Rasper! and! Citygram! both! draw!
attention!to!aural!phenomena!that!are!normally!ignored!by!the!ears!of!city!dwellers:!the!ubiquitous!buzzing!of!the!urban!
machines,! or! the! incessant! clamor! of! NYC.! Additionally,! they! both! employ! visual! accompaniments! to! create! unified!
audiovisual!paradigms!in!which!the!worldly!existence!of!noise!is!highlighted!in!a!way!that!is!both!accessible!and!engaging.!
In!this!way,!complex,!as!a!compound!of!both,!reasserts!the!audiovisual!noise!of!the!urban!life,!underscoring!its!existence!and!
affirming!the!need!for!awareness!of!such!noise.!!
nY<Station!(sculpture)!! !
!
!
!
!
!
!
!
!!!!!!!M!Bethancourt!
During!the!Cold!War,!YJstations!broadcasted!encoded!messages,!usually!in!the!form!of!spoken!sequences!of!numbers,!across!
shortwave! radio! to! agents! in! undisclosed! locations.! Messages! were! intended! for! a! small! and! specific! audiences,! but! were!
totally!accessible!to!the!public.!YJstations!made!information!available,!but!meaning!inscrutable.!nYJStation!is!an!interactive!
installation!that!allows!users!to!interact!with!and!manipulate!sonic!data!collected!from!various!locations!around!New!York!
City!by!the!Citygram!project.!Users!are!invited!to!wear!surveillance!style!headphones!and!manipulate!sonic!data!through!an!
eightJstep!sequencer,!knobs!and!patch!cables,!casting!the!user!in!the!role!of!a!detached!outside!observer!seeking!to!glean!
information!from!an!array!of!possible!connections!and!nonJexplicit!meanings.!While!interaction!with!the!installation!will!be!
interesting!and!rewarding!for!all!users,!only!a!small!number!will!be!able!to!decode!the!message.!!
3:58"AM"–"(stasis)!(Interactive!projection!art!&!2!channel!audio)! !
!!!!
!
Zack!Merritt!!
I!Hear!NY!4D:!Hybrid!Acoustic!and!Augmented!Auditory!Display!for!Urban!Soundscapes!
(interactive!immersive!environment)!!
The*Immersive*Audio*Group*at*NYU*Steinhardt**
I!Hear!NY4D!presents!a!modular!auditory!display!platform!for!layering!recorded!sound!and!sonified!data!into!an!immersive!
multiJchannel!environment.!Our!specific!use!of!the!platform!layers!Ambisonic!recordings!of!New!York!City!and!a!palette!of!
virtual!sound!events!that!correspond!to!various!static!and!realJtime!data!feeds!based!on!the!listener’s!location.!This!creates!a!
virtual!listening!environment!modeled!on!an!augmented!reality!stream!of!sonified!data!in!an!existing!acoustic!soundscape,!
allowing!for!closer!study!of!the!interaction!between!real!and!virtual!sound!events,!for!simultaneous!global!and!local!sound!
experiences.!!
Sonic!Immersion!in!the!Global!Seismic!Wave!Field!!
!
!
!
!
!
!
!
!
!
!
!
!
!!!!Benjamin!Holtzman,!Jason!Candler,!and!Matthew!Turk!
*Hosted!at!the!Planetarium!J!81!Central!Park!West!
!
What! is! an! earthquake?! Why! are! they! unpredictable?! How! do! we! use! the! “seismic! waves”! emitted! from! an! earthquake! to!
make!images!of!the!Earth’s!deep!interior?!What!do!those!images!tell!us!about!where!and!why!earthquakes!occur?!To!explore!
these!questions,!we!will!fill!the!planetarium!dome!with!seismic!waves!moving!through!the!planet!and!the!complex!patterns!
50!
of!earthquake!locations!through!time!and!space,!using!the!Hayden’s!full!24!channel!sound!system!and!194.6!degree!screen.!
With!movies!and!sounds,!we!will!examine!five!earthquakes!from!the!last!decade!—!in!California,!Haiti,!Sumatra,!Japan!and!
Kamchatka!—!as!if!we!were!out!in!space!and!then!deep!inside!the!planet,!far!from!the!sometimes!catastrophic!consequences!
for!humans.!You!will!emerge!with!an!altered!view!of!our!planet!and!our!place!in!it.!!
!
Artist!Biographies!
M! Bethancourt! is! a! composer,! musician,! educator! and! interactive! designer.! His! current! work! focuses! on! harnessing!
external! datasets! for! experimental! electronic! musical! expression.! Past! work! has! touched! on! nostalgia,! collaborative!
frameworks! and! innovative! gestural! controllers.! He! is! an! assistant! professor! at! CUNY! Hostos! College! in! the! Bronx,! NY,!
teaching!courses!in!game!design,!audio!production,!sound!synthesis,!sound!design,!web!design,!and!Max/MSP.!He!earned!
his!MFA!in!Design!and!Technology!from!Parsons!the!New!School!for!Design!and!lives!in!Brooklyn,!NY.!!
Ben!Holtzman!is!a!research!scientist!in!Geophysics!at!Lamont!Doherty!Earth!Observatory,!Columbia!University.!Jason!
Candler!is!a!musician!and!sound!designer!in!NYC,!and!teaches!at!NYU.!Matthew!Turk!is!an!astrophysict!working!at!the!
National!Center!for!Supercomputing!Applications!at!the!University!of!Illinois!Urbana/Champaign.!
The!Immersive!Audio!Group!in!New!York!Universties!Music!and!AudioResearch!Lab!(MARL)!is!a!graduate!student!group!
interesting!the!research!and!use!of!immersive!audio!technologies.!Under!the!faculty!advisement!of!Dr.!Agnieszka!Roginska,!
this!group!has!built!a!number!of!audio!installations!over!the!past!few!years!focusing!on!the!creative!reproduction!of!urban!
soundscapes.! Sonification! led! by! Jenn! Grossman! and! Mike! Tierney,! Data! Acquisition! led! by! Michael! Musick,! Auditory!
Display!Implementation!led!by!Samuel!Nacach,!User!Interface!Design!led!by!Adriana!Madden.!
Zack!Merritt!(muZack__)!
My!work!is!as!simple!as!you!think!it!is.!
I!like!curries,!knitting,!and!kittens!(though!not!combined).!!
http://zackmerritt.com!!
!
Mo!H.!Zareei!(aka!mHz)!is!an!electronic!musician,!sound!artist,!and!a!music!technology!researcher,!born!and!raised!in!Iran.!
After! completing! his! Physics! degree,! Zareei! moved! to! the! US! in! 2010,! where! he! started! to! explore! the! world! of! electronic!
music!at!California!Institute!of!the!Arts.!Using!customJbuilt!software!and!hardware,!Zareei's!work!is!targeted!at!the!point!
where! noise! meets! gridJbased! structures,! and! his! mediums! range! from! IDM! and! glitch! music! to! soundJsculptures! and!
installations.!He!is!currently!based!in!New!Zealand,!pursuing!his!PhD!research!on!mechatronics!and!noise!music!at!Victoria!
University!of!Wellington.!!
!
!
51!
!
ICAD!2014!WORKSHOPS/TUTORIALS!
!
ICAD!workshops!and!tutorials!provide!inJdepth!opportunities!for!conference!attendees!to!discuss!and!
explore! important! aspects! of! the! field! of! auditory! display! with! likeJminded! researchers! and!
practitioners.!!Workshop!participation!is!open!and!costJfree!for!all!conference!attendees.!!Four!sessions!
are!being!offered!this!year!on!Sunday,!June!22,!2014.!
W1:!Sonic!Information!Design:!Framework,!Approach,!and!Application!
Time:!!13:00!to!17:00!
Organizers:**Myounghoon*“Philart”*Jeon,*Bruce*Walker,*Stephen*Barrass*and*Mikael*Fernström*
This!workshop!will!explore!and!develop!“design!research”!methods!within!the!ICAD!community.!
Submission! of! position! papers! on! the! use! of! "research! through! design"! and! approaches! that!
extend! design! methods! from! other! domains! to! sonic! information! design! in! advance! of! the!
workshop!is!invited.!
W2:!Sonification!for!Sports!and!Performance!
Time:!!9:00!to!12:00!
Organizers:**Oussama*Metatla,*Tony*Stockman*and*Doon*MacDonald*
This! workshop! focuses! on! the! growing! body! of! work! on! sonification! for! use! in! sports,! exercise!
andperformance!in!drama,!dance!and!related!applications.!Participants!will!have!an!opportunity!
to! discuss!their! experiences,! new! findings,! and! applications! in! this! area.! Advance! submissions!
are!encouraged.!
W3:!Collaborative!Sonification!Design!to!Sonify!Scientific!Data!
Time:!!12:30!to!15:30!
Organizer:**Visda*Goudarzi*
This!workshop!introduces!SysSon,!a!platform!for!systematic!sonification!of!climate!data!and!will!
feature!a! handsJon! sonification! hack! session.! Participants! will! work! in! interdisciplinary! groups!
and!present!and!compare!sonification!designs!and!results!at!the!end!of!the!workshop.!
!
!
52!
W4:!Citygram!Workshop:!Composing,!Performing,!and!Creating!Music!via!SpatioJ
Acoustic!Big!Data!
Time:!!15:30!to!18:00!
Organizer:**Tae*Hong*Park,*Michael*Musick*and*John*Turner*
Citygram! is! concerned! with! the! capture,! analysis,! and! understanding! on! nonJoccular! spatioJ
temporal! urban! energies.! This! workshop! will! introduce! participants! through! a! combination! of!
presentations! and! handsJon! work! to! the! Citygram! project,! infrastructure,! API’s,! software,! and!
inherent!compositional/sonification!possibilities.!
!
!
!
!
!
!
!
!
53!
!
SPECIAL!EVENTS!
!
Reception!
Sunday,!June!22,!18:30!!
NYU!MAGNET,!2!MetroTech!Center,!8th!Floor!
!
!
ICAD!Concert!and!Awards!Ceremony!
Monday,!June!23,!19:00!!
Loewe!Theater,!35!West!4th!St.!
!
Banquet!Dinner!Cruise!
Tuesday,!June!24!
Boarding:!18:30!
Cruise:!19:00!–!22:00!
!
Spirit!Cruises!!
Pier!61,!Chelsea!Piers!!
New!York,!NY!10011!
http://www.spiritcruises.com/
newJyorkJmetro/cruises/newJ
yorkJdinnerJcruise!
*Attire:!For!men,!appropriate!attire!includes!slacks!and!jacket.!For!women,!nice!slacks,!skirt!or!
dress!is!recommended.!Collarless!tJshirts,!jeans,!shorts!or!sneakers!are!not!allowed.!
!
Earthquake!Sonification!
Wednesday,!June!25,!19:00!
Hayden!Planetarium,!American!Museum!of!Natural!History!
!
!
54!
LOCAL!INFORMATION!
!
Maps!
!
!
NYU!Main!Campus!
!
!
!
55!
!
!
NYU!Poly!(MAGNET,!8th!Floor),!Brooklyn!Campus!
!
!
NYC!Subway!
!
!
56!
!
Transportation!
!
Public!transportation!in!New!York!City!is!provided!by!the!Metropolitan!Transportation!Authority.!The!
MTA!provides!online!subway!maps!&!the!Weekender!to!keep!you!updated!on!planned!service!changes.!
To!ride!the!subways!and!busses,!MetroCards!can!be!bought!from!the!vending!machines!found!inside!
most!subway!stations.!Using!a!MetroCard,!the!fare!for!a!subway!or!local!bus!ride!is!$2.50,!as!opposed!to!
$2.75!for!a!SingleRide!ticket.!There!is!a!new!card!fee!of!$1.00!when!purchasing!a!new!MetroCard,!which!
can!be!avoided!by!later!refilling!or!reusing!your!card.!PayJPerJRide!MetroCards!allow!you!to!buy!as!
many!rides!as!you!want,!giving!you!a!5%!bonus!for!money!put!on!your!card.!Unlimited!Ride!
MetroCards!allow!you!to!buy!an!unlimited!number!of!rides!for!a!fixed!price.!Seven!day!passes!cost!$30!
and!thirty!day!passes!cost!$112.!The!most!convenient!Subway!stops!for!NYU!campus:!
!
West!4th!Street!/!Washington!Square!
Blue!Line!J!A,C,E!
Orange!Line!J!B,D,F,M!
Wheelchair!Accessible!
!
8th!Street!/!NYU!
Yellow!Line!J!N,R!(Q!does!not!stop!here)!
!
Christopher!Street!/!Sheridan!Square!
Red!Line!–!1!
!
Union!Square!/!14!Street!
Green!Line!J!4,5,6!
Grey!Line!J!L!
Yellow!Line!J!N,Q,R!
Wheelchair!Accessible!
!
Yellow!Cab!NYC:!800J609J8731!
!
!
57!
Conference!Event!Locations!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Monday!6/23!–!Wednesday!6/25!
Rosenthal!Pavilion!–!NYU!Kimmel!Center!
60!Washington!Square!South!
New!York,!NY!10012!
10th!Floor!
!
Monday!6/23,!19:30!–!Award!Ceremony!and!Concert!
Loewe!Theater!
35!West!4th!Street!
New!York,!NY!10012!
!
Sunday!6/22!–!Workshops,!Installations,!and!Reception!
NYU!MAGNET!Center!
2!MetroTech!Center!
Brooklyn,!NY!11201!
8th!Floor!
Jay!St.!/!MetroTech:!Blue!Line!J!A,C!or!Orange!Line!J!F!
Borough!Hall:!Red!Line!–!2,3!or!Green!Line!–!4,5!
!
Wednesday!6/25,!19:30!–!Earthquake!Sonification!
Hayden!Planetarium!
American!Museum!of!Natural!History,!Rose!Center!for!Earth!and!Space!
81!Central!Park!West!
New!York,!NY!10023!
Main!entrance!located!on!81st!St.!between!Central!Park!West!&!Columbus!Ave.!
81st!St:!Blue!Line!J!B,C!
79th!St:!Red!Line!–!1!
!
Founders!Hall!(Accommodations)!
!
120!East!12th!St.!
!
New!York,!NY!10003!!
58!
Food!&!Dining!
!
!
!
!
!
!
ICAD!attendees!can!receive!discounts!at!two!local!restaurants!by!showing!one’s!conference!badge.!
Bareburger!is!providing!a!20%!discount!while!a!10%!discount!can!be!found!at!Apple!Restaurant.!
!
Bareburger!..............................................................................................................................................!Burgers!
535!LaGuardia!Pl.!
(212)!477J8125!
!
Apple!Restaurant!............................................................................................................................!Vietnamese!
17!Waverly!Pl.!
(212)!473J8888!
!
Other!local!restaurant!recommendations!include:!
Mamoun’s!................................................................................................................................................!Falafel!
119!Macdougal!St.!
(212)!674J8685!
!
Galanga!........................................................................................................................................................!Thai!
149!W!4th!St.!#2!
(212)!228J426!
!
Marumi!.................................................................................................................................................!Japanese!
546!LaGuardia!Pl.!
(212)!979J7055!
!
Favela!Cubana!..........................................................................................................................................!Cuban!
543!LaGuardia!Pl.!
(212)!777J6500!
!
Quantum!Leap!.................................................................................................................................!Vegetarian!
226!Thompson!St.!
(212)!677J8050!
!
Artichoke!....................................................................................................................................................!Pizza!
226!Thompson!St.!
(212)!677J8050!
59!
!
!
!
!
60!
!
FUN!&!GAMES!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
61!
!
62!
!
!
63!
!
!
64!