SOUND TO SYMBOL

iPad Apps Based on Preverbal Elemental Music

iPad Apps Based on Preverbal Elemental Music

All ages

Algorithm for Animal Collection Level 1

Synchronized image shaking

Music 1

Image 1

X

Touch the screen

Watch what happens

Question:
​Music 1 or 2 

Match with
​Image 1 or 2

Music 2

Visual cue

Image 2

X

Synchronized image shaking

Fading cue



Fruits and Vegetables Collection

Animals Collection

Level 1:
  • Audiovisual integration
  • ​Working memory
  • Sound feature discrimination 
                   spectral shape 
                   frequency pattern
                   duration
  • Higher order tasks
                   auditory object formation
                   symbolic reasoning 
              
​                  

Level 2
  • Alternating picture image/contour image/auditory object associations
  • Auditory object connects picture image to contour image
  • Paired by similarities
  • Higher difficulty level due to reduced visual and auditory contrasts
  • Audiovisual integration
  • ​Working memory
  • Sound feature discrimination: spectral shape, frequency pattern, duration 
  • Higher order tasks
                   auditory object formation
                   symbolic reasoning 

             

Level 3
  • Auditory object connects picture image to Word card image
  • Introduction to reading
  • Audiovisual integration
  • ​Working memory
  • Sound feature discrimination: spectral shape, frequency pattern, duration ​ 
  • Higher order tasks
                   auditory object formation
                   symbolic reasoning 



​                  

  • Designed to be used without instruction
  • Problem solving design
  • Increasing difficulty level
  • Syllabic rhythm
  • Prerecorded specially composed 3 sec music segments
  • Visual cues
  • Audiovisual synchronization cues
  • Inductive and deductive reasoning
  • Visual and auditory comparison
  • Visual and auditory categorization
  • Visual and auditory patterns
  • Mapping sounds to meanings
  • Working memory
  • Cause-effect
  • ​Matching
  • Symbolic thinking
  • Introduction to vocabulary
  • ​Introduction to reading
  • Results as correct #of answers

​​

Method

Apps programmed by Darius Kuddo
                                             Apple developer since 2011
                                             St. Anselm's Abbey School
                                             Washington, D.C.
​                                             Email: [email protected]