top of page

Computer Science Senior Capstone Project

SOUNDSWORD

MOTIVATION

  • Synesthesia is a physiological trait in which the perception of auditory stimuli triggers visualizations.

  • Our sponsor experiences synesthesia and has been working over the past several decades to share synesthesia with those who do not.

GROUP STRUCTURE & MY ROLE

This Project was a group effort for Tufts University's 2021 Computer Science Department year-long Capstone course. 

​

Team:

  • Korri Lampedusa: UX Design + UI Development in Unity, Project Management

  • Timothy Holt: Audio Engineering + Sponsor Champion

  • Kevin Hyun Seok Lee: Backend Engineering + Math

  • Cameron King: Unity Development Support

VISION & MAIN CHALLENGES

GROUP-DEFINED SCOPE & VISION

Build a Unity program that allows users to create and share interactive audio-visual experiences in Virtual Reality (VR).

  • Allow users to generate an abstract visualization or modify an existing image to accompany audio experiences

  • Create an immersive playback studio allowing users to fully experience VR audio-visualizations

​

CHALLENGES

  • Forming a cohesive vision for the project amongst team members and project sponsor

  • Lack of access to lab and equipment to develop during Fall 2020 due to COVID-19 

  • Slower progress due to limitations of virtual/remote collaboration in Unity and only 2/4 team members having a VR headset

Oculus Mirror 4_13_2021 6_59_21 PM.png
Oculus Mirror 4_13_2021 6_59_55 PM.png

FINAL PRODUCT: ACCOMPLISHMENTS

  • Successfully implementing a “VR Audio Mixer” to control the audio effect parameters 

  • Designing and implementing a user interface that allows users to point and select 1 of 7 possible effects to map controller movement in each direction to with the left controller

  • Prototyping a more robust Save/Load system for playing new and existing SoundSword tracks

bottom of page