Sonification Lab Projects:
Whats Happening…Again
Description: Prof. John Stasko’s research group developed a system to harvest/scrape data from the internet (e.g., weather data, flight prices, etc.), then use those data to generate artwork that is modified based on the data. The information (the data) is basically embedded in the art.
We are taking that to the next level, creating both visual and audio versions of data-driven art/music, and deploying those in VR, in the car, and in other on-the-go contexts.
We will develop data harvesters, and a pipeline to convert data into art/music, then design various art/music pieces, and do evaluations/research.
STING 2.0 – Driving Simulator Telemetry-driven GUIs
Description: Our advanced driving simulators produce a lot of telemetry data (e.g., speed, steering wheel angle, whether cruise control is turned on). We have built a bridge (middleware) called STING that listens for those data, and makes them available for use by third-party applications. We have also written just such a third-party app that generates heads-up displays based on the telemetry, and displays it anywhere in the driving simulator’s 6+ screens. This project will be update STING, and create STING 2.0 that will work with the newest version of the simulator software, and provide advanced data handling and display capabilities.
VR training for automated vehicles
Description: As cars come out with new features (ranging from advanced cruise control (ACC) all the way up to fully self-driving), consumers need to know that these features exist, what they are, and perhaps experience them before they buy a car. In some cases drivers need to be trained how to interact with advanced features before they get out onto the road. We plan to use VR, AR, and other (Unity-based) simulations to familiarize and train consumers. This involves setting up a driving simulator, extending it to meet our needs, designing and prototyping training, and doing evaluations.
Accessible Maps
Description: We have a number of projects that rely on map data, so we have built GIS and Unity-based maps of campus, of buildings, etc. We are working on software to make the map data accessible to blind users. We are also working on ways to leverage the map data in robotics and other ways. This project needs various kinds of programmers, as well as designers and researchers.
Robotic Guide Dog
Description: A GT team is beginning a multi-year interdisciplinary program of research to develop a robotic guide dog. The point is to do the research, design, algorithm development, prototyping, and extensive testing that is clearly needed in such a project. We need all skill sets, including ethnographers, designers, programmers (!!), researchers. We have robots, and access to plenty of experts (including persons with vision loss, and dog+human teams).
VR-based Driving Simulator
Description: WE do lots of driving research, and we need an additional platform for R&D. We will implement a Unity-based driving simulator that can output to a 3-screen computer display or / and a VR headset. We have all the hardware, so we just need to set up the simulation software, then modify it to our needs. This is primaryily a Unity setup and programming effort, which will evolve into a research effort once we have the tools set up.
AccessCORPS VIP
Description: Course materials (think Web sites, powerpoint slides, lab manuals, text books) can be inaccessible to students with disabilities, such as those who have vision loss. Teachers may not know that their materials are in accessible; they may not know how to fix them; and they may not have the time to do so. We are creating AccessCORPS, which is a group of students who will be trained to identify accessibility issues in courses, and then work with instructors to fix and enhance their courses and course materials. AccessCORPS will be supported with a VIP (Vertically Integrated Projects) course at GT (see
https://www.vip.gatech.edu). We need to (a) design and plan the VIP course, (b) pull together many of the initial course materials (and make them accessible), and (c) use the tools and training to start to fix/enhance a couple current courses at GT, this semester.
