by Steve DiPaola, Bill Kraus, Caitlin Akia
Virutal Beluga Project - Vancouver Aquarium
Actual screen shot from our Virtual Beluga Interactive Prototype
which shows realistically swimming Beluga in a wild grouping (pod) created via 3d real-time graphics and artificial intelligence systems.
Technology is becoming increasingly incorporated into exhibit design. Both on the floor and extended online. Our work focuses on the design of a multimedia interactive exhibit for an aquarium gallery. The goal was to use technology to better immerse and engage the visitors in complicated educational concepts about the life of wild belugas. We were interested in encouraging deeper exploration of the content than what is typically possible via wall signage or a video display. The beluga simulation uses extremely realistic graphics and is based on an intelligent system that allows the virtual belugas to learn and alter their behaviour based on the visitor interaction. It was informed by research data from the live belugas, (e.g. voice recordings tied to mother/calf behavior) obtained from interviews with the marine mammal scientists and education staff. Observation and visitor studies determined that visitors rarely visit alone, so the interface was designed to encourage collaboration. It allows visitors and their companions to engage in "what-if" scenarios of wild beluga emergent behavior via a 3D interactive that uses artificial intelligence, physically based animation, and real-time graphics. The program could be linked to the aquarium web site to allow for an extension of the aquarium visitor experience.
The design process focused specifically on visitor experience and ensured that visitor input was taken into consideration early in the design process. Visitor studies also informed the design process from the formative evaluation to the summative evaluation. The use of technology allows the exhibit to present an experience beyond what has been previously possible.
This work addresses the scientific and design process issues of creating an extremely realistic 3D simulation of a wild beluga whale pod for a major aquarium that is situated next to a group of real beluga whales in an integrated marine mammal exhibit. The Virtual Beluga Interactive was conceived to better immerse and engage the visitors in complicated educational concepts about the life of wild belugas compared to what is typical possible via wall signage or a video display, thereby allowing them to ask deeper questions and hopefully have deeper insights into the life of beluga whales. The simulation is specifically informed by research data from the live belugas, (e.g. voice recordings tied to mother/calf behavior) obtained from interviews with the marine mammal scientists and education staff. The collaborative user interface allows visitors to engage in "what-if" scenarios of wild beluga emergent behavior via a 3D interactive that uses artificial intelligence, physically based animation, and real-time graphics. We document a development and design process integrating design objectives, biological data capture from wild animals, scientific ethogram data of animal behavior and artificial life software development to create a synergistic interactive that teaches deeper insights into the life of beluga whales.
Screen shots where we are able to show the feature that turns on see-thru skin with internal anatomy of the beluga as it naturally swims about.
Using the research and work of our colaborator Bill Kraus of Digital Biology,
Key features of these simulations include:
- real-time interaction among organisms as well as between organisms and the viewer,
- lifelike organic movement through the use of actuators ('virtual bones and muscles') and a virtual physics model,
- intelligent behavior, in which some animals even have the ability to learn from experience,
- a true 3D environment with collision detection, 'bump' texture mapping and projected shadows for enhanced realism, and
- directional, multi-channel sound.
Digital Biology System
Downloads and Links
|Movies of our Interactive||WebLink: Assorted Movies captured off the screen of the interactive prototype|
|Journal paper PDF||WebLink:Journal of Adabtive Behavior: Experiencing Belugas: Developing an Action Selection-Based Aquarium Interactive|
|ACM paper PDF||WebLink:ACM paper: Designing Adaptive Multimedia Interactives to Support Shared Learning Experiences|
|Digital Biology Site||WebLink: Digital Biology Site.|
|Vancouver Aquarium site||WebLink: Vancouver Aquarium Marine Science Centre.|
|NewForms Festival Paper||WebLink:PDF from NewForms Festival at the Museum of Anthropology, Vancouver, Abstract|
Steve DiPaola :: sdipaola @ sfu.ca