Work

Steve DiPaola is an active artist and scientist who explores AI, cognitive science, virtuality and creativity systems both in his research and art work. View his resume (most updated).

Deep Learning AI Creativity Research

Deep Learning AI Creativity Research

Using Cognitive Science as a basis for our work, we attempt to model aspects of human creativity in AI. Specially we are using Neural Networks (and evolutionary systems) in the form of Deep Learning, CNNs, RNNs and other modern techniques to model aspects of human expression and creativity. We are known for modelling expression semantics and generation of visual art (stills, videos, VR) but have extended our work into expressive forms of linguistic (word based) narrative.

AI, Vision, CogSci, Creativity, GenerativeDesign, PainterlyRendering, NPR, NeuralNets

http://ivizlab.sfu.ca/research/deepai
Bio Sensing System for 2D, 3D, VR

Bio Sensing System for 2D, 3D, VR

Our lab has extensive experience in using different sensing technology including eye tracking and facial emotion recognition (DiPaola et al 2013), as well as gesture tracking and bio sensing heart rate and EDA (Song & DiPaola, 2015) which both affect the generative system and can be used to understand the reception to the generated graphics (still, video, VR).

AI, Vision, CogSci, Creativity, FaceResearch, VRWorlds

http://ivizlab.sfu.ca/research/biosense
AI Virtual Human

AI Virtual Human

Our open source toolkit / cognitive research in AI 3D Virtual Human (embodied IVA : Intelligence Virtual Agents) - a real-time system that can respond emotionally (voice, facial animation, gesture, etc) to a user in front of it via a host of gestural, motion and bio- sensor systems. The system uses SmartBody (USC) and MatLab Simulink as its control and AI system.

AI, Vision, CogSci, Creativity, FaceResearch

http://ivizlab.sfu.ca/research/virthuman
Cognitive (AI) based Abstraction

Cognitive (AI) based Abstraction

What is abstraction? Can you use AI techniques to model the semantics of an idea, object, or entity, where that understanding allows for abstraction of the meaning? We use several AI techniques including genetic programming, Neural Nets and Deep Learning to explore abstraction in its many forms. Mainly here in the visual and narrative arts.

AI, Vision, CogSci, Creativity, NPR, NeuralNets, PainterlyRendering,VRWorlds

http://ivizlab.sfu.ca/research/cogabstract
Evolving Creative Computer Programs w/Genetic Programming

Evolving Creative Computer Programs w/Genetic Programming

This research uses creative evolutionary systems to explore computer creativity for various applications: in our first pass - evolving a family of abstract portrait panter programs.

AI, GeneticProg, Creativity, GenerativeDesign

http://ivizlab.sfu.ca/research/creativegp
Painterly Portrait NPR Project

Painterly Portrait NPR Project

Can you build a computer parameterized model of the cognitive process or open methodology that human portrait painters use. This interdisciplinary toolkit research project automatically generates painterly output from people photographs and cognitive parameters.

PainterlyRendering, Vision, CogSci, Creativity, EmotionExpression

http://ivizlab.sfu.ca/research/painterly
Rembrandt / Vision Science Work

Rembrandt / Vision Science Work

Using new computer modelling techniques, we show that artists including Rembrandt, use vision based techniques (lost and found edges, center of focus techniques) to guide the eye path of the viewer through their paintings in significant ways...

PainterlyRendering, Vision, CogSci, Creativity, FaceResearch

http://ivizlab.sfu.ca/research/rembrandt
faceToolKit - A 3D Facial ToolKit

faceToolKit - A 3D Facial ToolKit

A system for creating, animating and communicating with 3D faces types. This dev toolkit is based on a hierarchical parametric approach allowing for an additive realtime language of expressions, emotions and lip-sync sequences..

EmotionExpression, CogSci, FaceResearch, Character3D, GamesResearch

http://ivizlab.sfu.ca/research/facetoolkit
iFACE - Comprehensive Envir for Interactive Face Anim

iFACE - Comprehensive Envir for Interactive Face Anim

Introducing the concept of Face Multimedia Object (FMO), iFACE develops an integrated framework for working with FMO by defining and implementing the necessary functionality (3D and 2D) and exposing proper interfaces to a variety of application types (Web clients, GUI programs, and interactive users).

EmotionExpression, CogSci, FaceResearch, Character3D, GamesResearch

http://ivizlab.sfu.ca/research/iface
Virutal Beluga Project - Vancouver Aquarium

Virutal Beluga Project - Vancouver Aquarium

An interactive beluga whale pod simulation for the Vancouver Aquarium which uses realistic 3D graphics and an artificial intelligent system. It was informed by research data from the live belugas.

AI, NeuralNets, Character3D

http://ivizlab.sfu.ca/research/vraquarium
A Social Metaphor-based Virtual Communities (voiceAvatar)

A Social Metaphor-based Virtual Communities (voiceAvatar)

The goal of this project is to deliver a rich experience of human socialization and telepresence via a voice-enabled web3D avatar community by emulating natural socal metaphors.

VRWorlds, AvatarsAgents, Character3D, EmotionExpression, GamesResearch

http://ivizlab.sfu.ca/research/voiceavatar
MusicFace

MusicFace

Music-driven Emotionally Expressive Face (MusicFace) creates 'facial choreography' driven by musical input. Structural and emotion data are extracted from the music via a fuzzy rule based system and remapped to 'equivelents' in face space.

AI, EmotionExpression, PainterlyRendering, CogSci, Character3D, FaceResearch

http://ivizlab.sfu.ca/research/musicface
Virtual CoLab Project

Virtual CoLab Project

Researching how mathematicians (& scientists) using 3D v-environments can collaborate with each other using 3D with rich media objects (browsers, video, 3D models, animation), avatar embodiments and spatial user interface constructs.

VRWorlds, AvatarsAgents, Character3D, ColabDesign, KnowledgeViz

http://ivizlab.sfu.ca/research/virtualcolab
KnowViz

KnowViz

An interactive 3D knowledge visualization system that explores a more intuitive approach to knowledge and data visualization. An open source, cross platform programming project using openGL, Python and XML. Now working with Connection's James Burke.

KnowledgeViz, VRWorlds

http://ivizlab.sfu.ca/research/knowviz
SFU/FIT Colaborative Design Project

SFU/FIT Colaborative Design Project

Using virtual tools, this was an interdisciplinary, cross-institutional effort in collaborative design, distance learning and virtual performance culminating in a co-designed fashion show and performance.

Character3D, AvatarsAgents, KnowledgeViz, VRWorlds, ColabDesign

http://ivizlab.sfu.ca/research/colabdesign
GenFace - Exploring FaceSpace with Genetic Algorithms

GenFace - Exploring FaceSpace with Genetic Algorithms

genFace uses a genetic algorithm technique to search through a large multi-dimensional space of correlated faces -- making it possible to traverse a path from any face to any other face, morphing through locally similar faces along that path.

AI, GenerativeDesign, GeneticProg, FaceResearch, Character3D, GamesResearch

http://ivizlab.sfu.ca/research/genface

─░stanbul escort