Tag Search
Here's what we found for the CogSci tag:
art projects
Revisting Rembrandt
Using new visual computer modelling techniques, we show that artists use vision based techniques to guide the eye path of the viewer through their paintings in significant ways.
http://ivizlab.sfu.ca/research/rembrandt/research projects
Bio Sensing System for 2D, 3D, VR
Our lab has extensive experience in using different sensing technology including eye tracking and facial emotion recognition (DiPaola et al 2013), as well as gesture tracking and bio sensing heart rate and EDA (Song & DiPaola, 2015) which both affect the generative system and can be used to understand the reception to the generated graphics (still, video, VR).
http://ivizlab.sfu.ca/research/biosense
Cognitive (AI) based Abstraction
What is abstraction? Can you use AI techniques to model the semantics of an idea, object, or entity, where that understanding allows for abstraction of the meaning? We use several AI techniques including genetic programming, Neural Nets and Deep Learning to explore abstraction in its many forms. Mainly here in the visual and narrative arts.
http://ivizlab.sfu.ca/research/cogabstract
Deep Learning AI Creativity Research
Using Cognitive Science as a basis for our work, we attempt to model aspects of human creativity in AI. Specially we are using Neural Networks (and evolutionary systems) in the form of Deep Learning, CNNs, RNNs and other modern techniques to model aspects of human expression and creativity. We are known for modelling expression semantics and generation of visual art (stills, videos, VR) but have extended our work into expressive forms of linguistic (word based) narrative.
http://ivizlab.sfu.ca/research/deepai
faceToolKit - A 3D Facial ToolKit
A system for creating, animating and communicating with 3D faces types. This dev toolkit is based on a hierarchical parametric approach allowing for an additive realtime language of expressions, emotions and lip-sync sequences..
http://ivizlab.sfu.ca/research/facetoolkit
iFACE - Comprehensive Envir for Interactive Face Anim
Introducing the concept of Face Multimedia Object (FMO), iFACE develops an integrated framework for working with FMO by defining and implementing the necessary functionality (3D and 2D) and exposing proper interfaces to a variety of application types (Web clients, GUI programs, and interactive users).
http://ivizlab.sfu.ca/research/iface
MusicFace
Music-driven Emotionally Expressive Face (MusicFace) creates 'facial choreography' driven by musical input. Structural and emotion data are extracted from the music via a fuzzy rule based system and remapped to 'equivelents' in face space.
http://ivizlab.sfu.ca/research/musicface
Painterly Portrait NPR Project
Can you build a computer parameterized model of the cognitive process or open methodology that human portrait painters use. This interdisciplinary toolkit research project automatically generates painterly output from people photographs and cognitive parameters.
http://ivizlab.sfu.ca/research/painterly
Rembrandt / Vision Science Work
Using new computer modelling techniques, we show that artists including Rembrandt, use vision based techniques (lost and found edges, center of focus techniques) to guide the eye path of the viewer through their paintings in significant ways...
http://ivizlab.sfu.ca/research/rembrandt
AI Virtual Human
Our open source toolkit / cognitive research in AI 3D Virtual Human (embodied IVA : Intelligence Virtual Agents) - a real-time system that can respond emotionally (voice, facial animation, gesture, etc) to a user in front of it via a host of gestural, motion and bio- sensor systems. The system uses SmartBody (USC) and MatLab Simulink as its control and AI system.
http://ivizlab.sfu.ca/research/virthumanpublications
Facial Actions as Visual Cues for Personality
Arya A, Enns J, Jefferies L, DiPaola S,—Computer Animation and Virtual Worlds (CAVW) Journal, Vol 17, No 3-4 , pp 371–382, 2006.
PDF journal
Touch of the Eye: Does Observation Reflect Haptic Metaphors in Art Drawing?”
Choi S K, DiPaola S,—Proc ACM Conf on Human Factors in Computing Systems (CHI '15), , pp. 579-588, 2015.
PDF proceeding
A Knowledge Based Approach to Modeling Portrait Painting Methodology
DiPaola S,—In Proc: Electronic Visualisation and the Arts, 10 pages, London, 2007.
proceeding
The Trace and the Gaze: Textural Agency in Rembrandt’s Late Portraiture, a Vision Science Perspectiv
DiPaola S,—In Proc: Electronic Visualisation and the Arts, 8 pages, London, 2008.
PDF proceeding
Face, Portrait, Mask – Using a Parameterized System to Explore Synthetic Face Space
DiPaola S,—In Proc: Electronic Visualisation and the Arts, 7 pages, London, 2010.
proceeding
Interactively Exploring Picasso's Multi-dimensional Creative Process in Producing Guernica
DiPaola S, Smith A, — Proc: Electronic Visualisation and the Arts, pp. 25-31. British Computer Society, London, 2013.
PDF proceeding
How a Painter Paints: An Interdisciplinary Understanding of Embodied Creativity
Choi S K, DiPaola S,— Proc; Electronic Visualisation and the Arts, pp. 127-134. British Computer Society, London, 2013.
PDF proceeding
A Framework for Socially Communicative Faces in Games and Interactive Applications
DiPaola S, Arya A,—In Proc: Conference on Future Play, Toronto, Future Play '07, pp 129-136, ACM, New York, NY, 2007.
proceeding
How Did Humans Become So Creative? A Computational Approach
Gabora L, DiPaola S, —Proc: International Conference on Computational Creativity, pp 203-211, 2012.
PDF journal
Face Modeling and Animation Language for MPEG-4 XMT Framework
Arya A, DiPaola S—IEEE Transactions on Multimedia, Vol 9, No 6, pp 1137-1146, 2007.
PDF journal
Perceptually Valid Facial Expressions for Character-based Applications
Arya A, DiPaola S, Parush A,—Intl Journal of Computer Games Technology, Vol 2009, Article ID 462315, pp 1-13, 2009.
PDF journal
Expressive Animated Character Sequences Using Knowledge-based Painterly Rendering
Seifi H, DiPaola S, Arya A, —International Journal of Computer Games Technology, International Journal of Computer Games Technology, vol. 2011, Article ID 164949, 7 pages, 2011.
PDF journal
Multi-Space Behavioral Model for Face-based Affective Social Agents
Arya A, DiPaola S,—Journal of Image and Video Processing. , Special Issue on Facial Image Processing. Vol. 2007, Article ID 48757, pp 1-12, 2007.
PDF journal
Rembrandt’s Textural Agency: A Shared Perspective in Visual Art and Science
DiPaola S, Riebe C, Enns J,—Leonardo, Vol 43, No 3, pp 145-151, 2010.
PDF journal
Emotional Remapping of Music to Facial Animation
DiPaola S, Arya A,—In Proc: 2006 ACM SIGGRAPH Symposium on Videogames, (Boston), pp. 143-149, Sandbox '06. ACM, New York, NY, 2006.
PDF proceeding
Painterly Rendered Portraits from Photographs using a Knowledge-Based Approach
DiPaola S,—In Proc: SPIE Human Vision and Imaging, Int. Society for Optical Engineering, Keynote paper. pp 33-43, 2007.
PDF proceeding
Quantifying artist’s use of human vision constructs to influence viewer eye gaze,
DiPaola S,—In Proc: SPIE Human Vision and Imaging, Int. Society for Optical Engineering, 6 pages, 2009.
proceeding
Following The Masters: Viewer Gaze is Directed by Relative Detail in Painted Portraits
Riebe C, DiPaola S, Enns J,—Journal of Vision, Vol 9, No 8, pp 368 (abstract), 2009.
PDF journal