Intelligent Avatar on E-Learning using Facial Expression and Haptic
Abstract
The process of introducing emotion can be improved through three-dimensional (3D) tutoring system. The problem that still not solved is how to provide realistic tutor (avatar) in virtual environment. This paper propose an approach to teach children on understanding emotion sensation through facial expression and sense of touch (haptic).The algorithm is created by calculating constant factor (f) based on maximum value of RGB and magnitude force then magnitude force range will be associated into particular colour. The Integration process will be started from rendering the facial expression then followed by adjusting the vibration power to emotion value. The result that achieved on experiment, it show around 71% students agree with the classification of magnitude force into emotion representation. Respondents commented that high magnitude force create similar sensation when respondents feel anger, while low magnitude force is more relaxing to respondents. Respondents also said that haptic and facial expression is very interactive and realistic.
Full Text:
PDFReferences
Wang Z, Cheng N, Fan Y, Liu J, Zhu C. Construction of Virtual Assistant Based on Basic Emotions Theory In: Construction of Virtual Assistant Based on Basic Emotions Theory. Heidelberg: Springer Berlin. 2005.
Rojas AG, Gutirrez M, Thalmann D. Simulation of individual spontaneous reactive behavior. In: Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems. Estoril, Portugal. 2008; 1: 19-24.
Ekman P. Emotion in the Human Face. United Kingdom: Cambridge University Press. 1982.
Ekman P, Friesen WV. Facial Action Coding System: A Technique for The Measurement of Facial Movement. Palo Alto, California: Consulting Psychologists Press, Inc. 1978.
Parke FI. Parameterized three-dimensional facial model. http://www.cs.ucla.edu/~dt/siggraph97-panel/; 1971 [cited 2010 1 March ]; Available from: http://www.cs.ucla.edu/~dt/siggraph97-panel/.
Neuberger L. Animating Facial Expressions using Blend Shape. Alfred State College, http://www.creativecrash.com/maya/tutorials/animating/c/animating-facial-expressions-using-blend-shape; 2010 [cited 2010 09 March].
Grubb W. Facial Animation Rig for Delgo. Animation Director for Fathom Studios on the film Delgo, http://www.creativecrash.com/tutorials/facial-animation-rig-for-delgo/page3; 2010 [cited 2010 09 march].
James. Boris with Facial GUI 1.0.0 http://www.creativecrash.com/maya/downloads/character-rigs/c/boris-with-facial-gui; 2010 [cited 2010 09 March].
Bailenson JN, Yee N, Brave S, Merget D, Koslow D. Virtual interpersonal touch: expressing and recognizing emotions through haptic devices. Hum.-Comput. Interact. 2007; 22(3): 325-53.
Hashimoto Y, Kajimoto H. Emotional touch: a novel interface to display emotional tactile information to a palm. In: ACM SIGGRAPH 2008 new tech demos. Los Angeles, California. 2008.
Garc AR, Vexo F, Thalmann D, Raouzaiou A, Karpouzis K, et al. Emotional face expression profiles supported by virtual human ontology: Research Articles. Comput. Animat. Virtual Worlds. 2006; 17(3-4): 259-69.
Zagalo N, Torres A. Character emotion experience in virtual environments. Vis. Comput. Springer-Verlag 2008; 24(11): 981-6.
Traum D. Talking to Virtual Humans: Dialogue Models and Methodologies for Embodied Conversational Agents. Modeling Communication with Robots and Virtual Humans. LNCS 2008; 4930: 296-309.
Fabri M, Moore DJ, Hobbs DJ. The Emotional Avatar: Non-verbal Communication Between Inhabitants of Collaborative Virtual Environments. In: Proceedings of the International Gesture Workshop on Gesture-Based Communication in Human-Computer Interaction. 1999: 269-276.
Rojas AG, Vexor, Thalmann D. Individualized reaction movements for virtual humans. In: Proceedings of the 4th international conference on Computer graphics and interactive techniques in Australasia and Southeast Asia. Kuala Lumpur, Malaysia. 2006: 101-104.
Melo C, Paiva A. Expression of Emotions in Virtual Humans Using Lights, Shadows, Composition and Filters. In: Proceedings of the 2nd international conference on Affective Computing and Intelligent Interaction. Lisbon, Portugal. 2007: 87-90.
Farbenlehre JWvGZ. Sechste Abteilung: Sinnlich-sittliche Wirkung der Farbe. 2005: 1808-1810.
Melo CMd, Gratch J. The Effect of Color on Expression of Joy and Sadness in Virtual Humans. In: The International Conference on Affective Computing and Intelligent Interaction. Amsterdam, Netherlands. 2009: 35-38.
Nijdam NA. Mapping emotion to color. http://hmi.ewi.utwente.nl/verslagen/capita-selecta/CS-Nijdam-Niels.pdf, Human Media Interaction (HMI). Department of Electrical Engineering, Mathematics and Computer Science, (EEMCS) at the University of Twente. Last accessed date :09 September 2009.
Sucontphunt T, Yuan X, Li Q, Deng Z. A Novel Visualization System for Expressive Facial Motion Data Exploration. In: IEEE Pacific Visualisation Symposium. Tokyo, Japan. 2008: 103-106.
Dai K, Fell H, MacAuslan J. Comparing emotions using acoustics and human perceptual dimensions. In. Proceedings of the 27th international conference extended abstracts on Human factors in computing systems. Boston. 2009: 47-52.
Shan MK, Kuo FF, Chiang MF, Lee SY. Emotion-based music recommendation by affinity discovery from film music. Expert Syst. Appl. 2009; 36(4):7666-7674.
Camurri A, Lagerl I, Volpe G. Recognizing emotion from dance movement: comparison of spectator recognition and automated techniques. Int. J. Hum.-Comput. Stud. 2003; 59(1-2): 213-25.
Oborne DJ, Clarke MJ. The determination of equal comfort zones for whole-body vibration. Ergonomics 1974; 17: 769-82.
DOI: http://doi.org/10.12928/telkomnika.v9i1.676
Refbacks
- There are currently no refbacks.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
TELKOMNIKA Telecommunication, Computing, Electronics and Control
ISSN: 1693-6930, e-ISSN: 2302-9293
Universitas Ahmad Dahlan, 4th Campus
Jl. Ringroad Selatan, Kragilan, Tamanan, Banguntapan, Bantul, Yogyakarta, Indonesia 55191
Phone: +62 (274) 563515, 511830, 379418, 371120
Fax: +62 274 564604