South Korean scientists have developed a groundbreaking technology that can recognise human emotions in real-time, an advance poised to revolutionise various industries, including next-generation wearable systems. The multi-modal human emotion recognition system, developed by a team from the Ulsan National Institute of Science and Technology (UNIST), combines verbal and non-verbal expression data to efficiently utilise comprehensive emotional information.<\/p>\n
At the core of this system is the personalised skin-integrated facial interface (PSiFI) system, which is self-powered, facile, stretchable, and transparent. It features a first-of-its-kind bidirectional triboelectric strain and vibration sensor that enables the simultaneous sensing and integration of verbal and non-verbal expression data. The system is fully integrated with a data processing circuit for wireless data transfer, enabling real-time emotion recognition.<\/p>\n
Utilising machine learning algorithms, the developed technology demonstrates accurate and real-time human emotion recognition tasks, even when individuals are wearing masks. The system has also been successfully applied in a digital concierge application within a virtual reality (VR) environment, including smart homes, private movie theatres, and smart offices. This enables the provision of personalised recommendations for music, movies, and books.<\/p>\n
The technology is based on the phenomenon of \u201cfriction charging,\u201d where objects separate into positive and negative charges upon friction. Notably, the system is self-generating, requiring no external power source or complex measuring devices for data recognition. \u201cBased on these technologies, we have developed a skin-integrated face interface (PSiFI) system that can be customised for individuals,\u201d said Prof. Jiyun Kim, from the Department of Material Science and Engineering at UNIST.<\/p>\n
In the study, published online in the journal Nature Communications, the team successfully integrated the detection of facial muscle deformation and vocal cord vibrations, enabling real-time emotion recognition. The system\u2019s capabilities were demonstrated in a virtual reality \u201cdigital concierge\u201d application, where customised services based on users\u2019 emotions were provided.<\/p>\n
\u201cWith this developed system, it is possible to implement real-time emotion recognition with just a few learning steps and without complex measurement equipment. This opens up possibilities for portable emotion recognition devices and next-generation emotion-based digital platform services in the future,\u201d Jin Pyo Lee, the first author, from the varsity.<\/p>\n
The research team conducted real-time emotion recognition experiments, collecting multimodal data such as facial muscle deformation and voice. The system exhibited high emotional recognition accuracy with minimal training. Its wireless and customisable nature ensures wearability and convenience.<\/p>\n","protected":false},"excerpt":{"rendered":"
South Korean scientists have developed a groundbreaking technology that can recognise human emotions in real-time, an advance poised to revolutionise\u2026<\/p>\n","protected":false},"author":28,"featured_media":31663,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[94],"tags":[10366,10367,10369,150,10368],"class_list":["post-31662","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-science","tag-human-emotions-detection","tag-machine","tag-personalised-skin-integrated-facial-interface-psifi-system","tag-south-korea","tag-ulsan-national-institute-of-science-and-technology-unist"],"reading_time":"2 min read","_links":{"self":[{"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/posts\/31662","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/users\/28"}],"replies":[{"embeddable":true,"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/comments?post=31662"}],"version-history":[{"count":0,"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/posts\/31662\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/media\/31663"}],"wp:attachment":[{"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/media?parent=31662"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/categories?post=31662"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/tags?post=31662"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}