Earphone tracks facial expressions, even with a face mask — ScienceDaily
Cornell University researchers have invented an earphone that can continuously track full facial expressions by observing the contour of the cheeks — and can then translate expressions into emojis or silent speech commands.
With the ear-mounted device, called C-Face, users could express emotions to online collaborators without holding cameras in front of their faces — an especially useful communication tool as much of the world engages in remote work or learning.
With C-Face, avatars in virtual reality environments could express how their users are actually feeling, and instructors could get valuable information about student engagement during online lessons. It could also be used to direct a computer system, such as a music player, using only facial cues.
“This device is simpler, less obtrusive and more capable than any existing ear-mounted wearable technologies for tracking facial expressions,” said Cheng Zhang, assistant professor of information science and senior author of “C-Face: Continuously