TALKING AVATARS EXHIBIT ACCURATE LIP SYNCHRONIZATION FOR WIRELESS APPLICATIONS
3Dmsg to bring three-dimensional
talking avatars to wireless handsets
Las Vegas, NV, …3Dmsg™, a subsidiary of Sensory, Inc., is now under formation focusing on applications for the cell phone and wireless handset markets. 3Dmsg’s avatars are created with the most accurate lip-synchronization technology, using a patented scheme that morphs between visemes (visual phonemes) and can be created, not only from live speech, but also from input text or a combination of text and speech. The accuracy of 3Dmsg lip synchronization can be precise enough for lip readers to understand, enabling products not just for fun, but for communications, and language learning as well.
“We’ve spent a lot of time over the past few years talking to handset companies and service providers about our speech technologies,” states Todd Mozer, president of Sensory. “We learned that although speech recognition is interesting, what is really more desirable are applications using accurate 3D modeling to exploit many of the new features and capabilities of today’s handsets.” Development of the technology is underway at facilities in Trivandrum, India, and Portland, Oregon.
The patented 3Dmsg technology takes advantage of a hybrid neural network and hidden Markov modeling speech technology to analyze spoken data and break it into components that can be represented visually. These components may be thought of as visual phonemes or “visemes” and represent different mouth/teeth/tongue positions and movements. By stringing and morphing between these visemes, an avatar can be controlled or rendered to represent a talking person or creature.
3Dmsg’s products will include 3D animated messaging (from voice and text), 3D greeting cards, 3D pronunciation and language learning, low bandwidth 3D broadcasting and much more.
The 3Dmsg technology allows MMS, SMS, Instant Messaging, and other text or voice messages to be delivered as ultra-low bandwidth 3D video-like messages by a talking avatar. 3Dmsg’s avatars achieve the quality and accuracy of lip synchronized video with the bandwidth of text or voice.
3Dmsg. (www.3Dmsg.com), is based in Sunnyvale, Calif., and is owned and financed by Sensory, Inc.
Sensory, Inc., (www.sensoryinc.com) is the world leader in embedded speech technologies. Sensory is a profitable private company offering a complete line of IC and software-only solutions for speech recognition, speech synthesis, speaker verification, music synthesis and more. The company’s products are widely deployed in consumer electronics applications including telephones, home automation, toys, remote controls, automotive, security, and learning aids. Sensory’s customers represent the leaders in consumer electronics, including such companies as Hasbro, JVC, Kenwood, Mattel, Mitsubishi, Toshiba, Uniden and Sony. Additional Sensory offices are located in Portland, Hong Kong, Tokyo and Vienna.