This is Speechin, a necklace camera that recognizes silent commands

A year ago, we wrote about how the NeckFace smart necklace tracks facial expressions to assess emotions, and today we have a continuation of the work of the Cornell University engineers responsible for it. This time the Speechin necklace comes into play, designed to catch not so much whispers as silent commands.

The Speechin necklace relies on the chest to collect all the wearer’s whispers

Speechin comes down to a module suspended on a necklace, which is built by an infrared camera, which records the image only of the underside of the wearer’s chin. The device is held in this orientation by a set of “wings” that extend to both sides, with a coin that serves as the weight.

Also read: More changes on the OLX platform – PayU payments and some other news

However, it is in the system, or rather the algorithm that drives it, that all the magic is hidden, because by using algorithms based on machine learning, the device is able to determine what commands its user is saying quietly based on the movements of the chin. It can then transmit these commands to the paired smartphone, and on this basis, chances are that, with further development, this technology will be able to be used not only in places where people need to stay quiet, but also in noisy environments.

In tests after training the algorithm on the chin movements of 20 volunteers (half spoke Mandarin and the remainder spoke English), 90.5% and 91.6% accuracy were successively shown when motionless. Such a high level was maintained mainly due to the fact that the algorithm was based solely on 54 English and 44 Mandarin commands, which, for example, the Google assistant can understand.