I read There’s a Way to Control Phones With Sound, Not Electronics article I read yesterday interesting. It says that researcher Gierad Laput thinks the future of smartphone interaction could look a lot like playing the flute as he has developed together with Eric Brockmeyer, from the Disney Research Lab, a series of phone accessories that function like tiny woodwind instruments. The basic operation principle is that a hollow tube connects runs between the phone’s speaker and microphone and the phone measures the acoustical response of the system (speaker emits a high-frequency sound microphone measures it). If you make a change to tube system (add a hole, thicken the plastic walls, pinch the tube etc..) the measurements can see the change and can control your phone’s actions by physically altering how that signal flows.
To get the idea on this interesting looking system (at least interesting to me as I have studies acoustics and signal processing) view this Acoustruments: Passive, Acoustically-Driven, Interactive Controls for Handheld Devices introduction video:
The video even shows in the end example how to add this type of interaction to Google Cardboard VR glasses I built and tested some time ago. The promise of Acoustruments research is that a simple 3-D printed accessory could add an element of tangible interaction to smartphones without much cost or complexity. The results claim that Acoustruments can achieve 99% accuracy with minimal training, is robust to noise, and can be rapidly prototyped.
For more details check Acoustruments: Passive, Acoustically-Driven Interactive Controls for Hand Held Devices research project page.
1 Comment
Tomi Engdahl says:
News & Analysis
Ultrasounds and Plastic in Place of Complex Electronics
http://www.eetimes.com/document.asp?doc_id=1326568&
PARIS — In a joint project from Carnegie Mellon University HCI Institute and Disney Research, researchers have demonstrated the use of cheap 3D printed plastic parts in place of complex analogue electronic circuitry to build smartphone plug-in accessories such as docking stations and other playful extensions.
There is a burgeoning market for so called app toys, or smartphone application-driven toy peripherals. In fact, this is one of the fastest growing tech sectors and according to MarketWatch.com, it is expected to generate billions in sales in 2015 and beyond, linking the two multi-billion dollars toy and mobile app industries together.
Today even the most humble smartphone docking station has built electronics and control knobs to activate circuitry and send the right control signals to the docked phone. But such accessories could be made much more simply and cheaply
Like for most of these app toys, Laput relies on the smartphone’s compute capacity and rich display interface to do most of the work, but the actual user interface extensions he has built, in the shape of knobs or sliders or any other linear sensors, bear no electronics whatsoever.
Instead Laput leverages the smartphone’s speaker as an analogue signal source of ultrasounds, and cheap plastic structures that can passively interfere with the sound waves as the user interacts with them.
The phone’s microphone picks up the modulated ultrasounds and interprets these variations as user inputs. Today, the researcher uses 100ms linear sweeps from 16.50 to 22.05kHz, but in a paper titled “Acoustruments: Passive, Acoustically-Driven, Interactive Controls for Handheld Devices,” he notes that for increased resolution, both sweep rate and frequency range could be drastically increased as the sampling rate of handheld devices continues to improve.
This gives plenty of scope for cheap plastic electronic-free app toys delivering rich, tangible interactive functionalities. Experiments have shown that the Acoustruments could achieve 99% accuracy with minimal training while being very robust to noise.