Jump to content

Hearables

From Wikipedia, the free encyclopedia
Hearable generic illustration

Hearables or smart headphones or earbuds are electronic in-ear devices designed for multiple purposes. The category is split between hearables for hearing health, and hearables for other applications.

Terminology

[edit]

The neologism "hearable" is a hybrid of the terms wearable and headphone, as hearables combine major assets of wearable technology with the basic principle of audio-based information services, conventional rendition of music and wireless telecommunication. The term was introduced in April 2014 simultaneously by Apple in the context of the company's acquisition of Beats Electronics and product designer and wireless application specialist Nick Hunn in a blogpost for a wearable technologies internet platform.[1]

Hearables are often referenced as a subset of wearables. Sometimes the terms "smart headphones" or "smart advisors" are also used to denominate hearables. The news agency Reuters in its "Journalism media and technology predictions 2015" ranked voice-driven virtual assistants as an important field of innovation, including voice recognition software like Apple's Siri, Amazon's Echo,[2] or Me-OS on Vinci headphones.[3]

Concept and use

[edit]

The first description of a wearable ear-worn multimedia platform for health monitoring, heart rate monitoring, entertainment, guidance, and cloud-based communications was described by Valencell in 2006.[4] Current advancements in the development of hearables aim at feature integration, size reduction, and covering a diverse range of applications. Controlled by touch, movement, thought or voice (or any combination of the mentioned control mechanisms) these miniaturized in-ear buds are designed primarily for the purposes of mobile communication, real time information services, activity tracking and various monitoring applications focusing on the wearers health conditions and body performance.

The hardware architecture typically comprises

  1. Speakers, to convert analog signals to sound
  2. Bluetooth IC, to communicate with other devices typically a smartphone
  3. Sensors, to track heart rate, cadence, or to detect proximity
  4. Microphones, to take or make phone calls, or take voice commands

Most of the "Hearables" seen to date are Bluetooth devices that use phones or PCs as the central computing unit. Vinci smart headphones, announced in 2016,[5] incorporated a dual-core CPU, local storage, Wi-Fi, and 3G connectivity that allow users to use without a phone.[6]

One important benefit of placing the entire interaction unit in-ear and addressing users purely through acoustic signals is the lower grade of overall distraction compared to vision based augmented reality tools or wearables with tactile signal, measuring and interaction mechanisms. At the same time acoustic warning signals – for example in case of an otherwise unnoticed medical crisis – are, as experiments have shown, more effective and immediate than visual indicators.[7] Furthermore, the measurement of biometric data such as temperature, heart rate or oxygen saturation can be monitored through via PPG with significantly higher reliability and better response times through in ear monitoring than contact devices placed on wrist or torso.[8][9][10][11]

A substantial amount of research around hearables is dedicated to aiding the hearing impaired and the increasing number of elderly people struggling with conventional input/output devices such as keyboard, mouse or touchscreen, as it is reflected for instance by the recent cooperation between the EHIMA (European Hearing Industry Manufacturer's Association)[12] and the Bluetooth Special Interest Groupworks on the enhancement of conventional hearing aids by applying the newest Bluetooth generation for additional streaming of music, telecommunication and audio notifications.[13] The European Commission has initiated a similar research project in mid 2013, with a projected runtime until summer 2016. This so-called "AAL Joint Programme"[14] also involves the "Austrian Ministry of Traffic, Innovation and Technology",[15] the Austrian Society for Research Funding[16] and several privately owned technology companies.[17] A somewhat more ambitious project is the inclusion of EEG in hearables, making it an example of ear-EEG.

Current developments

[edit]
Global Revenue from Smart Wearables and hearables

Most systems in development are designed for binaural use and share a basic set of desired functionalities. Currently the deployment of hearables is on the agenda of many consumer technology manufacturers. The first hearable product to enter the marketplace was the iriverON Bluetooth headset, launched in late 2013, which integrated biometric sensor technology into a Bluetooth audio headset. Other biometric have since followed in the market, including the Jabra Sport Pulse, the Sony B-Trainer, the LG HR Earphone, and other biometric Bluetooth headsets. The core technology behind these products has been independently validated by Duke University.[18] In the summer of 2014 "Earin", a headphone firm based in Lund (Sweden), started a crowdfunding campaign for their "Minuscule" earbuds, claiming them to become the smallest in ear headphones ever.[19][20][1] However, the design details known as of today hint at „Minuscule“ being deployed as Bluetooth headphones and as such the earbuds will not completely comply with the definition of hearables in a broader sense. If they are to be seen as but an interim stage in the development of a multi-purpose in ear-piece is yet uncertain. A similar approach was chosen by headphone company OwnPhones,[21][22] which is currently working on wireless, Bluetooth triggered earbuds, which can be fitted individually to the user's ear by a smartphone based measuring application triggering a 3D-printing device. The earphones will be fully compatible with all major smartphone and tablet manufactures, as well as notebooks and desktop computers. However an independent use of the earbuds is not yet projected, OwnPhones-earbuds will, for now, be controlled by primary electronic devices.

Apart from "Earin" and "Ownphones," the Munich-based technology company Bragi[23] has advertised developments towards truly wireless smart earphones according to different publications such as Wired Magazine (10/2014),[24] the Dutch daily newspaper De Telegraaf,[25] and The Huffington Post.[26][27] In early 2014 "Bragi" set up a crowdfunding campaign for "The Dash", claiming to realize the world’s first wireless performance tracking earbud which would eventually become the most successful crowd-sourcing campaign in Europe to date with a total revenue of roughly 3.3 million dollars.[28] "The Dash", which according to public company announcements will reach start of production in autumn 2015, is projected to enable wearers to listen to music while tracking physical activity (speed, time, distance, cadence, elevation gain, etc.) and at the same time measure key data on body performance (heart rate, energy turnover, oxygen saturation, etc.). In January 2015 "The Dash" was awarded the "Innovation Award" of the CES (Consumer Electronic Show).[29] held in Las Vegas. The preceding CES had already witnessed the release of LG's "Heart Rate Earphones", a device that connects wirelessly to the company's product "Lifeband Touch" and arbitrary smart devices via a "data processing medallion", which is attached to the earpieces applying a conventional wire connection.[30]

Already in autumn 2014 "FreeWavz"[31] was announced, a Bluetooth triggered headset developed by Florida-based ENT physician and fitness enthusiast Dr. Eric Hensen.[32] The earpieces can be controlled independently and give acoustic updates on heart rate, oxygen saturation, calories burned, distance, speed and duration. However, unlike the approach chosen by Bragi, the FreeWavz headphones as yet fully depend on the interlinking with a smartphone or tablet via a dedicated app.

Several other companies are currently also investing development capacities in hearables. Among them are "Elbee",[33] "Waverly Labs"[34] and "Motorola",[35] who with the "Moto Hint" already offer a hands-free, voice-controlled earbud for Bluetooth-enabled smartphones, and Alango Technologies, who has designed a hearable called "BeHear" that disrupts the hearing aid industry by putting a hearing enhancement solution that could previously only be provided by medical/healthcare professionals directly into the hands of users.

In May 2014 the British daily newspaper The Guardian reported on an information leak claiming that Apple Inc. had recently started to break into the wearables market by equipping their standard headphones with health monitoring features. However the article uncovered the unofficial source's information as totally fabricated.[36] In September 2016, Apple made several announcements that could further propel the hearables market. One was the removal of the 3.5mm audio jack from the iPhone, which was denigrated by many. However, it fundamentally changed the dynamics of the market for wireless headphones. Two additional announcements were a new wireless chip allowing them to enter the world of hearables by launching their own brand of earbuds, known as Airpods.

A company, "United Sciences",[37] founded in 2009, has developed a digital ear scanner which is used to make custom shaped hearables. Every individual has differently shaped ears and a custom shaped hearable provides comfort for long term wear. They are rumoured to have partnered with Google to develop custom shaped hearable for measuring pulse oxygenation, EEG, heart rate and for Brain computer interface.[38]

In November, 2016, Vinci smart headphones were first seen on Kickstarter[39] and successfully raised nearly $1M. The Vinci smart headphones integrate AI virtual assistant that manages users' music requests and other online services such as Spotify, Amazon Music, navigation on maps and search on Wiki. It also supports direct call for Amazon Alexa for voice services. It is the first of kind that combines a HiFi music player, a 32G local storage, voice recognition, activity tracking and biometric sensors (like heart rate).[40] The Vinci smart headphones use a combination of touch, gesture and voice to provide a streamlined music listening experience.[41] Vinci headphones carry an internal dual-core CPU thus no phones are needed when users go for a run or work out in a gym.[42][43]

The NPD Group, which tracks retail sales in the US, has reported in June 2016 that the overall value of wireless headphone sales in the US overtook that of wired headphones, paving the way for a major hearable explosion.[44] Now more than 50 hearable devices exist or are in crowdfunding stages to be brought to market.

In 2024, Nature Electronics reported on noise-canceling headsets that can create sound bubbles around the wearer.[45][46] These devices combine artificial intelligence with noise-canceling technology to create customizable auditory zones—known as sound bubbles—that let users focus on speakers within a designated area around them while suppressing sounds outside it.[46]

References

[edit]
  1. ^ Nick Hunn: "Hearables – The new Wearables", Wearable Technologies online (April 4, 2014)
  2. ^ Nic Newman: "Journalism media and technology predicitions 2015", Reuters Institute online (January 12, 2015)
  3. ^ UberGizmo. "Vinci Smart Hearable Reinvents Headphones". ubergizmo.com.
  4. ^ "United States Patent: 8157730 - Physiological and environmental monitoring systems and methods".
  5. ^ Kickstarter. "Vinci - First Smart Headphones with Artificial Intelligence".
  6. ^ Engadget. "Vinci's smart headphones play music, no phone required".
  7. ^ Dieter Klebelsberg: Verkehrspsychologie, Berlin | Heidelberg | New York 1982, p. 83 [German] (with references to "Robert S. Woodworth" | Harold H. Schlosberg: Experimental Psychology (1954))
  8. ^ Nick Hunn: "Hearables the new Wearables", Wearable Technology online (April 4, 2014)
  9. ^ Scott Snyder (Senior Fellow MACK Institute for Innovation Management, University of Pennsylvania): "The ear happens to be a good place to pick up blood flow as it moves consistently in and out of the ear, and the membrane is relatively thin. We can pick up heart rate, blood flow and even oxygen levels at an accuracy rate comparable to the chest strap." Quoted from: "Are Hearables the next big thing in fitness?", U.S. News & World Report online (April 8, 2014)
  10. ^ On the high accuracy of estimates on total energy expenditure and oxygen consumption during exercise through in ear devices also see: Steven Francis Leboeuf | Michael E. Aumer | William E. Kraus | Johanna L. Johnson | Brian Duscha: Earbud-based sensor for the adjustment of energy expenditure, HR and VO2 Max, in: Medicine & Science in Sport & Exercise, Vol. 46, Issue 5 (May 2014), pp. 1046–1052
  11. ^ An overview on the advantages of in ear health monitoring is also given by: O. Brodersen | D. Römhild | D. Starke | A. Steinke & S. Vogel: In-Ear acquisition of vital signs discloses new chances for preventous continuous cardiovascular monitoring, in: IFMBE Proceedings, Vol. 13 (4th International Workshop on Wearable and Implantable Body Sensor Networks), Berlin | Heidelberg | New York 2007, pp. 189-194, particularly p. 189
  12. ^ Homepage EHIMA
  13. ^ "Bluetooth SIG and EHIMA Partner to Advance Hearing Instrument Technology to Improve the Lives of the Hearing Impaired", bluetooth.com (April 12, 2014)
  14. ^ Homepage AAL Joint Programme
  15. ^ Austrian Ministry of Traffic, Innovation and Technology
  16. ^ Austrian Society for Research Funding
  17. ^ Lutz Reum: "Wearables: Hype oder nützliches Gimmick?", "Deutsches Ärzteblatt Supplement" online [German] (2015)
  18. ^ Leboeuf, SF; Aumer, ME; Kraus, WE; Johnson, JL; Duscha, B (2014). "Earbud-based sensor for the assessment of energy expenditure, HR, and VO2max". Med Sci Sports Exerc. 46 (5): 1046–52. doi:10.1249/MSS.0000000000000183. PMC 3996514. PMID 24743110.
  19. ^ Manufacturer's homepage
  20. ^ "Wearable of the Month: Earin Truly Wireless Earbud". Humavox. Retrieved 2022-08-16.
  21. ^ Manufacturer's homepage: "OwnPhones" Archived 2015-08-10 at the Wayback Machine
  22. ^ Company Website of OwnPhones Archived 2015-08-10 at the Wayback Machine
  23. ^ Manufacturer's homepage
  24. ^ Stephen Brown: "Wearable fatigue? Stick it in your ear", "Wired Magazine" online (October 2014)
  25. ^ "Kleinere sensoren laten wearables verdwijnen", "De Telegraaf" online (May 1, 2015)
  26. ^ "The Dash: Die Kopfhörer der Zukunft sind das erfolgreichste Crowdfunding-Projekt Europas", "The Huffington Post" online [German] (February 2, 2014)
  27. ^ Also see Nyshka Chandran: "Hearables – the next big thing in wearable tech", "CNBC" online (December 29, 2014)
  28. ^ "Crowdfunding platform kickstarter.com"
  29. ^ "Bragi’s The Dash wins CES Best of Innovation Award 2015 (PDF)" Archived 2015-04-19 at the Wayback Machine (November 1, 2014)
  30. ^ Samuel Gibbs: "CES 2014: the best wearable smartwatches and fitness gadgets", "The Guardian" online (January 7, 2014)
  31. ^ Manufacturer's homepage: FreeWavz
  32. ^ For details see Randy Rieland: "These Ear Buds Will Play Music and Track Your Heart Rate", "The Smithsonian Institution Magazine" online (August 11, 2014)
  33. ^ Manufacturers homepage: Elbee Archived 2015-08-21 at the Wayback Machine
  34. ^ Manufacturer's homepage: Waverly Labs
  35. ^ Manufacturer's homepage: Motorola
  36. ^ Charles Arthur: "Apple's next headphones to track heart rate and blood pressure, leak claims", The Guardian online (May 1, 2014)
  37. ^ Company homepage: / United Sciences Archived 2016-02-08 at the Wayback Machine
  38. ^ Press article : / Project Aura updates
  39. ^ "VINCI smart headphones". Kickstarter.
  40. ^ Slash Gear. "Vinci smart headphones offer Alexa and standalone Spotify".
  41. ^ UberGizmo. "Vinci Smart Hearable Reinvents Headphones".
  42. ^ Wareable. "Vinci smart headphones: Would you wear these to play music without your phone?".
  43. ^ Engadget. "Vinci's smart headphones play music, no phone required".
  44. ^ Nick Hunn: "The Market For Hearables 2016-2020"
  45. ^ Chen, Tuochao; Itani, Malek; Eskimez, Sefik Emre; Yoshioka, Takuya; Gollakota, Shyamnath (2024-11-14). "Hearable devices with sound bubbles". Nature Electronics: 1–12. doi:10.1038/s41928-024-01276-z. ISSN 2520-1131.
  46. ^ a b Ma, Dong (2024-11-14). "Creating sound bubbles with intelligent headsets". Nature Electronics: 1–2. doi:10.1038/s41928-024-01281-2. ISSN 2520-1131.
[edit]
Retrieved from "https://en.wikipedia.org/w/index.php?title=Hearables&oldid=1258102186"