Integrating User-Centred Design in the Development of a Silent Speech Interface Based on Permanent Magnetic Articulography

  • Lam A. CheahEmail author
  • James M. Gilbert
  • Jose A. Gonzalez
  • Jie Bai
  • Stephen R. Ell
  • Michael J. Fagan
  • Roger K. Moore
  • Phil D. Green
  • Sergey I. Rychenko
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 574)


A new wearable silent speech interface (SSI) based on Permanent Magnetic Articulography (PMA) was developed with the involvement of end users in the design process. Hence, desirable features such as appearance, portability, ease of use and light weight were integrated into the prototype. The aim of this paper is to address the challenges faced and the design considerations addressed during the development. Evaluation on both hardware and speech recognition performances are presented here. The new prototype shows a comparable performance with its predecessor in terms of speech recognition accuracy (i.e. ~ 95 % of word accuracy and ~ 75 % of sequence accuracy), but significantly improved appearance, portability and hardware features in terms of miniaturization and cost.


Assistive speech technology User-centred design Silent speech interface Permanent magnetic articulography Magnetic sensors 



The work is an independent research funded by the National Institute for Health Research (NIHR)’s Invention for Innovation Programme. The views stated are those of the authors and not necessary reflecting the thoughts of the sponsor.


  1. 1.
    Fagan, M.J., Ell, S.R., Gilbert, J.M., Sarrazin, E., Chapman, P.M.: Development of a (silent) speech recognition system for patients following laryngectomy. Med. Eng. Phys. 30(4), 419–425 (2008)CrossRefGoogle Scholar
  2. 2.
    Gilbert, J.M., Rybchenko, S.I., Hofe, R., Ell, S.R., Fagan, M.J., Moore, R.K., Green, P.D.: Isolated word recognition of silent speech using magnetic implants and sensors. Med. Eng. Phys. 32(10), 1189–1197 (2010)CrossRefGoogle Scholar
  3. 3.
    Ell, S.R., Mitchell, A.J., Parker, A.J.: Microbial colonisation of the Groningen speaking valve and its relationship to valve failure. Clin. Otolaryngol. 20, 555–556 (1995)CrossRefGoogle Scholar
  4. 4.
    Ell, S.R., Mitchell, A.J., Clegg, R.T., Parker, A.J.: Candida: the cancer of silastic. J. Laryngol. Otol. 110(3), 240–242 (1996)CrossRefGoogle Scholar
  5. 5.
    Heaton, J.M., Parker, A.J.: Indwelling trachea-oesophageal voice prostheses post-laryngectomy in Sheffield, UK: a 6-year review. Acta Otolaryngol. 114, 675–678 (1994)CrossRefGoogle Scholar
  6. 6.
    Denby, B., Schultz, T., Honda, K., Hueber, T., Gilbert, J.M., Brumberg, J.S.: Silent speech interfaces. Speech Commun. 52(4), 270–287 (2010)CrossRefGoogle Scholar
  7. 7.
    Hofe, R., Ell, S.R., Fagan, M.J., Gilbert, J.M., Green, P.D., Moore, R.K., Rybchenko, S.I.: Small-vocabulary speech recognition using silent speech interface based on magnetic sensing. Speech Commun. 55(1), 22–32 (2013)CrossRefGoogle Scholar
  8. 8.
    Hofe, R., Bai, J., Cheah, L.A., Ell, S.R., Gilbert, J.M., Moore, R.K., Green, P.D.: Performance of the MVOCA silent speech interface across multiple speakers. In: Proceedings of the 14th INTERSPEECH, pp. 1140-1143, Lyon, France (2013)Google Scholar
  9. 9.
    Hofe, R., Ell, S.R., Fagan, M.J., Gilbert, J.M., Green, P.D., Moore, R.K., Rybchenko, S.I.: Speech synthesis parameters generation for the assistive silent speech interface MVOCA. In: Proceedings of the 12th INTERSPEECH, pp. 3009–3012, Florence, Italy (2011)Google Scholar
  10. 10.
    Gonzalez, J.A., Cheah, L.A., Bai, J., Ell, S.R., Gilbert, J.M., Moore, R.K., Green, P.D.: Analysis of phonetic similarity in a silent speech interface based on permanent magnetic articulography. In: Proceedings of the 15th INTERSPEECH, pp. 1018–1022, Singapore (2014)Google Scholar
  11. 11.
    Bright, A.K., Conventry, L.: Assistive technology for older adults: psychological and socio-emotional design requirements, In: Proceedings of the 6th International Conference on Pervasive Technologies Related to Assistive Environments, pp. 1–4, Rhodes, Greece (2013)Google Scholar
  12. 12.
    Hirsch, T., Forlizzi, J., Goetz, J., Stoback, J., Kurtx, C.: The ELDer project: Social and emotional factors in the design of eldercare technologies. In: Proceedings on the 2000 Conference of Universal Usability, pp. 72–79, Arlington, USA (2000)Google Scholar
  13. 13.
    Martin, J.L., Murphy, E., Crowe, J.A., Norris, B.J.: Capturing user requirements in medical devices development: the role of ergonomics. Physiol. Meas. 27(8), R49–R62 (2006)CrossRefGoogle Scholar
  14. 14.
    Cook, A.M., Polgar, J.M.: Assistive Technologies: Principles and Practice, 3rd edn. Mosby, London (2008)Google Scholar
  15. 15.
    Leonard, R.G.: A database for speaker-independent digit recognition. In: International Conference on Acoustic, Speech and Signal Processing, pp. 328–331, San Diego, USA (1984)Google Scholar
  16. 16.
    Young, S., Everman, G., Gales, M., Hain, T., Kershaw, D., Liu, X., Moore, G., Odell, J., Ollason, D., Povery, D., Valtchev, V., Woodland, P.: The HTK Book (for HTK version 3.4.1), Cambridge University Press, Cambridge (2009)Google Scholar
  17. 17.
    Rabiner, L.R.: A tutorial on Hidden Markov models and selected applications in speech recognition. Proc. IEEE 77, 257–286 (1989)CrossRefGoogle Scholar
  18. 18.
    Maier-Hein, L., Metze, F., Schultz, T., Waibel, A.: Session independent non-audible speech recognition using surface electromyography. In: Automatic Speech Recognition and Understanding Workshop, pp. 331–336, Cancun, Mexico (2005)Google Scholar
  19. 19.
    Wand, M., Schultz, T.: Session-independent EMG-based speech recognition. In: Proceedings of the 4th International Conference on Bio-inspired Systems and Signal Processing, pp. 295–300, Rome, Italy (2011)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Lam A. Cheah
    • 1
    Email author
  • James M. Gilbert
    • 1
  • Jose A. Gonzalez
    • 2
  • Jie Bai
    • 1
  • Stephen R. Ell
    • 3
  • Michael J. Fagan
    • 1
  • Roger K. Moore
    • 2
  • Phil D. Green
    • 2
  • Sergey I. Rychenko
    • 1
  1. 1.School of EngineeringThe University of HullKingston upon HullUK
  2. 2.Department of Computer ScienceThe University of SheffieldSheffieldUK
  3. 3.Hull and East Yorkshire Hospitals Trust, Castle Hill HospitalCottinghamUK

Personalised recommendations