Blink Detection Using Image Processing to Predict Eye Fatigue

  • Akihiro KuwaharaEmail author
  • Rin Hirakawa
  • Hideki Kawano
  • Kenichi Nakashi
  • Yoshihisa Nakatoh
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 1253)


With the use of information terminals represented by smartphones, our eyes get tired. One index indicating eye fatigue is a change in the number of blinks. In this study, we set the ultimate goal that is to develop eye fatigue prevention system with less time and less physical burden for patient. By doing this, the information terminal performs a flickering of the eyes using a detection camera and a validity check. Previous EAR study with blink detection is confirmed to be effective, and this paper proposes a new formula EARM used EAR. As an evaluation method of blink detection, we used the total time average of the square of the residual value. The results showed that EARM was more accurate than the EAR. Further, it was suggested that the number of blinks during VDT work can be classified into several patterns.


Eye fatigue Image processing Dlib EAR 


  1. 1.
    Lee, H.S., Park, S.W., Heo, H.: Acute acquired comitant esotropia related to excessive Smartphone use (2016)Google Scholar
  2. 2.
    Ratnayake, K., Payton, J.L., Harshana Lakmal, O., Karunarathne, A.: Blue light excited retinal intercepts cellular signaling (2018)Google Scholar
  3. 3.
    Ministry of Internal Affairs and Communications: Heisei 30 years communication Usage Trend Survey results (2019)Google Scholar
  4. 4.
    Ministry of Health, Labor and Welfare: Guidelines for Occupational Health Management in Information Equipment Operations (2019)Google Scholar
  5. 5.
    Bandou, T., Moriyama, J.: Influence of personal characteristics on health maintenance awareness and internet dependence when using information devices. In: 30th Japan Society for Educational and Information Science, pp. 100–101 (2014)Google Scholar
  6. 6.
    Fukuda, T.: Biological Information Systems. Industrial Books, pp. 213–214 (1995)Google Scholar
  7. 7.
    Dlib C++ Library.
  8. 8.
    Bradski, G., Kaehler, A.: detailed explanation OpenCV - image processing and recognition that uses a computer vision library, pp. 171–172 (2018)Google Scholar
  9. 9.
    Intelligent Behaviour Understanding Group (IBUG): 300 faces in-the-wild challenge (300-W). In: ICCV (2013). https://Ibug.Doc.Ic.Ac.Uk/resources/300-W/
  10. 10.
    Sagonas, C., Antonakos, E., Tzimiropoulos, G., Zafeiriou, S., Pantic, M.: 300 faces in-the-wild challenge: database and results. Image Vis. Comput. (IMAVIS) 47, 3–18 (2016). Special Issue on Facial Landmark Localisation “In-The-Wild”CrossRefGoogle Scholar
  11. 11.
    Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., Pantic, M.: 300 faces in-the-wild challenge: the first facial landmark localization challenge. In: Proceedings of IEEE International Conference on Computer Vision (ICCV-W), 300 Faces in-the-Wild Challenge (300-W), Sydney, Australia, December 2013 (2013)Google Scholar
  12. 12.
    Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., Pantic, M.: A semi-automatic methodology for facial landmark annotation. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (CVPR-W), 5th Workshop on Analysis and Modeling of Faces and Gestures (AMFG 2013), Oregon, USA, June 2013 (2013)Google Scholar
  13. 13.
    Soukupova, T., Cech, J.: Real-Time Eye Blink Detection Using Facial Landmarks (2016)Google Scholar

Copyright information

© The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG 2021

Authors and Affiliations

  • Akihiro Kuwahara
    • 1
    Email author
  • Rin Hirakawa
    • 1
  • Hideki Kawano
    • 1
  • Kenichi Nakashi
    • 1
  • Yoshihisa Nakatoh
    • 1
  1. 1.Kyushu Institute of TechnologyKitakyushu-shiJapan

Personalised recommendations