A WEARABLE SENSOR BASED APPROACH TO REAL-TIME FALL DETECTION AND FINE-GRAINED ACTIVITY RECOGNITION

Authors

  • CUONG PHAM Department of Computer Science, Posts & Telecommunications Institute of Technology, Hanoi, Vietnam Affiliation: Culture Lab, Newcastle University, Newcastle upon Tyne, NE17RU, UK
  • NGUYEN NGOC DIEP Department of Computer Science, Posts & Telecommunications Institute of Technology, Hanoi, Vietnam
  • TU MINH PHUONG Department of Computer Science, Posts & Telecommunications Institute of Technology, Hanoi, Vietnam

Keywords:

Activity recognition, fall detection, wearable sensors

Abstract

We present a real-time fall detection and activity recognition system that is inexpensive and can be easily deployed using two Wii Remotes worn on human body. Continuously 3-dimentional data streams are segmented into sliding windows and then pre-processed for removing signal noises and filling missing samples. Features including Mean, Standard deviation, Energy, Entropy, Correlation between acceleration axes extracted from sliding windows are trained the activity models. The trained models are then used for detecting falls and recognizing 13 fine-grained activities including unknown activities in real-time. An experiment on 12 subjects was conducted to rigorously evaluate the system performance. With the recognition rates as high as 95% precision and recall for user dependent isolation training, 91% precision and recall for 10-fold cross validation and as high as 82% precision and recall for leave one subject out evaluations, the results demonstrated that the development of real-time, easyto- deploy fall detection and activity recognition systems using low-cost sensors is feasible.

 

Downloads

Download data is not yet available.

References

Abbate, S., Avvenuti, M., Bonatesta, F., Cola, G., Corsini, P. V., A Smartphone-based Fall

Detection System. Pervasive Mob. Comput. 8, 6 (December 2012), 883-899.

Albinali, F., Intille, S., Haskell, W., Rosenberger, M., Using Wearable Activity Type Detection to

Improve Physical Activity Energy Expenditure Estimation. In Proceedings of the 12th ACM

International Conference on Ubiquitous Computing (Ubicomp’10). ACM, New York, 311-320.

Bao, L., Intille, S., Activity Recognition from User-Annotated Acceleration Data. In Proceedings

of the 2nd International Conference on Pervasive Computing (Pervasive’2004), AloisFerscha,

Friedemann Matter (Eds.). Springer-Verlag, Berlin, Heidelberg, 1-17.

Buettner, M., Prasad, R., Philipose, M., Wetherall, D., Recognizing Daily Activities with RFIDbased

Sensors. In Proceedings of the 11th International Conference on Ubiquitous Computing

(Ubicomp '09). ACM, New York, NY, USA, 51-60.

Doukas, C., Maglogiannis, I., Tragas, P., Liapis, D., Yovanof, G., Patient fall detection using

support vector machines. In Artificial Intelligence and Innovations 2007: from Theory to

Applications (pp. 147-156). Springer US, 2007.

Duong, T. V., Bui, H. H., Dinh, Q. P., Venkatesh, S., Activity Recognition and Abnormality

Detection with the Switching Hidden Semi-Markov Model. In Computer Vision and Pattern

Recognition, 2005. CVPR 2005. IEEE Computer Society Conference, vol. 1, pp. 838-845, 2005.

ELAN. http://tla.mpi.nl/tools/tla-tools/elan/ (accessed on 19/02/2013).

Falls Among Older Adults: An Overview.

http://www.cdc.gov/HomeandRecreationalSafety/Falls/adultfalls.html (accessed on 28/1/2013).

Farringdon, J., Moore, A. J., Tilbury, N., Church, J., Biemond, P. D., Wearable sensor badge and

sensor jacket for context awareness. In Wearable Computers, 1999. Digest of Papers. The Third

International Symposium on (pp. 107-113). IEEE, 1999.

General office for population family planning. http://www.gopfp.gov.vn (accessed on 28/1/2013)

HMM ToolKit. http://www.cs.ubc.ca/~murphyk/Software/HMM/hmm.html (as of 07/03/2013).

Huynh, T., Blanke, U., Schiele, B., Scalable Recognition of Daily Activities with Wearable

Sensors. In Proceedings of the 3rd International Conference on Location-and Context-Awareness

(LoCA’07), J. Hightower, B. Schiele, and T. Strang (Eds.). Springer-Verlag, Heidelberg, 50-67.

Hwang, J. Y., Kang, J. M., Jang, Y. W., Kim, H. C., Development of Novel Algorithm and Realtime

Monitoring Ambulatory System Using Bluetooth Module for Fall Detection in the Elderly.

In Engineering in Medicine and Biology Society, 2004. IEMBS'04, Vol. 1, 2204-2207, 2004.

Jantaraprim, P., Phukpattaranont, P., Limsakul, C., Wongkittisuksa, B., Fall Detection for the

elderly using a Support Vector Machine. Intl J. of Soft Compu.&Eng., 2(1) (2012), 484-490.

Kasteren, T. V., Noulas, A., Englebienne, G., Kröse, B., Accurate Activity Recognition in a

Home Setting. In Proceedings of the 10th international conference on Ubiquitous computing

(UbiComp '08). ACM, New York, NY, USA, 1-9.

Lai, C. F., Chang, S. Y., Chao, H. C., Huang, Y. M., Detection of cognitive injured body region

using multiple triaxial accelerometers for elderly falling. Sensors Journal, 11(3) (2011), 763-770.

Microstrain. http://www.microstrain.com/parameters/acceleration (accessed on 28/1/2013).

Olivieri, D. N., Conde, I. G., Sobrino, X. A. V., Eigenspace-based Fall Detection and Activity

Recognition from Motion Templates and Machine Learning. Expert Syst. Appl. 39, 5 (2012),

-5945.

Pham, C., Hooper, C., Lindsay, S., Jackson, D., Shearer, J., Wagner, J., Ladha, C., Ladha, K.,

Pltz, T., Olivier, P., The Ambient Kitchen: A Pervasive Sensing Environment for Situated

Services. Demonstration in the Designing Interactive Systems Conference (DIS’2012). ACM.

Pham, C., Olivier, P., Slice&Dice: Recognizing Food Preparation Activities using Embedded

Accelerometers. In Proc. Europ. Conf. Ambient Intell., pp. 34—43.

Rabiner, L., A Tutorial on Hidden Markov Models and Selected Applications in Speech

Recognition. Readings in speech recognition, Alex Waibel and Kai-Fu Lee (Eds.). Morgan

Kaufmann Publishers Inc., San Francisco, CA, USA 267-296.

Ravi, N., Dandekar, N., Mysore, P., Littman, M. L., Activity Recognition from Accelerometer

Data. In Proceedings of the 17th Conference on Innovative Applications of Artificial Intelligence

- Volume 3 (IAAI’05), Bruce Porter (Ed.), Vol. 3. AAAI Press 1541-1546.

Reece, A. C., Simpson, J. M., Preparing Older People to Cope after A Fall. Physiotherapy 1996,

(4), 227-235.

Spline Interpolation: http://en.wikipedia.org/wiki/Spline_interpolation (accessed on 29/1/2013).

Sposaro, F., Tyson, G., iFall: An Android Application for Fall Monitoring and Response. In Proc.

of 31st Annual International Conference of the IEEE EMBS, Minneapolis, 2009.

SUNSPOT. http://www.sunspotworld.com/products/ (accessed on 28/11/2013).

Tapia, E. M., Intille, S. S., Larson, K., Activity Recognition in the Home Using Simple and

Ubiquitous Sensors. In Proceedings of the 2nd International Conference on Pervasive Computing

(Pervasive’2004), AloisFerscha, FriedemannMattern (Eds.). Springer-Verlag, Berlin, 158-175.

Van Laerhoven, K., Cakmakci, O., What Shall We Teach Our Pants?. In Wearable Computers,

The Fourth International Symposium on (pp. 77-83). IEEE, 2000.

Van Laerhoven, K., Schmidt, A., Gellersen, H. W., Multi-sensor context aware clothing. In

Wearable Computers (ISWC 2002). Proc. Sixth International Symposium 49-56. IEEE, 2002.

Ward, A. J., Lukowicz, P., Gellersen, W. H., Performance Metrics for Activity Recognition.

ACM Trans. Intell. Syst. Technol. 2, 1, Article 6 (January 2011), 23 pages.

WAX3. http://axivity.com/v2/ (accessed on 28/11/2013).

Wherton, P. J., Monk, F. A., Technological Opportunities for Supporting People with Dementia

Who Are Living at Home. Int. J. Hum.-Comput. Stud. 66, 8 (August 2008), 571-586.

Wii Remote. http://en.wikipedia.org/wiki/Wii_Remote (accessed on 28/11/2013).

Wu, G. E., Xue, S., Portable preimpact fall detector with inertial sensors. Neural Systems and

Rehabilitation Engineering, IEEE Transactions on, 16(2) (2008), 178-183.

Wu, J., Osuntogun, A., Choudhury, T., Philipose, M., James, M. R., A Scalable Approach to

Activity Recognition based on Object Use. In Proc. of ICCV’2007, IEEE Press, 1-8.

Zhang, T., Wang, J., Xu, L., Liu, P., Using wearable sensor and NMF algorithm to realize

ambulatory fall detection. In Advances in Natural Computation (pp. 488-491). Springer, 2006.

Ploetz, T., Moynihan, P., Pham, C., Olivier, P. 2011; Activity Recognition and Healthier Food

Preparation. In Activity Recognition in Pervasive Intelligent Environments. Chen, L.; Nugent,

C.D.; Biswas, J.; Hoey, J. (Eds.). 1st Edition, 2011, Atlantis Press. 313-327

Downloads

Published

2013-01-13

Issue

Section

Articles