A WEARABLE SENSOR BASED APPROACH TO REAL-TIME FALL DETECTION AND FINE-GRAINED ACTIVITY RECOGNITION
Keywords:
Activity recognition, fall detection, wearable sensorsAbstract
We present a real-time fall detection and activity recognition system that is inexpensive and can be easily deployed using two Wii Remotes worn on human body. Continuously 3-dimentional data streams are segmented into sliding windows and then pre-processed for removing signal noises and filling missing samples. Features including Mean, Standard deviation, Energy, Entropy, Correlation between acceleration axes extracted from sliding windows are trained the activity models. The trained models are then used for detecting falls and recognizing 13 fine-grained activities including unknown activities in real-time. An experiment on 12 subjects was conducted to rigorously evaluate the system performance. With the recognition rates as high as 95% precision and recall for user dependent isolation training, 91% precision and recall for 10-fold cross validation and as high as 82% precision and recall for leave one subject out evaluations, the results demonstrated that the development of real-time, easyto- deploy fall detection and activity recognition systems using low-cost sensors is feasible.
Downloads
References
Abbate, S., Avvenuti, M., Bonatesta, F., Cola, G., Corsini, P. V., A Smartphone-based Fall
Detection System. Pervasive Mob. Comput. 8, 6 (December 2012), 883-899.
Albinali, F., Intille, S., Haskell, W., Rosenberger, M., Using Wearable Activity Type Detection to
Improve Physical Activity Energy Expenditure Estimation. In Proceedings of the 12th ACM
International Conference on Ubiquitous Computing (Ubicomp’10). ACM, New York, 311-320.
Bao, L., Intille, S., Activity Recognition from User-Annotated Acceleration Data. In Proceedings
of the 2nd International Conference on Pervasive Computing (Pervasive’2004), AloisFerscha,
Friedemann Matter (Eds.). Springer-Verlag, Berlin, Heidelberg, 1-17.
Buettner, M., Prasad, R., Philipose, M., Wetherall, D., Recognizing Daily Activities with RFIDbased
Sensors. In Proceedings of the 11th International Conference on Ubiquitous Computing
(Ubicomp '09). ACM, New York, NY, USA, 51-60.
Doukas, C., Maglogiannis, I., Tragas, P., Liapis, D., Yovanof, G., Patient fall detection using
support vector machines. In Artificial Intelligence and Innovations 2007: from Theory to
Applications (pp. 147-156). Springer US, 2007.
Duong, T. V., Bui, H. H., Dinh, Q. P., Venkatesh, S., Activity Recognition and Abnormality
Detection with the Switching Hidden Semi-Markov Model. In Computer Vision and Pattern
Recognition, 2005. CVPR 2005. IEEE Computer Society Conference, vol. 1, pp. 838-845, 2005.
ELAN. http://tla.mpi.nl/tools/tla-tools/elan/ (accessed on 19/02/2013).
Falls Among Older Adults: An Overview.
http://www.cdc.gov/HomeandRecreationalSafety/Falls/adultfalls.html (accessed on 28/1/2013).
Farringdon, J., Moore, A. J., Tilbury, N., Church, J., Biemond, P. D., Wearable sensor badge and
sensor jacket for context awareness. In Wearable Computers, 1999. Digest of Papers. The Third
International Symposium on (pp. 107-113). IEEE, 1999.
General office for population family planning. http://www.gopfp.gov.vn (accessed on 28/1/2013)
HMM ToolKit. http://www.cs.ubc.ca/~murphyk/Software/HMM/hmm.html (as of 07/03/2013).
Huynh, T., Blanke, U., Schiele, B., Scalable Recognition of Daily Activities with Wearable
Sensors. In Proceedings of the 3rd International Conference on Location-and Context-Awareness
(LoCA’07), J. Hightower, B. Schiele, and T. Strang (Eds.). Springer-Verlag, Heidelberg, 50-67.
Hwang, J. Y., Kang, J. M., Jang, Y. W., Kim, H. C., Development of Novel Algorithm and Realtime
Monitoring Ambulatory System Using Bluetooth Module for Fall Detection in the Elderly.
In Engineering in Medicine and Biology Society, 2004. IEMBS'04, Vol. 1, 2204-2207, 2004.
Jantaraprim, P., Phukpattaranont, P., Limsakul, C., Wongkittisuksa, B., Fall Detection for the
elderly using a Support Vector Machine. Intl J. of Soft Compu.&Eng., 2(1) (2012), 484-490.
Kasteren, T. V., Noulas, A., Englebienne, G., Kröse, B., Accurate Activity Recognition in a
Home Setting. In Proceedings of the 10th international conference on Ubiquitous computing
(UbiComp '08). ACM, New York, NY, USA, 1-9.
Lai, C. F., Chang, S. Y., Chao, H. C., Huang, Y. M., Detection of cognitive injured body region
using multiple triaxial accelerometers for elderly falling. Sensors Journal, 11(3) (2011), 763-770.
Microstrain. http://www.microstrain.com/parameters/acceleration (accessed on 28/1/2013).
Olivieri, D. N., Conde, I. G., Sobrino, X. A. V., Eigenspace-based Fall Detection and Activity
Recognition from Motion Templates and Machine Learning. Expert Syst. Appl. 39, 5 (2012),
-5945.
Pham, C., Hooper, C., Lindsay, S., Jackson, D., Shearer, J., Wagner, J., Ladha, C., Ladha, K.,
Pltz, T., Olivier, P., The Ambient Kitchen: A Pervasive Sensing Environment for Situated
Services. Demonstration in the Designing Interactive Systems Conference (DIS’2012). ACM.
Pham, C., Olivier, P., Slice&Dice: Recognizing Food Preparation Activities using Embedded
Accelerometers. In Proc. Europ. Conf. Ambient Intell., pp. 34—43.
Rabiner, L., A Tutorial on Hidden Markov Models and Selected Applications in Speech
Recognition. Readings in speech recognition, Alex Waibel and Kai-Fu Lee (Eds.). Morgan
Kaufmann Publishers Inc., San Francisco, CA, USA 267-296.
Ravi, N., Dandekar, N., Mysore, P., Littman, M. L., Activity Recognition from Accelerometer
Data. In Proceedings of the 17th Conference on Innovative Applications of Artificial Intelligence
- Volume 3 (IAAI’05), Bruce Porter (Ed.), Vol. 3. AAAI Press 1541-1546.
Reece, A. C., Simpson, J. M., Preparing Older People to Cope after A Fall. Physiotherapy 1996,
(4), 227-235.
Spline Interpolation: http://en.wikipedia.org/wiki/Spline_interpolation (accessed on 29/1/2013).
Sposaro, F., Tyson, G., iFall: An Android Application for Fall Monitoring and Response. In Proc.
of 31st Annual International Conference of the IEEE EMBS, Minneapolis, 2009.
SUNSPOT. http://www.sunspotworld.com/products/ (accessed on 28/11/2013).
Tapia, E. M., Intille, S. S., Larson, K., Activity Recognition in the Home Using Simple and
Ubiquitous Sensors. In Proceedings of the 2nd International Conference on Pervasive Computing
(Pervasive’2004), AloisFerscha, FriedemannMattern (Eds.). Springer-Verlag, Berlin, 158-175.
Van Laerhoven, K., Cakmakci, O., What Shall We Teach Our Pants?. In Wearable Computers,
The Fourth International Symposium on (pp. 77-83). IEEE, 2000.
Van Laerhoven, K., Schmidt, A., Gellersen, H. W., Multi-sensor context aware clothing. In
Wearable Computers (ISWC 2002). Proc. Sixth International Symposium 49-56. IEEE, 2002.
Ward, A. J., Lukowicz, P., Gellersen, W. H., Performance Metrics for Activity Recognition.
ACM Trans. Intell. Syst. Technol. 2, 1, Article 6 (January 2011), 23 pages.
WAX3. http://axivity.com/v2/ (accessed on 28/11/2013).
Wherton, P. J., Monk, F. A., Technological Opportunities for Supporting People with Dementia
Who Are Living at Home. Int. J. Hum.-Comput. Stud. 66, 8 (August 2008), 571-586.
Wii Remote. http://en.wikipedia.org/wiki/Wii_Remote (accessed on 28/11/2013).
Wu, G. E., Xue, S., Portable preimpact fall detector with inertial sensors. Neural Systems and
Rehabilitation Engineering, IEEE Transactions on, 16(2) (2008), 178-183.
Wu, J., Osuntogun, A., Choudhury, T., Philipose, M., James, M. R., A Scalable Approach to
Activity Recognition based on Object Use. In Proc. of ICCV’2007, IEEE Press, 1-8.
Zhang, T., Wang, J., Xu, L., Liu, P., Using wearable sensor and NMF algorithm to realize
ambulatory fall detection. In Advances in Natural Computation (pp. 488-491). Springer, 2006.
Ploetz, T., Moynihan, P., Pham, C., Olivier, P. 2011; Activity Recognition and Healthier Food
Preparation. In Activity Recognition in Pervasive Intelligent Environments. Chen, L.; Nugent,
C.D.; Biswas, J.; Hoey, J. (Eds.). 1st Edition, 2011, Atlantis Press. 313-327