Context-Aware Vital Sign Estimation Using Multimodal Wearable Sensing

Authors

  • Reid L. Jorgensen Department of Computer Science and Engineering, University at Buffalo, Buffalo, NY, USA. Author
  • Umesh Vohra School of Electrical Engineering and Computer Science, Oregon State University, Corvallis, OR, USA. Author
  • Christopher Rao Department of Computer Science, Binghamton University, Binghamton, NY, USA. Author

Keywords:

context-aware sensing, multimodal fusion, wearable computing, vital sign estimation, edge infrastructure, health equity, data governance

Abstract

Wearable health monitoring has undergone a transition from narrow single-signal recording toward multimodal platforms that combine photoplethysmography, electrocardiography, motion, temperature, and environmental sensing. While multimodal sensing creates new opportunities for robust vital sign estimation, it also introduces significant system-level challenges in context inference, data fusion, computational orchestration, deployment sustainability, and governance. This paper presents a system-oriented examination of context-aware vital sign estimation using multimodal wearable sensing. It discusses the conceptual foundations of context-aware physiological inference, emphasizing why vital signs such as heart rate, respiratory rate, and oxygen saturation cannot be interpreted reliably without understanding physical activity, posture, and environmental conditions. The analysis then develops an architectural perspective covering sensing, context inference, edge-cloud coordination, and adaptive fusion. Structural trade-offs are examined across centralized, edge-based, and hybrid designs. The paper further addresses robustness and drift under free-living conditions, including challenges introduced by physical activity intensity, skin tone, sensor displacement, and population heterogeneity. Special attention is given to fairness, bias, and equity implications because data-driven physiological models can reproduce structural disparities when training populations and deployment contexts differ. Policy, privacy, and regulatory dimensions are discussed in relation to medical device governance, health data stewardship, and large-scale population screening. The conclusion argues that future systems should treat context awareness not as a model-level correction but as a first-class architectural and governance principle. The paper contributes an interdisciplinary research synthesis for engineers, clinical informaticians, and policy researchers working on next-generation wearable health infrastructures.

References

1. Majumder, S., Mondal, T., & Deen, M. J. (2017). Wearable sensors for remote health monitoring. Sensors, 17(1), 130.

2. Gravina, R., Alinia, P., Ghasemzadeh, H., & Fortino, G. (2017). Multi-sensor fusion in body sensor networks: State-of-the-art and research challenges. Information Fusion, 35, 68-80.

3. Castaneda, D., Esparza, A., Ghamari, M., Soltanpur, C., & Nazeran, H. (2018). A review on wearable photoplethysmography sensors and their potential applications. Biosensors, 8(4), 87.

4. Koydemir, H. C., & Ozcan, A. (2018). Wearable and implantable sensors for biomedical applications. Annual Review of Analytical Chemistry, 11, 127-146.

5. Baca, A., Dabnichki, P., Heller, M., & Kornfeind, P. (2009). Ubiquitous computing in sports: A review and future trends. Sports Technology, 2(3-4), 87-98.

6. Ravi, N., Dandekar, N., Mysore, P., & Littman, M. L. (2005). Activity recognition from accelerometer data. In Proceedings of the Twentieth National Conference on Artificial Intelligence (pp. 1541-1546). AAAI Press.

7. Ordóñez, F. J., & Roggen, D. (2016). Deep convolutional and LSTM recurrent neural networks for multimodal wearable activity recognition. Sensors, 16(1), 115.

8. Chen, T., & Guestrin, C. (2016). XGBoost: A scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 785-794). ACM.

9. Reiss, A., & Stricker, D. (2012). Introducing a new benchmarked dataset for activity monitoring. In Proceedings of the 16th International Symposium on Wearable Computers (pp. 108-109). IEEE.

10. Slapničar, G., Mlakar, N., & Luštrek, M. (2019). Blood pressure estimation from photoplethysmography using a spectro-temporal deep neural network. Sensors, 19(15), 3420.

11. Satyanarayanan, M. (2017). The emergence of edge computing. Computer, 50(1), 30-39.

12. Ray, P. P., Dash, D., & De, D. (2019). Edge computing for Internet of Things: A survey. Journal of Network and Computer Applications, 131, 1-13.

13. Lazer, D., Kennedy, R., King, G., & Vespignani, A. (2014). The parable of Google Flu: Traps in big data analysis. Science, 343(6176), 1203-1205.

14. Zheng, X., Dwyer, V. M., Barrett, L. A., Derakhshani, M., & Hu, S. (2023). Rapid vital sign extraction for real-time opto-physiological monitoring at varying physical activity intensity levels. IEEE Journal of Biomedical and Health Informatics, 27(7), 3107-3118.

15. Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019). Dissecting racial bias in an algorithm used to manage the health of populations. Science, 366(6464), 447-453.

16. Vayena, E., Haeusermann, T., Adjekum, A., & Blasimme, A. (2018). Digital health: meeting the ethical and policy challenges. Swiss Medical Weekly, 148, w14571.

17. Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J., Appleton, G., Axton, M., Baak, A., & Mons, B. (2016). The FAIR Guiding Principles for scientific data management and stewardship. Scientific Data, 3, 160018.

18. Blumenthal, D., & Tavenner, M. (2010). The "meaningful use" regulation for electronic health records. New England Journal of Medicine, 363(6), 501-504.

19. Tison, G. H., Sanchez, J. M., Ballinger, B., Singh, A., Olgin, J. E., Pletcher, M. J., & Marcus, G. M. (2018). Passive detection of atrial fibrillation using a commercially available smartwatch. JAMA Cardiology, 3(5), 409-416.

20. Perez, M. V., Mahaffey, K. W., Hedlin, H., Rumsfeld, J. S., Garcia, A., Ferris, T., & Turakhia, M. P. (2019). Large-scale assessment of a smartwatch to identify atrial fibrillation. New England Journal of Medicine, 381(19), 1909-1917.

Downloads

Published

2026-07-04