ViTAL Lab Computational Behavior and Health Analytics

Publications

2024

Detecting Cognitive Impairment and Psychological Well-being among Older Adults Using Facial, Acoustic, Linguistic, and Cardiovascular Patterns Derived from Remote Conversations
Detecting Cognitive Impairment and Psychological Well-being among Older Adults Using Facial, Acoustic, Linguistic, and Cardiovascular Patterns Derived from Remote Conversations
Xiaofan Mu, Salman Seyedi, Iris Zheng, Zifan Jiang, Liu Chen, ..., Rachel Hershenberg, Allan I. Levey, Gari D. Clifford, Hiroko H. Dodge, Hyeokhyen Kwon
arXiv   ·   20 Dec 2024   ·   arxiv:2412.14194
Classifying Simulated Gait Impairments using Privacy-preserving Explainable Artificial Intelligence and Mobile Phone Videos
Classifying Simulated Gait Impairments using Privacy-preserving Explainable Artificial Intelligence and Mobile Phone Videos
Lauhitya Reddy, Ketan Anand, Shoibolina Kaushik, Corey Rodrigo, J. Lucas McKay, Trisha M. Kesar, Hyeokhyen Kwon
arXiv   ·   03 Dec 2024   ·   arxiv:2412.01056
IMUGPT 2.0: Language-Based Cross Modality Transfer for Sensor-Based Human Activity Recognition
IMUGPT 2.0: Language-Based Cross Modality Transfer for Sensor-Based Human Activity Recognition
Zikang Leng, Amitrajit Bhattacharjee, Hrudhai Rajasekhar, Lizhe Zhang, Elizabeth Bruda, Hyeokhyen Kwon, Thomas Plötz
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies   ·   22 Aug 2024   ·   doi:10.1145/3678545
Feasibility of assessing cognitive impairment via distributed camera network and privacy-preserving edge computing
Feasibility of assessing cognitive impairment via distributed camera network and privacy-preserving edge computing
Chaitra Hegde, Yashar Kiarashi, Allan I Levey, Amy D Rodriguez, Hyeokhyen Kwon, Gari D Clifford
arXiv   ·   21 Aug 2024   ·   arxiv:2408.10442
Explainable Artificial Intelligence for Quantifying Interfering and High-Risk Behaviors in Autism Spectrum Disorder in a Real-World Classroom Environment Using Privacy-Preserving Video Analysis
Explainable Artificial Intelligence for Quantifying Interfering and High-Risk Behaviors in Autism Spectrum Disorder in a Real-World Classroom Environment Using Privacy-Preserving Video Analysis
Barun Das, Conor Anderson, Tania Villavicencio, Johanna Lantz, Jenny Foster, Theresa Hamlin, Ali Bahrami Rad, Gari D. Clifford, Hyeokhyen Kwon
arXiv   ·   01 Aug 2024   ·   arxiv:2407.21691
Development of a Tremor Detection Algorithm for Use in an Academic Movement Disorders Center
Development of a Tremor Detection Algorithm for Use in an Academic Movement Disorders Center
Mark Saad, Sofia Hefner, Suzann Donovan, Doug Bernhard, Richa Tripathi, ..., Jeanne M. Powell, Hyeokhyen Kwon, Reza Sameni, Christine D. Esper, J. Lucas McKay
Sensors   ·   31 Jul 2024   ·   doi:10.3390/s24154960
Evaluating and mitigating unfairness in multimodal remote mental health assessments
Evaluating and mitigating unfairness in multimodal remote mental health assessments
Zifan Jiang, Salman Seyedi, Emily Griner, Ahmed Abbasi, Ali Bahrami Rad, Hyeokhyen Kwon, Robert O. Cotes, Gari D. Clifford
PLOS Digital Health   ·   24 Jul 2024   ·   doi:10.1371/journal.pdig.0000413
Multimodal Mental Health Digital Biomarker Analysis From Remote Interviews Using Facial, Vocal, Linguistic, and Cardiovascular Patterns
Multimodal Mental Health Digital Biomarker Analysis From Remote Interviews Using Facial, Vocal, Linguistic, and Cardiovascular Patterns
Zifan Jiang, Salman Seyedi, Emily Griner, Ahmed Abbasi, Ali Bahrami Rad, Hyeokhyen Kwon, Robert O. Cotes, Gari D. Clifford
IEEE Journal of Biomedical and Health Informatics   ·   01 Mar 2024   ·   doi:10.1109/JBHI.2024.3352075
Indoor Group Identification and Localization Using Privacy-Preserving Edge Computing Distributed Camera Network
Indoor Group Identification and Localization Using Privacy-Preserving Edge Computing Distributed Camera Network
Chaitra Hegde, Yashar Kiarashi, Amy D. Rodriguez, Allan I. Levey, Matthew Doiron, Hyeokhyen Kwon, Gari D. Clifford
IEEE Journal of Indoor and Seamless Positioning and Navigation   ·   01 Jan 2024   ·   doi:10.1109/JISPIN.2024.3354248
Website

2023

Graph Trilateration for Indoor Localization in Sparsely Distributed Edge Computing Devices in Complex Environments Using Bluetooth Technology
Graph Trilateration for Indoor Localization in Sparsely Distributed Edge Computing Devices in Complex Environments Using Bluetooth Technology
Yashar Kiarashi, Soheil Saghafi, Barun Das, Chaitra Hegde, Venkata Siva Krishna Madala, ..., Matthew Doiron, Amy D. Rodriguez, Allan I. Levey, Gari D. Clifford, Hyeokhyen Kwon
Sensors   ·   30 Nov 2023   ·   doi:10.3390/s23239517
FingerSpeller: Camera-Free Text Entry Using Smart Rings for American Sign Language Fingerspelling Recognition
FingerSpeller: Camera-Free Text Entry Using Smart Rings for American Sign Language Fingerspelling Recognition
David Martin, Zikang Leng, Tan Gemicioglu, Jon Womack, Jocelyn Heath, William C Neubauer, Hyeokhyen Kwon, Thomas Ploetz, Thad Starner
The 25th International ACM SIGACCESS Conference on Computers and Accessibility   ·   22 Oct 2023   ·   doi:10.1145/3597638.3614491
On the Benefit of Generative Foundation Models for Human Activity Recognition
On the Benefit of Generative Foundation Models for Human Activity Recognition
Zikang Leng, Hyeokhyen Kwon, Thomas Plötz
arXiv   ·   19 Oct 2023   ·   arxiv:2310.12085
Classifying Tremor Dominant and Postural Instability and Gait Difficulty Subtypes of Parkinson’s Disease from Full-Body Kinematics
Classifying Tremor Dominant and Postural Instability and Gait Difficulty Subtypes of Parkinson’s Disease from Full-Body Kinematics
N. Jabin Gong, Gari D. Clifford, Christine D. Esper, Stewart A. Factor, J. Lucas McKay, Hyeokhyen Kwon
Sensors   ·   09 Oct 2023   ·   doi:10.3390/s23198330
On the Utility of Virtual On-body Acceleration Data for Fine-grained Human Activity Recognition
On the Utility of Virtual On-body Acceleration Data for Fine-grained Human Activity Recognition
Zikang Leng, Yash Jain, Hyeokhyen Kwon, Thomas Ploetz
Proceedings of the 2023 International Symposium on Wearable Computers   ·   08 Oct 2023   ·   doi:10.1145/3594738.3611364
Generating Virtual On-body Accelerometer Data from Virtual Textual Descriptions for Human Activity Recognition
Generating Virtual On-body Accelerometer Data from Virtual Textual Descriptions for Human Activity Recognition
Zikang Leng, Hyeokhyen Kwon, Thomas Ploetz
Proceedings of the 2023 International Symposium on Wearable Computers   ·   08 Oct 2023   ·   doi:10.1145/3594738.3611361
Website
🏆 Best Paper Finalist and Honorable Mention in Ubicomp/ISWC 2023
Leveraging WiFi network logs to infer student collocation and its relationship with academic performance
Leveraging WiFi network logs to infer student collocation and its relationship with academic performance
Vedant Das Swain, Hyeokhyen Kwon, Sonia Sargolzaei, Bahador Saket, Mehrab Bin Morshed, ..., Joshua Philipose, Yulai Cui, Thomas Plötz, Munmun De Choudhury, Gregory D. Abowd
EPJ Data Science   ·   07 Jul 2023   ·   doi:10.1140/epjds/s13688-023-00398-2
Phenotyping Motor-subtypes of Parkinsonism from Full-body Kinematics using Machine Learning (P6-11.007)
Phenotyping Motor-subtypes of Parkinsonism from Full-body Kinematics using Machine Learning (P6-11.007)
Naiji Gong, Hyeokhyen Kwon, Gari Clifford, Christine Esper, Stewart Factor, Johnathan McKay
Neurology   ·   25 Apr 2023   ·   doi:10.1212/WNL.0000000000203887
Data-Driven Discovery of Novel Motor Biomarkers for Freezing-of-Gait in Parkinsonism from Full-body Kinematics using Artificial Intelligence (P6-11.001)
Data-Driven Discovery of Novel Motor Biomarkers for Freezing-of-Gait in Parkinsonism from Full-body Kinematics using Artificial Intelligence (P6-11.001)
Hyeokhyen Kwon, Gari Clifford, Christine Esper, Stewart Factor, Johnathan McKay
Neurology   ·   25 Apr 2023   ·   doi:10.1212/WNL.0000000000203857
An Explainable Spatial-Temporal Graphical Convolutional Network to Score Freezing of Gait in Parkinsonian Patients
An Explainable Spatial-Temporal Graphical Convolutional Network to Score Freezing of Gait in Parkinsonian Patients
Hyeokhyen Kwon, Gari D. Clifford, Imari Genias, Doug Bernhard, Christine D. Esper, Stewart A. Factor, J. Lucas McKay
Sensors   ·   04 Feb 2023   ·   doi:10.3390/s23041766
🏆 Finalist for the Oracle for Research Fellows program 🏆 Oracle for Research Project Award
A Feasibility Study on Indoor Localization and Multiperson Tracking Using Sparsely Distributed Camera Network With Edge Computing
A Feasibility Study on Indoor Localization and Multiperson Tracking Using Sparsely Distributed Camera Network With Edge Computing
Hyeokhyen Kwon, Chaitra Hegde, Yashar Kiarashi, Venkata Siva Krishna Madala, Ratan Singh, ..., Craig M. Zimring, Matthew Doiron, Amy D. Rodriguez, Allan I. Levey, Gari D. Clifford
IEEE Journal of Indoor and Seamless Positioning and Navigation   ·   01 Jan 2023   ·   doi:10.1109/JISPIN.2023.3337189

2022

On the Effectiveness of Virtual IMU Data for Eating Detection with Wrist Sensors
On the Effectiveness of Virtual IMU Data for Eating Detection with Wrist Sensors
Yash Jain, Hyeokhyen Kwon, Thomas Ploetz
Proceedings of the 2022 ACM International Joint Conference on Pervasive and Ubiquitous Computing   ·   11 Sep 2022   ·   doi:10.1145/3544793.3560337

2021

Complex Deep Neural Networks from Large Scale Virtual IMU Data for Effective Human Activity Recognition Using Wearables
Complex Deep Neural Networks from Large Scale Virtual IMU Data for Effective Human Activity Recognition Using Wearables
Hyeokhyen Kwon, Gregory D. Abowd, Thomas Plötz
Sensors   ·   13 Dec 2021   ·   doi:10.3390/s21248337
Can You See It? Good, So We Can Sense It!
Can You See It? Good, So We Can Sense It!
Hyeokhyen Kwon, Catherine Tong, Harish Haresamudram, Yan Gao, Gregory D. Abowd, Nicholas D. Lane, Thomas Ploetz
GetMobile: Mobile Computing and Communications   ·   14 Sep 2021   ·   doi:10.1145/3486880.3486891
Approaching the real-world: Supporting activity recognition training with virtual imu data
Approaching the real-world: Supporting activity recognition training with virtual imu data
Hyeokhyen Kwon, Bingyao Wang, Gregory D. Abowd, Thomas Plötz
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies   ·   09 Sep 2021   ·   doi:10.1145/3478096
Website
🏆 Finalist for Gaetano Borriello Outstanding Student Award at Ubicomp 2021
Personalization Models for Human Activity Recognition with Distribution Matching-Based Metrics
Personalization Models for Human Activity Recognition with Distribution Matching-Based Metrics
Huy Thong Nguyen, Hyeokhyen Kwon, Harish Haresamudram, Andrew F. Peterson, Thomas Plötz
Deep Learning for Human Activity Recognition Second International Workshop, DL-HAR 2020, Held in Conjunction with IJCAI-PRICAI 2020   ·   01 Jan 2021   ·   doi:10.1007/978-981-16-0575-8_4

2020

IMUTube: Automatic Extraction of Virtual on-body Accelerometry from Video for Human Activity Recognition.
IMUTube: Automatic Extraction of Virtual on-body Accelerometry from Video for Human Activity Recognition.
Hyeokhyen Kwon, Catherine Tong, Harish Haresamudram, Yan Gao, Gregory D. Abowd, Nicholas D. Lane, Thomas Plötz
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies   ·   04 Sep 2020   ·   doi:10.1145/3411841
Website
🏆 Oracle for Research Project Award 💡 Patent published.

2019

Handling annotation uncertainty in human activity recognition
Handling annotation uncertainty in human activity recognition
Hyeokhyen Kwon, Gregory D. Abowd, Thomas Plötz
Proceedings of the 23rd International Symposium on Wearable Computers   ·   09 Sep 2019   ·   doi:10.1145/3341163.3347744
Website

2018

Adding structural characteristics to distribution-based accelerometer representations for activity recognition using wearables
Adding structural characteristics to distribution-based accelerometer representations for activity recognition using wearables
Hyeokhyen Kwon, Gregory D. Abowd, Thomas Plötz
Proceedings of the 2018 ACM International Symposium on Wearable Computers   ·   08 Oct 2018   ·   doi:10.1145/3267242.3267258
Website

2015

RGB-Guided Hyperspectral Image Upsampling
RGB-Guided Hyperspectral Image Upsampling
Hyeokhyen Kwon, Yu-Wing Tai
2015 IEEE International Conference on Computer Vision (ICCV)   ·   01 Dec 2015   ·   doi:10.1109/ICCV.2015.43
Data-driven depth map refinement via multi-scale sparse representation
Data-driven depth map refinement via multi-scale sparse representation
HyeokHyen Kwon, Yu-Wing Tai, Stephen Lin
2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)   ·   01 Jun 2015   ·   doi:10.1109/CVPR.2015.7298611