Xin Liu

I am a 4th-year PhD candidate in the Paul G. Allen School of Computer Science & Engineering at the University of Washington, where I am advised by Shwetak Patel at UW, and also work closely with Daniel McDuff at Microsoft Research.

Besides my school research, I am also a part-time student researcher at Google Health where I am helping ship some mobile health technologies.

Before joining UW, I obtained my bachelor’s degree in computer science from the University of Massachusetts Amherst in 2018, where my advisor was Sunghoon Ivan Lee . While at UMass Amherst, I received a 21st Century Leaders Award, Rising Researcher Award, and Outstanding Undergraduate Achievement Award.

Email  /  CV  /  Bio  /  Google Scholar  /  Twitter  /  Github  /  Linkedin

Check out our Microsoft Research Webinar about non-contact health sensing!

profile photo
Work Experience
google_logo Consumer Health Research Team Research Intern + Part-time Student Researcher (Sep, 2021 - Present)
microsoft_logo Human Understanding and Empathy Group Research Intern (June, 2021 - Sep, 2021)
octoml_logo Machine Learning Systems Team Part-time Research Intern (Nov, 2020 - May, 2021)
ai2_logo Allen Institute for AI Research Intern (June, 2019 - Sep, 2019)
Publication

My research interests lie in the intersection of efficient machine learning, sensing and healthcare — bringing machine learning to edge and mobile devices to advance the state-of-the-art healthcare. Currently, my thesis research focuses on enabling accessible, equitable, and useful non-contact camera-based physiological sensing. See a full-list of publication at my Google Scholar.

RGB Camera-Based Physiological Sensing: Challenges and Future Directions
Xin Liu, Shwetak Patel, Daniel McDuff
Preprint
pdf / bibtex
Efficientphys: Enabling simple, fast and accurate camera-based vitals measurement
Xin Liu, Brian Hill, Ziheng Jiang, Shwetak Patel, Daniel McDuff
Preprint
pdf / bibtex
Learning Higher-Order Dynamics in Video-Based Cardiac Measurement
Brian Hill, Xin Liu, Daniel McDuff
Preprint
pdf / bibtex
Enabling Real-time On-chip Audio Super Resolution for Bone Conduction Microphones
Yuang Li, Yuntao Wang, Xin Liu, Yuanchun Shi, Shao-Fu Shih
Preprint
pdf / bibtex
Federated Remote Physiological Measurement with Imperfect Data
Xin Liu, Mingchuan Zhang, Ziheng Jiang, Shwetak Patel, Daniel McDuff
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshop, 2022
pdf / bibtex
Using High-Fidelity Avatars to Advance Camera-based Cardiac Pulse Measurement
Daniel McDuff, Javier Hernandez, Xin Liu, Josh Fromm, Erroll Wood, Tadas Baltrušaitis
IEEE Transactions on Biomedical Engineering (TBME 2022)
pdf / bibtex
MobilePhys: Personalized Mobile Camera-Based Contactless Physiological Sensing
Xin Liu, Yuntao Wang, Sinan Xie, Xiaoyu Zhang, Zixian Ma, Daniel McDuff, Shwetak Patel
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT/Ubicomp 2022)
pdf / bibtex
Beat-to-beat cardiac pulse rate measurement from video
Brian Hill, Xin Liu, Daniel McDuff
IEEE/CVF International Conference on Computer Vision Conference (ICCV Vision for Vitals (V4V) Workshop – 2nd Place)
pdf / bibtex
Synthetic Data for Multi-Parameter Camera-Based Physiological Sensing
Daniel McDuff, Xin Liu, Javier Hernandez, Josh Fromm, Erroll Wood, Tadas Baltrušaitis
IEEE Engineering in Medicine & Biology Society (EMBC 2021)
pdf / bibtex
Online Mobile App Usage as an Indicator of Sleep Behavior and Job Performance
Chunjong Park, Morelle Arian, Xin Liu, Leon Sasson, Jeffrey Kahn, Shwetak Patel, Alex Mariakakis, Tim Althoff
International World Wide Web Conference (WWW 2021)
pdf / bibtex
MetaPhys: Few-Shot Adaptation for Non-Contact Physiological Measurement
Xin Liu, Ziheng Jiang, Josh Fromm, Xuhai Xu, Shwetak Patel, Daniel McDuff
ACM Conference on Health, Inference, and Learning (ACM-CHIL 2021)
Selected Media: IEEE Spectrum , ACM TechNews , GeekWire , UW News
pdf / bibtex
SplitSR: An End-to-End Approach to Super-Resolution on Mobile Devices
Xin Liu, Yuang Li, Josh Fromm, Yuntao Wang, Ziheng Jiang, Alex Mariakakis, Shwetak Patel
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT/Ubicomp 2021)
pdf / bibtex
HulaMove: Using Commodity IMU for Waist Interaction
Xuhai Xu, Jiahao Li, Tianyi Yuan, Liang He, Xin Liu, Yukang Yan, Yuntao Wang, Yuanchun Shi, Jennifer Mankof, Anind K. Dey
ACM CHI Conference on Human Factors in Computing Systems (CHI 2021)
pdf / bibtex
Advancing Non-Contact Vital Sign Measurement using Synthetic Avatars
Daniel McDuff, Javier Hernandez, Xin Liu, Josh Fromm, Erroll Wood, Tadas Baltrušaitis
Preprint
pdf / bibtex
Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurement
Xin Liu, Josh Fromm, Shwetak Patel, Daniel McDuff
Conference on Neural Information Processing Systems (NeurIPS' 20)
Oral, Top 1%, 105 out of 9454 Submissions
Selected Media: Microsoft Research Webinar, Microsoft Research Blog, ZDNet
pdf / bibtex
A Novel Upper-Limb Function Measure Derived from Finger-Worn Sensor Data Collected in a Free-Living Setting
Sunghoon Ivan Lee , Xin Liu, Smita Rajan, Nathan Ramasarma, Eun Kyoung Choe, Paolo Bonato
PLoS One, 2019
pdf / bibtex
The Use of A Finger-Worn Accelerometer for Monitoring of Hand Use in Ambulatory Settings
Xin Liu, Smita Rajan, Nathan Ramasarma, Paolo Bonato and Sunghoon Ivan Lee
IEEE Journal of Biomedical and Health Informatics (J-BHI 2019)
Cover Article Nominee
pdf / bibtex
Finger-Worn Sensors for Accurate Functional Assessment of the Upper Limbs in Real-World Settings
Xin Liu, Smita Rajan, Nathan Ramasarma, Paolo Bonato and Sunghoon Ivan Lee
IEEE Engineering in Medicine & Biology Society (EMBC 2018)
pdf / bibtex

Teaching Experience

Winter 2021/2022 - TECHIN 513: Managing Data and Signal Processing, Graduate Teaching Assistant

Fall 2017 - CS328: Mobile Health & Sensing, Undergraduate Course Assistant
Outstanding Course Assistant Award

Misc.

During my undergraduate studies, I spent a huge amount of effort to push the international community to engage various leadership experiences at the university. I was the first international peer mentor in the residential life office and the first international student consultant in the department of information and technology. I worked at six different departments during my undergrd years :p

During my free time, I enjoy snowboarding, climbing and playing tennis with my partner. I am also a big fan of NBA.


Website Credits to Jon Barron source code and Siddhartha Gairola source code