2022

 

Objective Measurement of Hyperactivity Using Mobile Sensing and Machine Learning: A Pilot Study

Oliver Lindhiem, Mayank Goel, Sam Shaaban, Kristie Mak, Prerna Chikersal, Jamie Feldman, Jordan Harris
JMIR Formative Research (JFR)
PDF

 

FitNibble: A Field Study to Evaluate the Utility and Usability of Automatic Diet Monitoring in Food Journaling Using an Eyeglasses-based Wearable.

Abdelkareem Bedri, Yuchen Liang, Sudershan Boovaraghavan, Geoff Kaufman, Mayank Goel
Proceedings of the Annual Conference on Intelligent User Interfaces (IUI)
PDF Video Code

2021

 

IMU2Doppler: Cross-Modal Domain Adaptation for Doppler-based Activity Recognition Using IMU Data

Sejal Bhalla, Mayank Goel, Rushil Khurana
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT)
PDF Video

 

TouchPose: Hand Pose Prediction, Depth Estimation, and Touch Classification from Capacitive Images

Karan Ahuja, Paul Streli, Christian Holz
Proceedings of User Interface Software and Technology (UIST)
PDF Video

 

EyeMU Interactions: Gaze + IMU Gestures on Mobile Devices

Andy Kong, Karan Ahuja, Mayank Goel, Chris Harrison
Proceedings of the International Conference on Multimodal Interaction (ICMI)
PDF Video

 

Vid2Doppler: Synthesizing Doppler Radar Data from Videos for Training Privacy-Preserving Activity Recognition

Karan Ahuja, Yue Jiang, Mayank Goel, Chris Harrison
Proceedings of the Annual ACM Conference on Human Factors in Computing Systems (CHI)
PDF Video

 

Pose-on-the-Go: Approximating User Pose with Smartphone Sensor Fusion and Inverse Kinematics

Karan Ahuja, Sven Mayer, Mayank Goel, Chris Harrison
Proceedings of the Annual ACM Conference on Human Factors in Computing Systems (CHI)
PDF Video

 

Classroom Digital Twins with Instrumentation-Free Gaze Tracking

Karan Ahuja, Deval Shah, Sujeath Pareddy, Franceska Xhakaj, Amy Ogan, Yuvraj Agarwal, Chris Harrison
Proceedings of the Annual ACM Conference on Human Factors in Computing Systems (CHI)
PDF Video

 

CoolMoves: User Motion Accentuation in Virtual Reality

Karan Ahuja, Eyal Ofek, Mar Gonzalez-Franco, Christian Holz, Andrew D. Wilson
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT)
PDF

2020

 

Detecting Depression and Predicting its Onset Using Longitudinal Symptoms Captured by Passive Sensing: A Machine Learning Approach With Robust Feature Selection.

Prerna Chikersal, Afsaneh Doryab, Michael Tumminia, Daniella K. Villalba, Janine M. Dutcher, Xinwen Liu, Sheldon Cohen, Kasey G. Creswell, Jennifer Mankoff, J. David Creswell, Mayank Goel, Anind Dey
ACM Transactions on Computer-Human Interaction (TOCHI)
PDF

 

BodySLAM: Opportunistic User Digitization in Multi-User AR/VR Experiences

Karan Ahuja, Mayank Goel, Chris Harrison
Proceedings of SUI 2020
PDF Video

 

Direction-of-Voice (DoV) Estimation for Intuitive Speech Interaction with Smart Devices Ecosystems

Karan Ahuja, Andy Kong, Mayank Goel, Chris Harrison
Proceedings of UIST 2020
PDF Video

 

Understanding Client Support Strategies to Improve Clinical Outcomes in an Online Mental Health Intervention

Prerna Chikersal, Danielle Belgrave, Gavin Doherty, Angel Enrique, Jorge E. Palacios, Derek Richards, Anja Thieme
Proceedings of the Annual ACM Conference on Human Factors in Computing Systems (CHI)
PDF Video

 

Eyes on the Road: Detecting Phone Usage by Drivers Using On-Device Cameras

Rushil Khurana, Mayank Goel
Proceedings of the Annual ACM Conference on Human Factors in Computing Systems (CHI)
PDF Video

 

Beyond the Prototype: Understanding the Challenge of Scaling Hardware Device Production

Rushil Khurana, Steve Hodges
Proceedings of the Annual ACM Conference on Human Factors in Computing Systems (CHI), Best Paper Award
PDF

 

Digital Ventriloquism: Giving Voice to Everyday Objects

Yasha Iravantchi, Mayank Goel, Chris Harrison
Proceedings of the Annual ACM Conference on Human Factors in Computing Systems (CHI)
PDF Video

 

FitByte: Automatic Diet Monitoring in Unconstrained Situations Using Multimodal Sensing on Eyeglasses.

Abdelkareem Bedri, Diana Li, Rushil Khurana, Kunal Bhuwalka, Mayank Goel
Proceedings of the Annual ACM Conference on Human Factors in Computing Systems (CHI)
PDF Video Dataset

2019

 

MeCap: Whole-Body Digitization for Low-Cost VR/AR Headsets

Karan Ahuja, Chris Harrison, Mayank Goel, Robert Xiao
UIST 2019, Honorable Mention Award
PDF Video

 

LightAnchors: Appropriating Point Lights for Spatially-Anchored Augmented Reality Interfaces

Karan Ahuja, Sujeath Pareddy, Robert Xiao, Mayank Goel, Chris Harrison
Proceedings of UIST 2019
PDF Video

 

Detachable Smartwatch: More Than A Wearable

Rushil Khurana, Mayank Goel, Kent Lyons
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2019
PDF Video

 

Interferi: Gesture Sensing using On-Body Acoustic Interferometry

Yasha Iravantchi, Yang Zhang, Evi Bernitsas, Mayank Goel, Chris Harrison
Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19), 2019, Honorable Mention Award
PDF Video

 

BeamBand: Hand Gesture Sensing with Ultrasonic Beamforming

Yasha Iravantchi, Mayank Goel, Chris Harrison
Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19), 2019
PDF Video

 

GymCam: Detecting, recognizing, and tracking simultaneous exercises in unconstrained scenes

Rushil Khurana, Karan Ahuja, Zac Yu, Jennifer Mankoff, Chris Harrison, Mayank Goel
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2019
PDF Video

 

Challenges in Realizing Smartphone-based Health Sensing

Alex Mariakakis, Edward J. Wang, Shwetak Patel, Mayank Goel
IEEE Pervasive 2019, Best Paper Award Runner-Up
PDF

2018

 

RainCheck: Overcoming Capacitive Interference Caused by Rainwater on Smartphones

Ying-Chao Tung, Mayank Goel, Isaac Zinda, Jacob Wobbrock
International Conference on Multimodal Interaction (ICMI) 2018
PDF

 

Ubicoustics: Plug-and-Play Acoustic Activity Recognition

Gierad Laput, Karan Ahuja, Mayank Goel, Chris Harrison
Conference on Human Factors in Computing Systems (CHI), 2016
PDF Video Code

 

In only 3 minutes: perceived exertion limits of smartwatch use

Rushil Khurana, Nikola Banovic, Kent Lyons
International Symposium on Wearable Computers (ISWC), 2018
PDF

 

EyeSpyVR: Interactive Eye Sensing Using Off-the-Shelf, Smartphone-Based VR Headsets

Karan Ahuja, Rahul Islam, Varun Parashar, Kuntal Dey, Chris Harrison, Mayank Goel
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2018
PDF Video

2017

 

Carpacio: Repurposing Capacitive Sensors to Distinguish Driver and Passenger Touches on In-Vehicle Screens

Edward Wang, Jake Garrison, Eric Whitmire, Mayank Goel, Shwetak Patel
30th Annual ACM Symposium on User Interface Software and Technology (UIST), 2017
PDF Video

 

EarBit: using wearable sensors to detect eating episodes in unconstrained environments

Abdelkareem Bedri, Richard Li, Malcolm Haynes, Raj Prateek Kosaraju, Ishaan Grover, Temiloluwa Prioleau, Min Yan Beh, Mayank Goel, Thad Starner, Gregory Abowd
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2017
PDF

 

DigiTouch: Reconfigurable Thumb-to-Finger Input and Text Entry on Head-mounted Displays

Eric Whitmire, Mohit Jain, Divye Jain, Greg Nelson, Ravi Karkar, Shwetak Patel, Mayank Goel
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2017
PDF Video

 

Use of a smartphone app to assess neonatal jaundice

James A. Taylor, James W. Stout, Lilian de Greef, Mayank Goel, Shwetak Patel, Esther K. Chung, Aruna Koduri, Shawn McMahon, Jane Dickerson, Elizabeth A. Simpson, Eric Larson
Pediatrics Sep 2017
PDF Video

2016

 

Design and Learnability of Vortex Whistles for Managing Chronic Lung Function via Smartphones

Spencer Kaiser, Ashley Parks, Patrick Leopard, Charlie Albright, Jake Carlson, Mayank Goel, Damoun Nassehi, Eric Larson
Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16)
PDF

 

SpiroCall: Measuring Lung Function over a Phone Call

Mayank Goel, Elliot Saba, Maia Stiber, Eric Whitmire, Josh Fromm, Eric Larson, Gaetano Borriello, Shwetak Patel
Conference on Human Factors in Computing Systems (CHI), 2016, Honorable Mention Award
PDF Video

2015

 

MagnifiSense: Inferring Device Interaction Using Wrist-worn Passive Magneto-inductive Sensors

Edward Wang, Tien-Jui Lee, Alex Mariakakis, Mayank Goel, Sidhant Gupta, Shwetak Patel
ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), 2015
PDF

 

HyperCam: Hyperspectral Imaging for Ubiquitous Computing Applications

Mayank Goel, Eric Whitmire, Alex Mariakakis, Scott Saponas, Neel Joshi, Dan Morris, Brian Guenter, Marcel Gavriliu, Gaetano Borriello, Shwetak Patel
2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '15), Honorable Mention Award
PDF Video

 

Tongue-in-Cheek: Using Wireless Signals to Enable Non-Intrusive and Flexible Facial Gestures Detection

Mayank Goel, Chen Zhao, Ruth Vinisha, Shwetak Patel
Conference on Human Factors in Computing Systems (CHI), 2015, Honorable Mention Award
PDF Video

 

SwitchBack: Using Focus and Saccade Tracking to Guide Users’ Attention for Mobile Task Resumption

Alex Mariakakis, Mayank Goel, Md. Tanvir Islam Aumi, Shwetak Patel, Jacob Wobbrock
Conference on Human Factors in Computing Systems (CHI), 2015
PDF

 

Wibreathe: Estimating respiration rate using wireless signals in natural settings in the home

Ruth Vinisha Ravichandran, Elliot Saba, Ke-Yu Chen, Mayank Goel, Sidhant Gupta, Shwetak Patel
IEEE International Conference on Pervasive Computing and Communications (PerCom), 2015, Best Paper Runner-up
PDF

2014

 

BiliCam: Using Mobile Phones to Monitor Newborn Jaundice

Lilian de Greef, Mayank Goel, Min Joon Seo, Eric Larson, James W. Stout, James A. Taylor, Shwetak Patel
ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), 2014, Honorable Mention Award
PDF Video

 

AirLink: Sharing Files Between Multiple Devices Using In-air Gestures

Ke-Yu Chen, Daniel Ashbrook, Mayank Goel, Sung-Hyuck Lee, Shwetak Patel
ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) 2014
PDF Video

 

SurfaceLink: Using Inertial and Acoustic Sensing to Enable Multi-device Interaction on a Surface

Mayank Goel, Brendan Lee, Md. Tanvir Islam Aumi, Shwetak Patel, Gaetano Borriello, Stacie Hibino, Bo Begole
Conference on Human Factors in Computing Systems (CHI), 2014
PDF Video

2013

 

DopLink: Using the Doppler Effect for Multi-device Interaction

Md. Tanvir Islam Aumi, Sidhant Gupta, Mayank Goel, Eric Larson, Shwetak Patel
ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), 2013
PDF Video

 

ContextType: Using Hand Posture Information to Improve Mobile Touch Screen Text Entry

Mayank Goel, Alex Jansen, Travis Mandel, Shwetak Patel, Jacob O. Wobbrock
Conference on Human Factors in Computing Systems (CHI), 2013
PDF

 

Tracking Lung Function on Any Phone

Eric Larson, Mayank Goel, Morgan Redfield, Gaetano Boriello, Margaret Rosenfeld, Shwetak Patel
ACM DEV '13
PDF

2012

 

GripSense: Using Built-in Sensors to Detect Hand Posture and Pressure on Commodity Mobile Phones

Mayank Goel, Jacob Wobbrock, Shwetak Patel
ACM symposium on User Interface Software and Technology (UIST), 2012
PDF Video

 

SpiroSmart: Using a Microphone to Measure Lung Function on a Mobile Phone

Mayank Goel, Eric Larson, Gaetano Boriello, Sonya Heltshe, Margaret Rosenfeld, Shwetak Patel
ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), 2012, Honorable Mention Award
PDF

 

WalkType: using accelerometer data to accomodate situational impairments in mobile touch screen text entry

Mayank Goel, Leah Findlater, Jacob Wobbrock
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI), 2012, Honorable Mention
PDF

 

Open data kit sensors: a sensor integration framework for android at the application-level

Waylon Brunette, Rita Sodt, Rohit Chaudhri, Mayank Goel, Michael Falcone, Jaylen Van Orden, Gaetano Borriello
Proceedings of the 10th international conference on Mobile systems, applications, and services, 2012
PDF

 

Open Data Kit Sensors: Mobile Data Collection with Wired and Wireless Sensors

Rohit Chaudhri, Waylon Brunette, Mayank Goel, Rita Sodt, Jaylen Van Orden, Michael Falcone, Gaetano Borriello
ACM DEV '12 Proceedings of the 2nd ACM Symposium on Computing for Development, 2012
PDF