Jingyu Shi
About Me
I am a Research Scientist at Meta Reality Labs Research.
I earned my Ph.D. in Electrical and Computer Engineering from Purdue University, under the supervision of Prof. Karthik Ramani. I obtained my M.S. degree in ECE in Georgia Institute of Technology, working with Prof. Patricio Vela. Prior to that, I studied Instrument Science and Technology in Beihang University and became a B.Eng.
My research interests lie in the intersection of AI and HCI. I work on multi-modal language models and embodied intelligence, as well as the interaction design of their applications.
news
| Nov 09, 2025 | One paper was accepted to 3DV 2025. |
|---|---|
| Oct 08, 2025 | One paper got accepted to TMLR. |
| Aug 25, 2025 | I am now working for Meta Reality Labs as a Research Scientist. |
| Jul 23, 2025 | I successfully defended my Ph.D. dissertation today. |
| Jul 04, 2025 | One paper was accepted to UIST 2025 |
latest posts
| Apr 07, 2026 | Maturity |
|---|---|
| Nov 27, 2025 | When the Gradients of Youth Fade, I Pause the Update of My Dreams |
| Sep 24, 2025 | On Traveling |
selected publications
-
OccludeNeRF: Geometry-aware 3D Scene Inpainting with Collaborative Score Distillation in NeRFIn Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , Mar 2025 -
CARING-AI: Towards Authoring Context-aware Augmented Reality INstruction through Generative Artificial IntelligenceIn Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems , Jan 2025 -
Transparent Barriers: Natural Language Access Control Policies for XR-Enhanced Everyday ObjectsIn Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems , Jan 2025 -
Interacting objects: A dataset of object-object interactions for richer dynamic scene representationsIEEE Robotics and Automation Letters, Oct 2023 -
An HCI-Centric Survey and Taxonomy of Human-Generative-AI InteractionsarXiv preprint arXiv:2310.07127, Jan 2024 -
Ubi-TOUCH: Ubiquitous Tangible Object Utilization through Consistent Hand-object interaction in Augmented RealityIn Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology , Oct 2023 -
Ubi Edge: Authoring Edge-Based Opportunistic Tangible User Interfaces in Augmented RealityIn Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems , May 2023