Jingyu Shi

me2.png

About Me


I am a Research Scientist at Meta Reality Labs in the XR Codec Interaction and Avatar (XRCIA) Action Decoder team.

I earned my Ph.D. in Electrical and Computer Engineering from Purdue University, under the supervision of Prof. Karthik Ramani. I obtained my M.S. degree in ECE in Georgia Institute of Technology, working with Prof. Patricio Vela. Prior to that, I studied Instrument Science and Technology in Beihang University and became a B.Eng.

My research interests lie in the intersection of AI and HCI. Specifically, I study applied CVML algorithms and their applications across various platforms including AR, MR, Robots, etc. I enjoy building interactive systems that utilize the state-of-the-art AI algorithms and designing user-friendly interactions to deploy the AI in real world applications.

Google Scholar / Resume / LinkedIn

Academic Services

[Conference Reviewer] ICCV 2025, CHI 2024-2025, UIST 2024-2025, IEEE VR 2024-2025, CHI LBW 2024, CSCW 2024, DIS 2024, proudly, all with multiple special recognitions and commendations.

[Journal Reviewer] IEEE RAL, IEEE TVCG, ACM TOCHI

[Mentoring] Graduate Mentor at Summer Underdergrad Research Fellowship (SURF) 2023 for Hyungjun Doh and Heesoo Kim.

Honors and Awards

[2024] Outstanding Intern Award, Futurewei Technologies Inc.

[2018] Chinese Scholarship Council (CSC) Scholarship for Distinguished Undergraduate International Exchange Program

[2018] First prize of the 28th Feng Ru Cup Competition of Academic and Technological Works (top1%), Beihang University

[2017] Second prize of the 27th Feng Ru Cup Competition of Academic and Technological Works, Beihang University

news

Oct 08, 2025 One paper got accepted to TMLR.
Aug 25, 2025 I am now working for Meta Reality Labs as a Research Scientist.
Jul 23, 2025 I successfully defended my Ph.D. dissertation today.
Jul 04, 2025 One paper was accepted to UIST 2025
Apr 30, 2025 I will defend my PhD in the summer and join Meta Reality Lab as a Research Scientist, starting August 2025.

latest posts

Sep 24, 2025 On Traveling
Jun 15, 2024 Fighting the Imposter Syndrome
Nov 19, 2023 ChatGPT as a Reviewer

selected publications

  1. occludenerf.png
    OccludeNeRF: Geometry-aware 3D Scene Inpainting with Collaborative Score Distillation in NeRF
    Jingyu Shi, Achleshwar Luthra , Jiazhi Li , and 5 more authors
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , Mar 2025
  2. caring.png
    CARING-AI: Towards Authoring Context-aware Augmented Reality INstruction through Generative Artificial Intelligence
    Jingyu Shi*, Rahul Jain* , Seunggeun Chi* , and 4 more authors
    In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems , Jan 2025
  3. transparent.png
    Transparent Barriers: Natural Language Access Control Policies for XR-Enhanced Everyday Objects
    Kentaro Taninaka , Rahul Jain , Jingyu Shi, and 2 more authors
    In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems , Jan 2025
  4. ooi.png
    Interacting objects: A dataset of object-object interactions for richer dynamic scene representations
    Asim Unmesh , Rahul Jain , Jingyu Shi, and 5 more authors
    IEEE Robotics and Automation Letters, Oct 2023
  5. hgenai.jpg
    An HCI-Centric Survey and Taxonomy of Human-Generative-AI Interactions
    Jingyu Shi*, Rahul Jain* , Hyungjun Doh , and 2 more authors
    arXiv preprint arXiv:2310.07127, Jan 2024
  6. ubitouch.png
    Ubi-TOUCH: Ubiquitous Tangible Object Utilization through Consistent Hand-object interaction in Augmented Reality
    Rahul Jain* , Jingyu Shi*, Runlin Duan , and 3 more authors
    In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology , Oct 2023
  7. ubiedge.jpg
    Ubi Edge: Authoring Edge-Based Opportunistic Tangible User Interfaces in Augmented Reality
    Fengming He , Xiyun Hu , Jingyu Shi, and 3 more authors
    In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems , May 2023