Jingyu Shi

me2.png

Mechanical Engieering Building, Room 3164

585 Purdue Mall Dr.

West Lafayette, IN, 47906

About Me


I am a Ph.D. candidate (5-th year) in Electrical and Computer Engineering from Purdue University, under the supervision of Prof. Karthik Ramani. I obtained my M.S. degree in ECE in Georgia Institute of Technology, working with Prof. Patricio Vela. Prior to that, I studied Instrument Science and Technology in Beihang University and became a B.Eng.

My research interests lie in the intersection of Artificial Intelligence (AI) and Human-Computer-Interaction (HCI). Specifically, I study applied machine learning/deep learning algorithms and their applications across various platforms including Augmented Reality (AR), Mixed Reality (MR), Robots, etc. I enjoy building interactive systems that utilize the state-of-the-art AI algorithms, as much as I enjoy designing user-friendly interactions to deploy the AI in real world applications. Currently, I am studying the deployment and interaction design of generative AI in AR applications.

Google Scholar / Resume / LinkedIn

Academic Services

[Conference Reviewer] ICCV 2025, CHI 2025, 2024, IEEE VR 2025, 2024, CHI 2024 LBW, CSCW 2024, DIS 2024, proudly, all with multiple special recognitions and commendations.

[Journal Reviewer] IEEE RAL, IEEE TVCG, ACM TOCHI

[Mentoring] Graduate Mentor at Summer Underdergrad Research Fellowship (SURF) 2023 for Hyungjun Doh and Heesoo Kim.

Honors and Awards

[2024] Outstanding Intern Award, Futurewei Technologies Inc.

[2018] Chinese Scholarship Council (CSC) Scholarship for Distinguished Undergraduate International Exchange Program

[2018] First prize of the 28th Feng Ru Cup Competition of Academic and Technological Works (top1%), Beihang University

[2017] Second prize of the 27th Feng Ru Cup Competition of Academic and Technological Works, Beihang University

news

Apr 17, 2025 One paper got accepted to CVPR 25 CV4METAVERSE Workshop. One paper got accepted to DIS 25. One poster for I3D 25 too.
Jan 17, 2025 One co-authored paper and one first-authored paper were accepted in CHI 2025!
Dec 17, 2024 I have finished my internship at Futurewei and return to campus. I will be actively looking for internship for Summer 2025.
Nov 24, 2024 My co-first-authored paper “Visualizing Causality in Mixed Reality for Manual Task Learning: A Study” underwent a minor revision in TVCG!
Nov 21, 2024 I finished three projects during my internship at Futurewei. We submitted three manuscripts to CVPR 25!

latest posts

selected publications

  1. occludenerf.png
    OccludeNeRF: Geometry-aware 3D Scene Inpainting with Collaborative Score Distillation in NeRF
    Jingyu Shi, Achleshwar Luthra , Jiazhi Li , and 5 more authors
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , Mar 2025
  2. caring.png
    CARING-AI: Towards Authoring Context-aware Augmented Reality INstruction through Generative Artificial Intelligence
    Jingyu Shi*, Rahul Jain* , Seunggeun Chi* , and 4 more authors
    In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems , Jan 2025
  3. transparent.png
    Transparent Barriers: Natural Language Access Control Policies for XR-Enhanced Everyday Objects
    Kentaro Taninaka , Rahul Jain , Jingyu Shi, and 2 more authors
    In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems , Jan 2025
  4. ooi.png
    Interacting objects: A dataset of object-object interactions for richer dynamic scene representations
    Asim Unmesh , Rahul Jain , Jingyu Shi, and 5 more authors
    IEEE Robotics and Automation Letters, Oct 2023
  5. hgenai.jpg
    An HCI-Centric Survey and Taxonomy of Human-Generative-AI Interactions
    Jingyu Shi*, Rahul Jain* , Hyungjun Doh , and 2 more authors
    arXiv preprint arXiv:2310.07127, Jan 2024
  6. ubitouch.png
    Ubi-TOUCH: Ubiquitous Tangible Object Utilization through Consistent Hand-object interaction in Augmented Reality
    Rahul Jain* , Jingyu Shi*, Runlin Duan , and 3 more authors
    In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology , Oct 2023
  7. ubiedge.jpg
    Ubi Edge: Authoring Edge-Based Opportunistic Tangible User Interfaces in Augmented Reality
    Fengming He , Xiyun Hu , Jingyu Shi, and 3 more authors
    In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems , May 2023