CS-UDT flood digital twin
2026
A crowd-sourced urban digital twin for hurricane flooding in Jacksonville, with a zero-install citizen client and a planner dashboard. The demo runs on simulated data.
Builds
Systems I have built or helped build across software and hardware, from study platforms and LLM pipelines to puppets, AR glasses apps and a humanoid telepresence robot.
| Build | AI and LLMs | Sensing and tracking | 3D, XR and robots | Hardware | Web and dashboards | User study |
|---|---|---|---|---|---|---|
| CS-UDT flood digital twin2026 | yes | no | no | no | yes | no |
| LLM interest-extraction pipelineICALT 2026 study | yes | no | no | no | yes | yes |
| Gaze and interaction-log study platformICIDS 2026 study | no | yes | no | no | yes | yes |
| Academic revision checklistOct 2026 | yes | no | no | no | no | no |
| Unity puppet storytelling system2018–21 | no | yes | yes | yes | no | yes |
| AR smart-glasses appsIEEE VR 2020 | no | yes | yes | no | no | yes |
| CTE activity recognition for bench electronics | yes | yes | no | no | yes | no |
| Humanoid telepresence robot — ANA Avatar XPRIZESept 2021 | no | yes | yes | yes | no | no |
| Humanoid robot behavior imitation (undergraduate thesis)2016 | no | yes | yes | no | no | no |
| Wearable baby thermometer (Galaxy Studio)2012–16 | no | no | no | yes | no | no |
| Engagement dashboards — The Teaching Lab (internship)2022 | no | no | no | no | yes | no |
Projects
LLM interest-extraction pipeline
ICALT 2026 study
The pipeline behind Study 2 of my dissertation, which extracted students’ interests, with explanations, from their browsing history and social-media posts.
Gaze and interaction-log study platform
ICIDS 2026 study
A remote study platform that synchronizes a webcam gaze stream with time-stamped video scrubbing and keystrokes.
Academic revision checklist
Oct 2026
An open checklist for revising academic English for a first-time reader, drawn from five weeks and more than 60 revision rounds of my dissertation. It also installs as a Claude Code skill.
Unity puppet storytelling system
2018–21
3D-printed puppets animated in Unity in real time, built for the NSF project To Enact, To Tell, To Write.
AR smart-glasses apps
IEEE VR 2020
Two Android apps for the Vuzix Blade that compared showing information when an object was detected with showing it on spoken request.
CTE activity recognition for bench electronics
Breadboarding and soldering recorded with eye-tracking glasses and a GoPro, and a GPT-4o vision stage that summarizes the activities from video frames.
Humanoid telepresence robot — ANA Avatar XPRIZE
Sept 2021
On-site leader of four-person Team Limitless, whose 300+ lb humanoid telepresence robot was a semifinalist in the ANA Avatar XPRIZE.
Humanoid robot behavior imitation (undergraduate thesis)
2016
Kinect-based human action recognition driving a humanoid robot over Wi-Fi. Outstanding Thesis Award (top 1%).
Wearable baby thermometer (Galaxy Studio)
2012–16
A wearable thermometer, designed and iterated at Galaxy Studio, later commercialized and sold in the U.S.
Engagement dashboards — The Teaching Lab (internship)
2022
Two interactive dashboards of student-engagement data for program directors, and a centralized web grading system.
On GitHub
nanjierao/nanjierao.github.io
TypeScript · updated
JimmyRaoUF/academic-revision-checklist
66 reader-first rules for revising academic English, drawn from 60+ revision rounds of a PhD dissertation, with a 16-item quick list, a script that flags places to reread, and a Claude skill.
Python · updated
JimmyRaoUF/icalt2026-interest-extraction-supplementary
Supplementary materials for ICALT 2026 paper Identifying Student Interests for Interest-Based Learning
JavaScript · updated
JimmyRaoUF/t1
updated
JimmyRaoUF/JimmyRaoUF.github.io
HTML · updated
JimmyRaoUF/S2
Dissertation Study 2 - week-long study designed to understand personal interests through passive audio capture
updated
JimmyRaoUF/ChatGPT-Next-Web
TypeScript · updated
JimmyRaoUF/MLC
updated
JimmyRaoUF/PRITVoiceDirection
C# · updated
All public repositories: github.com/JimmyRaoUF and github.com/nanjierao.