CTE activity recognition for bench electronics
Breadboarding and soldering recorded with eye-tracking glasses and a GoPro, and a GPT-4o vision stage that summarizes the activities from video frames.
Datasheet
- Recording
- Breadboarding and soldering recorded with Tobii Pro Glasses 3 (first-person video + gaze) and a GoPro
- Vision stage
- GPT-4o: frame extraction, prompt design, activity summaries
- Comparison
- GPT-4o vs. GPT-4 task identification and API cost
- Dashboard
- Revived the project’s React/TypeScript + Node/Flask + Docker Compose dashboard
- Team
- Built with two student researchers