Andrea Pesciotti
Things I Build
← All projects

research · 2026

AR cooking assistant

A hands-free AR cooking assistant with voice commands and floating 3D panels. Published at ICWE 2026 (Springer LNCS).

Floating 3D panels for recipes, timers and shopping lists follow the user around the room. Voice commands are mapped to app actions with OpenAI function calling, with an on-device wake word ("Hey Mirage").

Paper: L. Cordioli, A. Pesciotti et al., "LLM-Driven Orchestration of Pervasive Web Interfaces in Extended Reality", ICWE 2026, Lyon.

Role
Lead developer
Team
Team of 5
Stack
Next.js 15, React Three Fiber, WebXR, OpenAI, Picovoice, Prisma, Neon, Vercel
Links
Paper (DOI) ↗