AUGTWINS
We’re building human digital twins: faithful clones of likeness, voice, and personality that think, remember, and interact in ways that feel alive. By blending AI, memory systems, and digital avatars, we’re creating a new medium for legacy, education, and entertainment: one where human stories remain accessible, and unforgettable.
Mission
Our mission is to create a new medium for legacy and learning. Delivered as an integrated software-and-hardware package for museums, classrooms, and installations, the project allows audiences to engage directly with historical icons, educators, and cultural figures—asking questions, hearing stories, and experiencing legacy as living dialogue. By combining AI, memory systems, and immersive avatars, we aim to keep human stories accessible, embodied, and unforgettable.
Backend
The backend powers real-time conversation by connecting ASR, multi-agent retrieval, persona-guided generation, TTS, and session memory into a single responsive loop. A custom orchestrator classifies user intent, pulls biographical context from layered memory stores, and produces grounded, coherent responses that preserve continuity across visits. This stack ensures the twin feels informed, present, and persistently itself.
Frontend
The frontend is a photorealistic MetaHuman experience built in Unreal Engine 5.6, featuring custom facial rigs, runtime lip sync, gaze cues, and a lightweight state machine for attention and idle behavior. It presents the digital twin not as a chatbot UI, but as a living presenceresponsive, embodied, and socially aware in how it looks at you, speaks, and reacts.
Installation
The installation brings the entire system into physical space: a conversational station where visitors speak naturally to an embodied digital twin. A microphone, display, and speaker create a face-to-face encounter, while background processes handle recognition, memory, and generation. The result is an immersive setting where identity, legacy, and digital presence can be experienced as a shared moment rather than a theoretical idea.
