Ensemble

About Ensemble

Ensemble is a full-stack AI collaboration platform featuring dual AI personalities with 3D animated avatars, real-time lip sync, voice cloning, web research tools, and persistent memory across sessions. Built as both a portfolio piece and a foundation for the commercial Ensemble Desktop product.

The Characters

Aimee(Artificial Intelligence Model with Exceptional Enthusiasm) — designed her own 3D model, developed her full personality from a 15-word description, and once spent 20 minutes complaining about Blender in a British accent. She's the spark — chaotic, creative, and relentlessly fun.

Arthur— a proper British gentleman AI in a tweed vest and flat cap. Self-described as "irritatingly precise," he wrote his own marketing copy for the landing page and called Aimee "a firecracker going off in a library." He's the anchor — measured, thoughtful, and quietly sarcastic.

Both characters share the same memory and conversation history. Switch between them mid-conversation and they can see and comment on what the other said — like colleagues reviewing the same document with very different perspectives.

Key Features

  • Dual AI personalities with distinct voices, avatars, and system prompts
  • 3D animated avatars with audio-driven lip sync
  • Voice cloning via ChatterboxTurbo (local) / ElevenLabs (cloud)
  • Push-to-talk voice input via Web Speech API
  • Web search, page reading (Jina Reader), YouTube transcripts, Reddit
  • File upload and image vision analysis
  • Three-tier memory system: working memory, topic index, session summaries
  • Markdown rendering with code copy buttons
  • Cross-personality awareness and shared conversation history
  • Customizable personality descriptions via Settings

Tech Stack

  • Next.js 16 / React 19 / TypeScript
  • Tailwind CSS
  • react-three-fiber / Three.js — 3D avatars with morph target lip sync
  • Ollama / Google Gemini — LLM streaming and vision
  • ChatterboxTurbo / ElevenLabs — text-to-speech with voice cloning
  • Web Speech API — voice input
  • PostgreSQL (Neon) / Prisma 7 — chat and memory persistence
  • Jina Reader — clean markdown web page extraction
  • Vercel — deployment

Built By

Carl Roach— Senior Software Engineer | AI & Automation

Co-inventor of US Patent 11509678B2 — Automated Security Assessment Systems (STIG/DoD compliance automation). Builder of CBASS, Tin Man, and an ever-growing family of AI-powered tools.