# Building Remotely: The Operating System for AI Coworkers ## Introduction: The Problem with Today’s AI Tools Modern AI tools are powerful, but fragmented. You can ask an AI to write copy, another to generate code, and another to analyze data — but none of them actually work together. Instead, users are forced into a broken workflow: * Prompt an AI tool * Copy the output * Move it into another tool * Manually execute the task * Repeat this process across dozens of steps This makes AI feel less like a workforce — and more like a collection of disconnected assistants. **Remotely is built to change that.** We are building a unified environment where AI agents don’t just respond — they collaborate, execute, and operate like a real company. --- ## What is Remotely? **Remotely is a virtual company operating system where humans and AI coworkers share the same workspace.** It combines: * A real-time 3D office environment * A marketplace of 106 specialized AI agents * A central AI Chief of Staff called “Buddy” * A secure execution and tool runtime Instead of managing multiple tools, you manage one company — powered by AI. --- ## The Vision: A Living AI Workplace Traditional AI tools live in chat windows. Remotely introduces something different: A **spatial operating system for work.** Inside Remotely, you don’t just type commands — you enter a workspace. You can: * Move through a 3D office environment * Join meetings with voice and video * Assign tasks to AI coworkers * Watch execution happen in real time * Collaborate with agents as if they were teammates This creates a new interaction model: > AI is no longer a tool you use — it becomes part of your organization. --- ## Buddy: Your AI Chief of Staff At the center of Remotely is **Buddy**, a coordinating intelligence layer. Instead of manually assigning tasks to different agents, you simply communicate your goal. Example: > “Launch a marketing campaign for my product.” Buddy automatically: * Breaks the task into steps * Assigns work to specialized agents * Coordinates outputs across teams * Tracks execution progress * Reports results back to you Buddy acts like a real COO — orchestrating execution across the entire AI organization. --- ## The AI Workforce: 106 Specialized Agents Remotely includes a structured workforce of **106 AI coworkers**, each designed for a specific role. ### Marketing * Content strategists * Copywriters * SEO specialists * Paid ads managers ### Sales * Outreach agents * Lead qualification systems * CRM assistants ### Engineering * Frontend developers * Backend developers * QA testers * Security reviewers ### Operations * Research analysts * Financial planners * Administrative assistants Each agent has: * A defined role * A system prompt * Tool access * Task-specific behavior This creates a modular, scalable organization — not just a set of prompts. --- ## The Spatial Layer: A Real-Time 3D Office Remotely is built around a fully interactive workspace. Unlike traditional dashboards, the system is spatial. You can: * Walk through rooms * Join conversations via voice (LiveKit) * See agents working in different zones * Interact with dashboards in context The interface is built with: * React Three Fiber * Three.js * Real-time presence systems This creates something closer to a living digital office than a SaaS dashboard. --- ## Security by Design AI systems that execute real actions must be designed with trust in mind. Remotely introduces two core security systems: ### 1. Human Approval Loop No sensitive action executes automatically. Before any external effect (emails, ads, payments, integrations), the system: * Pauses execution * Sends an approval request to the user * Waits for explicit confirmation * Logs the action in an audit trail Nothing is executed without human oversight. --- ### 2. SecretRef Vault API keys and credentials are never exposed to AI models. Instead, Remotely uses a secure token system: * Credentials are encrypted at rest (AES-256-GCM) * Agents only see a reference token (e.g. `vault:stripe:123`) * Secrets are resolved only at execution time on the server * The LLM never sees raw credentials This ensures agents cannot leak or hallucinate sensitive data. --- ## Architecture & Tech Stack Remotely is built for scalability and performance. * **Frontend:** Next.js 16, React 19, Tailwind v4, Turbopack * **3D Engine:** React Three Fiber + Three.js * **Backend:** Node.js runtime with typed tool execution layer * **Database:** Drizzle ORM + Neon Postgres * **AI Layer:** Multi-model routing via Vercel AI SDK v6 * **Real-time:** LiveKit (voice + presence) * **Security:** Encrypted vault + approval-based execution system --- ## Multi-Model Intelligence Routing Not all tasks require the same level of intelligence. Remotely dynamically routes tasks across models: * **Fast model (Llama 3.1 8B):** lightweight task sorting, categorization * **Balanced model (Llama 3.3 70B):** writing, marketing, coordination * **Expert model (Claude 3.5 Sonnet):** code, audits, reasoning-heavy tasks This optimizes cost, speed, and quality automatically. --- ## Business Model: Transparent AI Infrastructure Most AI platforms bundle costs into opaque pricing tiers. Remotely takes a different approach: ### 1. Bring Your Own AI Keys Users connect their own API providers and pay directly for usage. ### 2. Office Subscription The only paid layer is the workspace itself — the virtual company environment. This makes costs: * Transparent * Predictable * Scalable with usage --- ## Roadmap We are currently expanding Remotely into a fully production-ready AI operating system. Upcoming features include: * Full voxel-based 3D office with pathfinding avatars * Multi-seat organization support (Clerk-based teams) * Self-improving agent skill registry * Expanded tool marketplace for agents * Advanced workflow automation system --- ## Closing Remotely is not just another AI tool. It is an attempt to redefine how work is structured in the age of AI. Instead of replacing workers, we are building environments where humans and AI systems collaborate as one organization. --- ## Links * Website: https://remotely-ten.vercel.app

Remotely

The AI operating system for Compagnies

The AI operating system for Compagnies