Skip to content
Back to Projects
AI & Agents|February 2026

Mandy Control Tower: AI-Native Infrastructure

Mandy Control Tower: AI-Native Infrastructure

The Control Tower is the unified infrastructure management, monitoring, and autonomous orchestration hub for the Mandy ecosystem. It transforms a collection of Docker containers into a self-healing, agent-managed platform.

🌟 Key Capabilities

  • Unified Ingress: A single "Front Door" for the Public API, Management Dashboard, and Analytics — with SSL/TLS termination and access control handled centrally.
  • Smart Sequential Orchestration: Dependency-aware startup logic for the inference stack, preventing resource contention during initialization.
  • Resident Engineer (Agentic SRE): An autonomous agent that monitors system pulse, analyzes logs, and performs corrective actions — using a cloud LLM for fast, lightweight SRE analysis.
  • MCP Toolbox: A standards-based Model Context Protocol (MCP) host that dynamically discovers and executes tools for container management and system monitoring.
  • Black Box Audit Trail: Every agent decision and system event is logged with full reasoning and snapshots for production auditability.
  • Anomaly Detection: Baseline profiling of GPU and system resources enables early detection of service degradation before it becomes an outage.

🛠️ Architecture

The ecosystem is organized into three tiers:

  1. Infrastructure Tier: Reverse proxy, management API, dashboard UI, and observability (metrics + alerting).
  2. Application Tier: The RAG engine, task queue, and supporting data services.
  3. Model Tier: Local inference services and embedding/reranking pipelines.

Status: Internal Tool / Core Infrastructure

Tech Stack

PythonFastAPIStreamlitCaddyPrometheusGrafanaMCPDocker