Skip to content

Modal Sandboxes: GPU Sandbox and Sandbox as a Standalone Product Line

Aug 30, 20261 min
TL;DRThe cloud deep dive post (order 12) of the Sandbox Series. Modal Sandboxes architecture, GPU sandbox support, pricing model, and how it grew from a feature to a $300M–$1B annualized run rate standalone product line.

Look up & save

Loading dictionary…

🌏 中文版

What This Post Is

This post is the "cloud deep dive" post (order 12) of the Sandbox Series, focusing on Modal Sandboxes. Modal is one of the most watched sandbox providers in 2026, with its sandbox product alone contributing approximately $300M–$330M annualized run rate, supporting over 3 billion cumulative executions and 1 million concurrent sandboxes.

This post covers:

  1. Modal Sandboxes architecture — Control plane, execution plane, isolation technology
  2. GPU sandbox support — Why GPU sandbox is Modal's differentiation advantage
  3. Pricing model — Wall-clock billing, no idle charge, GPU fees
  4. Trade-offs with other providers — E2B, Daytona, Vercel, Cloudflare comparison
  5. Commercialization lessons — How sandbox grew from feature to standalone product

Modal Sandboxes uses a three-layer architecture:

┌─────────────────────────────────────┐
│           Control Plane              │
│  - Modal Worker scheduler             │
│  - Sandbox lifecycle management       │
│  - Snapshot and pause/resume          │
└─────────────────────────────────────┘
           │
┌─────────────────────────────────────┐
│           Execution Plane             │
│  - Cloud Hypervisor microVM           │
│  - gVisor isolation (default)         │
│  - VM execution mode (optional)       │
└─────────────────────────────────────┘
           │
┌─────────────────────────────────────┐
│           Data Plane                  │
│  - Persistent disks (Volumes)         │
│  - Memory snapshots                   │
│  - Network policy                     │
└─────────────────────────────────────┘

Isolation Technology

Modal defaults to gVisor for syscall interception, providing medium-strength isolation; for workloads needing stronger isolation, microVM execution mode (based on Cloud Hypervisor) is available. GPU sandboxes only support gVisor isolation.

Sandbox Lifecycle

  1. Create: Start sandbox from image (OCI container), cold start approximately seconds
  2. Execute: Send commands via SDK, stream output results
  3. Pause: Preserve memory and process state, release CPU
  4. Resume: Continue execution from paused state
  5. Snapshot: Save disk state as reusable snapshot
  6. Destroy: Release all resources

GPU Sandbox Support: Modal's Differentiation Advantage

One of Modal's key differentiation advantages is GPU sandbox support. Most sandbox providers (E2B, Daytona, Vercel, Cloudflare) do not support GPU, or have limited GPU support. Modal allows sandboxes to attach NVIDIA GPUs (T4 to H100), enabling agents to run ML inference, training, or data processing inside the sandbox.

GPU Sandbox Use Cases

Use CaseDescription
ML inferenceAgent-generated code runs model inference
Data processingLarge-scale data cleaning and transformation
Model fine-tuningSmall-scale model training and fine-tuning
Computer visionImage and video processing

GPU Sandbox Example

import modal

app = modal.App("agent-sandbox-gpu")

@app.function(
    image=modal.Image.debian_slim().pip_install("torch", "transformers"),
    gpu="A100",
    sandbox=True,
)
def run_agent_code(code: str):
    result = subprocess.run(["python", "-c", code], capture_output=True, text=True)
    return result.stdout

Pricing Model

Modal uses wall-clock billing, but with no idle charge — paused sandboxes are not billed. This is advantageous for bursty interactive agents.

ItemRateDescription
CPU$0.00003942 / core-sPer second
Memory$0.00000672 / GiB-sPer second
GPUBy model typeA100, H100, etc.
NetworkBy egress trafficPer GB
CacheBy storage sizePer GB-month

Compared to E2B/Daytona wall-clock billing, Modal's no-idle-charge is advantageous for "short execution, long wait" scenarios.


Trade-offs with Other Providers

ProviderGPU SupportIsolation TechCold StartPricing ModelBest For
Modal✅ (A100/H100)gVisor / microVMsub-secondwall-clock (no idle)GPU workloads, high concurrency
E2B❌Firecracker microVM~150 mswall-clockCoding agent, long tasks
Daytona❌Docker / Kata~90 mswall-clockParallel evaluation, snapshot fork
Vercel❌Firecracker microVM~1.8 sactive-CPUVercel ecosystem integration
Cloudflare❌Container in VM~2–3 sactive-CPU (10ms)Cloudflare ecosystem

Choose Modal when: Need GPU, need high concurrency, need no-idle billing, already on Modal platform.

Don't choose Modal when: Don't need GPU, prefer open-source self-host, need Windows sandbox (Daytona supports), deeply bound to other cloud ecosystems.


Commercialization Lessons

Modal sandbox's success shows sandboxing has shifted from "feature" to "independent commercial product":

  1. Single product line can reach $300M+ ARR: Sandbox is no longer an ancillary feature, but an independent commercial market.
  2. GPU is the key differentiator: In the sandbox market, GPU support is a high-value differentiator.
  3. No-idle billing is a selling point: For bursty agent workloads, this is a strong competitive advantage.
  4. Ecosystem integration matters: Integration with inference, training, batch processing on the same platform reduces switching cost.

What You Should Understand After Reading

  1. Modal Sandboxes three-layer architecture and isolation technology (gVisor / microVM).
  2. GPU sandbox is Modal's differentiation advantage, applicable to ML inference and data processing.
  3. Modal's pricing model: wall-clock billing, no-idle charge, GPU fees.
  4. Trade-offs with E2B, Daytona, Vercel, Cloudflare.
  5. Commercialization lessons: single product line can reach $300M+ ARR, GPU and ecosystem integration are key.

References