Technical Note

Grok-1 314B Bounded Topology

NAS-backed local execution and a canonical mixed-edge topology for a 314B-parameter MoE model.

NAS-Backed Local Execution and Bounded Topology Checkpoint for Grok-1 314B

Download PDF Back to research Verify a receipt

Simple version

Same careful map of how a model works, but for a model so large we had to stream it from a network drive.

In plain terms

Grok-1 has 314 billion parameters and uses a routing design that picks different sub-networks for different inputs. We ran it from network-attached storage, captured a bounded slice of its routing and attention structure, and ran adversarial checks against the result.

Technical artifact

NAS-backed local execution and bounded mixed-edge topology for a 314B MoE model, 8 bounded edges, ratified under a page-cache-purge storage contract with adversarial verification.

Evidence path

  1. Step 1

    Stream the model from network storage

    Weights stream from NAS-backed SMB storage under a page-cache-purge protocol.

  2. Step 2

    Capture a bounded topology slice

    4 expert-routing edges and 4 attention edges across 2 layers of a 64-layer MoE.

  3. Step 3

    Emit a canonical topology artifact

    Mixed-edge topology.v2 artifact with 8 bounded edges, gated by determinism admission.

  4. Step 4

    Run adversarial verification

    Reproduces across independent runs; the gate rejects corrupted input with no state contamination.

Artifact details

Surface
Model Topology
Artifact
Technical note · PDF
Model
Grok-1 — 314B parameters · 64-layer MoE
Storage
NAS-backed SMB · page-cache-purge protocol
Evidence collected
8 bounded edges · expert-routing + attention
Verification result
Reproduces across independent runs

Scope of this note

This page summarizes one bounded topology capture under the NAS-backed storage contract. The PDF contains the full admission rule, edge schema, and adversarial verification results.

Open the technical artifact

The PDF contains the full admission rule, edge schema, NAS storage contract, and adversarial verification details.

Download PDF Back to research

Have an artifact?

Verify a receipt, digest, or bundle.

Verify a receipt