XEROLANE

Large designs

Billions of gates, on one GPU or several, every result checked

Xerolane simulates designs of billions of gates on a single GPU, and splits larger ones across several. Every run on this page was checked against an independent reference: a C model of the design, the aigsim reference simulator, or the original design the copies were made from.

10.67B gates

in one connected chip, split across four GPUs: 64 data sets against its C model. How →

10.03B gates

on one GPU, 1.31 billion flip-flops: every output and every flip-flop of every copy checked.

2.04B gates

in one connected chip, 1.59 million cycles of 64 data sets against its C model.

0mismatches

on any design listed here.

Designs and their checks

One row per run. The check column names what Xerolane's results were compared with.

DesignSizeRunChecked againstGPUResult
Transformer inference chip, across four GPUs1,024 experts × 16 layers, one connected design, weights in memories10.67 billion gates, 2.67 billion on each GPU82,109 cycles × 64 data sets, 5 h 1 minThe design’s C reference model, every data set4 × NVIDIA L40S, 48 GB each64 of 64 exact
1,200 copies of a neural-network chipone expert by one layer of the transformer chip10.03 billion gates, 1.31 billion flip-flops2,000 cycles in 216 s; eight runs at once in 205 sThe original design: every output, and every flip-flop’s saved stateNVIDIA B200, 183 GB1,200 of 1,200 exact
Transformer inference chip16 experts × 16 layers, one connected design2.04 billion gates, 276 million flip-flops1.59 million cycles × 64 data sets, about 43 hoursThe design's C reference model, every data setNVIDIA L40S, 48 GB64 of 64 exact
178 copies of EPFL twentythreeEPFL Combinational Benchmark Suite5.02 billion gates100 cyclesaigsim, every output of every copyNVIDIA L40S, 48 GB178 of 178 exact
160 copies of EPFL twentythree4.51 billion gates100 cyclesaigsim, every output of every copyNVIDIA L40S, 48 GB160 of 160 exact
527 copies of a neural-network chipone expert by one layer of the transformer chip4.40 billion gates, 575 million flip-flops2,000 cyclesThe original design: every output, and every flip-flop’s saved stateNVIDIA RTX PRO 6000, 96 GB527 of 527 exact

How the copies make one design

The copies sit side by side in one netlist, with no wires between them. Each has its own inputs and outputs, and all of them run on one shared clock. Every copy is driven with the original design’s input vectors, so every copy must reproduce the original’s outputs, cycle for cycle. No reference simulator can run a 10-billion-gate design whole, but each copy can be checked against one that has already checked the original.

The transformer chip, by contrast, is one connected design: its experts and layers are wired together into a working chip, and its results are checked against the C model it was built from. At 2.04 billion gates it ran on one GPU; at 10.67 billion it was split across four, exchanging the signals between the parts every clock cycle.

Past 4.29 billion

  • 40-bit gate idsA 32-bit id stops at 4,294,967,296 gates. Xerolane’s ids are 40 bits, and the four runs past that line check every output, and every flip-flop, beyond it.
  • Saved state, checkedA design’s flip-flops can be saved at any cycle and restored later. On the 4.40-billion-gate run, the state of all 575 million flip-flops was saved and compared with the original design’s; on the 10.03-billion-gate run, all 1.31 billion.
  • Host memoryPreparing a design for simulation takes about 22 bytes of host memory a gate: 113 GB for the 5.02-billion-gate design. Now about 18 bytes: 185 GB for the 10.03-billion-gate design.
  • GPU memoryThe 5.02-billion-gate design used 39.5 GB of a 48 GB card; the 4.40-billion-gate design, with its flip-flops, 43.7 GB of 96 GB; the 10.03-billion-gate design, 101.6 GB of 183 GB, the same for one run as for eight at once.