Skip to main content

Cerebras WSE-2 (CS-2)

Overview​

The Cerebras WSE-2 (Wafer-Scale Engine 2), released in 2021, is the world's largest single-chip processor. It packs 2.6 trillion transistors, 850,000 AI cores, and 40GB on-chip SRAM (no HBM), all on a single wafer. WSE-2 solves the memory wall problem of traditional GPUs but requires a complete CS-2 system.

Core Specifications​

ItemParameter
ArchitectureWSE-2 (Wafer-Scale Engine)
ProcessTSMC 7nm
Transistors2.6 trillion
Cores850,000
On-Chip SRAM40 GB
On-Chip Interconnect220 PB/s
TDP (System)15 kW
Form FactorCS-2 complete system

Vendor Information​

ItemDetails
ManufacturerCerebras Systems
Websitehttps://www.cerebras.net
Product Pagehttps://www.cerebras.net/product-cs-2/
Softwarehttps://www.cerebras.net/software/
Documentationhttps://docs.cerebras.net

Key Features​

  • Single wafer-scale chip: no stitching
  • Extremely high core density: ideal for sparse computation
  • Weight Streaming: model weights streamed on-chip
  • No model parallelism needed: single chip trains large models

Use Cases​

  • Large model training (no sharding needed)
  • LLM pre-training
  • Scientific computing