Skip to main content

Esperanto ET-SoC-1 (RISC-V Heterogeneous AI)

Product Overview

Esperanto Technologies is a US RISC-V AI chip company, founded 2014 (by RISC-V founding fathers Darryl Gove + Dave Patterson and others), headquartered in Mountain View, California. ET-SoC-1 is its first RISC-V heterogeneous AI inference chip, 2022-Q3 released, TSMC 7nm, 1,300+ RISC-V cores (one of the largest RISC-V chips in industry), 42 TFLOPS INT8 inference, ~75W TDP. It is the RISC-V camp's representative in AI inference.

Core architecture:

  • ET-Minion: 4096-bit vector RISC-V cores (1000+, handles ML operators)
  • ET-Maxion: superscalar RISC-V cores (8, handles control + scalar)

Core Specs

ItemParameter
ArchitectureEsperanto ET-SoC-1 (heterogeneous RISC-V)
ProcessTSMC 7nm
Total Cores1,332 RISC-V cores
ET-Minion1,324 cores (vectorized AI cores, 4096-bit SIMD)
ET-Maxion8 cores (superscalar scalar cores, Rocket RISC-V)
L2 Cacheshared 256MB
HBM16GB HBM2E (optional 4GB HBM2E)
Memory Bandwidth410 GB/s
INT842 TOPS
FP1621 TFLOPS
FP3210.5 TFLOPS
TDP~75 W
Form FactorPCIe Gen4 x16
Interconnectproprietary interconnect (PCIe + Ethernet)
Mass Production2023-Q2
Unit Price~$1,500-3,000

Heterogeneous RISC-V Architecture

DimensionET-MinionET-Maxion
Typevectorized AI coressuperscalar scalar cores
Count1,3248
Vector Width4096-bit SIMD-
Frequency1.5 GHz2 GHz
Best Formatmul + activation functionsscheduling + control + scalar
NVIDIA AnalogTensor CoreCUDA core
ARM AnalogNEON (analogy)Cortex-A

1,324 ET-Minion Cores

Single core: 4096-bit x 1.5 GHz x 2 (MAC) = 12.3 GOPS INT8
1324 cores: 12.3 x 1324 = 16.3 TOPS INT8 (single card)
With sparsity + efficient encoding: 42 TOPS INT8 nominal

Advantages:

  • Fully RISC-V ISA (no proprietary instruction extensions)
  • Portable: all ET-Minion cores run standard RISC-V V extension
  • Debuggable: GDB debug all cores (vs GPU black box)

75W TDP Air-Cooled

MetricEsperanto ET-SoC-1NVIDIA L4NVIDIA H100
INT842 TOPS485 TOPS1,513 TOPS
TDP75W72W700W
Efficiency0.56 TOPS/W6.7 TOPS/W2.16 TOPS/W
Price~$2K~$2.5K~$25-30K
SoftwareRISC-V toolchainCUDACUDA

Esperanto advantage: very low price ($2K) + RISC-V open, but compute and efficiency both behind L4 (one generation behind NVIDIA).

Software Stack

LayerToolDescription
AI frameworkPyTorch (via TVM)auto-compile to ET-Minion
TensorFlow (via TVM)compatible
ET-SDKproprietary SDK (C/C++)
CompilerTVM + MLC-LLMauto operator mapping
RuntimeET-Runtime1,324 core scheduling
OptimizationET-QuantINT8 quantization
DebuggingGDB + standard RISC-V toolchainfully open

Warning: Ecosystem limitation: vs CUDA 18-year ecosystem, Esperanto only 3-4 years, operator coverage ~50-60%. LLM inference requires manual optimization or MLC-LLM compilation.

Vendor Information

ItemContent
CompanyEsperanto Technologies
FounderDarryl Gove (former ARM Chief Architect)
Dave Patterson (RISC-V founding father, UC Berkeley Professor, Turing Award winner)
Jeff Bonde (RISC-V veteran engineer)
Founded2014
HeadquartersMountain View, California, USA
Funding$280M+ (Series B 2022-Q1 led by: Fidelity)
Valuation (2025)~$1B (unicorn borderline)
2024 Revenue~$15M (early stage)
Employees~150
FabTSMC 7nm
CustomersUS National Labs (HPC), Rivos servers, RISC-V software ecosystem
Strategic PartnerRivos (RISC-V server chips, adopting ET-SoC-1 IP)

Use Cases

  • RISC-V software ecosystem building (ET-SoC-1 is RISC-V's first real AI deployment)
  • Government / National Lab HPC (US DOE, national security)
  • Low-power AI inference (75W air-cooled)
  • Domestic substitution (RISC-V no ARM/CUDA lock-in)
  • Academic research (debuggable RISC-V cores)
  • Production LLM inference (compute insufficient)
  • CUDA proprietary workloads
  • AI training (inference only)

Key Features

  • 1,332 RISC-V cores: largest RISC-V chip in industry
  • Fully open ISA: standard RISC-V V extension (no proprietary instructions)
  • Debuggable: GDB debug all cores
  • Low power: 75W TDP air-cooled
  • Low price: ~$2K (vs H100 $25K)
  • Drawbacks: low compute (42 TOPS INT8 far below L4 485 TOPS), weak ecosystem

Heterogeneous RISC-V Camp

CompanyProductRISC-V CoresCompute INT8Status
EsperantoET-SoC-11,33242 TOPS2023 mass production
TenstorrentWormhole80 Tensix cores (RISC-V control)320 TOPS2023 mass production
RivosServer SoCET-SoC-1 IP-2026 expected
SiPearlRhea72-core RISC-V80 TOPS2025 expected

RISC-V AI Strategic Significance

  • Founded by RISC-V founding father: Dave Patterson (Turing Award laureate, RISC-V originator)
  • First truly commercial RISC-V AI chip
  • Rivos server partnership: ET-SoC-1 IP integrated into Rivos server SoC
  • Fully open ISA: no ARM / CUDA proprietary lock-in
  • China Xinchuang compatible: RISC-V is the only choice for China's Xinchuang CPU