跳转至

Benchmarks

本页暂无中文版。以下为英文原文。

Nightly snapshot

GPU NVIDIA H200 · commit b473facc3f51 · run date 2026-08-24 · 191 ops, 1137 workloads · nightly run

Page rendered 2026-08-24 22:31 UTC from the nightly-bench snapshot.

Environment

image ghcr.io/tile-ai/tileops-runner:cu132-torch2.13-tl-afcebed1-1
gpu NVIDIA H200
driver 595.71.05
cuda 13.2
torch 2.13.0+cu132
tilelang 0.1.11+cu132.gitafcebed1
timer cupti

Method

  • One process, common inputs. Every implementation of an op is timed on the same tensors in the same process, in forward and then reversed order so drift does not land on whichever ran last.
  • A fixed warmup and measurement budget per implementation, reported as the median over however many samples fit in it, with L2 cleared between iterations.
  • Compilation and workspace setup excluded.
  • Device time is what is compared — the union of the intervals the device spent executing the call's kernels, collected through CUPTI. A run that cannot collect device activity fails rather than falling back to a different clock.

Coverage

  • 191 of 191 ops are measured against a real alternative — a tuned library kernel or a native PyTorch op — on the identical workload. The rest run against an eager reference only, which is not a bar worth reporting a win against.
  • Absent from every table: 0 workloads errored and 13 were skipped in this run.

How these numbers are taken

Data

Page Ops Workloads
Attention 15 119
Linear Attention & SSM 22 158
GEMM, MoE & Quantization 21 152
Elementwise & Reduction 97 508
Norm, Conv, Pool & Other 36 200