Kernels and Hardware Libraries

Kernel and hardware libraries implement the primitive operations that compilers and inference engines schedule onto devices.

Responsibilities

  • Matrix multiplication, convolution, attention, normalization, sampling, and vector operations.
  • Collective communication, topology-aware transfers, and device synchronization.
  • Precision-specific paths, layout requirements, workspace allocation, and autotuning.
  • Versioned compatibility with drivers, accelerators, and compiler-generated code.

Operational evidence

Record kernel selection, precision, fallback, launch overhead, device occupancy, memory traffic, and communication time when diagnosing performance.


Keep the source visible

Help others find this page

If this page was useful, link to it from a website, blog, public newsletter archive, resource page, documentation page, or social post. A public link helps the work remain discoverable after the feed moves on.

Get sharing text
Learn why links matter