09 · Hardware & Infrastructure

CPU

Central Processing Unit

The general-purpose processor in a computer. CPUs can run smaller or quantized models and handle orchestration well, but GPUs and other accelerators are usually much faster for large parallel training and inference workloads.

Concrete example

Great at running your operating system; far too slow to train a large model alone.