PagedAttention revolutionizes memory management by implementing a virtual memory system inspired by operating system design principles.

• Pages → Blocks: Fixed-size memory blocks containing attention keys and values
• Bytes → Tokens: Individual tokens within each block
• Processes → Requests: Individual inference requests with their own virtual address spaces