Evolution and Applications of Data Processing Units (DPUs) in Modern Cloud Computing

With the rapid development of cloud computing and virtualization, network adapters have evolved through four major stages: traditional NICs, SmartNICs, FPGA‑based DPUs, and single‑chip DPU SoCs, each adding more hardware offload functions and programmability.

1. Traditional NIC (Network Interface Card) handles basic packet transmission and reception with limited hardware offload (e.g., CRC check, TSO/LSO, VLAN) and no programmable capability.

2. SmartNIC introduces moderate data‑plane offload using FPGA or integrated processors, accelerating functions such as virtual switches, RDMA, NVMe‑oF, and IPsec/TLS, but still relies on the host CPU for control‑plane management.

3. FPGA‑Based DPU combines a general‑purpose CPU with FPGA, enabling both data‑plane and control‑plane offload and providing a programmable environment for networking, storage, and security workloads. However, as bandwidth scales to 100 Gbps, FPGA area and power constraints become limiting factors.

4. DPU SoC (Single‑Chip DPU) integrates ASIC and CPU on a single die, delivering rich hardware acceleration, low power consumption, and flexible programmability for diverse cloud scenarios, representing the current evolutionary direction for data‑center architectures.

DPU technology follows the "software‑defined, hardware‑accelerated" paradigm: a general‑purpose processing unit handles control‑plane tasks, while dedicated accelerators ensure high‑performance data‑plane processing, balancing performance and versatility.

Applications in Major Cloud Platforms

AWS Nitro DPU separates networking, storage, security, and monitoring functions into dedicated hardware, dramatically reducing server resource consumption and enabling cost‑effective, high‑performance instances.

Nvidia BlueField DPU (e.g., BlueField‑3) targets AI and accelerated computing, offering up to 400 Gbps connectivity and comprehensive offload for networking, storage, and security.

Intel IPU provides ASIC‑based packet processing with an integrated CPU subsystem, delivering full infrastructure offload and a secure control point for cloud services.

Alibaba Cloud CIPU (based on the MoC card) evolves from a micro‑server card to a fully hardened DPU, progressively adding network and storage offload capabilities across four generations.

Volcano Engine DPU powers elastic bare‑metal and cloud servers, combining hardware‑level virtualization with high‑performance networking and storage, and has been commercialized since 2022.

Overall, DPU SoC is becoming a key component in modern data‑center design, offering cost‑effective, high‑throughput, and programmable solutions that support virtual machines, containers, and bare‑metal workloads while optimizing resource utilization.