DataFunSummit
Apr 11, 2023 · Artificial Intelligence
OneFlow Coop: Joint Optimization of Dynamic‑Graph Recomputation and Memory Allocation
This article introduces OneFlow Coop, a memory‑optimization technique that jointly optimizes dynamic‑graph recomputation strategies and GPU memory allocation by analyzing existing DTR limitations, proposing recomputable in‑place, op‑guided tensor allocation, and layout‑aware eviction modules, and demonstrating superior experimental results.
Dynamic GraphGPU memoryMemory Optimization
0 likes · 18 min read