Tag

Burst Buffer

1 views collected around this technical thread.

Architects' Tech Alliance
Architects' Tech Alliance
Jan 5, 2025 · Fundamentals

HadaFS: A New Burst Buffer File System for Scalable High‑Performance Computing

The article presents HadaFS, a novel burst‑buffer‑based distributed file system that combines the scalability of local burst buffers with the data‑sharing advantages of shared buffers, details its LTA architecture, metadata handling, the Hadash management tool, and extensive performance evaluations on the SNS supercomputer.

Burst BufferFile SystemHPC Storage
0 likes · 18 min read
HadaFS: A New Burst Buffer File System for Scalable High‑Performance Computing
Architects' Tech Alliance
Architects' Tech Alliance
Jun 13, 2023 · Fundamentals

HadaFS: A Scalable Burst Buffer File System for Exascale Supercomputers

The article introduces HadaFS, a novel burst‑buffer file system that combines the scalability and performance of local burst buffers with the data‑sharing and cost advantages of shared buffers, details its LTA architecture, metadata handling, and evaluates its superior performance on the SNS supercomputer against BeeGFS and traditional GFS solutions.

Burst BufferFile SystemHPC
0 likes · 16 min read
HadaFS: A Scalable Burst Buffer File System for Exascale Supercomputers
Architects' Tech Alliance
Architects' Tech Alliance
Aug 27, 2020 · Fundamentals

Understanding Burst Buffer Technology and Its Role in High‑Performance Computing (HPC)

Burst Buffer is a storage acceleration technology that enhances I/O bandwidth and OPS for high‑performance computing by providing fast checkpoint/restart, temporary storage, and balancing SSD and parallel file system resources, with implementations from DDN, Cray, EMC, and IBM detailed for HPC designers.

Burst BufferCheckpointHPC
0 likes · 5 min read
Understanding Burst Buffer Technology and Its Role in High‑Performance Computing (HPC)
Architects' Tech Alliance
Architects' Tech Alliance
Jun 14, 2019 · Fundamentals

Understanding Burst Buffer Technology and Its Role in High‑Performance Computing (HPC)

The article explains what Burst Buffer technology is, how it leverages flash/SSD storage to boost I/O bandwidth and operations per second in HPC environments, details NERSC's Cray DataWarp implementation, outlines the hardware and software architecture, and surveys similar solutions from other vendors.

Burst BufferDataWarpFlash Storage
0 likes · 15 min read
Understanding Burst Buffer Technology and Its Role in High‑Performance Computing (HPC)
Architects' Tech Alliance
Architects' Tech Alliance
Mar 14, 2017 · Fundamentals

Understanding Burst Buffer Technology and Its Role in HPC at NERSC

The article explains what Burst Buffer technology is, how NERSC integrates Cray DataWarp‑based flash/SSD buffers into its Cori supercomputer to boost I/O bandwidth and IOPS for scientific workloads, and describes the architecture, software stack, performance benefits, roadmap, and competing solutions from other vendors.

Burst BufferCray DataWarpHPC
0 likes · 11 min read
Understanding Burst Buffer Technology and Its Role in HPC at NERSC