Tag

Memory-Mapped Files

1 views collected around this technical thread.

Code Ape Tech Column
Code Ape Tech Column
Feb 9, 2021 · Backend Development

Optimizing Java File Compression: From Buffered Streams to NIO Channels and Memory‑Mapped Files

This article demonstrates how to improve Java file compression performance by replacing unbuffered FileInputStream with BufferedInputStream, then leveraging NIO Channels, transferTo, memory‑mapped files, and Pipe, showing step‑by‑step code examples and timing results that reduce processing time from 30 seconds to about 1 second.

Buffered StreamsJavaMemory-Mapped Files
0 likes · 11 min read
Optimizing Java File Compression: From Buffered Streams to NIO Channels and Memory‑Mapped Files
Top Architect
Top Architect
Nov 15, 2020 · Backend Development

Optimizing Java File Compression: From Buffered Streams to NIO Channels and Memory‑Mapped Files

This article explains how to improve the performance of Java code that compresses multiple images into a zip archive by replacing unbuffered streams with buffered I/O, then using NIO channels, direct buffers, memory‑mapped files, and pipes, achieving a reduction from 30 seconds to about 1 second.

Buffered StreamsJavaMemory-Mapped Files
0 likes · 12 min read
Optimizing Java File Compression: From Buffered Streams to NIO Channels and Memory‑Mapped Files
Java Captain
Java Captain
Nov 12, 2020 · Backend Development

Optimizing Java File Compression: From Buffered Streams to NIO Channels, Memory‑Mapped Files and Pipes

This article demonstrates how to dramatically reduce the time required to compress multiple large images in Java by progressively applying buffered streams, NIO channels, direct buffers, memory‑mapped files and pipe techniques, measuring each optimization and explaining the underlying I/O mechanisms.

Buffered StreamsJavaMemory-Mapped Files
0 likes · 13 min read
Optimizing Java File Compression: From Buffered Streams to NIO Channels, Memory‑Mapped Files and Pipes
Architecture Digest
Architecture Digest
Jan 19, 2020 · Big Data

Why Kafka Is So Fast: Sequential Writes, Memory‑Mapped Files, and Zero‑Copy

This article explains how Kafka achieves high throughput by using sequential disk writes, memory‑mapped files, batch compression, and zero‑copy sendfile for reads, while also covering data retention policies and the role of offsets in consumer processing.

Data StreamingKafkaMemory-Mapped Files
0 likes · 10 min read
Why Kafka Is So Fast: Sequential Writes, Memory‑Mapped Files, and Zero‑Copy
58 Tech
58 Tech
Jul 18, 2019 · Fundamentals

Analyzing Memory-Mapped File Memory Usage and Monitoring in Linux

This article explains how memory-mapped files are used in a search engine, describes the underlying Linux mechanisms such as page cache, multi-level page tables and radix trees, and presents practical methods—including mincore, /proc smaps, pagemap and system commands—to analyze and monitor their memory consumption at both kernel and process levels.

LinuxMemory-Mapped Filesmemory analysis
0 likes · 14 min read
Analyzing Memory-Mapped File Memory Usage and Monitoring in Linux