Tag

Memstore

0 views collected around this technical thread.

Aikesheng Open Source Community
Aikesheng Open Source Community
Apr 27, 2023 · Databases

Diagnosing Freeze and Dump Issues in OceanBase Memstore

This article explains how to verify whether OceanBase's freeze mechanism and memstore dump processes are functioning correctly by querying internal tables, inspecting logs, and checking related metrics such as active_memstore_used, major_freeze_trigger, and MemTable reference counts.

Database AdministrationFreezeMemstore
0 likes · 14 min read
Diagnosing Freeze and Dump Issues in OceanBase Memstore
Big Data Technology Architecture
Big Data Technology Architecture
Oct 14, 2021 · Databases

Performance Evaluation and Optimization of HBase 2.x Write Operations

This article presents a detailed performance test of HBase 2.x write throughput on a five‑node SSD cluster, identifies latency spikes caused by MemStore flush and ConcurrentSkipListMap size() overhead, and demonstrates how fixing the bug and applying in‑memory compaction dramatically reduces P999 and P9999 latency while preserving throughput.

Big DataHBaseIn-Memory Compaction
0 likes · 10 min read
Performance Evaluation and Optimization of HBase 2.x Write Operations
Big Data Technology Architecture
Big Data Technology Architecture
Apr 16, 2020 · Databases

Memory Management Optimizations in HBase MemStore: SkipList, MemStoreLAB, ChunkPool, Off‑heap and CCSMap

The article systematically explains how HBase's MemStore uses a SkipList‑based model and introduces successive memory‑management optimizations—MemStoreLAB, ChunkPool, off‑heap chunks, CompactingMemStore and the CCSMap data structure—to reduce object overhead, GC pressure and improve throughput.

HBaseJavaMemstore
0 likes · 20 min read
Memory Management Optimizations in HBase MemStore: SkipList, MemStoreLAB, ChunkPool, Off‑heap and CCSMap
Big Data Technology Architecture
Big Data Technology Architecture
Jul 15, 2019 · Databases

Understanding HBase Write Path, Memstore Limits, and Preventing RegionServer OOM

This article explains the complete HBase write flow, the problems caused by rapid writes such as memstore overflow and RegionTooBusyException, and provides configuration and operational strategies to avoid RegionServer out‑of‑memory crashes.

HBaseMemstoreRegionServer
0 likes · 7 min read
Understanding HBase Write Path, Memstore Limits, and Preventing RegionServer OOM
Big Data Technology Architecture
Big Data Technology Architecture
Jun 1, 2019 · Big Data

Impact of Excessive HBase Partitions and How to Calculate Reasonable Region Numbers

The article explains how excessive HBase partitions can cause frequent flushes, compaction storms, high memory usage, long master assignment times, and reduced MapReduce concurrency, and provides formulas and guidelines for calculating a reasonable number of regions per RegionServer.

Big DataHBaseMemstore
0 likes · 8 min read
Impact of Excessive HBase Partitions and How to Calculate Reasonable Region Numbers
Big Data Technology Architecture
Big Data Technology Architecture
May 21, 2019 · Databases

Postmortem Analysis of a 10‑Node HBase Cluster Outage and Mitigation Measures

This article presents a detailed post‑mortem of a 10‑node HBase cluster failure caused by excessive region count and memstore pressure, analyzes HDFS and datanode log errors, and outlines configuration adjustments and operational recommendations that restored the service and prevented future outages.

Big DataCluster OutageCompaction
0 likes · 16 min read
Postmortem Analysis of a 10‑Node HBase Cluster Outage and Mitigation Measures