BestHub
Sign in
Tag

database partitioning

2 views collected around this technical thread.

Code Ape Tech Column
Code Ape Tech Column
May 28, 2025 · Databases

Evaluating MySQL Table Size and Optimizing Large Tables with Partitioning, Sharding, and Hot‑Cold Archiving

This article explains how to assess MySQL table size from table capacity, disk usage, and instance limits, describes why large tables degrade performance due to B+‑tree depth, and presents three practical solutions—partitioning, sharding, and hot‑cold archiving—to improve query speed and manage growth.

B+ TreeHot Cold ArchivingMySQL
0 likes · 16 min read
Evaluating MySQL Table Size and Optimizing Large Tables with Partitioning, Sharding, and Hot‑Cold Archiving
Top Architect
Top Architect
Nov 12, 2024 · Databases

Design and Implementation of Table Sharding for Loan Repayment Applications Using ShardingSphere and Spring Boot

This article describes how a senior architect designed, configured, and implemented a 50‑table sharding solution for loan and repayment request data using ShardingSphere, Spring Boot 3, MySQL, and custom synchronization scripts, while also addressing historical data migration, backend query changes, and operational safeguards.

MySQLShardingShardingSphere
0 likes · 23 min read
Design and Implementation of Table Sharding for Loan Repayment Applications Using ShardingSphere and Spring Boot
Top Architect
Top Architect
Aug 18, 2024 · Databases

Design and Implementation of Database Table Partitioning for Loan and Repayment Systems

This article details the design, planning, and step‑by‑step implementation of a database table‑partitioning solution for loan and repayment request tables, covering schema decisions, sharding strategy, historical data migration, dynamic synchronization, code examples with ShardingSphere, SpringBoot, and operational considerations for seamless migration.

ShardingShardingSphereSpringBoot
0 likes · 18 min read
Design and Implementation of Database Table Partitioning for Loan and Repayment Systems
Architect
Architect
Jul 17, 2024 · Databases

Design and Implementation of Table Sharding for Cash Repayment System Using ShardingSphere and SpringBoot

The article describes how a one‑year‑old loan/repayment service was refactored by introducing a 50‑table sharding scheme with ShardingSphere, detailing the design decisions, historical data migration, code changes, configuration files, pitfalls, and runtime synchronization strategies to achieve efficient query performance on billions of rows.

MySQLShardingShardingSphere
0 likes · 23 min read
Design and Implementation of Table Sharding for Cash Repayment System Using ShardingSphere and SpringBoot
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
May 21, 2024 · Backend Development

Design and Implementation of a High‑Performance Short URL Service

This article explains the motivation, architecture, resource estimation, code generation algorithms, data modeling, database partitioning, caching strategies, and implementation details for building a scalable short URL system that handles billions of links and high QPS workloads.

RedisShort URLbackend architecture
0 likes · 17 min read
Design and Implementation of a High‑Performance Short URL Service
Architecture Digest
Architecture Digest
Mar 6, 2024 · Databases

Implementing SaaS Multi‑Tenant Architecture with Shared Database Table Partitioning in MySQL

This article explains how to design a SaaS system that isolates each subsidiary's data by adding a tenant_id column to a shared MySQL table, converting the table to LIST‑partitioned storage, and enforcing tenant‑level access through stored procedures and a MyBatis interceptor, complete with code examples and testing steps.

MyBatisMySQLSaaS
0 likes · 18 min read
Implementing SaaS Multi‑Tenant Architecture with Shared Database Table Partitioning in MySQL
Top Architect
Top Architect
Jan 11, 2024 · Databases

Implementing Multi‑Tenant SaaS Architecture with MySQL Partitioning and MyBatis Interceptor

This article demonstrates how to convert a single‑tenant MySQL application into a multi‑tenant SaaS solution by adding a tenant_id column, using shared‑database partitioning, creating tenant tables, writing stored procedures for dynamic partition management, and implementing a MyBatis interceptor for hierarchical data permissions.

MyBatisMySQLSaaS
0 likes · 19 min read
Implementing Multi‑Tenant SaaS Architecture with MySQL Partitioning and MyBatis Interceptor
macrozheng
macrozheng
Dec 28, 2023 · Databases

Mastering Sharding: 21 Core Concepts for Scalable Database Design

This article introduces the essential concepts of sharding architecture—including data partitioning, logical and physical tables, sharding keys, routing strategies, SQL rewriting, distributed primary keys, data masking, transactions, migration, and shadow databases—providing a comprehensive guide for building high‑performance, horizontally scaled database systems.

SQL routingShardingbroadcast table
0 likes · 21 min read
Mastering Sharding: 21 Core Concepts for Scalable Database Design
Java Architect Essentials
Java Architect Essentials
Nov 2, 2023 · Databases

Optimizing Large MySQL Tables: Partitioning, Sharding, and Cold Archiving Strategies

This article explains how to evaluate MySQL table size, understand B+‑tree limitations, and improve query performance by using table partitioning, horizontal/vertical sharding, and hot‑cold data archiving, while also comparing the trade‑offs of each approach for practical selection.

B+ TreeCold ArchivingMySQL
0 likes · 15 min read
Optimizing Large MySQL Tables: Partitioning, Sharding, and Cold Archiving Strategies
Efficient Ops
Efficient Ops
Nov 1, 2023 · Databases

Why MySQL Single Tables Should Stay Below 20 Million Rows: Theory & Practice

This article explains the technical reasons why a MySQL single table should not exceed about 20 million rows, covering limits from auto‑increment primary keys, data‑page structures, B+‑tree storage calculations, and practical partitioning recommendations for large‑scale applications.

B+ TreeMySQLTable Size Limits
0 likes · 9 min read
Why MySQL Single Tables Should Stay Below 20 Million Rows: Theory & Practice
Architect's Guide
Architect's Guide
Oct 21, 2023 · Databases

Implementing Monthly Horizontal Partitioning in MySQL Using Stored Procedures and Dynamic Table Creation

This article details a practical approach to handling massive billing data by dynamically creating monthly tables in MySQL via stored procedures, integrating them with a SpringBoot‑MyBatis backend, and providing APIs for insertion, serial‑number lookup, and time‑range queries, complete with code examples and operational tips.

Dynamic TableMyBatisMySQL
0 likes · 31 min read
Implementing Monthly Horizontal Partitioning in MySQL Using Stored Procedures and Dynamic Table Creation
Architect
Architect
Sep 18, 2023 · Databases

Database Sharding: Data Partitioning Strategies, Challenges, and Practical Solutions

The article explains why relational databases become performance bottlenecks at large scales, introduces vertical and horizontal sharding techniques, discusses their advantages and drawbacks, and provides detailed guidance on handling distributed transactions, joins, pagination, global primary keys, and ID generation strategies.

ID generationShardingdatabase partitioning
0 likes · 24 min read
Database Sharding: Data Partitioning Strategies, Challenges, and Practical Solutions
Code Ape Tech Column
Code Ape Tech Column
Sep 7, 2023 · Databases

Hot and Cold Data Separation: Concepts, Scenarios, and Implementation Methods

The article explains the principle of hot‑cold data separation, when it should be applied, how to distinguish hot versus cold data, and three practical implementation approaches—code modification, binlog listening, and scheduled scanning—to improve database performance and maintain consistency.

Cold Databackend architecturedata lifecycle
0 likes · 9 min read
Hot and Cold Data Separation: Concepts, Scenarios, and Implementation Methods
Wukong Talks Architecture
Wukong Talks Architecture
May 16, 2023 · Databases

Understanding Sharding: 21 Common Concepts of Database Partitioning

This article introduces the fundamental concepts of database sharding, including data fragmentation, nodes, logical and physical tables, broadcast and single tables, sharding keys, strategies, algorithms, binding tables, SQL parsing, routing, rewriting, execution, result merging, distributed primary keys, data masking, distributed transactions, migration, and shadow databases, providing a comprehensive guide for designing and operating a sharded architecture.

SQL routingShardingbinding tables
0 likes · 19 min read
Understanding Sharding: 21 Common Concepts of Database Partitioning
Top Architect
Top Architect
Mar 14, 2023 · Databases

Handling Large MySQL Tables: Partitioning, Sharding, and Archiving Strategies

This article explains how to assess MySQL table size, identify performance issues caused by massive data volumes, and presents three practical solutions—table partitioning, database sharding, and hot‑cold data archiving—along with detailed SQL examples and considerations for implementation.

MySQLShardingdata archiving
0 likes · 16 min read
Handling Large MySQL Tables: Partitioning, Sharding, and Archiving Strategies
Top Architect
Top Architect
Mar 4, 2023 · Databases

How to Handle Large MySQL Tables: Partitioning, Sharding, and Archiving Strategies

This article explains why large MySQL tables cause slow queries, analyzes table size, disk usage, and instance capacity, and presents three practical solutions—table partitioning, database sharding (horizontal/vertical), and hot‑cold data archiving—helping developers choose the appropriate strategy for their workloads.

MySQLShardingdata archiving
0 likes · 18 min read
How to Handle Large MySQL Tables: Partitioning, Sharding, and Archiving Strategies
Code Ape Tech Column
Code Ape Tech Column
Feb 22, 2023 · Databases

Managing Large MySQL Tables: Evaluation, Root Causes, and Optimization Strategies

This article explains how to assess MySQL table size, why massive tables degrade performance due to B+‑tree depth, and presents three practical solutions—table partitioning, database sharding, and hot‑cold data archiving—along with guidance on selecting the appropriate approach.

Cold ArchivingLarge TablesMySQL
0 likes · 14 min read
Managing Large MySQL Tables: Evaluation, Root Causes, and Optimization Strategies
Architect's Guide
Architect's Guide
Nov 11, 2022 · Databases

Database Sharding: Table Partitioning, Horizontal and Vertical Splitting, and Implementation with Sharding-JDBC and Mycat

This article explains why high‑concurrency big‑data systems need database sharding, describes table‑level partitioning methods (modulus and range), shows how to implement them with MySQL and Java code, compares vertical and horizontal database splitting, and evaluates middleware solutions such as Sharding‑JDBC and Mycat.

JavaMySQLSharding
0 likes · 11 min read
Database Sharding: Table Partitioning, Horizontal and Vertical Splitting, and Implementation with Sharding-JDBC and Mycat
Top Architect
Top Architect
Nov 10, 2022 · Databases

Database Sharding and Partitioning Strategy for High‑Volume Order Systems

This article explains how to handle billions of order records by classifying data into hot and cold tiers, using MySQL sharding with database‑and‑table partitioning, storing cold data in Elasticsearch and Hive, and outlines combined routing formulas for scalable backend architecture.

MySQLShardingbackend
0 likes · 8 min read
Database Sharding and Partitioning Strategy for High‑Volume Order Systems