Tag

data migration

1 views collected around this technical thread.

Full-Stack Internet Architecture
Full-Stack Internet Architecture
Apr 30, 2025 · Databases

How to Reshard Slots in a Redis Cluster

This article explains the process of moving hash slots between nodes in a Redis cluster using the redis-cli --cluster reshard command, detailing the required parameters, interactive steps, and verification of successful slot migration.

ClusterDatabaseRedis
0 likes · 6 min read
How to Reshard Slots in a Redis Cluster
Architect
Architect
Apr 29, 2025 · Databases

Lessons Learned from Misusing INSERT INTO SELECT in MySQL Data Migration

A real‑world MySQL data‑migration case study shows how using INSERT INTO SELECT without proper indexing caused a full table scan, OOM errors, and data loss, and explains how to avoid the pitfall by adding appropriate indexes and understanding transaction locking.

Full Table ScanINSERT INTO SELECTIndexing
0 likes · 8 min read
Lessons Learned from Misusing INSERT INTO SELECT in MySQL Data Migration
360 Zhihui Cloud Developer
360 Zhihui Cloud Developer
Feb 26, 2025 · Cloud Computing

Master Cross-Cloud Object Storage Sync with Juicesync: Step-by-Step Guide

This article provides a comprehensive, step-by-step tutorial on using the open‑source Juicesync tool to migrate and synchronize object storage data across multiple cloud platforms, covering background, installation, configuration, full and incremental sync, and best‑practice notes.

GoJuicesynccloud storage
0 likes · 10 min read
Master Cross-Cloud Object Storage Sync with Juicesync: Step-by-Step Guide
JD Tech
JD Tech
Jan 23, 2025 · Databases

Comprehensive Migration Plan for MongoDB to Alternative Data Stores

This article presents a complete MongoDB migration solution, detailing the migration rhythm, code refactoring using a decorator pattern, data source replacement with JImKV, MySQL and ES, bulk and incremental data transfer strategies, and deployment safeguards such as monitoring, gray release, and rollback to ensure a seamless cut‑over without service disruption.

DatabaseMongoDBRollback
0 likes · 8 min read
Comprehensive Migration Plan for MongoDB to Alternative Data Stores
Lobster Programming
Lobster Programming
Dec 26, 2024 · Databases

How to Migrate Tens of Millions of Rows: Strategies and Practical Steps

This article explains common data‑migration strategies such as hash‑modulo, time‑range and ID‑range sharding, and compares practical migration solutions including downtime migration, dual‑write, and an MQ + Redis approach, with detailed workflow diagrams and implementation tips.

Database ScalingMessage QueueRedis
0 likes · 8 min read
How to Migrate Tens of Millions of Rows: Strategies and Practical Steps
Xiaolei Talks DB
Xiaolei Talks DB
Dec 6, 2024 · Databases

Unlocking OceanBase: How Its Open‑Source Ecosystem Powers Modern Databases

OceanBase’s open‑source ecosystem—spanning data migration tools, developer utilities, a database proxy, and robust operational management—delivers comprehensive, open, and compatible support that enhances development, migration, and maintenance, positioning it as a competitive enterprise‑grade distributed relational database.

Database EcosystemHTAPOceanBase
0 likes · 8 min read
Unlocking OceanBase: How Its Open‑Source Ecosystem Powers Modern Databases
Zhihu Tech Column
Zhihu Tech Column
Oct 28, 2024 · Databases

TiDB Architecture, Deployment Choices, and Zhihu’s Database Platform Practices

This article explains TiDB’s distributed relational database architecture, compares Kubernetes‑based and physical‑machine deployments, and describes Zhihu’s platform‑driven approach—including TiDB Operator, TiUP, self‑service tooling, monitoring, backup, security, and FinOps—to enable efficient database management for both developers and DBAs.

Database OperationsDistributed DatabaseFinOps
0 likes · 15 min read
TiDB Architecture, Deployment Choices, and Zhihu’s Database Platform Practices
Test Development Learning Exchange
Test Development Learning Exchange
Oct 24, 2024 · Databases

Comprehensive Testing of Business Data Migration in Enterprise Applications

This article details the comprehensive process of testing business data migration in enterprise applications, covering requirements analysis, environment preparation, test planning, data validation, performance testing, security checks, rollback strategies, and feedback mechanisms to ensure accuracy and integrity.

DatabaseTestingautomation
0 likes · 8 min read
Comprehensive Testing of Business Data Migration in Enterprise Applications
DataFunSummit
DataFunSummit
Oct 17, 2024 · Big Data

Waggle Dance Based Metadata Solution at Tongcheng Travel: Architecture, Migration Strategies, and Future Outlook

This article presents Tongcheng Travel's metadata solution built on the open‑source Waggle Dance project, detailing the three‑layer architecture, challenges of a monolithic Hive Metastore, evaluated migration plans, federation implementation, migration workflow, and future directions for unified metadata governance.

Big DataFederationHive Metastore
0 likes · 11 min read
Waggle Dance Based Metadata Solution at Tongcheng Travel: Architecture, Migration Strategies, and Future Outlook
Selected Java Interview Questions
Selected Java Interview Questions
Oct 16, 2024 · Databases

Design and Implementation of Table Sharding for Loan and Repayment Applications Using ShardingSphere and SpringBoot

This article describes the end‑to‑end design, configuration, and code implementation of a 50‑table sharding solution for loan and repayment request data, covering database schema planning, historical data migration, backend query adaptation, DBA coordination, SpringBoot 3 integration, common pitfalls, and a complete demo.

DatabaseJavaMySQL
0 likes · 18 min read
Design and Implementation of Table Sharding for Loan and Repayment Applications Using ShardingSphere and SpringBoot
Go Programming World
Go Programming World
Sep 17, 2024 · Operations

Migrating Data from MacBook Air to MacBook Pro Using Migration Assistant and Manual Steps

The author details both manual and one‑click migration of roughly 500 GB and 760 000 files from an older Intel‑based MacBook Air to a new M‑chip MacBook Pro, covering setup, SSH key handling, transferred settings, and a useful cursor‑speed command.

Migration AssistantSSHdata migration
0 likes · 4 min read
Migrating Data from MacBook Air to MacBook Pro Using Migration Assistant and Manual Steps
Top Architect
Top Architect
Sep 17, 2024 · Databases

Design and Implementation of Database Table Sharding for Loan and Repayment Applications Using ShardingSphere and Spring Boot

This technical article describes how a senior architect designed, configured, and migrated loan and repayment application tables to a sharded MySQL setup using ShardingSphere, Spring Boot, and MyBatis‑Plus, covering schema design, historical data sync, dual‑write switches, code integration, and common pitfalls.

DatabaseMySQLSharding
0 likes · 19 min read
Design and Implementation of Database Table Sharding for Loan and Repayment Applications Using ShardingSphere and Spring Boot
Sohu Tech Products
Sohu Tech Products
Aug 28, 2024 · Databases

MySQL Data Migration with Double‑Write Using MyBatis Plugin

The article details how the vivo Game Center’s appointment service migrated billions of rows to a dedicated MySQL database with zero‑downtime by implementing a double‑write strategy via a custom MyBatis interceptor that mirrors updates and queries to the new database, handling full and incremental sync, primary‑key consistency, transaction limits, and final cut‑over steps.

DatabaseDouble WriteMyBatis
0 likes · 19 min read
MySQL Data Migration with Double‑Write Using MyBatis Plugin
Aikesheng Open Source Community
Aikesheng Open Source Community
Aug 22, 2024 · Databases

ActionOMS: Intelligent Performance Diagnosis for OceanBase Data Migration

The article introduces ActionOMS, a customized version of OceanBase Migration Service that adds automated performance and fault diagnosis, explains its architecture, showcases a real‑world case of Oracle‑to‑OceanBase synchronization, and demonstrates how the tool improves migration throughput and reduces latency.

ActionOMSOceanBasePerformance Diagnosis
0 likes · 11 min read
ActionOMS: Intelligent Performance Diagnosis for OceanBase Data Migration
vivo Internet Technology
vivo Internet Technology
Aug 21, 2024 · Databases

MySQL Data Migration with Double‑Write Strategy Using a MyBatis Plugin

The article details a zero‑downtime migration of a high‑traffic reservation service from a shared MySQL instance to an isolated database by employing a double‑write strategy implemented through a custom MyBatis plugin, covering full and incremental sync, consistency verification, traffic shifting, and key lessons on primary‑key handling and asynchronous write side‑effects.

DatabaseDouble WriteMyBatis
0 likes · 19 min read
MySQL Data Migration with Double‑Write Strategy Using a MyBatis Plugin
Top Architect
Top Architect
Aug 18, 2024 · Databases

Design and Implementation of Database Table Partitioning for Loan and Repayment Systems

This article details the design, planning, and step‑by‑step implementation of a database table‑partitioning solution for loan and repayment request tables, covering schema decisions, sharding strategy, historical data migration, dynamic synchronization, code examples with ShardingSphere, SpringBoot, and operational considerations for seamless migration.

ShardingShardingSphereSpringBoot
0 likes · 18 min read
Design and Implementation of Database Table Partitioning for Loan and Repayment Systems
Wukong Talks Architecture
Wukong Talks Architecture
Aug 6, 2024 · Databases

Migrating Tencent Music's Data Infrastructure from ClickHouse and Druid to StarRocks: Strategy, Implementation, and Best Practices

This article details how Tencent Music’s data‑infrastructure team migrated thousands of ClickHouse and Druid nodes to a StarRocks compute‑storage‑separated lakehouse, achieving 40‑50% cost reduction while maintaining query performance, and shares the technical challenges, solutions, and best‑practice recommendations gathered during the process.

ClickHouseCost ReductionDruid
0 likes · 19 min read
Migrating Tencent Music's Data Infrastructure from ClickHouse and Druid to StarRocks: Strategy, Implementation, and Best Practices