BestHub
Sign in
Tag

database synchronization

1 views collected around this technical thread.

Aikesheng Open Source Community
Aikesheng Open Source Community
Aug 22, 2024 · Databases

ActionOMS: Intelligent Performance Diagnosis for OceanBase Data Migration

The article introduces ActionOMS, a customized version of OceanBase Migration Service that adds automated performance and fault diagnosis, explains its architecture, showcases a real‑world case of Oracle‑to‑OceanBase synchronization, and demonstrates how the tool improves migration throughput and reduces latency.

ActionOMSOceanBasePerformance Diagnosis
0 likes · 11 min read
ActionOMS: Intelligent Performance Diagnosis for OceanBase Data Migration
vivo Internet Technology
vivo Internet Technology
Jul 3, 2024 · Databases

End-to-End Data Consistency Verification for MySQL in DTS

The Vivo Internet Storage R&D team's article describes an end‑to‑end MySQL data‑consistency verification tool for DTS that uses fixed‑size chunking and CRC32/MD5 fingerprint aggregation to quickly compare source and target tables, pinpoint mismatched rows, and enable automated or manual correction while minimizing impact on replication.

CRC32ChunkingDTS
0 likes · 13 min read
End-to-End Data Consistency Verification for MySQL in DTS
Sanyou's Java Diary
Sanyou's Java Diary
Jun 17, 2024 · Backend Development

How to Keep Cache and Database Consistent? Proven Strategies and Common Pitfalls

This article explains why cache‑DB consistency is a long‑standing challenge, compares naive full‑load and delete‑cache approaches, analyzes concurrency and failure scenarios, and presents reliable solutions such as updating the database first followed by cache deletion using message queues or binlog subscriptions.

Cache ConsistencyMessage QueueRedis
0 likes · 19 min read
How to Keep Cache and Database Consistent? Proven Strategies and Common Pitfalls
Architecture & Thinking
Architecture & Thinking
Aug 30, 2023 · Backend Development

How to Ensure Cache‑Database Consistency: Strategies, Pitfalls, and Best Practices

This article examines data consistency between Redis cache and MySQL database, explains common cache execution strategies such as Cache‑Aside, Read‑Through, Write‑Through, and Write‑Behind, analyzes four update sequences for consistency risks, and proposes solutions like delayed double‑delete, transactional guarantees, retry mechanisms, and binlog‑based cache invalidation.

Cache ConsistencyDistributed SystemsRedis
0 likes · 18 min read
How to Ensure Cache‑Database Consistency: Strategies, Pitfalls, and Best Practices
Aikesheng Open Source Community
Aikesheng Open Source Community
Mar 21, 2022 · Databases

MySQL‑to‑DBLE Data Synchronization Using DTLE: Full and GTID‑Based Incremental Sync Guide

This article provides a step‑by‑step tutorial on deploying a DBLE cluster, configuring sharding.xml, db.xml and user.xml, creating test tables, installing DTLE, performing full MySQL‑to‑DBLE data migration, then switching to GTID‑based incremental synchronization with detailed troubleshooting tips and best‑practice recommendations.

DBLEDTLEGTID
0 likes · 15 min read
MySQL‑to‑DBLE Data Synchronization Using DTLE: Full and GTID‑Based Incremental Sync Guide
360 Smart Cloud
360 Smart Cloud
Apr 1, 2021 · Databases

Using TiDB Data Migration (DM) for MySQL‑to‑TiDB Sync: Architecture, Features, Tuning and Troubleshooting

This article shares practical experience with TiDB Data Migration (DM), covering its background, architecture, key features, online DDL support, common error handling such as duplicate‑key issues, large‑scale import tuning, configuration limits, and cleanup recommendations for reliable MySQL‑to‑TiDB synchronization.

DMMySQLPerformance Tuning
0 likes · 16 min read
Using TiDB Data Migration (DM) for MySQL‑to‑TiDB Sync: Architecture, Features, Tuning and Troubleshooting
Top Architect
Top Architect
Sep 25, 2020 · Databases

Introduction to ClickHouse: Installation, MySQL Migration, Performance Testing, and Best Practices

This article introduces ClickHouse, a column‑store OLAP database, explains its advantages over row‑store systems, guides installation on macOS, details migration strategies from MySQL, presents performance benchmarks showing 200‑fold speedups, and discusses synchronization methods, pitfalls, and practical tips.

ClickHouseColumnar DatabaseMySQL
0 likes · 6 min read
Introduction to ClickHouse: Installation, MySQL Migration, Performance Testing, and Best Practices
Qunar Tech Salon
Qunar Tech Salon
Mar 29, 2018 · Databases

Automating Test Environment Data Synchronization with Alibaba DataX and QDataManager

This article describes how a testing team replaced manual SQL updates with an automated solution using Alibaba's open‑source DataX framework and a custom QDataManager system to synchronize baseline database tables across multiple test environments, improving efficiency and reliability.

AutomationConfiguration ManagementDataX
0 likes · 6 min read
Automating Test Environment Data Synchronization with Alibaba DataX and QDataManager
Alibaba Cloud Infrastructure
Alibaba Cloud Infrastructure
Dec 29, 2015 · Databases

The Evolution and Architecture of Alibaba's Data Replication Center (DRC)

This article chronicles the development, design decisions, and technical achievements of Alibaba's Data Replication Center (DRC), a real‑time heterogeneous database synchronization platform that has become a core infrastructure for multi‑active data centers, large‑scale e‑commerce, and cloud services.

AlibabaDRCDistributed Systems
0 likes · 19 min read
The Evolution and Architecture of Alibaba's Data Replication Center (DRC)