1 views collected around this technical thread.
The article explains why using a VARCHAR(20) column to store billions of phone numbers is safer and more flexible than INT or BIGINT, covering range limits, data integrity, query convenience, interview expectations, and common pitfalls such as insufficient field length, charset issues, missing indexes, and lack of encryption.
This article examines why storing 2 billion phone numbers using INT or BIGINT is problematic and argues for using VARCHAR(20) to preserve data integrity, support international formats, simplify queries, and avoid common pitfalls in database design and development.
The article presents a lightweight tool to handle data consistency in RPC services during network timeouts by mocking or spying on service calls, ensuring data integrity without actual execution.
This article examines the conditions under which data may be lost when a Linux process crashes while writing a file, explaining page cache behavior, the roles of stdio versus system calls, dirty page handling, write‑back mechanisms, and strategies such as fflush, fsync, and direct I/O to ensure data integrity.
This article explains foreign key concepts in relational databases, showing how to create, modify, and drop foreign key constraints with SQL code, provides hands‑on exercises, discusses the pros and cons of using foreign keys, and outlines when they are appropriate or should be avoided.
The article explains why both frontend and backend data validation are essential for web applications, outlines specific validation checks for each side, and discusses the combined benefits of improving security, data integrity, user experience, and system reliability.
Vivo’s trillion‑scale data platform evolved into a dual‑active real‑time and offline architecture that leverages multi‑datacenter clusters, Kafka/Pulsar caching, a unified sorting layer, HBase‑backed dimension tables, and micro‑batch Spark jobs to deliver low‑cost, high‑performance processing, 99.9% availability, and 99.9995% data‑integrity.
This article explains MySQL InnoDB's various buffers—including the buffer pool, change buffer, log buffer, and doublewrite buffer—detailing their purposes, internal mechanisms such as LRU variants, configuration options, and how they improve performance and ensure data integrity.
This article examines Xiaohongshu's community anti‑cheat efforts, detailing the significance of fraud prevention, the black‑gray industry ecosystem, strategic defense frameworks, system architecture, and practical risk governance and detection methods for data‑inflation attacks.
This article explains fundamental database design concepts, including candidate and primary keys, attributes, relations, ER diagram components, and detailed descriptions of the first, second, third, and BC normal forms with examples and how to resolve insertion, deletion, update, and redundancy anomalies.
Database testing ensures data integrity, security, and quality by validating data mapping, ACID properties, schema, triggers, stored procedures, and field constraints through both manual and automated methods, using SQL queries, CRUD operations, and specialized tools to verify that applications interact correctly with underlying databases.
This article provides a comprehensive overview of relational database fundamentals, covering common DBMS products, SQL language components, integrity constraints, transactions, locking, views, stored procedures, indexes, normalization, key differences, constraints, optimization techniques, storage engines, and performance strategies for high‑traffic sites.
This article explains practical strategies for adding a new column to a MySQL table with tens of millions of rows, including creating a temporary table, copying data, renaming tables, and alternative replica‑based or third‑party methods to avoid long locks and potential crashes.
The article explains blockchain as a decentralized, tamper‑proof distributed ledger built from a peer‑to‑peer network, block structure, consensus, cryptography and smart contracts, outlines its evolution from information to value internet, classifies public, consortium and private chains, and details Tencent Cloud’s BaaS platform, Zhixin Chain evidence services, and various technical solutions and use‑cases such as data integrity, supply‑chain traceability and asset tokenization.
This article explains why URLs and their parameters must be encoded during testing, covering readability, completeness, reserved characters, non‑ASCII symbols, and unsafe characters, and provides practical examples to ensure reliable data transmission and correct parameter parsing.
This article outlines the end‑to‑end design of automotive finance risk‑control processes, discusses key data integrity and customer segmentation considerations, and details machine‑learning modeling practices—including logistic regression, decision trees, GBDT, XGBoost, LightGBM and CatBoost—along with an automated platform to streamline model development and deployment.
This article explains the core concepts of HDFS—including its block, packet, and chunk structures, their roles in data streaming, the detailed write and read workflows, and how checksums ensure data integrity—providing a comprehensive overview for anyone working with Hadoop distributed storage.
Silent data corruption, an often invisible yet pervasive threat to data integrity, can affect both on‑premises and cloud storage, and requires comprehensive detection, verification, and backup techniques such as ECC, CRC, RAID, ZFS/ReFS checksums, and specialized backup solutions to mitigate data loss.
The article explains silent data corruption, its detection challenges, root causes, and how standards like T10 PI (DIF) and DIX provide end‑to‑end data integrity across applications, HBA cards, storage arrays, and disks, including implementation requirements and vendor support.
This article reviews the history of Sun and Solaris, explains ZFS’s core design as a combined file system and volume manager, and details its key features such as metadata integrity, copy‑on‑write, snapshots, clones, storage pools, RAID‑Z, caching, compression, deduplication, and tunability.