This guide explains Vanna, an open‑source Python RAG framework for Text2SQL, covering its core concepts, RAG‑based architecture, step‑by‑step model training, code examples for customization, and how to deploy a conversational database chatbot with a Flask web UI.
This article explains Redis high‑availability through master‑slave replication, covering the architecture, read‑write separation benefits, the three‑stage initial sync process, incremental synchronization, and practical considerations for scaling and fault tolerance in production environments.
This guide shows how to install ThinkORM for PHP 8, then demonstrates inserting, querying, and updating JSON‑type columns both with raw queries and model classes, covering whole‑JSON operations, conditional searches, and handling JSON arrays in a ThinkPHP environment.
This article provides a comprehensive guide to using PyMySQL in Python, covering installation, connection setup, CRUD operations, transaction handling, advanced features like parameterized queries and connection pooling, as well as best practices for security, performance, and monitoring.
This article explains why using OFFSET and LIMIT for pagination becomes a performance bottleneck on massive tables, illustrates the cost of full‑table scans, and introduces a cursor‑based pagination technique that leverages primary‑key ordering for efficient data retrieval.
MongoDB’s locking system uses a hierarchical resource model with four lock modes, RAII‑style acquisition classes, ticket‑based throttling, and a bucketed lock manager that employs bit‑mask conflict checks and priority flags to grant exclusive locks promptly and prevent starvation.
This article walks readers through building a complete vaccine management desktop application using Python's Tkinter for the graphical interface and MySQL for data storage, covering UI design, database connection, user registration, login, CRUD operations for vaccine records, and query functionalities, all illustrated with full source code examples.
Linear, the SaaS project‑management tool, suffered a catastrophic data loss when a TRUNCATE CASCADE command unintentionally wiped production tables, prompting a detailed post‑mortem that outlines the timeline, root cause, recovery steps, impact, and a set of concrete preventive measures.
This article explains how to select appropriate sharding keys based on business requirements and data access patterns, describes vertical and horizontal partitioning methods, and presents common techniques such as equal‑value, index, and gene methods along with key generation strategies like auto‑increment, UUID, Snowflake algorithm, and open‑source middleware.
This article explains how to use PHP's mysqli_query function to perform MySQL operations such as SELECT, INSERT, UPDATE, and DELETE, providing a step‑by‑step example that creates a connection, runs a SELECT query, processes results, and handles errors and cleanup.
This article explains MySQL deadlocks, describing how they occur in InnoDB due to resource contention, outlines common causes such as race conditions, poor indexing, long transactions, lock upgrades, and provides practical prevention strategies including deadlock detection, short transactions, query optimization, lock timeouts, monitoring tools, lock ordering, and appropriate lock levels.
This article explains why using OFFSET and LIMIT for pagination on large tables leads to costly full‑table scans and poor performance, and introduces keyset (cursor) pagination as a faster, index‑driven alternative while discussing its requirements and trade‑offs.
This article summarizes essential MySQL concepts—including basic terminology, data types, SQL commands, indexes, views, storage engines, backup methods, and performance tuning techniques—to help developers understand and effectively apply this powerful open‑source relational database in real‑world projects.
This article demonstrates how to use Spring Data R2DBC with Spring Boot 3 to perform reactive 1‑to‑1 and 1‑to‑many database operations, covering environment setup, entity definitions, repository queries, custom converters, and unit testing for full‑stack backend development.
This article explains how to locate, trace, and resolve a syntax error that occurs when a stored procedure migrated from Oracle to OceanBase fails, detailing the use of trace IDs, SQL reconstruction, cursor analysis, and the necessary adjustments to primary‑key handling.
This article introduces Python's DB-API for database interaction, lists supported databases, demonstrates basic MySQL operations with PyMySQL and SQLAlchemy, explains preventing SQL injection, and shows how to implement connection pooling using DBUtils with examples of threaded usage and utility functions.
This article explains the concept of MySQL connection pools in PHP, demonstrates how to create, use, and correctly close both individual connections and pooled connections using mysqli functions and a custom pool class, and highlights the importance of releasing resources to maintain application performance.
This article outlines the step‑by‑step process for implementing a product promotion push feature in a PHP‑based e‑commerce platform, covering target user identification, promotion table design, message templating, script development, database queries, cron scheduling, and result monitoring to boost user engagement and sales.
This article introduces KeyDB, a high‑performance multithreaded fork of Redis, explaining its architecture, thread model, connection management, fastlock mechanism, and active‑replica features, while providing code examples and performance comparisons, and highlighting their impact on throughput and latency.
This guide explains Redis's three clustering modes—master‑slave, Sentinel, and Cluster—detailing their architectures, failover mechanisms, PSYNC replication, configuration files, Spring Boot integration, and step‑by‑step testing to achieve high availability and scalability.
Oracle announced preview support for JavaScript‑based stored procedures in MySQL, showing how to write, call, and debug them using GraalVM, while industry reactions highlight both excitement and concerns about mixing languages in database logic.
This article outlines a step‑by‑step guide for building a PHP‑based product promotion push system for e‑commerce platforms, covering recipient identification, database schema design, message templating, script development, scheduling with crontab, and result monitoring to boost user engagement and sales.
This article explains how MySQL InnoDB handles update, delete, and select statements within read and read‑only transactions, detailing when a read transaction becomes read‑write, the allocation of transaction IDs, rollback segments, and the role of lock types for ordinary and temporary tables.
This tutorial explains how to use PyCharm’s integrated database tool to create, configure, test, and manage a MySQL connection, including driver installation, schema selection, SQL execution, and removal of connections, with detailed visual instructions.
This article experimentally compares the efficiency of using IN clauses versus JOIN operations in MySQL by testing small, medium, and large datasets, measuring query costs, execution times, and highlighting the scalability limits of IN statements.
This guide explains MySQL’s most useful date and time functions—including CURDATE(), NOW(), DATE_FORMAT(), DATEDIFF(), DATE_ADD(), DATE_SUB(), and DATE()—with clear syntax examples and sample results, helping developers manipulate temporal data efficiently in their databases.
The article reflects on the rise and fall of Lotus Notes, illustrating how this once‑dominant email, database, and workflow platform once unified company operations, why it was eventually eclipsed by web‑based apps and Microsoft tools, and what its lingering legacy reveals about technology evolution.
An in‑depth guide explains MySQL replication fundamentals, compares asynchronous, semi‑synchronous, and fully synchronous modes, and details the binlog‑based architecture with its I/O, log dump, and SQL threads, helping readers understand how replication improves scalability and data safety.
Easy-Query is a Java ORM framework offering strong-typed, database-agnostic CRUD operations, complex SQL generation, multi-table joins, group awareness, and extensive function support, demonstrated through numerous code examples covering queries, joins, subqueries, pagination, and advanced features like enum handling and anonymous type alternatives.
This article explains how to design database tables, build management pages, and develop add, edit, and delete functionalities in PHP to control coupon activity rules for an online store, including logical constraints during checkout.
This article provides a comprehensive tutorial on installing RedisInsight, configuring its environment variables, running it as a service or in Kubernetes, and using its GUI features to monitor and manage Redis instances, complete with code examples and deployment YAML.
This article explains how MySQL InnoDB implements full‑text search using inverted indexes, shows how to create and drop FULLTEXT indexes, and demonstrates natural language, boolean, and query‑expansion search modes with concrete SQL examples and operator details.
An in‑depth tutorial walks through the five core SQL language families—DDL, DML, DQL, DCL, and TCL—explaining their purposes, key commands, and practical examples, while highlighting differences and usage tips for database schema definition, data manipulation, querying, permission control, and transaction management.
Version 8.3 of MySQL introduces tagged GTID replication, a selectable JSON EXPLAIN format version, enhanced thread‑pool plugin information, changes to binlog transaction dependency tracking and new CMake options, while removing several C API functions, the FLUSH HOSTS statement, and outdated replication flags.
This article walks through the common slow Excel‑to‑DB import pattern, shows why it becomes a bottleneck, and presents three progressive optimizations—including caching, asynchronous multi‑threaded reading, and double‑async processing—along with detailed Spring @Async thread‑pool configuration and EasyExcel alternatives, all illustrated with complete Java code samples.
This comprehensive guide walks through Redis's core data structures—including strings, lists, sets, sorted sets, hashes, HyperLogLog, bitmaps, streams, and geospatial indexes—explaining their characteristics and providing concrete command‑line examples to help developers select and use the right structure for their applications.
This article provides a concise overview of China’s Xinchuang (information technology innovation) ecosystem, explaining the roles and classifications of operating systems, middleware, databases, and firmware, while highlighting global OS market shares and the strategic importance of each layer for national information security.
Taobao’s shopping cart was scaled and optimized by raising the item limit to 380, deploying the cloud‑native in‑memory read‑only replica tairSQL for read‑write separation, pre‑computing promotions, compressing payloads, caching data, redesigning the protocol, introducing response‑streaming APIs, and parallelizing per‑item processing with Java’s ForkJoinPool, dramatically cutting latency during traffic spikes.
This article explains the concept of database read‑write separation, why it improves performance in high‑concurrency scenarios, when to apply it, the underlying master‑slave replication mechanism, and provides a MySQL example illustrating the steps of replication and its benefits for scalability and availability.
This article details Baidu Cloud's BTS semi‑structured storage system, covering its three‑generation evolution, three‑layer architecture, performance optimizations, high‑availability mechanisms, and real‑world use cases such as autonomous driving and large‑scale system monitoring.
A sudden Redis outage caused a shopping homepage to take 20 seconds to load, prompting a rapid analysis of data‑volume growth, a post‑mortem of the fallback logic, and the design of a combined local‑cache, MongoDB, and database strategy to restore fast, reliable service.
This article walks through the problem of sharing a single database across pre‑release, gray, and production environments, explains why adding an env column to dozens of tables is error‑prone, and demonstrates a MyBatis interceptor‑based solution with custom annotations that isolates data while preserving backward compatibility.
This article reveals the most common Redis pitfalls—including unexpected key expiration loss, O(1) commands that block or cause OOM, master‑slave synchronization quirks, and persistence bugs—while providing practical guidance to avoid each issue and keep your cache performant and reliable.
This article explains Redis's two persistence mechanisms—Append Only File (AOF) and RDB snapshots—detailing their operation, advantages, risks, write‑back strategies, rewrite process, and how to choose the appropriate method for performance and reliability requirements.
This article explains how Just‑In‑Time (JIT) compilation, particularly via the Gandiva expression compiler built on LLVM and Apache Arrow, can dramatically accelerate database expression evaluation by transforming abstract syntax trees into native vectorized code, addressing traditional interpretation bottlenecks and improving CPU‑bound query performance.
Explore 17 practical Python scripts that automate tasks ranging from file management and web scraping to email handling, database interaction, system monitoring, and cloud services, enabling developers and analysts to boost productivity, reduce errors, and streamline workflows across diverse domains.
The article explains why counting rows in large MySQL tables—especially with InnoDB—can become slow, compares COUNT() performance across storage engines and query forms, and offers optimization tactics such as using metadata counts, EXPLAIN estimates, a dedicated counting table, or periodic batch processing for accurate or approximate results.
This guide explains MySQL stored procedure flow‑control constructs—including IF, CASE, LOOP, WHILE, REPEAT, LEAVE and ITERATE—detailing their syntax, usage patterns, and practical examples such as salary adjustments and conditional logic, helping developers implement complex database operations efficiently.
This article explains how KeyDB, a Redis fork, redesigns the single‑threaded key‑value store into a multi‑threaded system, covering its thread model, connection management, fastlock mechanism, and active‑replica features while maintaining full Redis API compatibility.
This article explains how to migrate a specific Redis database (db8) to another server's db15 by writing a Python script that batches keys, tracks progress, estimates remaining time, and verifies the migration results.
Three real-world operations mishaps are recounted—a mistaken system‑time change that logged out thousands of users, an accidental bulk delete of database accounts, and a failed glibc downgrade that stalled a software release—illustrating the cascading impact of small errors and the urgent remediation steps taken.
This article walks through a real‑world case of a slow MySQL query that took 8 seconds, explains how the original use of EXISTS and NOT EXISTS caused performance bottlenecks, and details two successive rewrites—first using JOIN + GROUP BY, then replacing NOT EXISTS with NOT IN—bringing execution time down to 0.7 seconds while highlighting key indexing and testing lessons.
This newsletter announces the SQLE 3.2401.0-pre1 release with automatic data masking, shares recent community development work, outlines upcoming plans, and curates several technical articles covering MySQL EXPLAIN enhancements, transaction fundamentals, hardware considerations for database stability, consistent backup techniques, and efficient JDBC connection testing.
This article introduces Redis Stack’s RedisJSON module, explains its JSONPath syntax, details the full set of JSON commands for handling various data types, provides practical code examples, and highlights how RedisJSON enables Redis to function as a document, full‑text, and vector search database.
This guide explains MySQL stored procedures, covering their definition, benefits, parameter types, creation syntax, delimiter handling, multiple practical examples, calling conventions, debugging tips, and hands‑on exercises, enabling developers to efficiently write, test, and manage reusable SQL routines.
Redis implements its own Simple Dynamic String (SDS) instead of plain C strings because SDS stores length for O(1) queries, pre‑allocates extra space and lazily reuses freed bytes, prevents buffer overflows, handles binary data, and uniformly backs all string keys, values and container elements.
This article provides a comprehensive, step‑by‑step analysis of MyBatis, covering its core features, three‑layer architecture, configuration file parsing, dynamic proxy generation, and the detailed process of executing SQL statements within the framework.
This article walks through the design of a billion‑user group chat platform, covering functional and non‑functional requirements, core components, database schema, face‑to‑face group creation, message flow, storage strategies, and performance‑optimizing techniques such as clustering, message queues, multithreading, and Redis caching.
This article walks through a MySQL 5.6 scenario where a sub‑query that scans 700,000 rows takes over 30,000 seconds, then demonstrates how adding single‑column and composite indexes, rewriting the query as a join, and analyzing execution plans reduces the runtime to milliseconds, highlighting best‑practice indexing techniques.
This article explains the new EXPLAIN INTO clause introduced in MySQL 8.1 for storing JSON‑formatted EXPLAIN output in a user variable and the EXPLAIN FOR SCHEMA clause added in MySQL 8.2 for running EXPLAIN on other schemas, showing how to extract costs with JSON functions and automate collection with stored procedures.
This article explains how MySQL indexes work, compares clustered and non‑clustered indexes, outlines their advantages and disadvantages, and provides practical design guidelines to improve query performance and maintainability.
This article introduces SpringBoot 3.2's JdbcClient, explains how to add the dependency, inject it, and demonstrates fluent‑API query and insert operations—including positional, named, map‑based parameters and custom RowMapper—showing how to perform CRUD without heavyweight ORM frameworks.
ByConity 0.3.0 introduces a new inverted index supporting Chinese tokenization, a shared‑storage leader election mechanism, enhanced cold‑read performance via Prefetch and adaptive mark allocation, and an upgraded ELT pipeline with BSP mode, all detailed with implementation steps, code examples, and future roadmap.
This article explains why traditional LIKE queries fail on encrypted sensitive fields, analyzes common scenarios, and presents four practical solutions—including tokenized ciphertext mapping—along with environment setup, Maven dependencies, and complete Spring Boot code to enable secure fuzzy searches on encrypted data.
This guide walks through Redis fundamentals, covering how data persists after restarts, core key operations, database selection, serialization, expiration handling, key movement, random retrieval, renaming, and how to check the number of configured databases, all with practical command examples and visual illustrations.
This article introduces Spring Boot 3.2's new JdbcClient, explains its fluent API style, shows how to add the dependency, inject it, and perform various query and insert operations with code examples, highlighting its advantages over traditional ORM frameworks.
This article explains the nature of NULL in MySQL, demonstrates why comparisons with = or != fail, shows the correct IS NULL/IS NOT NULL syntax, and discusses how NULL behaves with DISTINCT, GROUP BY, ORDER BY, and aggregate functions.
StarRocks 3.2, released on December 21, 2023, introduces major usability upgrades—including optimized random bucketing, fast schema evolution, PIPE import, HTTP SQL API, runtime profiling, enhanced storage‑compute separation, data lake analysis, and advanced materialized view capabilities—while refining existing features such as indexing, catalog support, and export syntax.
This guide introduces Spring Boot 3.2's new JdbcClient, explains how to add the dependency, inject it, and perform fluent, chainable CRUD operations—including queries by ID, custom conditions, named parameters, map parameters, row mapping, and inserts—while highlighting its advantages over traditional ORM tools.
This article explains the most common MySQL table join types—including INNER, LEFT, RIGHT, FULL OUTER, and exclusive joins—by creating sample order and customer tables, inserting data, visualizing each join with diagrams, and providing the exact SQL statements and query results.
This article examines the storage challenges faced by large‑scale internet services and evaluates popular MySQL middleware solutions—ProxySQL, MaxScale, DBProxy, MyCat, and TDDL—by mapping business requirements to their core features and capabilities.
KeyDB is a high‑performance, multithreaded fork of Redis that retains full protocol compatibility while adding features like Active Replication, flash storage support, and advanced locking, offering up to double the query throughput and reduced latency on the same hardware.
This article explains how to boost PHP application performance by using caching functions, efficient array functions, selective database queries, and recursive functions, providing clear code examples for each technique.
This article explains how to build a two-level comment system for an Android app by designing a comment database schema, creating DAO and repository layers, and using nested RecyclerViews with adapters to display primary comments and their replies, including code snippets and layout illustrations.
This article presents thirteen practical Redis performance‑optimization rules, covering avoidance of slow commands, proper key expiration handling, data‑structure selection, persistence tuning, hardware considerations, pipeline usage, client‑side improvements, and distributed architectures such as replication, sentinel and Redis Cluster, to help developers achieve significant speed gains.
This comprehensive guide explores MySQL transaction fundamentals, the ACID properties, various isolation levels, concurrency issues like dirty, non‑repeatable, and phantom reads, and dives deep into MVCC implementation, hidden fields, undo logs, and read views to help developers write reliable, consistent database code.
This article presents a comprehensive overview of precise deduplication in Meituan's Doris database, detailing the underlying bitmap data structures, aggregation bottlenecks, and a series of optimizations—including memory management, fast union, orthogonal encoding, and vectorized engine integration—that together achieve significant performance gains in high‑cardinality scenarios.
This tutorial explains how to create a MySQL database on a Linux system using PHP's mysqli extension, covering prerequisite installations, establishing a connection to the MySQL server, and executing SQL statements to create the database, with complete code examples and instructions for customizing credentials.
This article provides a step‑by‑step guide for installing the open‑source SQLE 3.0 SQL quality management platform using both RPM packages and Docker containers, covering environment preparation, configuration file adjustments, service startup, common issues, and troubleshooting tips.
This article explains the various lock types in MySQL—including global, table, row, metadata, and intent locks—how they work under InnoDB, demonstrates lock acquisition with SQL examples, and provides practical guidance for detecting and resolving deadlocks in production environments.
This article details how SelectDB’s inverted‑index, Variant data type, and sampling capabilities were integrated into GuanceDB to replace Elasticsearch, achieving up to 70% storage cost reduction, 2‑4× query speed improvement, and a ten‑fold overall cost‑performance boost for log analytics and observability workloads.
This article introduces MyBatis‑Flex, a lightweight and high‑performance MyBatis enhancement framework, outlines its key features, compares it with similar tools, presents benchmark results, lists supported databases, and provides a step‑by‑step quick‑start tutorial with complete code examples for Spring Boot integration.
This article explains MySQL index types, B+Tree structures, secondary indexes, and demonstrates how enabling Index Condition Pushdown (ICP) can accelerate a query on a 6‑million‑row table by roughly ninety times, providing detailed setup, commands, and performance results.
A junior ops engineer mistakenly set the production server clock ahead by a year, causing thousands of user accounts to expire, triggering a large‑scale outage, emergency fixes, financial loss, and harsh career consequences, while highlighting the need for proper permission and change management.
This article traces the 70‑year evolution of databases, examines how the rise of AIGC, cloud computing and AI native architectures are reshaping the industry, and details Baidu Smart Cloud's historical milestones, flagship products such as GaiaDB and PegaDB, and the emerging trends that will drive the next generation of database solutions.
The article critically examines the drawbacks of running production databases inside Docker containers or Kubernetes, arguing that while containers excel for stateless services, they introduce reliability, performance, maintenance, and complexity challenges that make them unsuitable for critical stateful database workloads.
This article explains what NoSQL databases are, outlines their typical use cases and architectural components, compares them with traditional relational databases across storage, scalability, query, and transaction aspects, and highlights the advantages and trade‑offs to consider when choosing a data solution.
The Pika community announced version 3.5.2, fixing long‑standing bugs and adding features such as Redis transaction support, a cache layer for hot‑cold data separation, dynamic Codis‑Proxy configuration, and performance improvements, while also outlining the planned enhancements for the upcoming 3.5.3 release.
This article explains MySQL's explicit and implicit locking mechanisms, illustrates how transaction isolation levels affect lock scope, provides practical SQL examples for various scenarios, and offers guidelines on when to apply pessimistic locks versus optimistic approaches to maintain database performance.
This article walks through the step‑by‑step evolution from raw JDBC to the MyBatis framework, explaining why JDBC should be wrapped, how MyBatis improves connection handling, SQL management, dynamic statements, result mapping, caching, and overall architecture with concrete code examples.
This guide presents a comprehensive set of SQL statements for the idc_evaluating database, illustrating how to retrieve rows by province or IP, count and delete active IPs, describe table structures, perform conditional aggregations, and execute inner‑join queries with calculated fields.
This article examines Baidu Search's content storage team's HTAP table storage system, detailing the challenges of supporting massive OLAP workloads on an OLTP‑oriented backend, the architectural split into Neptune and Saturn, storage‑engine optimizations such as row partitioning and dynamic columns, and a SQL‑like KQL framework for compute and scheduling.
This article experimentally compares the performance of JOIN and IN approaches for retrieving order and user data in MySQL, showing that JOIN is faster on small datasets while IN may become costly with large data volumes, and discusses code implementations and practical conclusions.
This article explains how to migrate a 240 GB MongoDB replica set by performing a full backup with oplog, extracting the incremental oplog timestamp, and then applying incremental backup and restore scripts to minimize downtime, while providing detailed shell commands and precautionary tips.
This tutorial explains how to add enum types to GORM models in Go, covering definition of enum values, model integration, CRUD operations using enums, and alternative approaches such as string fields, custom types, and GORM's built‑in enum tag to enhance type safety and database reliability.
This article debunks the common belief that MySQL VARCHAR can store up to 65535 characters, showing how the true limit depends on the chosen character set, NULLability, column count, and row‑format details, and explains how oversized values are stored or require TEXT/BLOB types.
This article explains why MySQL master‑slave replication can become delayed, outlines the differences between DDL and DML, shows how to diagnose lag with show slave status, and provides architectural, hardware, and configuration solutions—including semi‑synchronous replication and tuning parameters—to reduce latency.
This tutorial walks you through creating mount directories, configuring redis.conf, running a Redis container with Docker, and verifying the setup using redis-cli and a visual client, providing all necessary commands and explanations for a successful deployment.
SQL database queries are essential skills for data analysts, enabling them to extract, transform, and analyze data from databases through various operations like filtering, sorting, aggregation, and joining.
This article explains Python's multithreading model, covering thread creation, synchronization, data sharing, and provides practical code examples for sending concurrent API requests, downloading files, running test cases, reading files, and inserting records into a SQLite database.
