Data Architecture

DataFunSummit

Dec 29, 2024 · Big Data

Ant Group Data Architecture Practice and Upgrade Strategy

This article shares Ant Group's practical experience and evolution of data architecture, covering theoretical foundations, analysis of current challenges, proposed upgrade solutions based on domain‑driven design, and future outlook through complex network theory to improve scalability, governance, and resilience of large‑scale data systems.

Ant GroupData ArchitectureDomain-Driven Design

0 likes · 19 min read

Ant Group Data Architecture Practice and Upgrade Strategy

DataFunSummit

Dec 21, 2024 · Big Data

Big Data Implementation Practices and Architecture in a Foreign Bank

This article shares the foreign bank's big data implementation journey, covering background and goals, overall planning and architecture, practical insights, phased rollout, data governance, security, and Q&A, illustrating how a unified data platform, storage‑compute separation, and AI‑driven tools drive business innovation.

AIData Architecturebanking

0 likes · 19 min read

Big Data Implementation Practices and Architecture in a Foreign Bank

58 Tech

Dec 19, 2024 · Big Data

Architecture Evolution and Implementation of the Intelligent Acceleration Engine in the 58 Big Data Platform

The article details the background, architectural analysis, multi‑tenant redesign, engine selection enhancements, compatibility adaptations, stability fixes, containerized deployment, performance optimizations, and measurable business outcomes of the Intelligent Acceleration Engine upgrade using Apache Kyuubi and StarRocks within the 58 big data platform.

Apache KyuubiContainerizationData Architecture

0 likes · 12 min read

Architecture Evolution and Implementation of the Intelligent Acceleration Engine in the 58 Big Data Platform

DataFunSummit

Dec 15, 2024 · Big Data

Ant Group Data Technology’s Thoughts and Practices on Data Governance

This article shares Ant Group Data Technology’s comprehensive view on data governance, covering its concepts and framework, practical strategies such as architecture, standards, platforms and digital operations, real‑world implementations like distributed warehouses and the OneData system, and future trends involving AI and automation.

AIData ArchitectureData quality

0 likes · 14 min read

Ant Group Data Technology’s Thoughts and Practices on Data Governance

DataFunSummit

Dec 2, 2024 · Big Data

Gravitino Powers TBDS Product Architecture Upgrade with a Unified Metadata Lake

This article explains how Tencent Cloud's TBDS platform evolves its architecture by adopting Apache Gravitino as a unified metadata lake, detailing the challenges of legacy versus new lakehouse designs, storage and compute separation, unified data access, permission management, and the resulting benefits for big‑data and AI workloads.

Data ArchitectureGravitinoLakehouse

0 likes · 15 min read

Gravitino Powers TBDS Product Architecture Upgrade with a Unified Metadata Lake

DataFunSummit

Nov 19, 2024 · Databases

From DIKW to Distributed Data Warebase: Evolution of Data Systems and AI‑Driven Architecture

The article traces the progression from the human DIKW information hierarchy to its computer‑world counterpart, illustrates how a homestay platform’s data architecture evolves through relational, NoSQL, search, and data‑warehouse layers, and introduces the next‑generation distributed Data Warebase that unifies structured, semi‑structured, and vectorized knowledge to meet modern AI‑driven business demands.

AIDIKW ModelData Architecture

0 likes · 26 min read

From DIKW to Distributed Data Warebase: Evolution of Data Systems and AI‑Driven Architecture

AntData

Nov 18, 2024 · Databases

Modern Data Paradigms: From Relational Databases to Vector Retrieval and AI

This article surveys the evolution of modern data technologies—from the 4V characteristics of big data and the limitations of traditional relational databases, through the rise of NoSQL and polyglot persistence, to embedding‑driven vector search, hybrid retrieval and RAG, illustrating how each paradigm frees applications from data constraints.

Artificial IntelligenceData ArchitectureNoSQL

0 likes · 30 min read

Modern Data Paradigms: From Relational Databases to Vector Retrieval and AI

Bilibili Tech

Oct 25, 2024 · Big Data

DataFunSummit2024: Next-Generation Data Architecture Technology Summit

DataFunSummit2024, co-hosted by Bilibili, convenes industry experts, scholars, and enterprise leaders across six forums to discuss next‑generation data architecture, showcasing Bilibili’s Iceberg‑based stream‑batch innovations, AI‑BI analytics, NoETL practices, and emerging alternatives to Lambda architecture.

AI+BIBig DataData Architecture

0 likes · 3 min read

DataFunSummit2024: Next-Generation Data Architecture Technology Summit

DataFunTalk

Oct 3, 2024 · Big Data

Data Lake Technology Maturity Curve: Architecture, Design Principles, Core Functions, and Open‑Source Solutions

Amid growing data demands, this article explains the data lake technology maturity curve, detailing lake‑warehouse architectural patterns, design principles, core functionalities, and the four leading open‑source solutions (Hudi, Iceberg, Delta Lake, Paimon) to guide enterprises in building flexible, scalable, and governed data platforms.

Data ArchitectureData LakeDelta Lake

0 likes · 10 min read

Data Lake Technology Maturity Curve: Architecture, Design Principles, Core Functions, and Open‑Source Solutions

JD Tech

Sep 28, 2024 · Big Data

From Early Coding to Big Data Architecture: A Personal Journey Through Data Platforms, Cloud Migration, and System Design

The article chronicles the author’s 30‑year programming career, detailing early experiences, the evolution from JavaScript projects to large‑scale big‑data architectures, cloud migration, business‑agnostic framework design, interactive analytics, and reflections on becoming an independent software architect.

Cloud ComputingData Architecturebig data

0 likes · 24 min read

From Early Coding to Big Data Architecture: A Personal Journey Through Data Platforms, Cloud Migration, and System Design

DataFunSummit

Sep 7, 2024 · Big Data

Observations on the Third Evolution of Data Infrastructure and the Next‑Generation Data Platform Architecture

This article reviews the current state of data platforms, analyzes the third wave of data infrastructure evolution driven by databases, big data and generative AI, proposes next‑generation lakehouse and cloud‑native architectural directions, and outlines future trends and unresolved challenges for AI‑centric data platforms.

AI integrationData ArchitectureLakehouse

0 likes · 21 min read

Observations on the Third Evolution of Data Infrastructure and the Next‑Generation Data Platform Architecture

DataFunSummit

Aug 13, 2024 · Big Data

Data Cost Reduction and Efficiency: Qichacha's Data Architecture and Multi‑Cloud Unified Design

This article presents Qichacha's comprehensive data‑cost‑reduction strategy, detailing its Hadoop‑based three‑pillar architecture, layered data warehouse, Hive upgrades, unified metadata across multi‑cloud clusters, middleware choices such as Alluxio and JuiceFS, version‑compatible hybrid clouds, and Kubernetes‑driven resource orchestration to achieve scalable, low‑cost data processing.

Data ArchitectureHadoopMulti-Cloud

0 likes · 16 min read

Data Cost Reduction and Efficiency: Qichacha's Data Architecture and Multi‑Cloud Unified Design

DataFunTalk

Jul 17, 2024 · Databases

From DIKW to Distributed Data Warebase: Letting Data Emerge as Intelligence

This article explores the DIKW hierarchy, explains how data evolves into information, knowledge, and wisdom, examines traditional data models and products, critiques existing multi‑system architectures, and proposes a new distributed Data Warebase that unifies structured, semi‑structured, and vectorized knowledge to enable intelligent data-driven applications.

Artificial IntelligenceDIKWData Architecture

0 likes · 24 min read

From DIKW to Distributed Data Warebase: Letting Data Emerge as Intelligence

DataFunSummit

Jul 2, 2024 · Cloud Computing

Global Perspective on Multi-Cloud Data Architecture

The forum presents a series of technical talks on multi‑cloud data architecture, covering Xiaomi’s lake‑warehouse practice, cross‑border e‑commerce data platforms, Alluxio‑based machine‑learning acceleration, Qichacha’s cost‑effective data solutions, and Kuaishou’s Flink on Kubernetes migration, highlighting strategies, implementations, and audience benefits.

Cloud ComputingData ArchitectureMulti-Cloud

0 likes · 8 min read

Global Perspective on Multi-Cloud Data Architecture

DataFunSummit

Jun 30, 2024 · Big Data

Data Architecture, Governance, and Application Practices at XinXuan Group for Live E‑commerce

The article presents a comprehensive case study of XinXuan Group’s data ecosystem, detailing its business background, data platform construction, governance framework, technical architecture, and practical analytics applications that support live‑commerce operations and strategic decision‑making.

Data AnalyticsData ArchitectureLive E‑commerce

0 likes · 21 min read

Data Architecture, Governance, and Application Practices at XinXuan Group for Live E‑commerce

DevOps

Jun 20, 2024 · Fundamentals

Understanding the 4A Enterprise Architecture: Business, Technology, Application, and Data Architecture

This article explains the TOGAF framework and its 4A architecture model—Business, Technology, Application, and Data Architecture—detailing each domain's definition, purpose, value, and step‑by‑step guidance for creating enterprise architecture diagrams to align strategy, processes, and technology.

Data ArchitectureTOGAFapplication architecture

0 likes · 8 min read

Understanding the 4A Enterprise Architecture: Business, Technology, Application, and Data Architecture

DataFunSummit

Jun 8, 2024 · Big Data

Case Study: Building a High‑Performance Advertising Platform with ClickHouse Enterprise

This article presents a detailed case study of how EasyPoint built a scalable, stable advertising platform using ClickHouse Enterprise, covering company background, data architecture with Kafka and Druid, ClickHouse advantages, serverless resource scaling, and extensive performance benchmarks.

ClickHouseData Architectureadvertising platform

0 likes · 11 min read

Case Study: Building a High‑Performance Advertising Platform with ClickHouse Enterprise

Code Ape Tech Column

May 28, 2024 · Databases

Query Separation: A Practical Approach to Optimizing Large Table Reads

This article explains the concept of query separation, outlines its suitable scenarios, compares implementation methods such as synchronous, asynchronous, and binlog approaches, discusses storage system choices like MongoDB, HBase, and Elasticsearch, and addresses consistency and operational challenges when decoupling read workloads from write workloads.

Data ArchitectureDatabase OptimizationMQ

0 likes · 8 min read

Query Separation: A Practical Approach to Optimizing Large Table Reads

DataFunSummit

May 18, 2024 · Big Data

Building a User Profile Platform with ClickHouse at 58.com: Architecture and Optimization

This article describes how 58.com designed and implemented a large‑scale user profiling platform using ClickHouse, covering system overview, core modules, major challenges of scale, complexity and performance, and the detailed storage, query, and optimization techniques applied to meet business needs.

ClickHouseData ArchitecturePerformance Optimization

0 likes · 11 min read

DataFunTalk

May 1, 2024 · Artificial Intelligence

A Comprehensive Guide to Vector Database Architecture and Application Scenarios

This article provides a detailed overview of vector database structures, their evolution, enterprise challenges, functional features, future trends, and key use cases, illustrating how they serve as the memory engine for large AI models and support multimodal data processing in modern data architectures.

AIData Architectureenterprise

0 likes · 11 min read

A Comprehensive Guide to Vector Database Architecture and Application Scenarios