BestHub
Sign in
Tagged articles
559 articles
Page 2 of 6
DataFunSummit
DataFunSummit
Jan 17, 2025 · Databases

Graph Database Applications and Architectures in DataFun Knowledge Map 3.0

The DataFun Knowledge Map 3.0’s graph database module, presented by Ant Group expert Cui Anqi, outlines how graph databases enhance complex analysis through risk‑control architectures, user‑relationship recommendation, data‑governance, a new graph‑based data management system, and the GraphRAG framework, while also offering a free download link.

AIGraph Databasedata governance
0 likes · 3 min read
Graph Database Applications and Architectures in DataFun Knowledge Map 3.0
DataFunSummit
DataFunSummit
Jan 1, 2025 · Big Data

Douyin Group Data Asset Management Platform: Full‑Stack Data Lineage Evolution and Applications

This article introduces Douyin Group’s end‑to‑end data asset management platform, explains the evolution and architecture of its large‑scale data lineage system, presents quality metrics and ecosystem components, and outlines practical applications and future directions for data governance, development, and security.

Data Asset PlatformData LineageDouyin
0 likes · 16 min read
Douyin Group Data Asset Management Platform: Full‑Stack Data Lineage Evolution and Applications
Data Thinking Notes
Data Thinking Notes
Dec 24, 2024 · Big Data

Unlock Business Growth with the Three‑Element and Four‑Movement Data Asset Framework

This article explains why data is a new production factor, introduces the “three elements” (organization & awareness, processes & standards, platforms & tools) and the “four‑movement” (inventory, assessment, governance, sharing) framework for data asset operation, and shows how it drives digital transformation, efficiency and innovative business models.

Big DataEnterprise Datadata asset
0 likes · 4 min read
Unlock Business Growth with the Three‑Element and Four‑Movement Data Asset Framework
JD Retail Technology
JD Retail Technology
Dec 24, 2024 · Industry Insights

How JD Retail Automates AB Experiment Data Pipelines with Data Weaving

This article analyzes JD Retail's approach to automating AB experiment workflows by introducing a data‑weaving framework that unifies metric definitions, streamlines logical data modeling, and enables scalable, real‑time DAG orchestration across multiple experiment scenarios.

AB testingData PlatformData weaving
0 likes · 21 min read
How JD Retail Automates AB Experiment Data Pipelines with Data Weaving
DataFunSummit
DataFunSummit
Dec 21, 2024 · Big Data

Big Data Implementation Practices and Architecture in a Foreign Bank

This article shares the foreign bank's big data implementation journey, covering background and goals, overall planning and architecture, practical insights, phased rollout, data governance, security, and Q&A, illustrating how a unified data platform, storage‑compute separation, and AI‑driven tools drive business innovation.

AIData ArchitectureStorage Compute Separation
0 likes · 19 min read
Big Data Implementation Practices and Architecture in a Foreign Bank
Data Thinking Notes
Data Thinking Notes
Dec 19, 2024 · Information Security

Unveiling 41 Official Data Terms: What They Mean for China’s Data Infrastructure

This article compiles the official definitions released by China’s National Data Bureau and other agencies for 41 data‑related terms, explains the concepts of data infrastructure, privacy‑preserving computing, trusted data spaces, and blockchain, and outlines how these definitions guide the nation’s data‑driven development strategy.

BlockchainData InfrastructurePrivacy Computing
0 likes · 25 min read
Unveiling 41 Official Data Terms: What They Mean for China’s Data Infrastructure
JD Retail Technology
JD Retail Technology
Dec 19, 2024 · Big Data

JD.com Data Governance: Architecture, Key Technologies, and Future Directions

JD.com’s data‑governance framework combines a health‑score‑driven, automated platform that cross‑verifies audit logs, builds full‑link and operator‑level lineage, introduces standard fields, and optimizes resource mixing, task staggering, and cross‑datacenter scheduling, while targeting real‑time AI‑enhanced detection and full automation.

Data LineageJD.comResource Optimization
0 likes · 15 min read
JD.com Data Governance: Architecture, Key Technologies, and Future Directions
DataFunSummit
DataFunSummit
Dec 16, 2024 · Big Data

Empowering Manufacturing Digital Transformation with Data: Architecture, Challenges, and Solutions

This article explains how data can empower the digital transformation of traditional manufacturing, covering background policies, challenges in building industrial data indicator systems, overall architecture design, technical and business considerations, and practical solutions such as the 4+4 principle, KPI loops, and case studies.

AICloud ComputingManufacturing
0 likes · 16 min read
Empowering Manufacturing Digital Transformation with Data: Architecture, Challenges, and Solutions
Data Thinking Notes
Data Thinking Notes
Dec 10, 2024 · Big Data

Why Data Asset Inclusion in Financial Statements Is the Next Competitive Edge for Enterprises

The article explains how recent policies make data asset inclusion in financial statements essential, outlines the concepts of data resources, assets and factors, describes the governance, assessment and lifecycle processes, and shows how this practice can boost financing, valuation and digital transformation for companies, economies and nations.

Data Managementdata assetdata governance
0 likes · 30 min read
Why Data Asset Inclusion in Financial Statements Is the Next Competitive Edge for Enterprises
DataFunSummit
DataFunSummit
Dec 10, 2024 · Big Data

JD.com’s Big Data Governance: Practices, Key Technologies, and Future Outlook

This article presents JD.com’s comprehensive big‑data governance experience, detailing the background and challenges, the automated governance platform and its core technologies such as audit logs and full‑link lineage, strategies for resource optimization, and the roadmap toward real‑time, intelligent, and fully automated data governance.

Data LineageJD.comResource Optimization
0 likes · 14 min read
JD.com’s Big Data Governance: Practices, Key Technologies, and Future Outlook
DataFunSummit
DataFunSummit
Dec 5, 2024 · Big Data

Ping An Financial Services' Big Data Platform Construction and Data Governance Practices

This article details Ping An Financial Services' journey in building a comprehensive big‑data platform, addressing fragmentation, low data timeliness, processing limits, and governance challenges through a four‑stage technical evolution, modular tool development, and a systematic data‑governance framework to support its digital transformation.

Financial Servicesdata engineeringdata governance
0 likes · 16 min read
Ping An Financial Services' Big Data Platform Construction and Data Governance Practices
DataFunSummit
DataFunSummit
Nov 27, 2024 · Artificial Intelligence

Applying Large Language Models in Data Management and Risk Control at Ping An One Wallet

This presentation details how Ping An One Wallet leverages large language models across five key areas—current application status, data management, risk control, technical architecture, and a Q&A session—highlighting strategies such as vectorized rule storage, prompt engineering, RAG enhancements, and workflow agents to improve efficiency and accuracy in data governance and fraud detection.

AI ArchitectureVector Databasedata governance
0 likes · 16 min read
Applying Large Language Models in Data Management and Risk Control at Ping An One Wallet
ByteDance Data Platform
ByteDance Data Platform
Nov 27, 2024 · Big Data

Inside Douyin’s Data Asset Platform: Transforming Data Lineage and Governance

Douyin Group’s data asset management platform introduces a systematic "manage, find, use" approach that unifies metadata collection, full‑coverage data lineage, and a suite of applications across development, governance, asset utilization, and security, while outlining its architecture, modeling, quality metrics, and future roadmap.

Data LineageMetadata Managementdata governance
0 likes · 14 min read
Inside Douyin’s Data Asset Platform: Transforming Data Lineage and Governance
Data Thinking Notes
Data Thinking Notes
Nov 19, 2024 · Big Data

Unlocking Data Value: The Four Stages of Enterprise Data Asset Realization

This article explains how enterprises transform raw data into valuable assets through four development stages, a triple‑entry accounting theory, and a detailed end‑to‑end process that covers data collection, resource building, product development, trading, evaluation, and financialization.

Big Datadata assetdata governance
0 likes · 14 min read
Unlocking Data Value: The Four Stages of Enterprise Data Asset Realization
JD Retail Technology
JD Retail Technology
Nov 19, 2024 · Big Data

Building an Intelligent Data Governance System with Active Metadata: JD Retail Experience

This article details JD Retail's experience building an intelligent data governance system using proactive metadata, covering challenges in data management, the design of a comprehensive governance framework, lifecycle evaluation models, and automated data backfill solutions to improve efficiency, cost control, and operational safety.

Data Fabricactive metadatadata governance
0 likes · 20 min read
Building an Intelligent Data Governance System with Active Metadata: JD Retail Experience
DataFunTalk
DataFunTalk
Nov 10, 2024 · Big Data

Douyin Group Data Asset Management Platform and Data Lineage Architecture Overview

This article provides a comprehensive overview of Douyin Group's data asset management platform, detailing the evolution, architecture, and applications of its large‑scale data lineage system, and discusses future directions for enhancing data quality, cost efficiency, and security across the organization.

Data LineageMetadata Managementdata governance
0 likes · 15 min read
Douyin Group Data Asset Management Platform and Data Lineage Architecture Overview
Data Thinking Notes
Data Thinking Notes
Nov 7, 2024 · Fundamentals

What’s Inside China’s New National Data Standard System Guide?

The Chinese government has issued a comprehensive ‘National Data Standard System Construction Guide’ that outlines a roadmap to build a unified data standards framework by 2026, detailing design principles, system architecture, core standard categories, and providing a downloadable full guide.

Big DataInformation Managementdata governance
0 likes · 6 min read
What’s Inside China’s New National Data Standard System Guide?
Data Thinking Notes
Data Thinking Notes
Nov 5, 2024 · Big Data

How a Next‑Gen Data Management Platform Boosts Efficiency and Innovation

This article outlines the motivations, objectives, and architectural design of a next‑generation data management platform, detailing its four‑layer “four‑ization” approach, core services such as data integration, modeling, API provisioning, componentization, as well as governance, security, and operational best practices.

Big DataData PlatformData Warehouse
0 likes · 20 min read
How a Next‑Gen Data Management Platform Boosts Efficiency and Innovation
58 Tech
58 Tech
Oct 28, 2024 · Databases

Design and Practices of Multi‑Tenant Database Management in the QiaoFang SaaS System

This article examines the QiaoFang SaaS platform’s multi‑tenant database architecture, tenant data governance, multi‑partition service design, and operational practices such as database operations, cleanup, and monitoring, highlighting the challenges and solutions for large‑scale real‑estate brokerage services.

Database ArchitectureMulti‑tenantSaaS
0 likes · 17 min read
Design and Practices of Multi‑Tenant Database Management in the QiaoFang SaaS System
Data Thinking Notes
Data Thinking Notes
Oct 24, 2024 · Big Data

Why Data Metrics Matter: Building Effective Indicator Systems

Understanding what data metrics are, how to construct comprehensive indicator systems, and why they are essential for data‑driven decision‑making, operational efficiency, and unified statistical standards is crucial for businesses seeking to leverage big‑data technologies and improve strategic outcomes.

Big DataBusiness AnalyticsIndicator System
0 likes · 12 min read
Why Data Metrics Matter: Building Effective Indicator Systems
DataFunSummit
DataFunSummit
Oct 20, 2024 · Operations

Data Metrics and Their Role in Business Operations: Current Challenges, Applications, and Future Outlook

This article examines the relationship between data metrics and business applications, outlines the current state and challenges of data metric usage, explains how metrics drive data‑driven operations, describes a step‑by‑step approach to building an application‑oriented metric system, and looks ahead to future trends in metric governance and automation.

business operationsdata governancedata metrics
0 likes · 25 min read
Data Metrics and Their Role in Business Operations: Current Challenges, Applications, and Future Outlook
Data Thinking Notes
Data Thinking Notes
Oct 15, 2024 · Fundamentals

Why Data Modeling Matters: Unlock Business Value and Governance

This article explains how data modeling drives business value by sparking conversations about data meaning, enabling the creation of useful data objects, and guiding smart decisions on data capture, storage, usage, and integration, while also outlining a governance framework for managing enterprise data models.

Data ManagementEnterprise Databusiness value
0 likes · 4 min read
Why Data Modeling Matters: Unlock Business Value and Governance
DataFunTalk
DataFunTalk
Oct 11, 2024 · Artificial Intelligence

E‑commerce Innovation and Data Governance: Summaries of Recent Research Topics

This article compiles concise overviews of recent e‑commerce research, covering real‑time online learning re‑ranking models, causal inference for user growth, full‑link data lineage, TikTok's data governance and attribution solutions, Volcano Engine's metric management, AI Agent applications on 1688, and XinXuan Group's live‑stream data architecture.

AIData LineageOnline Learning
0 likes · 5 min read
E‑commerce Innovation and Data Governance: Summaries of Recent Research Topics
Data Thinking Notes
Data Thinking Notes
Sep 29, 2024 · Operations

Why State-Owned Enterprises Struggle with Digital Transformation: Key Challenges and Insights

State-owned enterprises face unclear digital transformation goals, weak strategic positioning, fragmented data governance, talent shortages, and an underdeveloped technology ecosystem, which together hinder the realization of value benefits and impede effective digital innovation across the organization.

State-owned EnterprisesTalent Gapdata governance
0 likes · 17 min read
Why State-Owned Enterprises Struggle with Digital Transformation: Key Challenges and Insights
Data Thinking Notes
Data Thinking Notes
Sep 24, 2024 · Artificial Intelligence

Leveraging Large Models to Transform Data Governance: Quality, Cost, Efficiency

This article explains how large language models enhance data governance by improving data quality, reducing implementation costs, and increasing operational efficiency through knowledge bases and interactive prompt libraries, and it also outlines practical empowerment pathways for organizations seeking to leverage AI-driven analytics.

AICost ReductionEfficiency
0 likes · 3 min read
Leveraging Large Models to Transform Data Governance: Quality, Cost, Efficiency
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Sep 13, 2024 · Big Data

How Qimao Scales 20PB Data with StarRocks, Flink, and Real‑Time Analytics

Qimao, a Shanghai‑based cultural entertainment internet firm, details its 20 PB big‑data architecture built on StarRocks, Flink, Hive, and Redis, covering data ingestion, real‑time processing, audience selection, metric anomaly drill‑down, 730‑day aggregation, and future plans for metric acceleration and full‑link data governance.

Big DataData WarehouseFlink
0 likes · 13 min read
How Qimao Scales 20PB Data with StarRocks, Flink, and Real‑Time Analytics
Data Thinking Notes
Data Thinking Notes
Sep 9, 2024 · Fundamentals

Master the 6‑Step Blueprint for Building an Enterprise Data Middle Platform

This guide outlines a practical six‑step methodology—covering overall planning, data integration, model construction, data development, asset management, and data services—to help enterprises build a robust data middle platform that unlocks business value and supports agile digital transformation.

Data PlatformEnterprise Architecturedata governance
0 likes · 10 min read
Master the 6‑Step Blueprint for Building an Enterprise Data Middle Platform
Baidu Geek Talk
Baidu Geek Talk
Sep 9, 2024 · Big Data

TDS Platform Overview: Architecture, Modules, and Features of Baidu MEG's Turing 3.0 Data Ecosystem

The TDS platform, central to Baidu MEG’s Turing 3.0 ecosystem, unifies data development, warehouse management, monitoring, and resource control through Spark‑based TDE, a visual studio, and AI‑enhanced tools like Smart Diagnosis and Text2SQL, enabling standardized workflows, scalable scheduling, and handling over 30 k daily tasks.

AIBig DataData Development
0 likes · 21 min read
TDS Platform Overview: Architecture, Modules, and Features of Baidu MEG's Turing 3.0 Data Ecosystem
DataFunSummit
DataFunSummit
Aug 28, 2024 · Big Data

Building Data Lineage Foundations and Applications for E‑commerce Scenarios

This article explains how to construct a full‑link data lineage platform for e‑commerce, detailing its architecture, quality metrics, and practical uses such as table migration, field‑level tracing, and automated metric decomposition to improve data governance and efficiency.

Data Lineagedata governancee-commerce
0 likes · 14 min read
Building Data Lineage Foundations and Applications for E‑commerce Scenarios
Data Thinking Notes
Data Thinking Notes
Aug 27, 2024 · Information Security

Understanding Data Security Regulations and Classification Standards

This article presents an overview of data security related regulations, outlines the standards for data classification and grading, and showcases industry-specific classification schemes through illustrative diagrams, providing a concise visual guide for implementing data security measures.

Data SecurityInformation SecurityRegulations
0 likes · 2 min read
Understanding Data Security Regulations and Classification Standards
Data Thinking Notes
Data Thinking Notes
Aug 20, 2024 · Artificial Intelligence

How Large AI Models Transform Data Governance: Strategies and Challenges

This article explores how the rise of massive AI models reshapes data governance, detailing model fundamentals, architectural types, emerging challenges, a five‑domain governance framework, and practical AI‑driven applications for data standards, metadata, quality, and security, while also looking ahead to future trends.

AIData SecurityLarge Models
0 likes · 14 min read
How Large AI Models Transform Data Governance: Strategies and Challenges
Eric Tech Circle
Eric Tech Circle
Aug 18, 2024 · Industry Insights

How Huawei Tackles Data Silos: Lessons from “Huawei Data Way”

Drawing from the book “Huawei Data Way”, this article explains why Huawei must digitize, describes the resulting data‑island problem, and outlines the four‑part framework of data governance—including data asset catalogs, standards, models, and distribution—while showing how business‑object‑centric information architecture is built and implemented.

Enterprise ArchitectureHuaweidata governance
0 likes · 6 min read
How Huawei Tackles Data Silos: Lessons from “Huawei Data Way”
Data Thinking Notes
Data Thinking Notes
Aug 15, 2024 · Big Data

How to Build a Scalable Data Warehouse: Theory, Architecture, and Best Practices

This article outlines practical approaches to data warehouse construction, covering dimensional modeling, layered architecture, capability development, real‑time and batch processing with technologies like Hive, Spark, Flink, Iceberg, and discusses governance, security, and future trends toward data value and real‑time metrics.

Data WarehouseIcebergLambda architecture
0 likes · 13 min read
How to Build a Scalable Data Warehouse: Theory, Architecture, and Best Practices
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Aug 14, 2024 · Big Data

Understanding Data Middle Platform: Value, Architecture, and Real‑World Cases

This article explains the concept, value, three‑layer architecture, and practical implementations of a data middle platform, illustrating how it standardizes data, forms a middle‑office organization, and drives cost‑effective business empowerment through examples from Alibaba, NetEase, and other enterprises.

Big DataData Platformarchitecture
0 likes · 9 min read
Understanding Data Middle Platform: Value, Architecture, and Real‑World Cases
Data Thinking Notes
Data Thinking Notes
Aug 13, 2024 · Fundamentals

How to Define, Classify, and Catalog Your Enterprise Data Assets

This article explains what data assets are, how to categorize them by structure and source, outlines a six‑step inventory process, describes a hierarchical catalog architecture, and highlights the four key benefits of a unified data asset directory for modern enterprises.

Data AssetsData CatalogData Management
0 likes · 11 min read
How to Define, Classify, and Catalog Your Enterprise Data Assets
Data Thinking Notes
Data Thinking Notes
Aug 12, 2024 · Information Security

Understanding Data Governance vs Data Security Governance: Key Frameworks Explained

This article explains how data has become a strategic resource, outlines the economic and industrial value of data, differentiates data governance from data security governance, and reviews major data security frameworks and a data‑centric security architecture to guide organizations in protecting their data assets.

Data LifecycleData SecurityInformation Security
0 likes · 12 min read
Understanding Data Governance vs Data Security Governance: Key Frameworks Explained
Continuous Delivery 2.0
Continuous Delivery 2.0
Aug 1, 2024 · Fundamentals

The Essence of Data Governance: Managing Data and People

This article reflects on the challenges of data governance, emphasizing that effective governance involves not only technical data handling but also managing people, aligning responsibilities, fostering cooperation between leadership and business units, and establishing clear ownership and incentive mechanisms.

Data Managementdata governanceorganizational culture
0 likes · 4 min read
The Essence of Data Governance: Managing Data and People
Data Thinking Notes
Data Thinking Notes
Jul 30, 2024 · Information Security

Mastering Data Classification: A Practical Guide to Secure Data Grading

This article outlines the evolution of data security in China, explains why data classification and grading are central to governance, and provides a step‑by‑step framework, principles, implementation details, adjustment triggers, and practical reflections for building effective data protection strategies.

ComplianceData SecurityInformation Security
0 likes · 11 min read
Mastering Data Classification: A Practical Guide to Secure Data Grading
Data Thinking Notes
Data Thinking Notes
Jul 29, 2024 · Big Data

What Is a Data Middle Platform and How Does It Transform Enterprise Data Management?

This article explains the concept, design principles, and core components of a data middle platform, detailing its overall, functional, layered, logical, and data architectures, as well as the specific platforms for data collection, processing, organization, governance, quality, sharing, and visualization, illustrated with diagrams.

Big DataData ArchitectureData Platform
0 likes · 27 min read
What Is a Data Middle Platform and How Does It Transform Enterprise Data Management?
DataFunSummit
DataFunSummit
Jul 28, 2024 · Product Management

From 1 to N: Building and Maintaining a Tag System – Common Issues and Solutions

This article outlines the three essential steps for scaling a tag system from initial deployment to full maturity, highlights typical challenges such as incomplete functionality, business system integration, and permission management, and provides practical solutions and best‑practice recommendations for each stage.

Operationsdata governancefeature planning
0 likes · 6 min read
From 1 to N: Building and Maintaining a Tag System – Common Issues and Solutions
Data Thinking Notes
Data Thinking Notes
Jul 25, 2024 · Information Security

How Large Language Models Transform Data Security Compliance Management

This article explains how a leading insurance technology group leverages large language models to streamline data security compliance, detailing the evolution of data management, key governance challenges, multimodal AI architecture, and practical workflows for policy enforcement, risk monitoring, and asset management.

AIComplianceData Security
0 likes · 10 min read
How Large Language Models Transform Data Security Compliance Management
Data Thinking Notes
Data Thinking Notes
Jul 22, 2024 · Fundamentals

Why Data Architecture Governance Is the Key to Successful Digital Transformation

Data architecture governance, encompassing standards, security, modeling, quality, and lifecycle management, is essential for digital transformation in fast‑growing industries like express delivery, and this article outlines current challenges, traditional approaches, and a practical, phased methodology with platform support to implement effective governance.

Data ArchitectureInformation Securitydata governance
0 likes · 12 min read
Why Data Architecture Governance Is the Key to Successful Digital Transformation
Data Thinking Notes
Data Thinking Notes
Jul 11, 2024 · Big Data

How to Build a Robust Data Lineage Foundation for Scalable Business Insights

This article explains how to construct a full‑chain data lineage system, covering its overall architecture, quality measurement framework, and application layer, and demonstrates practical use cases such as handling data growth, monitoring warehouse changes, accelerating development, ensuring consistency, and automating metric decomposition in real‑world business scenarios.

Big DataData LineageData Warehouse
0 likes · 14 min read
How to Build a Robust Data Lineage Foundation for Scalable Business Insights
Data Thinking Notes
Data Thinking Notes
Jul 9, 2024 · Big Data

How to Build a Robust Enterprise Data Asset Catalog for Better Governance

This article explains why a comprehensive data asset catalog is essential for modern enterprises, outlines its core components such as inventory, metadata, data lineage, standards and access control, details step‑by‑step construction methods, and highlights key applications in governance, quality, compliance, architecture and valuation.

Big DataData CatalogData Lineage
0 likes · 13 min read
How to Build a Robust Enterprise Data Asset Catalog for Better Governance
DataFunSummit
DataFunSummit
Jul 8, 2024 · Big Data

Metric Management and Intelligent Insight Practices at MuTong Technology

This article shares MuTong Technology's comprehensive experience in metric management, covering pain points, governance, naming standards, production‑consumption workflows, cost‑ROI optimization, and the implementation of intelligent insight modules to improve data quality, efficiency, and business decision‑making.

cost optimizationdata governanceintelligent insight
0 likes · 22 min read
Metric Management and Intelligent Insight Practices at MuTong Technology
DataFunSummit
DataFunSummit
Jul 6, 2024 · Big Data

JD Tech Data Warehouse Journey, Model Management, and Tag Value Evaluation

This article shares JD Tech's experience in data warehouse evolution, model management practices, and tag value assessment, covering the company's data journey from 2013, layered warehouse architecture, modeling standards, governance, and a quantitative framework for evaluating tag effectiveness.

Model Managementdata governancetag value evaluation
0 likes · 14 min read
JD Tech Data Warehouse Journey, Model Management, and Tag Value Evaluation
Data Thinking Notes
Data Thinking Notes
Jul 4, 2024 · Big Data

How Active Metadata Revolutionizes Data Governance and Cuts Costs

This article examines the growing challenges of data management—such as asset discoverability, architectural rigidity, development quality, and rising resource costs—and presents a comprehensive data‑governance framework that leverages standards, agile architecture, development isolation, and active‑metadata‑driven lifecycle evaluation to improve efficiency, reduce expenses, and enable intelligent, automated data back‑filling.

Big DataStorage Optimizationactive metadata
0 likes · 17 min read
How Active Metadata Revolutionizes Data Governance and Cuts Costs
Data Thinking Notes
Data Thinking Notes
Jun 27, 2024 · Fundamentals

How to Build Effective Data Standards for Enterprise Governance

This article explains the concept of data standards, outlines the three main categories of data standards, describes a four‑stage implementation process, and provides a real‑world bank case study to illustrate how enterprises can establish and apply data standards for better data quality and value.

Enterprise Datadata governancedata modeling
0 likes · 11 min read
How to Build Effective Data Standards for Enterprise Governance
DataFunTalk
DataFunTalk
Jun 27, 2024 · Big Data

Data Warehouse Construction and Data Governance Practices at Wing Payment

This presentation by senior data warehouse engineer Huang Luo details Wing Payment’s end‑to‑end data warehouse build, covering background challenges, governance framework, platform architecture, layered modeling, naming standards, asset management, monitoring, and future plans, illustrating how systematic data governance drives cost reduction, efficiency, and security.

AnalyticsBig DataData Security
0 likes · 14 min read
Data Warehouse Construction and Data Governance Practices at Wing Payment
DataFunTalk
DataFunTalk
Jun 19, 2024 · Big Data

Evolution and Practices of E‑commerce Data Warehouse Governance

This article analyzes the current state, development stages, and comprehensive solutions of e‑commerce data‑warehouse governance, covering data quality, cost, security, and efficiency requirements, and presents a roadmap from early‑stage standardization to mature tool‑driven governance with future outlooks.

Big DataCost ManagementData Warehouse
0 likes · 13 min read
Evolution and Practices of E‑commerce Data Warehouse Governance
DataFunSummit
DataFunSummit
Jun 15, 2024 · Artificial Intelligence

Large‑Model‑Driven Data Governance: Technical Outlook and Research Highlights

This article reviews the rising importance of data quality for large models, explores data‑centric AI, large‑model pre‑training data engineering, and presents recent Fudan University research on using large models to improve data governance across multiple domains such as attribute normalization, geographic cleaning, compliance checking, and multimodal retrieval.

AIKnowledge Graphsdata engineering
0 likes · 19 min read
Large‑Model‑Driven Data Governance: Technical Outlook and Research Highlights
DataFunTalk
DataFunTalk
Jun 12, 2024 · Big Data

Technical Maturity Curve of Indicator Systems: Framework, Requirements, and the Role of Large Models

This article explores the technical maturity curve of indicator systems, covering data collection, modeling, production, management, governance, and application, while analyzing the security, stability, and usability requirements and discussing how large language models can enhance certain clear and complicated scenarios.

AI integrationBig DataMaturity Model
0 likes · 10 min read
Technical Maturity Curve of Indicator Systems: Framework, Requirements, and the Role of Large Models
DataFunSummit
DataFunSummit
Jun 3, 2024 · Big Data

Data Governance and Active Metadata Practices at JD Retail

The article outlines JD Retail's data management challenges—including asset awareness, architectural agility, development quality, and rising resource costs—and presents a comprehensive data governance framework that leverages data standards, agile architecture, development isolation, resource optimization, and active metadata to achieve intelligent lifecycle evaluation, automated back‑fill, and future‑oriented data fabric improvements.

Data LifecycleStorage Optimizationactive metadata
0 likes · 18 min read
Data Governance and Active Metadata Practices at JD Retail
Data Thinking Notes
Data Thinking Notes
Jun 2, 2024 · Big Data

How JD Retail’s Data Platform Boosts Efficiency with Unified Modeling and AI‑Driven Insights

This article details JD Retail’s end‑to‑end data platform, covering data asset certification, 5W2H modeling, unified query DSL, intelligent acceleration, robust governance, visualization components, low‑code orchestration, and large‑model AI applications that together reduce query latency, cut development costs, and empower analysts across the retail business.

AIBig DataData Platform
0 likes · 39 min read
How JD Retail’s Data Platform Boosts Efficiency with Unified Modeling and AI‑Driven Insights
DataFunTalk
DataFunTalk
May 28, 2024 · Big Data

Building and Managing a Metric System in Data Warehouse: Practices from Dongchedi

This article details how the Dongchedi business team designs, implements, and monitors a comprehensive metric system within its data warehouse, covering metric standards, model construction, metadata management, quality monitoring, application scenarios, and future directions using the DataLeap platform.

Big DataData WarehouseMonitoring
0 likes · 18 min read
Building and Managing a Metric System in Data Warehouse: Practices from Dongchedi
Data Thinking Notes
Data Thinking Notes
May 21, 2024 · Fundamentals

Master Data Management: Building a Unified, High‑Quality Data Backbone for Enterprises

Enterprises facing fragmented systems like OA, HR, CRM, and ERP must adopt a unified master data management framework that defines standards, governance, organizational structures, and integrated platforms to ensure data consistency, accuracy, and real‑time availability, thereby reducing maintenance costs and supporting digital transformation.

Enterprise ArchitectureMaster Datadata governance
0 likes · 16 min read
Master Data Management: Building a Unified, High‑Quality Data Backbone for Enterprises
DataFunSummit
DataFunSummit
May 13, 2024 · Big Data

Metadata‑Driven Data Governance: Concepts, Architectures, and Practices

This article explains how metadata‑driven data governance addresses the challenges of the digital economy by detailing the era background, limitations of traditional methods, the roles of Data Fabric, Data Mesh and DataOps, and presenting real‑world case studies and future directions.

AIData FabricData Mesh
0 likes · 14 min read
Metadata‑Driven Data Governance: Concepts, Architectures, and Practices
Goodme Frontend Team
Goodme Frontend Team
May 8, 2024 · Frontend Development

2024 Frontend & Tech Highlights: Node.js 22, React 19, Blockchain, AIGC Low‑Code

This curated newsletter presents the latest releases of Node.js, React, and React Native, highlights a blockchain career transition story, summarizes AIGC‑powered low‑code development, systematic data‑governance modeling, import‑statement optimization, techniques for showcasing technical depth, and design proposal guidance for the VUCA era.

AIBlockchainFrontend
0 likes · 6 min read
2024 Frontend & Tech Highlights: Node.js 22, React 19, Blockchain, AIGC Low‑Code
DataFunSummit
DataFunSummit
May 3, 2024 · Big Data

Comprehensive Guide to Enterprise Data Governance: Vision, Framework, Organization, Standards, Quality, and Security

This article presents a detailed overview of enterprise data governance, covering its vision and goals, three‑layer framework, organizational structure, institutional policies, data standards, quality management, metadata handling, security controls, lifecycle protection, and practical implementation cases.

Enterprise Datadata governance
0 likes · 14 min read
Comprehensive Guide to Enterprise Data Governance: Vision, Framework, Organization, Standards, Quality, and Security
Data Thinking Notes
Data Thinking Notes
Apr 25, 2024 · Fundamentals

Mastering Data Governance: Build High‑Quality, Secure, Traceable Business Data

This article explains how a comprehensive data governance framework—covering data quality, metadata, master data, asset management, security, and standards—can ensure high‑quality, safe, and traceable business data while outlining implementation steps, organizational roles, platform features, and assessment methods.

Data SecurityMaster Datadata governance
0 likes · 12 min read
Mastering Data Governance: Build High‑Quality, Secure, Traceable Business Data
Big Data Technology & Architecture
Big Data Technology & Architecture
Apr 21, 2024 · Big Data

Design Insights of Bilibili's Big Data Development Governance Platform

This article outlines Bilibili's five‑year journey building a comprehensive big‑data development and governance platform, detailing its user segmentation, product positioning, data map and governance product design, abstract configuration approach, operational mechanisms, value assessment, and measurable impact on data efficiency and business outcomes.

data governancedata operationsplatform design
0 likes · 11 min read
Design Insights of Bilibili's Big Data Development Governance Platform
DataFunTalk
DataFunTalk
Apr 20, 2024 · Big Data

Tencent Video Metrics Middle Platform and Lakehouse Integration: Architecture, Governance, and Practices

This article details Tencent Video’s data business, describing the design and implementation of its metrics middle platform and lake‑warehouse integration, covering architecture, governance, consistency, timeliness, usability, cost optimization, and future plans, with insights into technology choices such as Iceberg, StarRocks, and MQL.

Big DataLakehouseMetrics Platform
0 likes · 18 min read
Tencent Video Metrics Middle Platform and Lakehouse Integration: Architecture, Governance, and Practices
Data Thinking Notes
Data Thinking Notes
Apr 18, 2024 · Information Security

How to Implement Effective Data Classification and Grading for Secure Data Management

Data classification and grading, essential components of data security governance, involve defining data categories, assigning sensitivity levels, adhering to national standards, and establishing organizational processes to ensure compliant, secure, and value‑driven data handling across enterprises.

Data ManagementData SecurityInformation Security
0 likes · 20 min read
How to Implement Effective Data Classification and Grading for Secure Data Management
DataFunSummit
DataFunSummit
Apr 17, 2024 · Big Data

White‑Box Cost Governance in Big Data: Engine, Data Warehouse, and Tool Optimizations

This article presents a year‑long, white‑box cost‑governance practice for big‑data platforms, detailing the data‑governance framework, engine auto‑tuning (HBO), compression algorithm replacement, operator analysis, data‑warehouse white‑boxing, duplicate‑computation reduction, link‑depth minimisation, automation of routine governance, benefit analysis, and future plans.

cost optimizationdata governanceengine tuning
0 likes · 17 min read
White‑Box Cost Governance in Big Data: Engine, Data Warehouse, and Tool Optimizations
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Apr 16, 2024 · Big Data

MaxCompute’s Integrated Offline & Near‑Real‑Time Architecture: Transaction Table 2.0 Explained

This article explains MaxCompute’s new integrated offline‑and‑near‑real‑time architecture, Transaction Table 2.0, detailing its unified storage and compute design, automatic data governance, schema evolution, upsert and time‑travel capabilities, and how it simplifies complex big‑data pipelines while delivering minute‑level latency and lower costs.

Big DataMaxComputeSQL
0 likes · 27 min read
MaxCompute’s Integrated Offline & Near‑Real‑Time Architecture: Transaction Table 2.0 Explained
DataFunTalk
DataFunTalk
Apr 12, 2024 · Big Data

Building and Managing an Indicator System in a Data Warehouse: Practices from the Dongchedi Business

This article explains how the Dongchedi team designed, implemented, and monitored a comprehensive indicator system within a petabyte‑scale data warehouse, covering standards, metadata management, model construction, quality monitoring, and diverse application scenarios to improve data reliability and business insight.

Big DataData WarehouseIndicator Management
0 likes · 18 min read
Building and Managing an Indicator System in a Data Warehouse: Practices from the Dongchedi Business
Data Thinking Notes
Data Thinking Notes
Apr 9, 2024 · Big Data

What Is a Data Middle Platform and Why It’s Essential for Modern Enterprises

Data middle platforms transform raw enterprise data into reusable assets by integrating collection, storage, processing, governance, and service layers, enabling faster deployment, consistent metrics, improved data quality, and business value across digital transformation, while addressing challenges like siloed data, low efficiency, and inconsistent standards.

Big DataData PlatformEnterprise Architecture
0 likes · 23 min read
What Is a Data Middle Platform and Why It’s Essential for Modern Enterprises
DataFunTalk
DataFunTalk
Apr 3, 2024 · Artificial Intelligence

DataFunCon 2024 Shanghai: AI, Big Data, Cloud and Industry Forum Program

DataFunCon 2024 Shanghai brings together leading experts from AI, big data, cloud computing, and industry sectors to discuss cutting‑edge technologies, large‑model applications, intelligent operations, and digital transformation across automotive, healthcare, finance, retail, and entertainment.

Big DataCloud Computingdata governance
0 likes · 69 min read
DataFunCon 2024 Shanghai: AI, Big Data, Cloud and Industry Forum Program
DataFunTalk
DataFunTalk
Mar 29, 2024 · Big Data

Best Practices for Building an International Ride‑Hailing Data Metric System at Didi

This article outlines Didi’s best‑practice approach to constructing a global ride‑hailing data metric system, covering business scenarios, metric categories, pain points such as definition and technical challenges, and a comprehensive solution involving organizational structure, processes, model design, tooling, timezone handling, and governance.

Data ArchitectureDidiMulti‑Timezone
0 likes · 13 min read
Best Practices for Building an International Ride‑Hailing Data Metric System at Didi
DataFunTalk
DataFunTalk
Mar 27, 2024 · Big Data

Data Collection Quality Review: From Compliance to Reasonableness and Toolchain Overview

This article explores data collection governance by distinguishing data quality compliance from reasonableness, introduces a comprehensive quality review tool suite—including visual inspection, intelligent judgment, and self‑diagnosis—detailing its architecture, key techniques, and practical case studies for ensuring reliable data metrics.

Big DataIntelligent JudgmentQuality Review Tools
0 likes · 19 min read
Data Collection Quality Review: From Compliance to Reasonableness and Toolchain Overview
DataFunTalk
DataFunTalk
Mar 24, 2024 · Big Data

Didi's Big Data Asset Governance Practices: Hadoop and Elasticsearch Governance

This article details Didi's comprehensive big‑data asset governance platform, covering its architectural layers, Hadoop and Elasticsearch governance practices, health‑score models, lifecycle recommendations, and future plans for automated and intelligent data governance to reduce cost and manual effort.

Big DataElasticsearchHadoop
0 likes · 17 min read
Didi's Big Data Asset Governance Practices: Hadoop and Elasticsearch Governance
DataFunSummit
DataFunSummit
Mar 15, 2024 · Product Management

How to Build a Good Data Platform: Insights from Tencent’s Senior Product Manager

This presentation shares the speaker’s experience and practical methods for creating an effective data platform, covering the transition from technical roles to product management, deep understanding of data workers' needs, Tencent Oura asset‑factory practices, a product‑management methodology, and a Q&A session that addresses governance, performance, and engineering challenges.

data engineeringdata governanceproduct-management
0 likes · 15 min read
How to Build a Good Data Platform: Insights from Tencent’s Senior Product Manager
JD Tech
JD Tech
Mar 5, 2024 · Big Data

JD Retail Data Asset Management: Upgrading Practices and Technical Innovations

This article examines JD Retail's comprehensive upgrade of data asset management, detailing innovations in data governance, multi‑level acceleration engines, intelligent materialization, unified DSL, visualization tools, low‑code orchestration, and large‑model AI applications that boost efficiency, reliability, and business decision‑making.

Data Asset ManagementLow‑codedata governance
0 likes · 43 min read
JD Retail Data Asset Management: Upgrading Practices and Technical Innovations
JD Retail Technology
JD Retail Technology
Feb 22, 2024 · Big Data

JD Retail Data Platform: Data Asset Governance, Metric Middle Platform, Visualization Tools, and AI‑Driven Applications

This technical article details JD Retail’s 2023 data platform advancements, covering data‑asset certification and governance, a metric middle‑platform for unified indicator management, sophisticated visualization components, low‑code orchestration, and large‑model AI applications that together improve data retrieval efficiency, reduce storage‑compute costs, and support rapid business decision‑making.

AIData PlatformLow‑code
0 likes · 39 min read
JD Retail Data Platform: Data Asset Governance, Metric Middle Platform, Visualization Tools, and AI‑Driven Applications
ByteDance Data Platform
ByteDance Data Platform
Feb 21, 2024 · Big Data

How ByteDance’s DataLeap Automates Big Data Governance and Boosts Performance

ByteDance’s DataLeap suite tackles the complexities of large‑scale data platform governance by identifying manual tuning pain points, deploying automated rule‑engine recommendations, and optimizing resource allocation, ultimately improving stability, reducing costs, and enhancing overall system health across thousands of Spark, Flink and other tasks.

Resource Optimizationdata governancereal-time monitoring
0 likes · 14 min read
How ByteDance’s DataLeap Automates Big Data Governance and Boosts Performance
DataFunTalk
DataFunTalk
Feb 17, 2024 · Big Data

JD Logistics One‑Stop Agile BI Solution: Architecture, Challenges, and Optimization

This article presents JD Logistics' one‑stop agile BI platform, detailing the complex data sources, rapid requirement changes, and Chinese‑style reporting challenges it addresses, while outlining the UData solution, product methodology, performance enhancements, and real‑world case studies that demonstrate significant efficiency gains.

Agile AnalyticsBIBig Data
0 likes · 26 min read
JD Logistics One‑Stop Agile BI Solution: Architecture, Challenges, and Optimization
DataFunTalk
DataFunTalk
Feb 15, 2024 · Big Data

Data Quality Review: From Compliance to Reasonableness and Toolchain Overview

This article explores data collection governance by distinguishing compliance from reasonableness, introduces a comprehensive quality review tool system—including visual inspection, intelligent judgement, and self‑diagnosis—details key techniques such as comparison operators and sampling, and outlines a three‑layer architecture and future directions for data quality assurance.

Big Datadata governancedata sampling
0 likes · 18 min read
Data Quality Review: From Compliance to Reasonableness and Toolchain Overview
Data Thinking Notes
Data Thinking Notes
Jan 30, 2024 · Operations

How Banks Can Build an Effective Data Governance Framework

This article outlines a two‑step approach for banks to design a data governance system—clarifying organizational responsibilities and constructing a layered institutional framework—while detailing cross‑department collaboration, head‑office and branch coordination, and practical policy, procedure, and work‑detail levels to sustain continuous improvement and support digital transformation.

Data ManagementOperationsbanking
0 likes · 10 min read
How Banks Can Build an Effective Data Governance Framework
DataFunSummit
DataFunSummit
Jan 29, 2024 · Big Data

Building Bilibili's Data Service Middle Platform: Architecture, Practices, and Future Plans

This article presents Bilibili's data service middle platform, detailing its background, pain points of traditional data acquisition, the one‑stop service architecture, core processes, model and API construction, query mechanisms, practical solutions for full‑link control, cost reduction, efficiency gains, high‑availability design, and future roadmap.

APIdata governancedata services
0 likes · 19 min read
Building Bilibili's Data Service Middle Platform: Architecture, Practices, and Future Plans
政采云技术
政采云技术
Jan 24, 2024 · Big Data

A Business Analyst’s End‑to‑End Journey Using a Data Middle Platform: From Issue Identification to Data‑Driven Solutions

The article walks through a detailed, real‑world scenario where a business analyst leverages a data middle platform—covering metric analysis, exploratory queries, data development, visualization, and productization—to diagnose a 30% sales decline and implement data‑driven remediation, illustrating core concepts such as OneData and OneService.

AnalyticsData Developmentdata governance
0 likes · 12 min read
A Business Analyst’s End‑to‑End Journey Using a Data Middle Platform: From Issue Identification to Data‑Driven Solutions
DataFunTalk
DataFunTalk
Jan 22, 2024 · Big Data

Design and Implementation of Bilibili's Big Data Development Governance Platform

This article details Bilibili's five‑year development of a comprehensive big‑data governance platform, covering its usage scenarios, product positioning, data map and governance solutions, abstract configuration approach, operational mechanisms, and future plans, highlighting significant improvements in data efficiency and value assessment.

BilibiliData Valuebig data platform
0 likes · 10 min read
Design and Implementation of Bilibili's Big Data Development Governance Platform
DataFunTalk
DataFunTalk
Jan 20, 2024 · Big Data

How ByteDance Leverages the Data Flywheel in Large‑Scale Projects

This article explains how ByteDance (Douyin) transforms its data infrastructure from isolated workshops to a unified middle platform and finally to a data flywheel, detailing the three development stages, the Data BP organizational model, real‑time analytics, A/B testing, and the resulting business benefits for large‑scale event projects.

Big DataData Flywheeldata engineering
0 likes · 13 min read
How ByteDance Leverages the Data Flywheel in Large‑Scale Projects
DevOps
DevOps
Jan 17, 2024 · Operations

Agile Data Management: Principles, Practices, and Implementation Guide

This article explains how agile methodologies can be applied to data management, covering the need for agile data practices, core principles, iterative modeling, governance, CI/CD pipelines, tooling, metrics, security, case studies, challenges, and future outlooks in a comprehensive, step‑by‑step guide.

Data ManagementDataOpsagile
0 likes · 13 min read
Agile Data Management: Principles, Practices, and Implementation Guide