BestHub
Sign in
Tag

data lifecycle

1 views collected around this technical thread.

DataFunSummit
DataFunSummit
Jun 3, 2024 · Big Data

Data Governance and Active Metadata Practices at JD Retail

The article outlines JD Retail's data management challenges—including asset awareness, architectural agility, development quality, and rising resource costs—and presents a comprehensive data governance framework that leverages data standards, agile architecture, development isolation, resource optimization, and active metadata to achieve intelligent lifecycle evaluation, automated back‑fill, and future‑oriented data fabric improvements.

Active MetadataBig DataStorage Optimization
0 likes · 18 min read
Data Governance and Active Metadata Practices at JD Retail
DataFunTalk
DataFunTalk
Dec 5, 2023 · Big Data

Design and Practice of Xiaomi’s One‑Stop Data Production Platform

This article presents a comprehensive overview of Xiaomi’s data production platform, detailing the full data lifecycle, the technical‑driven product design methodology, the platform’s architecture and core capabilities, as well as real‑world case studies and a Q&A session that illustrate how the system improves data collection, storage, processing, and usage across the organization.

Big DataData EngineeringETL
0 likes · 17 min read
Design and Practice of Xiaomi’s One‑Stop Data Production Platform
Architects Research Society
Architects Research Society
Nov 12, 2023 · Fundamentals

Why Data Lifecycle Processes Are Crucial for an Outcome‑Driven Enterprise Data Strategy

The article explains how well‑designed data lifecycle processes—including simple, automated CRUD workflows and dedicated data stewards—are essential for managing growing data volumes, ensuring data quality, complying with regulations, and ultimately supporting outcome‑driven enterprise data strategies.

CRUDdata governancedata lifecycle
0 likes · 7 min read
Why Data Lifecycle Processes Are Crucial for an Outcome‑Driven Enterprise Data Strategy
Code Ape Tech Column
Code Ape Tech Column
Sep 7, 2023 · Databases

Hot and Cold Data Separation: Concepts, Scenarios, and Implementation Methods

The article explains the principle of hot‑cold data separation, when it should be applied, how to distinguish hot versus cold data, and three practical implementation approaches—code modification, binlog listening, and scheduled scanning—to improve database performance and maintain consistency.

Cold Databackend architecturedata lifecycle
0 likes · 9 min read
Hot and Cold Data Separation: Concepts, Scenarios, and Implementation Methods
政采云技术
政采云技术
Feb 14, 2023 · Fundamentals

Understanding Indicator Systems: Definitions, Lifecycle, and Construction Methodology

This article explains the concept of indicator systems, distinguishes result and process metrics, outlines their lifecycle stages, and details a step‑by‑step methodology for designing, naming, modeling, and productizing a comprehensive metric framework to support data‑driven business decisions.

Business IntelligenceData Analyticsdata lifecycle
0 likes · 13 min read
Understanding Indicator Systems: Definitions, Lifecycle, and Construction Methodology
Architects Research Society
Architects Research Society
Jan 5, 2023 · Fundamentals

Key Solution Architecture Focus Areas During a Project

The article outlines essential solution‑architecture considerations for complex ICT projects, covering digital data handling, information lifecycle management, process execution and orchestration, as well as reporting, and emphasizes how these fundamentals vary across domains such as manufacturing, banking, and cloud‑based systems.

data lifecycleinformation managementprocess orchestration
0 likes · 10 min read
Key Solution Architecture Focus Areas During a Project
Architects Research Society
Architects Research Society
Nov 1, 2022 · Fundamentals

Why Data Lifecycle Processes Are Crucial for a Result‑Driven Enterprise Data Strategy

The article explains why establishing simple, automated, and well‑governed data lifecycle processes—including CRUD, quality standards, and regulatory compliance—is essential for a result‑driven enterprise data strategy and outlines practical steps for designing such processes.

CRUDGDPRdata governance
0 likes · 7 min read
Why Data Lifecycle Processes Are Crucial for a Result‑Driven Enterprise Data Strategy
Architects Research Society
Architects Research Society
Jul 26, 2022 · Information Security

Data Governance: Securing the Data Lifecycle in Cloud Environments

This article explains how enterprises can implement data governance to protect data throughout its lifecycle—collection, storage, processing, and deletion—especially in public and hybrid cloud settings, outlining SABSA categories, key questions, and practical considerations for secure data management.

Cloud SecuritySABSAdata governance
0 likes · 6 min read
Data Governance: Securing the Data Lifecycle in Cloud Environments
Code Ape Tech Column
Code Ape Tech Column
Jan 24, 2022 · Databases

Hot and Cold Data Separation: Concepts, Scenarios, and Implementation Methods

The article explains the hot‑cold data separation pattern, describing its purpose, when to use it, how to distinguish hot versus cold data, and three practical implementation approaches—code modification, binlog listening, and scheduled scanning—to improve performance and maintain data consistency in large‑scale systems.

BackendCold Datadata lifecycle
0 likes · 10 min read
Hot and Cold Data Separation: Concepts, Scenarios, and Implementation Methods
DataFunTalk
DataFunTalk
Jan 18, 2022 · Information Security

Data Security Governance: Concepts, Goals, Tool Framework, and Practices

This presentation introduces data security concepts, outlines security goals and the 4A/5A model, describes the data lifecycle, and details practical tools and frameworks for identity authentication, access control, asset protection, and comprehensive governance to ensure secure data handling across its full lifecycle.

Access ControlData Securitydata governance
0 likes · 16 min read
Data Security Governance: Concepts, Goals, Tool Framework, and Practices
Architects Research Society
Architects Research Society
Oct 19, 2021 · Fundamentals

Data Lifecycle Diagram and Business Entity State Modeling

The article explains how data lifecycle diagrams model business data independently of processes, define stable entity states and transitions, and illustrate these concepts with a UML/BPMN EAP profile example of an order entity, while also providing community and resource links.

BPMNUMLbusiness entity
0 likes · 6 min read
Data Lifecycle Diagram and Business Entity State Modeling
Architects Research Society
Architects Research Society
May 18, 2021 · Fundamentals

Why Data Lifecycle Processes Are Crucial for Result‑Driven Enterprise Data Strategy

The article explains how well‑designed, simple, and automated data lifecycle processes—including CRUD operations—are essential for managing growing data volumes, ensuring data quality, complying with regulations, and ultimately supporting a result‑driven enterprise data strategy.

CRUDdata governancedata lifecycle
0 likes · 9 min read
Why Data Lifecycle Processes Are Crucial for Result‑Driven Enterprise Data Strategy
Big Data Technology Architecture
Big Data Technology Architecture
Mar 25, 2021 · Big Data

Implementing Erasure Coding in HDFS: Migration, Testing, and Data Lifecycle Management at JD

This article details JD's end‑to‑end implementation of HDFS erasure coding, covering the migration from replication to EC, the three‑phase upgrade and rollback process, comprehensive automated testing, a custom data‑lifecycle management system for hot‑warm‑cold data, and multi‑layer integrity safeguards to achieve significant storage cost reduction while maintaining reliability.

Big DataErasure CodingHDFS
0 likes · 17 min read
Implementing Erasure Coding in HDFS: Migration, Testing, and Data Lifecycle Management at JD
Efficient Ops
Efficient Ops
Oct 18, 2018 · Cloud Computing

How OpenSDS Is Transforming Multi‑Cloud Storage Management

This article explains how OpenSDS, an open‑source Software‑Defined Storage project, standardizes storage virtualization, simplifies traditional data‑center operations, and enables unified, vendor‑neutral data management across multi‑cloud environments while outlining its technical architecture and future roadmap.

Multi-CloudOpenSDSdata lifecycle
0 likes · 7 min read
How OpenSDS Is Transforming Multi‑Cloud Storage Management