data fusion | BestHub

DataFunSummit

Aug 21, 2024 · Artificial Intelligence

Causal Debiasing in Ant Group Marketing Recommendation: Data Fusion and Backdoor Adjustment

This article introduces causal debiasing techniques for Ant Group's marketing recommendation systems, detailing background biases, causal graph analysis, a meta‑learning data‑fusion model (MDI), backdoor‑adjustment methods, extensive experiments on public and internal datasets, and real‑world deployment results.

Ant GroupRecommendation systemsbackdoor adjustment

0 likes · 16 min read

Causal Debiasing in Ant Group Marketing Recommendation: Data Fusion and Backdoor Adjustment

Sohu Tech Products

Mar 6, 2024 · Big Data

Building Data Systems with Apache Arrow: Architecture, Memory Format, and Execution

The article explains how Apache Arrow’s columnar, cross‑language in‑memory format enables high‑performance, interoperable data systems—replacing traditional row‑oriented databases—by supporting dynamic schemas, zero‑copy data exchange, efficient indexing, Acero‑based query execution, and Flight/ADBC connectivity, while offering practical guidance and highlighting challenges.

Apache ArrowBig DataData Systems

0 likes · 20 min read

Building Data Systems with Apache Arrow: Architecture, Memory Format, and Execution

DataFunTalk

Mar 2, 2024 · Artificial Intelligence

Construction and Application of User Portraits in Credit Scenarios

This article explains how to build a comprehensive user‑portrait feature system for credit business, covering business goals, data collection, labeling, modeling workflow, technical challenges, multi‑source fusion, deployment, evaluation, management, practical applications, and future extensions using AI and big‑data techniques.

Big Datacredit riskdata fusion

0 likes · 18 min read

Construction and Application of User Portraits in Credit Scenarios

DataFunTalk

Feb 28, 2024 · Big Data

Building a Data System with Apache Arrow: Design, Modeling, and Execution

This article explains why new data systems are needed, introduces Apache Arrow and its columnar in‑memory format, describes read‑time modeling and dynamic schema handling, and shows how Arrow can be used to build a complete data processing pipeline with indexing, SQL planning, and zero‑copy data exchange.

Apache ArrowBig DataData Systems

0 likes · 20 min read

Building a Data System with Apache Arrow: Design, Modeling, and Execution

DataFunSummit

Feb 14, 2024 · Artificial Intelligence

Causal Debiasing Methods for Ant Group's Marketing Recommendation Scenarios

This article presents Ant Group's research on causal debiasing for recommendation and marketing, covering the background of bias, common bias types, causal graph analysis, two correction approaches—data‑fusion based MDI and back‑door adjustment based DMBR—along with experimental results on public and proprietary datasets and real‑world deployment insights.

Ant GroupMarketingRecommendation systems

0 likes · 16 min read

Causal Debiasing Methods for Ant Group's Marketing Recommendation Scenarios

DataFunTalk

Jan 6, 2024 · Artificial Intelligence

Causal Debiasing Techniques for Recommendation and Marketing Scenarios

This article presents Ant Group's causal debiasing techniques for recommendation and marketing, covering bias background, data‑fusion based MDI model, back‑door adjustment methods, experimental results on public and industry datasets, and practical applications in advertising and e‑commerce.

MarketingRecommendation systemscausal inference

0 likes · 16 min read

Causal Debiasing Techniques for Recommendation and Marketing Scenarios

DataFunTalk

Jan 7, 2023 · Artificial Intelligence

How to Better Leverage Data in Causal Inference

This presentation introduces two recent works from Ant Group that improve causal inference by explicitly using historical control data to reduce selection bias and by fusing heterogeneous multi‑source data, describing the GBCT and WMDL methods, their theoretical foundations, experimental results, and practical applications in finance.

Financebias correctioncausal inference

0 likes · 18 min read

How to Better Leverage Data in Causal Inference

DeWu Technology

Oct 10, 2022 · Big Data

Offline and Real-Time User Profile Fusion Architecture

The architecture combines a nightly batch job that generates offline user profiles stored in HBase with a Flink‑based stream layer that lazily loads those profiles on app start and creates real‑time updates, then fuses both streams into a unified, timestamp‑ordered profile in Redis, forming a Lambda‑style pipeline.

FlinkHBaseRedis

0 likes · 10 min read

Tencent Cloud Developer

Aug 17, 2021 · Big Data

Elasticsearch Technical Event in Shenzhen

The Shenzhen Elasticsearch technical event, co‑hosted by the Elastic Chinese community and Tencent Cloud, presented practical sessions on optimizing the Elastic Stack for search, real‑time analytics, logging, security and APM, featuring compression encoding, MongoDB fusion, ByteDance extensions, cost‑effective log storage, Lucene indexing, cross‑cluster replication, vector engine integration, and large‑scale case studies from Tencent, Tiptop Data and vivo.

Cloud PlatformElasticsearchLog Analysis

0 likes · 4 min read

Elasticsearch Technical Event in Shenzhen

Amap Tech

May 25, 2020 · Artificial Intelligence

Automated Production Line for Base Map Data Using Image AI and Data Fusion

Gaode’s automated production line combines deep‑learning image recognition, GPS‑enhanced location services, image differencing with semantic filtering, and standardized data‑fusion to continuously refresh China’s national base map, cutting manual effort and costs while delivering real‑time, high‑quality map updates for road traffic infrastructure.

computer visiondata fusionimage AI

0 likes · 11 min read

Automated Production Line for Base Map Data Using Image AI and Data Fusion

Didi Tech

Aug 14, 2018 · Mobile Development

Understanding GPS Technology and Its Applications in Mobile Location Services

GPS, originally a U.S. military system, now powers smartphones but struggles in urban canyons, tunnels, and elevated roads, so Didi’s Fusion Location Provider blends satellite data with Wi‑Fi fingerprinting, network positioning, dead‑reckoning, and map‑matching to deliver precise, reliable location for ride‑hailing services.

GPSLocation ServicesMobile

0 likes · 5 min read

Understanding GPS Technology and Its Applications in Mobile Location Services

JD Tech

Jun 6, 2018 · Backend Development

Integration of JD Service Market and Plugin Market: Architecture, Data and Process Fusion

This article details the comprehensive integration of JD's Service Market and Plugin Market, covering system architecture, data and process fusion, service workflow unification, transaction handling, and front‑back separation redesign to achieve a unified, high‑performance e‑commerce platform.

JD.combackend architecturedata fusion

0 likes · 13 min read

Integration of JD Service Market and Plugin Market: Architecture, Data and Process Fusion