Tag

resource optimization

1 views collected around this technical thread.

JD Tech
JD Tech
Apr 8, 2025 · Artificial Intelligence

MaRCA: Multi‑Agent Reinforcement Learning Computation Allocation for Full‑Chain Advertising Systems

The article presents MaRCA, a multi‑agent reinforcement learning framework that models user value, compute consumption, and action reward to allocate limited computation resources across the entire advertising recommendation pipeline, achieving higher ad revenue while keeping system load stable under fluctuating traffic and diverse request values.

Advertising SystemsLoad-Aware SchedulingMulti-Agent Reinforcement Learning
0 likes · 16 min read
MaRCA: Multi‑Agent Reinforcement Learning Computation Allocation for Full‑Chain Advertising Systems
JD Retail Technology
JD Retail Technology
Dec 19, 2024 · Big Data

JD.com Data Governance: Architecture, Key Technologies, and Future Directions

JD.com’s data‑governance framework combines a health‑score‑driven, automated platform that cross‑verifies audit logs, builds full‑link and operator‑level lineage, introduces standard fields, and optimizes resource mixing, task staggering, and cross‑datacenter scheduling, while targeting real‑time AI‑enhanced detection and full automation.

Audit LogsBig DataJD.com
0 likes · 15 min read
JD.com Data Governance: Architecture, Key Technologies, and Future Directions
DataFunSummit
DataFunSummit
Dec 10, 2024 · Big Data

JD.com’s Big Data Governance: Practices, Key Technologies, and Future Outlook

This article presents JD.com’s comprehensive big‑data governance experience, detailing the background and challenges, the automated governance platform and its core technologies such as audit logs and full‑link lineage, strategies for resource optimization, and the roadmap toward real‑time, intelligent, and fully automated data governance.

AutomationBig DataJD.com
0 likes · 14 min read
JD.com’s Big Data Governance: Practices, Key Technologies, and Future Outlook
DevOps Cloud Academy
DevOps Cloud Academy
Dec 2, 2024 · Artificial Intelligence

Key Kubernetes Features that Benefit AI Inference Workloads

This article explains how Kubernetes’ native scalability, resource optimization, performance tuning, portability, and fault‑tolerance features align with the demands of AI inference, helping organizations run large ML models efficiently, cost‑effectively, and reliably across diverse environments.

AI inferencefault tolerancekubernetes
0 likes · 15 min read
Key Kubernetes Features that Benefit AI Inference Workloads
Linux Ops Smart Journey
Linux Ops Smart Journey
Oct 15, 2024 · Cloud Native

Master Kubernetes Vertical Pod Autoscaler (VPA): Installation, Configuration, and Real‑World Tuning

This guide explains what Kubernetes VPA is, its architecture, version compatibility, step‑by‑step installation, certificate setup, manifest generation, practical VPA configuration, validation procedures, performance testing, and known limitations, enabling you to optimize pod resources in cloud‑native clusters.

Cloud NativeK8sVPA
0 likes · 12 min read
Master Kubernetes Vertical Pod Autoscaler (VPA): Installation, Configuration, and Real‑World Tuning
Bilibili Tech
Bilibili Tech
Jul 19, 2024 · Big Data

Bilibili's One-Stop Big Data Cluster Management Platform (BMR) - Architecture and Implementation

Bilibili’s one‑stop Big Data Cluster Management Platform (BMR) consolidates HDFS, Spark, Flink, ClickHouse, Kafka and other services into a unified system that evolved through four stages—standardization, metadata‑driven construction, containerization, and observability—addressing node consistency, scaling, fault self‑healing, and resource optimization while delivering elastic scaling, automated start/stop, and future cost‑saving and stability enhancements.

Cluster ManagementContainerizationbig data platform
0 likes · 12 min read
Bilibili's One-Stop Big Data Cluster Management Platform (BMR) - Architecture and Implementation
NetEase Cloud Music Tech Team
NetEase Cloud Music Tech Team
Jul 1, 2024 · Frontend Development

Performance Optimization and Engineering Practices for NetEase Cloud Music 2023 Annual Report Front‑End Development

The 2023 NetEase Cloud Music annual‑report front‑end case study details how sub‑second first‑screen loads, SPA routing with TypeScript, GPU‑accelerated animations, optimized media handling, multi‑layer quality monitoring, and a unified development platform together boost performance, reliability, and engineering efficiency, driving higher DAU and share‑rate.

PerformanceSPAcode-splitting
0 likes · 27 min read
Performance Optimization and Engineering Practices for NetEase Cloud Music 2023 Annual Report Front‑End Development
DataFunSummit
DataFunSummit
Apr 26, 2024 · Big Data

Didi's Big Data Cost Governance Practices

This article details Didi's comprehensive big data cost governance framework, covering its data architecture, asset management scoring, Hadoop and Elasticsearch cost optimization methods, and practical insights on organizational processes and incentives for effective cost control.

Big DataElasticsearchHadoop
0 likes · 17 min read
Didi's Big Data Cost Governance Practices
vivo Internet Technology
vivo Internet Technology
Feb 28, 2024 · Cloud Native

vivo's Online-Offline Co-location Technology Practice: Data Center Resource Optimization

Vivo’s online‑offline co‑location platform consolidates latency‑sensitive online services and batch offline workloads on shared Kubernetes nodes, using differentiated resource views, priority‑based QoS, and safety watermarks to boost CPU utilization from 13 % to 25 %, adding 20 000 cores and 50 TB memory for peak‑hour offline tasks.

Container OrchestrationDevOpsResource Isolation
0 likes · 17 min read
vivo's Online-Offline Co-location Technology Practice: Data Center Resource Optimization
ByteDance Data Platform
ByteDance Data Platform
Feb 21, 2024 · Big Data

How ByteDance’s DataLeap Automates Big Data Governance and Boosts Performance

ByteDance’s DataLeap suite tackles the complexities of large‑scale data platform governance by identifying manual tuning pain points, deploying automated rule‑engine recommendations, and optimizing resource allocation, ultimately improving stability, reducing costs, and enhancing overall system health across thousands of Spark, Flink and other tasks.

AutomationBig DataReal-time Monitoring
0 likes · 14 min read
How ByteDance’s DataLeap Automates Big Data Governance and Boosts Performance
JD Retail Technology
JD Retail Technology
Feb 8, 2024 · Frontend Development

Frontend Optimization Strategies for High‑Concurrency Interactive H5 during the Spring Festival Gala

This article details how the front‑end team tackled the massive traffic and performance challenges of the Spring Festival Gala interactive H5 by optimizing static resources, employing WebP and sprite techniques, implementing traffic‑shaping and localStorage caching, and automating engineering workflows to ensure a stable, smooth user experience.

Performanceengineeringfrontend
0 likes · 12 min read
Frontend Optimization Strategies for High‑Concurrency Interactive H5 during the Spring Festival Gala
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
Feb 2, 2024 · Mobile Development

Android APK Size Optimization: Removing Duplicate Resources and Image Compression with a Gradle Plugin

This article explains how the Android resources.arsc file is generated, identifies the problem of duplicate and uncompressed image resources in multi‑module projects, and presents a Gradle‑based solution that inserts a custom task after processReleaseResources to deduplicate resources, compress images using pngquant, guetzli and cwebp, and repack the .ap_ files, resulting in significant APK size reduction.

APKAndroidGradle Plugin
0 likes · 10 min read
Android APK Size Optimization: Removing Duplicate Resources and Image Compression with a Gradle Plugin
Yum! Tech Team
Yum! Tech Team
Jan 29, 2024 · Cloud Computing

Flexible Compute Scheduling Practices in the Restaurant Industry: A Yum China Case Study

This article examines the challenges of uneven compute resource distribution across China and presents Yum China's practical approaches—including multi‑unit deployment, dual‑data‑center scheduling, and supporting platforms—to achieve flexible, cost‑effective compute scheduling for the restaurant sector.

Yum Chinacloud computingcompute scheduling
0 likes · 5 min read
Flexible Compute Scheduling Practices in the Restaurant Industry: A Yum China Case Study
ByteDance Cloud Native
ByteDance Cloud Native
Jan 24, 2024 · Cloud Native

How Katalyst v0.4.0 Brings Tidal Colocation and Resource Overcommit to Native Kubernetes

Katalyst v0.4.0 introduces tidal colocation for mixed workloads, online resource overcommit, fine‑grained NUMA memory management, OOM priority enhancements, and topology‑aware scheduling, providing a comprehensive cost‑optimization solution for cloud‑native Kubernetes clusters.

NUMAOOM PriorityOvercommit
0 likes · 12 min read
How Katalyst v0.4.0 Brings Tidal Colocation and Resource Overcommit to Native Kubernetes
ByteDance Data Platform
ByteDance Data Platform
Jan 24, 2024 · Big Data

How ByteDance Cut Billions in Event‑Tracking Costs with Smart Data Governance

This article details ByteDance's end‑to‑end event‑tracking cost governance, covering background, strategies, large‑scale data pipelines, resource challenges, control mechanisms, automated and supervised governance modes, and the substantial savings achieved through point filtering, tiered prioritization, and sampling.

AutomationBig Datacost governance
0 likes · 16 min read
How ByteDance Cut Billions in Event‑Tracking Costs with Smart Data Governance
Soul Technical Team
Soul Technical Team
Jan 9, 2024 · Mobile Development

Package Size Optimization: Large Resource Detection, Unused Assets Scanning, and Resource Size Gatekeeping for Mobile Apps

This article describes a systematic approach to reducing mobile app package size by detecting oversized resources, scanning unused assets, enforcing size checkpoints during development, and integrating automated validation into the CI/CD pipeline, illustrated with tools, workflows, and results.

Build AutomationCI/CDasset scanning
0 likes · 10 min read
Package Size Optimization: Large Resource Detection, Unused Assets Scanning, and Resource Size Gatekeeping for Mobile Apps
DataFunTalk
DataFunTalk
Jan 8, 2024 · Big Data

Didi's Big Data Cost Governance Practices and Framework

This article presents Didi's comprehensive big data cost governance approach, detailing the overall framework, data system architecture, asset management platform, Hadoop and Elasticsearch cost‑control practices, metadata‑driven optimization, and organizational insights for effective resource and budget management.

Big DataElasticsearchHadoop
0 likes · 19 min read
Didi's Big Data Cost Governance Practices and Framework
DeWu Technology
DeWu Technology
Dec 27, 2023 · Cloud Native

DeWu's Cloud-Native Container Management Practices

Since August 2021, DeWu App has built a cloud‑native, multi‑cluster Kubernetes platform that uses an OAM‑style CloneSet model, Helm‑generated resources, Karmada‑based federation, custom scheduler plugins for reservation and node‑balance, offline mixing for Flink, a unified KubeAutoScaler, and a self‑built KubeAI stack, achieving significant cost cuts and improved stability while planning further middleware containerization and multi‑cloud expansion.

AICost Managementautoscaling
0 likes · 22 min read
DeWu's Cloud-Native Container Management Practices
DataFunTalk
DataFunTalk
Nov 20, 2023 · Big Data

Automated Data Governance and Optimization with Volcano Engine DataLeap: Challenges, Solutions, and Benefits

This article examines the challenges faced by Volcano Engine's DataLeap in computational governance, outlines automated solutions such as real‑time rule engines and monitoring, and presents concrete performance and cost benefits achieved through resource optimization across large‑scale Spark and Hadoop workloads.

AutomationBig DataPerformance
0 likes · 13 min read
Automated Data Governance and Optimization with Volcano Engine DataLeap: Challenges, Solutions, and Benefits
AntTech
AntTech
Nov 10, 2023 · Cloud Native

Highlights of the 2023 Financial Industry Cloud‑Native Green Computing Development Forum

The forum held on October 25, co‑organized by China Financial Computer magazine and Ant Group, gathered experts from eleven financial institutions to share cloud‑native and green‑computing practices—including distributed stacks, hybrid deployments, secure containers, serverless, and continuous profiling—aimed at advancing low‑carbon, high‑quality compute in the financial sector.

Cloud NativeContainerGreen computing
0 likes · 4 min read
Highlights of the 2023 Financial Industry Cloud‑Native Green Computing Development Forum