Resource Estimation

Bilibili Tech

Feb 18, 2025 · Artificial Intelligence

Algorithmic Empowerment of Bilibili Streaming: VOD Transcoding Decision, Resource Estimation, and Live Comment Semantic Analysis

The article details how Bilibili leverages AI algorithms—including XGBoost, statistical rules, XDeepFM, and fine‑tuned SBERT—to optimize VOD transcoding decisions, estimate compute resources and processing time, and analyze live comments, thereby boosting streaming efficiency, utilization, and user experience.

AIMachine LearningResource Estimation

0 likes · 19 min read

Algorithmic Empowerment of Bilibili Streaming: VOD Transcoding Decision, Resource Estimation, and Live Comment Semantic Analysis

Bilibili Tech

Mar 15, 2024 · Artificial Intelligence

Hardware Resource Estimation and Bottleneck Analysis for Large Language Models (LLMs)

The article analyzes the compute, memory, and communication resources required to train and run large language models, quantifies bottlenecks such as the massive FLOP demand, terabyte‑scale GPU memory, and high‑bandwidth interconnect needs, and evaluates parallelism strategies and bandwidth estimates to guide hardware and software design for scaling LLMs.

AI InfrastructureHardwareLLM

0 likes · 53 min read

Hardware Resource Estimation and Bottleneck Analysis for Large Language Models (LLMs)

Aikesheng Open Source Community

Dec 5, 2023 · Databases

Standard Architecture and Application Practices for Distributed Databases at Industrial Securities

The article details Industrial Securities' implementation of a standardized, high‑availability distributed database architecture using OceanBase, covering core capabilities, resource evaluation, migration, backup, and operational best practices to support financial digital transformation and autonomous controllable IT infrastructure.

Distributed DatabaseHigh AvailabilityOceanBase

0 likes · 14 min read

Standard Architecture and Application Practices for Distributed Databases at Industrial Securities

DataFunSummit

Apr 9, 2022 · Big Data

Impala Deployment and Optimization: Practical Experience with Sensor Data Multi‑dimensional Analysis Platform

This article presents a comprehensive technical walkthrough of Sensor Data's multi‑dimensional analysis platform, covering product architecture, an Impala‑based real‑time query engine, query performance tuning, resource‑estimation strategies, and future plans, with concrete diagrams, test results, and community contributions.

ImpalaQuery OptimizationResource Estimation

0 likes · 19 min read

Impala Deployment and Optimization: Practical Experience with Sensor Data Multi‑dimensional Analysis Platform

DataFunTalk

Apr 4, 2022 · Big Data

Impala Deployment and Optimization in Sensors Data's Multi-Dimensional Analytics Platform

This article details the architecture of Sensors Data's analytics platform, the implementation of a real‑time Impala query engine, multiple query‑performance optimizations—including storage redesign, user‑behavior sequence tuning, join elimination and expression push‑down—and a resource‑estimation framework that dramatically reduces query failures and latency.

ImpalaQuery OptimizationResource Estimation

0 likes · 16 min read

Impala Deployment and Optimization in Sensors Data's Multi-Dimensional Analytics Platform