Tag

Hardware Optimization

0 views collected around this technical thread.

Bilibili Tech
Bilibili Tech
Jan 21, 2025 · Artificial Intelligence

Accelerating Large Model Inference: Challenges and Multi‑Level Optimization Strategies

The article outlines how exploding LLM sizes create compute, memory, and latency bottlenecks and proposes a full‑stack solution—operator fusion, high‑performance libraries, quantization, speculative decoding, sharding, contiguous batching, PageAttention, and specialized frameworks like MindIE‑LLM—to dramatically boost inference throughput and reduce latency, while highlighting future ultra‑low‑bit and heterogeneous hardware directions.

Hardware OptimizationInference Accelerationcontinuous batching
0 likes · 21 min read
Accelerating Large Model Inference: Challenges and Multi‑Level Optimization Strategies
Xiaolei Talks DB
Xiaolei Talks DB
Feb 19, 2022 · Databases

Optimizing Database Server Hardware: CPU, Memory, Disk, and Network Best Practices

This guide explains why databases like TiDB have specific hardware requirements and provides detailed recommendations for CPU selection, memory tuning, storage choices, and network configuration to achieve optimal performance and cost efficiency.

Hardware OptimizationNetworkTiDB
0 likes · 12 min read
Optimizing Database Server Hardware: CPU, Memory, Disk, and Network Best Practices
Big Data Technology Architecture
Big Data Technology Architecture
Aug 29, 2019 · Databases

Elasticsearch Indexing and Search Performance Tuning Guide

This guide explains how to improve Elasticsearch indexing speed, search speed, and overall cluster performance by adjusting bulk request sizes, refresh intervals, replica settings, hardware resources, mapping choices, caching strategies, and query preferences, while also offering general best‑practice recommendations.

Cluster ConfigurationElasticsearchHardware Optimization
0 likes · 18 min read
Elasticsearch Indexing and Search Performance Tuning Guide
Architects' Tech Alliance
Architects' Tech Alliance
Feb 22, 2019 · Operations

Performance Monitoring and Analysis in Large‑Scale Data Centers: Challenges and Practices

The article presents Alibaba's experience in large‑scale data‑center performance monitoring, describing the challenges of software and hardware upgrades, the SPEED platform’s estimation‑evaluation‑decision workflow, the RUE metric, and practical insights such as hyper‑threading effects, hardware heterogeneity, and Simpson’s paradox.

Hardware OptimizationJavaSPEED platform
0 likes · 16 min read
Performance Monitoring and Analysis in Large‑Scale Data Centers: Challenges and Practices
DataFunTalk
DataFunTalk
Dec 20, 2018 · Artificial Intelligence

How to Build World-Class Visual AI Technology

This presentation outlines the fundamentals of computer vision, discusses key factors such as algorithm research, large‑scale training platforms, intelligent data processing, and hardware optimization, and shares practical experiences from DeepGlint on building a world‑class visual AI system and its real‑world applications.

Deep LearningHardware Optimizationcomputer vision
0 likes · 23 min read
How to Build World-Class Visual AI Technology
Efficient Ops
Efficient Ops
Jul 14, 2015 · Databases

Master MySQL Performance: Practical Optimization Strategies & FAQs

This article compiles expert insights from a high‑efficiency operations forum, covering MySQL performance optimization techniques such as read‑write separation, sharding, schema and parameter tuning, hardware and SSD enhancements, as well as a detailed FAQ addressing replication lag, Aurora challenges, and backup tools.

Database TuningHardware OptimizationMySQL
0 likes · 12 min read
Master MySQL Performance: Practical Optimization Strategies & FAQs