Tag

high performance

1 views collected around this technical thread.

ByteDance Data Platform
ByteDance Data Platform
Jun 11, 2025 · Databases

BlendHouse: The Award‑Winning Cloud‑Native Vector Database Redefining Search

ByteHouse’s BlendHouse, a cloud‑native vector database system presented at ICDE 2025, won the Best Industry and Application Paper Award, showcasing a high‑performance, universally designed framework with deep mixed‑query optimization that outperforms dedicated vector databases in read/write speed and supports large‑scale multimodal retrieval.

BlendHouseCloud NativeICDE 2025
0 likes · 6 min read
BlendHouse: The Award‑Winning Cloud‑Native Vector Database Redefining Search
AntData
AntData
Mar 5, 2025 · Cloud Native

DeepSeek 3FS Network Communication Module: Design, Implementation, and Impact on AI Infrastructure

This article provides an in‑depth analysis of DeepSeek's open‑source 3FS distributed storage system, focusing on its network communication module, RDMA‑based design, core classes such as IBSocket, Listener, and IOWorker, and how these innovations advance high‑performance AI infrastructure.

AI infrastructureDistributed StorageFolly Coroutines
0 likes · 15 min read
DeepSeek 3FS Network Communication Module: Design, Implementation, and Impact on AI Infrastructure
Python Programming Learning Circle
Python Programming Learning Circle
Feb 28, 2025 · Backend Development

Introducing Robyn: A High‑Performance Asynchronous Python Web Framework

Robyn is a young Python web framework built on Rust that delivers near‑native performance, async‑first design, and an easy‑to‑learn API, making it a compelling choice for high‑traffic, real‑time, or microservice back‑end projects.

AsyncRustWeb Framework
0 likes · 6 min read
Introducing Robyn: A High‑Performance Asynchronous Python Web Framework
FunTester
FunTester
Feb 17, 2025 · Backend Development

Efficient Thread Management with Agrona's AgentRunner for High‑Throughput Java Applications

This article explains how Agrona's lightweight AgentRunner replaces the standard Java ExecutorService to manage long‑running tasks with minimal thread‑context switching, using the Agent model and customizable IdleStrategy to achieve high throughput and low latency in concurrent Java systems.

AgentRunnerJavaThread Management
0 likes · 10 min read
Efficient Thread Management with Agrona's AgentRunner for High‑Throughput Java Applications
Alimama Tech
Alimama Tech
Feb 12, 2025 · Artificial Intelligence

HighService: A High‑Performance Pythonic AI Service Framework for Model Inference and Global Resource Scheduling

HighService, Alibaba’s Pythonic AI service framework, accelerates large‑model inference and maximizes GPU utilization by separating CPU‑GPU processes, offering out‑of‑the‑box quantization, parallelism and caching, and dynamically reallocating idle GPUs across clusters through a master‑worker scheduler to keep online latency low while boosting offline throughput for diffusion and LLM workloads.

AI ServiceModel InferencePython
0 likes · 16 min read
HighService: A High‑Performance Pythonic AI Service Framework for Model Inference and Global Resource Scheduling
Deepin Linux
Deepin Linux
Feb 3, 2025 · Backend Development

Understanding and Using io_uring for High‑Performance Asynchronous I/O in Linux

This article introduces Linux's io_uring framework, explains its design goals and advantages over traditional I/O models, details its core components and system calls, provides step‑by‑step implementation examples for file and network operations, and discusses performance comparisons and practical application scenarios.

Linux Kernelasynchronous I/Ohigh performance
0 likes · 43 min read
Understanding and Using io_uring for High‑Performance Asynchronous I/O in Linux
Sanyou's Java Diary
Sanyou's Java Diary
Jan 23, 2025 · Backend Development

How RocketMQ Achieves High Performance and Scalability with Queues, Brokers, and mmap

This article explains how RocketMQ tackles synchronous registration bottlenecks, tight coupling, and traffic‑burst risks by introducing an intermediate queue layer, designing a durable high‑availability broker, leveraging page cache and mmap for zero‑copy I/O, and using a nameserver for automatic routing, ultimately delivering a high‑throughput, low‑latency messaging system.

Distributed MessagingMessage Queueasynchronous processing
0 likes · 27 min read
How RocketMQ Achieves High Performance and Scalability with Queues, Brokers, and mmap
360 Zhihui Cloud Developer
360 Zhihui Cloud Developer
Jan 7, 2025 · Big Data

High‑Performance Distributed Storage: Ceph vs Alibaba Pangu 2.0 vs XSKY INFINI

This article compares three high‑performance distributed storage systems—Ceph, Alibaba's Pangu 2.0, and XSKY INFINI—examining their architectures, key technologies such as RTC thread models, append‑only writes, kernel‑bypass, RDMA, data compression, and metadata management to reveal how they exploit modern flash hardware.

CephDistributed StorageNVMe
0 likes · 21 min read
High‑Performance Distributed Storage: Ceph vs Alibaba Pangu 2.0 vs XSKY INFINI
Architecture Development Notes
Architecture Development Notes
Dec 4, 2024 · Backend Development

How to Build a Zero‑Copy, Low‑Latency Network Protocol in Rust

This article explains how to design and implement a high‑performance custom network protocol in Rust, covering zero‑copy parsing, memory‑mapped packet pools, lock‑free event loops, and an efficient binary packet format to achieve ultra‑low latency and massive concurrency.

RustZero Copyhigh performance
0 likes · 9 min read
How to Build a Zero‑Copy, Low‑Latency Network Protocol in Rust
Architect
Architect
Nov 28, 2024 · Backend Development

Designing a High‑Performance Message Notification System

This article explains how to design and implement a high‑performance, scalable message notification system, covering service partitioning, system architecture, first‑time and retry message handling, idempotency, dynamic routing, thread‑pool management, stability measures such as traffic surge handling, resource isolation, monitoring, and elastic scaling.

Backend DevelopmentMessage Notificationhigh performance
0 likes · 17 min read
Designing a High‑Performance Message Notification System
Zhuanzhuan Tech
Zhuanzhuan Tech
Nov 20, 2024 · Backend Development

Design and Implementation of a High‑Performance Message Notification System

This article presents a comprehensive design of a high‑performance, fault‑tolerant message notification system, covering service partitioning, system architecture, idempotent processing, dynamic error detection, thread‑pool management, retry mechanisms, and stability measures such as traffic‑spike handling, resource isolation, third‑party protection, monitoring, and active‑active deployment.

JavaMessage Notificationbackend architecture
0 likes · 16 min read
Design and Implementation of a High‑Performance Message Notification System
DataFunSummit
DataFunSummit
Sep 12, 2024 · Cloud Native

Design and Implementation of a Next‑Generation Multi‑Protocol Unstructured Storage System for Machine Learning

This article presents the challenges of storing massive machine‑learning datasets, evaluates existing storage solutions, and details the design of OrangeFS—a cloud‑native, multi‑protocol, multi‑tenant unstructured storage system that integrates object and file interfaces, optimizes metadata services, supports hot upgrades, and provides robust scalability and reliability for AI workloads.

Cloud Nativedistributed systemshigh performance
0 likes · 24 min read
Design and Implementation of a Next‑Generation Multi‑Protocol Unstructured Storage System for Machine Learning
JD Tech Talk
JD Tech Talk
Sep 4, 2024 · Backend Development

Methodology and Practices for Building High‑Performance, High‑Concurrency, High‑Availability Backend Systems

This article shares a backend‑centric methodology and practical experiences for constructing systems that simultaneously achieve high performance, high concurrency, and high availability, covering performance optimization, read/write strategies, scaling techniques, fault‑tolerance mechanisms, and deployment considerations.

High Availabilitybackendhigh concurrency
0 likes · 24 min read
Methodology and Practices for Building High‑Performance, High‑Concurrency, High‑Availability Backend Systems
JD Tech
JD Tech
Sep 3, 2024 · Backend Development

Designing High‑Performance, High‑Concurrency, High‑Availability Backend Systems: Methodologies and Practices

This article shares a backend engineer’s comprehensive methodology and practical experiences for building systems that simultaneously achieve high performance, high concurrency, and high availability, covering performance optimization, caching strategies, scaling techniques, fault tolerance, and operational best practices across application, storage, and deployment layers.

High Availabilitybackendhigh concurrency
0 likes · 28 min read
Designing High‑Performance, High‑Concurrency, High‑Availability Backend Systems: Methodologies and Practices
vivo Internet Technology
vivo Internet Technology
Aug 14, 2024 · Backend Development

Understanding Disruptor: High‑Performance In‑Memory Queue, Core Concepts, Demo, and Source Code Analysis

The article explains the Disruptor—an intra‑process, lock‑free, array‑based queue that achieves millions of operations per second—by covering its core concepts, demo code, source‑code mechanics, performance optimizations such as pre‑allocation and false‑sharing avoidance, and real‑world Vivo iTheme applications with best‑practice tips.

DisruptorJavaRing Buffer
0 likes · 29 min read
Understanding Disruptor: High‑Performance In‑Memory Queue, Core Concepts, Demo, and Source Code Analysis
Architecture Development Notes
Architecture Development Notes
Aug 13, 2024 · Backend Development

Build a High‑Performance HTTP Load Balancer with Rust’s Pingora Framework

Learn how to create a fast, modular HTTP load balancer using Rust’s Pingora framework, covering its core advantages, step‑by‑step project setup, code walkthrough, testing, and advanced features like health checks, service discovery, SSL offloading, and traffic control.

Backend DevelopmentLoad BalancingNetwork Services
0 likes · 6 min read
Build a High‑Performance HTTP Load Balancer with Rust’s Pingora Framework
Architecture Development Notes
Architecture Development Notes
Aug 4, 2024 · Artificial Intelligence

Why Mojo Could Replace Python for High-Performance AI Development

Mojo, a new language from Modular, combines Python-like ease with C++-level speed through static typing, MLIR integration, and hardware acceleration, enabling AI developers to write high-performance models without learning complex low-level languages, and its open-source release promises rapid ecosystem growth.

AI DevelopmentMLIRMojo
0 likes · 6 min read
Why Mojo Could Replace Python for High-Performance AI Development
Sohu Tech Products
Sohu Tech Products
Jul 31, 2024 · Backend Development

A High-Performance Strictly Incremental Distributed ID Generation Scheme Using MySQL, Redis, and Nacos

The article proposes a high‑performance, strictly incremental distributed ID generation scheme that combines MySQL segment tables, Redis caching, and Nacos‑controlled switching, achieving sub‑millisecond latency and 7‑10× speedup over pure database methods while preserving fault tolerance, availability, and global uniqueness.

MySQL segmentNacos switchRedis caching
0 likes · 9 min read
A High-Performance Strictly Incremental Distributed ID Generation Scheme Using MySQL, Redis, and Nacos
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jun 4, 2024 · Big Data

Why Kafka Can Achieve Million‑Message‑Per‑Second Throughput: Disk Sequential Write, Zero‑Copy, Page Cache, and Memory‑Mapped Files

The article explains how Kafka attains ultra‑high write throughput by leveraging disk sequential writes, zero‑copy data transfer, operating‑system page cache, and memory‑mapped files, detailing each technique’s impact on latency, CPU usage, and overall performance.

Big DataKafkaZero Copy
0 likes · 5 min read
Why Kafka Can Achieve Million‑Message‑Per‑Second Throughput: Disk Sequential Write, Zero‑Copy, Page Cache, and Memory‑Mapped Files