Parallel Processing

Java Captain

Apr 29, 2025 · Fundamentals

Java Stream API: Concepts, Operations, and Practical Examples

This article introduces the concept and benefits of Java Stream programming, explains its core features such as lazy evaluation, parallel processing, and functional style, and provides detailed examples of creating streams, common intermediate and terminal operations, and practical use cases for data manipulation.

Data TransformationFunctional ProgrammingParallel Processing

0 likes · 34 min read

Java Stream API: Concepts, Operations, and Practical Examples

Python Programming Learning Circle

Mar 18, 2025 · Fundamentals

Python Multiprocessing: Using the multiprocessing Module for Parallel Execution

Python's multiprocessing module enables parallel execution across multiple CPU cores, offering a more efficient alternative to multithreading for CPU-bound tasks, with examples demonstrating process creation, the Pool class, and common patterns such as map, imap_unordered, and considerations for inter-process communication.

ConcurrencyParallel ProcessingPython

0 likes · 7 min read

Python Multiprocessing: Using the multiprocessing Module for Parallel Execution

37 Interactive Technology Team

Dec 9, 2024 · Artificial Intelligence

Optimizing Request Concurrency for LLM Workflows: Rationale, Implementation, and Results

By breaking iterable inputs into parallel LLM calls and batching 20 items across three languages within Dify’s platform limits, the workflow achieves 43‑64% average runtime reductions and markedly higher success rates, demonstrating that request‑level concurrency dramatically improves throughput for large‑scale translation tasks.

CozeDifyLLM

0 likes · 6 min read

Optimizing Request Concurrency for LLM Workflows: Rationale, Implementation, and Results

Architect

Oct 18, 2024 · Operations

Design and Implementation of a Self‑Developed Video Transcoding Core Based on FFmpeg

This article describes the motivations, architecture, and key techniques of a custom video transcoding core built on FFmpeg, covering modular pipeline design, controllable serial/parallel execution, dynamic resolution and frame‑rate adaptation, SEI handling, and performance improvements for both live and on‑demand streaming.

FFmpegLive StreamingParallel Processing

0 likes · 11 min read

Design and Implementation of a Self‑Developed Video Transcoding Core Based on FFmpeg

Code Mala Tang

Sep 11, 2024 · Backend Development

Master Node.js Child Processes: exec, spawn, fork & IPC Explained

This guide explains the Node.js child_process module, covering its purpose, the four creation methods (exec, execFile, spawn, fork), how to handle output streams, inter‑process communication, best‑practice management tips, and when to choose child processes over worker threads.

Backend DevelopmentIPCNode.js

0 likes · 14 min read

Master Node.js Child Processes: exec, spawn, fork & IPC Explained

JD Retail Technology

Sep 3, 2024 · Backend Development

Design and Architecture of a New Video Review System with Streamlined Frame Extraction and Parallel Processing

This article presents the design goals, architecture, technology selection, and component details of a unified video review system that leverages FFmpeg for frame extraction, stream‑based parallel processing, and flexible synchronous/asynchronous workflows to achieve low latency and high scalability.

FFmpegParallel ProcessingStreaming

0 likes · 10 min read

Design and Architecture of a New Video Review System with Streamlined Frame Extraction and Parallel Processing

Bilibili Tech

Jul 26, 2024 · Backend Development

Design and Architecture of a Self‑Developed Video Transcoding Core

The team built a custom video‑transcoding core atop FFmpeg libraries, replacing the command‑line tool with modular controllers, pipelines, and parallel tasks that dynamically adapt resolution, frame‑rate, and SEI handling for both low‑latency live streams and high‑throughput VOD, improving scalability and maintainability.

Backend DevelopmentFFmpegLive Streaming

0 likes · 11 min read

Design and Architecture of a Self‑Developed Video Transcoding Core

Python Programming Learning Circle

Jun 21, 2024 · Artificial Intelligence

Using scikit-learn for Data Mining: Feature Engineering, Parallel Processing, Pipelines, and Model Persistence

This article demonstrates how to perform data mining with scikit-learn by detailing the full workflow—from data acquisition and feature engineering, through parallel and pipeline processing, to automated hyper‑parameter tuning and model persistence—using the Iris dataset as an example.

Data MiningFeature EngineeringParallel Processing

0 likes · 13 min read

Python Programming Learning Circle

Jun 5, 2024 · Big Data

Parallel Processing of Large CSV Files with multiprocessing, joblib, and tqdm in Python

This tutorial demonstrates how to accelerate processing of a multi‑million‑row CSV dataset by dividing the work into parallel tasks using Python's multiprocessing, joblib, and tqdm libraries, comparing serial, multi‑process, batch, and process‑map approaches with detailed timing results.

Big DataParallel ProcessingPython

0 likes · 8 min read

Parallel Processing of Large CSV Files with multiprocessing, joblib, and tqdm in Python

Python Programming Learning Circle

May 6, 2024 · Fundamentals

Comprehensive Guide to Python Multiprocessing and Advanced Concurrency Techniques

This article provides an in‑depth overview of Python's multiprocessing module, covering process creation, inter‑process communication, synchronization primitives, error handling, debugging tools, and real‑world project examples to help developers efficiently leverage multi‑core CPUs for CPU‑bound tasks.

ConcurrencyParallel ProcessingPython

0 likes · 25 min read

Comprehensive Guide to Python Multiprocessing and Advanced Concurrency Techniques

DaTaobao Tech

Jan 17, 2024 · Backend Development

Scaling and Performance Optimization of Taobao Shopping Cart

Taobao’s shopping cart was scaled and optimized by raising the item limit to 380, deploying the cloud‑native in‑memory read‑only replica tairSQL for read‑write separation, pre‑computing promotions, compressing payloads, caching data, redesigning the protocol, introducing response‑streaming APIs, and parallelizing per‑item processing with Java’s ForkJoinPool, dramatically cutting latency during traffic spikes.

Cloud NativeDatabaseParallel Processing

0 likes · 15 min read

Scaling and Performance Optimization of Taobao Shopping Cart

php中文网 Courses

Dec 21, 2023 · Backend Development

Accelerating Image Processing in PHP with GD, Caching, and Parallel Execution

This article explains how to speed up PHP image processing by using the GD library for resizing, implementing file‑based caching to avoid redundant work, and leveraging Swoole‑based parallel processing to handle multiple images concurrently, complete with practical code examples.

GDParallel Processingimage processing

0 likes · 6 min read

Accelerating Image Processing in PHP with GD, Caching, and Parallel Execution

Top Architect

Sep 28, 2023 · Backend Development

Understanding Java Stream API: Concepts, Operations, and Practical Examples

This article introduces Java Stream API, explaining its functional programming concepts, lazy evaluation, and parallel processing capabilities, and provides detailed coverage of stream creation, intermediate operations such as filter, map, sorted, limit, and skip, as well as terminal operations like forEach, collect, reduce, match, find, and statistics, complemented by practical code examples.

Functional ProgrammingParallel ProcessingStream API

0 likes · 37 min read

Understanding Java Stream API: Concepts, Operations, and Practical Examples

Architect

Sep 27, 2023 · Backend Development

Comprehensive Guide to Java Stream API: Concepts, Operations, and Practical Examples

Java Stream API enables functional-style, declarative processing of collections and other data sources, offering lazy evaluation, parallel execution, and a rich set of intermediate and terminal operations such as filter, map, sorted, reduce, and collect, with examples illustrating creation, transformation, and practical usage.

CollectionsFunctional ProgrammingParallel Processing

0 likes · 38 min read

Comprehensive Guide to Java Stream API: Concepts, Operations, and Practical Examples

Sohu Tech Products

Sep 20, 2023 · Backend Development

Java CompletableFuture Tutorial: Asynchronous Programming and Task Composition

This tutorial explains Java 8's CompletableFuture, showing how to create, compose, and handle asynchronous tasks with methods like supplyAsync, thenApply, allOf, and anyOf, while emphasizing custom thread pools, non‑blocking patterns, and robust exception handling for real‑world concurrent programming.

Asynchronous ProgrammingCompletableFutureException Handling

0 likes · 17 min read

Java CompletableFuture Tutorial: Asynchronous Programming and Task Composition

Python Programming Learning Circle

Jul 7, 2023 · Fundamentals

Python Performance Optimization Tools and Techniques

This article surveys a wide range of Python optimization tools—including NumPy, SciPy, Pandas, JIT compilers like PyPy and Pyston, GPU libraries, Cython, Numba, and interfacing utilities—explaining how they can accelerate code execution, reduce memory usage, and improve overall performance for single‑ and multi‑processor environments.

JITLibrariesOptimization

0 likes · 7 min read

Python Performance Optimization Tools and Techniques

Python Programming Learning Circle

Apr 23, 2023 · Big Data

Parallel Processing of Large CSV Files in Python with multiprocessing, joblib, and tqdm

This tutorial demonstrates how to accelerate processing of a 2.8‑million‑row CSV dataset by using Python's multiprocessing, joblib, and tqdm libraries, covering serial, parallel, and batch processing techniques, performance measurements, and best‑practice code examples for efficient large‑scale data handling.

Big DataData EngineeringParallel Processing

0 likes · 9 min read

Parallel Processing of Large CSV Files in Python with multiprocessing, joblib, and tqdm

Baidu Geek Talk

Jan 4, 2023 · Backend Development

Baidu Tieba Rule Engine: Architecture and Implementation

The Baidu Tieba rule engine is a low‑code platform that lets non‑developers define, compile, and execute dynamic business rules through modular components, variable handling, JSON‑based rule trees, and customizable disposition handlers, supporting synchronous, asynchronous and parallel execution to reduce hard‑coded logic, deployment frequency, and maintenance effort.

Asynchronous ExecutionBackend DevelopmentParallel Processing

0 likes · 18 min read

Baidu Tieba Rule Engine: Architecture and Implementation

Architects' Tech Alliance

Sep 30, 2022 · Fundamentals

High‑Performance Computing: Principles, Evolution, Applications, and Market Landscape

This article explains the concept and history of high‑performance computing (HPC), its serial and parallel processing architectures, performance metrics such as FLOPS, major application domains, and the rapid market growth and competitive landscape in China driven by national policies and industry investment.

Artificial IntelligenceChina HPCHPC Applications

0 likes · 14 min read

High‑Performance Computing: Principles, Evolution, Applications, and Market Landscape

Tencent Architect

Aug 26, 2022 · Fundamentals

How Tencent’s TXAV1 Encoder Achieves 20% Bandwidth Savings and Industry‑Leading Quality

This article details Tencent Cloud's self‑developed TXAV1 AV1 encoder, covering its evolution from V265, performance gains over competing codecs, compression‑rate improvements through pre‑analysis models, engineering acceleration techniques, and real‑world deployment in live streaming, video‑on‑demand, and AVIF image services.

AV1Cloud MediaCodec Optimization

0 likes · 15 min read

How Tencent’s TXAV1 Encoder Achieves 20% Bandwidth Savings and Industry‑Leading Quality