BestHub
Sign in
Topic

batch processing

Collection size
120 articles
Page 6 of 6
DataFunTalk
DataFunTalk
Nov 17, 2020 · Artificial Intelligence

Alink: A Flink‑Based Machine Learning Platform – Overview, Features, and Quick‑Start Guide

This article introduces Alink, Alibaba's open‑source machine‑learning platform built on Flink, explains its core algorithms, performance comparison with Spark ML, version‑wise feature evolution, and provides practical quick‑start instructions for both Java (Maven) and Python (PyAlink) users, including data source handling, type conversion components, unified file‑system operations, and an overview of its FM algorithm implementation.

AlinkFactorization MachinesFlink
0 likes · 13 min read
Alink: A Flink‑Based Machine Learning Platform – Overview, Features, and Quick‑Start Guide
DataFunTalk
DataFunTalk
Sep 17, 2020 · Big Data

Design and Implementation of a Scalable User Tag Production Platform

The article explains how a flexible, high‑performance user‑tagging system is built on a batch‑stream integrated architecture using big‑data technologies such as Impala, HDFS, and Flink to support both offline and real‑time label generation for precise marketing, product improvement, and operational analytics.

FlinkImpalaReal-time Streaming
0 likes · 15 min read
Design and Implementation of a Scalable User Tag Production Platform
Architect's Guide
Architect's Guide
Feb 13, 2024 · Backend Development

Optimizing Large Transactions in Backend Development

The article explains why large database transactions degrade backend API performance, outlines common issues such as concurrency inconsistencies, lock blocking, and undo‑log overhead, and presents practical optimization techniques including avoiding RPC inside transactions, using programmatic transactions, batch processing, splitting into smaller transactions, and asynchronous parallel execution with code examples.

BackendJavaasynchronous
0 likes · 9 min read
Optimizing Large Transactions in Backend Development
Architect's Guide
Architect's Guide
Nov 22, 2023 · Backend Development

Performance Optimization Techniques: Indexing, Caching, Compression, Prefetching, Throttling, and Batch Processing

This article explains how software performance can be improved by balancing time and space trade‑offs through six fundamental techniques—indexing, compression, caching, prefetching, peak‑valley smoothing, and batch processing—and then explores four advanced, parallelism‑focused methods for large‑scale systems.

IndexingOptimizationbatch processing
0 likes · 35 min read
Performance Optimization Techniques: Indexing, Caching, Compression, Prefetching, Throttling, and Batch Processing
Architect's Guide
Architect's Guide
May 25, 2023 · Backend Development

Spring Batch: Introduction, Architecture, Core Interfaces, and Practical Implementation Guide

This article provides a comprehensive overview of Spring Batch, covering its purpose, typical business scenarios, core components such as JobRepository, JobLauncher, Job, Step, and core interfaces like ItemReader, ItemProcessor, ItemWriter, followed by detailed code examples for configuration, multi‑step, parallel, decision, nested jobs, data reading, writing, processing, and scheduling using Spring Boot.

JavaJob SchedulingSpring Batch
0 likes · 15 min read
Spring Batch: Introduction, Architecture, Core Interfaces, and Practical Implementation Guide
Selected Java Interview Questions
Selected Java Interview Questions
Dec 12, 2023 · Backend Development

Spring Boot Integration with Spring Batch: A Complete Tutorial and Example

This article provides a step‑by‑step guide on integrating Spring Batch with Spring Boot, covering business scenarios, database setup, Maven dependencies, configuration of JobRepository, JobLauncher, Job, Step, ItemReader, ItemProcessor, ItemWriter, listeners, validators, execution via REST endpoints, troubleshooting with Druid and switching to HikariCP, and demonstrates processing CSV and database data in large batches.

DatabaseJavaMyBatis
0 likes · 19 min read
Spring Boot Integration with Spring Batch: A Complete Tutorial and Example
Selected Java Interview Questions
Selected Java Interview Questions
Dec 28, 2022 · Backend Development

Integrating Spring Batch with Spring Boot: A Step‑by‑Step Tutorial

This article provides a comprehensive guide on using Spring Batch within a Spring Boot application, covering CSV and database data sources, detailed configuration beans, custom readers, processors, writers, listeners, validation, and execution via a REST controller, along with practical troubleshooting tips.

CSVJavaMyBatis
0 likes · 21 min read
Integrating Spring Batch with Spring Boot: A Step‑by‑Step Tutorial
Python Programming Learning Circle
Python Programming Learning Circle
May 27, 2024 · Fundamentals

Batch Image Compression with Python: A 20‑Line Script Tutorial

This article explains how designers and developers can use a short Python script to automatically compress large numbers of high‑resolution images, covering the problem background, required environment, step‑by‑step implementation, and the impressive compression results achieved.

AutomationPythonbatch processing
0 likes · 3 min read
Batch Image Compression with Python: A 20‑Line Script Tutorial
Python Programming Learning Circle
Python Programming Learning Circle
Sep 3, 2021 · Fundamentals

Automating Excel with Python xlwings: Batch Create, Rename, Print, and Split Workbooks

This tutorial demonstrates how to use Python's xlwings library to programmatically create, save, list, rename, print, and split Excel workbooks and worksheets, providing practical code examples for automating common spreadsheet tasks and improving workflow efficiency.

Excel AutomationPythonbatch processing
0 likes · 5 min read
Automating Excel with Python xlwings: Batch Create, Rename, Print, and Split Workbooks
Python Programming Learning Circle
Python Programming Learning Circle
Jul 8, 2021 · Operations

Python Office Automation Techniques: Document Conversion, Geocoding, Distance Calculation, Batch File Processing, and Outlook Email Automation

This article presents a collection of Python scripts for office automation, covering Word doc‑to‑docx conversion, batch address geocoding using Baidu API, distance computation with geopy, coordinate conversion between Baidu and Gaode, Excel merging, Word‑to‑PDF conversion, extracting tables from Word, and bulk Outlook email sending.

File ConversionOffice AutomationPython
0 likes · 11 min read
Python Office Automation Techniques: Document Conversion, Geocoding, Distance Calculation, Batch File Processing, and Outlook Email Automation
Python Programming Learning Circle
Python Programming Learning Circle
Jun 25, 2021 · Artificial Intelligence

Batch Image Translation Demo Using Youdao OCR API with Python

This article presents a step‑by‑step Python demo that uses Youdao's OCR translation API to batch‑process cosmetic product images, covering API key setup, request parameters, signature generation, GUI implementation with Tkinter, and code snippets for file selection, result storage, and API invocation.

AIImage TranslationOCR
0 likes · 10 min read
Batch Image Translation Demo Using Youdao OCR API with Python
Python Programming Learning Circle
Python Programming Learning Circle
May 12, 2020 · Artificial Intelligence

Batch Image Segmentation with Python and PaddlePaddle

This tutorial demonstrates how to use Python and the PaddlePaddle deep‑learning platform to automatically remove backgrounds from multiple photos in one step, covering installation, verification, and a concise five‑line code example for batch human segmentation.

Deep LearningPaddlePaddlebatch processing
0 likes · 6 min read
Batch Image Segmentation with Python and PaddlePaddle
Vipshop Quality Engineering
Vipshop Quality Engineering
Nov 29, 2018 · Backend Development

Boost Backend Batch Testing Efficiency with a Comparative Test Platform

The article introduces a comparative test platform for financial core systems that automates regression testing of batch jobs, dramatically reducing test cycles from days to under one, while ensuring billing calculations remain accurate across evolving business scenarios.

backend testingbatch processingfinancial systems
0 likes · 12 min read
Boost Backend Batch Testing Efficiency with a Comparative Test Platform
Spring Full-Stack Practical Cases
Spring Full-Stack Practical Cases
Sep 20, 2023 · Backend Development

Master Spring Batch: Build a File‑to‑Database Batch Job with Spring Boot

This tutorial walks through using Spring Batch with Spring Boot 2.6.12 to create a batch job that reads CSV data, processes each record, and writes the results into a MySQL database, covering architecture, configuration, code components, and execution steps.

JPAJavaMySQL
0 likes · 11 min read
Master Spring Batch: Build a File‑to‑Database Batch Job with Spring Boot
Spring Full-Stack Practical Cases
Spring Full-Stack Practical Cases
Aug 22, 2023 · Backend Development

Master Spring Batch with Spring Boot: Build Scalable Batch Jobs Step‑by‑Step

This guide walks through setting up Spring Batch 4.2.7 with Spring Boot 2.4.12, covering architecture, configuration, job, step, reader, processor, writer, listeners, and deployment, demonstrating how to read CSV data, process it, and persist results to a MySQL database.

JPAJavaJob Scheduling
0 likes · 11 min read
Master Spring Batch with Spring Boot: Build Scalable Batch Jobs Step‑by‑Step
Efficient Ops
Efficient Ops
Jun 13, 2023 · Operations

How to Automate Batch Job Retries and Eliminate Midnight Outages

This article explores a real‑world scenario where a support manager faces nightly batch job interruptions, analyzes common database and environment failures, and presents a systematic redesign of the batch framework and executor to enable automatic retry, reducing manual intervention and improving operational reliability.

AutomationException HandlingMySQL
0 likes · 7 min read
How to Automate Batch Job Retries and Eliminate Midnight Outages
macrozheng
macrozheng
Jul 28, 2021 · Backend Development

Master Spring Batch: Core Concepts, Architecture, and Best Practices

This article provides a comprehensive overview of Spring Batch, covering its purpose, architecture, core components such as Job, Step, ItemReader/Writer/Processor, execution contexts, chunk processing, skip strategies, and practical tips for configuration and memory management.

Chunk ProcessingJavaJob Scheduling
0 likes · 20 min read
Master Spring Batch: Core Concepts, Architecture, and Best Practices
ByteDance Cloud Native
ByteDance Cloud Native
Apr 20, 2023 · Cloud Native

How Dragonfly Accelerates Image Distribution and Scales Kubernetes Batch Processing

At KubeCon+CloudNativeCon 2023 in Amsterdam, Volcano Engine and ByteDance presented two technical sessions covering Dragonfly's P2P image distribution best practices and large‑scale Kubernetes batch processing strategies, offering deep insights and real‑world implementations for cloud‑native developers.

Cloud NativeDragonflyImage Distribution
0 likes · 4 min read
How Dragonfly Accelerates Image Distribution and Scales Kubernetes Batch Processing