Tag

Puppeteer

1 views collected around this technical thread.

Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
Jul 11, 2024 · Backend Development

Scraping Frontend Job Listings from Boss Zhipin with Puppeteer and Storing in MySQL using NestJS

This tutorial demonstrates how to use Puppeteer to crawl frontend job postings from the Boss Zhipin website, extract details and job descriptions, and persist the data into a MySQL database through a NestJS application with TypeORM, including Docker setup and optional SSE streaming.

MySQLNestJSPuppeteer
0 likes · 10 min read
Scraping Frontend Job Listings from Boss Zhipin with Puppeteer and Storing in MySQL using NestJS
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
Apr 15, 2024 · Frontend Development

Automating Visual Regression Testing for Frontend Component Libraries with jest-image-snapshot and jest-puppeteer

This article explains how to set up and use jest-image-snapshot together with jest-puppeteer to automate visual regression testing for atomic frontend components, covering configuration, code examples, CI integration, and best practices for preventing unintended UI changes.

Frontend TestingJestPuppeteer
0 likes · 24 min read
Automating Visual Regression Testing for Frontend Component Libraries with jest-image-snapshot and jest-puppeteer
IT Services Circle
IT Services Circle
Feb 1, 2024 · Frontend Development

Understanding Headless Browsers and Using Puppeteer for Automation, Screenshots, and PDF Generation

This article explains what headless browsers are, outlines their advantages and limitations, introduces Puppeteer as a Node.js library for controlling headless Chrome, and provides step‑by‑step code examples for taking screenshots, generating PDFs, and performing automated web interactions.

Node.jsPDF generationPuppeteer
0 likes · 11 min read
Understanding Headless Browsers and Using Puppeteer for Automation, Screenshots, and PDF Generation
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
Jan 19, 2024 · Frontend Development

Building a Discreet VSCode Extension for Browsing Content While Coding

This article guides front‑end developers through creating a discreet VSCode extension that fetches and displays content such as news or comments, detailing required knowledge, installation steps, key APIs like status bar, commands, quick pick, hover providers, and includes essential code snippets.

PuppeteerTypeScriptVSCode
0 likes · 14 min read
Building a Discreet VSCode Extension for Browsing Content While Coding
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
Dec 11, 2023 · Frontend Development

Bypassing Juejin Slider Captcha with Puppeteer and Canvas Image Recognition

This article demonstrates how to use Puppeteer and the Canvas API to automate login on Juejin, extract the slider captcha image, apply grayscale and binarization processing to locate the gap, calculate the required drag distance, and simulate human‑like mouse movements with easing functions for successful verification.

Image RecognitionPuppeteerWeb Scraping
0 likes · 17 min read
Bypassing Juejin Slider Captcha with Puppeteer and Canvas Image Recognition
ByteFE
ByteFE
Dec 6, 2023 · Frontend Development

Comprehensive Guide to Building Chrome Extensions with React/Vue, Debugging, and E2E Testing

This article explains the overall architecture of Chrome extensions, how to create popup, DevTools, and content scripts using React or Vue, configure manifest.json, set up multi‑entry Webpack builds, debug each component, and perform end‑to‑end testing with Puppeteer and Xvfb for CI environments.

Chrome extensionsE2E testingPuppeteer
0 likes · 18 min read
Comprehensive Guide to Building Chrome Extensions with React/Vue, Debugging, and E2E Testing
Sohu Tech Products
Sohu Tech Products
May 12, 2023 · Backend Development

Unified Poster Image Generation Service for FoxFriend: Architecture, Implementation, and Optimization

This article details the design and deployment of a unified poster image generation service for the FoxFriend social product, explaining the background, challenges of platform‑specific implementations, the Node.js + Puppeteer solution, architectural flow, engineering stack, performance optimizations, operational results, and future enhancements.

OptimizationPuppeteerbackend
0 likes · 16 min read
Unified Poster Image Generation Service for FoxFriend: Architecture, Implementation, and Optimization
TAL Education Technology
TAL Education Technology
Mar 9, 2023 · Frontend Development

Using Chrome DevTools Recorder to Boost Development Efficiency with Puppeteer

This article introduces Chrome DevTools' experimental Recorder feature, explains what Puppeteer is, provides a step‑by‑step guide to record, edit, import, and export automation scripts, and demonstrates how the generated Puppeteer code can streamline front‑end testing and reduce manual effort.

ChromePuppeteerRecorder
0 likes · 13 min read
Using Chrome DevTools Recorder to Boost Development Efficiency with Puppeteer
ByteDance Web Infra
ByteDance Web Infra
Oct 20, 2022 · Frontend Development

Optimizing ByteDance Frontend Monitoring SDK: Size Reduction, Benchmarking, and Real‑World Performance Analysis

This article explains how ByteDance’s frontend monitoring SDK is continuously optimized for bundle size and runtime performance through micro‑ and macro‑level code refactoring, benchmark testing with Benny and Puppeteer, and real‑world analysis using Perfsee Lab, ultimately achieving minimal impact on page load metrics.

OptimizationPuppeteerSDK
0 likes · 18 min read
Optimizing ByteDance Frontend Monitoring SDK: Size Reduction, Benchmarking, and Real‑World Performance Analysis
ByteDance Terminal Technology
ByteDance Terminal Technology
Oct 13, 2022 · Frontend Development

Optimizing the Size and Performance of a Frontend Monitoring SDK

This article explains how ByteDance's frontend monitoring SDK was systematically reduced in bundle size and runtime overhead through micro‑optimizations such as avoiding long class names, using functional patterns, minimizing polyfills, splitting files, leveraging Puppeteer‑based benchmarks, and applying requestIdleCallback scheduling to improve user experience on both web and mobile platforms.

OptimizationPuppeteerSDK
0 likes · 19 min read
Optimizing the Size and Performance of a Frontend Monitoring SDK
政采云技术
政采云技术
Jun 15, 2022 · Frontend Development

Applying Data Statistics to Frontend Performance Detection and Optimization

This article explains how a self‑built performance testing platform leverages data‑statistical models, such as scoring and interval models based on normal distribution and percentile analysis, to quantify web‑page metrics, guide automated and semi‑automated optimizations, and integrate with CI/CD workflows for frontend development.

OptimizationPuppeteerdata-statistics
0 likes · 24 min read
Applying Data Statistics to Frontend Performance Detection and Optimization
Xueersi Online School Tech Team
Xueersi Online School Tech Team
Jan 21, 2022 · Frontend Development

White‑Screen Detection and Performance Optimization for Front‑End Applications

The article explains the concept of white‑screen time, its impact on user experience, and presents multiple detection methods—including Navigation Timing API, MutationObserver, element‑point analysis, and headless‑browser simulation—along with implementation code and a monitoring‑alert architecture for front‑end performance optimization.

MutationObserverPuppeteerfrontend
0 likes · 17 min read
White‑Screen Detection and Performance Optimization for Front‑End Applications
转转QA
转转QA
Jan 19, 2022 · Frontend Development

Getting Started with UI Automation Testing Using Puppeteer and Mocha

This tutorial explains how to set up and use Puppeteer together with the Mocha test framework to create, run, and report UI automation test cases for web and H5 applications, covering installation, a demo script, selector handling, and visual test reporting.

JavaScriptNode.jsPuppeteer
0 likes · 6 min read
Getting Started with UI Automation Testing Using Puppeteer and Mocha
Yang Money Pot Technology Team
Yang Money Pot Technology Team
Apr 1, 2021 · Frontend Development

Implementing Page-Level User Interaction Recording and Replay for Insurance Compliance Using rrweb, Puppeteer, and FFmpeg

This article details a compliance‑driven solution that records, replays, and merges user interaction videos across multiple insurance web pages by leveraging rrweb for event capture, Puppeteer for automated playback, and FFmpeg for video stitching, while addressing performance, storage, and privacy challenges.

FFmpegPuppeteerUser Interaction
0 likes · 18 min read
Implementing Page-Level User Interaction Recording and Replay for Insurance Compliance Using rrweb, Puppeteer, and FFmpeg
58 Tech
58 Tech
Mar 12, 2021 · Operations

Continuous Delivery Evolution for Anjuke Mini Programs: From Manual Releases to Platformized Automation

This article details how the Anjuke mini‑program team tackled frequent, fragmented releases across multiple platforms by standardizing processes, introducing local SDK‑based uploads, integrating Jenkins, and ultimately building a platform‑based service with UI automation using Puppeteer, resulting in reduced cost, higher transparency, and scalable multi‑program support.

CI/CDContinuous DeliveryJenkins
0 likes · 12 min read
Continuous Delivery Evolution for Anjuke Mini Programs: From Manual Releases to Platformized Automation
Python Programming Learning Circle
Python Programming Learning Circle
Dec 17, 2020 · Backend Development

Scraping Taobao Live Chat Messages Using Puppeteer and WebSocket Decryption

This article details a step‑by‑step method for extracting live chat bullet comments from Taobao live streams by analyzing page sources, intercepting the token‑providing API with Puppeteer, establishing a WebSocket connection, and decoding the received base64‑ and GZIP‑compressed messages to retrieve clean usernames and comment texts.

PuppeteerWeb ScrapingWebSocket
0 likes · 9 min read
Scraping Taobao Live Chat Messages Using Puppeteer and WebSocket Decryption
Sohu Tech Products
Sohu Tech Products
Dec 9, 2020 · Frontend Development

Automatic Generation of Skeleton Screens Using DOM Analysis and Puppeteer

This article explains what skeleton screens are, reviews existing implementation methods, and presents a custom DOM‑based approach with configurable rules, code snippets, and a Puppeteer‑driven CLI tool that automatically generates and injects skeleton screens for web pages.

DOMPuppeteerSkeleton Screen
0 likes · 11 min read
Automatic Generation of Skeleton Screens Using DOM Analysis and Puppeteer
政采云技术
政采云技术
Oct 29, 2020 · Frontend Development

How to Build a Custom Frontend Performance Testing System from Scratch

This article explains how to design and implement a bespoke performance testing platform for web pages using Lighthouse, Puppeteer, and Node.js, covering architecture, data collection, hook functions, gatherer modules, scoring logic, and automated weekly reporting.

Puppeteerfrontendlighthouse
0 likes · 18 min read
How to Build a Custom Frontend Performance Testing System from Scratch
vivo Internet Technology
vivo Internet Technology
Aug 5, 2020 · Frontend Development

Using Puppeteer for Emoji Scraping, Headless Chrome, and Front‑End Automation Testing

The article demonstrates how to use Puppeteer—a Node.js API built on the Chrome DevTools Protocol—to run headless Chrome for tasks such as scraping Google emoji images, generating screenshots or PDFs, and automating front‑end tests by launching a browser, navigating pages, handling cookies, simulating user input, capturing responses, and saving results.

Automation TestingNode.jsPuppeteer
0 likes · 15 min read
Using Puppeteer for Emoji Scraping, Headless Chrome, and Front‑End Automation Testing
JD Retail Technology
JD Retail Technology
Jun 29, 2020 · Frontend Development

Implementing End-to-End Testing with Puppeteer for the Tongtian Tower Build System

The article details how the Tongtian Tower team adopted Puppeteer for end‑to‑end testing of their web‑based build system, covering technology selection, core concepts, API usage, project architecture, practical challenges, and the measurable efficiency gains achieved through automation.

E2E testingFrontend TestingPuppeteer
0 likes · 11 min read
Implementing End-to-End Testing with Puppeteer for the Tongtian Tower Build System