1 views collected around this technical thread.
This guide walks you through configuring GitLab to use an external MinIO object store and CertManager for TLS certificates, covering credential setup, bucket creation, Helm chart adjustments, secret management, and verification steps to achieve a secure, efficient cloud‑native deployment.
This tutorial guides readers through creating an AWS account, configuring the AWS CLI, uploading and downloading CSV files to S3, and using Python with pandas to clean, deduplicate, and aggregate the data before re‑uploading the results, illustrating end‑to‑end cloud data processing.
This guide walks you through upgrading the ob‑operator, creating S3 credentials, configuring an OBTenantBackupPolicy YAML, applying the backup, and verifying the backup status to achieve a full data backup of an OceanBase 4.2.5 tenant to Baidu Cloud BOS using Kubernetes.
This article presents NewsBreak's practical deployment of Alluxio Local Cache with Presto on S3, detailing the system architecture, cache design considerations, implementation steps, performance metrics, and future optimization directions to reduce query latency and storage costs.
This guide explains how to install the AWS SDK for PHP, configure an S3 client, perform bucket and object operations, paginate and filter objects, generate presigned URLs, compress downloaded objects with ZipArchive, and set up CORS for AWS S3 buckets.
This article explains how to boost performance and reliability of third‑party service calls in a Kubernetes cluster by configuring Nginx as a caching gateway, covering cache settings, deployment, persistent shared cache via S3, and the associated limitations.
The Shopee Data Infra talk details the current storage architecture, Presto‑based acceleration with Alluxio caching, service‑oriented storage solutions using Alluxio Fuse and S3 APIs, and outlines future enhancements for Spark/Hive integration and CSI/Fuse optimizations, providing a comprehensive view of large‑scale big data storage engineering.
The article introduces Promoter, a Go‑based webhook that fetches Prometheus metrics, renders alert graphs with gonum/plot, stores the images in S3‑compatible object storage, and embeds them in DingTalk notifications, providing deployment instructions, template customization, and core implementation details.
Shopee ClickHouse implements a cold‑hot storage architecture by mounting JuiceFS‑backed S3 as a remote volume, using table‑level storage policies and TTL‑driven background moves to shift data from SSD to cold storage, achieving cost‑effective scalability, improved disk utilization, and validated performance despite operational challenges such as Redis memory pressure and small‑file handling.
This tutorial demonstrates how to configure an open‑source Squid proxy in an AWS VPC to restrict Internet access, allow only approved Amazon S3 buckets and Yum repositories, route traffic through specific gateways, and achieve high availability using Auto Scaling and Route 53.
This article details GrowingIO's systematic approach to reducing AWS expenses by analyzing billing data, tagging resources, visualizing usage, and applying targeted optimizations across EC2 instances, EBS volumes, HDFS storage, network traffic, and S3, while outlining future automation and scaling plans.
The article analyses practical drawbacks of S3 static‑website hosting, the complexities of CDN query‑string caching, and protocol incompatibilities such as HEAD + Range and If‑Match handling, offering concrete lessons and mitigation strategies for cloud operations teams.
The article explains how Chinese filenames cause encoding errors when uploading to Amazon S3, why S3 forces UTF‑8 for website access, and presents a practical Nginx‑based proxy solution that transparently converts GBK‑encoded URIs to UTF‑8 to ensure reliable file retrieval.
This article explains how to create a cross‑platform desktop client for uploading local resources to S3‑backed CDN using Electron, Vue, and lowdb, covering UI design, project structure, main‑renderer process communication, persistent storage, command‑line integration, packaging, and update handling.
This article explains block, object, and file storage concepts based on Ceph, describes how front‑end JavaScript resources are migrated to an S3‑compatible object store, outlines the supporting Lua/Nginx combo tool, caching strategies, and step‑by‑step e‑commerce migration procedures.
The article describes how a Go‑based backend, using a two‑layer job/worker pattern with buffered channels and configurable worker pools, can reliably ingest millions of POST requests per minute, serialize payloads to Amazon S3, and dramatically reduce server count through Elastic Beanstalk auto‑scaling.