0 views collected around this technical thread.
This article introduces the concept and benefits of Java Stream programming, explains its core features such as lazy evaluation, parallel processing, and functional style, and provides detailed examples of creating streams, common intermediate and terminal operations, and practical use cases for data manipulation.
This article teaches how to use Pandas for data reshaping, covering the melt method for converting wide-format data to long-format and the pivot method for the reverse transformation, with practical code examples.
This article provides a comprehensive overview of 20 essential Pandas data processing methods with detailed code examples covering statistics, data cleaning, transformation, filtering, merging, grouping, sorting, reshaping, aggregation, window functions, time series analysis, conditional selection, indexing, slicing, visualization, type conversion, data filling, filtering, renaming, and import/export operations.
Box‑Cox transformation, introduced by Box and Cox in 1964, corrects skewed data to approximate normality by optimizing a λ parameter via maximum likelihood, enabling more accurate statistical modeling and machine‑learning predictions, as demonstrated with a crime‑rate dataset and Shapiro‑Wilk tests.
The article details how to add field‑lineage tracking to Spark SQL by creating a custom SparkSessionExtension that injects a check‑analysis rule and a parser, which capture INSERT statements, analyze the physical plan, and generate a JSON mapping of source‑to‑target fields for data governance.
This article explains the concept, syntax, and practical applications of SQL CASE expressions, covering simple and searched forms, row‑to‑column pivots, statistical transformations, conditional SELECT and UPDATE statements, and CHECK constraints, with detailed code examples and best‑practice tips.
The article explains how building low‑latency applications relies on simplicity, minimizing data transformations, using lightweight libraries, and separating business from infrastructure code to achieve high performance, maintainability, and reduced operational costs.