1 views collected around this technical thread.
This article introduces the fundamentals of compiler front‑end development, covering lexical analysis with finite automata, syntax analysis using context‑free grammars and parsing strategies, and semantic analysis concepts, while providing practical Antlr examples for Java code tokenization, parsing, and semantic checks.
The article explains why most programming languages forbid variable names that begin with digits, covering the definition of variables, Python's naming rules, human and computer confusion caused by such names, and the impact on code readability and maintainability.
The article walks readers through designing and implementing TinyLanguage—a minimal interpreted language with 4‑byte integers, constants, if/else, for loops, and print—by using Flex for lexical analysis, Bison for parsing into an AST, and an execution engine, even showing a Fibonacci example and future LLVM compilation possibilities.
This article explains MySQL 8.0.20's lexical analysis, describing the lexer’s role, the state‑machine implementation, step‑by‑step debugging with LLDB on macOS, the init_state_maps function, key source code snippets, and the optimizations introduced in this version.
This article explains how PHP_CodeSniffer parses PHP source code into tokens using lexical analysis, demonstrates token extraction with token_get_all, and guides readers through creating a custom rule to prohibit hash‑style comments, covering rule library setup, Sniff implementation, and execution.
This article explains how to create a JetBrains IntelliJ plugin that parses MySQL DDL statements, performs lexical analysis to extract table and column information, and automatically generates corresponding Python ORM model classes, illustrating the underlying state‑machine lexer, recursive parsing logic, and sample code.
This tutorial explains how to implement a simple LL(1) parser in Go for SQL queries, covering lexical analysis, syntax analysis, finite‑state‑machine strategy, and testing, providing complete code snippets and practical guidance for developers interested in parser construction.
This article explains how PHP_CodeSniffer performs static analysis by tokenizing PHP source code, describes PHP’s execution process, clarifies the concept of tokens and how to retrieve them with token_get_all and token_name, and shows how this knowledge enables custom rule creation.