Apr 30, 2026 · Artificial Intelligence

Why Transformers Are Naturally Succinct: Insights from the ICLR Best Paper

The ICLR 2026 best paper reveals that Transformers achieve extreme succinctness—encoding complex concepts with exponentially fewer symbols than RNNs—while proving that analyzing or verifying such models incurs EXPSPACE‑complete computational costs.

Computational ComplexityEXPSPACESuccinctness

0 likes · 8 min read

Why Transformers Are Naturally Succinct: Insights from the ICLR Best Paper

Machine Learning Algorithms & Natural Language Processing

Apr 27, 2026 · Artificial Intelligence

The Emerging ‘Newton’s Law’ of Deep Learning: Toward a Scientific Theory

Amid rapid scaling of large models, a new paper by researchers from UC Berkeley, Harvard, and Stanford proposes a unified "Learning Mechanics" framework that stitches together five theoretical strands—idealized solvable settings, extreme limits, empirical laws, hyperparameter theory, and universal behavior—to begin forming a scientific theory of deep learning.

NTKTheoretical AIdeep learning

0 likes · 18 min read

The Emerging ‘Newton’s Law’ of Deep Learning: Toward a Scientific Theory