Tag

Emergence

0 views collected around this technical thread.

Model Perspective
Model Perspective
Jun 19, 2024 · Fundamentals

How Simple Rules in Cellular Automata Reveal Complex Real-World Patterns

Cellular automata, a discrete mathematical modeling tool built from simple cells, grids, states, neighborhoods, and rules, can simulate complex phenomena such as traffic flow, forest fires, and urban development, demonstrating how local interactions generate emergent patterns and offering insights for scientific research and practical applications.

Emergencecellular automatacomplex systems
0 likes · 9 min read
How Simple Rules in Cellular Automata Reveal Complex Real-World Patterns
JD Tech
JD Tech
Nov 30, 2023 · Artificial Intelligence

Understanding ChatGPT: Mechanisms, Attention, Emergence, and the Chinese Room

This article examines the principles behind ChatGPT, detailing its continuation-based operation, the role of attention mechanisms and transformer architecture, the scaling of neural networks that leads to emergent abilities, and interprets these phenomena through the lenses of compression theory and the Chinese Room thought experiment.

ChatGPTEmergenceattention mechanism
0 likes · 27 min read
Understanding ChatGPT: Mechanisms, Attention, Emergence, and the Chinese Room
JD Retail Technology
JD Retail Technology
Oct 9, 2023 · Artificial Intelligence

Does ChatGPT Possess Theory of Mind? An Exploration of Attention Mechanisms, Emergence, and Compression in Large Language Models

Recent research suggests GPT‑3 exhibits Theory of Mind abilities, prompting a deep dive into attention mechanisms, neural network fundamentals, emergent capabilities, and the role of compression in large language models, while examining philosophical thought experiments like the Chinese Room to question true machine intelligence.

ChatGPTEmergenceTheory of Mind
0 likes · 26 min read
Does ChatGPT Possess Theory of Mind? An Exploration of Attention Mechanisms, Emergence, and Compression in Large Language Models
Architect
Architect
Apr 19, 2023 · Artificial Intelligence

Emergence in Large Language Models: Phenomena, Explanations, and Implications

This article reviews the emergence phenomena observed in large language models, explains how model scale, in‑context learning and chain‑of‑thought prompting contribute to sudden performance gains, discusses small‑model alternatives, and explores the relationship between emergence and the training‑time Grokking effect.

AI researchChain-of-ThoughtEmergence
0 likes · 13 min read
Emergence in Large Language Models: Phenomena, Explanations, and Implications