Cybernetics · Feedback · Control Theory · Information · Human Use of Human Beings

McCulloch-Pitts neuron · First neural network model · Logical calculus of nervous activity · 1943

McCulloch-Pitts neuron · Boolean logic in biology · Self-taught mathematician · Tragic prodigy

Mother of All Demos · Mouse · Hypertext · NLS · Augmenting human intellect

AI · Cognitive Science · Frames

Levels of analysis · The computational theory of vision · Natural constraints and stereopsis · Codons and the cerebellar theory · Simple memory

Perceptron · Neural Learning · Pattern Recognition

Yao's minimax theorem · Circuit complexity · Quantum computing theory · Tsinghua IIIS · 姚期智式 Yao Complexity

AGI Consciousness Architecture · Curiosity as Systemic Principle · Metacognition · Theory of Mind · Haptics · Embodied Cognition

Topological Reasoning · Perpendicular Thinking · Curiosity as Method · Machine Minds

Adaptive Resonance Theory · Stability–Plasticity · Complementary Computing · Neural Dynamics of Learning

Conditional Probability Computers · Classification of Signals · Informon Theory · Learning Machines

Bounded rationality · Satisficing · Nobel Economics 1978 · Administrative Behaviour · Cognitive architecture

Coined "artificial intelligence" · Dartmouth Conference 1956 · Lisp · Formal reasoning · Situation calculus

GPS · Physical Symbol System Hypothesis · Soar · Cognitive science · Unified theories of cognition

What Computers Can't Do · Phenomenological critique of AI · Heidegger and the limits of formal representation

SHRDLU · Breakdown as Revelation · Heidegger and Computing · Design for Human Practice

The Organization of Behavior · Hebbian learning rule · Synaptic plasticity · Cell assembly theory · 1949

Hopfield networks · Associative memory · Energy landscapes · Attractor networks · Nobel Physics 2024

Backpropagation · Parallel Distributed Processing · Connectionism · PDP volumes 1986

Deep Learning · Backpropagation · Boltzmann Machines · Capsule Networks · Neural Nets

Reinforcement Learning · Temporal Difference · The Bitter Lesson · Policy Gradient · Value Functions

Convolutional Neural Networks · Self-Supervised Learning · Meta AI · Vision

LSTM · Long Short-Term Memory · Curiosity · Self-Modifying Code · Compressed History

Deep Learning · Neural Language Models · Attention · Recurrent Networks · AI Safety

Persistent homology as featurisation · Filtration design · Element-specific and multiscale representations · Topology for molecular machine learning · What survives perturbation

Tensor rank and its NP-hardness · Ill-posedness of best low-rank approximation · Topological obstructions to neural separability · Conservation under composition · Three kinds of no

ResNet · Skip connections · 何恺明式 Residual Learning · Visual recognition · Nobel-adjacent architectural insight

Deep Q-Learning · DQN · Atari · Asynchronous Methods · Deep Reinforcement Learning

On Intelligence · The memory-prediction framework · Hierarchical temporal memory · Active dendrites and sparse codes · A thousand models in the cortical columns

Neural manifolds · Separating manifolds, not points · Capacity per neuron · Statistical mechanics of disordered networks · Untangling geometry through a hierarchy

Prioritized memory access · Hippocampal replay and planning · The value of computation · Fatigue, boredom and opportunity cost

Decision Neuroscience · Arbitration Between Goal-Directed and Habitual Control · Model-Based fMRI · Reinforcement Learning in the Brain

Latent Reasoning · In-Context Learning through Recurrent Memory · Sparse Hebbian Fast Weights · Cost–Accuracy Frontier

Optimal Transport · Matrix Scaling · AI Mathematics

AI · Cosmology · Scientific Machine Learning

DeepMind · AlphaGo · AlphaFold · Neuroscience-Inspired AI · General Intelligence

DeepSeek · 梁文锋式 Constraint-Driven Efficiency · Architectural innovation under hardware restriction · Open-source frontier AI

OpenAI · GPT · Scaling Laws · Sequence to Sequence · AI Safety · Superintelligence

Zero to Hero · Neural networks from scratch · Tesla AI · OpenAI · Understanding through rebuilding

comma.ai · tinygrad · Open-source autonomous driving · Building against institutional consensus

Moonshot AI · Kimi · Long-context models · 杨植麟式 Long-Context Architecture

World Models · Decision Transformers · RL

Recursive composition over structure · Casting every task into one interface · Self-improving training pipelines · Specification before optimisation · Write the metric, then cheat it

State space sequence models · Fixed state size as a design commitment · Memory as online function approximation · Selectivity bought with speed · Sequences as signals

IO-aware algorithms · Bytes moved, not operations counted · Exact attention made fast · Kernels with a hardware expiry date · Attention and state space models as one class

Open-endedness · Novelty and learnability, judged by an observer · Cultural accumulation across generations · Manufacturing a gradient for discovery · The task space as the experiment

Model Quantization · KV Cache · Bandwidth-Bound Decoding · Core ML & MLX · Unified Memory on Apple Silicon

Neural Darwinism · Dynamic core hypothesis · Consciousness as re-entry · Nobel Prize immunology

Neuromorphic engineering · Collective electrodynamics · Hearing the light · Silicon retina

Neural correlates of consciousness · Integrated Information Theory · The Feeling of Life Itself

Integrated Information Theory · Phi · Consciousness · IIT · The Intrinsic Causal Power of Systems

VR pioneer · You Are Not a Gadget · Dawn of the New Everything · What technology does to the humans using it

AIMA · Human Compatible · Beneficial AI · Uncertainty about human preferences · Inverse reward design

Human Brain Project · Blue Brain · Columnar cortical simulation · Neuromorphic computation

The hard problem of consciousness · Philosophical zombies · Qualia · AI consciousness

Superintelligence · Orthogonality thesis · Instrumental convergence · Existential risk · Future of Humanity Institute

Consciousness as self-modelling · Predictive processing · AI as mind · The hard problem dissolved

AI Alignment · Bayesian Reasoning · Rationality · Existential Risk · LessWrong

RLHF · Scalable oversight · ELK problem · ARC Evals · The technical core of AI alignment

The Ultraintelligent Machine · The Intelligence Explosion · The Docility Proviso · Weight of Evidence · Decibans

Constructionism · Logo · Mindstorms · Learning by Making · Hard Fun

Bayesian networks · Causal inference · Do-calculus · The Book of Why · Turing Award 2011

Support vector machines · VC dimension · Structural risk minimisation · Statistical learning theory

Bayesian topological data analysis · Persistence diagrams as point processes · Random cardinality as measurement · Substituted likelihoods and generalised posteriors · Generative models of shape

Bayesian topological neural networks · Epistemic and aleatoric uncertainty separated · Calibration as a curve rather than a score · Fixed manifold filters as inductive bias · Confidence where the data stops

Circuits of the Mind · The neuroidal model · Memorisation and association on weak synapses · Learnability · Resources counted, never assumed free

Fly olfaction as locality-sensitive hashing · Expand and sparsify · A Bloom filter for novelty · Circuits read as algorithms · Benchmarks at equal cost

Causal Artificial Intelligence · Causal Reinforcement Learning · Transportability & Data Fusion · Counterfactual Decision-Making

Interventionist Causation · Variable Choice · Invariance · What an Agent Can Learn by Doing