Was Einstein Just Autocomplete?
The article explores the nature of new information generated by large language models (LLMs) and compares it to Einstein's scientific breakthroughs. It argues that while LLMs may not create new information in a traditional sense, they can reorganize existing data into new representations that enhance human understanding. The discussion raises questions about the cognitive limitations of humans and the role of representation in scientific discovery.
- ▪LLMs process vast amounts of existing data and can surface structures that humans may miss.
- ▪A new representation can open cognitive territory that was previously closed, becoming genuinely new information for the mind.
- ▪Einstein's breakthroughs were largely based on manipulating representations within language rather than direct experimentation.
Opening excerpt (first ~120 words) tap to expand
Was Einstein Just Autocomplete?How a New Representation Becomes New Information for a Bounded MindAudrius BerzanskisMay 29, 20261ShareOften LLM debate comes down to one question: can these models produce anything genuinely new, or are they only predicting text?The answer depends on what you mean by “new.” In the technical sense, an LLM may not create new information at all. But humans are cognitively limited. We can absorb only a tiny fraction of the information available to us, and even processing that fraction requires substantial time and mental effort.
…
Excerpt limited to ~120 words for fair-use compliance. The full article is at Hacker News (Newest).
Discussion
0 commentsMore from Hacker News (Newest)
