Stored Object: paper:arxiv.2607.10430

{
"sourceId": "arxiv",
"paperId": "2607.10430",
"url": "https://arxiv.org/abs/2607.10430",
"title": "Emergent Generalization by Representation Learning in Artificial Neural Networks",
"authors": "Hardik Rajpal, Dan Goodman",
"abstract": "Dimensionality reduction has proven powerful for identifying neural manifolds, which are low-dimensional structures underlying high-dimensional neural activity. These low-dimensional representations have improved the interpretability of population-level coding. Yet whether such low-dimensional representations are biologically relevant and confer functional advantages in learning systems, or merely reflect neuron-level activity, remains contested in neuroscience. We show that an explicit information bottleneck forcing a recurrent neural network to learn a low-dimensional representation is necessary for rotational and out-of-distribution generalisation in a time-series prediction task. Using information-theoretic measures of causal emergence, we characterise the dynamics of this representation across the memorisation-to-generalisation transition, finding a non-monotonic trajectory which shows an initial decrease, a minimum, and a subsequent rise to a maximum, even as prediction loss falls monotonically. This trajectory scales with task complexity, and the magnitude of emergent structure reliably predicts generalisation performance. Analysis of CA1 hippocampal activity in mice learning an alternating maze task reveals analogous non-monotonic emergence dynamics that track behavioural performance. Together, these findings indicate that the ability of neural networks to learn compact, distributed and emergent representations confers a functional advantage for generalisation, supporting a causal role for learned representations in cognition.",
"timestamp": "2026-08-06T18:32:11.822Z",
"rating": "novote",
"publishedDate": "2026/07/11",
"tags": [
"Neurons and Cognition (q-bio.NC)",
"Information Theory (cs.IT)",
"Machine Learning (cs.LG)",
"Neural and Evolutionary Computing (cs.NE)",
"Chaotic Dynamics (nlin.CD)"
],
"doi": "",
"journalName": "",
"sourceType": "url"
}

The issue contains a stored paper record and its arXiv URL, but names no source file, test, entry point, or requested code change. Start by reviewing how this repository logs and analyzes academic reading data, then clarify whether the record exposes an ingestion or metadata problem before defining what done means.

Written by the indexing model from the issue text.