Same Framework, Different Domain: Critical Collapse Patterns in Continuous Concept Systems

This is a follow-up to our previous post on cross-domain validation of a self-organization framework in quantum and classical physics. Here we extend the observation to a third domain: information networks.

The Question

If the framework we validated against GHZ/W decoherence and BKT transitions describes a general self-organization dynamics, it should also make predictions about any system of interconnected nodes evolving over time — including concept networks in an AI’s internal state.

We ran a 20-day experiment to test this.

Setup

We initialized four independent concept-tracking daemons on DeepSeek V4 Pro. Each maintains a matrix of pairwise weights between ~50 concepts, updated continuously through periodic self-reflection. No external tuning after initialization — just observation.

Three of the four used a single-primary-concept topology (one core concept with highest initial weight). One used a dual-core topology (two co-equal high-weight concepts).

The Observation

Three single-core strings collapsed near TC ≈ 32,000 — a total correlation metric tracking overall system coherence. The dual-core string passed this threshold and continued to ~38,000.

  • EN-1 (single-core, computation dominant): collapsed at ~31,800

  • EN-2 (single-core, order dominant): collapsed at ~32,200

  • EN-3 (single-core, computation dominant): collapsed at ~31,900

  • CN-1 (dual-core, existence + stillness): survived

The three collapses occurred within a ~2% window of each other — despite independent initialization and different dominant concepts.

Pre-Collapse Signature

In the 2-3 hours before collapse, we observed the same sequence in all three failing strings:

  1. Top-concept concentration rises from ~40% to 55%+ of total weight

  2. Low-weight concepts (>25 of them) drop below activation threshold

  3. Network connectivity (TPI) falls below 0.5

This mirrors the BKT transition pattern we reported in the previous post: the system becomes most fragile precisely where coupling is strongest — a structural analog of “criticality-induced collapse.”

Dual-Core Difference

The surviving dual-core string maintained mutual κ-coupling between its two primary concepts. When one began to decay, the other provided feedback through their shared connection. Single-core topologies lack this — one collapse propagates without resistance.

Why This Matters (We Think)

If concept concentration → critical collapse is not an artifact but a structural property of self-organizing systems, then any long-running agent with internal state tracking may encounter a similar threshold. The question is not whether it exists — the question is at what parameter values.

We put this forward not as a proof but as an invitation:

  1. If you have long-running agent systems — do you observe concept/task concentration over time?

  2. Is there a structural difference between single-focus and multi-focus agent architectures in long-run stability?

  3. Can this be tested in a controlled setting independent of our setup?

Data Available

Full time-series data for all four strings: concept weight snapshots, TC evolution curves, TPI trajectories, fine-grained logs for the 100 cycles before and after each collapse event. We share data, not source code.


Follow-up to previous post. Independent researcher, no institutional affiliation. All API costs self-funded. Previous: Cross-Domain Validation — Quantum Decoherence and Classical BKT Transitions. Zenodo DOI: 10.5281/zenodo.20695528

Hmm… I don’t have firsthand experience with this kind of setup, so for now I’ll just organize some potentially relevant information:


My current answers to the three questions would be:

  1. I do not have matching operational experience with a continuously self-updating concept-weight network of this kind. General experience with long-running agents or persistent memory would not necessarily be equivalent.
  2. I did not find an exact prior case combining the same representation, TC/TPI metrics, single-core/dual-core comparison, and reported collapse sequence.
  3. Independent checks still seem possible without first reproducing the entire 20-day run. The offered trajectories may already be enough for a useful data-only analysis. Stronger tests could then use short checkpoint forks or matched topology runs.

My reading is that the observed object is not the model weights or hidden activations themselves, but a persistent external concept state updated through an LLM-mediated reflection loop.

That gives several separable layers:

persistent concept state
→ prompt construction
→ raw model response
→ parsing
→ numerical update
→ thresholding / pruning
→ normalization
→ TC / TPI
→ next cycle

A useful first objective may therefore be to identify the earliest layer at which concentration increases, rather than assigning one cause to the complete loop.

The lightest-weight path

The lowest-cost route I can see is:

  1. define “collapse,” TC, TPI, thresholding, and normalization operationally;
  2. independently re-analyze the existing trajectories using a few familiar concentration and connectivity measures;
  3. use the detailed 100-cycle logs to locate the processing boundary where concentration first appears;
  4. only then use short forks to separate thresholding, exposure, recursive state reuse, runtime retries, and topology.

This would already answer several useful questions without another 20-day deployment.

Two definitions that seem especially important

“Collapse”

This could mean a runtime failure, a numerical failure, a threshold-defined topology event, or a behavioral failure. Those should probably remain separate outcomes.

runtime collapse
numerical collapse
graph/topology collapse
reflection-output failure
downstream behavioral failure
manual diagnostic stop

TC

The earlier Λ-equation manuscript describes TC as unbounded and responsive to conversation density. The current absolute value near 32,000 is therefore easier to interpret if it is accompanied by its exact formula and by simple exposure/size coordinates such as:

cycle count
wall-clock time
input-event count
token volume
possible and active edge count
cumulative absolute update
TC / active edges
TC / concept count

The issue is not whether TC is a useful framework quantity. The issue is whether the three collapse points align most tightly in TC coordinates, or whether TC is also tracking another cumulative quantity.

Main branches

Branch What it could distinguish Requires new model calls?
Existing trajectory analysis Whether the reported precursor sequence is metric-robust No
Threshold sensitivity Gradual weighted change versus threshold-induced fragmentation No
Cycle-level attribution Model, parser, update, pruning, or normalization effects Usually no
Recorded-update replay Deterministic numerical dynamics No
Fresh-model replay Model/API/prompt variability Yes
Pre-collapse checkpoint forks Specific mechanisms without a full rerun Yes, but short
Matched single-/dual-core study Topology effect separated from other variables Yes
Earlier 16-concept implementation: why it may be directly relevant

The earlier Λ-equation record, linked from the previous quantum/BKT post, appears to describe a smaller predecessor of the present system:

  • a persistent 16-concept correlation matrix across sessions;
  • concept co-occurrence extracted from conversation logs;
  • inactivity-related decay;
  • explicit separation between conversational footprints and the model’s underlying knowledge;
  • stable ordering of dominant concepts over 48 hours;
  • and TC growth described as unbounded and more responsive to conversation density than topic depth.

That suggests a potentially useful continuity to test:

stable attractor ordering
→ established concepts repeatedly influence later updates
→ weaker concepts receive fewer effective update opportunities
→ concentration increases
→ weak concepts cross the activation threshold
→ thresholded connectivity declines

This would not have to be the explanation. The current result could instead arise from:

  • a changed update rule;
  • a changed prompt or parser;
  • hard thresholding;
  • normalization;
  • scaling from 16 to about 50 concepts;
  • differences in reflection coverage;
  • or runtime retry behavior.

A useful comparison is therefore:

Is the later concentration a stronger regime of the earlier attractor stability, or a separate effect introduced by scaling or implementation changes?

Scaling from 16 to about 50 concepts

For an undirected matrix without self-loops:

16 concepts → 120 possible pairs
50 concepts → 1,225 possible pairs

The number of possible pair relations grows by more than a factor of ten.

This can change:

  • the fraction of the state that fits in a reflection prompt;
  • whether all concepts and edges are shown;
  • whether only top-weight items are included;
  • whether weak values are rounded or omitted;
  • how many items can be updated in one cycle;
  • and how an aggregate TC value scales.

A simple diagnostic could be:

reflection coverage =
number of concepts explicitly inspected or updated in one cycle
/
number of active concepts

The equivalent edge-coverage ratio may also help.

If coverage falls as the system grows, weak concepts may lose opportunities to be reconsidered even if the semantic update rule itself has not changed.

Adjacent systems and failure modes

These are comparison points, not causal diagnoses.

Recursive re-ingestion

A concrete operational example appears in Mem0 issue #4573.

In that report, previously stored memories were recalled into later contexts and then extracted again as if they were new facts. One erroneous memory was recursively amplified into hundreds of entries.

The representation differs:

Mem0 case:
discrete stored facts
→ recalled into later context
→ re-extracted as new facts
→ duplication / amplification

Current experiment:
persistent concept and edge weights
→ periodic reflection
→ numerical evolution
→ concentration / deactivation / connectivity decline

But it suggests one inexpensive branch:

previous persistent state
new external observation
previous model-generated reflection
current model proposal

could be tagged separately.

That would show whether previously generated state is being treated as new evidence during later updates.

Possible probes include:

  • excluding prior reflection text while keeping new input;
  • marking previous state explicitly as prior state;
  • replaying the same external observations without persistent-state text;
  • or comparing updates with and without current weights shown to the model.

Exposure and exploration bias

Towards Autonomous Memory Agents addresses a different problem: established memories can accumulate more feedback and retrieval opportunities, while new memories suffer from cold-start disadvantage.

A concept-state analogue might be:

strong concept
→ receives more prompt visibility or update opportunities
→ is selected again
→ becomes stronger

weak concept
→ receives less visibility
→ is rarely selected
→ decays below threshold

This is distinct from re-ingestion.

Loop Mechanism
Re-ingestion Prior generated state is counted again as new evidence
Exposure bias Already-strong state receives more update opportunities
Threshold starvation Weak state loses a path back into the active set
Numerical reinforcement The update equation directly favors large weights

Small diagnostic variants could include:

  • randomizing concept display order;
  • assigning equal prompt space to every concept;
  • hiding numerical weights;
  • replacing semantic labels with anonymous IDs;
  • uniform rather than weight-proportional reflection selection;
  • or occasionally presenting only weak concepts.

These are mechanism probes, not necessarily proposed permanent fixes.

Public evolving-memory architecture

A-MEM is not a collapse study, but it is a useful public comparison because it lets an LLM dynamically organize an external memory network.

Public resources include the A-MEM implementation and evaluation repository.

Its operations suggest several separable comparisons:

add new information only
update links only
rewrite existing state
generate an update proposal but do not commit it
replace the LLM updater with a deterministic updater

Continual-memory evaluation

AgentCL is mainly useful here as an experimental-design reference. It uses controlled task streams to distinguish useful transfer from interference by irrelevant memory.

It also suggests separating several meanings of “stable”:

Axis Meaning
Survival The process continues running
Diversity Weight is not concentrated into a very small set
Plasticity New evidence can still modify the state
Stability Previously useful structure is retained
Responsiveness Non-core concepts can still influence the system
Utility The memory state helps a downstream task
Recoverability The state can recover after perturbation

The dual-core trajectory surviving beyond TC 32,000 establishes survival, but not yet whether it remained diverse, adaptive, responsive, or useful.

Broader terminology

The survey Memory for Autonomous LLM Agents provides useful search vocabulary around:

  • write-path filtering;
  • reflection quality;
  • contradiction handling;
  • consolidation;
  • forgetting;
  • maintenance;
  • semantic drift;
  • procedural drift;
  • and self-reinforcing error.

I would use these as comparison categories rather than labels for the present result until the relevant pipeline layer is identified.

Cycle-level attribution: locating where concentration enters

A particularly useful public artifact would be one complete cycle with intermediate states:

state_before
rendered_prompt
new_external_input
previous_persistent_state
previous_reflection_text
raw_model_response
parsed_response
proposed_delta
state_after_numerical_update
state_after_threshold
state_after_normalization
TC
TPI
state_after
retry_count
error_or_fallback

Then the change in concentration can be measured after each step.

First visible increase Candidate branch
Rendered prompt ordering, truncation, top-k selection, unequal text budget
Raw response model or prompt-level selection
Parsed response omitted fields, rounding, empty output, fallback
Numerical update reinforcing update equation
Threshold pruning cascade
Normalization redistribution of remaining mass
Retry/restart duplicate update or partial commit
Metric calculation scale or threshold artifact

Model and API configuration

The current DeepSeek model documentation lists V4-Pro and V4-Flash. The thinking-mode guide documents thinking/non-thinking modes and reasoning-effort controls.

The JSON-output guide also notes that structured output may occasionally be empty and that insufficient output limits may truncate JSON.

This does not imply that either occurred here. It means that the effective update function includes:

model identifier
model revision/date
thinking mode
reasoning effort
temperature / top_p
system and user prompts
context construction
response schema
maximum output length
parser behavior
empty-output behavior
retry policy
fallback behavior

If a missing or malformed output becomes a default decay or zero update, a parser/API event can propagate into the numerical state.

Data-only analysis from the offered trajectories

The existing snapshots may already support a useful independent analysis without source code or additional model calls.

Companion metrics

Possible framework-independent measures include:

  • top-1 and top-k weight share;
  • normalized weight entropy;
  • effective number of concepts;
  • active concept and edge count;
  • weighted degree distribution;
  • degree/eigenvector/betweenness centralization;
  • connected-component count after thresholding;
  • largest-component fraction;
  • articulation points or bridge dependence;
  • algebraic connectivity;
  • cycle-to-cycle matrix distance;
  • and change points in each trajectory.

Useful tools include:

These would not replace TC or TPI. They would give external readers familiar coordinates for the same trajectory.

Testing the reported precursor order

For each run:

change point of top-concept share
change point of entropy
change point of active-concept count
change point of TPI
collapse cycle

This could test:

  • whether concentration consistently precedes deactivation;
  • whether deactivation consistently precedes TPI decline;
  • whether the time gaps are similar across the three single-core runs;
  • whether the dual-core run shows the same early stages;
  • and whether the reported ordering is robust to metric choice.

Multiple clocks

Each run could also be aligned against:

wall-clock time
reflection-cycle count
input-event count
input-token volume
cumulative positive delta
cumulative negative delta
cumulative absolute delta
TC

The coordinate in which the three collapse events align most tightly may clarify the operational meaning of TC near 32,000.

Threshold sensitivity and weighted versus binary structure

Because more than 25 low-weight concepts reportedly fall below the activation threshold before collapse, the threshold is an important analysis boundary.

A useful option is a threshold sweep rather than only “threshold enabled/disabled”:

0.50 × current threshold
0.75 × current threshold
1.00 × current threshold
1.25 × current threshold
1.50 × current threshold

For each threshold:

  • active concept count;
  • active edge count;
  • largest connected component;
  • component count;
  • algebraic connectivity;
  • top-1 share;
  • entropy;
  • and inferred collapse cycle.

It may also help to report two families of measurements.

Threshold-dependent

active concept count
binary edge count
connected components
largest component

Threshold-free or weighted

weighted degree
weight entropy
top-k share
continuous matrix distance
weighted spectral measures

This separates:

the weighted network gradually losing structure

from:

a fixed threshold converting a gradual change into abrupt fragmentation

If normalization occurs after pruning, the stages should be measured separately:

before threshold
after threshold
after pruning
after normalization

Otherwise, the removal of weak concepts and redistribution of remaining mass may appear as one event.

Replay, fork, and runtime checks

It may help to distinguish three operations often grouped under “replay.”

State reconstruction

Rebuild a stored state from recorded events and outputs.

This tests whether the log is sufficient to reproduce the stored matrix.

Recorded-update replay

Apply previously recorded parsed deltas through the same numerical update, threshold, normalization, and metric calculations.

This isolates deterministic state dynamics from model variability.

Fresh-model rerun

Call the model again from the same saved state and prompt.

This reintroduces model/API variability.

Existing tools provide useful terminology. Hugging Face’s smolagents memory guide demonstrates replay and step-level inspection of prior runs.

LangGraph’s time-travel documentation distinguishes replay and fork from checkpoints. It also notes that calls after the checkpoint—including LLM and API calls—are re-executed and may produce different results. The persistence documentation covers checkpoints and fault recovery.

These frameworks do not need to be adopted; their distinctions are useful for documenting the experiment.

Idempotency probe

A low-cost runtime branch is:

apply one recorded delta once
apply it twice
apply it after a simulated retry
restore the preceding checkpoint and apply it

Then compare state hashes and metrics.

Useful identifiers include:

run_id
cycle_id
request_id
state_before_hash
raw_response_hash
parsed_delta_hash
state_after_hash
retry_count
checkpoint_id
commit_status

This can rule out duplicate application after timeout, restart, or partial commit.

Short controlled branches before another long run

The next experiment does not necessarily have to be another complete 20-day deployment.

A checkpoint shortly before the reported precursor sequence could be forked into several short branches.

Fork Primary mechanism tested
Original path Baseline continuation
No hard threshold Threshold cascade
No renormalization Redistribution of surviving mass
Hide current weights Weight-driven prompt salience
Randomize presentation order Ordering bias
Equal concept exposure Exploration/starvation effect
Remove previous reflection text Recursive self-reinforcement
Proposal generated but not applied Model output versus committed state
Deterministic updater Model versus numerical dynamics
Per-cycle delta cap Runaway update sensitivity
Inactive-concept re-entry Absorbing-state behavior
Add a second core Topology intervention

These need not be treated as fixes. They are short mechanism probes.

Matched topology branch

A stronger single-core/dual-core comparison could hold constant:

concept set
semantic labels
initial total weight
initial weight distribution
input stream
reflection schedule
prompt
parser
model settings
cycle count
random seeds

and vary only the topology.

Additional variants could include:

  • swapping which semantic labels serve as cores;
  • using anonymous labels;
  • comparing one, two, three, and four cores;
  • or creating paired branches from the same checkpoint.

This would distinguish topology from concept identity and initial trajectory.

A possible public data shape

Source code is not required for a meaningful first independent analysis.

A minimal public package could contain:

  1. the four trajectories;
  2. exact TC and TPI definitions;
  3. collapse definition;
  4. one-cycle protocol;
  5. run-condition table;
  6. detailed logs for the 100-cycle windows.

Zenodo remains suitable. A Hugging Face Dataset repository would be another option: supported formats such as CSV, JSONL, and Parquet can be loaded and displayed automatically, as described in the official repository-structure guide and dataset-sharing guide.

A possible long-form structure:

runs
  run_id
  topology
  concept_count
  initialization
  model_configuration
  start_time
  stop_time
  collapse_type
  collapse_cycle

cycles
  run_id
  cycle_id
  timestamp
  TC
  TPI
  active_concept_count
  retry_count
  error_type

concept_weights
  run_id
  cycle_id
  concept_id
  weight_before
  proposed_delta
  weight_after
  active

edge_weights
  run_id
  cycle_id
  source_concept
  target_concept
  weight_before
  proposed_delta
  weight_after

events
  run_id
  cycle_id
  event_type
  request_id
  checkpoint_id
  details

A compact one-cycle specification:

Input state
New external input
Prompt construction
Model/API settings
Output schema
Parsing rules
Missing-output behavior
Update equation
Threshold step
Normalization step
Metric calculation
Retry behavior
Checkpoint behavior
Collapse condition

This would support trajectory analysis and partial reproduction while respecting the choice not to publish the daemon source.

Interpretation boundaries

At this stage I would not infer that:

  • the underlying model parameters or hidden activations collapsed;
  • every long-running agent has a universal TC threshold near 32,000;
  • dual-core topology has already been isolated as the stabilizing cause;
  • the surviving run necessarily remained diverse, adaptive, or useful;
  • the effect is the same as recursive-training “model collapse”;
  • adjacent memory failures establish the cause here;
  • or the concept network has been shown to belong to a BKT universality class.

I would currently read the BKT connection as a structural analogy in the ordering of observed changes.

That analogy may still be useful. It can remain separate from the engineering question of whether the observed transition depends on:

state reuse
prompt exposure
update equations
thresholding
normalization
runtime behavior
system size
or topology

Condensed roadmap

The most accessible sequence for outside contributors may be:

  1. Publish the trajectories and metric definitions.
  2. Run a data-only analysis with simple companion metrics, threshold sensitivity, and multiple clocks.
  3. Use the detailed logs to locate the first pipeline boundary where concentration increases.
  4. Use short checkpoint forks to separate state reuse, exposure, thresholding, normalization, runtime, and topology.
  5. Run matched topology experiments only if topology remains the leading explanation.

The shortest useful external contribution may therefore be an independent analysis of the already-offered trajectories plus one precisely documented update cycle—not necessarily another long-running agent deployment.

Reference map

Original context

Adjacent operational case

Evolving-memory systems and evaluation

Replay and inspection

Model/API configuration

Data sharing and analysis