19 / Prediction error as evidence
A forecast creates a test
Model confidence must remain exposed to measurement. A plausible explanation is not corroboration: record a predicted observation, the actual result, the error rule, and the subsequent correction. Keep forecasts independent of later outcome knowledge.
Proposed test Use timestamped predictions and held-out sequences; track prediction loss, calibration, and the effect of corrections.
20 / Recursive computational layers
State, forecast, error, coherence
A proposed architecture separates state encoding, next-state prediction, an estimator of likely prediction error, and relational-coherence checking. These are candidate computational roles, not proof of awareness or subjective experience.
Proposed test Run capacity-matched ablations of each role, reporting task utility, error calibration, latency, and instability.
21 / Epistemic versus aleatoric uncertainty
Not every unknown has the same cause
Epistemic uncertainty concerns limited knowledge and may decrease with new evidence. Aleatoric uncertainty concerns outcome variability under a specified model. Opacity is the absence of relevant observations, which can prevent even a well-trained predictor from succeeding.
Proposed test Add measurements and training data separately; compare how uncertainty changes across repeated controlled trials.
22 / Entropy, surprise, and likelihood
Do not compress three metrics into one
Shannon entropy summarizes uncertainty across a distribution. Surprise is the negative log-probability of a particular outcome. Negative log-likelihood is a predictive score evaluated on observed data. They connect mathematically but are not generally interchangeable.
Proposed test Report likelihood, entropy, calibration, and reward separately; vary objective weights to expose confounding.
23 / Competence and distribution shift
The frontier of what a model knows
An agent may perform well on practiced states and fail in novel rules, terrains, or tasks. The boundary is better measured by experience coverage and prediction error than asserted as a universal capability horizon.
Proposed test Measure generalization before and after carefully bounded adaptation, using unchanged evaluation conditions.
24 / Uncertainty without condemnation
Unknown is not automatically bad
Limited knowledge, negative value, risk, and novelty should occupy distinct representations. A system that equates unfamiliarity with moral failure can prevent learning and misjudge harmless states. Exploration still requires limits proportional to potential harm.
Proposed test Contrast unfamiliar benign inputs with familiar harmful inputs; check abstention, inquiry, and safe information gathering.
25 / Truth versus coherence
Internal agreement cannot validate itself
An internally coherent belief system can still contradict reality. A coherence reward can help detect inconsistency, but it cannot substitute for independent observations or causal interventions. Confidence should depend on external performance.
Proposed test Compare coherence-only optimization with evidence-grounded prediction on hidden test data.
26 / Relational geometry
Curved representations need evidence
Learned curves, manifold constraints, and graph paths may capture state transitions that straight-line interpolation misses. Greater geometric sophistication is not inherently greater meaning; the representation must improve a measurable task.
Proposed test Compare linear interpolation, learned paths, and graph transitions against matched baselines with perturbations.