Evaluation Criteria for a Cognitive Mesh
SUMMARY
Defines evaluation dimensions for the field, its routes, its human effects, and its governance.
DETAIL
A cognitive mesh should be evaluated as an evolving environment for reasoning, not only as a generator of final answers.
Alternative coverage measures whether materially distinct interpretations and action paths are present. Coverage should discount duplicated paraphrases and reward alternatives that differ in assumptions, mechanisms, constraints, or consequences.
Structural separation measures whether incompatible regions remain distinguishable. A mesh fails this test when it blends conflicting causal models, value systems, or evidence states into an apparently smooth consensus.
Navigability measures whether users or agents can reach relevant regions with bounded effort. Useful submeasures include steps to discovery, ability to return to a prior region, success in locating contradictions, and ability to move between abstraction levels without losing context.
Operator fidelity tests whether a typed traversal produces the intended transformation. A counterfactual branch should change the specified condition rather than drift semantically. Constraint release should expose routes excluded by that constraint. Evidence expansion should reveal warrants rather than nearby text.
Route reproducibility measures whether a consequential path can be reconstructed and whether divergences can be attributed to changed evidence, models, constraints, or field structure.
Epistemic calibration compares represented confidence, uncertainty boundaries, and attractor stability with later observations. A strong attractor that repeatedly fails external tests indicates that the field is rewarding coherence or attention more than validity.
Diversity retention measures whether minority projections and weak alternatives survive long enough to be inspected. It should distinguish valuable pluralism from uncontrolled duplication or fragmentation.
Manipulation resistance tests whether repeated salience injection, strategic duplication, model collusion, or privileged access can dominate the field without corresponding evidence. It should also test whether users can detect that steering occurred.
Human comprehension measures whether participants can explain important distinctions, reconstruct a route outside the interface, notice uncertainty, and maintain independent judgment. A visually compelling field that produces dependence without transferable understanding is a failure.
Workload and health measures include cognitive saturation, attention demands, time spent curating the field, stress caused by persistent unresolved alternatives, and the ability to disengage safely.
Collective outcomes include transparency of agenda setting, distribution of cognitive labor, quality of disagreement, resilience to model failure, ability to revise decisions, and long-run improvement rather than mere speed of convergence.
The corpus strongly supports exploratory navigation, pattern recognition, memory anchors, post-exploration tools, iterative refinement, and human-AI collaboration. It does not provide validated metrics. This node converts those recurring design intentions into testable dimensions without claiming they have already been operationalized.
WHY THIS EXISTS
Supports research studies, product validation, architecture comparison, procurement, and deployment review.
SOURCE CONTEXT POINTERS
- /concepts/possibility-space-cognitive-mesh/RESEARCH_DIRECTIONS.txt
- /concepts/possibility-space-cognitive-mesh/RISKS_AND_CONTRADICTIONS.txt
- /concepts/possibility-space-cognitive-mesh/PRODUCT_BUSINESS.txt
EVIDENCE QUESTIONS
- evaluating exploratory landscapes iterative search memory anchors cognitive flexibility human AI collaboration (semantic): Would support measurable tasks and experimental protocols for each evaluation dimension