1 lightning.finite_horizon.studies.development_ranking

lightning.finite_horizon.studies.development_ranking

Float32 candidate-order diagnostics reduced over independent physical scenes.

Only label-separated pairs count; prediction ties earn no correct pair. Within scene pair counts describe support, while bootstrap draws resample whole scenes. These diagnostic thresholds do not revise the frozen development-regret decision.

1.1 Functions

Name Description
candidate_pair_ordering Return correctly ordered and informative unordered candidate pairs.
reduce_development_ranking Recompute descriptive H1 candidate ordering by physical scene.
summarize_scene_ordering Give each physical scene one vote, whatever its informative pair count.

1.1.1 candidate_pair_ordering

lightning.finite_horizon.studies.development_ranking.candidate_pair_ordering(
    labels,
    predictions,
    *,
    tie_band,
)

Return correctly ordered and informative unordered candidate pairs.

A prediction tie earns no correct pair. The tie band applies to the label difference only; it is not an accuracy tolerance for predicted order.

1.1.2 reduce_development_ranking

lightning.finite_horizon.studies.development_ranking.reduce_development_ranking(
    assignment,
    evaluations,
    *,
    bootstrap_seed=2930,
    bootstrap_resamples=10000,
)

Recompute descriptive H1 candidate ordering by physical scene.

evaluations is the same four learner/constant fold pairs consumed by the canonical development-screen reader. This reducer validates that whole paired source domain first, then independently recomputes the pair counts instead of trusting the recorded pair-accuracy columns.

1.1.3 summarize_scene_ordering

lightning.finite_horizon.studies.development_ranking.summarize_scene_ordering(
    per_scene,
    *,
    bootstrap_seed=2930,
    bootstrap_resamples=10000,
)

Give each physical scene one vote, whatever its informative pair count.

The shared sampler resamples scene accuracy summaries using the declared historical settings. One scene retains its empirical degenerate interval; that sparse diagnostic does not establish population uncertainty or useful generalization. These intervals do not revise the frozen regret gate.

Back to top