Forward-Look Bias Test Report

Strategy: Demo L/S Momentum  |  generated 2026-05-24 08:27

✓ PASS — strategy is causal

Test 1: Shift-Lookahead

Compute sum(positions × asset_returns) under four position-time alignments. A causal strategy can be "cheated" by using tomorrow's positions — so the lead-1 case must inflate Sharpe substantially. If lagging by 1 day collapses Sharpe MORE than leading boosts it, the strategy already has built-in lookahead.

AlignmentSharpeNotes
same-day  pos[t]·ret[t] 0.569 Strategy's actual mechanism
lag-1  pos[t-1]·ret[t] 0.531 Stale by 1 day. Drop = +0.037
lead-1  pos[t+1]·ret[t] 2.628 Cheat with tomorrow's pos. Gain = +2.060
lead-5  pos[t+5]·ret[t] 11.892 Cheat further

Pass criteria: both must hold —
  • lead_gain ≥ 0.30 (cheating must add Sharpe)
  • lead_gain ≥ 0.80 × lag_drop (asymmetry signature)
Result: CAUSAL — lead-cheat boosts Sharpe more than lag-stale drops it

Test 2: Position Autocorrelation

Day-over-day per-asset position autocorrelation. High AC means positions are stable and the shift test is reliable; low AC suggests positions are jumpy and the shift test less informative.

MetricValue
Assets included (≥ 100 active obs) 50
Mean autocorrelation0.950
Median0.952
Min0.922
Max0.964

Pass criteria: mean AC ≥ 0.50
Result: OK — mean AC 0.950 ≥ 0.5 (shift test reliable)

Test 3: Truncate-and-Compare (SKIPPED)

Skipped — to enable, pass truncated_pipeline_fn and truncate_date to run_bias_test(). This is the gold-standard test: it re-runs your strategy with data physically truncated to ≤ T and verifies that day-by-day outputs match the full-data run exactly (modulo the boundary day).

Methodology

Generated by bias_test_kit. See METHODOLOGY.md for the full theory + worked example. The asymmetry check (lead_gain ≥ 0.8 × lag_drop) is the key innovation that catches built-in lookahead even when the absolute lead-gain looks fine — without it, synthetic cheats can slip through.