Checklists
The pre-flight lists that keep a strategy or a model from shipping with a hole in it. Each item is tagged by priority — essential, recommended, nice-to-have — and links the tool that actually checks it. Print one, work down it, sign it off.
Backtesting & validation 14
- Backtest Hygiene Checklist
Backtest hygiene checklist: point-in-time data, realistic costs, no look-ahead, aligned returns, and a reproducible run before you trust a number.
12 items
- Execution Cost Audit Checklist
Execution cost audit checklist: measure spread, impact, slippage, and fees per fill, benchmark against arrival, and confirm the edge survives.
12 items
- Feature Leakage Audit Checklist
Feature leakage audit checklist: hunt full-sample stats, overlapping labels, restated fundamentals, and target contamination before they fake an edge.
12 items
- Forecast Calibration Review Checklist
Forecast calibration checklist: score with Brier and log loss, read the reliability curve, separate calibration from discrimination, honestly.
11 items
- Options Strategy Review Checklist
Options strategy checklist: verify the payoff and break-evens, map the Greeks, bound max loss, and stress vol and time decay before the trade.
12 items
- Overfitting Red-Flags Checklist
Overfitting red-flags checklist: spot high trial counts, fragile parameters, suspiciously smooth equity, and in-sample-only edge before you deploy.
12 items
- Pairs Trading Validation Checklist
Pairs trading checklist: test for genuine cointegration, measure the half-life, guard against spurious pairs, and stress the spread first.
12 items
- Paper-to-Live Transition Checklist
Paper-to-live transition checklist: reconcile fills against real costs, start at minimum size, set kill switches, and verify live matches backtest.
13 items
- Portfolio Construction Review Checklist
Portfolio construction checklist: vet correlation inputs, control optimizer error-maximization, set constraints, and verify the frontier first.
12 items
- Position Sizing Review Checklist
Position sizing checklist: size from edge and its uncertainty, apply fractional Kelly, cap correlated exposure, and stress the drawdown first.
12 items
- Pre-Deployment Trading Strategy Review
Trading strategy review checklist: a final sign-off on edge evidence, risk limits, capacity, operations, and an exit plan before capital goes live.
12 items
- Risk Model Validation Checklist
Risk model validation checklist: backtest VaR with Kupiec and Christoffersen, check breach independence, validate fat tails, and stress the model.
12 items
- Trading Strategy Validation Checklist
A sign-off checklist for validating a trading strategy before risking capital: data hygiene, out-of-sample testing, trial accounting, deflated Sharpe, and risk backtests.
12 items
- Walk-Forward Validation Setup Checklist
Walk-forward validation setup checklist: choose window mode, set an embargo, refit per slice, and read efficiency before trusting an OOS curve.
12 items
AI in markets 14
- AI in Finance Audit Trail Checklist
AI finance audit trail checklist: log inputs and outputs, version prompts and models, record sign-off, and retain reconstructable records.
12 items
- Broker API Integration Checklist
Broker API integration checklist: verify auth and order types, handle rate limits and partial fills, reconcile positions, and add idempotency.
12 items
- Earnings Call Summarization Pipeline Checklist
Earnings call summarization checklist: handle long transcripts, ground claims, verify guidance numbers, control cost, and audit the output.
12 items
- Finance Agent Fallback Resilience Checklist
LLM fallback chain checklist: define a provider fallback, handle rate limits and timeouts, set degradation modes, and test the failure paths.
12 items
- Hallucination Guardrails for Finance LLMs
Hallucination guardrails checklist: ground answers, verify every number, check citation faithfulness, and gate any money-moving output.
12 items
- LLM Cost Control Checklist
LLM cost control checklist: right-size the model, cache and batch, cap the agent loop, and set spend alerts before the first surprise invoice.
12 items
- LLM Finance Evaluation Design Checklist
LLM finance evaluation checklist: build a representative test set, include adversarial cases, choose scorable metrics, and avoid contamination.
12 items
- LLM for Finance Deployment Checklist
A pre-flight checklist for putting a large language model into a finance workflow: scoping, grounding, input security, numerical verification, and drift monitoring.
14 items
- LLM Model Risk Management Checklist
LLM model risk management checklist: inventory the model, document assumptions, validate outputs independently, monitor drift, and govern it.
12 items
- LLM Output Schema Validation Checklist
LLM output validation checklist: define a strict schema, validate types and ranges, sanity-check values, and fail safe on nonconforming output.
12 items
- Market Data Vendor Selection Checklist
Market data vendor checklist: match coverage and resolution, verify point-in-time history, compute true total cost, and check licensing first.
12 items
- Prompt Design for Financial Extraction
Financial extraction prompt checklist: enforce a strict schema, require source grounding, handle missing values, and test adversarial filings.
12 items
- Prompt Injection Defense for Finance Agents
Prompt injection defense checklist: treat retrieved data as untrusted, isolate instructions, least-privilege tools, and red-team the pipeline.
12 items
- RAG for Filings Setup Checklist
RAG for filings checklist: chunk on structure, tune retrieval, enforce citations, verify numbers, and treat retrieved text as untrusted.
12 items