Good Decisions Versus Lucky Outcomes

Captain · CP05: Journaling and Improvement · About 25–30 minutes

Safety rule: Preserve the original evidence and include every loss, rejected setup and cost in your analysis.

Your mission today

By the end you can grade a trade decision without seeing its outcome, then compare process quality with the eventual result.

Before you start

Use the frozen CP01 strategy card, a demo execution report, your risk charter and a calculator. All numerical examples below are imaginary.

1. Understand the evidence problem

Outcome bias is judging a decision by what happened afterward. This can reward a reckless win and punish a sensible loss. A good review first hides the result, examines the information available at decision time, then scores rule compliance. Only after that does the learner uncover the outcome and study the method's performance.

Outcome bias is the habit of grading a decision by its result. The student should be able to judge a trade while the exit is hidden, using only the frozen rules and information available at the moment. Then reveal the outcome and compare process grade with money earned.

TRADE, WAIT and SKIP are separate decisions. Make a precise rule citation for each; the attractive outcome of a skipped event does not change its eligibility.

2. Worked example: what can go wrong?

Consider two imaginary trades, each with $10 planned risk. Trade A follows every gate but loses −$10, or −1R. Trade B ignores a failed H1 structure rule but later gains +$20, or +2R. Trade A may receive a full process grade despite losing; Trade B fails compliance despite winning. Neither one-trade result establishes the strategy's edge.

The earlier preserved source also illustrated: A trade that meets every gate loses -1R; it may receive an A for process. Another trade ignores H1 invalidation but earns +2R; it must fail compliance. Those two labels are not contradictory. A process audit is distinct from an edge study.

Original Black Box Journey educational diagram. Fictional results are not a verified market edge.

3. Follow a reproducible review

1. Freeze and show the strategy version and decision-time evidence.
2. Hide entry outcomes and future candles from the reviewer.
3. Grade eligibility, timing, cost, size, stop and no-trade rules.
4. Reveal actual net P/L and execution separately.
5. Record process errors and outcome errors in different columns.

A complete record is more valuable than a flattering summary. A reviewer should be able to reproduce the decision using the same information.

4. Identify the failure mode

A process-perfect strategy may still have negative expectancy and require research. Process grades do not magically create a profitable market edge. Likewise, a lucky profitable violation can hide risk. Both quality measures are necessary.

Unsafe alternative: The novice thinks that any profitable deviation is an improvement. Unless tested over a comparable opportunity set, this is storytelling after the result.

5. Produce the independent research deliverable

The original lab requires: Blind-grade 20 cases without outcome, then reveal results. Score false positives and false negatives independently.

Record the original input, full trade set, execution costs, skipped events and the exact comparison. If a result changes after a correction, keep both versions.

6. Grade the decision separately from the trade result

Synthetic review A: A student follows a prewritten entry rule, uses the correct quote side and stop, limits planned risk to $10, and loses −$10 before charges. The result is a loss; the decision may be PROCESS COMPLIANT. Review B: Another student enters without a confirmed trigger, risks $25 against a $10 cap and happens to earn +$30. That result is a win; the decision is PROCESS BREACH.

If you judge only profit, you would reward the second student and punish the first. Over time that encourages rule-breaking and selective reporting. A sound review must ask what information existed at the decision time, which choices were controlled and which outcomes were uncertain. One winning or losing ticket cannot establish the profitability of a strategy.

Board drill: Create a two-by-two matrix: correct decision/win, correct decision/loss, rule breach/win, rule breach/loss. Assign four fictional tickets and write a short reason for each classification. Keep screenshots, original timestamps, actual costs and any UNKNOWN data. Suggest a process improvement only when repeated evidence supports it.

Common mistake

Reporting a favourable final P/L as if it proves every earlier decision was valid. Keep process compliance and statistical outcome in separate columns.

Plain-English glossary

• Outcome bias: Evaluating an earlier decision using its later result.
• Blind review: Grading with future information concealed.
• Rule compliance: Whether prescribed conditions were followed.
• Net R: Net result divided by original planned risk.

Try it yourself

Blind-grade 20 cases without outcome, then reveal results. Score false positives and false negatives independently. Include at least one losing and one rejected observation. Write the denominator and units beside every statistic.

What you can now do

• Grade a trade decision without seeing its outcome, then compare process quality with the eventual result.
• Show an adverse case using exact currency or R units.
• Explain the limits of the evidence without promising profit.

Next lesson

CP05.5 · Improve a Method Without Curve-Fitting.