Lesson Context Market Feed
SPY $776.34 -0.20%
QQQ $731.07 -0.14%
AAPL $305.93 +0.22%
MSFT $495.40 -0.30%
NVDA $225.16 -0.06%
XLK $190.01 -0.40%
05

Analytics & Performance

Analytics should tell you why the system behaved the way it did, whether that behavior still matches the thesis, and what deserves adjustment versus retirement. The goal is better decisions, not prettier dashboards.

3
Modules
3
Lessons
What caused the result?
Focus
Module 01 · Basics

What a serious operator looks at first

The best review sequence usually starts with stability and explanation, not with total return.

Edge quality
Expectancy beats headline win rate

A modest win rate with strong payoff balance can be healthier than a flashy win rate that depends on one fragile trade pattern.

Risk path
Drawdown shape matters operationally

Two strategies can lose the same amount and feel completely different to run depending on streak length, recovery time, and concentration.

Context
Performance has to be read by regime

A system may still be healthy even after a weak phase if the market shifted outside its intended environment and the damage stayed within expected bounds.

Why this matters

Every idea in this path reduces to one question: what are the explicit rules, and what stops the trade if the thesis is wrong? Keep that lens as you read.

Module 02 · Core Concepts

How to optimize without turning the strategy into a moving target

Optimization should refine a stable thesis, not hide a broken one.

Step 01
Start with the result path

Review equity behavior, drawdown timing, and trade clusters before touching parameters. Understand the story first.

Step 02
Trace the behavior back to the rule set

Ask which market conditions the strategy handled well, which it mishandled, and whether that matches the original design intent.

Step 03
Change one thing with a reason

Only adjust logic or constraints when you can explain exactly what problem the change is supposed to solve.

Step 04
Retest before you trust the revision

Every meaningful change resets the burden of proof. A refined rule set still has to earn its place through validation again.

Module 03 · Practical Understanding

Questions that keep optimization honest

These filters help distinguish productively refining a strategy from merely rescuing it.

Metrics to watch weekly
  • Expectancy and trade quality trend.
  • Drawdown duration relative to plan.
  • Exposure concentration by symbol or strategy family.
Signs you should not optimize yet
  • You cannot explain what specifically changed in behavior.
  • The review is driven only by recent pain or recent euphoria.
  • The proposed adjustment rewrites the thesis instead of refining it.
Strong review outcomes
  • Leave the strategy unchanged and keep monitoring.
  • Tighten capital rules without altering the signal logic.
  • Retire the bot because the thesis no longer earns desk space.
Try it — overfitting

Tune a strategy hard enough and it fits the past perfectly — then falls apart on new data. Push the tuning up and watch the out-of-sample curve diverge from the in-sample one.

In-sample
Out-of-sample
Overfit gap
Optimization warning

Do not optimize to erase normal drawdown.

  • Do not compare strategies that operate under different capital realities.
  • Do not keep a bot alive just because the dashboard is interesting.
Test your knowledge

Review should make the next decision easier, not turn the strategy into a moving target.

Question 1

What should you review before touching parameters?

Question 2

When should you avoid optimizing?

Question 3

Which is a strong review outcome?