STRATEGY DEVELOPMENT

How to Build a Trading Strategy from Scratch — Without Curve-Fitting

RB Trading 16 min read

Most "build your own strategy" guides start with indicators and chart patterns. That's backwards. A strategy starts with a market hypothesis, not a setup, and the difference is why 90% of homemade strategies look great in backtest and lose money live.

This is the 7-step framework that produces strategies that actually survive live trading.

Step 1: Pick a market hypothesis (not an indicator)

A strategy needs a reason to work. The reason is a hypothesis about how a specific market behaves at a specific time.

Bad hypothesis (indicator-led):

Good hypothesis (market behaviour-led):

The second one is testable, observable, and has a structural reason to exist. The first one is just a math relationship that may or may not have edge.

Write your hypothesis in one sentence:

If you can't fill in all 4, your hypothesis isn't good enough.

Step 2: Define the setup precisely

Now turn the hypothesis into an objective checklist:

Setup: NY Open Pullback (NAS100)
Entry conditions:
  [ ] Time between 14:30-16:00 UK
  [ ] 5-min trend confirmed (3 consecutive higher highs OR 3 consecutive lower lows)
  [ ] Price pulls back to 21 EMA on 5-min, touches within 5 points
  [ ] Rejection candle at EMA: hammer or shooting star, wick > body
  [ ] DXY direction confirms (e.g. long NAS = DXY weak or flat, not surging)
Exit conditions:
  [ ] Stop: 1.5× ATR(14) beyond rejection wick
  [ ] Target: 2R OR opposite swing high/low, whichever is closer
  [ ] Time-stop: close at 17:00 UK regardless

If the rules are subjective ("clear rejection," "good price action") then the strategy can't be tested. Subjective rules will appear to have edge in your manual backtest because you're cherry-picking unconsciously.

Step 3: Manually test 50 trades on past charts

Before automating anything, scroll back through historical charts and find 50 instances of the setup, without looking ahead.

The discipline: scroll to the day, mark the entry, then advance bar-by-bar to see what happens. Don't peek at the right edge before marking entry.

Track for each trade:

After 50 trades, calculate:

Expectancy above +0.3R per trade = solid edge. Expectancy 0 to +0.3R = marginal, needs refinement. Expectancy below 0 = the setup doesn't work, scrap it.

Step 4: Run an out-of-sample test

The next 50 trades should come from a different time period than your first 50. Test 1 = 2022 data. Test 2 = 2023 data. Don't tweak rules between tests.

If your expectancy in Test 2 is similar (within 30%) of Test 1, you have a real strategy. If it drops to half or goes negative, you over-fit to Test 1 data.

This is the single most-skipped step. Most homemade strategies look great because they were tuned on the same data used to evaluate them. Out-of-sample testing exposes curve-fitting.

Step 5: Forward test on a demo account for 30 days

Live demo trading reveals problems backtests miss:

Run the strategy for 30 days on demo. Use real position sizes (your planned account × planned risk %). Take every signal that fires, even bad-looking ones.

After 30 days, compare expectancy to your manual backtest. Expect a 20-30% drop. If it's worse than that, something in the live conditions is killing the edge.

Step 6: Quantify position sizing BEFORE going live

Risk per trade = 0.5-1% of account.

Account: $50,000
Risk per trade: 1% = $500
Setup A average stop distance: 15 points on NAS100
Per-lot risk at 15pt: $15 (assuming $1/pt CFD)
Position size: $500 / $15 = ~33 lots

If your strategy backtest had a 15% max drawdown over 100 trades, your live max drawdown could easily be 25%. Plan for it:

Drawdown math is more important than expectancy math. Strategies that have edge but blow accounts during normal drawdowns aren't tradeable.

Step 7: Journal every live trade

Once live, every trade goes into a journal that tracks:

After 50 live trades, review per-setup expectancy + per-deviation expectancy. You'll find that:

The journal data IS the iteration. Without it, you're guessing why the strategy isn't performing.

Common curve-fitting traps

  1. Over-fitting to recent data — using only the last 6 months of charts means your strategy is tuned to a single regime
  2. Cherry-picking instruments — testing on only winning pairs and ignoring the rest
  3. Optimising parameters too tightly — best EMA = 23, best stop = 1.6× ATR, etc. = curve-fit
  4. Ignoring spread / slippage — backtest with 0 spread assumption, live trades pay 2-5 pips spread
  5. Subjective "I would have skipped that one" — every signal that fires in the rule set MUST be counted

If your strategy needs to be perfect to work, it's curve-fit. A real strategy survives missed trades, slippage, and a few subjective skips and still produces edge.

The realistic timeline

Total: 3 months from hypothesis to live trading. Strategies built faster than this are usually curve-fit and die within their first month live.

How to track strategy development cleanly

The hardest part isn't running tests — it's organising data across 50 manual trades + 50 OOS trades + 30 demo days + live trades without losing track.

RB Trading Pro Journal has a strategy development module specifically for this: backtest replay, R-tagged setups, OOS analytics, and live-vs-test expectancy comparison. Free for 7 days.

TL;DR

7-step framework:

  1. Market hypothesis (not indicator)
  2. Setup as objective checklist
  3. 50-trade manual backtest with expectancy
  4. 50-trade out-of-sample to detect curve-fit
  5. 30-day demo forward test
  6. Quantify position sizing for max drawdown
  7. Journal every live trade, iterate from data

Strategy building is slow because it has to be. The traders who skip steps are the ones whose perfect-looking backtest goes to zero in month 2 live.

3 Common Strategy-Building Mistakes That Waste Months

Most traders don't fail at strategy building because their idea was bad. They fail because of avoidable process errors that invalidate their work before it gets to live testing.

Mistake 1: Backtesting on the same data used to generate the idea. If you noticed a pattern in the charts, then backtested that pattern on the same period of charts — you've just confirmed your selection bias. A proper backtest uses out-of-sample data: generate the idea on one data set, validate it on a separate historical period. Some traders use a 70/30 split — build on the first 70% of available history, test blind on the final 30%. If the strategy degrades significantly on out-of-sample data, the edge was mostly noise.

Mistake 2: Optimizing for maximum backtest profit. Curve fitting — tuning every parameter to maximize historical returns — produces strategies that look brilliant on paper and fail immediately live. The market isn't static. Parameters that worked perfectly for 2021 trend conditions will likely fail in 2023 range conditions. Build strategies with the minimum number of rules that explain the edge. More rules = more opportunities for overfitting. If removing a rule barely changes the results, remove it.

Mistake 3: Skipping the drawdown analysis. Traders focus on total returns and win rate during backtesting and ignore the drawdown profile. But drawdown is what gets you emotionally. A strategy with a 60% win rate and a single 25% drawdown period will cause most traders to abandon it right at the bottom — destroying the expected value. Before committing to a strategy, simulate the worst drawdown period. Would you keep trading it through 15 consecutive losses? If not, reduce position size until you would.

When to Abandon a Strategy vs. When to Stay the Course

This is one of the hardest judgment calls in trading. Abandoning too soon means you never let an edge compound. Holding too long means you trade through a dead strategy for months. Here's a framework for making the decision clearly.

Abandon if: The strategy's core market condition no longer exists. A breakout strategy built on trending markets in low-volatility environments will not perform in a choppy, news-driven market. If the macro environment has fundamentally shifted and your setup is structurally dependent on conditions that no longer exist, the data will confirm it. Don't force setups that the market is no longer offering.

Stay the course if: The drawdown is within the range predicted by your backtest. Every strategy has losing periods. If your backtest showed maximum consecutive losses of 8 and you're at loss number 6, this is expected variance — not strategy failure. The question is whether you modeled this possibility before you went live. If yes, trust the model. If no, that's the real problem to fix.

Pause and reassess if: Win rate, average R, or trade frequency has materially changed (more than 15–20% from baseline) for 30+ trades. That's a signal worth investigating — either the market has changed, your execution has changed, or your selection process has drifted from the plan. Pull journal data, compare recent trades to the original backtest sample, and look for the specific point of divergence before deciding to modify or abandon.

The minimum sample size for any decision: Don't draw conclusions from fewer than 30 live trades. Anything less is noise. The market will produce strange runs in short samples. You need enough trades to see whether your edge is present across different market conditions within your live testing window.

Frequently Asked Questions About Building a Trading Strategy

How long does it take to build a trading strategy from scratch?

For a serious, statistically validated strategy: 3–6 months minimum. That includes 2–4 weeks of idea development, 4–8 weeks of backtesting with out-of-sample validation, 4–8 weeks of forward testing (simulated or small live), and then an assessment phase before scaling. Traders who rush this to 2–3 weeks almost always end up back at the start after a few months of live losses. The time investment front-loaded into testing saves multiples of that time in live losses avoided.

Should I buy a strategy or build one?

Build one. Not because purchased strategies are necessarily bad, but because you won't be able to trade through the inevitable losing periods of a strategy you don't deeply understand. The edge in a strategy comes partly from the setups and partly from the trader's conviction in the setups during drawdown. If you don't know why the strategy works at a structural level, you'll abandon it at the wrong time. Building your own also means you can adapt it as market conditions change.

Can I build a strategy based on indicators alone?

You can, but indicator-only strategies tend to be the most curve-fit because indicators are derived from price — they're lagging by definition. The more robust edge usually comes from combining an indicator-based entry trigger with a price-structure filter (market structure, key level, session context) that provides the "why" the setup should work. Pure indicator strategies often degrade quickly when market regime changes because there's no structural logic underneath them — just a correlation that existed in the backtested period.

RB Trading Pro Journal

Stop guessing. Start tracking.

Free 7-day trial · Card required · Cancel anytime · Used by 7,000+ funded traders

Start Free Trial →
Strategy DevelopmentBacktestingEdge