Trading What I see !?

[ShaunWhite]

You said it's all backtest, but you're only showing one set of results. Where's the multiple backtest results.

I've still not got enough data to fully dice, but i'll do some basic ones on what i've got, thanks for the idea

I did mention it quite a while ago but you're forgiven because a lot of info came in fast and you didn't know who to listen to. Gotta be honest here, without in and out of sample testing you're wasting your time. Using all your data and excluding the losers makes finding something a self fulfilling prophecy rather than proving anything. The future is unknown, so your test sample has to be unknown having done your analysis elsewhere.

[goat68]

You said it's all backtest, but you're only showing one set of results. Where's the multiple backtest results from random subsets of your data? At the risk of being repetitive finding an edge in one set of data is fairly easy but not many hold up to more rigorous analysis which you'll need to give you some assurance about what future data might show.

So that didn't take long! i've just updated my backtest program to produce a random backtest on 30% of the data taken at random, here are 10 random samples:
% turnOv = 0.34%
% turnOv = 0.72%
% turnOv = 0.75%
% turnOv = 0.63%
% turnOv = 0.65%
% turnOv = 0.88%
% turnOv = 0.40%
% turnOv = 0.38%
% turnOv = 0.74%
% turnOv = 0.20%

So roughly: average=0.57%, each random bucket=~75 trades
Quite happy with that result even if i've not really got enough data to truly rely on, but gives me more confidence there maybe something there and to ignore any current weakness...
Thanks Shaun, grand idea!

[goat68]

I do have doubts though mainly because most of the profits come from this string of 8 days
2021/03/10 : Wed : 5.23
2021/03/11 : Thr : 5.24
2021/03/12 : Fri : -0.34
2021/03/13 : Sat : 6.78
2021/03/14 : Sun : -1.28
2021/03/17 : Wed : 1.05
2021/03/18 : Thr : 5.97
2021/03/19 : Fri : 4.92

[ShaunWhite]

I do have doubts though mainly because most of the profits come from this string of 8 days
2021/03/10 : Wed : 5.23
2021/03/11 : Thr : 5.24
2021/03/12 : Fri : -0.34
2021/03/13 : Sat : 6.78
2021/03/14 : Sun : -1.28
2021/03/17 : Wed : 1.05
2021/03/18 : Thr : 5.97
2021/03/19 : Fri : 4.92

Great news on the out of sample testing.
I wouldn't worry about things like that group of good days. Humans are programmed to look for patterns, and patterns occur in random data*, so unless you can think of a good reason why those days were different then it's just what it is.

Besides when you've got a large enough set of results the days will start to blur and you'll see that drawing a line through your results when the sun rises and sets is fairly arbitrary unless time of day matters to you.

* YouTube and Spotify 'random' playlists aren't random. When they were people complained it did things like played 4 tracks by the same artist in a row so they had use a pseudo-random that doesn't produce the patterns normal random makes. I haven't read this but I think a few people enjoyed it-> https://www.amazon.co.uk/Fooled-Randomn ... 0141031484

[Trader724]

It looks pretty decent, keep it up.

Overall looks good doesn't it.. however since actually running it live 1stApril, it's not doing well... This seems to be a consistent trend, in that you find an algo that seems to show promise over the last month or so, it then performs pants going forward.. It's as-if algo creation is efficient, in that 1000s of algo creators are doing the same thing based on the last month, which thus makes forward trading -ve... So what I need to come up with is a strategy that is "not in the last month" ..yeah?

Don't worry about competition right now, try to solve one problem at a time and make sure you fit your model to market behavior, not to market data. When you go from backtesting to live, the psychological factor comes into play, you can start directly with a drawdown period. For us, only long-term results matter and we have to be patient.

If you think you've found an edge, try to explain why it
works, and if you can't find an explanation, you're trying to explain the inexplicable, which is lying to yourself.

You should not rule out that you have partially curve fitted your strategy (I did it when I started out) and consequently the real edge is much smaller, so be careful what stakes you use, you may suffer too much drawdown wich will make you believe it doesn't work at all.

[goat68]

I do have doubts though mainly because most of the profits come from this string of 8 days
2021/03/10 : Wed : 5.23
2021/03/11 : Thr : 5.24
2021/03/12 : Fri : -0.34
2021/03/13 : Sat : 6.78
2021/03/14 : Sun : -1.28
2021/03/17 : Wed : 1.05
2021/03/18 : Thr : 5.97
2021/03/19 : Fri : 4.92

Great news on the out of sample testing.
I wouldn't worry about things like that group of good days. Humans are programmed to look for patterns, and patterns occur in random data*, so unless you can think of a good reason why those days were different then it's just what it is.

Besides when you've got a large enough set of results the days will start to blur and you'll see that drawing a line through your results when the sun rises and sets is fairly arbitrary unless time of day matters to you.

* YouTube and Spotify 'random' playlists aren't random. When they were people complained it did things like played 4 tracks by the same artist in a row so they had use a pseudo-random that doesn't produce the patterns normal random makes. I haven't read this but I think a few people enjoyed it-> https://www.amazon.co.uk/Fooled-Randomn ... 0141031484

Thanks, yeah so the only causal reason I can think of is the proximity of Cheltenham to those days. So i've just ran a backtest with a regex excluding Chelt and it comes back with the following for those days, practically identical, so unless Cheltenham was having a causal effect on the other markets, which is possible, i'll put it down to variance at the moment:
2021/03/10 : Wed : 5.23
2021/03/11 : Thr : 5.24
2021/03/12 : Fri : -0.34
2021/03/13 : Sat : 6.78
2021/03/14 : Sun : -1.28
2021/03/17 : Wed : 0.87
2021/03/18 : Thr : 5.74
2021/03/19 : Fri : 4.83

[goat68]

It looks pretty decent, keep it up.

Overall looks good doesn't it.. however since actually running it live 1stApril, it's not doing well... This seems to be a consistent trend, in that you find an algo that seems to show promise over the last month or so, it then performs pants going forward.. It's as-if algo creation is efficient, in that 1000s of algo creators are doing the same thing based on the last month, which thus makes forward trading -ve... So what I need to come up with is a strategy that is "not in the last month" ..yeah?

Don't worry about competition right now, try to solve one problem at a time and make sure you fit your model to market behavior, not to market data. When you go from backtesting to live, the psychological factor comes into play, you can start directly with a drawdown period. For us, only long-term results matter and we have to be patient.

If you think you've found an edge, try to explain why it
works, and if you can't find an explanation, you're trying to explain the inexplicable, which is lying to yourself.

You should not rule out that you have partially curve fitted your strategy (I did it when I started out) and consequently the real edge is much smaller, so be careful what stakes you use, you may suffer too much drawdown wich will make you believe it doesn't work at all.

So most of what the bot does I have causal reasoning, one or two maybe pushing the boundaries a bit, so as you said, I do expect some of what I have is fitted, but hopefully not too much.

[ShaunWhite]

so unless Cheltenham was having a causal effect on the other markets..

A majority of punters are doing because they like the sport not just because of the betting opportunities, so when the good stuff is on that's where their eyes are and the rest of the day's action becomes a sideshow. A few days before and a few days after can be slightly different too because they might be keeping their powder dry for a bigger festival bet or waiting for payday to recover what they spent on it. Data without context can be misleading, markets are window onto the real world not a world in their own right.

[goat68]

Great capture of the 2min "car crash" today:

carcrash.jpg

[goat68]

So today was worst day again for bot.
Done a backtest starting after Cheltenham paints a very different picture, basically breakeven for the past 18days, I need another week like Cheltenham!:
2021/03/22 : Mon : -2.49
2021/03/23 : Tue : -0.20
2021/03/24 : Wed : 3.91
2021/03/25 : Thr : 0.56
2021/03/26 : Fri : -0.79
2021/03/27 : Sat : -1.80
2021/03/28 : Sun : -0.81
2021/03/29 : Mon : 6.41
2021/03/30 : Tue : 1.66
2021/03/31 : Wed : -0.21
2021/04/01 : Thr : 0.12
2021/04/02 : Fri : -0.08
2021/04/03 : Sat : 1.61
2021/04/04 : Sun : -0.50
2021/04/05 : Mon : -0.37
2021/04/06 : Tue : -2.53
2021/04/07 : Wed : -0.44
2021/04/08 : Thr : -2.97

==> Worst day = -2.97
==> Best day = 6.41
==> Winning days = 6
==> Losing days = 12
Sun : -1.31
Mon : 3.55
Tue : -1.07
Wed : 3.26
Thr : -2.29
Fri : -0.87
Sat : -0.19

Profit = 1.09
Wins = 79
Avg Win = 0.43
Losses = 75
Avg Loss = -0.44
S/Rate = 51%
Total trades = 154 from 1138 analysed markets
% turnOv = 0.03%