NinjaTrader Support Forum  

Go Back   NinjaTrader Support Forum > Suggestions and Feedback > Suggestions And Feedback

Suggestions And Feedback New feature suggestions and feedback.

Reply
 
Thread Tools Display Modes
Old 10-11-2007, 06:05 PM   #1
JonesWooHoo
Junior Member
 
Join Date: Oct 2007
Posts: 21
Thanks: 0
Thanked 0 times in 0 posts
Default Walk Forward Optimization

Hi,

The Walk Forward Optimization feature is a great one. Its really good at scaring me, and I am far happier to lose pretend money rather than real money.

I am requesting a change to the way it moves forward.
Say it is set to optimize over 320 days and test for 30 days.

It optimizes for 320 moves forward 320, then walks forward 30, then repeats.
Each cycle uses 350 days, so if I have 4 years of data, I only get 4 months of actual walk forward results.

It would be better if it moved back 320 before repeating the next cycle. This way, I could get at least 36 months of walk forward results.
If I can get things working well, this would give me far more confidence going forward live.
JonesWooHoo is offline  
Reply With Quote
Old 10-12-2007, 01:22 AM   #2
NinjaTrader_Dierk
Administrator
 
NinjaTrader_Dierk's Avatar
 
Join Date: Mar 2005
Location: Bamberg, Germany
Posts: 9,994
Thanks: 0
Thanked 6 times in 6 posts
Default

Sorry, not sure I follow.
NinjaTrader_Dierk is offline  
Reply With Quote
Old 10-12-2007, 01:34 AM   #3
JonesWooHoo
Junior Member
 
Join Date: Oct 2007
Posts: 21
Thanks: 0
Thanked 0 times in 0 posts
Default

Sorry, it is a bit hard to explain.

To summarize:
If I have 4 years of data, am optimizing on 320 days, with a forward test of 30 days, I would like to get 36 rows of walk forward results rather than 4.
JonesWooHoo is offline  
Reply With Quote
Old 10-12-2007, 01:39 AM   #4
NinjaTrader_Dierk
Administrator
 
NinjaTrader_Dierk's Avatar
 
Join Date: Mar 2005
Location: Bamberg, Germany
Posts: 9,994
Thanks: 0
Thanked 6 times in 6 posts
Default

I see. So basically the backtest period should be different than the roll forward period, no?

-> this already is supported, since there is "Optimization period" (320 days) and "Test period"(30 days).
NinjaTrader_Dierk is offline  
Reply With Quote
Old 10-12-2007, 01:57 AM   #5
JonesWooHoo
Junior Member
 
Join Date: Oct 2007
Posts: 21
Thanks: 0
Thanked 0 times in 0 posts
Default

It already has different optimize (I was using 320 days) and test periods (I was using 30 days).

With 4 years of data, I would like it to output 36 rows of result data, but currently it outputs only 4.

ie. I would like it to optimize 320 then test 30 days, then same for the *next* 30 days, then same for the next 30 days etc. This would result in (approx) 36 rows of result data, where each row shows the results of a 30 day test. Each 30 day test period would be consecutive.

At the moment they are not consecutive, there is 320 days between each 30 day test. I only get 4 result rows. ie. Currently the optimization ends 320 days after the end of the last test, whereas it should really end at the end of the last test period.

Gees this is hard to explain. You are going to have to try it see what I mean.
JonesWooHoo is offline  
Reply With Quote
Old 10-12-2007, 02:06 AM   #6
NinjaTrader_Josh
NinjaTrader Product Manager
 
NinjaTrader_Josh's Avatar
 
Join Date: May 2007
Location: Denver, CO
Posts: 17,458
Thanks: 1
Thanked 106 times in 70 posts
Default

It sounds like your "Keep best # results" is set to 4 to me. Try setting it to 36?
NinjaTrader_Josh is offline  
Reply With Quote
Old 10-12-2007, 02:08 AM   #7
NinjaTrader_Dierk
Administrator
 
NinjaTrader_Dierk's Avatar
 
Join Date: Mar 2005
Location: Bamberg, Germany
Posts: 9,994
Thanks: 0
Thanked 6 times in 6 posts
Default

>> ie. I would like it to optimize 320 then test 30 days, then same for the *next* 30 days, then same for the next 30 days etc.
It already works this way.
NinjaTrader_Dierk is offline  
Reply With Quote
Old 10-12-2007, 04:04 AM   #8
JonesWooHoo
Junior Member
 
Join Date: Oct 2007
Posts: 21
Thanks: 0
Thanked 0 times in 0 posts
Default

I can't get it to work like that.

Here are my settings


Here is the results:


As you can see, there are 3 results rows.
I am testing on nearly 3 years of minute data for AUD/USD future
You can see in the results, they show Nov/Dec 2005, then it skips to Oct/Nov 2006, then it skips to Aug/Sept 2007.
These results seem to be separated by the optimization time (320 days).

I would like there to be 1 result for each 30 days after the first 320 days. ie about 24 result rows.
JonesWooHoo is offline  
Reply With Quote
Old 10-12-2007, 04:16 AM   #9
NinjaTrader_Dierk
Administrator
 
NinjaTrader_Dierk's Avatar
 
Join Date: Mar 2005
Location: Bamberg, Germany
Posts: 9,994
Thanks: 0
Thanked 6 times in 6 posts
Default

My apologies. This is a bug. I would like to send you a custom build. Please PM me at "dierk AT ninjatrader DOT com".

Sorry for the inconvenience.
NinjaTrader_Dierk is offline  
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Optimization time bobby1001 Strategy Analyzer 38 02-03-2008 10:38 AM
Forward Alerts via e-mail vlc Miscellaneous Support 1 08-15-2007 04:10 AM
Walk Forward Out of Memory Message daven Strategy Analyzer 1 06-01-2007 11:03 AM
ninjatrader memory handling and optimization scriabinop23 Miscellaneous Support 10 05-22-2007 11:46 AM
Walk Forward within the strategy lyes Strategy Analyzer 2 04-30-2007 07:55 AM


All times are GMT -6. The time now is 07:29 AM.