Reload historical data problem

[vicentemmingo]

Hello,

I've been paper trading with the next configuration since 2010 January:

Ninja Trader 6.5
IB TWS 900

No problem until yesterday, the connection and the online data flow worked correctly, but when I tried to execute the 'Reload historical data' function it failed: the download window opened but nothing happenned, it only remains 'Loading data...' for several minutes.

Then I installed de new versions for both platforms:

Ninja Trader 6.5 1000.16
IB TWS 906 (last version)

From that moment on, the first time I connected de TWS the historical data were downloaded, and sometimes one or two more successive times it worked, but it fails again after these attempts. Then I close the TWS and open it again, sometimes it works and sometimes it doesn't.

I've tried to Repair DB and Reset Instruments, but nothing happens.

What can I do?

Thanks in advance,
Vicente

[NinjaTrader_Jason]

Hello Vicente,

Can you please install TWS 900 again as per the IB connection guide at the link below.
http://www.ninjatrader.com/webnew/support_interactivebrokers.htm

Please tell me what instrument and interval is selected in the charts where you right click and select 'Reload Historical Data'.

Do you perhaps see other error messages in the Control Center-->Log-tab at the times you hit 'Reload Historical Data'?

[vicentemmingo]

The TWS900 was failing yesterday, but I'm going to install it again.

The charts I'm using are for EURJPY 30min and 120min.

There is no message in the log when I select 'Reload Historical Data'

[NinjaTrader_Jason]

Please let me know if the issue recurs after you installed TWS 900 and tell me how much historical data is requested by the chart.

I tested it few times with a default look back period of 15 days, but I do not experience an issue so far.

[vicentemmingo]

I've installed the TWS900 and now I can connect NT, I se the price online, but the Reload Hist Data doesn't work, in any case. At least with the TWS906 I got the Hist Data occasionally.

Historical issue: I request 10 days for 30min and 15 days for 120min, as I have been doing for the last 6 months.

I have tested it in two laptops, one with Windows Vista and the other one with Windows 7, both of them with the last weekend upgrades.

[NinjaTrader_Jason]

Do you perhaps have custom or 3rd party indicators applied in the chart?

Does the issue perists if you create 2 brand new charts? Restart NinjaTrader and close all windows except the Control Center. Connect to IB. Subsequently create 2 new charts and check if 'Reload Historical Data' functions as expected.

[vicentemmingo]

Jason,

I've been testing your idea about de third party indicators, and you were right. Firstable I did a test without indicators, and every thing was ok, then I used one indicator at a time until I found the tricky one: it was the Force Index indicator. I got it from the NT forum and it's supossed that you don't support these kind of indicators.

I've been using the Force Index for almost six months, and it's the key indicator for my trading strategy. Today I've found a 'decent' and 'legal' substitute, but it's not exactly the same. BTW, do you know if NT is planning about including Force Index between the official list?

Thank you very much for your help, and apologize for my english.

Vicente

[vicentemmingo]

Forget my last message, it's failing again.

You can see attached the trace file. Sometimes the reload hist data works and sometimes not, and I don't know why.

I'll keep you informed.

[NinjaTrader_Jason]

Hello Vicente,

Am I correct you do not have any indicators applied and the issue still persists? Do you still use the same intervals (30 min and 120 min) and look back periods (10 days and 15 days)?

I still cannot reproduce it on my end - I even imported the ForceIndex indicator and applied in my EURJPY 15 min chart. When I reload historical data, the 'Loading Data' window will appear. After a few seconds the chart will become blank and the 'Loading Data' window remains. Then, after a few seconds the chart displays all data and the 'Loading Data' window disappears.

Could it be you perform other actions on your PC during the loading of data?

[vicentemmingo]

Jason,

I've been talking with an IB tech support agent and, after one hour of phone talking, the problem has been solved. I don't have a clear explanation, but it was a problem related with a Windows 7 update, some issue about my 3G internet connection and the TWS password. I don't know why but all that situation was affecting to NT and TWS performance.

My findings about Force Index were only casualties.

Thank you for your time,
Vicente

[NinjaTrader_Jason]

I see, good to hear you resolved the issue and thank you for reporting.

Have a nice day.

[tworth]

I am having a very poor experience using Barchart data with NT6.5.16 for ES and NQ. ES seems to be the most unreliable. I an using 7500 and 3350 Volume charts for ES. Charts sometimes take as long as 10 minutes to load - literally, I've timed it. And frequently during the trading day I experience huge gaps in the charts, causing me to refresh, costing another 3-5-10 minutes of load time. Almost always get the "Error loading historical data" pop up, sometimes charts look fine anyway, sometimes obvious gaps where data is missing.

Are there any settings or connection issues I have overlooked or don't understand. Barchart includes historical data, so I assume that's where it comes from, but I've noticed on other account connections that Ninja servers provide historical data.

BTW - This is on a fast up-to-date computer, dual processors, large RAM, high speed cable, and I have used numerous platforms in the past, so not a total rookie, and understand that things slow down during volatile markets, news, etc. This is a constant issue.

I was planning to go live with NT, but unless I can resolve this I won't be able to. Thanks in advance for help and suggestions.

Tom

[NinjaTrader_Jason]

Hello Tom,

BarChart provides historical data itself - it does not use our historical data server like other connections.

Depending on how much historical data you request and the indicators you have applied, it can take a while for the chart to load. If you want to speed up this process, please request less historical data or apply less indicators. Indicators will need to be calculated on the data that is loaded.

I am not sure why you experience gaps. Could it be the market was not very volatile for the times you experience gaps? So it seems like a gap, however since the market was not very volatile, it created less volume bars for that period? Please check the session begin and end times of the chart as well - double click the chart to open the chart properties menu. If you like to reflect all available data, please use 12:00 AM and 12:00 AM.

In addition, could you please start a new thread in the future.

[tworth]

Jason, thanks for your speedy reply. I'm sorry but can you tell me how to move this conversation to a new thread?

[NinjaTrader_Jason]

Unfortunately, as far as I know this is not possible. You can correspond using this thread, since the initial issue is resolved. Just start a new thread if you post a new inquiry or issue in the future.

[tworth]

Thanks Jason,

Have taken all usual steps, performed all XP updates, turned off firewall, blockers, etc,, checked internet connection, router, etc, re installed NT, deleted all charts and workspaces, eliminated indicators, and still experiencing long minutes of load time for 3days worth of ES 7500 volume charts.

Minute charts no problem, seems to be specifically related to tick, volume, range data. Not ready to move to NT7, possibly ready to try a different data provider...

Any suggestions, similar experience, feedback, etc?

Would using NT historical data servers be a better option? IS that an option?

Thanks,

Tom

[NinjaTrader_Kyle]

Hi Tom,

Testing another connection which uses the NinjaTrader historical data servers would be a good next step.

Please send a note to Support [AT] NinjaTrader [DOT] com with 'ATTN: Kyle' in the subject line.

In the message, please include a link to this forum thread.

[tworth]

Thanks Kyle, will do. Meanwhile talked to the guys at Barchart - their hypothesis is that because I'm asking for volume based charts the conversion process from time-based data is an issue. Still they say that they don't hear this often, so obviously not a common issue. I'll email as instructed


Thanks,
Tom