Stuck on Loading Data... cache problem?

[JS999]

I am getting this problem where I cannot load charts... every time I try to load a chart where the cache has already been constructed, I get a "Loading Data..." message that just hangs and does not go away. If I shut down NT, clear the cache directory, and restart, the bars build fine... but when I try to reload at that point from the newly built bar cache data it just hangs. There is no message in the trace file or log that indicates any error. Is this a known issue with B19?

(Also, when I exit the program after I get stuck like this, I have to go into Task Manager and manually kill the NT process, since it seems to be in some kind of deadlock loop and doesn't exit properly.)

[NinjaTrader_Kyle]

Hi JS999,

Thanks for your post.

1.) Who is your data provider?

2.) Can you give me an idea of what you're trying to load?

[JS999]

Hi JS999,

Thanks for your post.

1.) Who is your data provider?

2.) Can you give me an idea of what you're trying to load?

Data provider is Zen-Fire. This is not a provider issue, since I have multiple installs connected to the same feed and the others are working just fine.

I am trying to load CL 09-10. The problem seems to be intermittent. For example, I just shut down NT, and tried to load it up again... now it works, at least for the charts that I already had loaded in my workspace. Sometimes it loads a few of them and the others get stuck on Loading Data... and sometimes they all get stuck. I just tried to open a new chart for CL 09-10 on top of my normal workspace charts and this one is now stuck, although the others are fine.

It seems as though the entire program gets stuck if even one chart screws up, making it impossible to do Reload Historical Data on anything else. If I close the offending chart, it doesn't help - the system is permanently stuck and no charts can reload. When I exit the program in this case, even if I shut down the offending chart, I have to manually kill the process in Task Manager as I stated. So basically as soon as one chart gets screwed up in the Loading Data... process, the entire program is pretty much toast since you can't load anything else and have to restart.

[JS999]

Yep, getting stuck loading absolutely anything at all... cannot create a new chart apart from the 6 that are already in my workspace, the system just hangs. I _can_ create new charts in my other NT 7 B19 installations connected to the same feed.

[NinjaTrader_Kyle]

Hi JS999,

What I'm looking for is an overview of the different charts you are running in your workspace, what intervals they use and how many days of data are being requested.

[JS999]

Hi JS999,

What I'm looking for is an overview of the different charts you are running in your workspace, what intervals they use and how many days of data are being requested.

I have been running with the same setup for months and it has been working fine, so that's not the issue. However, here it is:

6 charts:

10 minute, 300 bars back (equals 2 days of data)
3 minute, 1000 bars back (equals 2 days of data)
1 minute, 3000 bars back (equals 2 days of data)
20 second, 9000 bars back (equals 2 days of data)
3 range, 2 days back setting
6 range, 2 days back setting

That's it. Nothing special on the charts, just some moving averages and bollinger bands. Anyways, those charts actually load fine right now as I said... the issue is opening up a brand NEW chart. For a new chart, I have tried something as simple as a 10 minute chart looking 10 bars back, and it doesn't work.

[NinjaTrader_Kyle]

Hi JS999,

Just curious - if you open a new workspace, are you able to load the new chart?

[JS999]

Hi JS999,

Just curious - if you open a new workspace, are you able to load the new chart?

If I add a new chart to the current workspace and then exit and try to reload, the new chart gets stuck on Loading Data...

Also, any charts that were "after" that one in the loading sequence do not get loaded. When I remove the new chart, everything works fine again.

When I create a new workspace and try to load a chart, it just hangs. Anyways, I have to go now... I'll check in later...

[NinjaTrader_Kyle]

Hi JS999,

When you find the time, please send a note to Support [AT] NinjaTrader [DOT] com with 'ATTN: Kyle' in the subject line.

In the message, please include the following:
1.) A link to this forum thread.

2.) Your workspace.
You'll find the workspace here: My Documents > NinjaTrader 7 > Workspaces

[waverider]

I have exactly the same problem.

I always connect to Zen Fire, then IQ Feed. The 'loading data' hang issue occurs frequently whenever I change the time frame in my daily chart (which uses IQ data) to minute. Can't do anything but force shut down.

Grrr, this is a very annoying bug


Thanks

[NinjaTrader_Kyle]

waverider,

Thanks for your post.

What amount of historical data is being requested in your chart?

[waverider]

30 days of 60 min data. Sometimes 45. Usually it's fine, but lately I've seen it hang quite often. Not sure if related to my move to Win 7 64bit using NT 6.5. Or a possible workspace corruption? (they seem to corrupt easily?).

Likewise I just got an error loading data - invalid symbol. But closing and re-opening the app sorts that problem out too.

[NinjaTrader_Kyle]

waverider,

You're running 6.5.1000.16 then? (To check: Help > About)

If so, please open the Documents > NinjaTrader 6.5 > DB folder, right click on the file named 'NinjaTrader' and select Properties.

What size is this file reported to be?

[waverider]

Yes.

Only 230,000 KB

Does the DB tend to corrupt when it becomes too large ??

How would one maintain it?

I note that 'reset db' doesn't really clean out historical data, you have to change the DB name and begin a new DB for that? (and loose my ATM strategies / Instruments etc).

I think I'll stop recording historic data since it is available through NT7 now ... Although it's nice to at least maintain a week or so, would be good to be able to clean out everything else...

Cheers

[NinjaTrader_Kyle]

waverider,

We tend to see a higher instance of related issues such as these when databases grow larger than 100 (or so) MB in size.

Please rename your database by following the steps listed below. Doing so will create a new database at start up. Due to this, historical chart data will need to be reloaded. Likewise, ATM strategy templates, custom instruments and instrument lists will need to be recreated.


To rename the DB:


Shutdown NinjaTrader and Go to the Start Menu
Select My Documents--> NinjaTrader 6.5--> DB--> NinjaTrader.MDB.
Right click on NinjaTrader.MDB and select "Rename."
Name it "NewNinjaTrader.MDB."
Then restart the software.

[waverider]

Kyle,

Renaming the DB is something I've had to do in the past and to be honest, not something I want to be in the habit of. It's a royal pain to re-load instruments, etc.

There should be an option to either/or:

- 'Clean' DB by deleting all data, WITHOUT deleting instrument lists / atm strategies
- 'Save / Export' instrument lists / atm strategies so that they need not be lost when rebuilding the DB

It's completely silly to be able to store historical data if it only leads to corruption ! ??

[NinjaTrader_Kyle]

waverider,

I'll forward your comments on - thanks for your feedback.

Please proceed as per my last post and let me know if I can be of assistance with anything else.

[waverider]

Thanks Kyle,

Also, there is a dire need to be able to abort 'loading data'.

But I believe this has been done in NT 7 correct?

Meanwhile, it's probably the most common issue I have, so would be good to have a patch in NT6.5 also.

Regards,

[NinjaTrader_Kyle]

waverider,

I'll forward these recommendations on as well.

If we may be of assistance with anything else, please let us know.

[waverider]

Just to let you know,

I renamed the DB, but I CONTINUE to have the same problem - just gets STUCK on "loading data" ... When you are live trading, you don't want to have to shut down the platform to fix this problem ...

Is there not any other way to quit the loading process when it hangs like this?

It is my number one frustration with Ninja at the moment !

Thanks,

[NinjaTrader_Kyle]

waverider,

1.) What amount of data are you attempting to load? In what interval?

2.) Unfortunately, there's no way to abort the data request currently.

[waverider]

Probably too much, I had the chart on 45 days, and loaded 1m bars. But that's because I previously had 60m bars on that chart. If it's too much, it should just load what it can? Surely?

Just shut down and restarted, now it says "error, invalid symbol" .. .I'm also confused as to why it does this from time to time, when nothing has changed ! ?? I load another symbol, then come back to it, and the second time round it works ?

I guess my only option is to double check the data series to see how much data I'm requesting BEFORE loading new data ..?

[NinjaTrader_Kyle]

waverider,

Data requests of this magnitude will require some time to process and may stall completely. Your best bet is to load smaller increments of data. (say, five days of minute data)

Per the invalid symbol error, please check the Log tab of the Control Center to see which chart is erroring out.

[waverider]

Team,

Getting stuck "loading data" is becoming my biggest gripe with Ninja. I have re-named the database, started fresh, and am very careful to only load smaller increments of data. STILL I continuously have the problem where it just hangs on loading data. I'm beginning to wonder if it's a problem connecting to ZF and IQFeed at the same time?

Further, I just don't understand why sometimes Ninja says "invalid symbol", when it's exactly the same setup as a prior day ! ? Also, it goes ahead and loads data for said 'invalid symbol' - so how is that possible?

Am I better of switching to NT7 ?

This is killing me, I have to shut down and re-open ninja 10 times per day.

I have a very fast machine, so it's not my hardware.

Cheers

[NinjaTrader_Kyle]

waverider,

Getting stuck at 'loading data' indicates that the data request has stalled. Ultimately, you'll need to restart NinjaTrader to restart the data request.

That said, you should run in to this type of issue less often by reducing the amount of data you're trying to load at a single time.

Per 'invalid symbol', I'd need you to provide me with more information. (which provider were you connected to first, which instrument(s) are effected, etc)

[waverider]

Kyle, sounds like a bug that needs fixing to me, as I said, I don't load much history, have nothing in the DB, and still have the prob all the time.

Please look into a fix. NT is just buggy.

Would be nice if NT gets it together, gets some solid code behind it, and doesn't fall by the wayside ... It has come so far, but users are getting frustrated.

No point going into detail about other issue, there's no fix ...

Cheers,