cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Try the Materials Informatics Toolkit, which is designed to easily handle SMILES data. This and other helpful add-ins are available in the JMP® Marketplace
Choose Language Hide Translation Bar
vinkane
vinkane
Level III

Frequently receive out of memory pop ups when working with a data table approx 4M rows. My Lenovo has 8GB ram

Jul 28, 2015 10:30 AM (12274 views)

Unable to develop summary tables when using data tables in excess of 4M rows.

Frequently get pop up windows dealing with "Memory type issues"

0 Kudos
1 ACCEPTED SOLUTION

Accepted Solutions
markschahl
markschahl
Level V
Solution

Re: Frequently receive out of memory pop ups when working with a data table approx 4M rows. My Lenovo has 8GB ram

Jul 30, 2015 12:38 AM (14541 views)  |  Posted in reply to message from vinkane 07-28-2015

A basic question about your machine. What OS are you running? 32-bit or 64-bit? If you have a Win7 32-bit machine, it can only access 4GB, even though you may have 8GB installed. If this is the case, you will have to wipe the HD, install Win7 64-bit to access the the 8GB. I speak from experience... It was worth the pain to wipe HD and reinstall 64-bit versions of my software.

View solution in original post

8 REPLIES 8
Eric_Hill
Staff Eric_Hill
Staff

Re: Frequently receive out of memory pop ups when working with a data table approx 4M rows. My Lenovo has 8GB ram

Jul 28, 2015 01:05 PM (12005 views)  |  Posted in reply to message from vinkane 07-28-2015

How many columns per row, and what data types?  If each row requires ~1000 bytes, that would be 4GB.  Doing analysis on top of that, you could easily be pushing the boundaries of 8 GB.

Eric

0 Kudos
vinkane
vinkane
Level III

Re: Frequently receive out of memory pop ups when working with a data table approx 4M rows. My Lenovo has 8GB ram

Jul 28, 2015 02:02 PM (12005 views)  |  Posted in reply to message from Eric_Hill 07-28-2015

Eric:  Thanks for the reply. About 12 columns, dates, numeric and character type columns.

I'm not bugging IT for some more RAM

0 Kudos
Eric_Hill
Staff Eric_Hill
Staff

Re: Frequently receive out of memory pop ups when working with a data table approx 4M rows. My Lenovo has 8GB ram

Jul 28, 2015 02:07 PM (12005 views)  |  Posted in reply to message from vinkane 07-28-2015

Okay, assuming your character columns are not quite large, it does seem surprising that you are running out of memory.  You may want to run this one through SAS Tech Support.

Are there some platforms that you can run on this data without running out of memory? Or have you only tried Tables > Summary?

Thanks,

Eric

0 Kudos
vinkane
vinkane
Level III

Re: Frequently receive out of memory pop ups when working with a data table approx 4M rows. My Lenovo has 8GB ram

Jul 30, 2015 02:05 PM (12005 views)  |  Posted in reply to message from Eric_Hill 07-28-2015

Yes, I have tried summary tables which I found that there was no summary table constructed and there was no log entry.

That was the original SAS issue I logged in.


0 Kudos
markschahl
markschahl
Level V
Solution

Re: Frequently receive out of memory pop ups when working with a data table approx 4M rows. My Lenovo has 8GB ram

Jul 30, 2015 12:38 AM (14542 views)  |  Posted in reply to message from vinkane 07-28-2015

A basic question about your machine. What OS are you running? 32-bit or 64-bit? If you have a Win7 32-bit machine, it can only access 4GB, even though you may have 8GB installed. If this is the case, you will have to wipe the HD, install Win7 64-bit to access the the 8GB. I speak from experience... It was worth the pain to wipe HD and reinstall 64-bit versions of my software.

briancorcoran
Staff briancorcoran
Staff

Re: Frequently receive out of memory pop ups when working with a data table approx 4M rows. My Lenovo has 8GB ram

Jul 30, 2015 01:47 PM (12005 views)  |  Posted in reply to message from markschahl 07-30-2015

On a 32-bit machine, while the OS has access to 4GB JMP only has access to 2 GB.  So, there are serious constraints there.

Brian Corcoran

JMP Development

0 Kudos
vinkane
vinkane
Level III

Re: Frequently receive out of memory pop ups when working with a data table approx 4M rows. My Lenovo has 8GB ram

Jul 30, 2015 02:06 PM (12005 views)  |  Posted in reply to message from markschahl 07-30-2015

Thanks for this insight. I'll try this suggestion with the help of IT

0 Kudos
ron_horne
Super User (Alumni) ron_horne
Super User (Alumni)

Re: Frequently receive out of memory pop ups when working with a data table approx 4M rows. My Lenovo has 8GB ram

Jul 30, 2015 10:41 AM (12005 views)  |  Posted in reply to message from vinkane 07-28-2015

I get the same when working with scripts that include very long loops of huge tables simultaneously . in my case it turned out that if i send several messages to the same object it happens while sending each message separately and repeating the name of the object each time it doesn't happen at all.