You are now following this question
- You will see updates in your followed content feed.
- You may receive emails, depending on your communication preferences.
Importing .mat files with text also
1 view (last 30 days)
Show older comments
Hi, I'm trying to import large tables saved as a .mat file, but MATLAB won't load the file. The table is set up as a column matrix with ['str',#,#,#,#,#,#]. The str is a date file which could be converted to date, but takes a long time to do. (3.5million rows). I'm looking for a way to get this to import into matlab, but load won't work, and textscan doesn't either. Load is trying to pick it up as a ASCII file (due to the string) and textscan won't pick it up because it isn't a text file. Any suggestions?
Edit: Doing more research, could this also be related to my version of everything being 32bit rather than 64? The .mat file is only 36MB, so it didn't occur to me until I kept crashing the program doing some sidework.
11 Comments
Mike Beacham
on 14 Jul 2014
Edited: Mike Beacham
on 14 Jul 2014
Hey Jose,
Short version - If I'm understanding correctly, for load to work, it has to be an entirely binary file, and for ASCII to work, it needs to be a text file?
Longer Version - I have tried load, load( ,-mat) and load( ,-ascii). They all keep giving errors. Just load gives error "Can't read file filename.mat." If I try adding -mat tag, I get the same thing, which makes sense. If I try as an -ascii, "Unknown text on line number 1 of ASCII file filename.mat "MATLAB"." And I've read through the documentation a few times, but it wasn't helping me too much. I was just getting on here to mention I might be overloading the 32 version I'm running, but it's nowhere near the 4G limit on file size. If I use some other data of about 10% the size, MATLAB crashed halfway through my script.
Star Strider
on 14 Jul 2014
Please post relevant parts of your code. Without it we can only guess.
Also, what version of MATLAB was the .mat file saved with? Do you have access to the script that saved it?
Mike Beacham
on 14 Jul 2014
The files were saved by converting a CSV to .mat file through MATLAB on R2014a 64bit, then they were given to me. I'm running R2014a 32bit.
I don't even have the load portion written into the script. I'm currently just trying to get the thing to load. I'm trying to load various files, and then the script picks columns out and does calculations.
>> load('filename.mat','-ascii');
Error using load
Unknown text on line number 1 of ASCII file filename.mat
"MATLAB".
>> load('filename.mat')
Error using load
Can't read file filename.mat.
>> load('filename.mat','-mat')
Error using load
Can't read file filename.mat.
>>
Mike Beacham
on 14 Jul 2014
good checks, They are MATLAB files, so not Access Tables, and I checked my paths, the folder was a few down the list, but when I moved it to the top, same problems.
dpb
on 14 Jul 2014
Edited: dpb
on 14 Jul 2014
...The files were saved by converting a CSV to .mat file through MATLAB on R2014a 64bit, then they were given to me. I'm running R2014a 32bit....
I don't have a 64-bit system to check on so can't answer whether there's a compatibility issue there or not. Official TMW support should be able to tell or the supplier of the files to check the doc for the 64-bit version for any caveats listed there or for any switches can use if known need them to be 32-bit compatible.
ADDENDUM
Are MAT-files compatible between the 32-bit and 64-bit versions of MATLAB?
MAT-files created with 32-bit versions and 64-bit versions of MATLAB are compatible with each other.
Note: With large data sets that use the -7.3 MAT-file format, it is possible for the 64-bit version of MATLAB to produce a MAT-file that is too large for the 32-bit version of MATLAB.
That implies other than the overall file size should be compatible if save was how files were actually created.
END ADDENDUM
Other than that, we're still guessing -- if can post the segment of code that did the save to create the files and the relevant information for the variables within, then could have something to go on to know what the files really are.
It would be of interest to see what
whos -file 'filename.mat'
returns and if could get it from both machines that would be even better.
Mike Beacham
on 14 Jul 2014
Edited: Mike Beacham
on 14 Jul 2014
The file was saved using te import data function on the command window, not actually writen code. It started as a CSV file. I wanted it to export as a table, so I chose that option, labeled the headings, and then saved as a .mat file. It opens just fine on the 64 bit machine. If I enter in whos there I get
>> whos('-file','siws01.mat')
Name Size Bytes Class Attributes
siws01 - 562714480 table
Running on my 32 bit system, I get a warning that says unknown MAT-file error.
>> whos('-file','siws01.mat')
Warning: Unable to read some of the variables due to unknown MAT-file error.
Hmmm. I think that means my problem is more related to file type as opposed to text vs binary inputs. Thanks everyone. I'll figure this out and then see if I still have the importing problem.
dpb
on 14 Jul 2014
Indeed your surmise is correct. I don't have a version with the table type so can't test. I'd suggest after you read the data in if the point is to transport the data to the other machine, use
save filename txtvar numericvars
will be more compact and you can then just load the variables and create the table on the target machine.
Mike Beacham
on 14 Jul 2014
Thanks! I'll give that a shot.
Mike Beacham
on 15 Jul 2014
It turns out my whole MATLAB install was corrupt, I re-installed and it started loading them. Thanks for all the help guys!
Answers (0)
See Also
Categories
Find more on Data Type Conversion in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!An Error Occurred
Unable to complete the action because of changes made to the page. Reload the page to see its updated state.
Select a Web Site
Choose a web site to get translated content where available and see local events and offers. Based on your location, we recommend that you select: .
You can also select a web site from the following list
How to Get Best Site Performance
Select the China site (in Chinese or English) for best site performance. Other MathWorks country sites are not optimized for visits from your location.
Americas
- América Latina (Español)
- Canada (English)
- United States (English)
Europe
- Belgium (English)
- Denmark (English)
- Deutschland (Deutsch)
- España (Español)
- Finland (English)
- France (Français)
- Ireland (English)
- Italia (Italiano)
- Luxembourg (English)
- Netherlands (English)
- Norway (English)
- Österreich (Deutsch)
- Portugal (English)
- Sweden (English)
- Switzerland
- United Kingdom (English)
Asia Pacific
- Australia (English)
- India (English)
- New Zealand (English)
- 中国
- 日本Japanese (日本語)
- 한국Korean (한국어)