title: limit size JLD2 Julia
body: <p>Is there a size limit to load data using JLD2 in Julia? </p>
  
  <p>The same code:</p>
  
  <pre><code>using JLD2
  using FileIO
  exp=load("myfile.jld2");
  </code></pre>
  
  <p>seems to work fine until a certain size of data. For some experiments I ran, the file is 5GB and I obtain the following : </p>
  
  <blockquote>
    <p>Error encountered while loading "/pathtofile/myfile.jld2".
    Fatal error:</p>
    
    <p>ERROR: EOFError: read end of file</p>
    
    <p>Stacktrace:</p>
    
    <p>[1] handle_error(::EOFError, ::File{DataFormat{:JLD2}}) at /path/.julia/packages/FileIO/Y0Lre/src/error_handling.jl:80</p>
    
    <p>[2] handle_exceptions(::Array{Any,1}, ::String) at /path/.julia/packages/FileIO/Y0Lre/src/error_handling.jl:75</p>
    
    <p>[3] #load#27(::Base.Iterators.Pairs{Union{},Union{},Tuple{},NamedTuple{(),Tuple{}}}, ::Function, ::File{DataFormat{:JLD2}}) at /path/.julia/packages/FileIO/Y0Lre/src/loadsave.jl:193</p>
    
    <p>[4] load(::File{DataFormat{:JLD2}}) at /path/.julia/packages/FileIO/Y0Lre/src/loadsave.jl:172</p>
    
    <p>[5] #load#13(::Base.Iterators.Pairs{Union{},Union{},Tuple{},NamedTuple{(),Tuple{}}}, ::Function, ::String) at /path/.julia/packages/FileIO/Y0Lre/src/loadsave.jl:118</p>
    
    <p>[6] load(::String) at /path/.julia/packages/FileIO/Y0Lre/src/loadsave.jl:118</p>
    
    <p>[7] top-level scope at none:0</p>
  </blockquote>
  
  <p>I tried using jldopen which I have no experience in using at all but I also get similar error messages. </p>
  
  <p>What could I do ? </p>
  
  <p>And, btw, what is the difference between load and jldopen("my file.jld2","r")?</p>
  
  <p>I am using Julia Version 1.0.2 on Mac OSHighSierra 10.13.6.</p>