[MINC-development] me, I'm stumped
Jason Lerch
minc-development@bic.mni.mcgill.ca
01 May 2003 11:44:28 -0400
Ok, this is even more messed up than I first expected:
this works:
rawtominc -byte -clobber -input /dev/null /tmp/junk.mnc 470 2400 2800
this does not:
rawtominc -byte -clobber -input /dev/null /data/rome/temp/jason/test.mnc
470 2400 2800
So ... on a local filesystem everything appears to be OK (I have not yet
waited long enough to check whether the file actually holds sensible
values when I do this with real data - it is running now, but will take
a while), but over NFS it fails at 2GB. I'm running the commands on
yorick.
So I've cc-ed this to the trinity (are any of you on this list) - any
ideas why?
Jason
On Thu, 2003-05-01 at 10:03, Jason Lerch wrote:
> Hello again,
>
> there is no documentation that I could find about IRIX and large files,
> so I tried John's solution. Turns out you also have to add the NDEBUG
> symbol. Nevertheless, it still crashes at the same place with the same
> error, so no luck here.
>
> I guess it is time to start searching for bugs in the minc library
> source code ...
>
> Jason
>
> On Wed, 2003-04-30 at 17:37, John G. Sled wrote:
> > Hi Jason,
> >
> > Under 32-bit linux I was able to get commands such as the following to
> > work
> >
> > rawtominc -short /tmp/junk.mnc 2048 1024 1024 < /dev/zero
> >
> > Under linux I had to build minc and netcdf with the options
> >
> > -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64
> >
> > Is there something similar for IRIX?
> >
> > John
> >
> > On Wed, Apr 30, 2003 at 04:23:05PM -0400, Jason Lerch wrote:
> > > Hi all,
> > >
> > > OK, I'm officially stumped:
> > >
> > > I'm trying to create a large minc file with the following dimensions:
> > > 470*2800*2400
> > >
> > > The source is 470 images, each with the dimensions of 2800*2400. So,
> > > naturally, I'm using a 64-bit compiled version of rawtominc. This is the
> > > call:
> > >
> > > cat *.raw |
> > > /home/bic/jason/seconddir/minc64/src/minc/progs/rawtominc/rawtominc
> > > -clobber -yzx -xstep -0.01 -ystep 0.1 -zstep -0.01 test.mnc 470 2400
> > > 2800
> > >
> > > This, however, crashes with the following message:
> > >
> > > ncendef: ncid 3: Invalid argument
> > >
> > > At the time of the crash, the file has the following size:
> > >
> > > 2147450880
> > >
> > > If I resize the input files so that the final output is less than that
> > > magical 2GB limit (and adjust the size options for rawtominc
> > > accordingly), it works just fine. So this appears to be something to do
> > > with files over the 2GB limit. The point of the crash in rawtominc is
> > > here:
> > >
> > > (void) miattputstr(cdfid, imgid, MIsigntype, osign);
> > > if (ovrange_set)
> > > (void) miset_valid_range(cdfid, imgid, ovalid_range);
> > >
> > > /* End definition mode */
> > > (void) ncendef(cdfid);
> > >
> > > It gets to the ncendef call, but does not progress past it.
> > >
> > > I've spent a good part of today trying to figure out why this would be
> > > the case, but have come up with nothing obvious (and certainly no fix).
> > > So any help/suggestions would be greatly appreciated!
> > >
> > > Jason
> > >
> > > P.S. I also tried the 64-bit version of rawtominc that John sent to the
> > > geeks list a few months ago, but with the same results.
> > >
> > > P.P.S If anybody wants the input files to play with, look here:
> > >
> > > /data/rome/temp/jason/histo
> > >
> > > the files there are in raw byte format, as generated by convert file.png
> > > GRAY:file.raw
> > >
> > > _______________________________________________
> > > MINC-development mailing list
> > > MINC-development@bic.mni.mcgill.ca
> > > http://www.bic.mni.mcgill.ca/mailman/listinfo/minc-development
> > >
> > _______________________________________________
> > MINC-development mailing list
> > MINC-development@bic.mni.mcgill.ca
> > http://www.bic.mni.mcgill.ca/mailman/listinfo/minc-development
>
> _______________________________________________
> MINC-development mailing list
> MINC-development@bic.mni.mcgill.ca
> http://www.bic.mni.mcgill.ca/mailman/listinfo/minc-development