Filestreaming System.OutofMemoryException

Question

sharon.chapman7 -1 Newbie Poster

12 Years Ago

Hi,
I am getting an System.OutofmemoryException when using Filestream to load zip file. the file is 521MB. My code is:

//Insert using Filestream, file into SQL Server Table
        private void btnInsert_Click(object sender, EventArgs e)
        {
            OpenFileDialog openFileDlg = new OpenFileDialog();
            openFileDlg.InitialDirectory = Directory.GetCurrentDirectory();
            if (openFileDlg.ShowDialog() == DialogResult.OK)
            {
                FileInfo fi = new FileInfo(openFileDlg.FileName);
                FileStream fs = new FileStream(fi.FullName, FileMode.Open, FileAccess.Read);
                BinaryReader rdr = new BinaryReader(fs);
                byte[] fileData = rdr.ReadBytes((int)fs.Length);
                rdr.Close();
                fs.Close();

My program dies on this line: byte[] fileData = rdr.ReadBytes((int)fs.Length);
i have also attached the detail for the System.OutofMemoryException. I am runing this on a Windows 7, 64bit

machine.

thanks for your help.

Sharon

file-stream

Thread_OutOfMemory.txt (1.08 KB)

subject: Filestreaming System.OutofMemoryException

Hi,
I am getting an System.OutofmemoryException when using Filestream to load zip file. the file is 521MB. My code is:

//Insert using Filestream, file into SQL Server Table
        private void btnInsert_Click(object sender, EventArgs e)
        {
            OpenFileDialog openFileDlg = new OpenFileDialog();
            openFileDlg.InitialDirectory = Directory.GetCurrentDirectory();
            if (openFileDlg.ShowDialog() == DialogResult.OK)
            {
                FileInfo fi = new FileInfo(openFileDlg.FileName);
                FileStream fs = new FileStream(fi.FullName, FileMode.Open, FileAccess.Read);
                BinaryReader rdr = new BinaryReader(fs);
                byte[] fileData = rdr.ReadBytes((int)fs.Length);
                rdr.Close();
                fs.Close();

My program dies on this line: byte[] fileData = rdr.ReadBytes((int)fs.Length);
i have also attached the detail for the System.OutofMemoryException.  I am runing this on a Windows 7, 64bit machine.

thanks for your help.

Sharon

Edited 11 Years Ago by Dani because: Formatting fixed

4 Contributors
8 Replies
260 Views
4 Days Discussion Span
Latest Post 12 Years Ago Latest Post by gusano79

ddanbe 2,724 Professional Procrastinator

12 Years Ago

You are casting to an int=int32. Should that not be long=int64 ?

gusano79 247 Posting Shark

12 Years Ago

So... how much RAM do you have in your system? I recommend you keep an eye on the Performance Monitor while your program is running. Watching the amount of free memory available might be very educational.

Reply to this topic

Be a part of the DaniWeb community

We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.

sharon.chapman7 -1 Newbie Poster · Answer 1 · 2012-03-09T01:39:53+00:00

So... how much RAM do you have in your system? I recommend you keep an eye on the Performance Monitor while your program is running. Watching the amount of free memory available might be very educational.

Hi,

As I mentioned I have a machine that has 8 GB of memory. I had to shut down my machine to take it home last night.

When I tried to load the file again today it loaded with no problem. Normally I will only be loading one file at a

time, but in this case I was testing my Development database and was loading 28 files one right after the other.

Now my question is, since it is working ok now, is there a problem I still need to fix?

Sharon

sharon.chapman7 -1 Newbie Poster · Answer 2 · 2012-03-09T01:45:51+00:00

You are casting to an int=int32. Should that not be long=int64 ?

Hi,

As I mentioned I have a machine that has 8 GB of memory. I had to shut down my machine to take it home last night.

When I tried to load the file again today it loaded with no problem. Normally I will only be loading one file at a

time, but in this case I was testing my Development database and was loading 28 files one right after the other.

Sharon

skatamatic 371 Practically a Posting Shark · Answer 3 · 2012-03-09T02:18:02+00:00

Windows has a limit of 2GB of memory per process. How big is the file that you are trying to read?

sharon.chapman7 -1 Newbie Poster · Answer 4 · 2012-03-09T02:55:44+00:00

You are casting to an int=int32. Should that not be long=int64 ?

Hi,

As I mentioned I have a machine that has 8 GB of memory. I had to shut down my machine to take it home last night.

When I tried to load the file again today it loaded with no problem. Normally I will only be loading one file at a

time, but in this case I was testing my Development database and was loading 28 files one right after the other.

Sharon

skatamatic 371 Practically a Posting Shark · Answer 5 · 2012-03-09T05:16:55+00:00

Ummm. I hope you realize that you posted the exact same thing about an hour prior...

gusano79 247 Posting Shark · Answer 6 · 2012-03-12T23:15:46+00:00

As I mentioned I have a machine that has 8 GB of memory.

I've re-read your original post a number of times, and I'm still not seeing where you said how much RAM you have.

but in this case I was testing my Development database and was loading 28 files one right after the other.

Are they all about the same size, ~500 MB? If so, there's your answer: ~1/2 GB * 28 = ~14 GB, so if the CLR isn't collecting garbage fast enough, it'll run out of memory quite easily.

Now my question is, since it is working ok now, is there a problem I still need to fix?

I would imagine so. One success does not necessarily mean the issue is fixed. It's possible that, while there still may be a problem, it only comes up under rare circumstances. That may be acceptable to you--if so, then make a note of it and move on.

If you're interested in understanding what's happening and why, please humor me and do your test with the performance monitor running.