OutOfMemoryException Processing Large File

Posted by Krip on Stack Overflow See other posts from Stack Overflow or by Krip
Published on 2010-03-30T13:21:17Z Indexed on 2010/03/30 13:23 UTC
Read the original article Hit count: 424

Filed under:

BizTalk

|

orchestration

|

map

|

memory

|

32bit

We are loading a large flat file into BizTalk Server 2006 (Original release, not R2) - about 125 MB. We run a map against it and then take each row and make a call out to a stored procedure.

We receive the OutOfMemoryException during orchestration processing, the Windows Service restarts, uses full 2 GB memory, and crashes again.

The server is 32-bit and set to use the /3GB switch.

Also I've separated the flow into 3 hosts - one for receive, the other for orchestration, and the third for sends.

Anyone have any suggestions for getting this file to process wihout error?

Thanks, Krip

© Stack Overflow or respective owner

Related posts about BizTalk

Future of BizTalk

as seen on Geeks with Blogs - Search for 'Geeks with Blogs'
The future of BizTalk- The last TechEd Conference was a very important one from BizTalk perspective. Microsoft will continue innovating BizTalk and releasing BizTalk versions for “for next few years to come”. So, all the investments that clients have made so far will continue giving returns. Three… >>> More
BizTalk Server Monitoring – SharePoint Web Part

as seen on Geeks with Blogs - Search for 'Geeks with Blogs'
I have been worked with customers using BizTalk as shared infrastructure in the enterprise, where we have two or more BizTalk apps running on it for different Business groups. Also these customers are not using BizTalk ESB portal even though they are using BizTalk ESB exception framework. So main… >>> More
Useful Tips for BizTalk 2006 to BizTalk 2009 Porting

as seen on Geeks with Blogs - Search for 'Geeks with Blogs'
BizTalk projects require some manual intervention in order to upgrade them. Execute the following steps to port a BizTalk solution / project: Open the project’s solution file (.sln) using a text editor – NotePad++ is recommended. Remove all the contents (in red below) between (not including)… >>> More
TFS - How much nesting on disk structure

as seen on Stack Overflow - Search for 'Stack Overflow'
We just got TFS installed and ready go. I'm trying to decide on the disk structure. Let's suppose I have two BizTalk projects called Common and BookTransfer (in actuality I have 7). [At this client, we adopted the style of having schemas, orchs, maps in one project called BizTalk.Artifacts]. A folder… >>> More
BizTalk Server 2009 - Architecture Options

as seen on Geeks with Blogs - Search for 'Geeks with Blogs'
I recently needed to put forward a proposal for a BizTalk 2009 implementation and as a part of this needed to describe some of the basic architecture options available for consideration. While I already had an idea of the type of environment that I would be looking to recommend, I felt that presenting… >>> More

Related posts about orchestration

BizTalk: Suspend shape and Convoy

as seen on Geeks with Blogs - Search for 'Geeks with Blogs'
Part 1: BizTalk: Instance Subscription and Convoys: Details This is a Part 2. I am discussing the Suspend shape together with Convoys and going to show that using them together is undesirable. In previous article we investigated the Instance Subscriptions and how they could create situation with… >>> More
Simple BizTalk Orchestration & Port Tutorial

as seen on Geeks with Blogs - Search for 'Geeks with Blogs'
(This is a reference for a lunch & learn I'm giving at my company) This demo will create a BizTalk process that monitors a directory for an XML file, loads it into an orchestration, and drops it into a different directory. There’s no real processing going on (other than moving the file from one… >>> More
BizTalk: Internals: the Partner Direct Ports and the Orchestration Chains

as seen on Geeks with Blogs - Search for 'Geeks with Blogs'
Partner Direct Port is one of the BizTalk hidden gems. It opens simple ways to the several messaging patterns. This article based on the Kevin Lam’s blog article. The article is pretty detailed but it still leaves several unclear pieces. So I have created a sample and will show how it works from… >>> More
BizTalk: Instance Subscription: Details

as seen on Geeks with Blogs - Search for 'Geeks with Blogs'
It has interesting behavior and it is not always what we are waiting for. An orchestration can be enlisted with many subscriptions. In other word it can have several Receive shapes. Usually the first Receive uses the Activation subscription but other Receives create the Instance subscriptions. [See… >>> More
Custom BizTalk, Orchestration SMTP Adapter Dynamic send port

as seen on Dot net Slackers - Search for 'Dot net Slackers'
How to build a BizTalk application that will allow run time configuration and sending of SMTP email from within an orchestration read moreBy BiZTech KnowDid you know that DotNetSlackers also publishes .net articles written by top known .net Authors? We already have over 80 articles in several categories… >>> More