How and where to store user uploaded files in high traffic web farm scenario website?

Posted by Inam Jameel on Stack Overflow See other posts from Stack Overflow or by Inam Jameel
Published on 2010-03-12T16:45:28Z Indexed on 2010/03/12 16:47 UTC
Read the original article Hit count: 369

Filed under:

high-traffic

|

web-farm

|

fileupload

|

synchronization

|

filesystem

i am working on a website which deploy on web farms to serve high traffic. where should i store user uploaded files? is it wise to store uploaded files in the file system of the same website and synchronize these files in all web servers(web farm)? or should i use another server to store all uploaded files in this server to store files in a central location? if separate file server will be a better choice, than how can i pass files from web server to that file server efficiently? or should i upload files directly to that file server?

© Stack Overflow or respective owner

Related posts about high-traffic

Enjoy High Traffic on Your Site With SEO

as seen on Ezine Articles - Search for 'Ezine Articles'
Effective Internet marketing is necessary for a profitable online business. There are various advertising and marketing techniques that are used by business sites to increase website traffic. But one of the most important and effective techniques is SEO. >>> More
Normalize or Denormalize in high traffic websites

as seen on Stack Overflow - Search for 'Stack Overflow'
what is the best practice for database design for high traffic websites like this one stackoverflow? should one must use normalize database for record keeping or normalized technique or combination of both? is it sensible to design normalize database as main database for record keeping to reduce… >>> More
managing a high traffic media sharing website

as seen on Server Fault - Search for 'Server Fault'
i'm in the process of developing a website that i predict will generate a lot of traffic. the site will be similar to many other sites offering free media streaming: mp3's. we are going to start with a pretty minimal amount of media to share, but the basic idea is that artists will set up a profile… >>> More
CentOS 5.0 with Ligthttpd notices high traffic without reason

as seen on Server Fault - Search for 'Server Fault'
I have a CentOS 5 with Lightppd installed. Also I have MySQL on board. I lately discovered high traffic: http://img686.imageshack.us/img686/8596/traff.jpg Could you please tell me how to diagnose what is cause of this traffic? I didn't do anything that would explain it. >>> More
Using ThreadPool.QueueUserWorkItem in ASP.NET in a high traffic scenario

as seen on Stack Overflow - Search for 'Stack Overflow'
I've always been under the impression that using the ThreadPool for (let's say non-critical) short-lived background tasks was considered best practice, even in ASP.NET, but then I came across this article that seems to suggest otherwise - the argument being that you should leave the ThreadPool to… >>> More

Related posts about web-farm

ISA Web Farm and WCF service hosted in a Windows Service with basicHttpBinding

as seen on Stack Overflow - Search for 'Stack Overflow'
I have created a WCF service that needs to be hosted in a Window Service because it is participating in a P2P mesh (NetPeerTcpBinding). When I tried to host the WCF Service with NetPeerTcpBinding endpoints in the IIS Service container the service wouldn't run because it turns out that the P2P binding… >>> More
nHibernate strategies in a web farm

as seen on Stack Overflow - Search for 'Stack Overflow'
Our current project at work is a new MVC web site that will use a WCF service primarily to access a 3rd party billing system via a web service as well as a small SQL database for user personalization. The WCF service uses nHibernate for the SQL database. We'd like to implement some sort of web farm… >>> More
ASP.NET Page Caching in a Web Farm

as seen on Stack Overflow - Search for 'Stack Overflow'
We have a small web farm(2 servers) balanced by the built in network load balancer in Windows 2003. We have a few pages that use page caching. My question is: Is it possible that that a given user could cause a page to be cached and another user see that content? Here is the page directive for… >>> More
iis 7.5 - WFF and ARR farm management

as seen on Server Fault - Search for 'Server Fault'
We have two test web farms (IIS 7.5). The Florida web farm has two ARR servers and two content servers. The ARR servers have WFF and NLB installed. The ARR setup uses a shared config located on a file share. The content servers do not have WFF installed. There is one web farm, and it's managed on… >>> More
single point of failure in IIS Web Farm Framework setting?

as seen on Server Fault - Search for 'Server Fault'
ASP.NET WEB API Windows Server 2008 R2/IIS 7.5/Web Farm Framework 2.5 I am planning to deploy application across 4 web servers. Should i use shared content/configuration using DFS among web servers for web farm scenario? Second option is to use Web Farm Framework for deployment. Furthermore, is… >>> More