Clustering filesystem for small files

Posted by viraptor on Server Fault See other posts from Server Fault or by viraptor
Published on 2011-01-14T16:26:52Z Indexed on 2011/01/14 16:55 UTC
Read the original article Hit count: 279

Hi, I'm looking for a distributed filesystem which I could use for storing lots of small files (<1MB usually). What I want to get is:

  • 2 servers which have the fs mounted themselves and mirror the data
  • locking support (among reachable nodes)
  • some kind of best-effort automatic resynchronisation after one node goes down and comes back again

What I mean by the resync is that, I'm ok with both servers doing read/write operations even if they split-brain. I'm also ok if a local process obtains a lock if the other host is not reachable. From the resync I expect only a file-level consistent view after a while - that is - if file x is modified on both nodes during a split-brain, I don't really care which one is available after they join again, as long as it's full file, not one block coming from node1 and another block from node2.

Is there a solution like that out there? I see that gluster has some problems with file locks (even in 3.1). I also noticed that OCFS2 will panic if both nodes split-brain. What other filesystem would allow me to do what I want?

© Server Fault or respective owner

Related posts about cluster

Related posts about filesystem