Technical details for Server 2012 de-duplication feature

Posted by syneticon-dj on Server Fault See other posts from Server Fault or by syneticon-dj
Published on 2012-10-26T16:59:52Z Indexed on 2012/10/26 17:05 UTC
Read the original article Hit count: 160

Filed under:

zfs

|

windows-server-2012

|

deduplication

Now that Windows Server 2012 comes with de-duplication features for NTFS volumes I am having a hard time finding technical details about it. I can deduce from the TechNet documentation that the de-duplication action itself is an asynchronous process - not unlike how the SIS Groveler used to work - but there is virtually no detail about the implementation (algorithms used, resources needed, even the info on performance considerations is nothing but a bunch rule-of-thumb-style recommendations).

Insights and pointers are greatly appreciated, a comparison to Solaris' ZFS de-duplication efficiency for a set of scenarios would be wonderful.

© Server Fault or respective owner

Related posts about zfs

ZFS replication between 2 ZFS file systems

as seen on Server Fault - Search for 'Server Fault'
I initially replicated tank/storage1 -- usb1/storage1-slave (depicted below), and then (deliberately) destroyed the snapshot I replicated from. By doing this, did I lose the ability to incrementally (zfs send -i) replicate between these 2 file systems? What's the best way to approach SYNC'ing these… >>> More
Troubleshoot broken ZFS

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
I have one zpool called tank in RaidZ1 with 5x1TB SATA HDDs. I'm using Ubuntu Server 11.10 Oneric, kernel 3.0.0-15-server. Installed ZFS from ppa also I'm using zfs-auto-snapshot. The ZFS file system when zfs module loaded to the kernel hangs my computer. Before it I created few new file systems: zfs… >>> More
Oracle Solaris 11 ZFS Lab for Openworld 2012

as seen on Oracle Blogs - Search for 'Oracle Blogs'
Preface This is the content from the Oracle Openworld 2012 ZFS lab. It was well attended - the feedback was that it was a little short - thats probably because in writing it I bacame very time-concious after the ASM/ACFS on Solaris extravaganza I ran last year which was almost too long for mortal… >>> More
zfs setup question

as seen on Super User - Search for 'Super User'
Currently I have a linux storage box and server with 4x750gb harddrives in raid-5 with ext3. I have ordered 3x1.5tb disks to upgrade this. Here is my planned upgrade: Backup: Format the 1.5 tb disks Copy all data from the raid-5 disks to the 1.5tb disks Destroy the raid-5 array. New setup: Create… >>> More
I need advice about iscsi + zfs(or ntfs) + windows 2008 clustering

as seen on Server Fault - Search for 'Server Fault'
I want to setup a storage farm with iSCSI. I have 2 cluster node machine, 1 iscsi target machine that has 8TB installed as RAID 10. The capacity is now 8TB, but I'll upgrade the capacity in future. Let's say, I installed clusters as file server, and I connected these servers to iscsi target, then… >>> More

Related posts about windows-server-2012

Can't upgrade Windows Server 2012 Essentials to Windows Server 2012 R2 Essentials

as seen on Server Fault - Search for 'Server Fault'
So today was RTM of Windows Server 2012 R2 Essentials released. I immediately tried to do an in-place upgrade of an existing RTM 2012 Essentials to RTM 2012 R2 Essentials, but get: Windows Server 2012 Essentials cannot be upgraded to Windows Server 2012 R2 Essentials. You can choose to install… >>> More
Top 31 Favorite Features in Windows Server 2012

as seen on Geeks with Blogs - Search for 'Geeks with Blogs'
Over the past month, my fellow IT Pro Technical Evangelists and I have authored a series of articles about our Top 31 Favorite Features in Windows Server 2012. Now that our series is complete, I’m providing a clickable index below of all of the articles in the series for your convenience, just in… >>> More
Windows Azure: Announcing Support for Windows Server 2012 R2 + Some Nice Price Cuts

as seen on ASP.net Weblogs - Search for 'ASP.net Weblogs'
Today we released some great updates to Windows Azure: Virtual Machines: Support for Windows Server 2012 R2 Cloud Services: Support for Windows Server 2012 R2 and .NET 4.5.1 Windows Azure Pack: Use Windows Azure features on-premises using Windows Server 2012 R2 Price Cuts: Up to 22%… >>> More
A SpecTECHular follow-up: Windows Server 2012 #HyperV, #SysCtr 2012 and #Windows8

as seen on Geeks with Blogs - Search for 'Geeks with Blogs'
Last week, I had the pleasure of presenting at the New Horizons SpecTECHular events (www.spectechular.com) in Cincinnati and Dayton OH. It was great meeting some very engaged IT Pros and discussing the new features of Windows Server 2012 Hyper-V, System Center 2012 / Private Cloud, and Windows 8… >>> More
Windows Server 2012 sera disponible en quatre éditions : Foundation, Essentials, Standard et DataCenter

as seen on Developper.com - Search for 'Developper.com'
Windows Server 2012 sera disponible en quatre éditions Foundation, Essentials, Standard et Datacenter, Microsoft dévoile les prix de l'OS Windows Server 2012, la prochaine version du système d'exploitation serveur de Microsoft sera officiellement disponible en quatre éditions : Foundation… >>> More