« previous next »
Pages:  [1]     Go Down

Author Topic: Server 2012 - Dedup Feature/Storage Savings  (Read 1826 times)

0 Members and 1 Guest are viewing this topic.

Offline osi

  • Thread Starter
  • Posts: 964
Server 2012 - Dedup Feature/Storage Savings
« on: Tue, 17 December 2013, 09:59:06 »
Guys and Gals,

If anyone has never used the server 2012 deduplication feature, I highly reccomend it. Of course, always suggest following best practices to achieve the greatest gains.

For example, deduplication does not apply to virtual hard drives among other things. For file shares, it's amazing.



Anyone else utilizing this feature out there??
« Last Edit: Tue, 17 December 2013, 10:11:44 by osi »
Logged

Offline swill

  • * Elevated Elder
  • Posts: 3365
  • Location: Canada eh
  • builder & enabler
    • swillkb.com
Re: Server 2012 - Dedup Feature
« Reply #1 on: Tue, 17 December 2013, 10:01:34 »
Windows as a server.  Eww...

Logged

Offline osi

  • Thread Starter
  • Posts: 964
Re: Server 2012 - Dedup Feature
« Reply #2 on: Tue, 17 December 2013, 10:02:54 »
Quote from: swill on Tue, 17 December 2013, 10:01:34
Windows as a server.  Eww...

For domain environments, definitley. We have our fair share of nix boxes and workstations as well
Logged

Offline swill

  • * Elevated Elder
  • Posts: 3365
  • Location: Canada eh
  • builder & enabler
    • swillkb.com
Re: Server 2012 - Dedup Feature
« Reply #3 on: Tue, 17 December 2013, 11:16:28 »
Quote from: osi on Tue, 17 December 2013, 10:02:54
Quote from: swill on Tue, 17 December 2013, 10:01:34
Windows as a server.  Eww...

For domain environments, definitley. We have our fair share of nix boxes and workstations as well

Ya, I am bias.  :)  I work with nix servers all the time and I hate it when I have to touch a Windows server.  :P

How bad is the performance hit on Windows with dedup enabled?  The main issue with dedup usually is that it takes a huge amount of CPU to dedup while the data is being written.  It will usually redline your CPU and reduce the IOPs because it can't write as quickly?  Are you using it mainly for backup data?

Edit: In regards to dedup.  SolidFire is doing some really cool **** with dedup.  I know its off topic a bit from your point, but I build cloud computing infrastructure and we have been playing with is a bunch recently.  Pretty impressive approach they have...
« Last Edit: Tue, 17 December 2013, 11:21:44 by swill »
Logged

Offline osi

  • Thread Starter
  • Posts: 964
Re: Server 2012 - Dedup Feature/Storage Savings
« Reply #4 on: Tue, 17 December 2013, 11:32:59 »
On this particular server, it's just a backup destination dump so the CPU use isn't a big deal.

Also have dedup turned on and active for an accounting server. So far, there have been no issues with CPU time/utilization that would effect business. Windows actually handles it well and it hurt to say that. So no NOTICEABLE load.

Of course you could always schedule your deduping task for off peak hours if it is causing performance issues.

The only other deduping I have got to use were for 'Greenbytes' storage devies. These had a backend powered by BSD and used a ZFS filesystem. Definitley more enterprise class with snapshot support.

Will definitely take a peek at SolidFire...
Logged

Offline digi

  • elite af tbh
  • * Exquisite Elder
  • Posts: 2789
  • keyboard game on fleek
Re: Server 2012 - Dedup Feature/Storage Savings
« Reply #5 on: Tue, 17 December 2013, 11:35:48 »
Curious which file types you have in that folder, your de-dupe ratio is ridiculously high.
Logged

Offline swill

  • * Elevated Elder
  • Posts: 3365
  • Location: Canada eh
  • builder & enabler
    • swillkb.com
Re: Server 2012 - Dedup Feature/Storage Savings
« Reply #6 on: Tue, 17 December 2013, 11:39:46 »
Quote from: digi on Tue, 17 December 2013, 11:35:48
Curious which file types you have in that folder, your de-dupe ratio is ridiculously high.

Its backups, so two backups with be about 95% the same...  Dedup on backups is probably the best use case for it.  You get great dedupe ratios because most of the backup data is the same between backups.
Logged

Offline swill

  • * Elevated Elder
  • Posts: 3365
  • Location: Canada eh
  • builder & enabler
    • swillkb.com
Re: Server 2012 - Dedup Feature/Storage Savings
« Reply #7 on: Tue, 17 December 2013, 11:43:22 »
Quote from: osi on Tue, 17 December 2013, 11:32:59
On this particular server, it's just a backup destination dump so the CPU use isn't a big deal.

Also have dedup turned on and active for an accounting server. So far, there have been no issues with CPU time/utilization that would effect business. Windows actually handles it well and it hurt to say that. So no NOTICEABLE load.

Of course you could always schedule your deduping task for off peak hours if it is causing performance issues.

The only other deduping I have got to use were for 'Greenbytes' storage devies. These had a backend powered by BSD and used a ZFS filesystem. Definitley more enterprise class with snapshot support.

Will definitely take a peek at SolidFire...

Ya, I wouldn't try to dedup a webserver, but backup servers can see a real benefit from dedup.  Especially because they usually have very little to no load, so the extra resource usage is not an issue at all.

SolidFire is not a system for backups really.  They use all SSD drives and they are not cheap.  What is very cool about them is that they do dedup natively as well as many other cool things like guaranteed IOPS per mounted volume which is a real problem with shared infra.  They have a VERY different approach, but it is pretty cool.  But not cheap...  Haha...
Logged

Offline osi

  • Thread Starter
  • Posts: 964
Re: Server 2012 - Dedup Feature/Storage Savings
« Reply #8 on: Tue, 17 December 2013, 11:49:01 »
blank
« Last Edit: Fri, 28 February 2014, 07:10:23 by osi »
Logged

Offline rowdy

  • HHKB Hapster
  • * Erudite Elder
  • Posts: 21175
  • Location: melbourne.vic.au
  • Missed another sale.
Re: Server 2012 - Dedup Feature/Storage Savings
« Reply #9 on: Tue, 17 December 2013, 15:38:49 »
Wish I could store my media files with "compression" like that.
Logged
"Because keyboards are accessories to PC makers, they focus on minimizing the manufacturing costs. But that’s incorrect. It’s in HHKB’s slogan, but when America’s cowboys were in the middle of a trip and their horse died, they would leave the horse there. But even if they were in the middle of a desert, they would take their saddle with them. The horse was a consumable good, but the saddle was an interface that their bodies had gotten used to. In the same vein, PCs are consumable goods, while keyboards are important interfaces." - Eiiti Wada

NEC APC-H4100E | Ducky DK9008 Shine MX blue LED red | Ducky DK9008 Shine MX blue LED green | Link 900243-08 | CM QFR MX black | KeyCool 87 white MX reds | HHKB 2 Pro | Model M 02-Mar-1993 | Model M 29-Nov-1995 | CM Trigger (broken) | CM QFS MX green | Ducky DK9087 Shine 3 TKL Yellow Edition MX black | Lexmark SSK 21-Apr-1994 | IBM SSK 13-Oct-1987 | CODE TKL MX clear | Model M 122 01-Jun-1988

Ị̸͚̯̲́ͤ̃͑̇̑ͯ̊̂͟ͅs̞͚̩͉̝̪̲͗͊ͪ̽̚̚ ̭̦͖͕̑́͌ͬͩ͟t̷̻͔̙̑͟h̹̠̼͋ͤ͋i̤̜̣̦̱̫͈͔̞ͭ͑ͥ̌̔s̬͔͎̍̈ͥͫ̐̾ͣ̔̇͘ͅ ̩̘̼͆̐̕e̞̰͓̲̺̎͐̏ͬ̓̅̾͠͝ͅv̶̰͕̱̞̥̍ͣ̄̕e͕͙͖̬̜͓͎̤̊ͭ͐͝ṇ̰͎̱̤̟̭ͫ͌̌͢͠ͅ ̳̥̦ͮ̐ͤ̎̊ͣ͡͡n̤̜̙̺̪̒͜e̶̻̦̿ͮ̂̀c̝̘̝͖̠̖͐ͨͪ̈̐͌ͩ̀e̷̥͇̋ͦs̢̡̤ͤͤͯ͜s͈̠̉̑͘a̱͕̗͖̳̥̺ͬͦͧ͆̌̑͡r̶̟̖̈͘ỷ̮̦̩͙͔ͫ̾ͬ̔ͬͮ̌?̵̘͇͔͙ͥͪ͞ͅ

Offline IvanIvanovich

  • Mr. Silk Underwear
  • Posts: 8199
  • Location: USA
Re: Server 2012 - Dedup Feature/Storage Savings
« Reply #10 on: Tue, 17 December 2013, 19:30:49 »
Well... if you put 47 copies of your favorite Rick Astley tracks in random subfolders and set that to dedup you certainly could. I can see how super amazing this is for enterprise, since moronic people seem to feel a need to copy spreadsheet X to their own user folder so they can have their own independent out of sync useless copy of it instead of using the group share copy they are supposed to  :rolleyes:
Logged
Pages:  [1]     Go Up
« previous next »