Exchange Storage Is Not So Neat and Tidy
About a year ago, I was in charge of migrating an Exchange 2000 server to Domino (RHEL). We did an migration in which the original Exchange server was converted into the Domino server, so I had the unique experience of using the exact hardware for the Domino server that had originally hosted the Exchange server—same accounts, same databases.
I probably should have taken better notes, but anyone who's done a mail migration will tell you that you want to stay in the transition window for as short of a time as possible. Two things surprised me: (1) the CPU utilization was dramatically lower for the Domino server, and (2) the data storage was a little bit smaller.
The Lower CPU usage I can explain in terms of the code rewrite for Domino 7, but using less disk space was completely unexpected. After all, I have always heard that the single-store architecture of Exchange provided the benefit of reducing disk resources (and, Domino has a single-store option as well for the same reasons). Since that migration, I've been more aware of Exchange's unique disk characteristics. This month, Storage magazine has published an article on Exchange and archiving and it raised my eyebrows when I learned that archiving doesn't do as much as I thought to recover any diskspace. On paper, "yes," in reality, "no."
Tim Tiches, director of product management for CA's Message Manager (formerly iLumin Assentor), concurs. "We will stub messages to reduce the footprint, in theory, on the Exchange server," says Tiches, "but the actual space isn't recovered until it's compacted. . . . Those newly vacated areas of the database are referred to as "white space" and may be filled with new messages. "It can get overwritten if everything's lined up perfectly," says Werelius, "but if you talk to companies that really run Exchange--whether it's 5.5 or 2003--they'll tell you, 'No, my database still grows.'"
For a Domino administrator, the above quote may seem odd, because we simply run the compactor task to recover the data released from archiving. Doesn't Exchange have a compact task? Yes and no. For Exchange, the mail service has to be taken off-line for compaction:
Besides shutting down mail service, bringing down Exchange to compact the database is an uncertain proposition because an admin won't know exactly how long it will take. "You can't really predict," says Devine, Millimet & Branch's DuBois. "You can only guess-timate."
Perhaps Exchange 2007 will fix the compact issue, but Microsoft hasn't committed to any further feature changes for the upcoming release. Troy Werelious, CEO of Lucid8, a provider of Exchange utilities, says he isn't “isn't as optimistic about Microsoft's efforts because he thinks those improvements are linked to Microsoft replacing the Jet database at the heart of Exchange's mail store. "Microsoft's most recent statement is that their goal is to be off of it by 2012," notes Werelius.
Ouch.
- 


Comments
Also in the article: Tim Tiches says that re-use of whitespace is not happening in reality. So it'll just grow and grow...
Posted by Lars Berntrop-Bos At 05:07:40 PM On 08/18/2006 | - Website - |
It's true that Exchange requires the database to be offlined to compact it. However, in most organizations it's not necessary to do this. If your store takes up (say) 10GB, and you have 2GB of white space, if you compact it the store will then take up 8GB. However, as your users' mailboxes grow, your store will consume additional space on disk. If you've compacted, Exchange will ask the OS to allocate more space; if you haven't compacted, Exchange will reuse previously allocated pages from the white space.
Posted by Paul Robichaux At 09:23:17 AM On 08/16/2006 | - Website - |
Sean---
Posted by Sean Burgess At 07:13:19 AM On 08/16/2006 | - Website - |
Regarding the Exchange vs. Domino, I'm not really intending to start up a test-bed flame for evaluating disk storage usage. I thought it was odd to find leaner disk requirements, when I did the migration using the same hardware. I've done other migrations, but never onto the original hardware. I'm sure everyone's mileage will vary.
But, to think that the Exchange messaging system is taken off-line for compacting? I find that completely absurd.
Posted by jack dausman At 04:05:37 AM On 08/16/2006 | - Website - |
We had a lot of post-offices for only 1200 users mostly because they had been migrated from the old IBM PCNet that would only support 64 users (if my memory is accurate) on any one network and cc:Mail was the main method of data exchange between offices I used to lobby to migrate the users to fewer post-offices so that there would be less chance of failure. My boss in those days told me “I like my job and want to keep it. These users are getting very dependant on email and when the post-office fails they start complaining, so make sure you never have enough users in any one database to get me fired when it fails.” Moving to Notes where every mail file was a separate database was a wonderful improvement and allowed mail to be consolidated onto only a couple of servers.
While data reliability has greatly improved over the years (I'm pretty sure my current mail file is larger than any one of those old post-office databases) utilizing individual mail files for each user just makes good sense. (and just might be good for your career) If everything else was equal (and of course it's not), I'd choose Notes/Domino over Exchange for this one reason alone. It’s no surprise that Exchange uses more data storage, but I’d still stick with Domino even if it required twice as much.
Posted by Kit Davis At 03:09:07 AM On 08/16/2006 | - Website - |