The Notebook Review forums were hosted by TechTarget, who shut down them down on January 31, 2022. This static read-only archive was pulled by NBR forum users between January 20 and January 31, 2022, in an effort to make sure that the valuable technical information that had been posted on the forums is preserved. For current discussions, many NBR forum users moved over to NotebookTalk.net after the shutdown.
Problems? See this thread at archive.org.

    DiskZIP Review - Finished!

    Discussion in 'Windows OS and Software' started by msintle, Apr 11, 2018.

  1. msintle

    msintle Notebook Consultant

    Reputations:
    15
    Messages:
    181
    Likes Received:
    62
    Trophy Points:
    41
    Topics I shall cover in this review:

    Describe the product's purpose/background as desired
    How to get it (download, etc)
    Installation/setup
    In use/impressions
    Competing product discussion
    Benchmarks as applicable
    Bulleted Pros/cons (if desired)

    1. What is DiskZIP?

    A lot of old timers on this forum are already familiar with the DiskZIP concept. DiskZIP is similar to the on-the-fly, transparent disk compression tools found in the late 80's-early 90's. Examples of such old-time products include:

    Stac's Stacker
    stacker-for-OS2-front.jpg
    Microsoft's DriveSpace/DoubleSpace
    AddStor's SuperStor

    All of the above methods stored your data inside a single "compressed disk file" on your disk. This file would be similar to a really large ZIP archive, with the crucial difference that it was "mounted" by a driver so to the operating system (DOS, Windows, and even OS/2) would perceive it as an actual disk.

    Stacker discontinued its product after Windows 95, and the other products similarly vanished with the exception of Microsoft, which continued to include disk compression in its Windows 9X line, but replaced it with NTFS compression in its Windows NT line. NTFS compression implemented a much weaker form of disk compression, and it never actually created a "compressed disk file". Instead, each file was compressed on a per-file basis. NTFS compression is still available in Windows 10, but decades after the likes of Stacker, its compression is terrible - both from a space savings perspective and a performance perspective. Therefore, it is safe to say that, with the death of Windows 9X and its integrated DriveSpace compression, there has not been a reasonable disk compression alternative available for Windows - until DiskZIP.

    DiskZIP, which appears to be about two years old and counting (based on the domain age), is the first strong compression, compressed-disk-file based alternative for Windows NT based operating systems. Just to clarify, all modern versions of Windows (10, 8.1, 7, Vista, XP, 2000, etc.) are based on Windows NT technology.

    As some of you may already be familiar from this forum, I am an avid user of DiskZIP! I have been looking high and low for years for a product which could do something we had from as long back as three decades ago. Let's face it - we all run out of space eventually. And we may be running remote server hardware (which we cannot upgrade at reasonable cost), or using a fixed-storage, non-upgradeable tablet (such as the Surface tablet I am typing this on), or have just run out of space, with no easy file deletion targets in sight. I've been in all three situations, which is how I found out about DiskZIP.

    DiskZIP claims to do the following:

    - Increase free disk space without deleting anything
    - Improve disk read performance and not harm disk write performance
    - Automatically recover free space from duplicate files without deleting or hard-linking them
    - Protect from malware using the last compressed state of the system as a reference
    - Apply your compressed disk image to another computer, effectively cloning your PC

    In addition to the above, DiskZIP also includes a full featured file compression stack, giving products like WinZip/WinRAR a run for their money. This stack is based on the open source 7-Zip, with the following additions:

    - Archives of 100+ types shown as folders in Windows File Explorer, with a much faster and more advanced implementation than Windows's own criticized ZIP Folders feature (do not confuse this with transparent disk compression, it is not related)
    - WinZip compatible ZIPX compression including JPEG compression
    - Outlook Add-Ins for attachment compression and secure attachment previews

    Since that is a review in itself, I will be skipping the file compression related parts entirely, and focus on what is really unique about DiskZIP - the transparent disk compression.

    Many of the old timers I alluded to at the start of this section have had strongly negative experiences with transparent disk compression in the 90s. For as long as I have been using the product (almost two years now), I have not had any issues with data loss or corruption.

    This product is truly a hidden gem, which motives me to write this review.
     
    Last edited: Apr 11, 2018
    Maleko48 and Vasudev like this.
  2. msintle

    msintle Notebook Consultant

    Reputations:
    15
    Messages:
    181
    Likes Received:
    62
    Trophy Points:
    41
    2. Setting Up DiskZIP

    The first thing to do is download and install the software. Head on over to their website at www.diskzip.com. The site attempts to be clever but is a bit counter-intuitive in my opinion, as it is not immediately obvious that you need to scroll down for content and downloads. The animations which happen while you are scrolling down do add a nice touch though.

    Basically, scroll down until you see the download link, and click it. Entering your email address before downloading is optional. If you do this, you will get news of new version announcements, promotions, bug fixes, software enhancements, and the works. I was subscribed for a while and then I removed myself during a mailing. However, I later subscribed again because the site does not contain any version announcements/history, and the only way of receiving new version notifications seems to be by email. This is once place where DiskZIP definitely need to improve their website.

    The installer is a breeze though. There is a single file which supports both 32 bit and 64 bit operating systems, so you don't need to guess which file you need. Part of my day job is to test software on various operating systems, and I cannot help but notice how shiny the installer looks running on Windows Vista:
    Untitled.png
    If you don't want the file compression feature, feel free to deselect it while installing - so you'll just be getting the juiciest bits of the software. I myself have grown fond of the archives-as-folders feature, so I keep it on. Other than this feature screen, the entire installation is basically a breeze with next-next-nexts all the way through. All of the disk compression related features are automatically configured based on your Windows version, so there's no guesswork on your part.

    System Requirements:

    This does mean that, for example, on Windows Vista, while you get the slickest installer look, you won't be getting DiskZIP's best disk compression features. In fact, only Windows 8.1.1 and newer users have access to the best DiskZIP has to offer with disk compression, and this could be considered a negative.

    Minimum OS: Windows XP
    Minimum OS for Advanced Disk Compression Features: Windows 8.1.1 or Newer
    My Recommended OS: 64-bit Windows 8.1.1 or Newer

    The following are the actual disk compression programs included with DiskZIP:

    DiskZIP Online:
    NTFS compression + Windows 10 compression (where available) + proprietary extensions
    Always installed
    Runs on all operating systems
    Compresses all types of disks, including boot, non-boot, and external disks

    DiskZIP Offline:
    Best DiskZIP compression, appears to be a proprietary technology built on top of WIMBoot
    Installed on Windows 8.1.1 or later
    Runs only on Windows 8.1.1 or later
    32 bit and 64 bit supported
    Compresses boot disks only, external drives are not supported

    DiskZIP Max:
    DiskZIP shell for Microsoft data deduplication, appears to be a GUI wrapper only
    Installed on Windows 8.1.1 or later
    Runs only on Windows 8.1.1 or later
    Requires a 64 bit operating system
    Requires manual installation of Microsoft data deduplication drivers
    Compresses non-boot disks only, external drives are not supported

    The good news is you don't have to worry about what to install and what may not work. The installer, to its credit, handles all of this automatically.

    The bad news is, for DiskZIP Max, the installer cannot do the job cleanly. Unless you are installing on a server operating system, or you have pre-installed Microsoft data deduplication drivers yourself on your Windows 10 workstation OS (some hacked libraries are available, sourced from Server 2016), DiskZIP Max directs you to a third party website for installing these data deduplication drivers:

    www.orontesprojects.com/?page_id=371

    The software you download from this recommended "partner" site completes the job of installing data deduplication drivers on your system:

    dedup.png

    The above is a screenshot of this installer. It looks a little confusing in my opinion and does not employ the design ethos of the DiskZIP product at all. It would appear Orontes Projects are only loosely associated with DiskZIP.

    It is also possible to install data deduplication drivers from the command line, yourself, manually, if you'd rather not run an opaque EXE from a mostly unknown entity. Simply visit:

    http://www.slr-corp.fr/2017/04/windows-10-all-builds-enabling-deduplication/

    Just look for Dedup_16299_DSIM.zip on this page. It adds deduplication drivers for the latest version of Windows 10, Fall Creators Update. Download this ZIP file, and run the included batch file as an administrator - and you're good as gold with data deduplication on your PC.

    My final verdict on the installation is that it is perfect, except for this data deduplication driver mess. It is because of this reason that I will not be covering DiskZIP Max in this review. I don't believe customers should be jumping through hoops during any software installation like this on a consumer oriented, mass market OS like Windows. To be fair, it would be illegal for DiskZIP to bundle these official Microsoft drivers with their software, which is why I am not penalizing their installer for that exclusion. But this does mean I will be focusing on DiskZIP Online and DiskZIP Offline only, which is where DiskZIP adds value anyways - DiskZIP Max, despite the "maximum" in its name, is nothing more than a fancy shell for what you can do yourself with the data deduplication drivers above and some PowerShell scripts.

    3. In Use - DiskZIP Online

    We're finally here! Having installed DiskZIP from their website, we're ready to compress our disk. First, we take a look at DiskZIP Online, which is a lot less fear inducing than DiskZIP Offline, because it runs "online", meaning while Windows (and all your apps) are up and running.

    Of course, this means any files in-use by the system cannot be compressed.

    This also means that none of the advanced capabilities of DiskZIP Offline will be available (such as built-in data deduplication - yes, even DiskZIP Offline does a form of data deduplication, eliminating space taken up by duplicate files without deleting them or creating hard-links).

    Still, this is a great place to start building confidence using DiskZIP. DiskZIP Online implements per-file compression, and does not do the per-disk compression that DiskZIP Offline does. In other words, it compresses files individually on disk, and does not put them all together in a single compressed disk image file. In this sense, DiskZIP Online is closest to what most of us already know as being traditional NTFS file system compression.

    Start out by opening up your Start Menu, and manually launch DiskZIP Online by typing "diskzip online":

    dzo.PNG

    Choose the DiskZIP Online icon, which launches the DiskZIP Online window:

    win.png

    This window is deceptively simple, and I love that about the DiskZIP design ethos. There's really no reason it should be more complex:

    1. First, click the drive to compress. You can choose any drive, including removable drives such as USB flash memory.

    2. Next, click "Compress" to compress your selected drive. Yes, it's that easy!

    DiskZIP Online will compress your disk with recommended defaults immediately when you click "Compress". However, if you are the curious type (like I am), I suppose you will click "Options" at least once before beginning compression. Let's take a look at what's available:

    options.png

    Compression Cores: This field is automatically adjusted by DiskZIP Online based on your detected hardware. If you have an SSD, your compression speed will be limited by only your available CPU cores. If you have an HDD, your compression speed will be limited by the hard disk, so DiskZIP will not attempt to use all of your CPU cores, as this would slow the process down instead of speeding it up, since spinning platter hard drives cannot access multiple areas of disk all at once, unlike flash memory.

    Exclude Extensions: I don't know where to find the Server Edition of DiskZIP. Presumably, this area allows you to exclude certain file types from processing with DiskZIP Online.

    Compression Type: If you're running on Windows 10, this field let's you change the type of compression being used:

    menu.png

    One nice touch is that DiskZIP Online automatically increases or decreases the number of threads you will be using during compression. Probably the notion of cores here is a bit of a misnomer, since the CPU maxes itself out during higher compression grades easily, even when you have selected a small number of threads. For example, on my 4 core Surface Pro 2017 tablet that is the subject of these examples, DiskZIP Online suggests using only 2 threads when compressing the disk using the most aggressive LZX algorithm - this means that a single LZX worker thread has enough load to keep 2 CPU cores busy while processing:

    maxstrength.png
     
    Last edited by a moderator: Apr 19, 2018
    Maleko48 and Vasudev like this.
  3. Vistar Shook

    Vistar Shook Notebook Deity

    Reputations:
    2,761
    Messages:
    1,256
    Likes Received:
    1,362
    Trophy Points:
    181
    How much?

    Enviado de meu Pixel 2 usando Tapatalk
     
    msintle likes this.
  4. msintle

    msintle Notebook Consultant

    Reputations:
    15
    Messages:
    181
    Likes Received:
    62
    Trophy Points:
    41
    Excellent question. I should probably integrate this into the main review roadmap at some point.

    The current list price is not advertised on their site, which appears to be another oversight (maybe intentional, to not distract from their main message).

    The installer contains a purchase link:

    www.diskzip.com/buy.php - $99

    The software in trial mode contains a different link, but same price:

    www.diskzip.com/buy.aspx - $99

    So their list price is $100, more than triple that of WinZip/WinRAR, which may be hard to justify despite their exponentially larger feature set.


    However they have cleverly hidden some "achievements" in the product. These reduce the cost substantially. Here are the "achievements" which I have managed to unlock so far:

    1) Use DiskZIP Online in trial mode - 30% discount - $69.30
    Instructions: Launch DiskZIP Online directly using your Start Menu. Start compressing your disk with DiskZIP Online. Once you have created 1 GB of free disk space, the trial will prevent further compression; but you will be shown the coupon code. You can also "game" the system by restarting DiskZIP Online each time you are booted out, and creating a new free 1 GB block each time.

    2) Use DiskZIP Offline with maximum compression - 50% discount - $49.50
    Instructions: Launch DiskZIP Offline directly using your Start Menu. Choose the MaxSpace compression setting and click Compress. The trial does not allow compression at this setting, but it will show you the coupon code.

    3) Use DiskZIP Offline to recompress a disk - 70% discount. - $29.70
    Instructions: Launch DiskZIP Offline directly using your Start Menu. Choose the MaxSpeed compression setting and click Compress. Follow the on-screen instructions to complete the compression process "offline". When you have rebooted back into Windows, Launch DiskZIP Offline again through the Start Menu. Choose the MaxSpeed compression setting, and click Recompress. The trial does not allow you to recompress your disk, but it will show you the coupon code.

    If the above instructions are against the rules or DiskZIP has an issue with it, just drop me a note and I'll take them out!

    Clearly the product is overpriced at list, and the achievements mechanism is designed to lure you in to trying the product in exchange for revealing its true price. At $30, its a bargain, at least compared to the likes of WinZip/WinRAR. Considering how much extra space you may create on the biggest SSDs which run in the thousands (say Samsung 860 EVO 4 TB, $1,872.95 on Newegg), it would easily pay for itself many times over.
     
    Maleko48 likes this.
  5. TreeTops Ranch

    TreeTops Ranch Notebook Deity

    Reputations:
    330
    Messages:
    904
    Likes Received:
    124
    Trophy Points:
    56
    "Many of the old timers I alluded to at the start of this section have had strongly negative experiences with transparent disk compression in the 90s."

    I'm one of those so I don't do disk compression anymore. But appreciate your review non the less and I don't want to be critical of your effort.
     
  6. msintle

    msintle Notebook Consultant

    Reputations:
    15
    Messages:
    181
    Likes Received:
    62
    Trophy Points:
    41
    Thank you for your support! I am trying to do a good job here.

    I am barely getting started with the review, hoping to finish the installer section later today.
     
  7. Maleko48

    Maleko48 Notebook Deity

    Reputations:
    207
    Messages:
    711
    Likes Received:
    529
    Trophy Points:
    106
    Can you share any quantified results proving there is no or very minimal performance losses? Like disk speed/test results with and without the DiskZIP software?
     
    Last edited: Apr 12, 2018
    msintle and Vistar Shook like this.
  8. msintle

    msintle Notebook Consultant

    Reputations:
    15
    Messages:
    181
    Likes Received:
    62
    Trophy Points:
    41
    Here are official DiskZIP results on an SSD:

    ssd.jpg

    And here are official DiskZIP results on an HDD:

    hdd.jpg

    All of the results apply only to compression performed with DiskZIP Offline.

    As you can see, these results illustrate that effects vary by compression type, and the underlying type of hardware
     
    Maleko48 likes this.
  9. Maleko48

    Maleko48 Notebook Deity

    Reputations:
    207
    Messages:
    711
    Likes Received:
    529
    Trophy Points:
    106
    Thank you for that info. And the other half of the equation is roughly what percentage % of disk space does this actually conserve?

    Like say you got a 512GB SSD that's half full uncompressed for example.

    One reason I really like the idea of this utility is because it would actually put our often-under-utilized CPUs to better use for everyday computing. I hate spending the money on nice hardware and rarely using it beyond 10% of it's abilities, lol.

    On the flip side, I bet all the extra processing full time on a laptop would knock down battery life figures.
     
    msintle likes this.
  10. Maleko48

    Maleko48 Notebook Deity

    Reputations:
    207
    Messages:
    711
    Likes Received:
    529
    Trophy Points:
    106
    Oh and I just thought of a couple more questions:


    How hard is this to reverse or uninstall if you have issues?

    Does it require partition imaging or restructuring at all during install/uninstall?

    Or does it just operate at the O/S level on top of whatever your existing partition layout/scheme is?
     
    alexhawker and msintle like this.
  11. msintle

    msintle Notebook Consultant

    Reputations:
    15
    Messages:
    181
    Likes Received:
    62
    Trophy Points:
    41
    Thank you for your support.

    Some battery benchmarks would be interesting, indeed!

    Your actual compression savings will depend on the data you have installed on your PC. To give you an idea, the core OS files create at least 5 GB free disk space on the MaxSpace setting, less with MaxSpeed. The games in the benchmarks above also must have compressed appreciably, resulting in the performance boosts (otherwise, there couldn't have been any acceleration effect). I would say, bet on a 1.5:1 compression ratio (so if you you have 256 GB free disk space, after compression, bet on having 128 GB more free space, for a total of 384 GB free disk space).

    You make an excellent point regarding CPU utilization - I hadn't thought of it this way, but in a sense, DiskZIP consumes your unused CPU cycles to accelerate your disk performance, and hence your PC overall. That's a very nice way of putting it - thank you!
     
    Last edited: Apr 13, 2018
    Maleko48 likes this.
  12. msintle

    msintle Notebook Consultant

    Reputations:
    15
    Messages:
    181
    Likes Received:
    62
    Trophy Points:
    41
    All of this is still coming in the review, but to quickly address your questions:

    You can reverse if you have an external drive to use as temporary storage while decompressing (or, an internal partition with enough free space while decompressing). This completely decompresses your existing disk. As I will also cover in the review, you can also apply any existing compressed disk image in either compressed or uncompressed mode, to any target PC - which is extremely convenient for cloning/imaging purposes.

    I have also seen that you can uninstall the DiskZIP software itself from a compressed disk, the software uninstaller doesn't stop you from doing so, and Windows will work just fine after the uninstallation. Of course, once you've uninstalled, you will not be able to maintain or recompress your disk at all - all coming in the main review.

    No repartitioning is required at all. The software works on a per-partition basis, processing whatever partition you choose.

    You may even size partitions after processing (I have done this many times to create a new partition with the free space for use with virtual machines exclusively, which are ideally compressed with DiskZIP Max at dream ratios of 3.1:1, which I decline to cover in this review due to DiskZIP's installer limitations as I discussed above).

    SIDEBAR: If you are going to shrink an existing partition, and Windows offers you extremely little shrink room (say a couple of gigs only, when you actually have tens or hundreds of gigs free space on the partition to shrink), run the following commands in a console:

    defrag c: /d /v /u /h -> performs traditional defrag, even on an SSD.

    defrag c: /x /v /u /h -> performs free disk space consolidation, even on an SSD.

    Why would you ever want to run these commands, even on an SSD? This is because to shrink your partition using the built-in Windows tools, free disk space needs to be contiguous at the end of the partition, or you won't be able to shrink your partition at all. Otherwise, you should of course *not* run a traditional defrag on your SSD at all. If you are using third-party tools to shrink an existing partition, the limitation/workaround above may or may not apply to you.
     
    Last edited: Apr 13, 2018
    alexhawker and Maleko48 like this.
  13. Maleko48

    Maleko48 Notebook Deity

    Reputations:
    207
    Messages:
    711
    Likes Received:
    529
    Trophy Points:
    106
    Excellent work. Thank you again.

    And as to your final statement above, I think it's similar to how 10-20 years ago GPUs were strictly for games and were otherwise a waste of hardware that was going unutilized unless you were actually gaming.

    To change that, first they incorporated GPU acceleration at the O/S level to take some strain off the CPU and make better use of that 'wasted' hardware.

    Then they integrated an adequately capable GPU onto the same CPU package and we got integrated graphics so everything just 'worked' automatically for the average Joe.

    Whereas now, we are finally taking advantage of our GPUs for more than just graphics, but now also specialized data processing, VR, statistics, neural networks, and hopefully more cool **** in the future.

    My point being, anything that improves a users experience and makes better average use of their hardware with no or minimal downsides, really only increases the value a user gets out of their machine.
     
    msintle likes this.
  14. msintle

    msintle Notebook Consultant

    Reputations:
    15
    Messages:
    181
    Likes Received:
    62
    Trophy Points:
    41
    You're very welcome!

    I realize the review has been taking a while, but I want to do a good job and not rush through anything at all.

    That's a perfect analogy you make with respect to GPUs.

    And I completely agree with this point you made:

    My point being, anything that improves a users experience and makes better average use of their hardware with no or minimal downsides, really only increases the value a user gets out of their machine.
     
    Maleko48 likes this.
  15. Maleko48

    Maleko48 Notebook Deity

    Reputations:
    207
    Messages:
    711
    Likes Received:
    529
    Trophy Points:
    106
    All solid info here. Now you really caught my interest with regards to saving space with VMs. I actually have a triple boot system myself right now. Win7/Win10/Ubuntu along with a Mac VM living in my Win10 disk.
     
    Last edited: Apr 13, 2018
    msintle likes this.
  16. msintle

    msintle Notebook Consultant

    Reputations:
    15
    Messages:
    181
    Likes Received:
    62
    Trophy Points:
    41
    VM's compress extremely well with DiskZIP Max, but it is not something DiskZIP can take credit for, in my opinion. Their DiskZIP Max software is just a GUI around Microsoft data deduplication drivers, as betrayed by their convoluted installation routine. I certainly use DiskZIP Max because I like the GUI and the information it displays, instead of messing around with PowerShell commandlets. However, there's no real value-add there on behalf of DiskZIP.

    You can just compress your VM partition after installing data deduplication drivers on your Windows 10 workstation OS as I described earlier on this thread, with or without DiskZIP. Data deduplication will not improve performance (I believe, to the contrary, it may hurt performance noticeably). However, it will compress data incredibly well for virtual machines, and it lets you use a virtual machine in a compressed state, which is nothing short of excellent.

    DiskZIP Offline actually exceeds the compression ratios possible with DiskZIP Max (bad naming there DiskZIP!), but if you were to compress your virtual machines with DiskZIP Offline, they would be decompressed the first time you make a write inside a virtual machine. This naturally introduces a huge first-use delay for absolutely no benefit, space or time wise.

    Another thing you could try would be to compress your virtual machines with NTFS compression (with or without DiskZIP Online), which retains the VMs in a compressed state like data deduplication. However, NTFS compression is extremely poor from both a time and a space perspective, so there's no justification to using it for compressing VMs if data deduplication is available. If data deduplication is unavailable, then NTFS may be a viable option to compress VMs and keep using them in a compressed state, of course.
     
    Maleko48 likes this.
  17. Maleko48

    Maleko48 Notebook Deity

    Reputations:
    207
    Messages:
    711
    Likes Received:
    529
    Trophy Points:
    106
    At this point the thing I am most unclear on are the deduplication drivers. Maybe this will make more sense in the morning when I read it again after some sleep...

    Right now I'm under the impression these deduplication drivers are essentially a driver-level compression algorithm that handles everything at a lower level than say, a service would?

    I think it's their naming convention compared to how I am interpreting and understanding your explanation of them that is confusing me.

    That and I also haven't really looked into what exactly they are on my own yet because I'm using my cell phone right now and it's annoying trying to do a bunch of multitasking and typing, lol.
     
    msintle likes this.
  18. msintle

    msintle Notebook Consultant

    Reputations:
    15
    Messages:
    181
    Likes Received:
    62
    Trophy Points:
    41
    Sorry for the confusion! Any faults with the explanations are fully mine. Let me try again:

    The data deduplication drivers are provided by Microsoft on Windows Server operating systems only. The links I provided are hacks by third parties (be it the DiskZIP partner Orontes, or the unaffiliated second link). They essentially lift the drivers out of a Windows Server installation, and inject them into a Windows 10 (Workstation) installation. Microsoft does not normally allow this, otherwise we'd already be having data deduplication support in Windows 10 out-of-the-box.

    That is why I will not be covering them (or the associated DiskZIP Max software) in this review. I am not sure about the legality of using such components lifted from a Server SKU on a Workstation SKU. I am sure DiskZIP aren't sure about it either, and this is why they aren't installing these drivers with their own setup. Otherwise, I'm sure their setup, which is sophisticated enough to do many things automatically for us already, would be installing dedup drivers for us as well.

    Please stay tuned for the main part of my review where I will be covering the actual software built by DiskZIP - DiskZIP Online and DiskZIP Offline. That is where they add real value, both in terms of acceleration and space.
     
    Maleko48 likes this.
  19. msintle

    msintle Notebook Consultant

    Reputations:
    15
    Messages:
    181
    Likes Received:
    62
    Trophy Points:
    41
    3. In Use - DiskZIP Online (Continued)

    Conversely, it can handle a whole lot more threads at lesser compression grades, such as LZNT1 - which appears to be just another name for good 'ole NTFS compression. In fact, DiskZIP Online suggests to spawn double the number of threads as the actual available CPU cores when doing NTFS compression. This makes sense, given that NTFS compression was invented in the early 90s when CPU's were thousands of times less powerful and single-core only:

    maxspeed.png

    Did I mention NTFS compression remains unchanged to this day? This is also the only compression grade you will be able to enjoy if you're running any operating system earlier than Windows 10. Fortunately, Microsoft finally added some new algorithms with Windows 10, as exposed by DiskZIP Online.

    You may have also noticed that, in addition to the CPU thread count slider, the check-boxes below change as well, based on the type of the compression algorithm you choose.

    Don't compress root: This one can be tricky to make sense of. When SSDs first came out, before TRIM was available at the operating system level, some manufacturer SSD applications wrote specific byte-patterns to disk to tell the disk controller that it was supposed to TRIM those areas.

    SIDEBAR: TRIM on an SSD does a kind of garbage collection, sort of like a defragmentation operation specific for SSDs only.

    Now, NTFS compression automatically compresses data on a per-file basis as it is being written to disk. Therefore, enabling NTFS compression on special TRIM byte patterns can totally change the original byte pattern and disrupt the TRIM process. This "don't compress root" option must be a heuristic attempt to prevent that, in case the special TRIM pattern is being recorded on a file at the root of the disk being TRIMmed. Presumably, DiskZIP have already talked to SSD manufacturers, and know TRIM byte pattern files are not stored anywhere else other than the root of a disk?

    DiskZIP Online enables this option only when you select NTFS compression as your desired algorithm. It does not need to enable this option for the other algorithms at all, because they cannot automatically compress new files as they are being written to at all. That is only the exclusive purview of NTFS compression. Otherwise, of course, this would have been potentially problematic for the other algorithms as well.

    This issue does highlight a problem with the new compression algorithms: That they cannot do in-place recompression unlike the decades old NTFS compression. So while Microsoft did finally give us new compression algorithms after more than two decades of waiting, they did not make these algorithms very sustainable, at least not without third party tooling like DiskZIP.

    Don't compress new files in folders: This one is straightforward enough. With NTFS compression, it is possible to mark a folder itself compressed, although NTFS compression happens on a per-file basis. When a folder is marked compressed, any new (or existing) files in that folder will be automatically compressed upon write. While this sounds great, its actually sort of a performance killer, because NTFS compression is very slow and inefficient. So DiskZIP Online leaves this option turned off by default.

    Again, the other algorithms do not enjoy the possibility of automatic compression upon write at all. Any file that is written to gets automatically decompressed upon first write. You also cannot mark a folder to compress automatically using any of the other algorithms - only NTFS compression.

    Clear archive attribute on incompressible files/Compress files only if archive attribute is set: Some files may be pre-compressed, encrypted, or may just be incompressible for any number of reasons. It is also theoretically possible (although extremely rare) that when you compress a file, it grows larger instead, due to a quirk of the compression algorithm. This option helps you tackle such files.

    When you compress your disk for the first time with DiskZIP Online, if this option is enabled, it will use the archive attribute to mark incompressible files. It will do this by clearing the archive attribute. Why is this helpful? This is because the operating system will automatically set the archive attribute on the file when it is modified, alerting DiskZIP Online to the fact that the file may now be compressible.

    So the next time you compress your disk with DiskZIP Online, it will save you a lot of time over the first pass. It will know to skip each file with the archive attribute cleared, as these are files known to be impregnable to the compression algorithm you have chosen.

    Of course, if you change your compression algorithm, you may want to disable this option - as files which were impregnable to a previous compression algorithm may be susceptible to a new one. There's only one way to find out!

    If you're confused about which options to use, just click the Reset button.

    If you're unsure about which algorithm to pick, here's my suggestions:

    1) Stay away from NTFS (LZNT1) if its not the only one available.
    2) If you want to accelerate your disk, use the algorithm indicated by your disk type.
    3) If you want to maximize your free space, select LZX.
    4) Note that sometimes maximum space is the option to choose when accelerating your disk, as is in the case for mechanical/spinning platter based traditional disk drives (but rarely, if ever, SSDs).

    Click OK when done, and then click Compress to begin compressing your disk:


    smallmao.png

    What we get here is another blast from the past. These DiskZIP folks have a sense of humor. They actually replicated the Microsoft ScanDisk disk map display, from way back in MS-DOS 6.x in the early 90s, pixel per pixel, in this modern Windows 10 app! For example, you can maximize the window, and the disk map grows proportionally:

    largemao.png

    As processing continues, the processed areas of the disk are painted yellow, and more free space should appear (the gray shaded areas are empty, with the dots designating files stored on disk).

    A little more information is also available during processing. Click the Status dog-ear at the bottom left of the map to switch to a throughput display:

    status.png

    And clicking Threads found in the same location will display exactly which files DiskZIP Online is currently compressing:

    threads.png

    Do you want to quit? Just click Exit! You may want to do this if you need your PC to become more responsive, as DiskZIP Online can be quite processor and hard disk intensive, especially the first time it is compressing your disk. You may also need to be patient after clicking Exit - DiskZIP Online cannot leave files on disk in an inconsistent state during a compression pass, so it will register your request to exit, but keep processing until the current batch of files it was working on have finished processing.

    If you want to uncompress, just quit, start DiskZIP Online again, and click the Uncompress button.

    That's all there is to it with DiskZIP Online!
     
    Last edited: Apr 14, 2018
    Maleko48 likes this.
  20. msintle

    msintle Notebook Consultant

    Reputations:
    15
    Messages:
    181
    Likes Received:
    62
    Trophy Points:
    41
    3. In Use - DiskZIP Online, Approximating with Built-In Windows Tools

    You may be wondering how to approximate what DiskZIP Online does without using the tool itself. This is certainly possible, although the results will be less than satisfactory, due to a variety of reasons.

    Approximating NTFS Compression: Simply use Windows File Explorer to bring up the properties window of a hard disk, and check the highlighted section:

    approxntfs.PNG

    You will notice that with my disk, this is unchecked, even though I have already compressed my disk using DiskZIP.

    The problems with this approach are:

    1) All folders will be marked for NTFS compression, which will automatically compress all new/updated files in them, but wreck your performance at the same time.

    2) A majority of your disk remains uncompressed, because Windows does not process non-user files with this tool. So all program files, system files - the best of what's highly compressible on your disk - will be skipped.

    3) Only a single thread will be spawned, meaning it can take you up to tens of times longer than is actually necessary to compress your disk, especially on an SSD (but not so much on an HDD).

    4) You can only use this option to enable NTFS compression.


    Approximating Windows 10 Compression: Fire up a command line window as administrator, change to the root of your drive, and enter in one of the following commands, based on what algorithm you want to use:

    compact /c /s /a /i /f /EXE:LZX
    or
    compact /c /s /a /i /f /EXE:XPRESS16K
    or
    compact /c /s /a /i /f /EXE:XPRESS8K
    or
    compact /c /s /a /i /f /EXE:XPRESS4K

    There are also several problems with this approach:

    1) The most serious one is that, on occasion, compact.exe may render your system unbootable, as it processes your entire disk, and apparently this renders some vital boot files compressed as well.

    2)This approach is also single-threaded only, wasting you precious time when you are compressing an SSD.

    3) Even with the force flag (/f), it doesn't seem to be possible to change the compression algorithm on previously compressed files (if they were compressed with Windows 10 compression). You would need to uncompress first, and then recompress.

    4) The command line may not be ideally suited for some people.

    For these reasons, it makes sense to use DiskZIP Online if you're going to compress your disk while Windows is running, even though Windows does offer some approximation of what you can do with DiskZIP using its own built-in capabilities.

    Do you want even better compression and more acceleration? It's finally time to look at DiskZIP's crown jewel, DiskZIP Offline!
     
    Maleko48 likes this.
  21. msintle

    msintle Notebook Consultant

    Reputations:
    15
    Messages:
    181
    Likes Received:
    62
    Trophy Points:
    41
    3. In Use - DiskZIP Offline

    Let's boot DiskZIP Offline from the Start Menu:

    offline.PNG

    The user interface again embodies the minimalist design ethos of DiskZIP. The software settings and progress feedback are all rolled into one:

    rolled.png

    Maybe a bit too minimalist here, as an options window is available for DiskZIP Offline, accessed from the almost-hidden chevron found on the right of the big box that is the "Compress" button:

    submenu.PNG

    This menu allows us, among other things, to take a peek at the advanced options which are available specifically for DiskZIP Offline. Let's succumb to our curiosity again, and look here first:

    opciones.PNG

    This seems to spill the guts of DiskZIP Offline out in the open. I say so, because the biggest section of the dialog is off-limits, unless you are being directed by DiskZIP Technical Support. I am not that, so I will not speculate on these settings here at all. However, there's some user configurable settings here still.

    Automatically compress new files: This seems to enable NTFS compression, buying you more time until you have to recompress your disk because you've added so many new apps and files since your last compression pass with DiskZIP Offline that it has become full again. Not worth it in my opinion, I agree with DiskZIP's official recommendation to avoid it here, but I could see it coming in handy on chronically full drives.

    Compression boost: This slider is a bit counter-intuitive, perhaps DiskZIP have erred on the side of oversimplification here. It's actually a slider moving across three settings here, instead of two. The left-most setting is a pass-through, where the slider has no effect at all and the compression boost is turned off. The second left, which is what I have portrayed above, is the fastest (and weakest) compression boost. The right most setting, is the strongest (and slowest) compression boost.

    Note that the compression boost is just that - a boost to the main setting found in the main user interface. It doesn't seem to make a noticeable difference in my anecdotal experience.

    There's also more settings and features accessible on the Chevron menu.

    Untitled.png

    Excluded Folders: Shows a dialog where you can exclude one or more folders from compression with DiskZIP Offline. It is vital to exclude folders containing frequently updated files, because compressing them with DiskZIP Offline takes time, and then they are automatically going to be uncompressed the first time they're updated anyways. Some folders may also need to be excluded for proper operation of the operating system, so DiskZIP Offline already comes with a list of built-in default exclusions.

    Be sure to not delete any of the default exclusions here, unless you know what you are doing!

    Feel free to add and delete your own folders though.

    Clone: Here's the disk imaging feature of DiskZIP Offline. This menu contains two submenus, Backup and Restore. First click Backup to compress your disk onto an external drive, which you can then carry to a new computer where you've previously installed DiskZIP Offline. Next, you click Restore on that new computer, and then choose Restore Compressed or Restore Uncompressed. Restoring uncompressed clones your current operating system to the target PC in uncompressed form, even if the original OS itself is in a compressed state. Similarly, restoring compressed clones your current operating system to the target PC in compressed form, even if the original OS is uncompressed. Once you've done a compressed restore, it is as good as having compressed the target PC with DiskZIP Offline - you get all the benefits, including more disk space and faster performance.

    Backing up your disk is a great way to get your feet wet with DiskZIP Offline. It's a great way to get a feel for how DiskZIP Offline works. There's absolutely no risk to your PC, since no changes to it are made during the backup. It was one of the first things I tried to get a sense for how much free disk space I would gain by running DiskZIP Offline, since there's no way to know that without trying. The final size of the DiskZIP.WIM file on your backup disk gives you an indication of how much space it takes to store all your apps and files in compressed form, and you can expect your actual disk usage to be roughly the same (with a gig or two extra added on top for good measure, plus of course any space consumed by excluded folders).

    Uncompress:
    Once you've compressed your disk, you can go back and uncompress your disk any time with DiskZIP Offline. Just point at this menu, and choose either From Backup Disk, or Use Latest State. It is faster to just uncompress from a backup disk, as this option, for all practical intents and purposes, just clones the image on your backup disk to your PC in uncompressed form. But if you're like most people, you actually want to uncompress the current state of your disk, not how it was some days (or weeks or months or even years ago), so you'll want to uncompress using the latest state. This is understandably slower, as it actually compresses your disk again to a backup disk, and then applies that freshly compressed disk image back onto your disk in uncompressed form. Of course, you can speed up uncompression by choosing the MaxSpeed compression grade (which, sure enough, is counter-intuitive when you're trying to uncompress your disk - but that's how DiskZIP Offline works).

    The only real inconvenience with uncompression is that you'll need an external backup disk to get it to work, and this external backup disk must have enough free disk space to hold your compressed disk image file. Feel free to check the size of C:\DiskZIP.WIM as this will give you an idea of how large, roughly, your external backup disk needs to be. If you have an internal disk (or a second internal partition) big enough to hold a file of this size, you can just choose that partition as your "Backup Disk", and get the job done without any external media at all, which can certainly come in very handy.

    Of course, it should go without saying that you should not try to uncompress your disk unless your disk already has enough free disk space to hold all of your compressed data in uncompressed form. Unfortunately, DiskZIP Offline does not seem to validate this free disk space requirement in my experience. Maybe there's something odd in my setup, but I've tried this on many virtual and physical machines, so I doubt it. You will simply need to ensure that you have enough free disk space before proceeding with uncompression. At least, if anything goes wrong, you can just restore your disk using DiskZIP Offline in clone mode, using the backup disk that is updated during the uncompression process. Your data is always safe.

    System Refresh: This is one of my favorite features in DiskZIP Offline! It is a very, very nice thing that you get thanks to the technology based on a compressed disk image file, instead of per-file compression.

    System Refresh is essentially a free "undo" to recover from any intentional or unintentional changes you may have made to your system since your last compression pass. For example, you may have installed some software which broke your business critical software configuration. Instead of spending harrowing days figuring out what broke and how to fix it, just choose System Refresh!

    Or, you may have been outright the victim of a malicious attack, getting infected by some kind of malware, spyware, ransomware, or any good ole' PC virus. The good news here is that your compressed disk image file is absolutely impregnable to malware. While this doesn't mean your PC is completely protected (after all, DiskZIP Offline is not an anti-virus solution), it does mean that you're just a single click away from restoring your PC to the same state it was in when you had last compressed it.

    I should clarify here, of course, that when I say restore your PC, what I really mean is restore your DiskZIP Offline compressed partition. DiskZIP Offline's protection applies only to the partition you compress with it, not to the entire PC magically somehow.

    So let's say you got infected by some kind of ransomware that starts merrily encrypting your files and demanding ransom. This malware will have no idea that your data is safe inside the compressed disk image file, which it will never be able to access or encrypt. Just click System Refresh, and you've saved yourself from that ransomware, without paying a dime. All of the files encrypted by the ransomware, and the ransomware itself, will be nuked out of your disk.

    There is also a not immediately obvious, but very practical use of the System Refresh function. Its essentially another type of backup/clone operation, but one you do yourself directly, instead of choosing the built-in options in the DiskZIP Offline software. The workflow goes as follows.

    1) You normally compress your disk with DiskZIP Offline, at any time when you want to take a "snapshot" of its current state and back it up.

    2) You use Windows File Explorer, the command line, your favorite file management tool, or basically whatever you use to manage files, and you copy your compressed disk image file to a backup disk, be that external, internal, networked, or wherever. You can even keep multiple compressed disk images files to ensure you have depth in your backup strategy and multiple dates to go back to in case of need. There's absolutely nothing magical about a compressed disk image file at all, its just a really, really large file that happens to contain everything on your disk, including both the operating system and apps, as well as your own files and data.

    3) Copy whichever backup file you want to clone to the root drive of the target PC, which should already have DiskZIP installed.

    4) Choose System Refresh, and you've got yourself a manual clone!

    We've got only two options left to cover before we get to the main software operation:

    Reload Drive List: DiskZIP Offline always seems to automatically detect when you attach an external drive and updates the drive lists instantly, so I'm not sure why this option is here explicitly, to be frank.

    Command Line: Launches a command line window. While this doesn't add any value when Windows is already running, it can and does come in handy when DiskZIP Offline is actually processing your disk offline, and you don't have any other way to launch a console window to take a peek around what's going on, while it's going on. In fact, while processing a disk, all menu items get disabled except this one, so clearly this is intended to be used while a disk is being processed. I frequently launch Task Manager by running "taskmgr" from this console window to see how much DiskZIP Offline stresses my PCs while running on them. You should not expect to be able to run your email client or web browser from this command line window, but most simple Windows apps work.

    Now that we've discussed all the available options, we're finally ready to explore the main user interface, which is surprisingly simple and streamlined.
     
    Last edited: Apr 16, 2018
  22. msintle

    msintle Notebook Consultant

    Reputations:
    15
    Messages:
    181
    Likes Received:
    62
    Trophy Points:
    41
    3. In Use - DiskZIP Offline (Continued)

    Here we are. If you skipped the previous sections, don't worry - you're at the right place! The below is all you really need to know to make the best of the entire DiskZIP software collection, in my opinion. Please don't even worry about all the options I have described above, possibly in much greater detail than is necessary.

    lax.PNG

    It's extremely simple to compress your disk.

    First, choose the disk to process. Drive C: will be selected for you automatically. Leave it at that.

    Next, do you have a backup disk, ideally as large as Drive C: itself, but maybe up to half the size if you're feeling adventurous? If so, check the "Optional Backup Disk" box, and select the drive letter for the disk here. If not, leave it unchecked.

    Then, select the type of disk you have. Just click on the connector type. Don't know what this is? Choose MaxSpeed if you want the quickest processing and least free disk space available. Choose MaxSpace if you want the most free disk space available, with a delay in processing. Or choose something in between.

    Finally, click the big Compress button, and get ready to reboot your PC! That's all there is to it. Here is what you will see after rebooting:


    Windows 10 Fall Creators x64 UEFI-2018-04-16-16-10-34.png

    Choose DiskZIP Offline on this menu. DiskZIP Offline will not compress your disk (or make any changes to your system) until you select this menu item.

    This rebooting is magical, and definitely merits a few extra words. It is one of the things that really inspired confidence in me while using DiskZIP Offline. It just works. Even on RAID systems with custom drivers. It just works. This is magical. You don't need to create a USB drive with a bootable version of Windows and then add some drivers to it and then figure out how to get it to work with UEFI systems, or BIOS systems, or both. It just works. No external disks are required, which I find to be convenient to the extreme. If I regularly had external drives lying around matching the size of my main storage, I probably wouldn't be trying DiskZIP anyways! Therefore it is vital that this all works in a single click, without fuss, for all users, without spare disks lying around. It does.

    Windows 10 Fall Creators x64 UEFI-2018-04-16-16-11-29.png

    Shortly after your selection, DiskZIP Offline stars an instance of Windows PE, from where it accesses your main boot partition to process all of the files it contains, even those that would be typically locked by Windows or other apps on your PC. It first checks your disk for errors. If you chose a backup disk, it is scanned as well. DiskZIP Offline will not run unless your selected disks are in perfect condition, to eliminate the chance of unintended data loss.

    Windows 10 Fall Creators x64 UEFI-2018-04-16-16-14-50.png

    DiskZIP Offline then reads your disk and compresses it, bit by bit, until its done. Finally, DiskZIP Offline invokes DiskZIP Online directly, without you having to do anything, to optimize the newly compressed disk. You don't have to babysit the process at any point past choosing DiskZIP Offline from the boot menu in any way. Just walk away.

    When you return, your PC has already booted back into your main Windows installation without any further fanfare. Everything is where you left it, pixel-perfect. Your PC is faster and has more disk space. You've made it. Enjoy!

    What Is The Risk Of Data Loss?

    I want to be very clear about this, since so many readers have expressed concern with the potential of data loss. If any of the following happens, you might lose data:

    1) You lose power (or your battery runs out) during compression. If you haven't selected a Backup Disk, your system may become unbootable, and you may lose your apps and files, and you may need to reinstall Windows.

    If you selected a Backup Disk, the worst that can happen to you is you need to reinstall Windows, and then restore from your Backup Disk. All your apps and files are safe on the Backup Disk, because DiskZIP Offline does not even touch your boot partition until everything is squared away securely on your Backup Disk.

    2) There is a media error on a disk
    . Your system may become unbootable, and you may lose your apps and files. You probably don't want to reinstall Windows until you've gotten a working disk.

    If you selected a Backup Disk but it has hardware faults also, the Backup Disk cannot protect you.

    3) A software bug occurs. Yes, it is true that nobody can rule this out. And there's no telling if the software bug might wreck your Backup Disk and your boot partition both at the same time. I've never run into a fatal software bug with DiskZIP Offline in my two years of using it, so I cannot speculate. Quirks, yes, but nothing where the software does not work as documented.

    You must always approach all imaging tools with a level of caution, be they DiskZIP Offline or a third party partition manager (even Windows's built-in Disk Management). Whatever precautions you take before using a disk partitioning tool, I'd take the exact same precautions with DiskZIP Offline. Nothing more, nothing less.

    What Is The Risk Of Data Loss After Having Compressed My Disk With DiskZIP Offline?

    I find this to be a very legitimate question, so I definitely want to address it in some detail.

    I find the risk of data loss after you've successfully completed a compression pass with DiskZIP Offline to be nearly identical to the risk of data loss you ordinarily are at while running Windows without transparent disk compression.

    Actually, it may help clarify things to refer to what DiskZIP Offline does as not transparent disk compression, but transparent disk uncompression!

    This is actually what is really going on when you use your PC after having compressed it with DiskZIP Offline. There is no transparent compression going on in the background or foreground or anywhere (at least, not unless you enabled NTFS compression, which is disabled by default in the settings we covered earlier).

    There is transparent disk uncompression going on all the time though, as what appears to be your good ole' disk is now actually just a single file, C:\DiskZIP.WIM, which contains virtually all of the files and folders and apps and settings and data and media on your disk (except, excluded folders of course).

    So what's the risk with transparent disk uncompression? Sure, you can still lose data - especially if the disk you're using develops bad sectors and C:\DiskZIP.WIM happens to occupy some of those bad sectors.

    Which is exactly why I say the risk is nearly identical to when you're running Windows itself without disk compression: If the disk you're running Windows on has bad sectors, you may lose data that resides on those bad sectors; with or without transparent disk uncompression!

    Taking this a step further - what if the critical metadata for C:\DiskZIP.WIM is stored in sectors which then get corrupt? Isn't that a more serious issue that might affect access to the whole file, and therefore, the entire contents of the disk?

    Sure, that can happen. Just the same way your NTFS MFT may also get stored on a bad sector on disk and get corrupted, again losing your disk contents in the process. However, there's two copies of the NTFS MFT, precisely to prevent against total data loss in the case one copy gets damaged.

    I don't imagine there'd be two copies of the master file index for C:\DiskZIP.WIM, which is why I've quantified the risk of data loss as nearly identical, and not exactly identical. It seems to me there would still be a better chance of data recovery with NTFS MFT corruption, as compared to the chance of data recovery with C:\DiskZIP.WIM corruption.

    But in today's world where disk controllers do tons of built-in error correction and even sector relocation without skipping a breath (or without letting the OS know what's really going on), and especially where even the concept of a "sector" has become something of the past thanks to SSDs, the risk you're taking is basically just the risk of defective media. And that's the same risk you take any time you use a disk, around which there's only one thing: If you really want to protect your data, back it up, and more than once.

    If you're like the most of us, you won't back anything up until after disaster strikes, so if using transparent disk uncompression motivates you to backup ahead of that, all the better!

    Recompressing Your Disk

    Recompressing your disk is as easy as compressing your disk. The steps are fully identical, just click the big button that now reads "Recompress" instead of "Compress":

    same.PNG

    When recompressing a previously compressed disk, DiskZIP Offline allows you to change the compression algorithm/acceleration type you used only if you use a Backup Disk. Without a Backup Disk, you will still be able to customize your compression boost, but you will not be able to change your previously selected acceleration type.

    Using a Backup Disk during recompression takes as long as the first time you compressed your disk, since all of your data is newly read and compressed freshly onto your Backup Disk. This is the safest way to do things, as no changes are made to your boot partition until your Backup Disk has been safely created.

    Not using a Backup Disk, DiskZIP Offline goes through recompression so much faster. It only compresses new files/folders added to the system, while recovering space from deleted files/folders. It does not recompress anything it had already previously compressed. This is riskier if something goes wrong during the process for any reason.

    I must admit I never use Backup Disks when recompressing, because it is so much faster without Backup Disks. When I am recompressing a 2 TB DiskZIP.WIM file, there's a huge difference between recompressing 2 TB of data versus the 10 GB of changes I made on disk. That's a difference in speed of roughly 200 times.

    You will want to periodically recompress your disk, after having compressed it with DiskZIP Offline. Think of this as a regular maintenance task on your PC, and schedule it the same way. On average, I recompress my disk about once a month to once every two months, but sometimes as frequently as once every couple of weeks. Below are three reasons I can think of for you to recompress your disk:

    1) Compress (and accelerate) new files, apps, updates added to your PC since your last compression pass.

    2) Recover space from files and apps deleted since your last compression pass. These are not automatically removed from C:\DiskZIP.WIM when you delete them, you must do a recompression pass to gain free disk space. Admittedly, this is the least convenient feature of DiskZIP Offline, and probably something done in favor of accelerating your disk at all costs, as opposed to maximizing free disk space in exchange for speed. Nonetheless, it does have some benefits as I have described below.

    3) Create a new "snapshot" of your operating system, apps, data, to act as baseline in case your PC gets infected by ransomware/malware, or to protect against accidental deletions via user error.

    This "snapshot" can remain on-disk, or you may copy it to an external drive to have a full secondary backup of your disk stored in a single file.

    Manually Extracting Files From A Compressed Disk Image

    It is of course possible to extract individual files/folders from either your "on-disk backup" or your external backup, which is a great thing - especially if you end up accidentally deleting or overwriting files, and need their originals as stored in the C:\DiskZIP.WIM file. You would just use any WIM file extractor for this (but ironically, DiskZIP's file compression stack itself seems to choke on the WIM image files it creates, as they often contain millions upon millions of files - sadly, this is the same with the open source 7-Zip project that DiskZIP's file compression stack is partially based upon).

    Since this can be so useful, I'll go ahead and give an example. Note - the steps below require command line processing and may not be for the faint of the heart:

    1) First, download the Windows binaries from https://wimlib.net/, which DiskZIP Offline itself referenced above in its advanced configuration page we covered earlier in this review.

    2) Next, extract the archive you downloaded, open an elevated command prompt, and change into that directory.

    3) Finally, type a command similar to this:

    wimextract c:\diskzip.wim 1 "\folder\to extract\inside wim\*" --dest-dir=c:\temp --preserve-dir-structure

    So basically, when you're typing the source path, you're using double quotes, and skipping the drive letter and colon designator for the path. That's all it takes to access/extract the original files inside the compressed disk image, even if you have since updated those files on-disk!
     
    Last edited: Apr 17, 2018
  23. msintle

    msintle Notebook Consultant

    Reputations:
    15
    Messages:
    181
    Likes Received:
    62
    Trophy Points:
    41
    3. In Use - DiskZIP Offline, Approximating with Built-In Windows/Free Tools

    Unlike DiskZIP Online, there is really no straightforward way to approximate what DiskZIP Offline does using free tools, or those tools built into Windows. There's definitely nothing like a GUI or a compact.exe to compress your disk into a disk image file in a single step or two.

    There are things you can try. The WIMLIB package I referenced above does have command line tools to create WIM disk images. Microsoft presumably also has something similar in WIMGAPI (which WIMLIB is an improvement of). The workflow would basically have to be like so:

    1) You prepare a bootable USB drive with all the necessary disk access drivers.

    2) You boot from this USB and run wimcapture.cmd to create a compressed disk image manually on an external drive (think of this as the Backup Disk above).

    3) You format the partition you just captured, and copy the newly created compressed disk image onto this partition.

    4) You run the wimapply command in --wimboot mode to "mount" your compressed disk image, and reboot your PC.

    This is, after all, roughly what DiskZIP Offline does during processing. Of course, you'll have to manually:

    1) Figure out which files/folders to exclude from processing (the built-in default exclusion list that comes with WIMLIB may be a good place to start looking).

    2) Manually backup and restore file and folder exclusions before and after the creation of the disk image.

    3) There's no way to skip a Backup Disk requirement, unless you have at least 50% free disk space on the partition you're processing - this is because there's no option to delete compressed files on-the-fly with WIMLIB command line tools. So this option is quite impractical on PCs with disks nearly full, which DiskZIP Offline handles with grace.

    There's plently of WIMBoot tutorials out there on the Internet - but none of them seem to cover all of the steps above exhaustively, and none of them seem to support WIMBoot'ing an existing operating system - they are all designed to WIMBoot a new, clean installation of Windows.

    I frankly don't know if this is because it is impossible to WIMBoot an existing Windows installation with files, apps, and user data on it. I've never had to find out, thanks to DiskZIP Offline.

    With the steps above, it should be theoretically possible. But there's no way to know for sure, and I am wondering if there's some secret sauce to DiskZIP Offline, given the absolute lack of non-clean-machine WIMBoot tutorials out there.

    Feel free to try it out and let us know what you find - it won't be easy, but it may be worthwhile.

    So this concludes our extensive coverage of DiskZIP Offline - we have only one tool left to review, named the DiskZIP Accelerator! Coming up next...
     
  24. msintle

    msintle Notebook Consultant

    Reputations:
    15
    Messages:
    181
    Likes Received:
    62
    Trophy Points:
    41
    3. In Use - DiskZIP Accelerator

    This is the final tool I will be discussing in my review (as I mentioned earlier, I am excluding DiskZIP Max from this review):

    integrator.png

    Launching this tool is extremely easy. Click the DiskZIP icon on your Taskbar, or Start Menu, whichever you prefer. The icon created by the installer launches this tool, which is great after you've compressed your disk (but not before, because the tool does nothing until you've actually compressed your disk).

    Let's take a look at the available buttons in this tool.

    Compress: Simply launches DiskZIP Offline. Nothing new here.

    Tune: This is new and interesting, if not exactly useful. Take a look:

    tune.png

    The software reads your existing compression ratio on your DiskZIP Offline compressed disk. For my tablet here, the ratio is 2.1:1, which means I have more than doubled my storage.

    So far so good - but what does this tune thing do? Here, take a look. This is with the tuner set to 1.0:1. To move the tuner, simply move the slider up or down. So with the trackbar set all the way to the top and then "Save" clicked:

    10.png

    This is the truth, actually. Now, let's lie a little. Move the slider all the way down to the bottom and click "Save". This is what you get:

    32.png

    So what's going on here? Take a look at what it looks like at the recommended medium setting (2.1:1):

    21.png

    It's all the same partition. But the software is making the disk appear bigger or smaller, based on the compression ratio selected here.

    This is just what the old DOS software used to do as well. When you're compressing your disk, you can store more than your raw free disk space would report. However, with DiskZIP, its not entirely useful. This is because, by default, DiskZIP does not compress data on-the-fly.

    And even if you enable on-the-fly data compression, keep in mind its just falling back to NTFS compression, which is a whole lot weaker than DiskZIP Offline's custom compression. So while you can nicely make it look like your disk is as big as your compression ratio indicates, in real world use, you actually cannot use your remaining free disk space as if it was being compressed on-the-fly.

    This is surely the most gimmicky feature of the entire DiskZIP suite. Nice to show off all that extra disk space you've gained, but useful for nothing else.
     
    Last edited: Apr 19, 2018
    Maleko48 likes this.
  25. msintle

    msintle Notebook Consultant

    Reputations:
    15
    Messages:
    181
    Likes Received:
    62
    Trophy Points:
    41
    Optimize: This just launches DiskZIP Online, so nothing new here either.

    Report: This is new again, and definitely more useful. It goes through each file on your disk to thoroughly calculate your compression ratio:

    analyze.png

    The ratio will keep changing as more files are scanned. It will eventually end up being lower than what is shown in the startup screen of this tool, most probably because of uncompressed files which are in excluded folders that end up lowering your compression ratio. Also, as you overwrite existing files and write new files to disk, these too would be in an uncompressed state, again lowering your ratio.

    report.png

    When this scan is done (which you may cancel at any time), you get a thorough report of your uncompressed size, and your compressed size, and the space you have saved with compression. There's still something a little funny about this report. Take a look at my partition setup here:

    partitions.png

    My boot partition is 564 GB. The compressed data totals 1 TB, so I'm definitely squeezing nearly double the data on this partition that I would ordinarily be able to store - great job, DiskZIP Offline! However, my compressed size is reported to be 671 GB, which still wouldn't fit in 564 GB (and I do have a few tens of gigs still available on my C: drive). DiskZIP reports that I've saved 375 GB of space, which is really nice - but either the compressed size estimate is wrong, or something else is - because the numbers don't add up to the reality of the partition size.

    If I actually calculate file sizes using Windows File Explorer (selecting every file and folder at the root of Drive C:, and then clicking "Properties"), this is what I get in turn:

    crazier.png

    As you can see, that definitely looks a whole lot crazier and unreal. So the plot definitely thickens, and I'm not entirely sure how to account for all of these discrepancies in something that should be as obvious and simple as disk space reporting! I won't dwell on this though, because it appears to be a cosmetic issue with no real-world ramifications - if anyone else figures this out though, I'd love to hear about how you solved this puzzle!

    Anyways, dismissing this window, you are put back into the Tune section, so you can apply the accurate compression ratio you just spent a while calculating (yes, the tool scans the entire partition, so it takes a while). You can then apply that updated ratio if you wish.

    Just keep in mind that even with a super accurate ratio, the Tune setting is still a gimmick. This is because with the recommended defaults, DiskZIP will not compress files on-the-fly, so no matter how well the rest of your disk is compressed, you still cannot automatically assume your free disk space is going to hold more than it normally can, at least not until DiskZIP Offline compresses your disk again.

    So this is the chicken-egg problem with disks overflowing with data - you theoretically can fit more data in, but sooner or later, you're going to run out of the necessary "temporary storage" where you can store that data until it gets compressed. The DOS tools certainly did not have this issue, so if I were to speculate, I'd reckon the NTFS kernel is way more restrictive in this regard.

    Check: This is the most useful of the bunch in this tool. It checks your disk for corrupted files, as well as for space that can be recovered when you recompress it with DiskZIP Offline - which is actually a very actionable, useful report:

    logs.png

    The Garbage Data field here indicates files which have been deleted and/or updated since your last offline compression pass with DiskZIP Offline. It is space that is guaranteed to be recovered when you recompress your disk, but not before.

    The New Data field indicates which files are uncompressed due to their having been added after your last offline compression pass with DiskZIP Offline. It is space that can be compressed so you can expect some space recovery from compression, although not all of that space can be recovered as in the Garbage Data field.

    The Corrupted Files field indicates the number of files which have been corrupted on disk due to DiskZIP. In 99.99% of cases where I have run DiskZIP, this field has remained at 0 - zero.

    In nearly two years of my using DiskZIP Offline, to date I have had only one time where this field read "2", and that was for some files stored in the Recycle Bin. The tool in this case displayed the paths of the files that were corrupted and offered to delete them, unfortunately no recovery option was available.

    This type of corruption therefore appears to be extremely rare. I don't know if I had emptied the Recycle Bin before running DiskZIP Offline - that is my guess - but maybe DiskZIP Offline does run into issues occasionally with the corruption of files stored in the Recycle Bin. Your guess is as good as mine, to be honest - and in fairness, I feel I had to report this, especially considering how concerned people are with reliability.
     
    Last edited: Apr 19, 2018
    Maleko48 likes this.
  26. msintle

    msintle Notebook Consultant

    Reputations:
    15
    Messages:
    181
    Likes Received:
    62
    Trophy Points:
    41
    So when the process is complete (which again takes a while to comb through your entire disk), you get a nice and useful summary:

    integrity.png

    Unfortunately, my attempts to reproduce the issue with the corrupted files in the Recycle Bin failed in my attempts with virtual machines, so I have been unable to produce a screenshot illustrating how corrupted files are displayed/handled here. I do remember that their full path was shown, together with the option to delete them.

    All in all, while I would have liked more transparency into what went there, I am letting it slide given how it has been the only incident I've had in two years. It would have of course been better, had DiskZIP offered to repair the corruption instead of just deleting the files. So again, in the spirit of full disclosure, no matter how much I love this product and feel super safe with it, I thought I had to let you all know. I owe it to you as your reviewer! Otherwise, it may simply have all been caused by generic file system corruption/a bug in Windows, for all I know.

    This actually concludes our section #3 - where I've attempted to describe each component in great detail.

    4. Competing product discussion

    This section is real easy. There's actually no other disk compression products that I'm aware of! So DiskZIP Offline has no competition. Really.

    In a sense, you may consider the ways I described above in section #3 to approximate what DiskZIP does competing products, but they're not really products at all - so I feel justified skipping this section entirely, having earlier provided the approximations (again, none of which are really products).

    5. Benchmarks

    I don't believe I am qualified to conduct in-depth benchmarks of this software, so I will keep this section short as well. This was one of the first questions asked near the start of my review, where I posted official DiskZIP benchmarks.

    In my experience, these benchmarks are true, and I would love if someone skilled in these matters could compile some additional benchmarks on their hardware.

    If we had a benchmark for each type of disk - that would be great!

    Thank you for your understanding here, and I hope my reaching out to the community for help with this one is not inappropriate.

    6. Bulleted Pros/Cons:

    Wow, here we are - at the very end of this admittedly very long review!

    If you made it so far, thank you.

    Here's my list:

    Pros:
    More disk space without performance loss!
    A layer of protection against ransomware
    Entirely undoable and as safe as possible
    At the discounted prices, a no-brainer

    Cons:
    For best compression, must process disk offline
    Loss of space requiring periodic recompression
     
    Last edited: Apr 19, 2018
    Maleko48 likes this.
  27. Frosti

    Frosti Notebook Enthusiast

    Reputations:
    0
    Messages:
    18
    Likes Received:
    1
    Trophy Points:
    6
    I would like to try, but am very time constrained (and space constrained as i dont have a space for backup before trying DiskZip)

    My question:
    I have 8TB of video's.
    I know that videos are already compressed and cant be helped with ZIP/RAR
    Would DiskZip help in anyway? or like a standard ZIP drive it wont make a difference?

    Thanks!
     
  28. msintle

    msintle Notebook Consultant

    Reputations:
    15
    Messages:
    181
    Likes Received:
    62
    Trophy Points:
    41
    It wouldn't help at all, other than buying you a few tens of gigabytes from compressing the non-video program files stored on your system (Windows, Office, etc.)