Incremental vs. differential methods and how Veeam writes backups

Source: Veeam

Many times when I explain how Veeam backups work, people have questions about how data is moved for incremental backups. In addition, there are frequent questions about the differences between incremental and differential backups. In this post, I’ll explain these differences and show what Veeam does and why the options are what they are today.

First, there are no differential backups with Veeam. A differential backup is somewhat of a carry-over from the disk-to-tape era where there is a full backup with a comprehensive collection of the changes. A restore would have a full backup tape and a second tape with all changes in the form of a differential backup. This would help in avoiding tape changes (multiple tapes required for a restore), which is another relic from the disk-to-tape era. The figure below visualizes a differential backup:

Differential backup

The differential backup would make it so that the tape set with the full backup and the tape set with the differential backup could access a restore point. It may be the same tape or may be a pool of tapes, but historically when tape was the first place backups landed, this was a common arrangement. However, the implementation varied widely. This was designed to avoid swapping multiple tapes (say a week’s worth) to do a single restore.

With the generally accepted practice using disk-to-disk backups for the first part of a backup, the industry and Veeam have clearly aligned to use incremental backups for a number of reasons. Specifically with Veeam, there are two types of incremental backup methods: forward and reverse incremental backups. These two backup methods also leverage one important new technique called changed block tracking (CBT). Veeam leverages CBT for both VMware vSphere and Microsoft Hyper-V backups (and Veeam Endpoint Backup FREE).

The forward incremental backup with Veeam is the default to write backups on disk. With a forward incremental backup, the virtual machine’s new, unique blocks are transferred to a separate file — the .vib file — after the full backup has been taken (Sunday in the example below). This is repeated with each restore point created, indicated as daily backups in the figure below. One additional technique that is used is the synthetic full backup. This is a great way to reduce the stress on primary storage and still have a complete restore point in one file. The synthetic full backup is created by reading the full backup contained in the .vbk file and the incremental backups to create a full backup file with the contents already in the backup repository. The forward backup is shown below:

forward incremental backup

Veeam recommends the reverse incremental backup for general-purpose storage, such as holding your backups on a SAN or direct-attached storage devices. The latest restore point is always a full backup file in this example, and the incremental backups are reflected by the previous restore points. The incremental process in this example happens by copying the unique blocks of the VM and then injecting that into the full backup. The blocks that represent the previous restore point are put in a reverse incremental file .vrb that will exist for each restore point in the backup chain. The diagram below shows this process:

reverse incremental backup

To bring this all into perspective, Veeam Backup & Replication v7 introduced tape support, allowing users to write backups to tape either from a backup to tape job or a file-to-tape job. In either scenario, the backup files are not manipulated onto the tape. This means that the nature of the full backup and its associated incremental backups are kept intact. However, Veeam Backup & Replication v9 did introduce GFS retention on tape, which will consolidate the number of tapes required to meet weekly, monthly, quarterly or annual retention requirements.

For today’s Availability requirements, the incremental approach is by far preferred. For one, the transfer for each restore point (in any Veeam example) is only the unique blocks since the last backup. In the differential approach, systems with high changes rates would transfer all new data since the last full backup. This can cause increased backup times and stress on primary storage. What factors go into your decision process to select a backup method? Share your comments below.

Incremental vs. differential methods and how Veeam writes backups

Veeam Vanguard Nominations are Now Open!

Source: Veeam

Last year, we launched the Veeam Vanguard program. Veeam Vanguards are people who embrace Veeam the best in their respective communities. They come from all backgrounds and are spread across different products. Partners, customers, influencers and others are represented here. Now, we’re pleased to announce that the second round of Vanguard nominations are open for 2016 recipients.

Veeam Vanguard Vanguards receive a number of exclusive program benefits — honestly, too many to list — but among these extensive benefits are a private Forum site, elevated access to Veeam Product Management, and private webinars and briefings. We’re continually adapting the program based on feedback from the Vanguards, as well as catering program benefits to innovate the program for this elite group.

For 2016, we’re accepting nominations through Wednesday March, 30 2016. So, make sure you nominate yourself or someone you feel embodies the Veeam spirit best. You can nominate via this special link.

Register new Vanguard nominees via the link above. Existing Vanguards must renew themselves or be nominated for renewal, which is a different process exclusive to current members. When you register yourself or someone else, be prepared to provide the complete story of their community engagement to give us the most accurate picture of their activity and insight. In other words, overload us with data!

The Vanguard Program is administered by a familiar group:

Veeam Vanguard program

The Vanguard Program team includes Veeam Vice President of Product Strategy, Doug Hazelman — the Executive Sponsor of the program — the four global evangelists (Clint Wyckoff, Luca Dell’Oca, Mike Resseler and Rick Vanover) and the two program coordinators (Kirsten Stoner and Dmitry Kniazev).

When we launched the program last year, many people reached out to us and said “What about me?” or “Why didn’t you select this person?” The inaugural process was an internal-only process, and we’re going into this next round with disciplined growth, focused on ensuring the Vanguard membership body is the best of the best of the best.

It’s natural to have a few questions on this type of program, so I’ve created a few Frequently Asked Questions (FAQ):

Who can apply to be a Vanguard? Anyone active in a technology community.

Can Veeam employees be awarded Vanguard status? No, but employees can nominate persons for consideration.

What criteria is needed to be awarded Vanguard status? The criteria is done by our team that looks across communities to find the persons who embody our brands the best.

How will nominees be notified of the result? The team is meeting around the time the nominations are closed and will deliberate the results, look for communication either way a few days after that.

I encourage you to apply using the link above. If you see a Vanguard in the wild, let us know!

Veeam Vanguard Nominations are Now Open!