Welcome to Voyager Help

Use the Search field below or select a Category from the list at the left

Understanding Duplicate Data

Voyager offers a default Saved Search for detecting duplicate data. There are three types of duplicates that users can search for:

  1. An MD5 hash is a byte by byte comparison of a file. It would be considered an exact duplicate. It is like a digital fingerprint of the file. There is a very small possibility of getting two identical hashes of two different files. 

  2. A Schema Hash indicates that the data you are looking at is in the same schema. We don't compare data or row counts.

  3. A Content Hash compares the schema, number of rows, and the first few hundred rows and use the combined data to build a hash. If multiple datasets come up with the same hash value then the data has a good chance of being duplicate
Web Design and Web Development by Buildable