Purging Duplicate Records from a Project in StreetSweeper Pro

Duplicate records can be identified and removed from a Project.
Products affected: StreetSweeper® Pro 

Duplicate records can be identified and removed from a Project. Criteria used to determine if two records are duplicates is set by the user. Duplicate records will be identified and purged from all files merged into your Project. To use a suppression file, please review Removing Records Based on a Suppression File.

  1. Select Address Tools > Purge & Suppression.
  2. Check the fields that will be used by the application to match duplicate records. By default, Address Line 1, Address Line 2, Province, and Postal Code are checked. These can be removed if address fields will not be used to match records.
  3. Select the options that will be used to identify duplicates:
    1. If fields must match exactly, select Exact Match on Name.
    2. If fields must be close but not an exact match to be identified as a duplicate, select Near Match on Name.
    3. If rural postal codes and rural route addresses should not be identified as duplicates, check this box. This is helpful if the Project contains a high number of RR or GD addresses rather than civic-style addresses.
  4. Select how results are handled by checking the appropriate Result Options.
    1. To have purge results display on a separate screen after processing is finished, select Display results when complete.
    2. To automatically delete duplicate records after processing, select Remove marked items from database.
    3. To create an export file with duplicate records, select Export marked items from database.
    4. To print the purge report, select Print report.
  5. When you have completed setting your options, select OK to start the purge process.

After the purge process is complete, you will be returned to the main dashboard. The database view will be filtered to show only duplicate records. Additional information on duplicate records is displayed in the IsDupe and Dupes fields. Navigate to these fields by scrolling the database view to the right.

UPDATED: 01 October 2024