Data Shuttle: Duplicated Data with Different Creation Dates

Question

Hello!

I am working on a new Data Shuttle workflow and have come across an issue I haven't encountered before. I have to run an annual audit on a list of employees through a third-party site. I am able to download the query results of the audit from the third-party site, and I would like to use Data Shuttle to add results to my audit tracker. The issue I'm having is that the download has the query results from every year each employee was included in the audit, and I only need the results for the most recent year. I have an example below:

UniqueID

FirstName

LastName

Date

Results

12563

Jane

Doe

12/15/25

Failed

25686

John

Doe

12/15/25

Passed

12563

Jane

Doe

12/15/24

Passed

49668

Jennifer

Doe

12/15/25

Passed

Jane Doe has results from 12/15/25 and results from last year's audit on 12/15/24. I only need the results from 12/15/25. They show a change from the previous year.

Is there a way to only have the most recent results shuttle into my sheet?

Thank you!

Neil Egsgard · Accepted Answer

@DorothyWasHere , you should be able to use the DataShuttle filter to only load data with "Date" >= "12/15/2025". Alternatively, you could add a column with a formula that indicates "Import" when your criteria are met and use the filter on that column.

Have a good day,

Neil Egsgard

Business Solutions Architect

Southern Alberta Institute of Technology