Data Shuttle - Append Existing List

Conv_Eng

Hello -

I am trying to create an upload data shuttle that does the following:

• Appends an existing list when a new file is attached. If there are duplicate rows, a new row should be created instead of merging the data.  Even if all rows were duplicates of the existing rows in the destination sheet, the expectation would be that a new row is created for each duplicate entry. 

The workflow settings are as follows:

Workflow action: Merge data into the target based on a key column value

Row options: Add rows to the sheet as they are added to the source file (Checked); Update rows as they change in the source file (Unchecked); Delete rows that no longer match the filter criteria (Unchecked)

I think my issue might be in the 'Unique Identifier" settings. I am not quite sure if I have properly configured this portion. The Unique Identifier Column was chosen as a column in the target sheet that is not expected to change and is mapped to a column in the source sheet that corresponds to data I don't need. 

Any help would be greatly appreciated. 

Kerry St. Thomas

In my experience, there isn't an Append option as you suggest…directly, at least. The workaround I have used is to use a second sheet as a staging area: make that sheet the basis of the Shuttle upload, using the "Replace all Target sheet rows with data from the input file". Separately, set up a Move Row automation set to trigger on a cadence that's on pace with your datafile attachment, that moves any row from this staging sheet to your ultimate sheet.

The limitation here is that if more than one person adds attachments, it's possible that data will be lost (if person 1 starts a Shuttle workflow and then Person 2 uploads a NEW datafile that retriggers the workflow… data from #1 might not have made it into the sheet and/or moved to the new sheet before it's cleared out when #2 starts).

Good luck, and Happy Smartsheeting!

ChristianFinke

Hi @Conv_Eng,

It sounds like the Unique Identifier setup may be the issue. Try mapping it to a consistent column between the source and target sheets. Alternatively, you could use a staging sheet for uploads and automate moving rows to the final sheet to avoid conflicts.

Let me know if you have any other questions—we’d be happy to help!

Best,

Kerry St. Thomas

In my experience, there isn't an Append option as you suggest…directly, at least. The workaround I have used is to use a second sheet as a staging area: make that sheet the basis of the Shuttle upload, using the "Replace all Target sheet rows with data from the input file". Separately, set up a Move Row automation set to trigger on a cadence that's on pace with your datafile attachment, that moves any row from this staging sheet to your ultimate sheet.

The limitation here is that if more than one person adds attachments, it's possible that data will be lost (if person 1 starts a Shuttle workflow and then Person 2 uploads a NEW datafile that retriggers the workflow… data from #1 might not have made it into the sheet and/or moved to the new sheet before it's cleared out when #2 starts).

Good luck, and Happy Smartsheeting!

ChristianFinke

Hi @Conv_Eng,

It sounds like the Unique Identifier setup may be the issue. Try mapping it to a consistent column between the source and target sheets. Alternatively, you could use a staging sheet for uploads and automate moving rows to the final sheet to avoid conflicts.

Let me know if you have any other questions—we’d be happy to help!

Best,

Conv_Eng

Thanks for the response @Kerry St. Thomas. This helps!