Sheet Historian - grab snapshots of a sheet and append them to a Data Table
I'd like to be able to grab copies of a sheet and append them to rows in a datatable so I can build a "historian" over time. This is the use case: I have a sheet that all our project managers use to capture the Cost To Complete (CTC) for all our projects. Each week the PMs are asked to update this sheet with their current forecasts. I'd like to be able to trend this data over time. I've tried a Bridge workflow to copy the rows into another sheet, which works on smaller sheets, but our master CTC sheet contains over 9k rows and the Bridge 'copy rows' tool doesn't seem to be able to handle that many rows. Also we'd hit the row limit pretty quickly if we simply copied the data from one sheet to another, which is why I think a DataTable would be the best place to house the data.
I've tried using DataShuttle to offload snapshots to a CSV and then upload them to a DataTable. I'm simulating my workflow by running a DataShuttle that imports the data from the CSV into DataTable, which works the first time, but when I go to update 'forecast' time, and offload and re-import the CSV, DataShuttle doesn't append the data, it only updates, which is not what I want.
Each week I want the snapshot of our CTC to be appended to the bottom of a DataTable, even if all the data is the same.
Can someone help me with this?