Data Shuttle + Data Table: Move Row Repopulation

Charlie.H

I have a large Data Table that gets fueled daily with fresh information. There is a 'KEY' column that uniquely identifies each ROW of data.

Using a Data Shuttle, I am fueling a regular sheet with only SOME of the data from the Data Table. Unfortunately I cannot find a way to filter the Table with ANY (and) ALL logic. What I need is to pull specific accounts from the larger table (therefore 'or' statements) as well as only entries from a certain timeframe (and statement).

Because I cannot filter the query in the correct way, I have setup a MOVE ROW automation to get rid of entries I don't need on the sheet. But the next day, the sheet "finds" those Data Table entries again. So my 'helper move' sheet keeps getting filled exponentially and the workflow fails.

I need some hand holding / solutioning :-(

Brian_Richardson

If you have Data Shuttle then I assume you have Data Mesh also? You could setup this (admittedly) roundabout solution:

1. Your sheet loads the data from the Data Table for specific accounts or timeframes (whatever part of the AND statement gives you the smallest set of data)
2. You have a column on that connected sheet that runs the rest of the filter conditions and checks a box for the rows that you want to keep
3. Setup a report that filters that sheet just for the checked rows. Be sure to include the unique ID column in the report.
4. Setup a Data Mesh that reads from that report and posts to a second sheet. Set the Data Mesh to "Copy and Add" mode.

That will result in a sheet that's synced to Data Table but has only the complex filter conditions that you want to apply.

There's one drawback to this method, which is that Data Mesh can only run with report as a source on an hourly basis.

If you need more immediate results, then instead of your filter conditions creating a checkbox and using a report as source, you can use the filter conditions to drive the population of a second Unique ID column. If the conditions are met, Unique ID populates with the original ID. If conditions are not met, it's blank. Then you can set Data Mesh to run when something changes, and it will copy and add only the populated Unique IDs.