How to manage large data set uploads without Data Shuttle or DataMesh when creating a SCC Blueprint?

Trang Turtletraxx

I have a client who has a Smartsheet commercial plan and just migrated to Microsoft GCCH.

I know DataMesh is not directly integrated with Smartsheet Control Center (SCC).

Because the client does NOT have a Smartsheet Gov plan, they are NOT able to utilize Data Shuttle if the source is OneDrive/SharePoint.

Does anyone have any suggestions on how to redesign their SCC Blueprint to deal with the monthly upload of their large data sets without using Data Shuttle or DataMesh?

kowal

hi @Trang Turtletraxx,

what about using Data Table? Nowadays Data Table can keep up to 2mln rows so shall be enough to cover for a while.

Trang Turtletraxx

@kowal I was asking more regarding the automations and workflows more than the amount of data.

kowal

hi @Trang Turtletraxx got it in that case I am out of ideas :(

prime_nathaniel

Your options to inbound data en mass are

Copy paste into UI - not automated
Core Import from csv or excel - not automated
Shuttle - no dynamic targets and limited triggers to attachment or timebase
Bridge / API - requires custom configuration / code to do but is half done for you
Pure API - requires all custom code, do it all from scratch
Salesforce connector - have an auto import into salesforce then sync it over, same issue as shuttle one with only allowing 1 sheet target per workflow

Data tables has no way to import data it is a data store, you get data into there from shuttle (for now).

Trang Turtletraxx

@prime_nathaniel

Copy paste into UI

• this is inefficient for large data sets with thousands of rows of data if there is a max # of rows to copy and paste at a time

Shuttle - no dynamic targets and limited triggers to attachment or timebase

• We considered this, but we are trying to limit the amount of data stored in Smartsheet. Most gov clients prohibit massive amounts of data stored on a third party app
• It is also inefficient for data sets that are updated daily.

Bridge / API - requires custom configuration / code to do but is half done for you

• what do you mean it is half done?
• I was also under the impression there were significant restrictions with using Bridget and API if the client has a commercial plan on a GCCH tenant. Can you confirm this?

Pure API - requires all custom code, do it all from scratch

• can you expand on this?

Salesforce connector - have an auto import into salesforce then sync it over, same issue as shuttle one with only allowing 1 sheet target per workflow

• is Salesforce connector compatible with a commercial plan on a GCCH tenant?