Add record limit to source step

Emilia Fuks
Emilia Fuks Contributor
edited June 25 in Ideas board

What problem are you facing?

Working with very large datasets, sometimes hundreds of millions of records, in order to debug a workflow, I often find myself adding a sample tool after each source so that I can preview results at different steps in the workflow. Otherwise it can take hours waiting for 'show step results'. It is a slow process, since the sample tools need to be reconnected with the other tools in the workflow.

What impact does this problem have on you/your business?

It affects efficiency and user experience.

Do you have any existing workarounds? If so, please describe those.

Workaround is to add a sample step after every source step.

Do you have any suggestions to solve the problem? Feel free to add images if this helps.

Add an option to limit the number of records in the source step.

Tagged:
5
5 votes

Gathering interest · Last Updated

Comments

  • Great idea. We've certainly had the same when trying to quickly debug a flow

  • This would be very convenient for debugging without having to add new Steps. I like it!