2 questions on TRANSFORM

George_Stephen

Looking for ideas from community.

1)   Transform – ‘Equals’ Command

I am in a workflow to check if the input file matches to data loaded in SAP Table. There are about 70 columns and I want to create new 70 check columns as follows:

field1_input equals field1_Sap

field2_input equals field2_Sap

...

….

field70_input equals field70_Sap

Is there any easy way to define the 70 fields other than defining them one by one?

2)   Transform – ‘And’ command

Once the 70 columns are defined, I want to define another column to True if all the fields are True using the And command. Here again, is there any easy way other than manually picking all the 70 columns to the And command?

Josh Boxer

Hi George

It would make more sense to do this in a Validate step rather than a Transform

https://docs.experianaperture.io/data-quality/aperture-data-studio-v2/create-a-single-customer-view-scv/validate-and-enrich-data/#validate-step

Once you have created the rule/Function field1_input equals field1_Sap, you can clone it which would save you a little effort

Validation rules are contained in Groups, and you could see at the Group-level any rows that have failed without needing to And all the rules

You will be pleased to hear there is an improvement planned in this area coming in a few months that would make this easier, so I will let you know once it is available

George_Stephen

Hi Josh,

Thanks for the quick response. I shall explore Validate option. Looking forward to the improvement you mentioned.