Is there a scramble function?

James T Sidebotham

Hi,

Is there a scramble function (much like there was in Pandora), as that feature was great for hiding PII but keeping the cardinality of values.

Thanks

Henry Simms

Having a look at what Pandora's scramble did, and specifically it retains the format of values (length, character type), as well as transforming values consistently:

It does this by replacing alphabetic characters with other random alphabetic chars, numbers with other numbers, and retaining most common non-alphanum characters.

Given this, the hash code function alone may not be quite the right thing, depending on the use-case, because it transforms values consistently but at the expense of format:

If you want to retain the format, also using the Format pattern function may be useful:

The format pattern is derived by replacing character types with a standard character (eg all alphabetic characters become A, all numeric chars become 9).

Josh Boxer

Hi James

You can use the Hash Function to mask PII / sensitive values.

https://docs.experianaperture.io/data-quality/aperture-data-studio-v2/get-started/create-functions/#encoding~native-functions

If you are using Data Tags on columns https://docs.experianaperture.io/data-quality/aperture-data-studio-v2/prepare-and-move-data/tag-data/

Then Suggest Transformation will suggest it is applied:

https://docs.experianaperture.io/data-quality/aperture-data-studio-v2/get-started/create-a-workflow/#transform_suggestions