What is the Aperture Data Studio equivalent of TABLE LOOKUP in VALIDATE in Pandora ?

aguthakari
aguthakari Member
edited December 2023 in General

We are migrating DQR's from Pandora to Aperture Data Studio. Pandora has TABLE LOOKUP functionality in VALIDATE and I am trying to convert to the same in Aperture but I don't see any TABLE LOOKUP component with in VALIDATE when trying to create the DQR.

TABLE LOOKUP in Pandora is being used to get a Minimum value of a column for every ID column.

Can someone please help?

Answers

  • henry_
    henry_
    edited March 2023
    Hi @aguthakari
    To make workflows easier to understand and maintain, lookups in Data Studio are done in a separate lookup step (https://docs.experianaperture.io/data-quality/aperture-data-studio-v2/get-started/create-a-workflow/#lookup ). The recommendation would be to do the "minimum value" lookup, and pass that value into a Validate step to build the rule.
  • Josh Boxer
    Josh Boxer Administrator

    I am not entirely sure how Pandora worked, but if Lookup step does not solve this or for anyone else looking for a minimum value from multiple columns, the Group step could be useful. You can pick a column(s) to group on, i.e. Customer Id then add an aggregate such as Count (rows) or First value or Max/Min for a column then another aggregate for another column, etc.

    image.png

    https://docs.experianaperture.io/data-quality/aperture-data-studio-v2/get-started/create-a-workflow/#group

Categories