Comparison Step has Limitation on Number of columns?

Mahulima
Mahulima Contributor
in General

Best Answer

  • Josh Boxer
    Josh Boxer Administrator
    Answer ✓

    Map to target step to rename and reorder columns to ensure same schema:
    https://docs.experianaperture.io/data-quality/hosted-aperture-data-studio/data-studio-objects/workflows/#map-to-target~workflow-steps

    Can also use Transform step to rename and reorder when it is a small number of columns

Answers

  • Mahulima
    Mahulima Contributor
    edited July 31

    I am using 2 sources 1 having 132 columns and one having 362 columns, and in Comparison step only getting 52 columns? So is there any limitation on the number of columns?

    image.png

  • Mahulima
    Mahulima Contributor

    I think I got the issue , its because I dont have exact same column name in both source , Is there a way I can update the Column name in one of my instance so that it matches the other instance or I can map the column name of Source 2 with Source 1 . I am here looking for getting the comparison of 132 columns which is my Source 2 in the picture which has less number of columns. the columns in Source 2 is the Subset of source 1 but some columns not having the exact same name in Source 1 as Source 2 which is the issue here

  • Mahulima
    Mahulima Contributor

    @Josh Boxer

    is there any Bu on this comparison step? In the below example the comparison step giving the result that the value does not match even though its same. I observed this issue on the Numbers

    image.png

    There is no extra space with the numbers I copied both the values in excel and compared

  • Josh Boxer
    Josh Boxer Administrator

    https://docs.experianaperture.io/data-quality/hosted-aperture-data-studio/data-studio-objects/workflows/#compare~workflow-steps

    "Equals - the values pass if they match. Can be configured to become non-strict equals, e.g. Ignore case."

Categories