Experian Data Quality Community
-
Merging Rows for Unique IDs
Hi, I have a table showing customers, their current statuses, and when those statuses take effect. As customers can have more than one status, we have duplicate customer IDs. I need to merge the statuses into one row, separated by a forward slash, so that each customer ID is unique. Can this be done in a workflow?
-
Add a delay in automation between when a trigger is triggered and when the action is carried out.
Hi, I currently have a number of schedules and automations running in order to run some sequential steps in a find duplicate process. I have an initial schedule that refreshes data and then an automation that detects the datasets are refreshed and kicks off a workflow that validates that the date stamp on the data is…
-
Pushdown Processing on a pivot
Hi, In testing Pushdown Processing today, I hit a couple of errors. The first is simple to workaround by removing it (but would be awesome if the generation understood to omit) - the dataset query had a semi-colon at the end, which pushdown processing then put it's "as R0" after: The second I'm still at a bit of a loss. I…
-
Date column recognized as "alphanumeric" while profiling
i have some date columns in my table (like below example). Just done profiling on those columns it recognizes their datatype as alphanumeric instead of date. after profiling i just right click and seen the values, there it shows as Date datatype all rows have date only in MM/DD/YY format because of this i am getting wrong…
-
Best approach- to do profiling for large dataset (20 million records)
Hello , I need to do profiling for tables which have more than 20million records and also the table will get update with new records as every week. 1) Is that right to do profiling for such a large dataset, will i get any performance issue? 2) as the table gets updated with new record as weekly basis, is that possible that…
