Best Of
Re: A Function with two parameters is not showing up in a workflow
@Henry Simms I am creating the function in the same workspace and did published and tried as well still no luck.
If its single parameter function I am able to use it (I created all functions as reusable)
koti
Relationships in Aperture
In Pandora we have option/facility to see the relationships between datasets/tables.
In Aperture do we have that if so help me on how we can see them.
koti
⌚ Convert Epoch Date/Time to Standard Date/Time
⌚
Convert Epoch Date/Time to Standard Date/Time
This function was inspired by this post and created to support any users exploring use of the Data Studio API as a source to generate meainginful MI (e.g. reporting on sessions/events/activties/jobs/users and more) as Data Studio's publishes times in the epochtime format (i.e. how many milliseconds since 1st Jan 1970).
As the name suggests this function simply converts this value into a standard date/time format for easier onward processing:
Compatibility:
This function is compatible with all instances of Data Studio from v2.9.6 onwards.
Re: What is the Aperture Data Studio equivalent of TABLE LOOKUP in VALIDATE in Pandora ?
To make workflows easier to understand and maintain, lookups in Data Studio are done in a separate lookup step (https://docs.experianaperture.io/data-quality/aperture-data-studio-v2/get-started/create-a-workflow/#lookup ). The recommendation would be to do the "minimum value" lookup, and pass that value into a Validate step to build the rule.
henry_
Keyword: Community - Data Management User Group Material 09th March 2023
It was great to meet the Experian Aperture Team and fellow users last week.
Just wondering if and when the slides and any other additional material (Q&As etc) might be available and whether they'll be emailed or shared via Download?
Would be really useful to walk through with colleagues that couldn't attend and to provide an overview to internal Stakeholders.
Thanks in advance
Andrew 😎
Re: Find Duplicate new feature compatibility
Hi Mahulima
As a rule we never push out breaking changes. If we did need to ever push out a breaking change it would be called out explicitly and we would try to contact any customers we think might be affected to ensure they are aware.
In this case I assume you tested the behaviour on your dev environment to confirm there are no issues
Aperture Data Studio quarterly newsletter – March‘23
We’ve recently updated Aperture Data Studio to the latest version, v2.10.
You can view the interactive product roadmap to see the current state of deliverables as well as the plans for future development. You can find out all the details on our community page.
What’s happening?
This latest version of Aperture Data Studio includes a roll out of new features (click on the highlighted feature to watch the demo):
- Profile step custom output - It is now possible to define what a Profile output should contain, i.e., the attribute columns required and the order they should appear in.
- Workflow Notes - To assist with collaboration, we added Workflow notes that can be added by double-clicking anywhere on the Workflow canvas.
- Info Panel - An info panel is now available that shows the metadata for the object as well as any associations. Users can edit or add descriptive information as well.
- Job Screen Chart – The Job list screen now shows a chart that updates in real-time to quickly see the frequency a Workflow is running and the time it is taking in comparison to other jobs.
- Find duplicates enhancements - Duplicate stores (added in v2.9) can now be used as the Source of a Workflow. To better manage Duplicate stores, that often contain many millions of records, there are two new Workflow steps:
- Find duplicates delete step – feed in a list of IDs to bulk remove specific records from a Duplicate store and re-calculate the clusters impacted by the changes.
- Find duplicates query step – search for records in a Duplicate store that match the input values.
What do I need to do?
Download and install the latest version. We highly recommend that you upgrade at least quarterly to ensure the best experience and have your data protected to the highest levels. For hosted customers, this release will be implemented automatically in the following occurrence of monthly maintenance.
Where can I find further information?
To find out more about Aperture Data Studio releases and download the latest version, go to this community page. You can also bookmark it to make sure you get alerts when new discussions or posts are added.
New E-Learning Platform
A new training resource will soon become available, offering 8 free-of-charge self-paced training modules for Data Studio customers and partners. Initially the platform will be for UK users, but reach out to your Experian contact if you are interested or stay tuned for more updates.
If you have any questions, please contact the Data Management Product Team on [email protected]
-------------------------------------------------------------------------------------------
Have your say
We work hard to make Data Studio as easy to use as possible, but we always want to do better. It will only take 5 mins to share your experience we’ll make sure to share the results and upcoming improvements.
Kind regards,
Experian data quality team
ℹ How to use Functions in Workflows
Workflows
Workflows is the area in Data Studio where designer users tend to spend most of their time. For anyone new to it, imagine a data pipeline that manipulates one or more data sources through a number of stages and then does something with the results.
Whilst a Workflow is easy to build by connecting different steps together, it is most valuable to build this out for a process that needs to be run repeatedly. It can be helpful to plan a new workflow on paper to visualise the different steps, how they depend on each other and what the outcome should be.
Each step in the Workflow allows you to ‘Show step results’ i.e. what the data looks like up to that point.
It is then possible to explore the data and manipulate it in the grid using either the action buttons or by right-clicking the column headers to check the data is as expected.
Since most of the actions have equivalent Workflow steps, clicking ‘Add to Workflow’ will convert them into additional steps in the Workflow so that they become part of the data pipeline.
Some Workflow steps (or their equivalent Actions) use Functions, including the Filter, Split, Transform and Validate.
Functions
There are over 100 Functions that can be applied to a column of data, i.e. if a value equals A or B or C then return True else return False. Alternatively, if a number or date is greater than N return True. This can be used in a Split step to divide data and send it down different branches of a Workflow. A rule such as ‘ID should never be NULL’ in a Validate step is a Function but using another name in this context.
Anyone familiar with formulas in Excel or SQL functions will see many similarities with Data Studio Functions, for example a Transform converting each value in a column to lowercase:
Excel formula: =LOWER(A1) SQL function: SELECT LCASE(column_name); Data Studio function: LowerCase([c: column_name])
In Data Studio, Functions can be built using a simple drag and drop UI that is similar to Workflows, so you don't need to know how to write code, although it can be useful to edit the Function script in combination with the UI to be more efficient. The examples above are quite simple, but Functions can be connected to achieve more complex outcomes:
A more complex Function you have built is often called a custom or advanced Function. This could exist only within the Workflow step/Action or if it is something that will be useful several times in many different Workflows then make it Re-usable and it will appear in the Function list and can be shared to other Spaces.
Find more detailed information about creating Workflows and Functions on our respective documentation pages.
Re: Pivot grouping issue?
Hi Henry!
wow this worked thanks!
Somehow the rows to columns were not grouping the columns as I wanted and how Pivot does... or maybe I do not know how to use it 😅
But thanks I will use now the pivot with sort!
Kind regards,
Vera
Vera O