-
Do you have a need for Pivot/Unpivot steps?
As part of our product discovery activities, we would like to find out if any of our clients have a use case for pivoting or unpivoting data. If you do, we'd like to hear about it. Please leave us a message and we'll get in touch.
-
Fuzzy Matching Logic
Hi, I have a requirement to match records from two separate systems on the basis of FirstName, LastName and DOB from System1 and FisrtName, MiddleName, LastName and DOB from System2 to return the match Id from System2 to System1. Below are the challenges The names are not consistent in both systems . For eg in system1 for…
-
Validate address data dictionary?
Hi, started looking at 'Validate Address' step and cannot find a data dictionary for the returned fields. For example, AddressAction I see 0 & 3 and Street Non-trivially Corrected I see blanks, 0, 1. Any pointers would be great, thanks
-
Any Function to check the one field in Present in the List of the fields?
For example I have a column where I have Value like this If I use function contains then I am getting this true for all of the above scenario, but I want only row 1 should be true and rest should be false when the entire string is not matching. Can this be done?
-
Turn a field storing a list into rows?
Hi, is it possible to turn a list stored in a column into rows? For example: ID COL 1 AA,BB,CC 2 XX,YY,ZZ Becomes 1 AA 1 BB 1 CC 2 XX 2 YY 2 ZZ Thanks
-
Unable to restart the Aperture services
Hi team, Suddenly the aperture data studio application is connecting. We tried to restart the services and the services are still stopping .we are unable to restart the services. Can you please help us to resolve this issue ASAP .
-
Dropzone
Hi there, How do add columns on a dropzone file? The columns have been added in the source file but it's not reflecting on the dropzone file in aperture. How do I fix this? I have tried adding a new external system but it doesn't work. Many thanks, Mariana
-
Network error
I am trying to create a development environment to test some changes but when I try to import anything to it, gives me this network error message. Any ideas on what the problem is? I am connected with the VPN, already checked that! TIA, Mariana
-
Best practice for checking that Datasets have been refreshed
A user asked this question: We have hundreds of datasets we need to refresh before a migration, what is the best practice in ADS to make sure they have all been updated, without adding a source in a workflow for every dataset can you iterate through the desired datasets and look at the metadata to determine when it was…
-
Inquiry Regarding Royal Mail Address Database Updates
Good afternoon, We are currently using the "Validate Addresses" step to check UPRNs. However, we have observed a significant number of addresses—where we already know the UPRN—that are returning empty during validation. Could you please confirm how frequently the Royal Mail address database is refreshed? Thank you for your…
-
find duplicate update row limitation
Is currently is there any limitation in the latest version ? I am getting error in my existing workflow . Please suggest where I need to change to set the limit
-
DDL for datasets before including in aperture.
Hi, Is it possible to see DDL of tables before adding those in datasets from external system? or Aperture does not have that kind of control. can i see DDL of tables before adding? or service_account wont have that control.? Br, HS @Ian Hayden , @Henry Simms
-
All Schedules information?
Hi, I'm looking for a way to be able to view details of all the Schedules that exist within our environment. I'm thinking details like space, schedule name, recurrence pattern and workflows ran by it. Is there a way to surface this information via API or otherwise? Thanks Mike
-
Workbench
Hi everyone, I am trying to analyse some blocking keys on the workbench but it keeps on this page forever. Is anyone else going through the same issue?
-
Issue list - see comments?
Hi, is there a way to see all the comments that have been added to an issue list? Also, can comments only be updated manually? Thanks
-
Security related Documentation
Is there any documentation available where it tells about how secure is Aperture in terms of handling the data. We might need to provide this document to one of our internal team as we try to access that source system's data through aperture
-
Split a value into multiple rows
Hi I have full addresses split by ; that I want to split out into new rows ready for the Address Validate step. An example of the data layout ... "Address1 Address2 Address3 Town County Postcode;Address1 Address2 Address3 Town County Postcode" This should become two rows "Address1 Address2 Address3 Town County Postcode"…
-
Charts - last 10 batches
Hi, if i wanted to create a chart that graphs data quality over time, but I only wanted to display the latest 10 batches from a dataset, what are my options for this? I was thinking that a workflow would use the original file as a source, and I would specify 10 batches, and that would output to a dataset (single batch…
-
Add Source to Column Names
Is there a way to bulk update/set an option to add the Source name to all columns, rather than just the _1 on the second source? For example, if Source1 and Source2 both have an ID column, then columns would be named Source1.ID and Source2.ID, rather than ID and ID_1 which is ambiguous outside of the workflow.
-
đź“Ł Join us at our next User Group - 12th November 2024
We would love you to join us for our next Data Management User Group taking place on 12 November 2024 between 10:00am – 3:00pm at our offices in Cardinal Place, Victoria, London. Join us for a day of networking, in person to hear from industry experts about what’s happening in the world of Data, AI along with real-life…
-
Date format
Hi there, I am having trouble with some date data. ADS is not recognizing the dates that comes from Azure Data Lake. Is that anyway to change that?
-
Invoking PowerShell script from Experian workflow/Schedule
Is there a way to invoke a PowerShell script from Experian Aperture Data studio using workflow or schedule? I am using the 2.14.14 version
-
Ingest data with API, check rules, send results back to source system
A Data Studio user raised the following questions: Is there any demo or material to show how can we configure Aperture ingest the json data with api service and check the data quality rules and response it back to the calling system again ?Â
-
Include Chart in notification?
Hi, is it possible to include a chart in a notification? Lets say I want to show progress on some cleansing over time, and the chart is sent at the end. Thanks
-
REST API workflow Execution Error
hi, I have created a reusable workflow accepting 4 parameters with source configured as below "sources": [ { "stepExternalLabel": null, "canSupplySourceWhenExecuted": true, "mustBeSupplied": true, "allowAutoRefreshed": true } ] I am trying to execute the workflow using below request, but I am getting error for the…
-
Experian REST API for Dataset Creation
Hi, Can someone please help me with the JSON request to create a dataset using SQL query? Below are my dataset requirements a. Type : JDBC(SQL Server 6.0) b. Allow Refresh : True c. AllowBatchDeletion : False
-
Experian API call to Execute Workflow
hi, Can someone help me with the JSON request to invoke a workflow through REST API? Below are my workflow specification a. Workflow accepts workflow parameters b Workflow accepts source at execution and its mandatory to give source information.
-
How to capture log errors into a table if error occurred during execution of workflow or Schedules?
How to capture log errors into a table if error occurred during execution of workflow or Schedules
-
đź“Ł Join us at our next User Group - 9th November 2023 đź“…
I am pleased to confirm that our next User Group event for Aperture Data Studio users will take place on Thursday 9th November, 11am-3pm (UK-time). We will be running the event from our offices in London (near Victoria statioon) but will have a dial-in option for those who are unable to be there in person. Following on…
-
COMING SOON: Webinars
Subscribe to be the first to find out!
-
Error while invoking REST API from Experian Studio VM
Background Experian data Studio version - 2.14.14 SSL setup done on the data studio url and private CA is added to the trust store under E:\ApertureDataStudio\certificates\cacerts API Key genrerated with 365 days validity and able to invoke API via Swagger Issue While trying to invoke the CURL command from command prompt…
-
Accessing Azure KeyVault
I have stored my Azure SQL's connection string as a secret in the Azure KeyVault. I wanted to access this secret value while trying to create an External System.
-
Experian Aperture Data Studio REST API error
Hi, I am planning to automate dataset creation using Data studio REST API, however I am getting 401 Authorization Error. Background Experian data Studio version - 2.14.14 SSL setup done on the data studio url and private CA is added to the trust store under E:\ApertureDataStudio\certificates\cacerts Please see the steps…
-
Re-run Track Issue list?
Hi. I have a workflow that validates a file and sends failing rows to an Issue list. I have made that workflow reusable and can supply source when executed. I have another workflow that uses the same source data, but does some transformation to correct data anomalies. The final step in that workflow is to execute the first…
-
Another Dataset already exists with external label
A Data Studio user had the following challenge/question that might be relevant for other community members. I'm getting the above error ('Another Dataset already exists with external label') when trying to synchronize a dataset into an environment. I found the dataset in question and deleted it from that space where it's…
-
AWS S3 Dropzone
A Data Studio user had the following question that might be relevant for the community. Is someone able to elaborate on how an Aperture dropzone on an AWS s3 bucket works? I have a dataset setup as a dropzone and it correctly picks up new files of a different name when added to the s3. However, if I replace a file with a…
-
Solution Deployment error
This question was raised by a user and might be relevant to other community members. What can I do to resolve a Solution Deployment error? BTW I also have a "Data Discovery Pipeline" space in this destination environment, also with the same external label but this one doesn't get rejected ... Could it be because object…
-
Automation Time Expiry Limits
A Data Studio user had the following question that might be relevant for the community. I have a monthly job that has data coming from multiple datasets across the month. What is the maximum time period (minutes) allowed for an automation and does that limit get reset for any reason i.e. a server/application restart?
-
This site can’t provide a secure connection
Hi team, I have applied the SSL certificates with wrong private key file on our aperture server .The aperture application is not connecting due to the incorrect private key. Could you please help me to remove the applied SSL and reapply again.
-
Problem updating Server Certificate
Our tech team previously applied a cert to the server a couple of weeks ago, now we are looking to upload the Server Certificate but have come across a problem in uploading: We used the same cert file due the documentation stating: For certificate files which include both certificate and private key, such as .pfx, the same…
-
Validation step not yielding the right output
Good morning, I'm building a simple validation for a numerical field, where I'm using the "contains match" function. The output shows the right result (true) when looking in the grid view, however the output in the validation step is showing as a failure. (see screenshots below) Is there any issue on this configuration…
-
Remove duplicates
Hi there, Just want to check with you smart people what is the best way to remove duplicates from a list. Basically I am having a problem that some data is duplicating when coming to aperture from the Azure Data Lake and while we resolve this issue I wanted to create a function to deal with this duplicates so I can do the…
-
Why is my duplicate store matching these two addresses?
Can anyone shine some light onto why my duplicate store is matching these two addresses: Flat 11, Kylna Court, Wood Lane End, Hemel Hempstead, Hertfordshire, HP2 4BF Flat 22, Kylna Court, Wood Lane End, Hemel Hempstead, Hertfordshire, HP2 4BF The records are being standardised like this: The workbench explains the match as…
-
Issues using replace function
Good Afternoon, I'm using the below function to replace values in one column with another value that I've stored in a variable(all the columns are within the same dataset), and I'm able to change only one row. Is there anything I'm missing here? Many thanks in anticipation. Best regards, Marco
-
Comparison Step has Limitation on Number of columns?
-
External system Connection Possibility
Is it possible to get External System Connection in Aperture for SAP, KAFKA, postgress, PWX ?
-
Working hours between 2 timestamps
Hi All, Is there a way to calculate the working hours between 2 timestamps - start date and end date. We would like make this calculation for our KPI measures. We need to exclude the weekend hours as well somehow, so the result should be the exact hours, minutes, seconds. Let me know if you have any ideas! Many thanks!…
-
Excel floating point issue
Hello. I am on ADS 2.8.8 currently and I am facing an issue when trying to load .xlsx as a dataset. Some, but not all floating point numbers are read incorrectly (see screenshot below). I have read the post below and understand this might not be possible to resolve instantly I just wanted to ask that aside from using other…
-
Is there a way to split a column with multiple delimiters like the excel function TEXTSPLIT?
I have a dataset which is semi-structured which has columns with multiple values split by different delimiters in different positions e.g "'123',' 456'; '789' & '321' and '654'" The excel function TEXTSPLIT can easily split the data into multiple columns easily but i'm struggling to find a function in Aperture which does…
-
Is anyone experiencing any problems to access aperture?
-
Is it possible to share a dashboard on ADS with my colleagues? If yes, how do I do that?
-
Automatic Deletion of Dataset
Hi, Is there a way we can delete the data in the dataset by setting up some Process? For example running a WF to delete the data in the Dataset. But we want to keep the Dataset metadata. Thanks.
-
Long datatype
Hi there, Does anyone came across a problem of the wrong datatype coming from the outputs produced by aperture that goes to Azure Data Lake? According to the my colleague Data Engineer the outputs need to be the long data type. Just checking if anyone knows anything about this to offer me some support. TIA
-
Dynamic replace based on expression
Hello, I wonder if you can help me come up with a solution. How to replace values from one input with values from another, where the new value is calculated with an expression. Example below: input 1: input 2: Result: Input 2 is dynamic so I'd need a tool that can read the expression/ statement from Input 2 and apply to…
-
SNOW Connection - OAUTH2.0 in Aperture
@henry_ @Henry Simms @Josh Boxer We are trying to Build the External System connection through API in Aperture, the authentication method is OAuth 2.0 I am able to get the response in Postman and also able to Download the JSON file and then process the Same in Aperture, then i can see the Table and also the records. But…
-
Interactive Snapshot Not Available
Hi, I have a dataset that is 'Interactive' (can see the failings rows). Once I pull it into a new workflow, to do some filtering, transforms etc, I can no longer make the resulting snapshot interactive. Is there a way I can enable this? T Troubleshooting revealed it is nothing to do with the steps in the workflow, even if…
-
Previous Row value
Hello, How to tap into previous row values? If [CurrentRow] == NULL then [CurrentRow]=[CurrentRow-1] Like when you double click in Excel to fill empty row values with current value until next one? thank you
-
Directory / batch input based on key word
Good Morning, I wonder how you would handle this use case. I have a directory containing thousands of objects / datasets. I'd like to be able to load a selection of these datasets into a workflow in Aperture based on a key word contained in the name of the file. I will then join them up and process together. Any…
-
Deleting Consumer Spaces
Hi, I am trying to clean up my spaces and found our consumers each have their own space. Our consumers need to access specific dashboards, nothing more. In the documentation I see consumer should not have their own space. Can anyone suggest to me why these spaces are present and how i can delete them
-
Workflow stuck
Hi all, I have a workflow that has been running now for 2 days - has anyone come across this before and have a solution? Thanks Amie
-
Error mounting volumes when launching ADS
Hiya, We have recently tried to update our ADS image to the latest version (2.14.1) and are now unable to start the container. We are getting the error "Error response from daemon: failed to create task for container: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container…
-
User Information in Dataset get API
Is it possible to get the User Information, ex, who used or created the dataset that Information or Last User Information from the Dataset Get API. I can see that when I am manually doing Get More information the Dataset but not getting that as an output column when I fetch the metadata from API @KatriM
-
Container 7701
After restarting the ADS Container in docker compose I am not able to access on the port we normally would 7701. Can anyone tell me where the web logs are so I can trouble shoot?
-
How to add certificates has changed
Asked by @Rfaas Is there any online documentation available that describes the changes to the Settings > Communication screen where before my latest upgrade (went from 2.11.12 to 2.13.8)? I used to type in the server certificate details, path based on where I put the certificate file on the server. Now with the new 2.13.8…
-
Data Discrepancy Comparison Post-Migration
Does Aperture have an functionality that compares two datasets and highlights any discrepancies between them on a row-by-row and column-by-column basis. I've tried the compare datasets step however it does not highlights the row/column. The scenario is that data has been migrated from an old system to a new system, and as…
-
Controlling who can refresh data sources
Hi, I am dealing with a client who has some requirements regarding refreshing datasets. Their situation is this: - They are/ will be loading large numbers of tables from Salesforce. - They want to create a schedule to refresh these datasets at specific dates/ times. This they know how to do. - The important thing is that…
-
401error when using AutoRest connection as external system for Zendesk API
Good Afternoon, I've created an Autonomous Rest connection and I'm able to access the tables, however when moving to the define settings step inside of the add dataset functionality, I'm getting the following error message. [ApertureDataStudio][AutoREST JDBC Driver][AutoREST]REST Status 401 Unauthorized returned for GET…
-
How do I udpdate my version of ADS? I am currently using 2.12.8.575
Do I need to download as if I was doing for the first time or can just update with the same requirements chosen before?
-
Is anyone using Aperture with the Parquet source file format?
Parquet is associated with Hadoop but I am not sure whether the Hadoop import setup will read this data. Many thanks, Charles
-
Are there any functions to get the biggest value in a column? Like large function in excel?
-
Hey Community! Can anyone help me to create a custom event?
I need to set up an automation between different spaces. TIA
-
AI Capability of Aperture Data Studio
Is there any documentation on the AI capability of Aperture Data Studio? Can you please share the features which Aperture Supports which are driven by AI along with the documentation if any exists. Many Thanks!
-
Does anyone had this problem when trying to schedule?
-
Where do I find the find duplicates rule builder?
Just updated to the latest version available and it indicates that the find duplicates rule builder should be new functionality. Perhaps I am blind? Could someone direct me to where this new functionality resides!?
-
Hi there, any ideas on why I am having a problem with a date column?
When I load the data is showing the date sign on the column but when I ask which datatype it says is alphanumeric and is no letting me change to date.
-
How can I change the space I am receiving an external system's dataset?
I tried to add the dataset from external system but when I press the next button it goes to a place where there is a lot of datasets instead the one I was expecting. Let me know if you can help
-
Storage Details
Could you please confirm me that if we can get the below details from Experian server. how much data storage we are using on the Aperture Server, would it be possible to have a weekly report of dive space both used and free?
-
Error attempting to delete match store
Hi, In my project, we are using Experian Aperture Data Studio(2.10.10) to connect to a Remote Find Duplicate match store(3.8.15) over http. The Find Duplicate step is configured with the 'Clear and re-establish store' checked as part of our requirements. Majority of the time ,the process runs end to end successfully,…
-
Scheduling in Specific Time frame
Hi, Is it possible to schedule my workflow once in a hour from 8:30 am to 8:30 PM? I can see the option for every hour but that option is for running 24 hrs, i want to run only 12 times (8:30, 9:30 , 10:30.. and last at 8:30 PM) Thanks, Mahu
-
How to repeat a single value for each row?
Hi, I have a table, that could have any number of rows from 1-60. I want to add a new column that determines the type of run this is for. I use a prior step to create a single value to be used. I know a workflow parameter would be best, but how do I automatically put the earlier determined value into the parameter? Thanks
-
Invaid Remote URL
We have renewed the SSL certificates for the aperture data studio servers successfully and we have tested the same. We have created the .pfx file and applied the certificate in find duplicate server as well. But when we tried to test the find duplicate through settings—>communications—>workflows, we are getting the below…
-
Issues with Dev Environment Post-Upgrade
I'm reaching out to address some critical issues we've been encountering with our Dev environment following the recent upgrade. After the upgrade to the latest versions, we've been experiencing difficulties that are hindering our work. our current versions: Aperture Data Studio: 2.13.7 Find Duplicates: 3.10.2 Specifically,…
-
Function details through the API?
Is it possible to get a list of functions via the API, similar to how the List Datasets call works (or even space-by space if an environment wide option is not possible)? Unless I'm misunderstanding the documentation, only the sharing details are exposed? Thanks Mike
-
How can I transform multiple columns at once?
This questions had been asked by a user of Data Studio so I'm posting it here for anyone else looking for advice on something similar: I'm building a reusable workflow that outputs the counts of each value in the selected column(s), an example input and output is below. Input: Output: To get the output in the format I…
-
When the next Version is coming? Also the find duplicate version will be updated?
-
Using Github connection?
Hi, Anyone using Github connection to/from Aperture? If so, for what kind of purpose(s)? @Josh Boxer How would you recommend to use that? Br, Katri
-
third party data for use with Facebook ads
Seeking a solution where I can build simple audiences – age 50+, US residents, household income $55000+, living in specific zip codes. Once I build that audience, I need it delivered to my Facebook campaign for targeting within 8 hours (I am happy to upload these audiences to Facebook manually but if this can be automated,…
-
Error Message 4020: A batch error occurred: Data file has expired
Hi community, does anyone knows what does this error means?
-
Error Message : 4022: Input columns different size to output columns
Good morning, I'm trying to get outputs of a particular workflow, see image below, but it fails and returns the title error. The input is coming from the REST API that collects Aperture stats and the grouping is done on the column NAME (see attached file); the Rows to Columns step is introduced to re-orientate the data for…
-
Email notification for job failure and success
Hi Team, We need to set up batch alerting for both failure and success for the below email addresses on the CAIS production environment. But the jobs are not yet placed in the environment. Could you please help us to set up the email notification for both job failure and success. Regards Uma Devi k
-
Load Excel and select/deselect worksheets?
Hi, Is it possible when loading an Excel file, to select only specific worksheets to load? I tried and could not see any options, but wondering if I missed something. Using version 2.12.13.108. Thanks
-
Are Views Materialized?
Hi, just wondering whether views are materialized (and only updated when underlying data is changed) or whether the view logic is executed each time the view is used. Thanks
-
Duplicate Store / Workbench
Hi there, my duplicate store is generation very big clusters and I am struggling to find why is this matching. I am using the workbench and I checked a few records but non of them are matching so my question is. How can I see in a big cluster where and why this records are matching? TIA
-
Unable to connect HDI cluster from Experian production server.
-
Refresh dataset notification
Hello dear community, my use case is: we refresh more that 200 dataset ( from SAP source) in the same refresh workflow. For reasons that we don't know some of these dataset are not being refresh sometime. How can I track the list of dataset the should be refresh but are not ? The issue is that the refresh workflow is not…
-
Is there a way to bypass the QAS validation for certain profiles
Hello, I would like to ask if there is a way for certain profiles not to go through the validation process when entering data
-
Address Validation & Cleansing
@Seamus Kyle Hi Seamus, We have a requirement, where we know the Invalid Address and we want to correct the Address. For Example , We have address Hurtnkatu 2 HYVINKÄÄ FIN 05820 But actual address is: Hurtankatu 2 HYVINKÄÄ FIN 05820 So there was some Spelling mistake. Is it Possible to get teh correct Street Address when…
-
Group in Validate step
Is it possible to Group in Validate Step. My Goal is to get the Data Along with the Stat example I want to see how many contacts are active , inactive and Passive along with that when I click Active stats it shows me the data like the way we can do in interactive snapshot.
-
Matching Rules
Hi there, On the duplicate step when we change the matching rules I wonder if two records are empty this is going to be considered an exact match? Is there a way of not considering an empty field?
-
Aperture Data Studio Certification
Is there any Official Data Studio Certification?
