-
Best practice for checking that Datasets have been refreshed
A user asked this question: We have hundreds of datasets we need to refresh before a migration, what is the best practice in ADS to make sure they have all been updated, without adding a source in a workflow for every dataset can you iterate through the desired datasets and look at the metadata to determine when it was…
-
What's the syntax for the Dataset "file pattern" text when loading from an SFTP dropzone?
I'm setting up a Dataset that automatically refreshes with data from files dropped into an External System dropzone (SFTP in this case). I only want to load specific files, determined by the file name. To do this, I was going to use the "Starts with file pattern" config option, but I couldn't find any information about the…
-
Experian REST API for Dataset Creation
Hi, Can someone please help me with the JSON request to create a dataset using SQL query? Below are my dataset requirements a. Type : JDBC(SQL Server 6.0) b. Allow Refresh : True c. AllowBatchDeletion : False
-
Experian Aperture Data Studio REST API error
Hi, I am planning to automate dataset creation using Data studio REST API, however I am getting 401 Authorization Error. Background Experian data Studio version - 2.14.14 SSL setup done on the data studio url and private CA is added to the trust store under E:\ApertureDataStudio\certificates\cacerts Please see the steps…
-
Automatic Deletion of Dataset
Hi, Is there a way we can delete the data in the dataset by setting up some Process? For example running a WF to delete the data in the Dataset. But we want to keep the Dataset metadata. Thanks.
-
User Information in Dataset get API
Is it possible to get the User Information, ex, who used or created the dataset that Information or Last User Information from the Dataset Get API. I can see that when I am manually doing Get More information the Dataset but not getting that as an output column when I fetch the metadata from API @KatriM
-
Data Discrepancy Comparison Post-Migration
Does Aperture have an functionality that compares two datasets and highlights any discrepancies between them on a row-by-row and column-by-column basis. I've tried the compare datasets step however it does not highlights the row/column. The scenario is that data has been migrated from an old system to a new system, and as…
-
Refresh dataset notification
Hello dear community, my use case is: we refresh more that 200 dataset ( from SAP source) in the same refresh workflow. For reasons that we don't know some of these dataset are not being refresh sometime. How can I track the list of dataset the should be refresh but are not ? The issue is that the refresh workflow is not…
-
Business Validation and Enrichment
Aperture is a powerful tool when validating business information you already have. We can leverage trusted address sources, like the Royal Mail’s Postal Address File, for the UK. This will ensure that the addresses and business name information you hold is accurate and deliverable as per that trusted source. That’s all…
-
SalesForce refresh failed to process query: INVALID_FIELD
We have scheduled refresh Jobs to refresh the Tables on daily basis. The Wfs are getting the status completed but the tables are actually not getting refreshed. I tried to manually refesh as well but that is also not working. This is happening when there is new column added in the tables and that tables is not getting…
-
Handling data from Experian Aperture Data Studio jobs
We are getting error in the execution of Experian scheduled jobs as "There is not enough space on the disk" We have installed the data from the Experian Aperture Data Studio on the E Drive (511 GB) out of which only 19 GB is remaining. Majority of the data is occupied in the E:\ApertureDataStudio\data\resource folder under…
-
Copy of FiServ Files uploaded into DA & use of the Metro2 Parser
Does anyone use Data Arc with a copy of a FiServ Metro2 File? We are setting this up as net new and it appears that FiServ does not include the RDW in the header or the file. This is limiting our ability to upload the dataset into the tool. Has anyone had any experience with this?
-
Stored Procedure invoked from PostSQL of Export step is not processing all records
hi, In my workflow, I am connecting to SQL server 2012 using Custom JDBC jar (Microsoft JDBC Jar 12.2) and the connection string looks like below…
-
Error while connecting to Embedded Duplicate Store
Hi, I am getting error as below when I am trying to connect to the Embedded Duplicate store in my Data studio server(2.10.10). Please let me know if you have faced similar issue and help me with the steps to resolve this. PS: We do have a remote duplicate store(3.8.15) which is working fine and we have secured the Data…
-
Error while invoking stored procedure from Experian Aperture Data Studio using custom JDBC driver
Hi, I am using the Experian Aperture Data Studio (2.10.0.80) and have configured a custom JDBC Jar for adding Microsoft SQL Server Driver to query On premise SQL server(Microsoft SQL Server 2012 (SP4-GDR) (KB4532098) - 11.0.7493.4). With this driver, I am able to perform DML SQL queries like Select, Insert and Update.…
-
Can we create a Dropzone folder where we can use multiple files?
Currently we can create One folder Per Dataset where I can use only one file to be uploaded. Can we have a folder in Dropzone where I can Place Multiple files together in the same folder? As this is now Dataset specific folder so is that be possible now to load multiple files?
-
How to delete Duplicate external systems and tag dataset with the actual one
How to delete Duplicate external systems in a space and then tag datasets that belongs to that external system to the unique external system name.' ex. I have database abc in my space I see another external systems with same cred is there as abc1 (might be created or cloned when copied one space to other or one env to…
-
Snowflake Issues with Dataset Creation
We have deployed the proper snowflake drivers and have successfully connected to a hosted warehouse. Initially we had some sporadic failures connecting, but feel it might be related to the "Auto Close" or "Auto Shutdown" options in Snowflake. We increased the timeout value on the connection string and it seems to have…
-
Incrementally Loading Datasets
I've thought through a few different ways that I can use to incrementally load a dataset using batches in the dataset and views on the source side. However, I'm wondering if anyone else has done some work around that and would be willing to share their thoughts / ideas. Essentially we have some really large tables which we…
-
Datasets not refreshing automatically
Hi, We built an integrated set of schedules and workflows that allows data from existent datasets to be refreshed on a daily basis. However, the refresh only happens if it is done manually per dataset. It was noticed when the dataset A (OBJALG as per screenshot) was refreshed, the number of records should have increased…
-
Does Aperture have the "treat leading zeros as alphanumeric" option that Pandora had
One a a global setting that instructed Pandora to treat any input field with leading zeros as alphanumeric so that the leading zeros were preserved. While I can see that one can set a field which has can have leading zeros as alphanumeric, this seems to require an analysis of the data to know that it has leading zeros -…
-
Configuration of a dropzone
Hi, We are working on the plan for integrating an application and Aperture. The latest was that a dropzone was going to be set up where we could store all the relevant files, which Aperture could then pick up. However, we have some questions around Aperture dropzones . Given the sensitive nature of this data, we need to…
-
SAP Views as Datasets
Has anyone used SAP views as a datasets? I have a strange situation where SAP View can be defined thru SQL (select * from sap_view) but I cannot define the view as a dataset directly. The view is not visible to pick from. Did anyone face this issue? Is there a solution?
-
Issue with dates being read as American dates
I am pulling in my source data with a column that contains dates of the format dd/mm/yyyy. When annotating the columns, I have specified the column to be a date column. Now ready to explore my data, most of the dates in the column have correctly loaded in format dd/mm/yyyy. However some have converted to format dd-MMM-yyyy…
-
Drop zone configuration in server.properties
Hi Team, Can we configure customize datadropzone folder at different shared location same as export directory by editing server.properties file? Thank you kin advance Best regards
-
🎞 A Short Feature Demo on dataset management in Data Studio
-
Profiling Data for the first time and changing the underlying data
This short video illustrates the ease with which you can define a dataset, profile the data to dynamically refresh via a view and then change the contents of the dataset without having to define it all over again
-
Fixed Width file parsing in Aperture Data Studio v1 versus v2
Fixed width files may be one of the common file formats that you have come across and need to process. You will often find that this would be more challenging as compared to a comma separated or Excel file. Here is an example of a small section in a layout to be submitted to the IRS (Internal Revenue Service) of the United…