-
Idea guidelines đź’ˇ
We’re so excited to hear your ideas to make Aperture Data Studio even better. 📌 Before you get started Search for the idea to see if it exists already – we review ideas regularly based on votes, so upvoting an existing idea and commenting with your use case is a great way to get visibility on your idea. When you’re ready…
-
Drill-through for Comparison step
Hi, I recently ran a workflow using the compare step to check differences between 2 systems. I wanted to suggest to add a way right click on the difference value of the column of interest and have the option to see the detailed results for that columns, instead of looking separately on the detailed results for the column…
-
Include system object tags in solution package / deployment
What problem are you facing? When creating / deploying a solution, system object tags set on datasets/views etc. are not included. What impact does this problem have on you/your business? We have used system object tags to ensure a core set of tags are consistent across spaces (e.g. input data, output data, schema). When…
-
Unique download URL for new releases
hi team! thanks for the good work in posting release notes and urls to download. Can I please ask to keep the download URL the same in new releases?every time there is a change in URL, it breaks our automation for auto-updates in our Linux server fleet..from V2 to V3 you guys changed from:…
-
Add object tags for charts
What problem are you facing? Unable to add an object tag to a chart. What impact does this problem have on you/your business? We use tagging to quickly identify where a view or dataset is used (e.g. what dashboard it sits in), without having to open associations for each one. We are unable to do this for charts as there is…
-
Add additional dataset source - dropzone naming
Hi, I really like the capability to have multiple dataset sources, I have used it numerous times - good upgrade. However, I notice that when adding a new source (such as External System), if I select 'Enable external system dropzone' the only name option I get is 'Starts with file pattern' whereas if this was the default…
-
Trash Bin?
What problem are you facing? Deleting of batches often after a failed run. It's nerve racking not to delete a batch as some are very much needed batchs. We track data quality month on month, so accidentially deleting a needed month could happen. What impact does this problem have on you/your business? Huge impact on the…
-
Sticky Notes attached to Workflow step
Just a thought… but it would be really nice if Sticky notes could be pinned to workflow steps (I always provide decisions or descriptions of steps as part of knowledge transfer). That way if I move my workflow step the Sticky note comment moves with it (or worse, someone hits the auto-arrange button and now my Sticky notes…
-
A way to "execute workflow with all batches in the Dataset" when a new batch triggers the execution
What problem are you facing? A common setup in automated end-to-end automation in Data Studio is: when a new batch is added to a multi-batch snapshot, the "dataset refresh" triggers an automation which executes a workflow using that same Dataset as the source. Despite the workflow's source step being configured to use all…
-
Administration Space containing info on all objects
George_Stephen - December 11 "Please create a Administration Space that contains information of all objects in all spaces" This discussion was created from comments split from: Having an issue managing too many objects.
-
A default value for "automatically delete data after N days"
What problem are you facing? Almost all the data loaded into my Data Studio instance has a mandated 90 day retention period. 90 days after load we want to delete any batches that remain. Most data is loaded into new Datasets (in new Spaces) because we are working typically on short-term, one-off projects. There are…
-
Improved Driver support for Teradata data warehouse platform.
What problem are you facing? Improved Driver support for Teradata data warehouse platform. We currently have to use the JDBC driver supplied by Teradata, which is not native to ADS and it generally works, but we do encounter many issues like data type conversion issues. Would be nice to have an alternative Teradata ODBC…
-
Manually reviewing clusters of duplicate records (Stewardship)
What problem are you facing? As a Find duplicates user I want to be able to manually evaluate and change clusters of records where I think the rules have matched records incorrectly e.g. I've got a husband and wife in my data, both called M. Smith and they share the same postal address, email address and loyalty card…
-
Find Duplicates: handling of Gmail email modifiers
What problem are you facing? The Email and Email_Local elements in Find Duplicates Standardization currently retain all characters by default, including dots (.) and plus-aliases (+alias) in the local part of email addresses. This means that emails like johnsmith@email .com, john.smith@email .com, and john+alias@email .com…
-
Whatsapp Validation as replacement for Email validation
What problem are you facing? An Indonesian based financial services company is looking to replace Experian's Mobile Validation with Whatsapp Validation as Whatsapp validation is the main method of communication there as its cheaper than calling or texting mobile numbers. Curious to know if this has been requested by other…
-
Dataset API - External System DropZone
What problem are you facing? The dataset API only shows if the "server dropzone" is enabled or not, the "external system dropzone" is not included in the return data. What impact does this problem have on you/your business? The API does not include all dropzone metadata associated with the dataset. This makes validating a…
-
Push down processing connection to Big Query
What problem are you facing? Comparing bank transactions at the bank is a major issue and time consuming exercise when trying to review large volumes of data. Some data points include types of offerings a customer may have for further loan/services approval ie. Mortgage, current account, personal loan, credit card…
-
Synthethic Data - Asks from clients
What problem are you facing? Long project timelines replicating data from production and masking PII information What impact does this problem have on you/your business? Time to project timelines as well as security risk by managing large volumes of PII information ie, credit card details, bank account numbers. Do you have…
-
Ability to List Automations (eg. API)
What problem are you facing? I need to ensure that automations have been created for specific tasks associated with specific entities. This allows validation for myself and my client that the work is complete, and no tasks are missing. What impact does this problem have on you/your business? With a large set of…
-
Option to include Group Name in Validate All Result
What problem are you facing? Validate Step All Results - Duplicate Rule names used in different groups result in indistinguishable columns What impact does this problem have on you/your business? We have occasion where we need to group our results into various sub-populations, so we take the All Results output then apply…
-
To be able to use groups and group permissions when using SAML and LDAP
What problem are you facing? Administrators are currently having to add individual users. This is a pain when a customer has more than 10 users to add. What impact does this problem have on you/your business? Not user friendly and time consuming to add users. Do you have any existing workarounds? If so, please describe…
-
Combine Filter/Split step
Hi, I'm raising this on here as it's come up a few times with various users and I want to see what others' think of the idea to essentially combine the filter and split steps (which perform the same action, with the only difference being the split step allows users to view unfiltered results): vs I myself have found on…
-
View batch data as an action item under 'Show Batches'
What problem are you facing? When I take the option 'Show batches' for a dataset, I see the list of batches for that dataset, including all the helpful metadata. If I select 'Action' the only option I get is 'Delete'. It would be very helpful if 'View' was an option to see data for that selected batch. What impact does…
-
Add record limit to source step
What problem are you facing? Working with very large datasets, sometimes hundreds of millions of records, in order to debug a workflow, I often find myself adding a sample tool after each source so that I can preview results at different steps in the workflow. Otherwise it can take hours waiting for 'show step results'. It…
-
Group Step Sum of Nulls should return Null
What problem are you facing? When getting the Sum of a column via a Group Step, if all the values considered in the aggregation are Null, the Sum presently returns zero. This makes it impossible to distinguish whether all the values were Null or if the data contained numbers with a sum of zero. This distinction may matter.…
-
Determine the minimum numeric value when column contains null/string values
What problem are you facing? The "minimum" aggregate returns null() as the minimum if at least one of the values in a column are empty. What impact does this problem have on you/your business? This impacts data quality and returns incorrect results for aggregates when dealing with numeric values. Do you have any existing…
-
Auto discovery of keys (foreign, primary)
Logging this idea on behalf of @AlanB (feel free to add further commentary) What problem are you facing? We are starting a migration project from a largely undocumented system and need to identify how the various tables relate to one another (e.g. what are the foreign / primary keys, potential joins as well as conducting…
-
Highlight steps connection in Read Mode
What problem are you facing? Users without edit permission can't trace the flow between workflow steps in large workflows. It would be useful if the lines could be highlighted when clicked on (like in edit mode). What impact does this problem have on you/your business? It impacts productivity, takes a long time to trace…
-
Configuration of Line Endings in Export Step
What problem are you facing? The option to select what type of Line ending that should be applied to an export What impact does this problem have on you/your business? Different clients have requests on the specific file format they want depending on how they load these files. There are some that request their files with…
-
On Schedules List Screen - Include whether Refresh Sources
What problem are you facing? On the schedules list screen, I have to go into each individual item to confirm if 'Refresh Sources' and what type of schedule has been configured (Refresh dataset or Run workflow). What impact does this problem have on you/your business? Ease of use impacted. Having 'Refresh Sources' and 'Task…
-
Session API is now set to get first 100K
What problem are you facing? It looks like the Sessions and Events endpoints have an internally configured maximum number of records to return, which is set to 100k. This would be in place to prevent the API response from getting too large, but paging of the response would seem to be a better solution. What impact does…
-
Allow worksheet naming at the Export step
What problem are you facing? When exporting data to Excel, I like to have each worksheet named according to the function or type of data being presented. To do this, the prior step must be named and that gets passed to the export step. However, if the workflow is changed and new steps are added prior to the export, the…
-
A way to avoid writing zero-row batches to Datasets
What problem are you facing? I have a workflow that runs regularly, and includes a filter step that only retains "error condition" records. These records are then written into a multi-batch snapshot using Take Snapshot The problem is that most of the time, there are no error conditions, meaning there are no rows to write…
-
Group Step > Being able to select and right click view multiple rows in groups
What problem are you facing? When the Group step is used, we can only view rows in group on one value. What impact does this problem have on you/your business? Feedback received of this not being user friendly and having to exit the screen to be able to get to the multiple filtered values. Do you have any existing…
-
đź“Š New chart types
With an increasing number of users now spending more and more time building (and then interacting with) charts and dashboards, there are a couple of additional requests I'm hearing cropping up relating to this so I'm posting them on here for discussion and to get the wider Community's thoughts. They are: Adding some new…
-
Prevent object tags from requiring a workflow to be re-published
What problem are you facing? I have applied the new Object Tags to various workflows. In each case the workflow status changed from Published to Draft when the Object Tag was saved. The tags can be bulk added but the workflows must then all be individually re-published and a comment added. What impact does this problem…
-
Include Metadata in the Export step
What problem are you facing? I would like to include metadata in the export step (specifically in the JDBC option) that includes metadata for the target system and table (e.g. tablename, DBMS system, credentials used etc.) as this would help users / DBAs to debug/resolve any issues or be included in a point-in-time audit…
-
Adding gzip Compression Method
What problem are you facing? gzip(.gz) compression method option not available when adding of compressed datasets and in the export step for compress or compress and encrypt. What impact does this problem have on you/your business? Most internal and clients files are compressed using .gz. This is has been the case for…
-
Issue list as a source for charts & indexes?
It would be so helpful if Issue lists could be used as a data source for charts and indexes. For example, I have a nice donut chart of my issues (includes custom status) that I share with a customer in a dashboard. Currently, I have to send the issue list data to a dataset and then let the chart use that dataset for the…
-
UX Improvement - Output label case sensitive
What problem are you facing? The Workflow step output names/labels are being all converted to lower case when the reusable workflow is added inside another workflow. What impact does this problem have on you/your business? It makes it more difficult to distinguish between outputs, especially when there are several, which…
-
Adding an Owner to my business rules
Submitted on behalf of a customer. We have created many different validation rules to monitor the quality of different datasets over time. It would be useful to denote who is the owner of a specific rule in case changes need to be made in future.
-
OAuth 2.0 authentication method with Snowflake
What problem are you facing? How can we connect to Snowflake external system with OAuth 2.0 authentication method? What impact does this problem have on you/your business? We cannot develop new functionalities. Do you have any existing workarounds? If so, please describe those. We can connect through a user ID / password…
-
UX improvement - connecting Workflow steps
Submitting on behalf of a user: What problem are you facing? Sometimes it can be a bit tricky connecting two workflow steps that have ended up far apart. What impact does this problem have on you/your business? It's a bit fiddly and slightly more time consuming. Do you have any existing workarounds? If so, please describe…
-
Export Data Object to external systems
Submitting on behalf of a client: What problem are you facing? Cannot export the new data objects to external systems, re-work of re-tagging is time consuming. What impact does this problem have on you/your business? Time consuming and need to match the object tags back to the relevant CDE's Do you have any existing…
-
Drop-down picklist instead of free text entry for re-usable workflows
What problem are you facing? Currently re-usable workflows allow a free text input option, which suggests most recent entries. The value entered will be used in processing within the workflow, often relating to fields/data to use for matching etc. This leaves risk of error, if the user enters a typo, which could result in…
-
Different date formats not being recognized as a date
What problem are you facing? Because the data is coming from many different sources the dates have different formats and when they are mixed up in one input it gets difficult to put them in the same format as they are not recognized as date datatype, so I would love to be able to just use the format date function and fix…
-
Importing data into Salesforce child objects
I have a user case to use out of the box functionality that come with Salesforce and is available in the Progress Driver to relate data in parent and child objects on import. In a Salesforce object you can designate a field as an external ID. When you load a child object such as Contact where the parent is Account and you…
-
Ability to select specific last number of batches in charts
What problem are you facing? For charts, if I only want to list the last N batches, I have to create a whole new process to create a new dataset. What impact does this problem have on you/your business? Extra maintenance and resources Do you have any existing workarounds? If so, please describe those. Use workflow to…
-
Having an issue managing too many objects
Submitted on behalf of a customer. Multiple active users collaborating in a Space have created many Workflows and Views etc. It is becoming difficult to quickly find the specific item that you are looking for sometimes needing to go in and out of a few things before finding the correct item. It would be good if the…
-
Add additional List object APIs such as Views
End point for View is required currently we have only for datasets Exporatble objects end point only provides Space specific output, it would be helpful if we can get output for all spaces. We have 40+ spaces its very difficult to create 40+ rest files to get this.
-
Add schema changes to Snapshot automatically
Submitting this on behalf of various Data Studio users. What problem are you facing? I've got a Dataset that will regularly add columns and I need to create a Snapshot for this. But my snapshot requires a given schema and to change the accepted schema I have to map the columns manually. Is there a way for Snapshots to…
-
Apply Filter memory functionality to Custom Events screen
In the Workflows, Datasets and Automations screens, users can use the Search box to filter and find the item they are looking for. When users have edited that item and closed it, the screen remembers the filter that was previously applied. This doesn't happen in the Custom Events screen - the filter is lost and the view…
-
Creation date
Adding the 'Creation date' in the objects listing (workflows, functions, etc) would be a very useful feature.
-
If-else flow in workflow
Please introduce an if-else logic in workflow step. Currently this is being achieved with issuing fire-events and executing next workflow based on the fire event. It would be nice to control the workflow steps with if-else logic. Please let me know if there is a better way to execute if-else logic other than using fire…
-
Job execution details to capture column mappings
Some of our workflows, when ran using difference sources (for different clients), will have different column mappings at job execution vs workflow definition. Could this be displayed as part of the Job Execution Details? We require functionality like this to report on what column mappings and parameter values have been…
-
Visualisation improvements
It will be great to see one view shared across which all spaces and which all wfs
-
Option in Schedules to run without Fire Events
A while ago Experian kindly added in an option to run individual workflows without the Fire Events being triggered. Would it be possible to add the same option for a whole Schedule of workflows? I've been asked if I can refresh a large number of workflows so we can see their results but without the emails being sent to…
-
Data refresh not adding a new column without a manual refresh.
Dataset refresh does not add a new column, when it is added in the table in source system. Manual refresh is required in that case
-
Avoiding the same data being loaded into multiple Spaces
Submitted on behalf of a customer. Sometimes users might be unaware that the data they are about to load already exists in a different Space. Rather than sharing it as a View we end up with multiple versions of the same data making it difficult to know which is the correct version to use. One idea is an administrator…
-
Manually reviewing clustered matches
Submitted on behalf of a customer. There are tools in the workbench that are useful to analyze Find duplicates match results, but the problem we are having is when there are records matched as a Possible match within a cluster we want to manually review them and maybe allow the reviewer to set them as a definite match or…
