Guidance Needed: Transitioning Data Sources from HD Insights to Databricks

Sneha Muthukumar
Sneha Muthukumar Member
edited May 28 in General

Hi Team,

We are anticipating changes in our datastore architecture, which will significantly impact datasets and views currently sourced from HD Insights. These sources will need to be repointed to Databricks as part of the transition.

Could you please advise on the possible solutions or best practices for handling this migration?

Looking forward to your suggestions.

Tagged:

Comments

  • Josh Boxer
    Josh Boxer Administrator
    edited May 28

    Firstly, the Compare step is useful to ensure data has been migrated successfully.

    Secondly, in v2.16.4 we added the ability for multiple Sources to write to a Dataset:
    https://community.experianaperture.io/discussion/1508/aperture-data-studio-2-16-4

    So you can add a Databricks table as a new source to a Dataset that is currently still receiving data from HD Insights

Categories