Data Migration using Smart Data Frameworks

What is Smart Data Frameworks?

Key Features

Other Features

How does SDF Work?

Articles

Resources

Further Information

What is Smart Data Frameworks?

Smart Data Frameworks is an off the shelf solution for enterprises looking to migrate between almost any database platform to almost any other database platform. It has been developed to allow faster, cheaper and better data integration with shorter time to value. By allowing developers and DBAs to focus on higher value business user needs, our framework takes the risk, cost and time out of “Lift and Shift” type upgrades.

Key Features

Smart Data Frameworks will allow you to:

Migrate an existing PureData for Analytics (PDA)/Netezza, Oracle, SQL Server, Teradata, Yellowbrick, MySQL, Greenplum, Snowflake, PostgreSQL, Google Big Table, or Db2 database to any of the above database types with just a few clicks,
Keep a source and target system in sync by periodically detecting and migrating deltas between the two,
Reconcile and validate that migrated data matches source data,
Automatically, regularly, and reliably load sequences of flat file source data in the most performant way possible,
Automatically generate custom extract, load, and transform (ELT) and data quality detection logic,
Run SQL scripts against any ODBC-compliant database from any device via a web browser

Smart Data Frameworks (SDF) improves developer productivity, quality, and consistency, whilst simultaneously reducing development, testing, and maintenance timescales, costs, and risk.

Other Features

Integrated Release Management for migrating code and database objects between different environments
Automatic email alerts when scheduled processes fail, for whatever reason
Native Teradata function and feature (e.g. SET tables, case insensitive character comparisons) compatibility

How does SDF work?

Smart Data Frameworks consists of:

A pre-configured virtual machine containing a number of pre-installed software components
A dedicated metadata database repository for storing control and log information
Customisable templates for performing data management tasks other than just loading e.g. referential integrity checking; database housekeeping; etc.
A portable GUI front end (that runs on Windows, OSX, Linux, and HTML 5 web clients) for configuring Framework metadata parameters and monitoring the status of executed code
A command line interface for the scripting/scheduling/execution of Framework data management processes