What Is ETL (Extract, Transform, Load) ?

ETL Stands for Extract Transform and Load. In different organizations there are different scenarios where we have to extract data from different sources such as Excel, Text Files, XML, Database systems etc. and then clean that data or transform that data according to our required format and save it to Destinations such as Database system or in different file types.

To perform ETL task , there are different tools available in market. Some of them are listed below

  • SQL Server Integration Services
  • IBM Infosphere Information Server
  • PowerCenter Informatica
  • Oracle Data Integrator (ODI)
  • Centerprise
Open source ETL solutions like:
AutomateIt - AutomateIt is an open source tool for automating the setup and maintenance of servers, applications and their dependencies, providing a way to manage files, packages, services, networks, accounts, roles, templates and more.

CloverETL - CloverETL is open source data integration platform based on Java. It can be used for data migration, data cleansing and other data transformation tasks.

Pentaho - Kettle - Delivers powerful Extraction, Transformation and Loading (ETL) capabilities using an innovative, metadata-driven approach. With an intuitive, graphical, drag and drop design environment, and a proven, scalable, standards-based architecture, Pentaho Data Integration is increasingly the choice for organizations over traditional, proprietary ETL or data integration tools.

Talend - Talend offers open source middleware solutions that address big data integration, data management and application integration needs for businesses of all sizes.

The importance of data and analytics

The efficient use of data and analytics, often becomes the competitive differentiator. Enterprises collect a wealth of data around consumer behavior, transaction details, traffic data, competitive data. The information might reside in the transaction database, web analytics database, SQL database or third party systems and is brought onto a single platform using ETL technologies so that it can be assimilated to extract valuable business insights.

Popular posts from this blog

How to get Active Transactions and Locks from MySQL

Example of a PAC file