SAP Analytics Cloud

Pentaho Data Integration provides the capability to create an ETL framework using Meta data ingestion method. This approach will allow to generalize ETL transformations that can change the behavior during run time. Instead of creating individual ETL transformations for each source entity, Pentaho Data Integration can create a template transformation for a specific functionality and ingest meta data information to this template from property files or data base tables.

Advantages of using Pentaho Data Integration Metadata approach
With Meta data Injection, developer agility and productivity will accelerate.
Instead of creating and maintaining dozens of transformations built with a common pattern, developers define a single transformation template and change its run time behavior by gathering and injecting meta data from property files or database tables.
Maintenance and updates required for any ETL change will be very minimal. We may need to change only the Meta data information if there is any change in the source. For e.g., additional columns, sata type changes, removing columns, etc.

This might interest you as well

Best practices for real-time Analytics Architecture on Big Data

Read blog post

Enhanced Big Data Insights with Pentaho 8.0

Read blog post

GrayMatter SAP Center of Excellence (CoE) Customer Success Stories

PDI best practices – Why avoid insert/update step

Read blog post