ETL Data Pipelines

Question 1

What is process Intelligence ETL?

Answer 1

The data ingestion component. It automates data extractions and transformations from external source systems and loads it directly to SAP Signavio Process Intelligence

Question 2

How is this setup on process intelligence?

Answer 2

there is not need to configure a staging environment, if you’re extracting from on-prem it requires an additional setup on the system side

Question 3

[creation of ETL Data Pipelines] What happens during the Extract phase?

Answer 3

1. configure data sources
2. configure integrations
3. click extract

Question 4

[creation of ETL Data Pipelines] What happens during the Transform phase?

Answer 4

1. configure business objects [sql scripts]
2. preview sql scripts

Question 5

[creation of ETL Data Pipelines] What happens during the Load phase?

Answer 5

1. select or create a process
2. click run

Question 6

What does SAP Signavio ETL use to carry out ETL?

Answer 6

they use standard connectors and provides an interface to extract, transform and load data. All interaction stays within the system.

Question 7

what are the 3 main components of PI ETL

Answer 7

1- data source management
2. integration management
3. data model management

[image 6]

Question 8

What do the the 3 main components do?

Answer 8

they are the integrated features of ETL, which together setup data pipelines

Question 9

What is data source management

Answer 9

the framework to manage online data sources. it includes credential mgmt and scheduling

Question 10

What does data sources establish?

Answer 10

a connection to the source system

Question 11

What is integration management

Answer 11

the framework to define what, how and when to extract data. it includes pseudonymisation (techniques that replace, remove or transform information that identifies individuals, and keep that information separate) and partitioning schemas

Question 12

How to extract, when the system is on prem?

Answer 12

On-premises Extractors are needed, it can then be set up under integrations where the specific tables and schedules for continuous loads can be defined

Question 13

What are the two options for integration?

Answer 13

1. Simple method
2. intricate method

Question 14

What is the simple method?

Answer 14

select the tables and fields through a graphical interface.
you can add a partition strategy in case of large tables and define field using a delta criteria

Question 16

What is the intricate method?

Answer 16

write your own extraction scripts with SQL

Question 16

When integrating, what is the default extraction time and why?

Answer 16

midnight (although continuous loads can be customised)
because data extraction should be done when the load on the source system has the least impact

Question 17

What is data model management

Answer 17

the framework to transform your data into an event-log starting from connected integrations and extractions.
This is also when you connect your data to an investigation to start the process analysis.
It includes process orientated data modeling, SQL editors for the transformation and live previews of transformed data.

Question 18

What do you do in a data model?

Answer 18

define how the ETL data pipeline extracts and transforms data, and where to load the data.

Question 19

5 steps to creating and using data model

Answer 19

1. create a new data model
2. select source system
3. select the data model template
4. select integration
5. select the configured data source

Question 20

A data model in SAP Signavio ETL has different sections - what is shown in the extraction section?

Answer 20

1. the connector - aka how we accessed the data on the source system eg. sap ecc
2. integration - what data we extracted from a source system - we can add new data or use a pre selected model template

Question 21

A data model in SAP Signavio ETL has different sections - what is shown in the transformation section?

Answer 21

[it looks like a BPMN model]
1. process events - representing main events
2. business objects - transformation rules for the case attributes and events

Question 22

What is an event collector?

Answer 22

the scripts for an event

Question 23

How can you adjust transformation rules

Answer 23

using SQL