13_ProcessRecords

Question 1

What does the ForEach scope do?

Answer 1

Splits a payload collection and processes the individual elements and returns the original payload.

Question 2

What happens in a ForEach scope if an error occurs?

Answer 2

Stops processing and invokes an error if one element throws an exception.

Question 3

What does the ForEach scope return?

Answer 3

The original paylaod (regardless of any modifications made inside the scope)

Question 4

What can a collection be (for a ForEach scope)?

Answer 4

can be any supported content type including applicationjson, aplication/java and application/xml

Question 5

What does the batch job provide?

Answer 5

The ability to split large messages and process them asynchronously in a batch jon.

Question 6

Where is the batch job scope available?

Answer 6

Enterprise edition only.

Question 7

What is created especially for processing data sets?

Answer 7

Batch Job scope.

Question 8

What splits large or streamed messages into individual records, performs actions upon each record, handles record level failures that ocure so batch job is not aborted, reports on the results and potentially pushes the prcessed output to other systems or queues.

Answer 8

Batch Job scope.

Question 9

Example use cases for Batch Job scope.

Answer 9

• Integrating data sets to parallel process records
– Small or large data sets, streaming or not
• Engineering “near real-time” data integration
– Synchronizing data sets between business applications
– Like syncing contacts between NetSuite and Salesforce
• Extracting, transforming, and loading (ETL) info into a target system
– Like uploading data from a flat file (CSV) to Hadoop
• Handling large quantities of incoming data from an API into a legacy
system

Question 10

A batch job contains one or more ?

Answer 10

Batch steps

Question 11

What are the 3 different phases in a batch job?

Answer 11

Load and dispatch (behind the scene work), Process (asynchronoulsy processes the records and contains one or more batch steps), On Complete (optional - reports summary of records processed, rovised insight into which records failed so you can address issues).

Question 12

Do all records have to finish processing in one step before any of them are send to the next step?

Answer 12

No

Question 13

Batch records are queued and scheduled in blocks of? and a threading profile of ?? threads per job?

Answer 13

100 records, 16 threads

Question 14

Can you customise the configuration for the block and threads?

Answer 14

Yes, as it may improve the batch’s performance in certain use cases

Question 15

Variables created BEFORE a batch job are available where?

Answer 15

in ALL batch steps

Question 16

Variables created inside a batch step are available where?

Answer 16

Only in the batch step that they were created.

Question 17

What are the 3 options if a record fails in a batch job?

Answer 17

Stop processing (the entire batch, the in-flight steps are finished but other steps are skipped and the on complete phase invoked), Continue processing (you should handle failed records using the batch step filters), Continue processing until a max number of failed records is reached (at that point, the on complete phase is invoked).

Question 18

What happens when the record fails and it stops processing the entire batch?

Answer 18

• In-flight steps are finished, but all other steps are skipped and the on complete phase is
invoked

Question 19

What happens when the record fails and it continues processing?

Answer 19

You need to specify how subsequent batch steps should handle failed records
– To do this, use batch step filters that are covered in the next section

Question 20

What happens when the record fails and it continues processing until a max number of failed records is reached?

Answer 20

At that point, the on complete phase is invoked

Question 21

What are the 2 attributes that are used to filter a record for a batch job?

Answer 21

An accept expression and an accept policy

Question 22

What is an accept expression?

Answer 22

Used in a batch job to filter the records, it’s an inline expression that will decide if that part of the collection will be processed. e.g. #[not var.exists]

Question 23

What is an accept policy?

Answer 23

Used in a batch job to filter out records, either set to ALL, NO_FAILURES (default) or ONLY_FAILURES

Question 24

Batch Aggregator scope do?

Answer 24

It accumulates records, it can upload them in bulk e.g. instead of inserting 100 individual records it will do it all in 1 insert.

Question 25

What can you use to accumulate records?

Answer 25

Batch Aggregator

Question 26

Does the ForEach scope process the elements sequentially?

Answer 26

Yes

Question 27

Examples of complex batch jobs.

Answer 27

Created especially for processing data sets
– Splits messages into individual records and performs actions upon each record
– Can have multiple batch steps and these can have filters
– Record-level data is persisted across steps using variables
– Can handle record level failures so the job is not aborted
– The batch job returns an object with the results of the job for insight into which
records were processed or failed