In this post I have shared my experience of designing and developing an OIM schedule job that uses multi threaded approach for updating data in OIM using APIs. I have used thread pool (in particular fixed thread pool) pattern in developing the OIM schedule job. The thread pooling pattern has noted advantages compared to thread per task approach. I have listed few of the advantage here
· Threads are reused
· Creation and tear-down cost of thread is reduced
· Task execution latency is reduced
· Improved performance
· Controlled and efficient management of memory and resources used by threads
More about java thread pool http://docs.oracle.com/javase/tutorial/essential/concurrency/pools.html
The following diagram depicts the high-level architectural diagram of the schedule job that process input from a flat file to update OIM process form data using fixed thread pool approach
The
custom scheduled job shared in this post is developed to meet following requirement
1) Need to process a CSV extract that contains identity, account identifying key and list of data to be updated on an existing OIM resource account.
2) CSV file can contain data for multiple resources configured in OIM
3) List of attribute to update and mapping between CSV column to OIM fields may vary between resources
The following are three Java class developed for this requirement (I have given only prototype of the code that explains how to use thread pools in schedule task)
CustomScheduler.java - Implementation of TaskSupport class that reads and passes the parameters configured on the schedule job to Thread Executor class.
package com.oracle.oim.scheduler;
import java.util.HashMap;
import com.oracle.oim.bo.MultiThreadDataRecon;
import oracle.iam.scheduler.vo.TaskSupport;
public class CustomScheduler extends TaskSupport {
public void execute(HashMap options) throws Exception {
/* Read Schedule Job Parameters */
String param1 = (String) options.get(“Parameter1”);
.
int noOfThread = (int) options.get(“No of Threads”);
.
String paramn = (int) options.get(“ParamterN”);
/* Provide all the required input configured on schedule job to Thread Pool Executor implementation class like 1) Name of the file, 2) Delimiter 3) Header Row Numer 4) Line Escape character 5) Config and resource map lookup 6) No the thread to create */
new MultiThreadDataRecon(all_required_parameters, noOfThreads).reconcile();
}
public HashMap getAttributes() { return null; }
public void setAttributes() { }
}
MultiThreadDataRecon.java – Helper class that reads data from input file, initialize the thread executor and builds the task queue.
package com.oracle.oim.bo;
import <required file IO classes>;
import <required java.util classes>;
import <required OIM API classes>;
import <csv reader api>;
public class MultiThreadDataRecon {
private int noOfThreads;
private ExecutorService threadExecutor = null;
public MetaDataRecon(<required params>, int noOfThreads) {
//Store parameters locally
.
.
this.noOfThread = noOfThread;
}
/**
* Initialize
*/
private void init() throws Exception {
try {
// Initialize CSV file reader API objects
// Initialize OIM API objects
/* Initialize Fixed Thread Pool Executor class if no of threads
configured is more than 1 */
if (noOfThreads > 1) {
threadExecutor = Executors.newFixedThreadPool(noOfThreads);
} else {
threadExecutor = Executors.newSingleThreadExecutor();
}
/* Initialize TaskProcess clas s which will be executing task
from the Queue */
TaskProcessor.initializeConfig(params);
} catch (***Exception e) {
// TO DO
}
}
/**
* Method to reconcile data from CSV to OIM
*/
public void reconcile() throws Exception {
try {
init();
while(<csv file has line>){
processRow(line);
}
/* Initiate thread shutdown */
threadExecutor.shutdown();
while (!threadExecutor.isTerminated()) {
// Wait for all task to complete.
}
} catch (Exception e) {
// TO DO
} finally {
try {
//Close all the file handles
} catch (IOException e) {
//TO DO
}
}
}
/**
* Method to process
*/
private void processRow(String row) {
// Create task processor instance with the row data
// Following code push the task to work queue and wait for next
available thread to execute
threadExecutor.execute(new TaskProcessor(rowData));
}
}
TaskProcessor.java – Implementation of “Runnable” interface that executes the required business logic to update data in OIM.
package com.oracle.oim.bo;
import <required APIs>
class TaskProcessor implements Runnable {
//Initialize required member variables
/**
* Constructor
*/
public TaskProcessor(<row data>) {
// Initialize and parse csv row
}
/*
* Method to initialize required object for task execution
*/
public static void initializeConfig(<params>) {
// Process param and initialize the required configs and object
}
/*
* (non-Javadoc)
*
* @see java.lang.Runnable#run()
*/
public void run() {
if (<is csv data valid>){
processData();
}
}
/**
* Process the the received CSV input
*/
private void processData() {
try{
//Find the user in OIM using the identity matching key value from CSV
// Find the account to be update from user’s account based on account identifying key on CSV
// Update the account with data from CSV
}catch(***Exception e){
//TO DO
}
}
}
