Search This Blog

Monday, August 1, 2011

How can I tune a graph so it does not excessivly consume my CPU? How to Tune a Graph Against Excessive CPU consumption?


1. Reduce the DOP ( degree of parallleism ) for components.

Example:
1. Change from a 4-way parallel to a 2-way parallel.
2. Examine each transformation for inefficiencies.

Example:
1. If transformation uses many local variables, make these variables global.
2. If same function call is performed more than once; call it once and store its value in a global variable.
3. When reading data, reduce the amount of data that needs to be carried forward to the next component

No comments:

Post a Comment