Scribd
Upload
25 views1 page

Optimize Lookup Transformation Tips

Cache lookup tables for large source tables and use persistent caching for static lookup tables. Place equality conditions first and optimize string comparisons. The lookup transformation indexes on key ports only, improving performance, and a router is more efficient than multiple filters. Sort data before aggregating and make the smaller source the join master.

Uploaded by

Senthil Kumar
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as RTF, PDF, TXT or read online on Scribd
25 views1 page

Optimize Lookup Transformation Tips

Cache lookup tables for large source tables and use persistent caching for static lookup tables. Place equality conditions first and optimize string comparisons. The lookup transformation indexes on key ports only, improving performance, and a router is more efficient than multiple filters. Sort data before aggregating and make the smaller source the join master.

Uploaded by

Senthil Kumar
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as RTF, PDF, TXT or read online on Scribd
You are on page 1/ 1

Lookup Transformation -Cache Lookup tables for large source tables Place all conditions that use the

equality operator '=' first in the list of conditions under the condition tab. Replace lookup with decode or IIF (for small sets of values). For static lookup tables use persistent cache When handling multiple matches, use the "Return any matching value" setting when ever possible. Also use this setting if the lookup is being performed to determine that a match exists, but the value returned is irrelevant.The lookup creates an index based on the key ports rather than all lookup transformation ports. This simplified indexing process can improve performance. Optimize char-varchar comparisons (i.e., trim spaces before comparing). Operators are faster than functions (i.e., vs. CONCAT). Avoid date comparisons in lookup; replace with string. For static lookup tables use persistent cache When handling multiple matches, use the "Return any matching value" setting when ever possible. Also use this setting if the lookup is being performed to determine that a match exists, but the value returned is irrelevant. The lookup creates an index based on the key ports rather than all lookup transformation ports.This si mplified indexing process can improve performance. Use a Router Transformation to separate data flows instead of multiple Filter Tr ansformations. Use a Sorter Transformation before an Aggregator Transformation to optimize the aggregate. With a Sorter Transformation, the Sorted Ports option can be used eve n if the original source cannot be ordered. When using a Joiner Transformation, be sure to make the source with the smallest amount of data the Master source.

You might also like