Tips for Aggregator Transformations. Using Sorter transformation is the easiest way to remove duplicates.But you need to compromise with performance if you are loading huge amount of data. In aggregator transformation, group by the key column and add a new port call it count_rec to count the key column. Then click Done. No doubt we can use Sorter transformation or Aggregate transformation to achieve the same but i want to do it using Expression transformation only. Share. Connect a router to the aggregator from the previous step.In router make two groups one named "original" andanother as "duplicate" Other ways to handle duplicate records in source batch run is to use an Aggregator Transformation and using the Group By checkbox on the ports having duplicate occurring data. Step 2: In aggregator transformation, group by the key column and add a new port call it count_rec to count the key column. Ask Question ... Use variable port in expression transformation and by using filter we can delete the duplicate records even if it is relational table or flat files.since dynamic lookup is costly, this way is preferable. Go to the Mapping Designer, click on transformation in the toolbar -> create. count = 1 – send to one target and Count > 1 send it to other target. Posted by gaurav_kapoor822338 (Systems Analyst) on 02/14/2008 03:09:00 PM. This will create an aggregator transformation without ports. We need to use transformations in such a way that Source table duplicate values are filter into separate table. Works with all types of sources. i feel i need to use some variable ports there and comparisons have to be made. Knowledge Base. Here you can have the flexibility to select the last or the first of the duplicate column value records. Or source is file and output row order does not matter. Deleting Duplicate Record Using Informatica Aggregator. i want to remove duplicate records from the relational table using EXPRESSION transformation. Subject: RE: [informatica-l] Seprate DUPLICATE records using Aggregator Transformation. As you guessed we need to use both Router and Aggregator Bring the source table and connect to an Aggregator Transformation When to use Any time an Aggregator transformation has no major impact on performance or the source is relational. Pros: Ease of implementation. Success Portal. Informatica Scenarios (31) Informatica Exercise (9) Informatica Basic (1) Informatica Installation (1) Tuesday, 24 June 2014 Scenario 25: How to remove duplicate records and load only non duplicate records without using Aggregator Transformation. The example shows … Informatica - Duplicate elimination. Creating a Non-Reusable Aggregator Transformation. Step 1: Drag the source to mapping and connect it to an aggregator transformation. Aggregator Mapping - essentially same as above but within Informatica. If you loading huge amount of data it … Explore Informatica Network Communities. Select the Aggregator transformation, enter the name and click create. This mapping illustrates one alternative for removing duplicate records when the source has a primary key that can be used for grouping. Yes, you can do the same using Aggregator transformation, do a count on the values and then a router. Creating an Aggregator Transformation: Follow the below steps to create an aggregator transformation. Cons: Limits in the choice of output row.