SSIS find and remove the duplicate rows

This short blog shows you how to list the data in duplicated rows using.

Let’s look at the Northwind ( database in SQL Server. You can see the Shippers table has 2 duplicate rows, United Package.

Duplicate the Shippers table.

1. Create a SSIS package.

2. Drag a Data Flow Task from SSIS Toolbox to Control Flow area.

3. Drag OLE DB Source, Aggregate, and OLE DB Destination from SSIS Toolbox to Data Flow.

4. Link them together by pulling the blue arrow.

5. Configure the OLE DB Source. First create a connection manager.

6. Configure the OLE DB Source.

7. Configure the Aggregate.

8. Configure the OLE DB Destination.

9. Mapping the columns.

Run the package to test it now.


About chanmingman

Since March 2011 Microsoft Live Spaces migrated to Wordpress ( till now, I have is over 1 million viewers. This blog is about more than 50% telling you how to resolve error messages, especial for Microsoft products. The blog also has a lot of guidance teaching you how to get stated certain Microsoft technologies. The blog also uses as a help to keep my memory. The blog is never meant to give people consulting services or silver bullet solutions. It is a contribution to the community. Thanks for your support over the years. Ming Man is Microsoft MVP since year 2006. He is a software development manager for a multinational company. With 25 years of experience in the IT field, he has developed system using Clipper, COBOL, VB5, VB6, VB.NET, Java and C #. He has been using Visual Studio (.NET) since the Beta back in year 2000. He and the team have developed many projects using .NET platform such as SCM, and HR based applications. He is familiar with the N-Tier design of business application and is also an expert with database experience in MS SQL, Oracle and AS 400.
This entry was posted in .Net, Community, Computers and Internet and tagged , , , . Bookmark the permalink.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.