{"id":8207,"date":"2019-10-19T08:22:53","date_gmt":"2019-10-19T08:22:53","guid":{"rendered":"https:\/\/zappysys.com\/blog\/?p=8207"},"modified":"2019-11-18T14:44:14","modified_gmt":"2019-11-18T14:44:14","slug":"pivot-csv-data-ssis","status":"publish","type":"post","link":"https:\/\/zappysys.com\/blog\/pivot-csv-data-ssis\/","title":{"rendered":"How to Pivot CSV Data in SSIS"},"content":{"rendered":"

Introduction<\/h2>\n

\"\"<\/a>In our previous blog we saw How to write data into CSV file in SSIS (GZip \/ Split)<\/a>. Now in this blog, we will see How to Pivot CSV Data in SSIS using CSV Source<\/a><\/strong>. It also supports Pivot mode so you can convert single CSV string value into Rows. In this article we also see how make some CSV columns as parent and not consider it in pivot and load it as it is using JSON Generator<\/a> and JSON Parser\u00a0Transform<\/a> Pivot Option.<\/p>\n

In nutshell,\u00a0this post will focus on how to Pivot CSV Data into multiple columns and rows.<\/p>\n

 <\/p>\n

Prerequisites<\/span><\/h2>\r\nBefore we perform the steps listed in this article, you will need to make sure the following prerequisites are met:\r\n
    \r\n \t
  1. SSIS<\/abbr> designer installed.\u00a0Sometimes it is referred to as BIDS<\/abbr> or SSDT<\/abbr> (download it from the Microsoft site<\/a>).<\/li>\r\n \t
  2. Basic knowledge of SSIS package\u00a0development using\u00a0Microsoft SQL Server Integration Services<\/em>.<\/li>\r\n \t
  3. Make sure\u00a0ZappySys SSIS PowerPack<\/a><\/span>\u00a0is installed (download it<\/a>, if you haven't already).<\/li>\r\n \t
  4. (Optional step<\/em>).<\/em>\u00a0Read this article<\/a>, if you are planning to deploy packages to a server and schedule their execution later.<\/li>\r\n<\/ol><\/div>\n

    How to Pivot CSV Data in SSIS using CSV File Source<\/h2>\n

    Let\u00b4s start with an example. In this SSIS CSV Parser Transform example, we will Parse database column string into multiple columns and rows.<\/p>\n

      \n
    1. First\u00a0of All, Drag and drop Data Flow Task from SSIS Toolbox and double click it to edit.\n
    2. Furthermore, drag and drop the CSV Source and Double click on it to configure it.\n
    3. Enter the CSV file path and select desire column delimiter most common in CSV is comma and check the First Row as headers and click on preview.\n
    4. Now, go to Pivot Columns to Rows Tab and checked Enable Pivoting and click on Preview Data to view the data.\n
    5. That’s it we see how to read data from CSV File and also Pivot the CSV Data using CSV Source.<\/li>\n
    6. Now In the next section we will see how to\u00a0how make some CSV columns as parent and not consider it in pivot and load it as it is.<\/li>\n<\/ol>\n

      How make some CSV columns as parent.<\/h2>\n

      Sometimes you just need to make child columns in to rows and want to leave parent level columns as it is.<\/p>\n

        \n
      1. First\u00a0of All, Drag and drop Data Flow Task from SSIS Toolbox and double click it to edit.\n
      2. Secondly, drag and drop the CSV Source and Double click on it to configure it.\n
      3. Furthermore, enter the file path and click on preview.\n
      4. For example if we want to pivot Email and Phone only in pivoting and wants to exclude parent level columns FirstName and LastName as it is.<\/li>\n
      5. For that drag and drop JSON Generator Transform and Select Output Mode as Output One JSON Per Parent Input Row<\/strong>\u00a0 and Add Unbound Nested Element and named it as Persons and click on OK<\/strong>.\n
      6. Now add that two parent level fields FirstName and LastName in the Persons.\n
      7. Now select Person Element and right click and Add Unbound Nested Element and named it as Contacts and click on OK<\/strong>.\n
      8. Now add that two child level fields Email and Phone in the Contacts.\n
      9. Therefore JSON Generator Transform looks like below screen. Now Copy that Sample Preview JSON String to use it in the JSON Parser Transom as sample string.\n
      10. Similarly, drag and drop JSON Parser Transform and select the Input JSON Column and Paste that copied Sample JSON String and select the Contacts filter to read the Child data and click on Include Parent.\n
      11. Now go to Pivot Columns to Rows Tab and checked the Enable Pivoting and click on the Preview.\n
      12. Finally, we are ready to load this data.\n
      13. Let’s load this data in the SQL Server.<\/li>\n<\/ol>\n

        Load Pivoted CSV File data into SQL Server<\/span><\/h2>\n

        ZappySys SSIS PowerPack makes it easy to load data from various sources such as REST, SOAP, JSON, XML, CSV or from other source into SQL Server, or PostgreSQL, or Amazon Redshift, or other targets. The Upsert Destination<\/strong> component allows you to automatically insert new records and update existing ones based on key columns. Below are the detailed steps to configure it.<\/p>\r\n

        Step 1: Add Upsert Destination to Data Flow<\/h3>\r\n
          \r\n
        1. Drag and drop the Upsert Destination<\/strong> component from the SSIS Toolbox.<\/li>\r\n
        2. Connect your source component (e.g., JSON \/ REST \/ Other Source) to the Upsert Destination.<\/li>\r\n<\/ol>\r\n
          \r\n\r\n\"\"<\/a>\r\n

          SSIS - Data Flow - Drang and Drop Upsert Destination Component<\/p>\r\n<\/div>\r\n

          Step 2: Configure Target Connection<\/h3>\r\n
            \r\n
          1. Double-click the Upsert Destination<\/strong> component to open the configuration window.<\/li>\r\n
          2. Under Connection<\/strong>, select an existing target connection or click NEW<\/strong> to create a new connection.\r\n