{"id":6503,"date":"2019-03-05T17:26:01","date_gmt":"2019-03-05T17:26:01","guid":{"rendered":"https:\/\/zappysys.com\/blog\/?p=6503"},"modified":"2019-09-10T00:59:08","modified_gmt":"2019-09-10T00:59:08","slug":"read-rss-feed-in-ssis-pagination","status":"publish","type":"post","link":"https:\/\/zappysys.com\/blog\/read-rss-feed-in-ssis-pagination\/","title":{"rendered":"How to read RSS feed in SSIS and ODBC (with pagination)"},"content":{"rendered":"

Introduction<\/h2>\n

\"\"<\/a>Read RSS feed in SSIS can be challenging. RSS named first RDF Site Summary and later named Rich Site Summary and Really Simple Syndication\u00a0allows customer applications to be updated with the news of a site. For example,\u00a0Microsoft RSS feeds<\/a>,\u00a0Apple RSS feeds<\/a>,\u00a0Samsung RSS feeds<\/a>,\u00a0etc.\u00a0 With RSS the information comes to you directly and you do not need to\u00a0waste time checking the web site. In this article, we will show how to read RSS\u00a0feed in SSIS and later using ODBC.<\/p>\n

<\/h2>\n

<\/h2>\n

Requirements<\/h2>\n
    \n
  1. First of all, ZappySys SSIS Powerpack<\/a> installed.<\/li>\n
  2. Secondly, SSDT for Business Intelligence<\/a> (SSIS) installed.<\/li>\n
  3. Finally, ODBC Powerpack installed<\/a>.<\/li>\n<\/ol>\n

    Getting Started<\/h2>\n

    Understanding RSS data<\/h3>\n
      \n
    1. In order to start, we will work with the WordPress RSS example:\n
      https:\/\/wordpress.org\/news\/feed\/<\/pre>\n<\/li>\n
    2. When you go to the link, you see the feed like this:\n
    3. Basically, it is an XML file with the Last Build date (lastBuildDate),\u00a0the title, link, description. It shows the WordPress news per version and date.<\/li>\n<\/ol>\n
      Read RSS feed in SSIS<\/h3>\n
        \n
      1. First of all, you need an SSIS Project and a Data Flow with the ZS XML Source (if you\u00a0are not familiar with SSIS and the ZS XML Source, refer to\u00a0this link<\/a>.\n
        \"Use
        Drag and drop Data Flow<\/p><\/div><\/li>\n
      2. Secondly, In the ZS XML Source, add the following RSS WordPress URL:\n
        https:\/\/wordpress.org\/news\/feed\/\r\n<\/pre>\n
        \"URL<\/a>
        SSIS read RSS<\/p><\/div><\/li>\n
      3. After that, you will be able to see the following tags when you press\u00a0the array filter:<\/li>\n
      4. This time, we will focus on the information under channel which is the\u00a0most relevant, make sure that the array filter is this one:\n
        $.rss.channel[*].item[*]<\/pre>\n
        \"Filter<\/a>
        Using RSS filters in SSIS<\/p><\/div><\/li>\n
      5. In addition, press the preview data button and you will see the\u00a0following information:\n
        \"SSIS<\/a>
        SSIS preview RSS<\/p><\/div><\/li>\n<\/ol>\n
        Read RSS feed in SSIS and copy to SQL Server<\/h3>\n
          \n
        1. In the previous section, we got data from RSS. Now we will copy to SQL\u00a0Server.<\/li>\n
        2. First of all, drag and drop the OLEDB Destination<\/strong> and join the XML\u00a0<\/strong>Source<\/strong> with the OLEDB Destination:\n
        3. Also, in the OLEDB Destination, press New<\/strong> button and select a SQL Server\u00a0connection or create a new one:\n
        4. In addition, in the table or view textbox press new<\/strong> to create a new\u00a0destination table:\n
        5. Next, modify the table name:\n
        6. Also, go to the mappings page to generate the mappings:\n
        7. Finally, run the package and you will export the data from RSS to SQL Server.<\/li>\n<\/ol>\n
           <\/p>\n
          How to read RSS feed in SSIS using pagination<\/h3>\n
          If you have multiple rows, pagination helps a lot to handle multiple items.\u00a0You can handle the information in pages. Instead of loading all the information, you can get the data from page 1, 2, 3 and more.<\/p>\n
            \n
          1. First of all, in the URL, you can include the following to specify the\u00a0page:\n
            https:\/\/wordpress.org\/news\/feed\/?paged=2<\/pre>\n<\/li>\n
          2. Also, note that it used the word paged<\/strong> and not page. Many URLs use page\u00a0and not paged, but WordPress is different:<\/li>\n
          3. In addition, if you want to use variables, you can use a variable like\u00a0this:
            \n            \"RSS<\/a>
            \nRSS page as a variable<\/li>\n
          4. Also, we have a pagination tab with different pagination options. You\u00a0can check the configuration here:\n
          5. Finally, for more information about pagination, refer to this link<\/a>.<\/li>\n<\/ol>\n
            How to read RSS feed in ZappySys ODBC PowerPack<\/h3>\n
            Zappysys ODBC PowerPack<\/a> is a powerful tool to\u00a0access to REST API, SOAP, XML, JSON, CSV, Odata. In this article, we will show\u00a0how to access to RSS using ODBC PowerPack.<\/p>\n
              \n
            1. First of all, open your ODBC Data Source Administrator in Windows.<\/li>\n
            2. Secondly, in the user DSN, press Add.<\/li>\n
            3. Also, add the Zappysys XML Driver:\n
            4. \u00a0In addition, add the following URL:\n
              https:\/\/wordpress.org\/news\/feed\/<\/pre>\n
              \"URL<\/a>
              ODBC to RSS connection<\/p><\/div><\/li>\n
            5. Finally, you can use the filters and pagination as we did with the SSIS\u00a0PowerPack in the previous sections.\n
              \"Use<\/a>
              ODBC pagination RSS<\/p><\/div><\/li>\n<\/ol>\n
              Conclusion<\/h2>\n
              To conclude, we can say that with SSIS PowerPack<\/a> and ODBC PowerPack<\/a>, it is\u00a0easy to access, filter and paginate RSS information or any XML \/ SOAP API. We strongly recommend you\u00a0to try the product by yourself and check the results.<\/p>\n
              References<\/h2>\n
              For more information about RSS, refer to these links:<\/p>\n