{"id":7604,"date":"2019-08-06T12:47:38","date_gmt":"2019-08-06T12:47:38","guid":{"rendered":"https:\/\/zappysys.com\/blog\/?p=7604"},"modified":"2019-10-01T11:37:27","modified_gmt":"2019-10-01T11:37:27","slug":"read-write-azure-queue-storage-data-ssis","status":"publish","type":"post","link":"https:\/\/zappysys.com\/blog\/read-write-azure-queue-storage-data-ssis\/","title":{"rendered":"How to Read\/Write Azure Queue Storage data in SSIS"},"content":{"rendered":"<h2>Introduction<\/h2>\n<p><a href=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/08\/azure-queues.png\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-7631 size-thumbnail alignleft\" src=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/08\/azure-queues-150x150.png\" alt=\"\" width=\"150\" height=\"150\" srcset=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/08\/azure-queues-150x150.png 150w, https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/08\/azure-queues.png 250w\" sizes=\"(max-width: 150px) 100vw, 150px\" \/><\/a>In our previous blog, we saw you how to <a href=\"https:\/\/zappysys.com\/blog\/read-write-azure-table-storage-data-ssis\/\" target=\"_blank\" rel=\"noopener\">read\/write Azure Table Storage<\/a> data. Now in this blog, we will see\u00a0How to Read\/Write Azure Queue Storage data in SSIS.\u00a0To illustrate, we will use\u00a0<a href=\"https:\/\/zappysys.com\/products\/ssis-powerpack\/\" target=\"_blank\" rel=\"noopener\">ZappySys SSIS PowerPack<\/a>, which includes several tasks to import\/export data from multiples sources to multiple destinations like flat files, Azure, AWS, databases, Office files and more. They are\u00a0Coding free, drag and drop high-performance suite of\u00a0<em>Custom SSIS Components<\/em>\u00a0and\u00a0<em>SSIS Tasks.<\/em>\u00a0If you like perform other operations on Azure Blob Storage Files (e.g. Download, Upload, Create, Delete) then\u00a0<a href=\"https:\/\/zappysys.com\/blog\/category\/ssis\/tasks\/ssis-azure-blob-storage-task\/\" target=\"_blank\" rel=\"noopener\">check these articles<\/a>.<\/p>\n<p>In nutshell,\u00a0this post will focus on How to Read\/Write Azure Queue Storage data in SSIS using the following Source\/Destination.<\/p>\n<p>&nbsp;<\/p>\n<h2>Component Mentioned in this article<\/h2>\n<div class=\"su-table su-table-alternate\">\n<table style=\"height: 44px;width: 307px\">\n<tbody>\n<tr style=\"height: 22px\">\n<td style=\"height: 22px;width: 1px\"><a href=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/azure-queue-storage-source\/ssis-azure-queue-source.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-3074\" src=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/azure-queue-storage-source\/ssis-azure-queue-source.png\" alt=\"\" width=\"40\" height=\"40\" \/><\/a><\/td>\n<td style=\"height: 22px;width: 247px\"><a href=\"https:\/\/zappysys.com\/products\/ssis-powerpack\/ssis-azure-queue-storage-source-connector\/\" target=\"_blank\" rel=\"noopener\">Azure Queue Storage Source<\/a><\/td>\n<\/tr>\n<tr style=\"height: 22px\">\n<td style=\"height: 22px;width: 1px\"><a href=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/azure-queue-storage-destination\/ssis-azure-queue-destination.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-3074\" src=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/azure-queue-storage-destination\/ssis-azure-queue-destination.png\" alt=\"\" width=\"40\" height=\"40\" \/><\/a><\/td>\n<td style=\"height: 22px;width: 247px\"><a href=\"https:\/\/zappysys.com\/products\/ssis-powerpack\/ssis-azure-queue-storage-destination-connector\/\" target=\"_blank\" rel=\"noopener\">Azure Queue Storage Destination<\/a><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<h2><span id=\"Prerequisite\"><span id=\"Requirements\">Prerequisite<\/span><\/span><\/h2>\n<ol>\n<li>First, you will need to have SSIS installed<\/li>\n<li>Secondly, make sure to have SSDT<\/li>\n<li>Download and install\u00a0<a href=\"https:\/\/go.microsoft.com\/fwlink\/?LinkId=717179&amp;clcid=0x4009\" target=\"_blank\" rel=\"noopener\">Microsoft Azure Storage Emulator<\/a><\/li>\n<li>Download and install\u00a0<a href=\"https:\/\/azure.microsoft.com\/en-us\/features\/storage-explorer\/\" target=\"_blank\" rel=\"noopener\">Microsoft Azure Storage Explorer<\/a><\/li>\n<li>Finally, do not forget to install\u00a0ZappySys\u00a0<a href=\"https:\/\/zappysys.com\/products\/ssis-powerpack\/\" target=\"_blank\" rel=\"noopener\">SSIS PowerPack<\/a><\/li>\n<\/ol>\n<p><strong>NOTE:<\/strong>\u00a0If you want to use Live account (Azure Storage) then you can skip Step #3<\/p>\n<h2 id=\"what-are-azure-queues\">What are Azure Queues?<\/h2>\n<p>Azure Queue storage is a service for storing large numbers of messages. You access messages from anywhere in the world via authenticated calls using HTTP or HTTPS. A queue message can be up to 64 KB in size. A queue may contain millions of messages, up to the total capacity limit of a storage account.<\/p>\n<h3 id=\"common-uses\">Common uses<\/h3>\n<div id=\"attachment_7610\" style=\"width: 291px\" class=\"wp-caption alignright\"><a href=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/08\/azure-queue-storage-service-concept.png\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-7610\" class=\"wp-image-7610 size-full\" src=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/08\/azure-queue-storage-service-concept.png\" alt=\"Microsoft Azure Queue Concept\" width=\"281\" height=\"144\" \/><\/a><p id=\"caption-attachment-7610\" class=\"wp-caption-text\">Microsoft Azure Queue Concept<\/p><\/div>\n<p>Common uses of Queue storage include:<\/p>\n<ul>\n<li>Creating a backlog of work to process asynchronously<\/li>\n<li>Passing messages from an Azure web role to an Azure worker role<\/li>\n<li>The Queue service contains the following components:<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<h2><span id=\"Getting_Started\">Getting Started<\/span><\/h2>\n<p>In order to start, we will show several examples. Zappysys includes an <a href=\"https:\/\/zappysys.com\/products\/ssis-powerpack\/ssis-azure-queue-storage-source-connector\/\" target=\"_blank\" rel=\"noopener\">SSIS Azure Queue Storage Source<\/a>\u00a0that will help you in reading data of Queue and <a href=\"https:\/\/zappysys.com\/products\/ssis-powerpack\/ssis-azure-queue-storage-destination-connector\/\" target=\"_blank\" rel=\"noopener\">SSIS Azure Queue Storage Destination<\/a> that will help you to write data in Queue. Here we are showing you is, how to Read\/Write Azure Queue Storage data in SSIS.<\/p>\n<p>You can connect to your Azure Storage Account by entering your storage account credentials. Here I am showing an example of the use of the local Azure Storage Emulator.<\/p>\n<h2><span id=\"Setup_Azure_Storage_client_tools\">Setup Azure Storage client tools and Create Queue<\/span><\/h2>\n<ol>\n<li>Once you have\u00a0<a href=\"https:\/\/go.microsoft.com\/fwlink\/?LinkId=717179&amp;clcid=0x4009\" target=\"_blank\" rel=\"noopener\">downloaded and installed storage emulator<\/a>\u00a0You can launch Microsoft Azure Storage Emulator from its Physical location or from the desktop or start menu shortcut.\n<div id=\"attachment_3631\" style=\"width: 869px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2018\/04\/microsoft-azure-storage-emulator-location.png\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-3631\" class=\"wp-image-3631 size-full\" src=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2018\/04\/microsoft-azure-storage-emulator-location.png\" alt=\"Azure Storage Emulator Physical Location\" width=\"859\" height=\"94\" srcset=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2018\/04\/microsoft-azure-storage-emulator-location.png 859w, https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2018\/04\/microsoft-azure-storage-emulator-location-300x33.png 300w, https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2018\/04\/microsoft-azure-storage-emulator-location-768x84.png 768w\" sizes=\"(max-width: 859px) 100vw, 859px\" \/><\/a><p id=\"caption-attachment-3631\" class=\"wp-caption-text\">Azure Storage Emulator Physical Location<\/p><\/div><\/li>\n<li>If you can see the below-attached Command Prompt screen after Emulator started. Then you can proceed to start Microsoft Azure Storage Explorer as the Azure Storage Emulator is started successfully.\n<div id=\"attachment_3633\" style=\"width: 710px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2018\/04\/microsoft-azure-storage-emulator-screen-after-started-e1552723801433.png\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-3633\" class=\"wp-image-3633 size-full\" src=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2018\/04\/microsoft-azure-storage-emulator-screen-after-started-e1552723801433.png\" alt=\"Command Prompt Screen after Microsoft Azure Storage Emulator Started\" width=\"700\" height=\"237\" \/><\/a><p id=\"caption-attachment-3633\" class=\"wp-caption-text\">Command Prompt Screen after Microsoft Azure Storage Emulator Started<\/p><\/div><\/li>\n<li>Now, you have to\u00a0<a href=\"https:\/\/azure.microsoft.com\/en-us\/features\/storage-explorer\/\" target=\"_blank\" rel=\"noopener\">download and install Microsoft Azure Storage Explorer<\/a>\u00a0and then you can launch Microsoft Azure Storage Explorer from its Physical location or from the desktop or start menu shortcut.\n<div id=\"attachment_3635\" style=\"width: 837px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2018\/04\/microsoft-azure-storage-explorer-location.png\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-3635\" class=\"wp-image-3635 size-full\" src=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2018\/04\/microsoft-azure-storage-explorer-location.png\" alt=\"Microsoft Azure Storage Explorer Location\" width=\"827\" height=\"97\" srcset=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2018\/04\/microsoft-azure-storage-explorer-location.png 827w, https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2018\/04\/microsoft-azure-storage-explorer-location-300x35.png 300w, https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2018\/04\/microsoft-azure-storage-explorer-location-768x90.png 768w\" sizes=\"(max-width: 827px) 100vw, 827px\" \/><\/a><p id=\"caption-attachment-3635\" class=\"wp-caption-text\">Microsoft Azure Storage Explorer Location.<\/p><\/div><\/li>\n<li>If you don\u2019t have Azure Storage account then it\u2019s easy to\u00a0<a href=\"http:\/\/azure.microsoft.com\/en-us\/pricing\/free-trial\/\" target=\"_blank\" rel=\"noopener\">get FREE Trial Azure Storage account<\/a>\u00a0or use your MSDN to get credit each month which will be more than enough for real testing. If you prefer to avoid all this hassle then Microsoft provides another great way to test Azure Storage functionality is totally offline mode on your local machine. You can just\u00a0<a href=\"http:\/\/www.microsoft.com\/en-us\/download\/details.aspx?id=42317\" target=\"_blank\" rel=\"noopener\">download Azure Storage Emulator<\/a>\u00a0and start testing.<\/li>\n<li><a href=\"http:\/\/msdn.microsoft.com\/en-us\/library\/azure\/hh403989.aspx\" target=\"_blank\" rel=\"noopener\">Click here<\/a>\u00a0to learn more about how to configure Azure Storage Emulator for Testing and Development purposes. In order to connect to Azure Storage Service from SSIS, you will need Storage AccountName and an AccessKey. Ask your SysAdmin or responsible person to provide that information to you. Here are sample Account Name and Access Key(<b>this is just example key which may differ in your case<\/b>)\n<pre class=\"lang:default decode:true \">Account Name: mystorageaccount \r\nAccess Key: Eby8vdM02xNOcqFlqUwJPLlmEtlCDXJ1OUzFT50uSRZ6IFsuFq2UVErCz4I6tq\/K1SZFPTOtr\/KBHBeksoGMGw==<\/pre>\n<\/li>\n<li>For Creating a Queue, First of all, you need to go to Microsoft Storage Explorer Window. Then you can go through like this way (Storage Accounts \u2013&gt; (Development) \u2013&gt; Queues. Right-click on Queues and Select Create Queue and give a name you want.\n<div style=\"width: 379px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/azure-queue-storage-destination\/ssis-azure-queue-storage-destination-create-new-queue-using-microsoft-storage-explorer.png\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/azure-queue-storage-destination\/ssis-azure-queue-storage-destination-create-new-queue-using-microsoft-storage-explorer.png\" alt=\"Microsoft Azure Storage Explorer - Create Queue \" width=\"369\" height=\"352\" \/><\/a><p class=\"wp-caption-text\">Microsoft Azure Storage Explorer &#8211; Create Queue<\/p><\/div><\/li>\n<\/ol>\n<h2>Write data using ZS Azure Queue Storage Destination<\/h2>\n<p>In this tutorial, you will learn how to write data into Azure Queue Storage. We will use\u00a0<a href=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/dummydata-source.htm\" target=\"_blank\" rel=\"noopener\">ZS DummyData Source<\/a>\u00a0for practice it but you can use a suitable\u00a0<a href=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/ssis-source-adapters.htm\" target=\"_blank\" rel=\"noopener\">Source Adapter<\/a>. So, Let\u2019s start, In this SSIS we will write data into Azure Queue Storage using ZS Azure Queue Storage Destination.<\/p>\n<ol>\n<li>Once you have created Azure Storage Queue and you got valid Account Name and AccessKey (for the local emulator you don\u2019t need this) you may proceed to create new SSIS package. In BIDS\/SSDT create a new SSIS package.<\/li>\n<li>From the SSIS toolbox drag and drop\u00a0<i>Data Flow Task<\/i>\u00a0on the control flow designer surface and double click on it too.\n<div id=\"attachment_7934\" style=\"width: 470px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/09\/ssis-drag-drop-data-flow-task.png\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-7934\" class=\"wp-image-7934 size-full\" src=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/09\/ssis-drag-drop-data-flow-task.png\" alt=\"Drag and Drop SSIS Data Flow Task from SSIS Toolbox\" width=\"460\" height=\"155\" srcset=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/09\/ssis-drag-drop-data-flow-task.png 460w, https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/09\/ssis-drag-drop-data-flow-task-300x101.png 300w\" sizes=\"(max-width: 460px) 100vw, 460px\" \/><\/a><p id=\"caption-attachment-7934\" class=\"wp-caption-text\">Drag and Drop SSIS Data Flow Task from SSIS Toolbox<\/p><\/div><\/li>\n<li>Click\u00a0<a href=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/azure-storage-connection-manager.htm\" target=\"_blank\" rel=\"noopener\">here<\/a>\u00a0to create Azure Storage Connection.<\/li>\n<li>From the SSIS toolbox drag and drop\u00a0<i>Dummy Data Source<\/i>\u00a0on the dataflow designer surface.\n<div style=\"width: 492px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/dummy-data-Source\/ssis-dummy-data-source-adapter-drag.png\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/dummy-data-Source\/ssis-dummy-data-source-adapter-drag.png\" alt=\"DummyData Source - Drag and Drop\" width=\"482\" height=\"120\" \/><\/a><p class=\"wp-caption-text\">DummyData Source &#8211; Drag and Drop<\/p><\/div><\/li>\n<li>Double click Dummy Data Source to configure it. From Template pick JsonDocuments and enter row count=100 to generate 100 JSON documents and click OK to save.\n<div style=\"width: 500px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/amazon-sqs-destination\/ssis-dummy-data-source-generate-fake-json-documents.png\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/amazon-sqs-destination\/ssis-dummy-data-source-generate-fake-json-documents.png\" alt=\"DummyData Source - Configure\" width=\"490\" height=\"537\" \/><\/a><p class=\"wp-caption-text\">DummyData Source &#8211; Configure<\/p><\/div><\/li>\n<li>Let&#8217;s drag and drop\u00a0<i>Azure Queue Storage Destination<\/i>\u00a0on the dataflow designer surface from the SSIS toolbox.<\/li>\n<li>Now single click on the Dummy Data Source, once you see the blue arrow from the source connect it to Azure Queue Destination.<\/li>\n<li>Double click Azure Queue Destination to configure it. Select the connection we have created before.\n<div style=\"width: 705px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/azure-queue-storage-destination\/ssis-azure-queue-destination-select-adapter-connection.png\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/azure-queue-storage-destination\/ssis-azure-queue-destination-select-adapter-connection.png\" alt=\"Configure Connection Manager\" width=\"695\" height=\"311\" \/><\/a><p class=\"wp-caption-text\">Configure Connection Manager<\/p><\/div><\/li>\n<li>Click on [Component Properties] tab and select the Target Queue from the dropdown list.\n<div style=\"width: 781px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/azure-queue-storage-destination\/ssis-azure-queue-destination-select-queue.png\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/azure-queue-storage-destination\/ssis-azure-queue-destination-select-queue.png\" alt=\"Configure Component Properties\" width=\"771\" height=\"605\" \/><\/a><p class=\"wp-caption-text\">Configure Component Properties<\/p><\/div><\/li>\n<li>Click on [Mappings] tab and verify mapping. Map Document column from upstream to the MessageText target column.\n<div style=\"width: 682px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/azure-queue-storage-destination\/ssis-azure-queue-destination-select-mappings.png\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/azure-queue-storage-destination\/ssis-azure-queue-destination-select-mappings.png\" alt=\"Configure Column Mappings\" width=\"672\" height=\"488\" \/><\/a><p class=\"wp-caption-text\">Configure Column Mappings<\/p><\/div><\/li>\n<li>Click OK to save settings.<\/li>\n<li>Execute the package and verify target data by going to your Azure Queue. We use <a href=\"https:\/\/azure.microsoft.com\/en-us\/features\/storage-explorer\/\" target=\"_blank\" rel=\"noopener\">Azure Storage Explorer.<\/a>\n<div style=\"width: 383px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/azure-queue-storage-destination\/ssis-azure-queue-destination-insert-messages.png\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/azure-queue-storage-destination\/ssis-azure-queue-destination-insert-messages.png\" alt=\"SSIS Execute Package\" width=\"373\" height=\"342\" \/><\/a><p class=\"wp-caption-text\">SSIS Execute Package<\/p><\/div>\n<div style=\"width: 810px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/azure-queue-storage-destination\/check-azure-queue-message-verify-count-console.png\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/azure-queue-storage-destination\/check-azure-queue-message-verify-count-console.png\" alt=\"Microsoft Azure Explorer - Verify Queue Data\" width=\"800\" height=\"478\" \/><\/a><p class=\"wp-caption-text\">Microsoft Azure Explorer &#8211; Verify Queue Data<\/p><\/div><\/li>\n<\/ol>\n<h2>Read data using ZS Azure Queue Storage Source<\/h2>\n<ol>\n<li>Here you may proceed\u00a0In BIDS\/SSDT to create a new SSIS package.<\/li>\n<li>Now, Drag and Drop SSIS Data Flow Task from SSIS Toolbox.\n<div style=\"width: 470px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/drag-and-drop-data-flow-task.png\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/drag-and-drop-data-flow-task.png\" alt=\"SSIS Data Flow Task - Drag and Drop\" width=\"460\" height=\"155\" \/><\/a><p class=\"wp-caption-text\">SSIS Data Flow Task &#8211; Drag and Drop<\/p><\/div><\/li>\n<li>Double click on the Data Flow task to see the Data Flow designer surface.<\/li>\n<li>From the SSIS toolbox drag and drop ZS Azure Queue Storage Source on the dataflow designer surface.\n<div style=\"width: 485px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/azure-queue-storage-source\/ssis-azure-queue-source-drag.png\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/azure-queue-storage-source\/ssis-azure-queue-source-drag.png\" alt=\"SSIS ZS Azure Queue Source - Drag and Drop\" width=\"475\" height=\"103\" \/><\/a><p class=\"wp-caption-text\">SSIS ZS Azure Queue Source &#8211; Drag and Drop<\/p><\/div><\/li>\n<li>Double click Azure Queue Storage Source to configure it.<\/li>\n<li>Select Azure Storage Connection we have created before and select queue from the dropdown and click on preview.\n<div style=\"width: 949px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/azure-queue-storage-source\/ssis-azure-queue-source-preview-messages.png\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/azure-queue-storage-source\/ssis-azure-queue-source-preview-messages.png\" alt=\"Configure Azure Queue Source\" width=\"939\" height=\"688\" \/><\/a><p class=\"wp-caption-text\">Configure Azure Queue Source<\/p><\/div><\/li>\n<li>Click on OK button to save configure.<\/li>\n<li>Now, you can use a suitable Destination Adapter from <a href=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/ssis-destination-adapters.htm\" target=\"_blank\" rel=\"noopener\">here.<\/a> In this case, we used Trash Destination.<\/li>\n<li>From the SSIS toolbox drag and drop Trash Destination on the data flow designer surface.\n<div style=\"width: 529px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/trash-destination\/ssis-trash-destination-adapter-drag.png\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/trash-destination\/ssis-trash-destination-adapter-drag.png\" alt=\"SSIS ZS Trash Destination - Drag and Drop\" width=\"519\" height=\"121\" \/><\/a><p class=\"wp-caption-text\">SSIS ZS Trash Destination &#8211; Drag and Drop<\/p><\/div><\/li>\n<li>Now single click on the Azure Queue Storage Source once you see the blue arrow from the source &#8230; connect it to Trash Destination.<\/li>\n<li>Double click on ZS Trash Destination to Configure it.\n<div style=\"width: 622px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/trash-destination\/ui-trash-destination-settings.png\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/trash-destination\/ui-trash-destination-settings.png\" alt=\"SSIS ZS Trash Destination - Configure\" width=\"612\" height=\"523\" \/><\/a><p class=\"wp-caption-text\">SSIS ZS Trash Destination &#8211; Configure<\/p><\/div><\/li>\n<li>Click on OK button to save Trash Destination configure setting UI.<\/li>\n<li>Execute the package and verify source data in the data viewer.\n<div style=\"width: 350px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/azure-queue-storage-source\/ssis-read-messages-from-azure-queue.png\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/images\/azure-queue-storage-source\/ssis-read-messages-from-azure-queue.png\" alt=\"SSIS ZS Azure Queue Source - Execute the Package\" width=\"340\" height=\"307\" \/><\/a><p class=\"wp-caption-text\">SSIS ZS Azure Queue Source &#8211; Execute the Package<\/p><\/div><\/li>\n<li>After messages read from Azure Queue, the same message cannot be read again until VisibilityTimeout. By default Queue, visibility timeout is used (-1 means use default) but you can override it on the source UI.<\/li>\n<\/ol>\n<h2>Conclusion<\/h2>\n<p>In this blog, we learn How to Read\/Write Azure Queue Storage data in SSIS. We used the Azure Queue Destination for write data and Azure Queue Source to read data.\u00a0You can\u00a0<a href=\"https:\/\/zappysys.com\/products\/ssis-powerpack\/\">download SSIS PowerPack here<\/a>\u00a0to try many other scenarios not discussed in this blog along with 70+ other components.<\/p>\n<h2>References<\/h2>\n<p>Finally, you can use the following links for more information:<\/p>\n<ul>\n<li><a href=\"https:\/\/zappysys.com\/products\/ssis-powerpack\/ssis-azure-queue-storage-source-connector\/\" target=\"_blank\" rel=\"noopener\">Azure Queue Source<\/a><\/li>\n<li><a href=\"https:\/\/zappysys.com\/products\/ssis-powerpack\/ssis-azure-queue-storage-destination-connector\/\" target=\"_blank\" rel=\"noopener\">Azure Queue Destination<\/a><\/li>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/storage\/queues\/storage-dotnet-how-to-use-queues\" target=\"_blank\" rel=\"noopener\">Microsoft Azure Queues<\/a><\/li>\n<li><strong>Help File:<\/strong> <a href=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/ssis-azure-queue-storage-source.htm\" target=\"_blank\" rel=\"noopener\">Azure Queue Source,<\/a> <a href=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/ssis-azure-queue-storage-destination.htm\" target=\"_blank\" rel=\"noopener\">Azure Queue Destination,<\/a> <a href=\"https:\/\/zappysys.com\/onlinehelp\/ssis-powerpack\/scr\/trash-destination.htm\" target=\"_blank\" rel=\"noopener\">Trash Destination<\/a><\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Introduction In our previous blog, we saw you how to read\/write Azure Table Storage data. Now in this blog, we will see\u00a0How to Read\/Write Azure Queue Storage data in SSIS.\u00a0To illustrate, we will use\u00a0ZappySys SSIS PowerPack, which includes several tasks to import\/export data from multiples sources to multiple destinations like flat files, Azure, AWS, databases, [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":7631,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[542,541],"tags":[183,282,509,534,313,519,314,305,12,478,508,529,286],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.3 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\r\n<title>How to Read\/Write Azure Queue Storage data in SSIS | ZappySys Blog<\/title>\r\n<meta name=\"description\" content=\"How to Read\/Write Azure Queue Storage data in SSIS using ZappySys PowerPack components Azure Queue Storage Source and Destination.\" \/>\r\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\r\n<link rel=\"canonical\" href=\"https:\/\/zappysys.com\/blog\/read-write-azure-queue-storage-data-ssis\/\" \/>\r\n<meta property=\"og:locale\" content=\"en_US\" \/>\r\n<meta property=\"og:type\" content=\"article\" \/>\r\n<meta property=\"og:title\" content=\"How to Read\/Write Azure Queue Storage data in SSIS | ZappySys Blog\" \/>\r\n<meta property=\"og:description\" content=\"How to Read\/Write Azure Queue Storage data in SSIS using ZappySys PowerPack components Azure Queue Storage Source and Destination.\" \/>\r\n<meta property=\"og:url\" content=\"https:\/\/zappysys.com\/blog\/read-write-azure-queue-storage-data-ssis\/\" \/>\r\n<meta property=\"og:site_name\" content=\"ZappySys Blog\" \/>\r\n<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/ZappySys\/\" \/>\r\n<meta property=\"article:published_time\" content=\"2019-08-06T12:47:38+00:00\" \/>\r\n<meta property=\"article:modified_time\" content=\"2019-10-01T11:37:27+00:00\" \/>\r\n<meta property=\"og:image\" content=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/08\/azure-queues.png\" \/>\r\n\t<meta property=\"og:image:width\" content=\"250\" \/>\r\n\t<meta property=\"og:image:height\" content=\"250\" \/>\r\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\r\n<meta name=\"author\" content=\"ZappySys\" \/>\r\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\r\n<meta name=\"twitter:creator\" content=\"@https:\/\/twitter.com\/zappysys\/\" \/>\r\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"ZappySys\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"7 minutes\" \/>\r\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/zappysys.com\/blog\/read-write-azure-queue-storage-data-ssis\/\",\"url\":\"https:\/\/zappysys.com\/blog\/read-write-azure-queue-storage-data-ssis\/\",\"name\":\"How to Read\/Write Azure Queue Storage data in SSIS | ZappySys Blog\",\"isPartOf\":{\"@id\":\"https:\/\/zappysys.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/zappysys.com\/blog\/read-write-azure-queue-storage-data-ssis\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/zappysys.com\/blog\/read-write-azure-queue-storage-data-ssis\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/08\/azure-queues.png\",\"datePublished\":\"2019-08-06T12:47:38+00:00\",\"dateModified\":\"2019-10-01T11:37:27+00:00\",\"author\":{\"@id\":\"https:\/\/zappysys.com\/blog\/#\/schema\/person\/2756c237457fbc95d82cb38962f81f82\"},\"description\":\"How to Read\/Write Azure Queue Storage data in SSIS using ZappySys PowerPack components Azure Queue Storage Source and Destination.\",\"breadcrumb\":{\"@id\":\"https:\/\/zappysys.com\/blog\/read-write-azure-queue-storage-data-ssis\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/zappysys.com\/blog\/read-write-azure-queue-storage-data-ssis\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/zappysys.com\/blog\/read-write-azure-queue-storage-data-ssis\/#primaryimage\",\"url\":\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/08\/azure-queues.png\",\"contentUrl\":\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/08\/azure-queues.png\",\"width\":250,\"height\":250},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/zappysys.com\/blog\/read-write-azure-queue-storage-data-ssis\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/zappysys.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How to Read\/Write Azure Queue Storage data in SSIS\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/zappysys.com\/blog\/#website\",\"url\":\"https:\/\/zappysys.com\/blog\/\",\"name\":\"ZappySys Blog\",\"description\":\"SSIS \/ ODBC Drivers \/ API Connectors for JSON, XML, Azure, Amazon AWS, Salesforce, MongoDB and more\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/zappysys.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/zappysys.com\/blog\/#\/schema\/person\/2756c237457fbc95d82cb38962f81f82\",\"name\":\"ZappySys\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/zappysys.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/5c9be148088ba9b8af8e955c5f7c22b5?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/5c9be148088ba9b8af8e955c5f7c22b5?s=96&d=mm&r=g\",\"caption\":\"ZappySys\"},\"sameAs\":[\"http:\/\/www.zappysys.com\/\",\"https:\/\/www.facebook.com\/ZappySys\/\",\"https:\/\/twitter.com\/https:\/\/twitter.com\/zappysys\/\"],\"url\":\"https:\/\/zappysys.com\/blog\/author\/admin\/\"}]}<\/script>\r\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"How to Read\/Write Azure Queue Storage data in SSIS | ZappySys Blog","description":"How to Read\/Write Azure Queue Storage data in SSIS using ZappySys PowerPack components Azure Queue Storage Source and Destination.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/zappysys.com\/blog\/read-write-azure-queue-storage-data-ssis\/","og_locale":"en_US","og_type":"article","og_title":"How to Read\/Write Azure Queue Storage data in SSIS | ZappySys Blog","og_description":"How to Read\/Write Azure Queue Storage data in SSIS using ZappySys PowerPack components Azure Queue Storage Source and Destination.","og_url":"https:\/\/zappysys.com\/blog\/read-write-azure-queue-storage-data-ssis\/","og_site_name":"ZappySys Blog","article_author":"https:\/\/www.facebook.com\/ZappySys\/","article_published_time":"2019-08-06T12:47:38+00:00","article_modified_time":"2019-10-01T11:37:27+00:00","og_image":[{"width":250,"height":250,"url":"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/08\/azure-queues.png","type":"image\/png"}],"author":"ZappySys","twitter_card":"summary_large_image","twitter_creator":"@https:\/\/twitter.com\/zappysys\/","twitter_misc":{"Written by":"ZappySys","Est. reading time":"7 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/zappysys.com\/blog\/read-write-azure-queue-storage-data-ssis\/","url":"https:\/\/zappysys.com\/blog\/read-write-azure-queue-storage-data-ssis\/","name":"How to Read\/Write Azure Queue Storage data in SSIS | ZappySys Blog","isPartOf":{"@id":"https:\/\/zappysys.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/zappysys.com\/blog\/read-write-azure-queue-storage-data-ssis\/#primaryimage"},"image":{"@id":"https:\/\/zappysys.com\/blog\/read-write-azure-queue-storage-data-ssis\/#primaryimage"},"thumbnailUrl":"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/08\/azure-queues.png","datePublished":"2019-08-06T12:47:38+00:00","dateModified":"2019-10-01T11:37:27+00:00","author":{"@id":"https:\/\/zappysys.com\/blog\/#\/schema\/person\/2756c237457fbc95d82cb38962f81f82"},"description":"How to Read\/Write Azure Queue Storage data in SSIS using ZappySys PowerPack components Azure Queue Storage Source and Destination.","breadcrumb":{"@id":"https:\/\/zappysys.com\/blog\/read-write-azure-queue-storage-data-ssis\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/zappysys.com\/blog\/read-write-azure-queue-storage-data-ssis\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/zappysys.com\/blog\/read-write-azure-queue-storage-data-ssis\/#primaryimage","url":"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/08\/azure-queues.png","contentUrl":"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/08\/azure-queues.png","width":250,"height":250},{"@type":"BreadcrumbList","@id":"https:\/\/zappysys.com\/blog\/read-write-azure-queue-storage-data-ssis\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/zappysys.com\/blog\/"},{"@type":"ListItem","position":2,"name":"How to Read\/Write Azure Queue Storage data in SSIS"}]},{"@type":"WebSite","@id":"https:\/\/zappysys.com\/blog\/#website","url":"https:\/\/zappysys.com\/blog\/","name":"ZappySys Blog","description":"SSIS \/ ODBC Drivers \/ API Connectors for JSON, XML, Azure, Amazon AWS, Salesforce, MongoDB and more","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/zappysys.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/zappysys.com\/blog\/#\/schema\/person\/2756c237457fbc95d82cb38962f81f82","name":"ZappySys","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/zappysys.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/5c9be148088ba9b8af8e955c5f7c22b5?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/5c9be148088ba9b8af8e955c5f7c22b5?s=96&d=mm&r=g","caption":"ZappySys"},"sameAs":["http:\/\/www.zappysys.com\/","https:\/\/www.facebook.com\/ZappySys\/","https:\/\/twitter.com\/https:\/\/twitter.com\/zappysys\/"],"url":"https:\/\/zappysys.com\/blog\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/posts\/7604"}],"collection":[{"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/comments?post=7604"}],"version-history":[{"count":31,"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/posts\/7604\/revisions"}],"predecessor-version":[{"id":8087,"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/posts\/7604\/revisions\/8087"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/media\/7631"}],"wp:attachment":[{"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/media?parent=7604"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/categories?post=7604"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/tags?post=7604"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}