SSIS Azure Blob Storage Task

Azure Blob Storage Task can be used to perform various operations with Azure Storage objects (blobs and containers) (e.g. Download, Upload, Copy, Move, Rename, Delete etc). You can also get single property of any Azure blob or get list of blobs as ADO.net Table and which can be easily loop through using ForEachLoop Task. Most of operations in this task support recursive search using wild card pattern (e.g. Myfile*.txt). Azure Cloud Storage service is one of the most popular Cloud Storage Services available right now.

Features

30+ azure storage operations for Azure Blob Storage (Such as Download, Upload, Copy, Delete…)
Download small or very large Azure Blob (i.e. Cloud Storage file) to local machine
Upload small or very large local file(s) to Azure Blob Storage
Support for Delete, Rename, List, Get Property, Copy, Move, Create, Set Permission … and many more operations
Support for Get List operation so you can use SSIS ForEachLoop to loop through files
Download, Upload, Copy, Delete are multi threaded (i.e. fast parallel operations)
Support for virtual folder structure (e.g. myroot/folder1/subfolder/myfile.txt
Support for SQL Server 2022, 2019, 2017, 2016, 2014, 2012 (32/64 bit) and now Azure Data Factory

From the SSIS Toolbox drag and drop Azure Storage Task on the designer surface

Drag and drop Azure Storage Task in Design Surface

Click on [New] button to create Azure Storage Connection Manager

Create Azure Storage Connection

Configure Azure Storage Connection and Click on Test Connection button.

How to download file from Azure Blob Storage

Download files from Azure Storage Task

Set Metadata in Azure Storage Task

Set Content Type in Azure Storage Task

That’s all run or execute the package and Check Execution log

Run or Execute the Package

Check Execution log

Articles / Tutorials

Click here to see all articles for [SSIS Azure Blob Storage Task] category

Download the Latest File from Azure Blob Storage using SSIS

Introduction In our previous article, we sawÃÂ SSIS Azure Blob Storage task examples. Now let’s look at how to Download the Latest File from Azure Blob Storage using SSIS.ÃÂ Microsoft SSIS includes the Azure Blob Storage Storage Task that allows us to upload files to Azure Blob Storage, download files, creating local and remote directories an more. […]

SSIS Azure Blob Storage Task Examples (Download, Upload, Delete files / folders)

Introduction In this article, we will showÃÂ SSIS Azure Blob Storage task examples. Uploading files using Azure Blob Storage Task or downloading files are common requirements in SSIS. In order to work with Azure Blob Storage, Microsoft SSIS includes the Azure Blob Storage Task that allows to upload files to Azure Blob Storage, download files, creating […]

Read Azure Blob Storage Files in SSIS (CSV, JSON, XML)

Introduction In our previous blog we sawÃÂ how to load data into Azure Blob Storage. Now in this blog, we will seeÃÂ How to read Azure Blob Storage Files in SSIS (CSV, JSON, XML Format files). To illustrate, we will useÃÂ ZappySys SSIS PowerPack, which includes several tasks to import/export data from multiples sources to multiple destinations like […]

Setting Metadata key / value in SSIS Amazon S3 / Azure Storage Task

Introduction In this post we will see how to set Metadata key/value in Azure Blob Storage Task and Amazon Storage Task (S3 Task). We will also see how to set them dynamically at runtime (Use SSIS Expression). Set Amazon S3 Task Metadata (Key / Value Pairs) Here is how you can set Metadata in Amazon […]

SSIS Data Load – SQL Server to Azure Blob (Split Files, GZip)

Introduction In this blog post you will see how easy it is to load large amount of data from SQL Server to Azure Blob Storage using SSIS. We will export / compress data to multiple files. For demo purpose we will use SQL Server as relational source but you can use same steps for any […]

How to download files from Azure Blob Storage in SSIS

Introduction In this blog, we will show how toÃÂ download filesÃÂ fromÃÂ Azure Blob Storage using SSIS. To illustrate, we will useÃÂ ZappySys SSIS PowerPack, which includes several tasks to import/export data from multiples sources to multiple destinations like flat files, Azure, AWS, databases, Office files and more. They areÃÂ Coding free, drag and drop high-performance suite ofÃÂ Custom SSIS […]

Using Regular Expressions in SSIS

Introduction In this short article you will learn how to write Regular expressions in SSIS (i.e. Regex) and what tool to use to test them. You will also find helpful resources on how to write more sophisticated expressions and learn more about them. For demo purpose we will use FREEÃÂ SSIS Regex Parser TaskÃÂ to parse and […]

Filter by file size, name, date for Amazon / Azure Storage SSIS Task

Introduction Sometimes you may need to make an advanced filtering on file path, file date, size etc in SSIS Amazon S3 Task orÃÂ SSIS Azure Blob Storage Task . For example, you have a directory “Customers“, which contains client directories. Each of them contains a directory named “Invoices“, which is partitioned by year. E.g. “Customers/Microsoft/Invoices/2015”. So […]

SSIS – Copy Amazon S3 files from AWS to Azure

Introduction Azure and AWS both are most popular Cloud Platforms. In this blog post we will learn how to copy or move Amazon S3 files to Azure Blob StorageÃÂ without any coding or scripting ÃÂ (AWS to Azure File Copy / Migration Scenario). To achieve this objective we will use following Drag and Drop SSIS ÃÂ Tasks (i.e. […]