Import / Export data from Amazon Athena using SSIS

Introduction In our previous post we explored unlimited possibilities to call Amazon AWS API using SSIS. Now in this post we will learn how to import / export data from Amazon Athena using SSIS. Amazon Athena is very similar service like Google BigQuery which we documented already.  To read data from Amazon Athena we will use […]

How to generate XML with namespace / prefix in SSIS

Introduction In this post you will see how to generate XML which has namespace and prefix for elements. We will use SSIS XML Generator Transform for this purpose. Common pattern would be generate XML SOAP message using XML Generator Transform and send to Web service using SSIS Web API Destination. For full tutorial on how […]

Tip – How to check file size before download from URL

Introduction In this article you will see how to use SSIS REST API Task to get file size without actually downloading it.       Prerequisites Before we look into Step-By-Step section to get file size from URL let’s make sure you met following requirements. SSIS designer installed. Sometimes it is referred as BIDS or SSDT […]

Filter by file size, name, date for Amazon / Azure Storage SSIS Task

Introduction Sometimes you may need to make an advanced filtering on file path, file date, size etc in SSIS Amazon S3 Task or SSIS Azure Blob Storage Task . For example, you have a directory “Customers“, which contains client directories. Each of them contains a directory named “Invoices“, which is partitioned by year. E.g. “Customers/Microsoft/Invoices/2015”. So […]

SSIS – Copy Amazon S3 files from AWS to Azure

Introduction Azure and AWS both are most popular Cloud Platforms. In this blog post we will learn how to copy or move Amazon S3 files to Azure Blob Storage without any coding or scripting  (AWS to Azure File Copy / Migration Scenario). To achieve this objective we will use following Drag and Drop SSIS  Tasks (i.e. […]

Update MongoDB Array Items using SSIS

Introduction In our previous blog post we saw how to perform Read and Write operations in MongoDB using SSIS (i.e. Bulk Update, Delete, Upsert, Insert). In this post we specifically focus on how to update MongoDB Array items / elements using SSIS. To make things simple to follow we have used JSON Source to produce […]

How to call Elasticsearch API using SSIS

Introduction Elasticsearch is a powerful engine that allows you to store, aggregate and, most importantly, search data in a very analytical way. In this tutorial, you will learn how to bulk load data from SQL Server to Elasticsearch with SSIS (part of SQL Server) and ZappySys PowerPack. The scope of this article will be to show how to import […]

How to Compress multiple files using SSIS Zip file Task (Encrypt using Password)

SSIS Zip File Task – Compress files and password protect

Introduction In this blog post we will see how to compress files and encrypt with password (zip and encrypt using AES algorithm). We will use SSIS Zip File Task which comes with many advanced options including encryption feature for password protected zip files. NOTE: Password feature is only available for Zip file format. If you […]

SSIS Advanced File System Task - Search / Replace Option -Remove invalid XML characters using Regex (Regular Expression)

How to remove invalid characters from XML using SSIS and Regex

 Introduction In this blog post you will see how to remove invalid characters from XML using SSIS. We will use search and replace feature of Advanced File System Task. Remove Invalid characters from XML Xml file specification have restriction about which characters can be part of XML data and which should be avoided. If you use […]