Introduction In order to consume Zendesk data using REST API you can use different methods. Now lets see how to create OAuth Application so you don’t have to rely on static Token or use UserID / Password to access data. OAuth method is more secure and recommended over other methods so whenever possible you should use […]
Category Archives: SSIS PowerPack
Import / Export data from Amazon Athena using SSIS
Introduction In our previous post we explored unlimited possibilities to call Amazon AWS API using SSIS. Now in this post we will learn how to import / export data from Amazon Athena using SSIS. Amazon Athena is very similar service like Google BigQuery which we documented already. To read data from Amazon Athena we will use […]
How to parameterize properties in SSIS package and configure them in a SQL job
Introduction In this article, we will cover the steps of how to run an SSIS package with sensitive data on SQL Server. In an SSIS package sensitive data such as tokens and passwords are by default encrypted by SSIS with your Windows account which you use to create a package. So if ProtectionLevel of a package is […]
How to call Amazon AWS API using SSIS (EC2, Lambda, API Gateway, SQS)
Introduction In this blog post you will learn how to call Amazon AWS API using SSIS (virtually any API) without a single line of code (No more JAVA, C#, Ruby, Python). Yes you heard it right 🙂 . If you are a SSIS / ETL Developer or even coder everyone loves drag & drop interface. SSIS […]
How to generate XML with namespace / prefix in SSIS
Introduction In this post you will see how to generate XML which has namespace and prefix for elements. We will use SSIS XML Generator Transform for this purpose. Common pattern would be generate XML SOAP message using XML Generator Transform and send to Web service using SSIS Web API Destination. For full tutorial on how […]
How to create BIML custom task or component
Introduction BIML or Business Intelligence Markup Language is a nice technology that lets you generate SSIS packages using a bit of scripting and parameters. Check for more info if you are new to it: https://en.wikipedia.org/wiki/Business_Intelligence_Markup_Language http://bimlscript.com/ In this article we will cover the points how to create BIML custom task or component. For this purpose […]
How to read Salesforce data in SSIS – Export to SQL Server
Introduction In this tutorial, you will learn how to read data from Salesforce to SQL Server using SSIS Salesforce Source. In this article, we will extract Salesforce contacts and import them into a SQL Server database table. Also, you will learn how to do basic filtering on the contacts and get only a subset of them. Finally, […]
How to configure MongoDB SSL Connection in SSIS
Introduction MongoDB comes with SSL support which can secure your end to end communication. However setting up MongoDB SSL Connection may require some configuration on both sides (i.e. Server and Client side). In this post our goal is to secure your MongoDB Integration in SSIS. Now lets look at steps to configure SSL in MongoDB. Configure […]
Tip – How to check file size before download from URL
Introduction In this article you will see how to use SSIS REST API Task to get file size without actually downloading it. Prerequisites Before we look into Step-By-Step section to get file size from URL let’s make sure you met following requirements. SSIS designer installed. Sometimes it is referred as BIDS or SSDT […]
Parse JSON array in SSIS or ODBC Drivers
Introduction In our previous post we saw how to parse JSON arrays. Now let’s look at more advanced techniques to parse multi-dimensional JSON array in SSIS ( e.g. 2D – JSON array inside array). We will use SSIS JSON Source to parse complex nested JSON in few clicks. Tips and Tricks mentioned in this article […]