Introduction In this post you will learn how to use SSIS REST API Task to perform REST API File Upload (i.e. RESTful file upload) to web server. Typically to access REST API you may have to use programming language but in this post we will use visual drag and drop approach. File upload using HTTP/HTTPS […]
Tag Archives: SSIS PowerPack
Calling Web API in SSIS with Authorization and Redirect
Introduction In some cases when you call API to http URL it may redirect you to different location (Also known as 301 or 302 redirect). Best example is when you type https://www.zappysys.com it will redirect you to https://zappysys.com. This can cause issue in some case if you are passing credentials (i.e. UserID / Password) because […]
How to register Google OAuth Application (Get ClientID and ClientSecret)
Introduction In our previous article we understood little bit about OAuth 2.0 Protocol. We talked how to use Default App for ease of use. However In this post you will learn how to register Google OAuth Application so you can access various Google Services programmatically (e.g Youtube, Google Analytics, AdWords, DoubleClick etc.). Here is the […]
How to check Amazon S3 Bucket location (Region)
Problem Sometimes if you loading data to Redshift via COPY command or using SSIS Redshift Data Transfer Task to move data to redshift then you will have to make sure your S3 Bucket is in the same region as Redshift Cluster. Many people don’t know how to verify that because its hidden in the console. This […]
SSIS check file is locked and wait until file is unlocked (C# Script)
Introduction In this small blog post you will learn How to move files using SSIS Advanced File System Task and How to wait until file is unlocked using C# Script Task. How to check if file is locked (SSIS C# Script Task) If you want to check if file is locked in C# then below […]
Get data from Zuora in SSIS using REST API
SSIS XML Source (FILE, SOAP, REST API Connector) SSIS JSON Source (File, REST Connector) Meanwhile check following similar articles : Read Zendesk data in SSIS using REST API Get data from SurveyMonkey in SSIS using REST API Read Twitter data in SSIS using REST API Task and JSON Source – OAuth2 Protocol Zuora REST API: […]
Read MongoDB data from array (extract nested sub documents)
Introduction In this post you will learn how to read MongoDB data from Array. We recently introduced new JSON Path expression feature in SSIS MongoDB Source Connector to extract nested information from MongoDB documents. Read documents from Array in MongoDB By default SSIS MongoDB Source Connector doesn’t support extracting data using JSON Path expression. So if […]
Fix Redshift Copy ERROR: XX000: Mandatory url is not present in manifest file
If you are doing data transfer using SSIS Redshift Data Transfer task and if you receive following error then most likely you have not specified folder in your target location. Error: An error occurred with the following error message: “ERROR: XX000: Mandatory url is not present in manifest file.”. Solution: To fix this error change […]
Reading JSON Arrays from file / REST API
Introduction REST API is becoming more and more common and with that you will see explosion in use of JSON data format. One of the questions we get a lot is “How to extract or read array from JSON data file” or “How to read multiple arrays from JSON data“. Example : Store JSON document […]
How to get data from Facebook in SSIS using REST API
Introduction In this article you will learn how to get data from Facebook using Graph API (OAuth 2.0) using SSIS PowerPack REST api Connectors. Facebook provides rich set of REST API to access data. Their REST API is also known as Facebook Graph API and it uses OAuth 2.0 Authorization. Traditionally any REST API Integration scenarios […]