REST API Looping/Pagination via URL Page Number Parameter (Loop until last page detected)

How to do REST API Pagination in SSIS / ODBC Drivers

Introduction In our previous blog, we saw how to call REST in SSIS including concepts of Authetication / Error Handling. Now in this post, we will cover API Pagination. You will learn concepts and patterns about REST API Pagination (for JSON / XML / SOAP or CSV API). We will describe methods and steps to implement REST API […]

How to find amazon s3 bucket location (AWS region endpoint)

How to check Amazon S3 Bucket location (Region)

Problem Sometimes if you loading data to Redshift via COPY command or using SSIS Redshift Data Transfer Task to move data to redshift then you will have to make sure your S3 Bucket is in the same region as Redshift Cluster. Many people don’t know how to verify that because its hidden in the console. This […]

SSIS – Loading data into MongoDB (Upsert, Delete, Update)

Introduction MongoDB is one of the most poplar NoSQL database out there. In this article you will learn how to use ZappySys MongoDB Destination Connector to perform various bulk operations on MongoDB such as Insert, Update, Delete and Upsert. If you wish to learn how to Update MongoDB Array items then check this blog post instread. […]

Informatica PowerCenter Redshift Data Load - Amazon Redshift Import Command line tools (COPY, S3, AWS)

Amazon Redshift data load in Informatica PowerCenter

Introduction In our previous post you learned how to load data into Redshift using SSIS. Now in this post you will learn how to load data into Redshift using Informatica PowerCenter. For PowerCenter we will use ZappyShell Command line for Redshift Data Load. This small powerful command line utility can handle load of several millions […]

SSIS Advanced File System Task - get file list as ADO.net Recordset into variable

Get list of files in SSIS for Looping

Introduction In this post you will learn how to use Advanced File System Task to get list of files and folders into variable. Advanced File System Task is significantly better than native SSIS File System Task How to get list of files in SSIS Most simplest way to get list of files in SSIS is […]

ZappySys Logo - SSIS, SQL Server, Big Data, Cloud Computing, NoSQL, Business Intelligence

Get data from Zuora in SSIS using REST API

  SSIS XML Source (FILE, SOAP, REST API Connector) SSIS JSON Source (File, REST Connector) Meanwhile check following similar articles : Read Zendesk data in SSIS using REST API Get data from SurveyMonkey in SSIS using REST API Read Twitter data in SSIS using REST API Task and JSON Source – OAuth2 Protocol Zuora REST API: […]

Read MongoDB data from array (extract nested sub documents)

Introduction In this post you will learn how to read MongoDB data from Array. We recently introduced new JSON Path expression feature in SSIS MongoDB Source Connector to extract nested information from MongoDB documents.   Read documents from Array in MongoDB By default SSIS MongoDB Source Connector doesn’t support extracting data using JSON Path expression. So if […]

Reading JSON Arrays from file / REST API

Introduction REST API is becoming more and more common and with that you will see explosion in use of JSON data format. One of the questions we get a lot is “How to extract or read array from JSON data file” or “How to read multiple arrays from JSON data“. Example : Store JSON document […]