JSON File / REST API Driver Archives | ZappySys Blog

ODBC Tutorial: How to connect Claude to ODBC

ZappySys Team — Wed, 15 Apr 2026 21:47:31 +0000

Introduction

Claude.IA is a powerful cloud-native intelligence and automation platform that offers REST APIs for accessing AI models, data processing pipelines, and automation workflows. In this guide, we will demonstrate how to connect to Claude using the Zappysys ODBC Driver for REST APIs with API key authentication.

Whether you are using Claude for intelligent document processing, data enrichment, or automated workflows, you will learn how to configure ODBC connectivity without writing custom code. Zappysys ODBC REST driver handles all the complexity, allowing you to query Claude APIs using standard SQL and connect from any ODBC-compatible application.

Prerequisites

Windows operating system (32-bit or 64-bit).
Claude’s account has API access enabled.
Finally, do not forget to install ZappySys ODBC PowerPack.

Steps

Generate an API Key in Claude

Log in to your Cloude.IA account settings.
Navigate to Settings > API Keys.
Click Create Key.
Enter the workspace name (optional).
Enter a descriptive name for the API key.
Press Add to generate the token Key.
Save the API key in a secure location; you won’t be able to view it again.
Cloude- Generate Token
Set Up Billing (required): add a payment method via the Billing Settings page.

Creating a new ODBC DSN using ZappySys JSON Driver

Search for ODBC in the Windows Start menu and open the ODBC Data Source Administrator.
In the User DSN or System DSN tab, click Add to create a new data source.
In the ODBC Data Source Setup window, select the ZappySys JSON Driver and click Continue.

Configure the Connection and API Settings

In the Base URL field, enter:
```
https://api.anthropic.com/v1
```
Select HTTP as the connection type, then click it to configure it.
Select Static Token/API Key as the Authentication Type.
Enter your Claude API key in the API Key field.
In the Header Name, enter x-api-key.
In the OAuth Scheme, use none.
Click OK to save the configuration.
Set up the HTTP Request Method to POST.

Use this JSON as the body:

{
  "model": "claude-sonnet-4-6",
  "max_tokens": 1024,
  "messages": [
    {
      "role": "user",
      "content": "{YOUR-Message}"
    }
  ]
}

In the Body content type, select
```
JSON(application/json)
```
Inside the header, add: anthropic-version: 2023-06-01
You can use the Array filter to get the object you need, and you can use
```
$.messages[*].content
```
to get only the message.
Test the connection to check everything is working fine
Claude – JSON ODBC Driver configuration

Preview the data

Once your ODBC DSN is configured, go to the preview tab.
Select the table you want to use.
Press the Preview data button to see the result.
Claude – JSON ODBC Driver result

Conclusion

You now have a secure and reliable ODBC connection to Claude. API Key authentication provides a simple and secure way to connect using the Zappysys ODBC Driver for REST APIs. With this connection configured, you can build powerful data extraction, transformation, and integration workflows using Claude’s intelligence and automation capabilities from any ODBC-compatible application without writing custom code.

Explore the full capabilities of the ZappySys ODBC PowerPack to optimize your data integration tasks. By applying this pattern, you can extend your solution to include additional data sources and create unified reporting across multiple cloud-based APIs.

Need Help?

If you encounter any issues, our support team is here to help:

Live Chat — Use the chat widget (bottom-right corner of this page)
Email — support@zappysys.com
Support Center — Visit the ZappySys Support Portal

The post ODBC Tutorial: How to connect Claude to ODBC appeared first on ZappySys Blog.

ODBC tutorial: How to connect Blogger to ODBC

ZappySys Team — Fri, 27 Mar 2026 12:19:14 +0000

Introduction

This tutorial walks you through the process of extracting blog posts and comments data from Blogger using the REST API and Zappysys ODBC connectors. In this guide, you will learn how to authenticate with the Blogger REST API, configure a Zappysys ODBC data source, and query extracted data using ODBC. This approach eliminates the need for custom code and provides a standard interface for managing complex API integrations.

Zappysys provides a powerful ODBC connector that simplifies the integration of cloud-based APIs. We will demonstrate a practical pattern using ZappySys ODBC JSON Driver to extract data from Blogger APIs through any ODBC-compatible application.

Prerequisites

Before you begin, make sure you have the following:

Windows operating system with ODBC Data Source Administrator available
Access to a Blogger blog with appropriate permissions to read public posts and comments
Finally, do not forget to install ZappySys ODBC PowerPack.

Steps

Create/Select a Project in the Google API Console

Navigate to the Google API Console.
Click on the Project Dropdown at the top bar and either select an existing project or create a new one by clicking CREATE PROJECT.
Google Console – Create or select a project
Once the project is set, click ENABLE APIS AND SERVICES.
Search for the Blogger API v3 and click ENABLE.
Google Console – Enable Blogger API
Return to the main screen and click on the OAuth Consent Screen tab.
Select the External user type and click CREATE.
Provide the application name, user support email, and developer contact information, then click SAVE AND CONTINUE.
Click through the remaining scopes and summary pages (no additional scopes are required for this tutorial), and click SAVE AND CONTINUE on each.
Move to the Credentials tab.
Click CREATE CREDENTIALS in the top bar, choose OAuth Client ID, select Desktop App as the Application Type, and click Create to obtain your Client ID and Secret.
Google Console – Create credentials
Download the credentials JSON file and save it in a secure location on your development machine.

Creating a new ODBC DSN using ZappySys JSON Driver

Search for ODBC in the Windows Start menu and open the ODBC Data Source Administrator.
In the User DSN or System DSN tab, click Add to create a new data source.
In the ODBC Data Source Setup window, select the ZappySys JSON Driver and click Continue.

Configuring the ODBC connection for Blogger

Set the API Base URL to the Blogger API endpoint:
https://www.googleapis.com/blogger/v3/blogs/{{Blog_ID}}/posts
Select OAUTH as the connection type, then click it to configure it.
Configure the authentication and provide the Client ID and Client Secret
Enter the Blogger Scope: https://www.googleapis.com/auth/blogger
Generate the token and test the connection
Click OK to save the connection
Set the HTTP method to GET.
Select the object you want to use in the Array Filter.
Test the connection by clicking Test Connection to verify your credentials and API access.
Save the configuration and name your ODBC DSN (e.g., “BloggerAPI”).
ODBC JSON driver – Blogger connection

Preview the data

Once your ODBC DSN is configured, go to the preview tab.
Select the table you want to use.
Press the Preview data button to see the result.
ODBC JSON driver – Blogger final result

Conclusion

You have successfully learned how to use Zappysys ODBC connectors to extract data from the Blogger
platform using the REST API. With ZappySys ODBC PowerPack, connecting Blogger to any ODBC-compatible application becomes
straightforward and reliable. By configuring the JSON ODBC driver for Blogger, you can access blog data from Excel, Power BI, Tableau, and other business intelligence tools.

Explore the full capabilities of the ZappySys ODBC PowerPack to optimize your data integration
tasks. By applying this pattern, you can extend your solution to include additional data sources and create unified reporting across multiple cloud-based APIs.

Need Help?

If you encounter any issues, our support team is here to help:

Live Chat — Use the chat widget (bottom-right corner of this page)
Email — support@zappysys.com
Support Center — Visit the ZappySys Support Portal

The post ODBC tutorial: How to connect Blogger to ODBC appeared first on ZappySys Blog.

Call ChatGPT REST API in SSIS

ZappySys Team — Fri, 20 Oct 2023 12:07:27 +0000

Introduction

OpenAI, the creators of ChatGPT, provide both a web interface and an API for seamless integration of their tools into applications. This article provides a comprehensive guide on how to establish a connection with the OpenAI API in SSIS using ZappySys JSON Source, enabling seamless data integration and retrieval.

Prerequisites

Before we perform steps listed in this article, you will need to make sure following prerequisites are met:

SSIS designer installed. Sometimes it is referred as BIDS or SSDT (download it from Microsoft site).
Basic knowledge of SSIS package development using Microsoft SQL Server Integration Services.
Make sure ZappySys SSIS PowerPack is installed (download it).
Optional (If you want to Deploy and Schedule ) – Deploy and Schedule SSIS Packages

Step-by-step guide to making a ChatGPT Rest API call

How to get an OpenAI API Key for ChatGPT

First, obtain your API key from OpenAI. This key is required for authenticating your requests.

To access the services, you will be required to set up an account with OpenAI. Click here to create your account. Once your account has been successfully created, proceed to log in to your OpenAI account.

You can find the API key by following these steps:

Navigate to the top right corner of the screen.
Click on your account name.
From the drop-down menu, select “API Keys.”
Alternatively, you can directly access the API Keys section by clicking here.

To generate a new secret key, please follow these steps:

Go to the API Keys page.
Look for the “Create new secret key” button.
Click the button to generate a new secret key.

Generate a new key

Upon generation, your API key will be visible on the screen. It’s crucial to copy the key and store it in a secure location immediately, as it will not be displayed again for security purposes.

The new key

Now that you have your API key, you can begin utilizing it to make calls with your components. A preliminary example involves retrieving a list of all available models in OpenAI. For detailed instructions, please refer to the API documentation available here.

ChatGPT Rest API call using JSON Source

1. Drag and Drop the SSIS Data Flow Task from the SSIS Toolbox.

Drag and drop Data flow task

2. Double-click on the DataFlow task to see the DataFlow designer surface.

3. From the SSIS toolbox drag and drop ZS JSON Source on the dataflow designer surface.

Drag and drop a JSON source

4. We will use this on the URL path:

https://api.openai.com/v1/models

5. In the HTTP headers grid add the following values by clicking Raw Edit button :

Authorization: Bearer YOUR_OPENAI_API_KEYOpenAI-Organization: org-YQ9qpxxxxxxxxxxxxgoPi

6. Select your preferred Array Filter, simply click the “Select Filter” button. for this API call we need to select the

$.data[*]

array filter

7. Final step: Click ‘Preview’ to initiate the ChatGTP Rest API call. You will also find a demonstration within our component, along with the resulting output from the call, below.

ChatGPT call

That’s it the configuration for the ChatGPT Rest API call has been completed successfully.

Load ChatGPT data in SQL Server using Upsert Destination (Insert or Update)

ZappySys SSIS PowerPack makes it easy to load data from various sources such as REST, SOAP, JSON, XML, CSV or from other source into SQL Server, or PostgreSQL, or Amazon Redshift, or other targets. The Upsert Destination component allows you to automatically insert new records and update existing ones based on key columns. Below are the detailed steps to configure it.

Step 1: Add Upsert Destination to Data Flow

Drag and drop the Upsert Destination component from the SSIS Toolbox.
Connect your source component (e.g., JSON / REST / Other Source) to the Upsert Destination.

SSIS - Data Flow - Drang and Drop Upsert Destination Component

Step 2: Configure Target Connection

Double-click the Upsert Destination component to open the configuration window.
Under Connection, select an existing target connection or click NEW to create a new connection.
- Example: SQL Server, or PostgreSQL, or Amazon Redshift.

Step 3: Select or Create Target Table

In the Target Table dropdown, select the table where you want to load data.
Optionally, click NEW to create a new table based on the source columns.

Configure SSIS Upsert Destination Connection - Loading data (REST / SOAP / JSON / XML /CSV) into SQL Server or other target using SSIS

Step 4: Map Columns

Go to the Mappings tab.
Click Auto Map to map source columns to target columns by name.
Ensure you check the Primary key column(s) that will determine whether a record is inserted or updated.
You can manually adjust the mappings if necessary.

SSIS Upsert Destination - Columns Mappings

Step 5: Save Settings

Click OK to save the Upsert Destination configuration.

Step 6: Optional: Add Logging or Analysis

You may add extra destination components to log the number of inserted vs. updated records for monitoring or auditing purposes.

Step 7: Execute the Package

Run your SSIS package and verify that the data is correctly inserted and updated in the target table.

SSIS Upsert Destination Execution

Conclusion

In this article, we explored the seamless process of establishing a connection with ChatGPT in SSIS and integrating data effortlessly, all without the need for coding. Interested in trying it out yourself? Feel free to Download ZappySys SSIS PowerPack by clicking here and experience the simplicity firsthand. Should you have any lingering queries, please don’t hesitate to ask by clicking here or initiating a conversation with our experts via the live chat icon at the bottom-right corner of this page.

The post Call ChatGPT REST API in SSIS appeared first on ZappySys Blog.

Download Gmail Attachment in SSIS

ZappySys Team — Wed, 30 Dec 2020 18:29:57 +0000

Introduction

UPDATE: ZappySys has released a brand new Gmail Connector for SSIS, which makes it much simpler to download attachments, read / search Emails, users, mail folders, send emails, and more in SSIS compared to the steps listed in this article. You can still use the steps from this article, but if you are new to APIs or want to avoid the learning curve, use a newer approach.

Downloading Gmail Attachments in SSIS is always a little more difficult than working with simple text or numeric columns. If you are not an SSIS expert, doing it for the first time may be challenging. That is why we created this article for you. This is a common request we receive, so we are bringing this article to you.

Gmail is the most popular email service in the world, and it can be helpful to automate and get valuable information from it. We will connect to Gmail with the REST API. For that, if you are not an experienced user of the REST API, do not worry. This article is for you. We will provide simple steps for the connection.

Requirements

To do it, we will need the following components:

SSDT for SSIS must be installed on your computer
ZappySys SSIS Powerpack should be installed. This Powerpack Plugin includes connectors to Gmail via the REST API.

Getting Started

Creating the connection

First of all, in SSDT, create a new SSIS project
To create a connection in SSDT, open the Connection Manager and select New Connection.
Create a new connection
Select the ZS OAuth connection. This is a special connection included with the ZS.
SSIS PowerPack installer that we will use to connect to Gmail.

Select ZS-OAuth connector

In the ZS OAuth connection, select the Google API OAuth Provider and specify the following credentials and scope permissions:

SSIS Gmail connection

https://mail.google.com/
https://www.googleapis.com/auth/gmail.modify
https://www.googleapis.com/auth/gmail.readonly
https://www.googleapis.com/auth/gmail.addons.current.message.readonly
https://www.googleapis.com/auth/gmail.addons.current.message.action

Creating the package to download Gmail attachments in SSIS

First of all, drag and drop the Data Flow Task from the SSIS Toolbox and double-click it
to edit.

Drag and Drop SSIS Data Flow Task from SSIS Toolbox
Secondly, in the Data Flow, we will use the JSON Source to connect to Gmail and get the attachments. JSON Source is a ZappySys component used now only to connect to JSON files, but also to connect to REST API Servers that support JSON. In this case, Gmail REST API can send information in JSON Format. Use the connection created before.
Basically, we need to specify the URL of the Gmail attachment. In Gmail, the email attachment is inside the message. Then you need to specify the message-id and the Gmail attachment-id like this:
Zappysys JSON source Gmail attachments configuration
```
https://www.googleapis.com/gmail/v1/users/me/messages/{{User::email_id}}/attachments/{{User::attachment_id}}
```
Now, in the go-to columns tab, set the data type to DT_IMAGE and increase the length of the other columns’ DT_WSTR fields by 1000 and 1500. We set
```
contentBytes
```
to the
```
DT_IMAGE
```
datatype, it’s like
```
varbinary(MAX)
```
JSON Source Columns Tab – attachment datatype
Next, we will use the derived column to set the path to the local folder where the attachment will be stored. The derived column will be used to set the local path for the attachment. Make sure to specify valid paths with double backslashes, since backslashes are special characters. The derived column is a special transformation component that creates new columns. SSIS expressions.
Derived columns – Gmail attachment file path
Also, we will require the Export column to download into a file. This component is specially used to get images or binary files into the file system.
Export columns transformation – Gmail attachment
Finally, we will use the Trash destination to get the attachment and finish the flow. This one is also a ZappySys component ubiquitous.
Your package should be something like this:
Final Result – Gmail attachment
The next step is to run it and test it.
If everything is fine, we will be able to see the file in your system.

Conclusion

In conclusion, we learned how to download Gmail attachments in SSIS. Basically, you need to use the ZappySys JSON Source to connect to Gmail via the REST API, then use the derived column component to specify the path to store the attachment. The next step is to use the Export column component to export the attachment. Finally, the ZS Trash destination is the attachment’s destination. If you liked this article, do not hesitate to continue testing and using ZappySys PowerPack for SSIS.

API Connector

Here are a few examples with our API connector for Gmail

API connector – Gmail get message attachments

API connector – Gmail download message attachments

The post Download Gmail Attachment in SSIS appeared first on ZappySys Blog.

Get data from Google Search Console API in SSIS and ODBC Apps

ZappySys — Wed, 09 Oct 2019 20:22:28 +0000

Introduction

In our previous few posts we saw how to call various google apis in SSIS. In this post lets learn how to call Google Search Console API in SSIS or other ODBC Compatible Apps such as Power BI, Informatica, SSRS using API Drivers for ODBC

Prerequisites

Before we perform the steps listed in this article, you will need to make sure the following prerequisites are met:

SSIS designer installed. Sometimes it is referred to as BIDS or SSDT (download it from the Microsoft site).
Basic knowledge of SSIS package development using Microsoft SQL Server Integration Services.
Make sure ZappySys SSIS PowerPack is installed (download it, if you haven't already).
(Optional step). Read this article, if you are planning to deploy packages to a server and schedule their execution later.

About Google Search Console API (Google Webmaster API)

If you are new to Google Search Console API (i.e. Webmaster API) then start from this link. You can also check API Explorer here to test API requests.

Search API can be called by supplying either API key in URL or use OAuth

Search Console V3 Covers following APIs (May add more in future)

API Name	Description
webmasters.searchanalytics.query	Query your data with filters and parameters that you define. Returns zero or more rows grouped by the row keys that you define. You must define a date range of one or more days. When date is one of the group by values, any days without data are omitted from the result list. If you need to know which days have data, issue a broad date range query grouped by date for any metric, and see which day rows are returned.
webmasters.sitemaps.delete	Deletes a sitemap from this site.
webmasters.sitemaps.get	Retrieves information about a specific sitemap.
webmasters.sitemaps.list	Lists the sitemaps-entries submitted for this site, or included in the sitemap index file (if sitemapIndex is specified in the request).
webmasters.sitemaps.submit	Submits a sitemap for a site.
webmasters.sites.add	Adds a site to the set of the user’s sites in Search Console.
webmasters.sites.delete	Removes a site from the set of the user’s Search Console sites.
webmasters.sites.get	Retrieves information about specific site.
webmasters.sites.list	Lists the user’s Search Console sites.

Search Console API Call Example

Here is simple example of Search Console API call. Below example returns all sites you added under your search console account.

Request

GET https://www.googleapis.com/webmasters/v3/sites?key={YOUR_API_KEY}

Response

{
 "siteEntry": [
  {
   "siteUrl": "https://my-google-search-api-1.com/",
   "permissionLevel": "siteOwner"
  },
  {
   "siteUrl": "https://www.my-google-search-api-1.com/",
   "permissionLevel": "siteOwner"
  },
  {
   "siteUrl": "https://my-google-search-api-2.com/",
   "permissionLevel": "siteOwner"
  },
  {
   "siteUrl": "https://www.my-google-search-api-2.com/",
   "permissionLevel": "siteOwner"
  }
 ]
}

Step-By-Step – Call Search Console API in SSIS

Now lets look at very simple API call to list search console sites

Open SSIS Package
Drag and drop ZS REST API Task from SSIS tool box
Drag and Drop ZS REST API Task from SSIS Toolbox
Now double click REST API Task and configure (Skip Step 5 if you use API Key instead of OAuth).
Enter API URL you like to call. For This example we will use simple URL as below
OAuth based Authentication
```
https://www.googleapis.com/webmasters/v3/sites/
```
API Key based Authentication
```
https://www.googleapis.com/webmasters/v3/sites/?key={YOUR_API_KEY}
```
If you want to use OAuth based credentials then perform the following steps
1. Select URL from Connection
2. Click New ZS-OAUTH connection from Dropdown
3. On the OAuth UI select Google as Provider
4. Enter Scopes as below
```
https://www.googleapis.com/auth/webmasters
https://www.googleapis.com/auth/webmasters.readonly
```
5. Click Generate Token. When you get Login Prompt enter your Google Account information and click Accept
6. Click OK to Save OAuth UI
This is how it will look like if you use OAuth Connection
Call Google Search Console API using SSIS REST API Task (OAuth Authentication)
Now click Test Request / Response to check if its working. You should get response like below

Read from Search Console Analytics API (query)

Now let’s look at how to call Search Console Analytics API (i.e. query) for Specified Site and extract data in tabular format using ZS JSON Source. In below example we will obtain search Impression, clicks, position etc for specified site. We will aggregate this over date and country (dimensions).

In this section you will learn how to use JSON Source Adapter to extract data from JSON file (In this case its Web URL).

Firstly, You need to Download and Install SSIS ZappySys PowerPack.
Once you finished first step, Open Visual Studio and Create New SSIS Package Project.
Now, Drag and Drop SSIS Data Flow Task from SSIS Toolbox.
Double click on the Data Flow task to see Data Flow designer surface.
From the SSIS toolbox drag and drop JSON Source on the Data Flow designer surface.
Double click JSON Source and configure like below
1. Enter URL as below. Notice two things, first we used <> placeholder function to encode : and // in the URL so it become %2F %3A. We use
```
--dont-escape--
```
  suffix at the end.
  For OAuth based Credentials
```
https://www.googleapis.com/webmasters/v3/sites/<>/searchAnalytics/query--dont-escape--
```
  For API Key based Credentials
```
https://www.googleapis.com/webmasters/v3/sites/<>/searchAnalytics/query/?key={YOUR_API_KEY}--dont-escape--
```
2. Check Use Credentials and select OAuth connection (created earlier) (if you are using API key in URL then skip this step).
3. Select POST as HTTP Method
4. Enter Body for Query. Here are some examples for various queries you can use. For our case we want to group by date and country so use below
```
{
"startDate": "2019-01-01",
"endDate": "2019-01-10",
"dimensions" : ["date","country"]
}
```
5. Select Content Type as
```
application/json
```
  from Content Type drop down.
6. Select Filter or enter as
```
$.rows[*]
```
7. Now go to Extract Multiple Arrays Tab and Check Array Flattening Option (on older version it was on the different Tab)
Click Preview and you will see your Google Search Console API data as below.
Read from Google Search API Console (Analytics Query Endpoint) – JSON Source

Loading Google Search Console API data into SQL Server / Other Target

Step 1: Add Upsert Destination to Data Flow

Drag and drop the Upsert Destination component from the SSIS Toolbox.
Connect your source component (e.g., JSON / REST / Other Source) to the Upsert Destination.

SSIS - Data Flow - Drang and Drop Upsert Destination Component

Step 2: Configure Target Connection

Double-click the Upsert Destination component to open the configuration window.
Under Connection, select an existing target connection or click NEW to create a new connection.
- Example: SQL Server, or PostgreSQL, or Amazon Redshift.

Step 3: Select or Create Target Table

In the Target Table dropdown, select the table where you want to load data.
Optionally, click NEW to create a new table based on the source columns.

Configure SSIS Upsert Destination Connection - Loading data (REST / SOAP / JSON / XML /CSV) into SQL Server or other target using SSIS

Step 4: Map Columns

Go to the Mappings tab.
Click Auto Map to map source columns to target columns by name.
Ensure you check the Primary key column(s) that will determine whether a record is inserted or updated.
You can manually adjust the mappings if necessary.

SSIS Upsert Destination - Columns Mappings

Step 5: Save Settings

Click OK to save the Upsert Destination configuration.

Step 6: Optional: Add Logging or Analysis

You may add extra destination components to log the number of inserted vs. updated records for monitoring or auditing purposes.

Step 7: Execute the Package

Run your SSIS package and verify that the data is correctly inserted and updated in the target table.

SSIS Upsert Destination Execution

Import Google Search Console API data in Reporting / other ETL tools (ODBC Usecase)

There will be a time when you dont want to use SSIS connector like mentioned in previous sections but extract Google Search API data in Reporting Tools / Other ETL Platform. Good news is you can use ZappySys ODBC Driver for JSON / REST API in ODBC Apps. See few popular ODBC Apps below.

Power BI connection for Google Search Console API
Excel connection for Google Search Console API
Informatica connection for Google Search Console API
MS Access connection for Google Search Console API
C# , PowerShell, VB.net connection for Google Search Console API

Preview / Generate Query in JSON Driver / XML Driver

Load Google Search Console API in SQL Server without any ETL

Now let’s look at even more interesting integration scenario. If you have SQL Server and like to load Google Search Console API without any ETL then you can use Data Gateway

Read this article to learn how to load REST API in SQL Server without any coding (Use just T-SQL) .

You can write query like below to load data inside SQL Table.

SELECT * FROM OPENQUERY([MY_LINKED_SERVER]
, 'SELECT * FROM $
WITH(
	 Src=''https://www.googleapis.com/webmasters/v3/sites/<>/searchAnalytics/query/?key={YOUR_API_KEY}--dont-escape--''
	,Filter=''$.rows[*]''
	,RequestData=''{
"startDate": "2019-01-01",
"endDate": "2019-01-10",
"dimensions" : ["date","country"]
}''
	,RequestContentTypeCode=''ApplicationJson''
	,Header=''cache-control: no-cache || Accept: */*''
	,RequestMethod=''POST''
	,EnableArrayFlattening=''True''
)')

SSMS Output – Query REST API via Linked Server OPENQUERY statement (Connect to ZappySys Data Gateway)

Conclusion

So in this post we saw how easy it is to achieve total REST API integration in SSIS using JSON Connector. We also saw how to use ODBC Drivers to query REST API data inside Apps like Excel, MS Access, Informatica and other ODBC Apps using ODBC JSON / REST API driver. If you are SSIS User download SSIS PowerPack and try for FREE and if you don’t have SSIS in house and want to try more generic approach then Download ODBC PowerPack Drivers for FREE Trial.

The post Get data from Google Search Console API in SSIS and ODBC Apps appeared first on ZappySys Blog.

How to Make PayPal API Call in ODBC / SQL Server (T-SQL)

ZappySys — Sat, 14 Sep 2019 08:49:27 +0000

Introduction

In our previous article we saw how to call PayPal API in SSIS. Now in this article, we will see How to Make PayPal API Call in ODBC from the SQL Server. This blog mainly focuses on ODBC approach but steps mentioned to call PayPal APIs can be useful for any developer regardless of which programming language or tool set you use. We will also see How to send basic Authorization header along with body in OAuth2.

We will go through the steps to Create PayPal Order from MS SQL Server.

In nutshell, this post will focus on how to make PayPal API Call using ODBC Driver.

Prerequisites

Before we perform the steps listed in this article, you will need to make sure the following prerequisites are met:

A first requirement, make sure that Microsoft Access installed
Make sure to have ZappySys ODBC PowerPack installed.
Credentials of PayPal API. Click here to create API.

What is PayPal?

PayPal is an American company operating a worldwide online payments system that supports online money transfers and serves as an electronic alternative to traditional paper methods like checks and money orders. The company operates as a payment processor for online vendors, auction sites, and many other commercial users, for which it charges a fee in exchange for benefits such as one-click transactions and password memory. PayPal’s payment system, also called PayPal, is considered a type of payment rail.

Get Started with PayPal API

If you have need to automate PayPal operations (e.g. read / write / update / delete ) then you can use PayPal REST API. Before you can integrate a PayPal product or solution, you must set up your development environment to get OAuth 2.0 client ID and secret credentials for the sandbox and live environments. You exchange these credentials for an access token that authorizes your REST API calls. To test your web and mobile apps, you create sandbox accounts.

Get PayPal credentials

To generate OAuth 2.0 credentials for the sandbox and live environments:

Log into Dashboard and type your PayPal personal or business account email and password.
In the REST API apps section, click Create App. The purpose of this app is to generate your credentials.
Type a name for your app and click Create App. The page shows your sandbox app information, which includes your credentials.

Note: To show your live app information, toggle to Live.
Copy and save the client ID and secret for your sandbox app.
PayPal Client ID and Secret
Review your app details and save your app.

Call PayPal Create Order API in SQL Server (T-SQL) using Data Gateway

Let’s start with an example. We use JSON Driver to make the call to PayPal API, we will Create the PayPal Order from SQL Server.

In REST API calls, include the URL to the API service for the environment:

Sandbox: https://api.sandbox.paypal.com
Live: https://api.paypal.com

To do this, first of all, we will open the ZappySys Data Gateway Configuration:
Open ZappySys Data Gateway
Add the Native – ZappySys JSON Driver Data source.
Add Gateway Data Source (Native JSON Driver)

Now it’s time to connect with PayPal. Let’s use JSON Driver Data source with the following URL:

https://api.sandbox.paypal.com/v2/checkout/orders

Body:

{
  "intent": "CAPTURE",
  "purchase_units": [
    {
      "amount": {
        "currency_code": "USD",
        "value": "100.00"
      }
    }
  ]
}

PayPal : Create Order

Create Basic OAuth Client Credentials Grant (Configure ZS-OAuth Connection).
In the SSIS ZS OAuth Connection Manager, Select Provider as Custom, select version as OAuth2 and select Grant Type as Client Credentials Grant. Enter the credentials and access token url and click OK.
```
https://api.sandbox.paypal.com/v1/oauth2/token
```
ZS OAuth Connection – Client Credentials Grant
Furthermore, Now click on Test Connection button to test PayPal Connection.
PayPal : Test Connection
Write your Query and Preview Data.
(Optional Step) If your Query use POST method (e.g. Create Invoice) to submit data then you have Save Metadata (Read More). We will use this meta file in later step when we call POST request.
Generate Metadata File for REST API POST Operation using ZappySys API Driver (JSON / XML)
Now using Code Generator we will generate the query.
Generate Query

Setup Linked Server in MS SQL Server for PayPal

Once you configured the data source in Gateway, we can now setup Linked Server in SQL Server to query API Calls.

Assuming you have installed SQL Server and SSMS. If not then get both for FREE from here: Get SQL Server Express and Get SSMS
Open SSMS and connect to SQL Server.
Go to Root > Server Objects > Linked Servers node. Right click and click New Linked Server…

Add Linked Server in SQL Server
Now enter the linked server name, select Provider as SQL Native Client
Enter data source as GatewayServerName, PORT_NUMBER
where server name is where ZappySys Gateway is running (Can be same as SQL Server machine or remote machine). Default PORT_NUMBER is 5000 but confirm on Data gateway > General tab in case its different.
Enter Catalog Name. This must match name from Data gateway Data sources grid > Name column

Configure Linked Server Provider, Catalog, Server, Port for ZappySys Data Gateway Connection
Click on Security Tab and select last option “Be made using this security context“. Enter your gateway user account here.
Click OK to save Linked Server

Create Order in PayPal from SQL Server (Call POST API Method)

To Create Order in PayPal we need to execute the query like this. Please refer to this link for more information: Create Order example.

Important Note*: Below query uses META property (fully explained here). This is needed if you creating anew record using POST, PUT. If you don’t pass META='{xxxx}’ in query driver calls REST API two times (first time to parse metadata and second time to get actual data). So that you find some odd thing in PayPal if you execute the query without Meta then you will find two same Orders created in your PayPal as the driver makes two calls as mentioned above.

-- In below query rather than WITH(META=''[{"Name": "Success","Type": "Int32"}]'' ....
-- You can also use WITH(META=''c:\my-meta-file.txt'' .... We created this file in previous section

SELECT * FROM OPENQUERY([MY_LINKED_SERVER_NAME]
, 'SELECT * FROM $
WITH(META=''[{"Name": "Success","Type": "Int32"}]''
	 ,Src=''https://api.sandbox.paypal.com/v2/checkout/orders''
	,RequestData=''{
  "intent": "CAPTURE",
  "purchase_units": [
    {
      "amount": {
        "currency_code": "USD",
        "value": "100.00"
      }
    }
  ]
}''
	,RequestContentTypeCode=''ApplicationJson''
	,RequestMethod=''POST''
)')

Here is the preview after you run REST API query in SQL Server. It will return created Order Id, Links and status. Notice that you can override default configuration by supplying many parameters in WITH clause.
Create Order In PayPal Using SQL Query
You can also find this created Order by opening that URL in the browser.
Created Order In PayPal

PayPal API integration in ODBC apps (e.g. Power BI, Excel, Informatica, Access, C#…)

So far we have looked at SQL Server integration only, but what if you like to use same powerful ZappySys API drivers part of ODBC PowerPack in other Apps like Power BI, Excel, MS Access, Informatica and many more… ?? Well not to worry if you know that App supports ODBC you can use ZappySys ODBC Driver same way described earlier… only difference is you dont need Linked Server and you dont have to use OPENQUERY statement when you use ODBC Drivers.

ZappySys ODBC Drivers built using ODBC standard which is widely adopted by industry for a long time. Which mean the majority of BI Tools / Database Engines / ETL Tools already there will support native / 3rd party ODBC Drivers. Below is the small list of most popular tools / programming languages our Drivers support. If your tool / programming language doesn't appear in the below list, which means we have not documented use case but as long as your tool supports ODBC Standard, our drivers should work fine.

BI / Reporting Tools Integration	ETL Tools Integration	Programming Languages Integration
Microsoft Power BI Tableau SSRS (SQL Reporting Services) QlikView /Qlik Sense MicroStrategy Google Sheet Microsoft Excel Microsoft Access Oracle OBIEE Many more (not in this list).....	Informatica PowerCenter (Windows) Informatica Cloud SSIS (SQL Integration Services) SQL Server Talend Data Studio Pentaho Kettle Oracle OBIEE Many more (not in this list).....	Visual Studio C# C++ JAVA Python PHP PowerShell T-SQL (Using Linked Server)

Conclusion

So in this blog, we learned how to generate a PayPal API Token, Load PayPal data in MS SQL Server table using ODBC JSON / REST API Driver in a very simple way. You can achieve many more functionalities with this tool. Check our blogs/articles on JSON / REST API Driver to find out what this tool is capable of more.

References

Finally, you can use the following links for more information about the use of PayPal API with our tools:

Landing Page for ODBC JSON / REST API Driver, you can also find Tutorial Video here.
Help File: Documentation of JSON Driver.
PayPal API

The post How to Make PayPal API Call in ODBC / SQL Server (T-SQL) appeared first on ZappySys Blog.

Pivot JSON and XML data using SSIS or ODBC Drivers

ZappySys — Wed, 11 Sep 2019 21:36:09 +0000

Introduction

In our previous post we saw various ways to transform JSON arrays. However there will be a time when your JSON / XML file wont have Array and you need to Pivot JSON Data.

Prerequisites

Before we perform the steps listed in this article, you will need to make sure the following prerequisites are met:

SSIS designer installed. Sometimes it is referred to as BIDS or SSDT (download it from the Microsoft site).
Basic knowledge of SSIS package development using Microsoft SQL Server Integration Services.
Make sure ZappySys SSIS PowerPack is installed (download it, if you haven't already).
(Optional step). Read this article, if you are planning to deploy packages to a server and schedule their execution later.

Sample JSON data file

Here is a sample JSON file which we like to parse into rows and columns. Notice how it is using values inside in property name. This pattern needs Pivot option usage described later in this article.

{
	"version": 1.0,
	"products": {
		"P001": {
			"name": "Product 1",
			"price": 10
		},
		"P002": {
			"name": "Product 2",
			"price": 11
		},
		"P003": {
			"name": "Product 3",
			"price": 12
		}
	}
}

If you like to play with real data then use below URL. This JSON has 60MB worth of data for all Products offered on AWS. And It has similar structure as above except many more attributes under products node.

https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonEC2/current/us-east-1/index.json

Using SSIS PowerPack to Pivot JSON data

ZappySys offers powerful JSON and XML Connectors. Below section will describe how to Parse and Pivot JSON data or Pivot XML data. For demo purpose we will use JSON Source but steps are almost same for XML too.

Step-By-Step JSON Pivot

First drag data flow from SSIS Toolbox and then double click data flow
Drag SSIS Data Flow Task from Toolbox
Once Data flow designer is open, drag ZS JSON Source from SSIS Toolbox.
Drag ZappySys JSON Source
Now for demo we will use Hard coded JSON using Direct Value option as below. You can also enter URL or File path if you select Direct Path option.
Go to Pivot Columns to Rows Tab and check Enable Pivoting Option
Pivot JSON / XML Data option for ZappySys API Connectors / Drivers
Now come back to Filter Options Tab here you can either browse Filter or enter by hand. If file is too large then enter by hand. For example in our case we will enter
```
$.products
```
because we like to to parse structure below that node. If you have nested hierarchy (i.e. products node under orders node and so on) then use dot to separate them e.g.
```
$.customer.orders.products
```
For very Large file you need to Un-check Include Parent Columns option else you will get OutOfMemory Exception
Now click Preview to see our data.
Pivot JSON Data using SSIS JSON Source
Now you can connect your JSON / XML source to destination. See below example.
SSIS Package Execution –
Loading Google BigQuery Data into SQL Server

Using ODBC PowerPack to Pivot JSON data

So far we talked how to use SSIS to read your JSON data and Pivot it but what if you want to consume JSON / XML / REST API data in some other App without doing ETL via SSIS? Thats where ZappySys ODBC PowerPack comes in picture. Its a collection of many drivers including JSON Driver and XML Driver. You can also use Data Gateway Approach, which allows T-SQL code to fetch JSON / XML data directly into SQL Server Table without any ETL / Programming.

Here is sample query you can run using JSON Driver or XML Driver

SELECT * FROM $
WITH(
	 Src='https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonEC2/current/us-east-1/index.json'
	,Filter='$.products'
	,IncludeParentColumns='False'
	,EnablePivot='True'
)

See below screenshot of JSON Driver Configuration to get idea.
Note: Use above query rather than what is displayed in the Screenshot.

Using ODBC DSN in C# code to call REST API

Preview / Generate Query in JSON Driver / XML Driver

BI / Reporting Tools Integration	ETL Tools Integration	Programming Languages Integration
Microsoft Power BI Tableau SSRS (SQL Reporting Services) QlikView /Qlik Sense MicroStrategy Google Sheet Microsoft Excel Microsoft Access Oracle OBIEE Many more (not in this list).....	Informatica PowerCenter (Windows) Informatica Cloud SSIS (SQL Integration Services) SQL Server Talend Data Studio Pentaho Kettle Oracle OBIEE Many more (not in this list).....	Visual Studio C# C++ JAVA Python PHP PowerShell T-SQL (Using Linked Server)

Advanced Pivot with Path / Search and Replace Option

Now let’s look at an advanced scenario where you like to extract Pivot_Path (know where Pivoted Property came from). For that, you can download the latest version which providers IncludePivotPath and EnablePivotPathSearchReplace options as below.

As you can see in the below example let’s say you like to extract table names and view names if defined under “views” node.

{
  "table-1": {
      "views": {
        "view-tbl1-1": {},
        "view-tbl1-2": {}
    }
  },
  "table-2": {
      "views": {}
  },
  "table-3": {
      "views": {
        "view-tbl3-1": {}
    }
  }
}

We set following

On the Filter Options Tab
Filter =
```
$..views
```
on the Pivot Columns To Rows Tab
Check Enable Pivoting
Check Include_PivotPath
Check Enable Pivot_Path search/replace
Set Search for
```
(.*).views.(.*)--regex
```
Set Replace With
```
$1
```

Advanced Pivot Option – Search and Replace Path

Conclusion

In this particle we saw how to use some advanced options for XML/ JSON Source and ODBC Drivers. You can download respective product depending your usecase. For SSIS usecase Download SSIS PowerPack and for other ETL / Reporting app integration scenarios (i.e. Power BI, Informatica, SSRS , Excel, MS Access, SQL Server, JAVA, C# ….) Download ODBC PowerPack.

The post Pivot JSON and XML data using SSIS or ODBC Drivers appeared first on ZappySys Blog.

How to Export REST API to MS Access using VBA Command Button

ZappySys — Sat, 29 Jun 2019 09:34:55 +0000

Introduction

In our previous blog we saw how to export REST API to CSV using c# or Python. In this post we will look at specific example on How to Export REST API to MS Access using VBA Command Button, along with few other topics such as how to make REST API Call, how to read all Customers data from Odata using our ODBC JSON Driver and load it into the Ms Access Table.

We will go through the steps to read data from Odata and Load into MS Access using VBA Command Button.

In nutshell, this post will focus on how to make ODBC Driver Call using VBA.

So let’s get started.

Requirements

First of all, you will need ZappySys ODBC PowerPack installed.
Secondly, Make sure that Microsoft Access installed for VBA example.

An introduction to Rest API and OData

In this example, we will use OData (Open Data Protocol) to consume REST API. REST API (Representational State Transfer Application Program Interface) allows handling the interoperability between computers and the internet.

In REST API we can handle web services in different formats. In this example, we will work with the Northwind example. The Northwind example is available in this URL:

https://services.odata.org/V3/Northwind/Northwind.svc

By default, the data is displayed in XML format. To show the data in JSON use this URL:
```
https://services.odata.org/V3/Northwind/Northwind.svc/?$format=json
```
There are collections of data like Categories, CustomerDemographic, Customers, Invoices, etc. For example, the following URL will show the data of the categories collection:
```
https://services.odata.org/V3/Northwind/Northwind.svc/Customers?$format=json
```
In the next steps, we will use ZappySys drivers to connect to this URL and query using OData.

Configure ODBC DSN for ZappySys JSON Driver

ODBC driver can be accessed in two modes.

Using DSN
Without DSN (Supply direct Connection String e.g. DRIVER={ZappySys JSON Driver}; …….. )

In this article, we will use the DSN approach (User DSN). We will first add the ZappySys JSON Driver in the ODBC Data Source Administrator.

Follow these steps to accomplish the task:

First, Windows search, write ODBC and select the ODBC Data sources (32 bits)

Open ODBC Data Source
As a second step, in ODBC Data source Administrator press the Add button.

Add ZappySys
In this step, create the new data source, select ZappySys JSON Driver.

Add new zappysys json driver
Here we have several properties, write a data source name. In this example, the name will be ZappySys JSON to Excel.
The Data Source (URL or file path) can specify the URL of the source or if it is a local file, you can specify the local path. In this example, the URL is:
```
https://services.odata.org/V3/Northwind/Northwind.svc/Customers?$format=json
```
You can also specify a local file path as Data SourceFor a single file: c:\data\myfile_1.json
For multiple files: c:\data\myfile_*.json
Configure the ODBC JSON Driver like this and test the connection:
Configure JSON Driver for REST API Call
Now click on Copy Connection string Button.
ODBC Driver : Copy Connection String
That’s it Connection string is copied to clipboard. Now let’s use this connection string in the VBA code.

How to import REST API data to Access using VBA

Open the access database and create the table with the desire columns to get API data in it.
Create Table in Access
Now close the table, and go to Create menu and click on Form Design to add the new blank form in design view.
Access : Create a New Form in Design View
It will open the new form in the design view, now add new button with the desire text.
Access : Add Command Button
Now right click on button and go to properties and click on … builder button and select Code Builder.
Access : Code builder

When you click the button, it will open a new VBA instance, executing the command event associated with that button click.
Next, insert the provided code inside the Command5_Click() function. In this example, the button is named Command5, and that’s why it’s added within this click function.
The provided code encompasses the following steps:

Ensure the table is closed:
It’s crucial to close the table beforehand; otherwise, executing the subsequent command may result in an error.
Truncate the table:
Clear the existing data from the table. If you want to add fresh data each time
Make the API call:
Utilize the ODBC Driver connection string to initiate an API call.
Insert into the Access table:
Use the retrieved data from the API call to insert new records into the Access table.
Open the table:
Reopen the table to inspect the newly inserted data.

' Pass your ZappySys Driver Connection String: Refer to below link to learn how to obtain the ZappySys Driver connection string:
    ' https://community.zappysys.com/t/how-to-copy-the-zappysys-driver-connection-string/172
    Dim zsConnStr As String
    zsConnStr = "DRIVER={ZappySys JSON Driver};DataPath='https://services.odata.org/V3/Northwind/Northwind.svc/Customers?$format=json';Filter='$.value[*]';IncludeParentColumns=0;RequestMethod='GET';RequestHeaders='cache-control: no-cache || Accept: */*'"
        
    'ZappySys Driver Query
    Dim zsDriverQuery As String
    zsDriverQuery = "Select * from $"
 
    'MS Access Table Name
    Dim tableName As String
    tableName = "tblCustomers"

    ' 1. Close Table If Open
    CloseTableIfOpen tableName

    ' 2. Truncate Table (Optional): If you want to load fresh data each time, uncomment the line below.
    'TruncateTable tableName

    ' 3. Import Data From API Into Table
    ImportDataFromAPIIntoTable zsConnStr, zsDriverQuery, tableName

    ' 4. Open Table for Viewing (Optional)
    OpenTableForViewing tableName

    ' Show Message after Loading Data Successfully
    MsgBox "Data Loaded Successfully!"

VBA Button OnClick Function

Below the Private Sub Command5_Click() function, please add the necessary functions and procedures as provided below:

Sub ImportDataFromAPIIntoTable(zsConnStr As String, zsDriverQuery As String, tableName As String)
    Dim dscn As New ADODB.Connection
    dscn.Open zsConnStr

    Dim rs As Object
    Set rs = New ADODB.Recordset
    
    ''ZappySys Driver Query Goes here
    rs.Open zsDriverQuery, dscn

    Dim strQuery As String
    strQuery = ""
    ' Check if the recordset is not empty
    If Not rs.EOF Then
        ' Get the field names
        Dim fieldNames As String
        fieldNames = ""

        For i = 1 To rs.Fields.Count
            fieldNames = fieldNames & rs.Fields(i - 1).Name
            If i < rs.Fields.Count Then
                fieldNames = fieldNames & ","
            End If
        Next i

        ' Generate the INSERT script
        Dim insertScript As String
        ' Iterate through the recordset to get the values
        Do Until rs.EOF
            ' Generate Insert script
            insertScript = "INSERT INTO " & tableName & " (" & fieldNames & ") VALUES"
            insertScript = insertScript & vbCrLf & "("
            For i = 1 To rs.Fields.Count
                ' Assuming all fields are text, you might need to handle different data types appropriately
                
                If IsNull(rs.Fields(i - 1).Value) Then
                    insertScript = insertScript & "''"
                Else
                    insertScript = insertScript & "'" & EscapeSingleQuote(rs.Fields(i - 1).Value) & "'"
                End If
                
                
                If i < rs.Fields.Count Then
                    insertScript = insertScript & ","
                End If
            Next i
            insertScript = insertScript & ")"
            
            'Insert data
            CurrentProject.Connection.Execute insertScript
            
            rs.MoveNext
        Loop
    End If
    
    ' Close the recordset and connection
    rs.Close
    dscn.Close
    Set rs = Nothing
    Set conn = Nothing
    
End Sub

Sub OpenTableForViewing(tableName As String)
    If Not IsTableOpen(tableName) Then
        DoCmd.OpenTable tableName
    End If
End Sub

Public Function IsTableOpen(strName As String) As Boolean
     IsTableOpen = SysCmd(acSysCmdGetObjectState, acTable, strName)
End Function

Sub CloseTableIfOpen(tableName As String)
    If IsTableOpen(tableName) Then
        DoCmd.SelectObject acTable, tableName
        DoCmd.RunCommand acCmdSaveRecord
        DoCmd.Close
    End If
End Sub


Sub TruncateTable(tableName As String)
    Dim strSql As String
    strSql = "DELETE FROM " & tableName & ";"
    CurrentProject.Connection.Execute strSql
End Sub

Public Function EscapeSingleQuote(strData As String) As String
     EscapeSingleQuote = Replace(strData, "'", "''")
End Function

Now, save the VBA form code and provide some appropriate form names.
Save form vba code
Make sure to add the reference to the Microsoft ActiveX Data Objects X.0 Library in the project settings.In Microsoft Access VBA,
You can add the reference to the Microsoft ActiveX Data Objects X.0 Library by following these steps:
1. In the VBA editor, go to “Tools” in the menu and select “References.”
2. In the References dialog box, scroll down the list to find “Microsoft ActiveX Data Objects X.0 Library” (where “X.0” corresponds to the version number, such as 6.1, 2.8, etc.).
3. Check the box next to the appropriate version to enable the reference.
4. Click “OK” to save the changes and close the References dialog box.
Now, your Access project has a reference to the Microsoft ActiveX Data Objects library, and you can use its features in your VBA code.

Access : Add reference

If the MS ActiveX reference is not added, an error will be thrown.

VBA : Error Type not defined
Close the code project, open the form in Form View, and click on the button.
Access : Click Command Button
After clicking the button, it will initiate a REST API call, insert the data into the Access table, and open the table to display the inserted records along with a success message.
Access : Open the table

Troubleshooting Errors

While running in Access\Excel\other and reading data from DSN created with ODBC PowerPack, if you get this error "License type [ODBC_PP_TRIAL] not found or its expired"

Please refer to this article for the same: Troubleshooting "License type [ODBC_PP_TRIAL] not found or its expired" error in Microsoft Access

Conclusion

In this article, we saw how to use VBA to call REST API. We show how to do REST API calls in Access using the ZappySys ODBC driver. Also, we show how to write VBA Code in MS Access for command button to make REST API call, truncate access table and insert record in the access table using VBA code. If you liked this article and you want to try, you can download the ZappySys ODBC installer here.

References

Form VBA Code:

After completing the migration of the higher-level VBA code, you’ll notice a transformation in the structure of your forms’ code.

Option Compare Database

Private Sub Command5_Click()
 
    ' Pass your ZappySys Driver Connection String: Refer to below link to learn how to obtain the ZappySys Driver connection string:
    ' https://community.zappysys.com/t/how-to-copy-the-zappysys-driver-connection-string/172
    Dim zsConnStr As String
    zsConnStr = "DRIVER={ZappySys JSON Driver};DataPath='https://services.odata.org/V3/Northwind/Northwind.svc/Customers?$format=json';Filter='$.value[*]';IncludeParentColumns=0;RequestMethod='GET';RequestHeaders='cache-control: no-cache || Accept: */*'"
        
    'ZappySys Driver Query
    Dim zsDriverQuery As String
    zsDriverQuery = "Select * from $"
 
    'MS Access Table Name
    Dim tableName As String
    tableName = "tblCustomers"

    ' 1. Close Table If Open
    CloseTableIfOpen tableName

    ' 2. Truncate Table (Optional): If you want to load fresh data each time, uncomment the line below.
    'TruncateTable tableName

    ' 3. Import Data From API Into Table
    ImportDataFromAPIIntoTable zsConnStr, zsDriverQuery, tableName

    ' 4. Open Table for Viewing (Optional)
    OpenTableForViewing tableName

    ' Show Message after Loading Data Successfully
    MsgBox "Data Loaded Successfully!"
    
End Sub

Sub ImportDataFromAPIIntoTable(zsConnStr As String, zsDriverQuery As String, tableName As String)
    Dim dscn As New ADODB.Connection
    dscn.Open zsConnStr

    Dim rs As Object
    Set rs = New ADODB.Recordset
    
    ''ZappySys Driver Query Goes here
    rs.Open zsDriverQuery, dscn

    Dim strQuery As String
    strQuery = ""
    ' Check if the recordset is not empty
    If Not rs.EOF Then
        ' Get the field names
        Dim fieldNames As String
        fieldNames = ""

        For i = 1 To rs.Fields.Count
            fieldNames = fieldNames & rs.Fields(i - 1).Name
            If i < rs.Fields.Count Then
                fieldNames = fieldNames & ","
            End If
        Next i

        ' Generate the INSERT script
        Dim insertScript As String
        ' Iterate through the recordset to get the values
        Do Until rs.EOF
            ' Generate Insert script
            insertScript = "INSERT INTO " & tableName & " (" & fieldNames & ") VALUES"
            insertScript = insertScript & vbCrLf & "("
            For i = 1 To rs.Fields.Count
                ' Assuming all fields are text, you might need to handle different data types appropriately
                
                If IsNull(rs.Fields(i - 1).Value) Then
                    insertScript = insertScript & "''"
                Else
                    insertScript = insertScript & "'" & EscapeSingleQuote(rs.Fields(i - 1).Value) & "'"
                End If
                
                
                If i < rs.Fields.Count Then
                    insertScript = insertScript & ","
                End If
            Next i
            insertScript = insertScript & ")"
            
            'Insert data
            CurrentProject.Connection.Execute insertScript
            
            rs.MoveNext
        Loop
    End If
    
    ' Close the recordset and connection
    rs.Close
    dscn.Close
    Set rs = Nothing
    Set conn = Nothing
    
End Sub

Sub OpenTableForViewing(tableName As String)
    If Not IsTableOpen(tableName) Then
        DoCmd.OpenTable tableName
    End If
End Sub

Public Function IsTableOpen(strName As String) As Boolean
     IsTableOpen = SysCmd(acSysCmdGetObjectState, acTable, strName)
End Function

Sub CloseTableIfOpen(tableName As String)
    If IsTableOpen(tableName) Then
        DoCmd.SelectObject acTable, tableName
        DoCmd.RunCommand acCmdSaveRecord
        DoCmd.Close
    End If
End Sub


Sub TruncateTable(tableName As String)
    Dim strSql As String
    strSql = "DELETE FROM " & tableName & ";"
    CurrentProject.Connection.Execute strSql
End Sub

Public Function EscapeSingleQuote(strData As String) As String
     EscapeSingleQuote = Replace(strData, "'", "''")
End Function

The post How to Export REST API to MS Access using VBA Command Button appeared first on ZappySys Blog.

Read WordPress data using SSIS REST API Call

ZappySys — Sat, 11 May 2019 06:22:31 +0000

Introduction

In this post you will learn how to Read WordPress data using SSIS REST API Call (Drag and drop approach without any coding). We will use SSIS JSON/ REST API Source to extract data from WordPress API. In this blog we will see how to get all WordPress Posts, Pages and Categories using JSON Source and load it into the SQL Server.

Now let’s look at step by step approach to call WordPress REST API.

Prerequisite

First, you will need to have SSIS installed
Secondly, make sure to have SSDT
Thirdly, You have obtained WordPress account credential with read and write permission.
Finally, do not forget to install ZappySys SSIS PowerPack

What is WordPress

WordPress is a free and open-source content management system based on PHP & MySQL. Features include a plugin architecture and a template system. It is most associated with blogging but supports other types of web content including more traditional mailing lists and forums, media galleries, and online stores.

Read data from WordPress using SSIS JSON Source

Let’s start with an example. We use SSIS JSON Source Task to make call to WordPress API, we will load WordPress Pages data to SQL Server.

Get all Posts, Pages and Categories using WordPress API

First of All, Drag and drop Data Flow Task from SSIS Toolbox and double click it to edit.
Furthermore, Drag and Drop JSON Source(REST API and File) File Task from the SSIS Toolbox.
Drag and Drop JSON Source Component
Double click on that Component to Edit the Configurations. Select File path or web URL from the Access Mode drop-down.
Enter Web URL like this to Get all Pages. Please refer to this link of WordPress API for more information.
```
https://{{your-wordpress-domain}}/wp-json/wp/v2/pages?page=1&per_page=100
```
To Get all Posts
```
https://{{your-wordpress-domain}}/wp-json/wp/v2/posts?page=1&per_page=100
```
To Get all Categories
```
https://{{your-wordpress-domain}}/wp-json/wp/v2/categories?page=1&per_page=100
```
Here, your-wordpress-domain is your WordPress site domain name (here we are using our zappysys.com wordpress site).

* page is the index of the first item returned in the page of results.
* per_page the maximum number of items that can be returned per page. Each API endpoint may have a different limit for the number of items returned, and these limits may change without notice. (For more See this WordPress API Documentation for Pagination)

Set URL in JSON Source
Check Use Credentials Option and select a new ZS-HTTP Connection from the drop-down.
Configure new HTTP Connection for WordPress as below.
Basically, you need to enter 3 pieces on the General tab (i.e. WordPress Site URL, UserName and Password)

WordPress Connection: HTTP Connection Manager
Likewise, we are going to set Pagination related configurations for WordPress API request. For example, if you want to read 100 records in each response and keep doing it until last page found then set Page=1, Per_page=100 and Increment by 1.
JSON Source – WordPress request Pagination Configurations Settings
Select the desire Filter and click on Preview button to see the response data.
JSON Source: Preview WordPress Data
Finally, click OK to save JSON Source settings.
That’s it we are ready to load WordPress data to SQL Server.

Load WordPress data into SQL Server

Step 1: Add Upsert Destination to Data Flow

Drag and drop the Upsert Destination component from the SSIS Toolbox.
Connect your source component (e.g., JSON / REST / Other Source) to the Upsert Destination.

SSIS - Data Flow - Drang and Drop Upsert Destination Component

Step 2: Configure Target Connection

Double-click the Upsert Destination component to open the configuration window.
Under Connection, select an existing target connection or click NEW to create a new connection.
- Example: SQL Server, or PostgreSQL, or Amazon Redshift.

Step 3: Select or Create Target Table

In the Target Table dropdown, select the table where you want to load data.
Optionally, click NEW to create a new table based on the source columns.

Configure SSIS Upsert Destination Connection - Loading data (REST / SOAP / JSON / XML /CSV) into SQL Server or other target using SSIS

Step 4: Map Columns

Go to the Mappings tab.
Click Auto Map to map source columns to target columns by name.
Ensure you check the Primary key column(s) that will determine whether a record is inserted or updated.
You can manually adjust the mappings if necessary.

SSIS Upsert Destination - Columns Mappings

Step 5: Save Settings

Click OK to save the Upsert Destination configuration.

Step 6: Optional: Add Logging or Analysis

You may add extra destination components to log the number of inserted vs. updated records for monitoring or auditing purposes.

Step 7: Execute the Package

Run your SSIS package and verify that the data is correctly inserted and updated in the target table.

SSIS Upsert Destination Execution

Conclusion

In this post you have seen how easy it is to Read WordPress data using SSIS REST API Call in few clicks. We used JSON Source Component to call WordPress REST API and load data into SQL server. You can download SSIS PowerPack here to try many other scenarios not discussed in this blog along with 70+ other components.

References

Finally, you can use the following links for more information about the use of WordPress REST API with our tools:

JSON Source, you can also find Tutorial Video here.
Help File: Documentation of SSIS Json Source
WordPress API
WP API Authentication
WP API Pagination

The post Read WordPress data using SSIS REST API Call appeared first on ZappySys Blog.

Read data from QuickBooks Online into SQL Server via ODBC Driver

ZappySys — Wed, 23 Jan 2019 12:12:20 +0000

Introduction

QuickBooks Online is a well-known Cloud-based Accounting Software. In this post, you will learn how to implement QuickBooks Online API Integration with SQL Server or any other RDBMS (e.g. Oracle, MySQL, Postgresql) using ODBC in few clicks. We will use ODBC JSON / REST API Driver to read data from QuickBooks Online and Load into SQL Server / other targets (Using OAuth Connection). We will discuss on How to Create an Intuit Developer Account, How to Create QuickBooks Online App for OAuth.

In nutshell, this post will focus on how to call QuickBooks Online API using ODBC.
So let’s get started.

Prerequisites

Before we look into Step-By-Step section to extract and read data from QuickBooks Online to SQL Server let’s make sure you met the following requirements.

A first requirement will be to SQL Server Database Engine Installed
The second requirement will be SSMS installed
Finally, make sure to have ZappySys ODBC PowerPack installed.

What is QuickBooks Online

QuickBooks is an accounting software package developed and marketed by Intuit. QuickBooks products are geared mainly toward small and medium-sized businesses and offer on-premises accounting applications as well as cloud-based versions that accept business payments, manage and pay bills, and payroll functions.

Getting Started

In order to start, we will show several examples. ZappySys includes an ODBC JSON / REST API Driver that will help you to call QuickBooks Online API, read various data from QuickBooks Online with ODBC. To learn more about QuickBooks Online API check this help file. To access QuickBooks Online data using REST API call, you need to create an Intuit Developer Account and then create QuickBooks Online App.

Create an Intuit Developer Account

Follow the mentioned steps below to create an Intuit developer account:

you can visit this site developer.intuit.com, and click on Sign up from the menu bar.
A registration form will be opened in a Popup. you can fill up and then click on Create Account.

Signup Form: Intuit Developer Account
Complete the validation check and click Continue.
On the confirmation dialog, provide a few details to fill out your profile and click All set.

Your account is created! You'll automatically be redirected to the app creation page to get coding on your app.

Note: Choose the user ID of your account carefully. Once an app is created in a given account it cannot be moved to another account or deleted. If you are building apps for a client, we recommend you create a dedicated account for that client that stays with them, leaving them full access.

Create a QuickBooks Online App

Follow the steps below to start creating your QuickBooks Online app.

From the developer portal, click on My Apps.
after that, Click Create a new app.

Create a new App: Select APIS
Click the Select APIs button under Just start coding.
Select the APIs you wish to use. This selection can always be changed later via your app's settings.
Your new app opens to its Dashboard tab.
Click the Keys tab. This is where you can find all keys related to your app.

Intuit App: Client Id, Secret Keys for OAuth Connection
To copy a key or token, click its Copy button.

Finally, we are ready with an App. Let´s start with an example. In this example, we will show how to retrieve all Invoices data from QuickBooks Online with ODBC.

Create ODBC – Native Zappysys JSON Driver Data Source

To do this, first of all, we will open the ZappySys Data Gateway Configuration:
Open ZappySys Data Gateway
Add the Native – ZappySys JSON Driver Data source.
Add Gateway Data Source (Native JSON Driver)
Now it’s time to connect with QuickBooks. Let’s use JSON Driver Data source with the following URL:
```
https://{RequestURL}/v3/company/{realmID}/query?query={selectStatement}
```
here, We have used 3 placeholders.
* {RequestURL}is either a SandBox base URL or Production base URL.
```
Sandbox Base URL: https://sandbox-quickbooks.api.intuit.com
Production Base URL: https://quickbooks.api.intuit.com
```
* {realmID} is your QuickBooks Online sandbox/production company ID.
* {selectStatement} can be any query something like Select * From Invoice (*Note: select statement must be URL encoded first)
For more information on Query, an Invoice Request API see this
I am using my sandbox URL like this:
```
https://sandbox-quickbooks.api.intuit.com/v3/company/193514799372394/query?query=SELECT * FROM Invoice STARTPOSITION <%startposition%> MAXRESULTS 1000
```
Setup QuickBooks ODBC-based data source configuration
Configure the new OAuth Connection for QuickBooks Online as below.
Basically, you need to configure the configurations of App on the General tab (i.e. OAuth Provider, Client ID, Client Secret, Scopes, etc.)

OAuth Connection Manager: General Tab Configurations
Most importantly, you also need to Enter your Callback URL in Advanced Tab.
OAuth Connection Manager: Advanced Tab Configurations
Similarly, you need to check “Do not include credentials in header”
OAuth Connection Manager: OAuth2 Grant Options Tab Configurations
Click on Generate Token button to Generate token and then click on Test Connection button and click on OK to save the connection manager configurations settings.
Generate Token and Test Connection
Let’s continue on, and enable pagination by configuring it like in the image below in the Pagination tab. In the Page Num Indicator field input this value: <%startposition%> Then set Increment By value to a maximum number of results possible: 1000

Configuring pagination to get QuickBooks all rows in ODBC JSON-based driver data source
Finally, now using Code Generator we will generate the query.
Generate Query

Load QuickBooks Invoices data in MS SQL Server

Once you configured the data source in Gateway, we can now setup Linked Server in SQL Server to query API data.

Assuming you have installed SQL Server and SSMS. If not then get both for FREE from here: Get SQL Server Express and Get SSMS
Open SSMS and connect to SQL Server.
Go to Root > Server Objects > Linked Servers node. Right click and click New Linked Server...

Add Linked Server in SQL Server
Now enter the linked server name, select Provider as SQL Native Client
Enter data source as GatewayServerName, PORT_NUMBER where server name is where ZappySys Gateway is running (Can be same as SQL Server machine or remote machine). Default PORT_NUMBER is 5000 but confirm on Data gateway > General tab in case its different.
Enter Catalog Name. This must match name from Data gateway Data sources grid > Name column

Configure Linked Server Provider, Catalog, Server, Port for ZappySys Data Gateway Connection
INFO:
- For SQL Server 2012, 2014, 2016, 2017, and 2019, use the SQL Server Native Client 11.0 as the Provider.
- For SQL Server 2022 or higher, use the Microsoft OLE DB Driver for SQL Server as the Provider.
Click on Security Tab and select last option "Be made using this security context". Enter your gateway user account here.
Optional: Under the Server Options Tab, Enable RPC and RPC Out and Disable Promotion of Distributed Transactions(MSDTC).

RPC and MSDTC Settings

You need to enable RPC Out if you plan to use EXEC(...) AT [MY_LINKED_SERVER_NAME] rather than OPENQUERY.
If don't enabled it, you will encounter the 'Server "MY_LINKED_SERVER_NAME" is not configured for RPC' error.

Query Example: EXEC('Select * from Products') AT [MY_LINKED_SERVER_NAME]

If you plan to use 'INSERT INTO...EXEC(....) AT [MY_LINKED_SERVER_NAME]' in that case you need to Disable Promotion of Distributed Transactions(MSDTC).
If don't disabled it, you will encounter the 'The operation could not be performed because OLE DB provider "SQLNCLI11/MSOLEDBSQL" for linked server "MY_LINKED_SERVER_NAME" was unable to begin a distributed transaction.' error.

Query Example:
```
Insert Into dbo.Products 
EXEC('Select * from Products') AT [MY_LINKED_SERVER_NAME]
```
Click OK to save Linked Server

In SSMS execute below SQL query to test your connectivity.

SELECT * FROM OPENQUERY( MY_LINKED_SERVER_NAME, 'SELECT * FROM $')

Here is the preview after you run some REST API query in SQL Server. Notice that you can override default configuration by supplying many parameters in WITH clause (second query example in the screenshot).

SSMS Output - Query REST API via Linked Server OPENQUERY statement (Connect to ZappySys Data Gateway)
You can wrap your queries inside View or wrap inside Stored procedure to parameterize. Here is an example of creating the view which calls REST API queries.
```
CREATE VIEW dbo.vw_MyAPICall_View 
AS 
/*Call REST API inside SQL Server View*/
SELECT * FROM OPENQUERY( MY_LINKED_SERVER_NAME , 'SELECT * FROM $');

GO
```
Notice in above approach if you parameterize Stored Procedure then check this article to understand Dynamic Metadata.
Now let's insert API data into the new data table "tblMyAPiData" in the SQL server database. For that, we need to execute below SQL query.
```
Select * into tblMyAPiData FROM OPENQUERY( MY_LINKED_SERVER_NAME , 'SELECT * FROM $')
```
Insert data into the new table
Let's insert and update records into the already created table "tblMyAPiData"
- To do that first we need to insert the new API data into the "#temp_tblMyAPiData" temporary database table.
- Now let's delete the old records from the database table which are updated.
- At the last insert all new API data into the database table.
- To do that, we need to query like below SQL queries.
```
SELECT * into #temp_tblMyAPiData FROM OPENQUERY(MY_LINKED_SERVER_NAME, 'SELECT * FROM $')

DELETE FROM [dbo].[tblMyAPiData] WHERE id in (SELECT id FROM #temp_tblMyAPiData)

INSERT INTO tblMyAPiData
SELECT * FROM #temp_tblMyAPiData
```

In the upper step, we see how to insert and update new records. Now if you want to update particular fields records only then you need to query like this.

Update dbtbl_1
set dbtbl_1.field1 = dbtbl_2.field1,
    dbtbl_1.field2 = dbtbl_2.field2
FROM tblMyAPiData dbtbl_1
JOIN (SELECT * FROM OPENQUERY(MY_LINKED_SERVER_NAME, 'SELECT * FROM $')) dbtbl_2 on dbtbl_1.id=dbtbl_2.id

*NOTE: If you are getting error like : "Cannot resolve the collation conflict between “Latin1_General_CI_AI” and “SQL_Latin1_General_CP1_CI_AS” in the equal to operation" then you need to query like this :
Update dbtbl_1
set dbtbl_1.field1 = dbtbl_2.field1,
    dbtbl_1.field2 = dbtbl_2.field2
FROM tblMyAPiData dbtbl_1
JOIN (SELECT * FROM OPENQUERY(MY_LINKED_SERVER_NAME, 'SELECT * FROM $')) dbtbl_2 
on dbtbl_1.id=dbtbl_2.id 
COLLATE SQL_Latin1_General_CP1_CI_AS

Conclusion

So in this blog, we learned how to generate a QuickBooks API Token, Load QuickBooks Invoices data in MS SQL Server table using ODBC JSON / REST API Driver in a very simple way. You can achieve many more functionalities with this tool. Check our blogs/articles on JSON / REST API Driver https://zappysys.com/blog/category/odbc-powerpack/odbc-drivers/json-rest-api-driver/ to find out what this tool is capable of more.

References

Finally, you can use the following links for more information about the use of QuickBooks API with our tools:

QuickBooks Documentation for API
Landing Page for ODBC JSON / REST API Driver, you can also find Tutorial Video here.
Help File: Documentation of JSON Driver.
Blog/articles link: https://zappysys.com/blog/category/odbc-powerpack/odbc-drivers/json-rest-api-driver/

The post Read data from QuickBooks Online into SQL Server via ODBC Driver appeared first on ZappySys Blog.