In this article, you will learn how to register Facebook OAuth App (Graph API) for data access using SSIS PowerPack REST API Connectors. Using SSIS PowerPack you can consume/manage Facebook data by calling Graph API. These connectors have drag and drop UI so you can do data integration without any coding (e.g. C#, Java, Python, Ruby).

JSON /REST Source Connector and REST API Task they both support a wide range of options for any type of REST API integration scenarios including Facebook REST API integration into your ETL Workflow. It also supports the use of OAuth 1.0 and 2.0 Protocols used by Twitter, Facebook, Google, LinkedIn, and many other popular Apis.

Facebook Graph API can be used to read or manage Facebook data via REST API Calls. To access Graph API you will have to create OAuth App inside Facebook Developer Portal. Let’s take a look step by step.

Step-By-Step: Create Facebook OAuth App (i.e Register OAuth App)

1. Go to www.facebook.com and log in with an account which you want to use to access Facebook data. You can access your own data using API without issue but if you have to access someone else data via App then it will require additional steps listed in this article in “Create Public Facebook OAuth App” section
2. Once you login to Facebook type https://developers.facebook.com/apps in the Address bar
3. Click on Create New App. If you never access developer portal then you may be prompted to Register as a developer.
   

   Create Facebook OAuth App for Graph API access (For SSIS PowerPack REST Connectors)

4. It creates the app by given name and asked you to choose some options like ads and FB login. Click on skip to skip that step.
5. Now go to basic settings and there you can change app name, contact email and select category (e.g. Business). There you can also found OAuth App ID and App Secret store it somewhere for the next phase.
   

   Register Facebook OAuth App for Custom Desktop Application (Basic Setup)

6. No Click on Add Products and add Facebook Login. Because our app is used for SSIS PowerPack which has custom login flow (using Embedded Browser). We have to Add Facebook Login support and check Embedded browser option (see below).
   

   Adding Embedded browser support for Facebook OAuth Application

7. Now you ready to use your App to use OAuth App ID and App Secret.

Test Facebook OAuth App (Consume graph api in SSIS)

If you using SSIS PowerPack to manage your Facebook data using Graph API then perform the following steps to test your connectivity.

1. In the SSIS Designer in connection manager page .. right click and add ZS-OAUTH
2. Select Facebook provider, Configure App ID and OAuth App Secret
3. Select Permission (i.e. Scope) or type by hand (1 per each line)
4. Click generate Token. You will be redirected to login page and then it will show Authorize App confirmation. Click Accept.
5. Test Connection (If things go well it will show green success)
   

   Testing Facebook OAuth Connectivity in SSIS (Use Graph API)

Fetch from Facebook Graph API (Load data into SQL Server)

Below is sample screenshot how you can use JSON Source to pull data from Facebook REST API and load into SQL Server. Refer this article for step-by-step information.

Extract data from Facebook using Graph API (SSIS JSON/REST API Connector) – Load into SQL Server Table

The post How to register Facebook OAuth App for Graph API Access appeared first on ZappySys Blog.

In this article you will learn how to get data from Facebook using Graph API (OAuth 2.0) using SSIS PowerPack REST api Connectors. Facebook provides rich set of REST API to access data. Their REST API is also known as Facebook Graph API and it uses OAuth 2.0 Authorization. Traditionally any REST API Integration scenarios in SSIS requires you to use some sort of SDKs using popular programming languages (e.g. C#, Java, Ruby, Python). If you are DBA or SSIS Developer and you prefer to use clean drag and drop approach rather complex programming then this article will show you how to achieve it.

SSIS PowerPack REST API Connectors can be used to consume/manage Facebook data using REST API. Following connectors will be used in this article.

	REST API Task
	OAuth Connection Manager
	JSON Source (File, REST, OData)

Register Facebook OAuth App for Graph API access

Very first step to access Facebook API is register your custom OAuth App under Facebook developer portal. Check this article for more information on this topic.

Consume data from Facebook using REST API in SSIS

In this section we will guide you how to create OAuth connection and consume data from Facebook in few clicks using JSON Source (File, REST, OData) . We will load Facebook data into SQL Server.

Find Facebook PageID from its Name

In our case for example we want to Extract Page Insights for some page (e.g. facebook.com/MyPage ). To findout pageid perform following steps

1. Navigate to https://developers.facebook.com/tools/explorer
2. Click Get Token button, select permission you really care (To get PageID you don’t need to check anything).
3. Type /YourPageName in the API Url bar
4. Now click Submit. You will see response json which will have pagename and pageID
   

   Using Facebook Graph API Explorer, Test API, Find Object ID / PageID from Name

Create Facebook OAuth Connection

You can create SSIS OAuth connection manager two ways. 1) From Add Connection manager option from designer or Click Add ZS-OAuth from Component UI. Lets use first method.

1. In the SSIS Designer in connection manager pane .. right click and new connection … select ZS-OAUTH Connection from list
2. Select Facebook provider from dropdown
3. Select Custom OAuth App option
4. Enter Facebook OAuth App ID and OAuth App Secret
5. Select Permission (i.e. Scope) or type by hand (1 per each line)
6. Click generate Token. You will be redirected to login page and then it will show Authorize App confirmation. Click Accept.
7. Test Connection (If things go well it will show green success)
   

   Testing Facebook OAuth Connectivity in SSIS (Use Graph API)

Get Page Access Token (optional)

Accessing data of your Facebook page requires to generate a Page Access Token, follow the steps below to get it. If you are using non-page API methods, then you can freely skip this step. In SSIS Designer drag and drop REST API Task.

1. Then use the same OAuth connection we created in the previous step.
2. Proceed with setting the URL using this format:
   https://graph.facebook.com/v2.5/REPLACE_WITH_PAGE_ID?fields=access_token
3. Click Test Request/Response button and then copy the Page Access Token to a Notepad.

Getting Facebook Page Access Token using Facebook Graph API and SSIS

Get Long-Lived Access Token

Most likely, once finished, you will deploy the SSIS package to your SQL Server and then set a schedule to run it daily or hourly. With ordinary Access Tokens you will run into a problem after 30 or 60 days because these tokens will expire after a similar time and your SQL Job will fail. To avoid that, we can generate a Long-Lived Access Token which will live for 60 days, as long as you use that token (and running the package is using it). Perform these steps to generate a Long-Lived Access Token:

1. Firstly, you will need to find out your Facebook User ID. To do that, call this URL in Facebook Graph Explorer or using REST API Task with configured OAuth Connection Manager:
   https://graph.facebook.com/v2.5/me
2. Copy the ID from the response.
3. Then drag and drop another REST API Task and configure it like this, if you want to generate a Long-Lived Page Access Token:
   

   Getting Facebook Long-Lived Page Access Token using Facebook Graph API and SSIS

   Otherwise, if you want to generate a non-page Long-Lived Access Token, use this configuration:

   

   Getting Facebook Long-Lived Access Token using Facebook Graph API and SSIS

Use JSON/REST API Source to read from Graph API

Once you have OAuth connection manager. You can perform following steps to Extract data from Graph API Url. Facebook Graph API uses ObjectID in the URL so make sure you have that handy for whatever resource you want to access.

Configure JSON/REST API Source

Once you know pageid we can build our API URL. Lets assume your pageid is 12345678 and you want to extract page insight data via API call. In that case you may build your URL following way. You can change v2.5 to something else depending on API version you wish to use. If you omit version number from URL then default version will be used by Facebook API (Default API version can be found on Dashboard of your OAuth App).

https://graph.facebook.com/v2.5/YOUR_PAGE_ID/insights/page_impressions_organic_unique

Now perform the following steps to configure JSON Source to extract data from Facebook API.

NOTE: Below steps assume that you already Downloaded and Installed SSIS PowerPack

1. Drag Data Flow Task from SSIS Toolbox and double click to view Dataflow designer
2. Drag ZS JSON Source from SSIS Toolbox. Double click to configure.
3. In the AccessMode select “File Path or Web URL”
4. Enter URL:
   https://graph.facebook.com/v2.5/YOUR_PAGE_ID/insights/page_impressions_organic_unique?access_token=REPLACE_WITH_LONG_LIVED_ACCESS_TOKEN
   NOTE: You may use variables and parameters in the URL e.g. http://mydomain/{{User::MyPath}}:
   

   Getting Facebook Page data using Facebook Graph API and SSIS

5. Click on Select Filter and select values node and click OK. It may produce filter expression like below.
6. You can set Max Rows option to desired value if you don’t want to extract all rows (0=Unlimited)
7. Goto Paging Tab and enter $.paging.next in the “Next Cursor” field as below
   

   Getting page data from Facebook and paginating through the results using SSIS

8. Click on Columns tab if you wish to see/change metadata (You can change size / datatype there and Lock metadata to prevent auto refresh)
9. Now click Preview to see sample data and then exit preview and click OK to save UI changes

Load Facebook data into SQL Server

If you wish to save Facebook data into SQL Server or any other target like Oracle, MySQL, FlatFile, Excel, etc., then you can use some native SSIS Connectors (e.g. OLEDB Destination, ADO.net Destination). Connect JSON Source to Destination and map source columns to target.

Facebook API Paging through dataset (i.e. Loop, Cursor)

In the previous section, you saw how to adjust few attributes so JSON Source can paginate through Facebook API response. To learn more about REST API Paging Methods – Click this link

Here is another link from Facebook Documentation for Paging

Manage/Write/Update Facebook data using REST API

If you wish to create new POST  or manage data using REST API then you most likely need to use REST API Task rather than JSON Source. REST API Task also supports uploading media files.

Deployment to Production

You may also check the article on how to make URL dynamic/parametric, so that you can pass Long-Lived Access Token as an argument in a SQL Job.

Conclusion

Facebook data integration can be quite challenging without right set of tools. SSIS PowerPack provides complete toolset for any REST API integration related scenarios. Try it yourself and find out all hidden features not discussed in this article.

References

Facebook Graph REST API reference link

https://developers.facebook.com/tools/explorer

https://developers.facebook.com/docs/facebook-login/access-tokens/refreshing/

Similar articles

Read Twitter data in SSIS using REST API Task and JSON Source – OAuth2 Protocol

How to get data from Google AdWords using SSIS

The post How to get data from Facebook in SSIS using REST API appeared first on ZappySys Blog.