Gmail Connector for Alteryx : Make generic REST API request (bulk write) via SQL
Learn how to make generic REST API request (bulk write) using the Gmail Connector for Alteryx. This connector enables you to read and write Gmail data effortlessly. Send, manage, and sync messages, attachments, labels, and threads — almost no coding required. We'll walk you through the exact setup.
Let's dive in!
Create data source using Gmail ODBC Driver
-
Download and install ODBC PowerPack (if you haven't already).
-
Search for
odbcand open the ODBC Data Sources (64-bit):
-
Create a User data source (User DSN) based on the ZappySys API Driver driver:
ZappySys API Driver
- Create and use a User DSN if the client application runs under a User Account. This is the ideal option at design time (e.g., when developing in Visual Studio). Use it for both types of applications (64-bit and 32-bit).
- Create and use a System DSN if the client application runs under a System Account (e.g., as a Windows Service). This is usually the required option in a production environment. If your Windows Service is a 32-bit application, you must use the 32-bit ODBC Data Source Administrator to configure this
-
When the Configuration window appears give your data source a name if you haven't done that already, then select "Gmail" from the list of Popular Connectors. If "Gmail" is not present in the list, then click "Search Online" and download it. Then set the path to the location where you downloaded it. Finally, click Continue >> to proceed with configuring the DSN:
GmailDSNGmail
-
Now it's time to configure the Connection Manager. Select Authentication Type, e.g. Token Authentication. Then select API Base URL (in most cases, the default one is the right one). More info is available in the Authentication section.
Gmail authentication
To make this work you will have to create a Google Cloud project. This project forms the basis for creating, enabling, and using all Google Cloud services, including managing APIs, enabling billing, adding and removing collaborators, and managing permissions.
- Go to the Google Cloud Console
- In the Google Cloud console, go to menu IAM & Admin, and then Create a Project.
- Enter the name of the new project into the Project Name field and select the appropriate organization, then click Create.
- The console navigates to the Dashboard page and your project is created within a few minutes.
- In the Google Cloud console, go to menu More products, Google Workspace, and then Product Library.
- Now we need to enable the Gmail API.
- Search for Gmail API. Select it and then click ENABLE.
- Select the Credentials tab on the left side of the screen.
- Select the + CREATE CREDENTIALS link to reveal a drop down menu.
- In the dropdown menu, select OAuth client ID.
- If presented, click the CONFIGURE CONSENT SCREEN button and then elect the appropriate User Type based on your business needs. Otherwise, continue to step 16.
- In the OAuth consent screen tab fill in your app's website and domain information, and then click SAVE AND CONTINUE.
- In the Scopes section of the app registration, click ADD OR REMOVE SCOPES and add the following scopes:
- openid
- https://mail.google.com/
- https://www.googleapis.com/auth/userinfo.email
- https://www.googleapis.com/auth/userinfo.profile
- https://www.googleapis.com/auth/gmail.labels
- https://www.googleapis.com/auth/gmail.send
- https://www.googleapis.com/auth/gmail.modify
- https://www.googleapis.com/auth/gmail.compose
- https://www.googleapis.com/auth/gmail.readonly
- After the scopes have been added, click SAVE AND CONTINUE.
- Complete the wizard setting up scopes.
- Select the Credentials tab on the left side of the screen.
- Select the + CREATE CREDENTIALS link to reveal a drop down menu.
- In the dropdown menu, select OAuth client ID.
- In the Application type drop down, select Desktop application and then give your app client a name.
- Select the CREATE button.
- A popup window will appear that provides important information you should record for your records:
- Client ID
- Client secret
- Go to OAuth Consent Screen tab. Under Publishing Status click PUBLISH APP to ensure your refresh token doesnt expire often. If you planning to use App for Private use then do not have to worry about Verification Status after Publish.
- Back to Connection UI, Enter the client ID and client secret into the required parameters.
API Connection Manager configuration
Just perform these simple steps to finish authentication configuration:
-
Set Authentication Type to
User Account [OAuth] - Optional step. Modify API Base URL if needed (in most cases default will work).
- Fill in all the required parameters and set optional parameters if needed.
- Press Generate Token button to generate the tokens.
- Finally, hit OK button:
GmailDSNGmailUser Account [OAuth]https://gmail.googleapis.com/Required Parameters UseCustomApp Fill-in the parameter... Authorization URL Fill-in the parameter... Token URL Fill-in the parameter... Default API Version Fill-in the parameter... Default User Id Fill-in the parameter... Scope Fill-in the parameter... Optional Parameters Client Id Client Secret RetryMode RetryWhenStatusCodeMatch RetryStatusCodeList 429 RetryCountMax 5 RetryMultiplyWaitTime True Redirect URL (Only for Web App)
-
Then go to Preview tab to start building a SQL query.
-
Once you do that, proceed by opening Query Builder:
ZappySys API Driver - GmailRead and write Gmail data effortlessly. Send, manage, and sync messages, attachments, labels, and threads — almost no coding required.GmailDSN
-
Then simply select the Make Generic REST API Request (Bulk Write) endpoint (action).
-
Continue by configuring the Required parameters. You can also set optional parameters too.
-
Move on by hitting Preview Data button to preview the results.
-
If you see the results you need, simply copy the generated query:
-
Click OK to use built SQL query and close the Query Builder.
-
Now hit Preview Data button to preview the data using the generated SQL query. If you are satisfied with the result, use this query in Alteryx:
ZappySys API Driver - GmailRead and write Gmail data effortlessly. Send, manage, and sync messages, attachments, labels, and threads — almost no coding required.GmailDSNSELECT * FROM __DynamicRequest__ WITH ( "Url" = '/something/123', "RequestMethod" = 'POST' )
You can also access data quickly from the tables dropdown by selecting <Select table>.AWHEREclause,LIMITkeyword will be performed on the client side, meaning that thewhole result set will be retrieved from the Gmail API first, and only then the filtering will be applied to the data. If possible, it is recommended to use parameters in Query Builder to filter the data on the server side (in Gmail servers).
Let's not stop here and explore SQL query examples, including how to use them in Stored Procedures and Views (virtual tables) in the next steps.
Gmail SQL query examples
Use these SQL queries in your Alteryx data source:
Make generic rest api request
SELECT * FROM __DynamicRequest__
WITH
(
"Url" = '/something/123',
"RequestMethod" = 'POST'
)
generic_request_bulk_write endpoint belongs to
__DynamicRequest__
table(s), and can therefore be used via those table(s).
Create SQL view in ODBC data source
ZappySys API Drivers support flexible Query language so you can override Default Properties you configured on Data Source such as URL, Body. This way you don't have to create multiple Data Sources if you like to read data from multiple EndPoints. However not every application support supplying custom SQL to driver so you can only select Table from list returned from driver.
If you're dealing with Microsoft Access and need to import data from an SQL query, it's important to note that Access doesn't allow direct import of SQL queries. Instead, you can create custom objects (Virtual Tables) to handle the import process.
Many applications like MS Access, Informatica Designer wont give you option to specify custom SQL when you import Objects. In such case Virtual Table is very useful. You can create many Virtual Tables on the same Data Source (e.g. If you have 50 URLs with slight variations you can create virtual tables with just URL as Parameter setting.
-
Go to Custom Objects Tab and Click on Add button and Select Add Table:
-
Enter the desired Table name and click on OK:
-
And it will open the New Query Window Click on Cancel to close that window and go to Custom Objects Tab.
-
Select the created table, Select Text Type AS SQL and write the your desired SQL Query and Save it and it will create the custom table in the ZappySys Driver:
Here is an example SQL query for ZappySys Driver. You can insert Placeholders also. Read more about placeholders here
SELECT "ShipCountry", "OrderID", "CustomerID", "EmployeeID", "OrderDate", "RequiredDate", "ShippedDate", "ShipVia", "Freight", "ShipName", "ShipAddress", "ShipCity", "ShipRegion", "ShipPostalCode" FROM "Orders" Where "ShipCountry"='USA'
-
That's it now go to Preview Tab and Execute your custom virtual table query. In this example it will extract the orders for the USA Shipping Country only:
SELECT * FROM "vt__usa_orders_only"
Make generic REST API request in Alteryx via SQL view
-
Open Alteryx Designer.
-
First, verify your DCM Settings to ensure you can access ODBC drivers. Go to Options > User Settings > Edit User Settings.
If DCM Mode is set to DCM Only, change it to DCM Optional if you would like to access the legacy Generic ODBC Connection.
After changing this setting, you may need to click Save and restart the connection window for the "Generic ODBC" icon to appear. -
Drag an Input Data tool onto your Alteryx canvas.
-
In the Configuration pane, click Set Up a Connection.
-
Note for DCM Users: If your environment has DCM (Data Connection Manager) enabled, the classic "Generic ODBC" icon may be hidden. To find it, select Data sources on the left and type "ODBC" in the search bar.
-
Once the ODBC window opens, click Connect Asset and select your GmailDSN DSN from the list.
Ensure you have configured a 64-bit System DSN in the Windows ODBC Data Source Administrator before this step. -
After selecting your DSN, configure your SQL Query in the Input Data tool configuration:
-
To save your data, drag an Output Data tool and connect it to the Input Data tool.
-
Configure the Output Data tool to write to a CSV file:
-
Press Run (Ctrl+R) to execute the workflow. Verify the results in the Results Window at the bottom.
Advanced topics
Creating SQL stored procedures
You can create procedures to encapsulate custom logic and then only pass handful parameters rather than long SQL to execute your API call.
Steps to create Custom Stored Procedure in ZappySys Driver. You can insert Placeholders anywhere inside Procedure Body. Read more about placeholders here
-
Go to Custom Objects Tab and Click on Add button and Select Add Procedure:
-
Enter the desired Procedure name and click on OK:
-
Select the created Stored Procedure and write the your desired stored procedure and Save it and it will create the custom stored procedure in the ZappySys Driver. Here is an example stored procedure for ZappySys Driver. You can insert Placeholders anywhere inside Procedure Body. Read more about placeholders here
CREATE PROCEDURE [usp_get_orders] @fromdate = '<<yyyy-MM-dd,FUN_TODAY>>' AS SELECT * FROM Orders where OrderDate >= '<@fromdate>';
-
That's it now go to Preview Tab and Execute your Stored Procedure using Exec Command. In this example it will extract the orders from the date 1996-01-01:
Exec usp_get_orders '1996-01-01';
Conclusion
And there you have it — a complete guide on how to make generic REST API request (bulk write) in Alteryx without writing complex code. All of this was powered by Gmail ODBC Driver, which handled the REST API pagination and authentication for us automatically.
Download the trial now or ping us via chat if you have any questions or are looking for a specific feature (you can also reach out to us by submitting a ticket):
More actions supported by Gmail Connector
Got another use case in mind? We've documented the exact setups for a variety of essential Gmail operations directly in Alteryx, so you can skip the trial and error. Find your next step-by-step guide below:
- Download Message Attachments (With search condition)
- Get a Specific Attachment included in a Specific Message for the Current User
- Get a Specific Message for a Specific User
- Get a Specific Message for the Current User
- Get labels
- Get List of Messages for a Specific User
- Get List of Messages for the Current User
- Get message attachment for user
- Get Message Attachments (With search condition)
- Send a New Message for the specified User
- Make Generic REST API Request