In this section, we will discuss how to register OAuth App to call Salesforce API using Client ID / Secret rather than using your User Id / Password. Once you follow these steps below to register your Salesforce App (OAuth App), at the end you will get a Client ID (sometimes referred to as App Id) and Client Secret (or App Secret). These two pieces can be used later on to call Salesforce API using OAuth. So let's get started.

Register Salesforce App (OAuth)

1. Login into your account and go to Setup as shown below (click on gear icon at the top right corner):
2. Then in the search bar input "app" and open App Manager:
3. Then click New Connected App to create a new OAuth App: NOTE: In some version, it may say New External Client App

   Look for one of the following buttons:

   • New Connected App (Classic name)

   • New External Client App (Lightning name)

   
4. Give your App a name and: - Enable OAuth Settings - Set callback URL to following two URLs (one in each line) https://login.salesforce.com/services/oauth2/success https://zappysys.com/oauth - Add an OAuth scope you want or simply add "Full access". - Add "Perform requests on your behalf at any time (offline_token)" scope to get a refresh token so that you don't have to re-authenticate each time requesting an access token: IMPORTANT: You can use "Access and manage your data (api)" if you do not like to grant full permission to this app but make sure you request same permission from the caller app too  (Example on ZappySys Salesforce Connection UI -> Advanced Tab -> Set scope as "api offline_access" rather than "full offline_access"
5. Click "Save".

Get Client Id and Client Secret for Salesforce Connected App

Once the App is created, we need to find out the App Id / Secret so we can use it for API calls.

1. Go to App Manager
2. Find out the recently created App and click View (click on the small arrow to the right)
3. Once App page is loaded you can Copy Consumer Key and Consumer Secret (click on reveal to see). Also copy anyone Call back URL (We will need this for OAuth Connection > Advanced Tab > Call Back URL or Redirect URL property depending on which ZappySys Product / Driver you are using)
4. That's it, you can now use these 3 pieces to ZappySys OAuth connection UI or on Salesforce Connection UI (new version with OAuth support). The above screenshot shows where to enter these 3 pieces in the New Salesforce Connection. For the OAuth Connection, the redirect URL goes to the Advanced Tab > Callback URL textbox.

Get Client Id and Secret for Salesforce External Client App

If you created a new App by clicking on the New External Client App button, then your App may not be visible in the App Manager Screen. In that case, find it below way. [caption id="attachment_11637" align="alignnone" width="1222"] Get Client Id, Client Secret - For New External Client App[/caption]

Enable Client Credentials Grant (Non-Interactive Run-As)

If you like to enable Non-Interactive mode, just like UserId / Password Authentication, but without actually passing a real UserId or Password on the Connection UI, then you can enable Client Credentials Flow as below. NOTE: Only the New version of ZappySys Salesforce Connection supports Client Credentials Grant. Version released after Nov 1, 2025 supports this grant type. [caption id="attachment_11639" align="alignnone" width="419"] Enable Salesforce Client Credentials Grant (Run As)[/caption]

(OPTIONAL) Configure Salesforce OAuth refresh token validity

By default, Salesforce Refresh Token doesn't expire once you generate. If you want to change the default behavior, follow these steps.

1. Go to "Manage Connected Apps" menu item and press on your App name:
2. Click "Edit Policies" to configure refresh token validity:
3. Set "All users may self-authorize" and "Refresh token is valid until revoked" options:
4. Click "Save".

Using Salesforce Connection with OAuth App in SSIS / ODBC

Once you have Client ID / Secret, you can use it in the Salesforce Connection in SSIS Connector / ODBC Driver for Salesforce like below (Only the new version will have OAuth option)

Troubleshooting Known Issues

Let’s look at some common issues with Salesforce Connection and how to fix them.

OAuth Error: Missing Required Code Challenge

When you click Generate Token button, you may get an error like the one below.

Salesforce OAuth Generate Token Error – Missing Required Code Challenge

Solution

Here is how to fix it.

For Salesforce Connection UI: Go to Advanced Tab => Check Enable PKCE Code Verifier option
–OR–
For OAuth Connection UI: Go to OAuth2 Grant Options Tab => Check Enable Code Verifier Option

Enable PKCE code verifier option – OAuth Connection for Salesforce.

The post How to register Salesforce App and obtain Client ID / Secret (for API Call / OAuth) appeared first on ZappySys Blog.

In this release we focused on mainly providing high quality and super fast Upsert Destination (Bulk Update, Insert and Delete / Merge) for SQL Server. We also added Salesforce BULK API support for Salesforce Destination.

Full Notes: https://zappysys.com/onlinehelp/ssis-powerpack/scr/release-notes.htm

Version 2.9.0.10210 [Feb 08, 2019]

New Features/Improvements

• NEW: Amazon S3 CSV File Source, FTP, Azure – Add UI validation for connection selection (Do not allow preview if selection is not valid)
• NEW: CSV Destination for Azure, AWS, FTP – Validate for no input columns selected
• NEW: Export CSV File Task – Change default delimiter as comma and add enable QuoteAroundValueIfNeeded option by default
• NEW: General – License Manager command line registration doesnt log errors to file (Command line is useful in ADF – SSIS IR in Azure Data Factory – License Registration in setup script)
• NEW: General – Reduce verbosity of connection not assigned validation error
• NEW: HTML Email Task – Provide an option to prevent HTML Encoding when you insert Recordset Variable (add new placeholder {{User::varRecordset,table_no_encode}} )
• NEW: HTTP Connection Manager – Add option to retain Cookies in Dynamic Token Method (e.g. SAP Odata / SOAP API use case)
• NEW: JSON, XML Source – Provide an option to set CharacterSet / Encoding just like REST API Task (e.g. Support UTF-8 without BOM )
• NEW: Salesforce Destination – Add support for Bulk API for very large dataset
• NEW: Secure FTP Connection – Lower the default minimum Key Size to 512 bit to support old version keys (Some customers reported problem with default 1023 bit size key we forced in last version)
• NEW: Secure FTP Task – Show file size in log
• NEW: Upsert Destination – Bulk Update, Insert, Delete and Merge for SQL Server

Bug fixes

• FIX: Amazon S3 CSV Source – When File name contains colon ( : ) it may not work when you hit preview (You get 404 Error)
• FIX: CSV File Destination – Object reference not set error may be thrown on ReleaseConnection
• FIX: Export JSON File Task, Export XML Task, Export CSV Task- Input string was not in a correct format.Couldn’t store <> in SomeIntegerColumn. Expected type is Int32
• FIX: JSON Generator Transform – Hidden columns with Include in output option may be NULL if Multiple rows included in output document
• FIX: PostgreSql Source, Amazon Redshift Source – License is not validated correctly
• FIX: Salesforce Connection Manager – For long running salesforce JOB you may get session timeout error after 2 hours
• FIX: Secure FTP Connection Manager – You cannot specify Host Key Exchange algorithms, if you set you get server and client has no common algorithm error
• FIX: Secure FTP Connection Manager – You may get error – Negotiation failed. Server signature is not valid
• FIX: Secure FTP Task – Progress event shows counter starting from zero rather than one
• FIX: XML Source, XML Parser Transform – When 2D Transform Enabled , Cannot deal with XSI:NIL or self closing nodes correctly: Type cast exception

SSIS Upsert Destination

In this release we added very useful component for Upsert operation (in SQL Server Database for now). This component can perform High performance Bulk Upsert (Insert + Update) in a single operation. It uses Key based Lookup. You can also do Bulk Delete or Bulk Update.

SSIS Upsert Destination Example – Bulk Insert or Update in SQL Server (Merge Records)

Salesforce BULK Update Feature

We also added highly requested feature in Salesforce to use BULK API for very large dataset. By default Salesforce Destination uses SOAP API for Insert operation. Which is good for most part if you don’t have large dataset. For millions of rows it won’t perform good. This is why we added Bulk API mode.

We added two new properties. EnableBulkApiMode and MaxRowsPerJob. When EnableBulkApiMode is enabled BatchSize is ignored.

SSIS Salesforce Destination – Upload Data using BULK API mode

The post SSIS PowerPack v2.9 released (Upsert Destination, Salesforce BULK API and more…) appeared first on ZappySys Blog.

In this article we’re going to focus on load data in Salesforce using SSIS (Bulk Insert, Update, Delete and Upsert). If you like to know how to read from Salesforce then refer to previous post here. For Demo purpose we will use AdventuresWorks sample database as our source but you can use your own Database for testing.

Salesforce developer account

To develop ETLs in Salesforce using SSIS you’ll need a Salesforce developer account. If you don’t have one, don’t worry, you can create a limited version FREE developer account. Click here to Sign up for FREE developer account.

Video Tutorial – Salesforce Insert, Upsert, Delete, Update

Getting Started

In this section, we will see how to perform bulk insert, update delete and upsert operations using ZS Salesforce Destination

Configure Salesforce Connection

First, we’ll need setup a connection to read or write Salesforce data is to make sure we have a working connection in SSIS.

1. Create new or open existing SSIS Project in Visual Studio.
2. Open SSIS Package and Go to SSIS designer.
3. Right click in the connection manager panel and click New connection
   

   Create a new SSIS Salesforce Connection

4. In the connection type selection, Select the ZS-SALESFORCE Connection.
5. We’ll use this information: Username, Password, Security Token (click the link learn how to obtain Salesforce Security Token )
6. Click OK to add the connection.
   

   Salesforce using SSIS, Salesforce connection

7. Save all changes

Bulk Insert – Import data into Salesforce using SSIS

Let’s start with the a bulk insert in Salesforce using SSIS. On this section, we’re going to generate retrieve data from and OLEDB Source and proceed to Insert the records into Salesforce using ZS Salesforce Destination.

Configure SQL Server Source (OLEDB)

1. Open SSIS Package and drag Data Flow task from Control Flow SSIS Toolbox
   

   Dragging and dropping Data Flow Task into Control Flow

2. Go to data flow designer. Drag and drop an OLE DB Source
3. Open the OLE DB Source and configure as follow:
   

   Configure SQL Server Source

Configure SSIS Salesforce Destination for Bulk Insert

Once SQL Server source is configure. Now let’s configure Salesforce Destination for Bulk Insert like below.

1. Drag and drop ZS Salesforce Destination
2. Open the destination component
3. Connection Manager
   

   Salesforce using SSIS, upsert destination connection manager

4. Component Properties
   

   salesforce-using-ssis-insert-properties

5. Column Mappings
   

   salesforce-using-ssis-insert-mapping

6. Click OK
7. Drag and drop two Trash Destination components
8. Connect ZS Salesforce Destination for: New records Output and Error Output
9. Right click on the joining arrows and enable data viewers on all previous connections
10. Save all changes
11. Right click in the data flow designer, click Execute Task
    

    salesforce-using-ssis-insert-results

Bulk Update – Modify data in Salesforce using SSIS

In this section we’re going to perform a bulk update on Salesforce using SSIS. We’re going to list some information from our source, list all our Salesforce Account data, merge it and only update the data we match. In below example what we will do is Find out matching records in Salesforce and our Source System based on some External Key field (e.g. AccountNumber in our case). And then obtain Salesforce Record Id for matching AccountNumber and use it to Update target record.

Configure SQL Server Source (OLEDB Source)

1. Open SSIS Package and drag Data Flow task from Control Flow SSIS Toolbox
2. Go to data flow designer. Drag and drop OLE DB Source
3. Open the OLE DB Source and configure
   

   Salesforce using SSIS, Update OLEDB source

Configure SSIS Salesforce Source

1. Now lets Drag and drop ZS Salesforce Source
2. Open the ZS Salesforce and configure. You can select Query Mode and enter query like this because we only care about two fields for now. Use query mode whenever possible because it transfers less data.
   

   select Id,AccountNumber from account

   

   Salesforce using SSIS, Update Salesforce source

Configure Sort Transforms

Now lets sort both previous datasets using Sort Transforms. This is needed to JOIN dataset using Merge Transform (See next section)

1. Drag and drop: 2 Sort and 1 Merge Join components
2. Connect the OLE DB Source to the first Sort component, and configure
   

   Salesforce using SSIS, Update OLEBD sort

3. Connect the Salesforce Source to the second Sort component, and configure
   

   Salesforce using SSIS,update Salesforce sort

Configure Merge Transforms

No next step would be to join previous datasets based on AccountNumber and then we will output Id from Salesforce which is needed for later step.

1. Drag and Drop Merge Transform from SSIS Toolbox like below.
   

   Drag SSIS Merge Join Transform from Toolbox

2. Connect Sorts to the Merge component (sort from OLEDB Source most be on the left)
3. Configure the Merge component
   

   Salesforce using SSIS, update merge

Configure SSIS Salesforce Destination for Bulk Update

1. Drag and drop ZS Salesforce Destination
2. Open the ZS Salesforce Destination and configure
3. Connection Manager tab
   

   Salesforce using SSIS, update destination connection manager

4. Component Properties tab
   

   Salesforce using SSIS, update destination component properties

5. For Update purposes, Salesforce Destinations needs to map the ID from the Account object. For more information, please use the following link SSIS Salesforce Destination – Update / Insert with Lookup Fields (Text to Id)
6. Column Mapping
   

   salesforce using SSIS, update destination column mappings

7. Click OK
8. Drag and drop three Trash Destination components
9. Create two connections from ZS Salesforce Destination as follows: Update records and Error Output
10. Right click on the joining arrows and enable data viewers on all previous connections
11. Save all changes
12. Right click in the data flow designer, click Execute Task
    

    Salesforce using SSIS, update results

Bulk Upsert – Import/Modify data in Salesforce using SSIS

In this section we’re going to perform a bulk upsert of 25 record’s on Salesforce using SSIS. Upsert is an operation that combines both insert an update.

ZS Salesforce Destination allows Upserts operations. You’ll need to select the Upsert as an action and indicate the Key value for the comparison.

Creating External ID field for Salesforce Upsert

For the Upsert action we have to use an Upsert Keyfield (i.e. External ID field). For more information read here External ID. Follow these steps to add a External ID field on Salesforce Accounts object:

1. Login to your Salesforce account.
2. Click on the configuration icon and select “Service Setup”
   

   Salesforce using SSIS, Salesforce edit object

3. On the new Tab, look for USER INTERFACE -> Objects And Fields -> Object Manager
4. Select Account object
5. Select Fields & Relationships
6. Click New, to create a field
   

   Salesforce using SSIS, Salesforce Fields & Configuration

7. For the field type, choose Number and click next
8. For Field Label and Field Name, type TableID. Check Unique and External ID boxes and click next
9. Leave field-level security as default, click next
10. Leave page layouts as default, click next.
11. After finishing the configuration, the field should appear in the Fields & Relationships page

Configure SQL Server Source

1. Open SSIS Package and drag Data Flow task from Control Flow SSIS Toolbox
   

   Dragging and dropping Data Flow Task into Control Flow

2. Go to data flow designer. Drag and drop OLE DB Source
3. Open the OLE DEB Source and configure as follow
   

   Salesforce using SSIS, Upsert OLE DB source

Configure SSIS Salesforce Destination for Upsert

1. Drag and drop ZS Salesforce Destination
2. Open the ZS Salesforce and configure
3. Connection Manager
   

   Salesforce using SSIS, upsert destination connection manager

4. Component Properties
   

   Salesforce using SSIS, upsert destination component properties

5. Column Mapping
   

   salesforce using SSIS, upsert destination column mapping

6. Click OK
7. Drag and drop three Trash Destination components

Configure Error Handling, Outputs for New, Updated, Failed Records

If you like to capture which rows are inserted and which rows are updated then you can drag Blue arrows coming from Salesforce destination component. You can also connect Red arrow to detect failed records and reason for error.

1. Connect ZS Salesforce Destination for: New records Output, Updated Records Output and Error Output
2. Right click on the joining arrows and enable data viewers on all previous connections
3. Right click in the data flow designer, click Execute Task
   

   Salesforce using SSIS, upsert results

Bulk Delete – Delete data in Salesforce using SSIS

In this section, we’re going to perform a bulk delete on Salesforce using SSIS ZS Salesforce Destination. In this example we’re going to list all our source customers (from previous sections), merge it wit the Salesforce Account object, retrieve the Salesforce Account Id and delete the rows. Delete Operation also requires to map Id field so we will use similar technique we used for Update.

Configure SQL Server Source (OLEDB Source)

1. Go to data flow designer. Drag and drop OLE DB Source
2. Open the OLE DEB Source and configure as follow
   

   salesforce-using-ssis-delete-oledb-source

Configure SSIS Salesforce Source

1. Drag and drop ZS Salesforce Source
2. Open the ZS Salesforce and configure.
3. You can select Query Mode and enter query like this because we only care about two fields for now. Use query mode whenever possible because it transfers less data.
   

   select Id,AccountNumber from account

Configure Sort Transforms

Now lets sort both previous datasets using Sort Transforms. This is needed to JOIN dataset using Merge Transform (See next section)

1. Drag and drop: 2 Sort and 1 Merge Join components
2. Connect the OLE DB Source to the first Sort component, and configure
   

   Salesforce using SSIS, Update OLEBD sort

3. Connect the Salesforce Source to the second Sort component, and configure
   

   Salesforce using SSIS,update Salesforce sort

Configure Merge Transforms

No next step would be to join previous datasets based on AccountNumber and then we will output Id from Salesforce which is needed for later step.

1. Now drag Merge Transform from SSIS toolbox
   

   Drag SSIS Merge Join Transform from Toolbox

2. Connect both Sort to the Merge component (sort from OLEDB Source most be on the left)
3. Configure the Merge component
   

   salesforce-using-ssis-delete-merge

Configure SSIS Salesforce Destination for Bulk Delete

1. Drag and drop ZS Salesforce Destination
2. Connect the Merge and ZS Salesforce Destination components. Right click the arrow and enable data viewer
3. Connection Manager tab
   

   Salesforce using SSIS, delete destination connection manager

4. Component Properties tab
   

   Salesforce using SSIS, delete destination component properties

5. For Delete purposes, Salesforce Destinations needs to map the ID from the Account object.For more information, please use the following link SSIS Salesforce Destination – Update / Insert with Lookup Fields (Text to Id) 
6. Column Mapping
   

   salesforce-using-ssis-delete-destination-column-mapping

7. Click OK
8. Save all changes
9. Right click in the data flow designer, click Execute Task
   

   salesforce-using-ssis-delete-results

Error Handling

When working on Salesforce with SSIS, we recommend Trash Destination component to help debugging outputs without performing DML on destinations.

Main benefits of usage:

1. Enable data viewers and get live feedback of the data
2. Save the results on different formats (XML, JSON, plain text files).

Conclusion

In this article, We have seen how easy it is to integrate Salesforce using SSIS. Using drag and drop connector you can perform Bulk insert, update, delete and Upsert operations.

Download ZappySys SSIS PowerPack to learn more about other possible scenarios which are not discussed in this article.

The post Load data in Salesforce using SSIS – Insert, Upsert, Delete, Update appeared first on ZappySys Blog.