In this post we will show you how to convert varbinary to Base64 in SSIS. We will use FREE Tasks provided by ZappySys.

Preparing Sample Data

First let’s create a sample table with some Varbinary datatype. Run following command in SSMS to create a sample table with one sample row.

create table binarydata(
 data varbinary(max)
)
go
insert into binarydata(data )
values(0x5468697320697320612074657374) /*binary of "This is a test"*/

Method 1 – Using Template Transform

Let’s use Template Transform to convert Varbinary data to Base64 format. When you use columns with binary data in Template transform it automatically converts to Base64 by default.

1. Go to Data flow
2. Drag your OLEDB Source and configure it to outputs SQL Data with Varbinary column  (e.g. select data from dbo.binarydata).
3. Now drag ZS Template Transform from SSIS Toolbox
4. Connect OLEDB Source to Template Transform
5. Double click Template Transform  to configure. Now you can click Insert Placeholders > Columns > Select your Upstream column name (which has Varbinary data)
6. You will see Template text as  <%MyVarBinaryColumn%>
7. Click OK to Save Template Transform
8. Now connect Template transform to any Destination e.g. OLEDB Destination.  You can Map TemplateOutput column to target column. This will contain Base64 representation of Varbinary data. For example purpose we used ZS Trash destination (Check save to file)

Convert Varbinary to BASE64 using SSIS Template Transform

Save Base64 string to Variable

In previous step we saw how Template Transform can convert binary data (i.e. Varbinary datatype) to BASE64 string. Now let’s look at how to save this value to Variable using Set Variable Transform.

Using SSIS Set Variable Transform in Data flow (Capture binary data as base64 example)

Method 2 – Using Trash Destination

Another way to dump Binary data to CSV file is use ZS Trans Destination. See previous screenshot. If you map OLEDB Source directly to Trash destination without Template Transform then you will see something like below.

data
VGhpcyBpcyBhIHRlc3Q=

The post How to convert Varbinary to Base64 in SSIS appeared first on ZappySys Blog.

In this post you will learn how to use FREE SSIS Logging Task to perform ssis base64 encode decode and save to Variable or File  (i.e. convert Base64 Encoded value to plain text or encode plain text to base64) . You can also use many other format specifiers found here

How to invoke Placeholder Functions

There are 3 ways you can use placeholder functions in many tasks with Variable Icon next to the property.

1. User Variable Placeholder
2. Static String Placeholder
3. Mixed Placeholder (Static String with Variable)

Examples: 

{{User::var1,FUN_BASE64ENC}} 

<<some direct string,FUN_BASE64ENC>>

–OR–

<<{{User::var1}} and {{User::var2}} ,FUN_BASE64ENC>>

Encode Plain text to Base64 string (SSIS base64 encode decode)

Many times you have requirement to convert plain text into Base64 encoded string (This is very common when you have to transfer data over the web – set query string / http headers / body ). Typically to perform this you may have to write C# Script if you are SSIS developer but below is very simple way to do without writing any code. Here is the most common use case of Base64 encoded string

1. Download FREE Tasks/Components of SSIS PowerPack
2. Create new SSIS Package
3. Drag ZS Logging Task from Toolbox
4. Create SSIS variable which holds plain text value (Lets call it varPlainText. Set some initial value which you want to encode)
5. Configure SSIS Logging Task as below
   

   SSIS Base64 Encode, Decode using SSIS Logging Task (Without coding convert plain text to base 64 string)

6. Run it and you will see new file created with encoded value. You can also save encoded value to Variable if you change Logging Mode = Variable rather than File

Convert Base64 Encoded value to plain text (Decode)

To convert Base64 encoded string into plaintext you can perform similar steps described in the above section except you need to use BASE64DEC format specifier rather than BASE64ENC

Example:

<<QUJDREVGMTIzIyM=,FUN_BASE64DEC>>
--OR--
{{User::MySSISVar1,FUN_BASE64DEC}}

How to decode Base64 file in SSIS and save to new file

If you have a file coming as a base64 encoded string and you want to decode it and save it to a new file then it’s simple too. Basically, you will need SSIS Advanced File System Task  and SSIS Logging Task to achieve this (see package below).

SSIS decode base64 file – Read content convert to plain text and save to new file

Here are your steps.

1. Use SSIS Advanced File System Task and use read file content option to save file content into SSIS Variable
2. Configure Advanced File System as below.
   

   Read file content into SSIS variable using SSIS Advanced File System task

3. Next step connect SSIS Logging Task
4. Configure SSIS Logging Task as per below screenshot.
   

   Decode base64 file content in SSIS – Use Logging Task

Convert Base64 Encoded string of local file content (Binary or Text)

Using FUN_FILE_BASE64ENC we can encode the image or any other local file(Binary or Text) to the Base64 string.

FUN_FILE_BASE64ENC

Syntax:

<<file_path,FUN_FILE_BASE64ENC>>

Returns BASE64 encoded string of local file content (binary or text).

Parameters:

Examples:

<<c:\someimage.png,FUN_FILE_BASE64ENC>>
--OR--
{{User::MySSISVar1,FUN_FILE_BASE64ENC}}

Sample Output:

This returns base64 encoded string of binary file (png)

bXl1c2V..........Ac3NXb3Jk

The post SSIS Base64 Encode Decode without Coding appeared first on ZappySys Blog.

In this blog post you will explain how to pass basic credentials (i.e. UserID/Password) along with your web request. You will also learn about setting up Authorization Header for HTTP Web Request in Base64 manually. To learn more about how to consume / call REST API in SSIS check this article.

HTTP Authorization Header basics

As per HTTP Standard you can pass credentials very simple way using basic Authorization header. Below is the sample of Basic Authorization header.

As you can see it consist of HeaderName=Authorization and Value=some base64 encoded string
Authorization: Basic QWxhZGRpbjpvcGVuIHNlc2FtZQ==
As per standard Base64 encoded string is made up with two elements. your_userid:your_password

NOTE: Base64 is encoding and not encryption method. So never hand over your encoded Authorization header string to anyone. Anyone can decode Base64 encoded string easily by using tools like this

Passing Basic Credentials along with HTTP Web Request

You can pass credentials (i.e. UserID/Password) in two different ways.

1. Automatic approach – Using ZS-HTTP Connection Manager (BASE64 Encoded Header automatically generated)
2. Manual approach – Supplying Authorization where UserID/Password encoded as Base64

Automatic approach – Using ZS-HTTP Connection Manager

Now lets look at how to use automatic approach to pass Basic Authorization in following 3 different tasks/components

1. Passing basic credentials in SSIS REST API Task
2. Passing basic credentials in SSIS JSON Source
3. Passing basic credentials in SSIS XML Source

Using SSIS REST API Task (Pass Basic credentials using Connection Manager)

The simplest way to pass credentials is use HTTP Connection Manager. If you are using REST API Task then you can use Url from Connection Access Mode. And on connection manager specify UserId and password to pass Basic Authorization Header

Advantages of this method are..
1) Its very simple
2) Credentials are encrypted in SSIS Package

NOTE: We recommend using https:// Urls whenever possible otherwise your web request can be decoded in plain text by any servers sitting between you and target and possibly they can get your password by decoding base64 header.

Base64 Encoded HTTP Basic Authorization Header – View in Fiddler

Using SSIS JSON/XML Source  (Pass Basic credentials using Connection Manager)

You can use HTTP Connection manager in JSON Source and XML Source too. Only difference is you have to check Use Credentials checkbox and select HTTP connection manager from available connection managers dropdown.

1. Select AccessMode as “File Path or Web URL”
2. Enter API URL
3. Check “Use Credentials” option
4. Click “New” next to Connection dropdown or select New “ZS-HTTP” connection from dropdown
5. Configure HTTP Connection as below (i.e. Enter URL, Select Basic Auth, Enter UserID, Password)
6. Clock OK on HTTP connection manager UI to save and now Test JSON or XML Source UI by clicking Preview (Assuming no other configuration needed)

SSIS JSON Source – Passing Basic Credentials (Supply UserID / Password) using HTTP Connection

Manual approach – Supplying Authorization where UserID/Password encoded as Base64

Our JSON Source, XML Source and REST API Task they all support passing BASE64 Encoded String for Authorization header (see below screenshot). Setting up userid and password in HTTP Connection Manger would do same trick as setting up it manually.

To encode any Header value in BASE64 format you simply have to add BASE64ENC format specifier after variable name.

Example: {{User::varUserAndPassword,BASE64ENC}}

SSIS JSON Source Task – Pass Base64 Encoded HTTP Authorization Header

Reference

Wikipedia Article – HTTP Basic Authorization Header

Download FREE SSIS Components

The post Calling REST API in SSIS with Basic Authentication / Userid-Password (BASE64 Authorization header) appeared first on ZappySys Blog.