In our previous blog we saw How to perform Upsert (Update or Insert) for SQL Server Table. In this post we will look at specific example on How to Load data into PostgreSQL – Upsert using SSIS Upsert Destination (Insert, Update, Delete), along with few other topics such as how to create target table using Upsert Destination, how to read data from Ms Access Table and Merge into PostgreSQL using SSIS.

We will go through the steps to read data from Access and Load into PostgreSQL – Upsert in SSIS.

In nutshell, this post will focus on how to read access table data in SSIS.

So let’s get started.

Requirements

1. First, you will need to have SSIS installed
2. Secondly, make sure to have SSDT
3. Thirdly, do not forget to install ZappySys SSIS PowerPack
4. Finally, Make sure that Microsoft Access installed.

Read MS Access data and Upsert into PostgreSQL table

Let´s start with an example. In this article we will see Data migration from Access to PostgreSQL.

1. First of All, Drag and drop Data Flow Task from SSIS Toolbox and double click it to edit.
   

   Drag and Drop : SSIS Data Flow Task from SSIS Toolbox

2. Furthermore, drag and drop the OLE DB Source.
   

   OLE DB Source – Drag and Drop

3. Double click on OLE DB Source for configure it and click on New Connection and configure connection as below to connect access database and click on OK.
   

   OLE DB : Access Connection

4. Now in OLE DB Source Select the mode as Table or View and select Preview to view the access table data.
   

   OLE DB Source Preview

5. Now drag and drop Upsert Destination (Insert, Update, Delete) and create connection with PostgreSQL Database.
   

   Setup SSIS Upsert Destination for PostgreSQL data load (Bulk Update, Insert, Delete)

6. Now select Action as Sync and check all the checkboxes Insert, Update and Delete from target if not found in source. Select the table and Map all the columns and select the Key field(s) and click on OK.
7. That’s it we are ready to migrate MS access table data into PostgreSQL Table. Execute the package and it will migrate the data.

Conclusion

In this article, we show how to read MS Access table data and migrate the data in PostgreSQL table using SSIS Upsert Destination. We show how to do connect access MS Access using OLE DB Source. Also, we show how to write Sync Insert, Update and Delete in target if not found in Source Using ZS Upsert Destination. If you liked this article and you want to try, you can download the SSIS PowerPack from here (includes 70+ Components).

References

• ZappySys SSIS installer.
• Help File: Upsert Destination

The post Load data into PostgreSQL – Upsert using SSIS (Bulk Update, Insert, Delete) appeared first on ZappySys Blog.

ZappySys provides high-performance drag and drop connectors for PostgreSQL Integration. In this post you will see how to Execute SQL query against PostgreSQL in SSIS, in various SQL commands such as SELECT, INSERT, DROP, COPY, CREATE, etc using PostgreSQL Execute SQL Task can be used to execute DDL and DML statements for PostgreSQL without needing any extra driver. PostgreSQL is a powerful, open-source relational database with a strong reputation for reliability, feature robustness, and performance.

In nutshell, this post will focus on how to Execute SQL query against PostgreSQL in just a few clicks.

Prerequisite

1. First, you will need to have SSIS installed
2. Secondly, make sure to have SSDT
3. Thirdly, You have obtained PostgreSQL Credential.
4. Finally, do not forget to install ZappySys SSIS PowerPack

Component Mentioned in this article

PostgreSQL Execute SQL Task

What is PostgreSQL?

PostgreSQL is a powerful, open source object-relational database system that uses and extends the SQL language combined with many features that safely store and scale the most complicated data workloads. The origins of PostgreSQL date back to 1986 as part of the POSTGRES project at the University of California at Berkeley and has more than 30 years of active development on the core platform.

PostgreSQL has earned a strong reputation for its proven architecture, reliability, data integrity, robust feature set, extensibility, and the dedication of the open source community behind the software to consistently deliver performant and innovative solutions. PostgreSQL runs on all major operating systems, has been ACID-compliant since 2001, and has powerful add-ons such as the popular PostGIS geospatial database extender. It is no surprise that PostgreSQL has become the open source relational database of choice for many people and organisations.

Getting started with using PostgreSQL has never been easier – pick a project you want to build, and let PostgreSQL safely and robustly store your data.

Download and Install PostgreSQL

Please go to below download link and download the Windows version Binary package and install it and follow the steps from the installer.

https://www.postgresql.org/download/

Download PostgreSQL

Create a PostgreSQL Database

1. To do this, go to Start Menu and search for pgAdmin and we will first open the pgAdmin Panel.
   

   Open pgAdmin from Start Menu

2. It will open the pgAdmin Panel in the system default browser. Select Server and Right-click on Databases to create a database.
   

   PostgreSQL Create Database

3. Now, Enter the Database name and click on Save to create it.
   

   Create a PostgreSQL Database

Getting Started

In order to start, we will show several examples. ZappySys includes an SSIS PostgreSQL ExecuteSQL Task that will help you how to Create and Drop table by Execute SQL query against PostgreSQL in SSIS. ZS PostgreSQL ExecuteSQL Task support execute queries against PostgreSQL without ODBC driver, load query at runtime from variable, file or Direct value, 100% Managed code means its 32bit and 64bit compatible, you can issue COPY, UNLOAD commands very easily, Support for SQL Server 2017, 2016, 2014, 2012, 2008 (32/64 bit) and Click here to see articles related to PostgreSQL.

You can connect to your PostgreSQL database by entering your PostgreSQL credentials.

Execute SQL query against PostgreSQL in SSIS

Let’s start with an example. In this tutorial, we will learn how to Create and Drop table using SQL query against PostgreSQL server using ZS PostgreSQL ExecuteSQL Task.

1. In order to connect to the PostgreSQL Database from SSIS, you will need Credentials. Ask your SysAdmin or responsible person to provide that to you.
2. Once you finished the above steps, Open Visual Studio and Create New SSIS Package Project.
3. In Visual Studio, drag and drop the ZS PostgreSQL ExecuteSql Task in the design surface.
   

   SSIS ZS PostgreSQL ExecuteSQL Task – Drag and Drop

4. We need a PostgreSQL Database connection. Click here to create a connection.
5. Now, double click on ZS PostgreSQL ExecuteSql Task to configure it.
6. In the PostgreSQL ExecuteSql Task, add the following SQL code to DROP a table if it exists and CREATE a table named pg_equipment in the SQL Statement section.
   You can replace the table name from the following code.
   

   DROP TABLE IF EXISTS playground_equip;
   CREATE TABLE pg_equipment (
   	equip_id serial PRIMARY KEY,
   	type varchar (50) NOT NULL,
   	color varchar (25) NOT NULL,
   	location varchar(25) check (location in ('north', 'south', 'west', 'east', 'northeast', 'southeast', 'southwest', 'northwest')),
   	install_date date
   );

   

   SSIS ZS PostgreSQL ExecuteSQL Task – Configure

7. In the above step, you can Select Variable as Sql Source Type.
8. Click OK to save ZS PostgreSQL ExecuteSql Task UI settings.
9. Finally, Right Click on Task and Select Execute Task to run it.

Conclusion

After all, In this blog, we learned Execute SQL query against PostgreSQL in SSIS using ZS PostgreSQL ExecuteSQL Task. You can download SSIS PowerPack here to try many other scenarios not discussed in this blog along with 70+ other components.

References

Finally, you can use the following links for more information:

• About PostgreSQL
• PostgreSQL Documentation
• PostgreSQL Query
• Help File: PostgreSQL ExecuteSQL Task

The post Execute SQL query against PostgreSQL in SSIS appeared first on ZappySys Blog.

In this post, we will learn How to Load data into PostgreSQL from Excel file using SSIS PostgreSQL Destination.  We will use SSIS PowerPack to connect PostgreSQL. This article also covers how to read Excel file in SSIS.

SSIS PostgreSQL Destination can be used to perform bulk insert in PostgreSQL Table from any data source using SSIS.

In nutshell, this post will focus on how to Read Excel file and load data into PostgreSQL Table.

Prerequisite

1. First, you will need to have SSIS installed
2. Secondly, make sure to have SSDT
3. Thirdly, You have obtained PostgreSQL Credential.
4. Finally, do not forget to install ZappySys SSIS PowerPack

Components Mentioned in this article

	PostgreSQL Destination
	Excel Source

What is PostgreSQL?

PostgreSQL is a powerful, open source object-relational database system that uses and extends the SQL language combined with many features that safely store and scale the most complicated data workloads. The origins of PostgreSQL date back to 1986 as part of the POSTGRES project at the University of California at Berkeley and has more than 30 years of active development on the core platform.

PostgreSQL has earned a strong reputation for its proven architecture, reliability, data integrity, robust feature set, extensibility, and the dedication of the open source community behind the software to consistently deliver performant and innovative solutions. PostgreSQL runs on all major operating systems, has been ACID-compliant since 2001, and has powerful add-ons such as the popular PostGIS geospatial database extender. It is no surprise that PostgreSQL has become the open source relational database of choice for many people and organisations.

Getting started with using PostgreSQL has never been easier – pick a project you want to build, and let PostgreSQL safely and robustly store your data.

Getting Started

In order to start, we will show several examples of how to connect the excel file and read data from the excel worksheet. ZappySys includes an SSIS Excel File Source Connector that will help you in reading excel sheet data from Excel File. Here we are showing you is, How to Load Excel File data in PostgreSQL using SSIS PostgreSQL Destination.

Getting Started – Read Excel File in SSIS

Let´s start with an example. Let’s use our SSIS Excel File Source Connector, we will read data from Microsoft Excel File.

1. First of all, Drag and drop Data Flow Task from SSIS Toolbox and double click it to edit.
2. Now Drag and Drop ZS Excel Source from the SSIS Toolbox.
3. Let’s Double Click on Excel Source for edit and select New Connection and click on New button.
   

   Edit Excel Source

4. Now select the excel file path in and test connection in opened excel connection manager window and click on OK.
   

   Select Excel File For Connection

5. Let’s read the Excel Workbook data using table mode and select sheet to read data from that excel sheet.
   

   Load Excel Sheet Data using Access mode as a Table

6.  We can also read Excel Workbook using SQL Query mode and filter the data.
   

   Read from Excel File using SQL Query Mode

7. You can do various other things also in the query mode, find our various example here to read Excel Workbook using SQL Query mode.
   

   Read from Excel File using SQL Query Mode Examples

    

8.  That’s it we are ready to load excel file data to PostgreSQL.

Load Excel File data into PostgreSQL

Now let’s look at how to load data into target like PostgreSQL database Table.

1. First of all, let’s create the PostgreSQL Database Connection From Connection Manager.
2. Right click in connection Window and select New Connection.
   

   Connection Manager Window: Create New Connection

3. Select the ZS-POSTGRESQL Connection type from the Connection Manager Window.
   

   Select ZS-PostgreSQL Connection

4. Let’s configure the connection for PostgreSQL Database and Test the Connection.
   

   Configure PostgreSQL Connection

5. Now lets’ Drag and Drop PostgreSQL Destination from SSIS Toolbox Inside the Data Flow.
   

   Add PostgreSQL Destination

6. Connect our Source component to PostgreSQL Destination.
   

   Connect Source Component to PostgreSQL Destination

7. Double click PostgreSQL Destination to configure it. And Select the PostgreSQL Connection.
   

   Select the PostgreSQL Connection

8. Furthermore, go to Component Properties Tab and Select the PostgreSQL Table to Load Excel File data into it.
   

   Select The PostgreSQL Table

9. Finally, let’s map the columns from the Column Mappings Tab.
   

   PostgreSql Destination : Column Mappings

10. That’s it we are ready to go. Finally execute the package and it will insert the excel file data into the PostgreSQL Table.

Conclusion

Above all, in this blog, we learned how to Load data into PostgreSQL from Excel file using SSIS PostgreSQL Destination using SSIS Pack. Therefore we used Excel File Source Connector to read the Excel file and load data into PostgreSQL using SSIS PostgreSQL Destination. You can download SSIS PowerPack here to try many other scenarios not discussed in this blog along with 70+ other components.

References

Finally, you can use the following links for more information:

• About PostgreSQL
• PostgreSQL Documentation
• Help File : PostgreSQL Destination
• Help File: Excel Source

The post Load data into PostgreSQL from Excel file using SSIS appeared first on ZappySys Blog.

In nutshell, this post will focus on how to read PostgreSQL Table Data and write into SQL Server table in few clicks.

Prerequisite

1. First, you will need to have SSIS installed
2. Secondly, make sure to have SSDT
3. Thirdly, You have obtained PostgreSQL Credential.
4. Finally, do not forget to install ZappySys SSIS PowerPack

Components Mentioned in this article

SSIS PostgreSQL Source

What is PostgreSQL?

PostgreSQL is a powerful, open source object-relational database system that uses and extends the SQL language combined with many features that safely store and scale the most complicated data workloads. The origins of PostgreSQL date back to 1986 as part of the POSTGRES project at the University of California at Berkeley and has more than 30 years of active development on the core platform.

PostgreSQL has earned a strong reputation for its proven architecture, reliability, data integrity, robust feature set, extensibility, and the dedication of the open source community behind the software to consistently deliver performant and innovative solutions. PostgreSQL runs on all major operating systems, has been ACID-compliant since 2001, and has powerful add-ons such as the popular PostGIS geospatial database extender. It is no surprise that PostgreSQL has become the open source relational database of choice for many people and organisations.

Getting started with using PostgreSQL has never been easier – pick a project you want to build, and let PostgreSQL safely and robustly store your data.

Download and Install PostgreSQL

Please go to below download link and download the Windows version Binary package and install it and follow the steps from the installer.

https://www.postgresql.org/download/

PostgreSQL Download

Create PostgreSQL Database and Table

1. To do this, we will first open the pgAdmin Panel.
   

   Open PostgreSQL pgAdmin Panel

2. It will open the pgAdmin Panel in the browser. Select Server and Right click on Databases to create database.
   

   PostgreSQL Select Create Database

3. Enter the Database name and click on Save to create it.
   

   Create PostgreSQL Database

4. Now select the created database under it expand Schemas and right click on Tables and click on create Table.
   

   PostgreSQL Select Create Table

5. Now enter the table name and go to columns tab.
   

   PostgreSQL Enter Table Name

6. Add the columns by clicking add button and give the desire column name and select the datatype for the same.
   

   PostgreSQL Add Table Columns

7. Now, let’s insert some data using Query Editor.
   

   PostgreSQL Insert Data in Table

8. That’s it, now let’s move forward to read the data from this table using SSIS PostgreSQL Source in the next the section.
   

   PostgreSQL Select Query Data

Getting Started

In order to start, we will show several examples. ZappySys includes an SSIS PostgreSQL Source that will help you extract large amount of data from a PostgreSQL Database. PostgreSQL Source supports Multiple modes (i.e. Table or Query) to read data from PostgreSQL Database and many more operations. Here we are showing you is, How to read data from PostgreSQL collection.

You can connect to your PostgreSQL database by entering your PostgreSQL credentials.

Configure PostgreSQL Source to read data from the table

Let´s start with an example. In this SSIS PostgreSQL Source Task example, we will load the PostgreSQL table data to SQL Server.

1. First of All, Drag and drop Data Flow Task from SSIS Toolbox and double click it to edit.
   

   Drag and Drop : Data Flow Task from SSIS Toolbox

2. Drag and Drop PostgreSQL Source Task from the SSIS Toolbox and double click on it to edit it.
   

   PostgreSQL Source

3. Let’s create a connection for PostgreSQL Database.
   

   Create PostgreSQL Database Connection

4. Let’s select the Table mode and select the table and click on preview.
   

   PostgreSQL Table Preview

5. You can also use the query mode to filter the data and do more operation using query. You can find our several Examples also by clicking on <<View Examples>>.
   

   PostgreSQL Query Preview

6. That’s it we are ready to load PostgreSQL Table data to SQL Server.

Load PostgreSQL Table data into SQL Server

ZappySys SSIS PowerPack makes it easy to load data from various sources such as REST, SOAP, JSON, XML, CSV or from other source into SQL Server, or PostgreSQL, or Amazon Redshift, or other targets. The Upsert Destination component allows you to automatically insert new records and update existing ones based on key columns. Below are the detailed steps to configure it.

Step 1: Add Upsert Destination to Data Flow

1. Drag and drop the Upsert Destination component from the SSIS Toolbox.
2. Connect your source component (e.g., JSON / REST / Other Source) to the Upsert Destination.

SSIS - Data Flow - Drang and Drop Upsert Destination Component

Step 2: Configure Target Connection

1. Double-click the Upsert Destination component to open the configuration window.
2. Under Connection, select an existing target connection or click NEW to create a new connection.
   • Example: SQL Server, or PostgreSQL, or Amazon Redshift.

Step 3: Select or Create Target Table

1. In the Target Table dropdown, select the table where you want to load data.
2. Optionally, click NEW to create a new table based on the source columns.

Configure SSIS Upsert Destination Connection - Loading data (REST / SOAP / JSON / XML /CSV) into SQL Server or other target using SSIS

Step 4: Map Columns

1. Go to the Mappings tab.
2. Click Auto Map to map source columns to target columns by name.
3. Ensure you check the Primary key column(s) that will determine whether a record is inserted or updated.
4. You can manually adjust the mappings if necessary.

SSIS Upsert Destination - Columns Mappings

Step 5: Save Settings

• Click OK to save the Upsert Destination configuration.

Step 6: Optional: Add Logging or Analysis

• You may add extra destination components to log the number of inserted vs. updated records for monitoring or auditing purposes.

Step 7: Execute the Package

• Run your SSIS package and verify that the data is correctly inserted and updated in the target table.

SSIS Upsert Destination Execution

Conclusion

Above all, in this blog, we learned how to Read data from PostgreSQL in SSIS. We used SSIS PostgreSQL Source to read the data from PostgreSQL Table and load data into SQL Server Table. You can download SSIS PowerPack here to try many other scenarios not discussed in this blog along with 70+ other components.

References

Finally, you can use the following links for more information:

• About PostgreSQL
• PostgreSQL Documentation
• PostgreSQL – SELECT Query
• Help File : PostgreSQL Source

The post Export PostgreSQL Table Data to SQL Server in SSIS appeared first on ZappySys Blog.

ZappySys provides high performance drag and drop connectors for PostgreSQL Integration. In this post you will see how to Load PostgreSQL Table Data to CSV File using SSIS PostgreSQL Source. PostgreSQL Source supports SQL language to query PostgreSQL data. PostgreSQL is a powerful, open source relational database with strong reputation for reliability, feature robustness, and performance.

In nutshell, this post will focus on how to Load PostgreSQL Table Data and write into CSV File using Trash Destination in few clicks. You can also use the CSV Destination instead of Trash destination if you wants more option like compressed file gzip (*.gz) or zip, wants to splitting the file by row count of file size and more.

Prerequisite

1. First, you will need to have SSIS installed
2. Secondly, make sure to have SSDT
3. Thirdly, You have obtained PostgreSQL Credential.
4. Finally, do not forget to install ZappySys SSIS PowerPack

Components Mentioned in this article

	SSIS PostgreSQL Source
	CSV Destination
	Trash Destination

What is PostgreSQL?

PostgreSQL is a powerful, open source object-relational database system that uses and extends the SQL language combined with many features that safely store and scale the most complicated data workloads. The origins of PostgreSQL date back to 1986 as part of the POSTGRES project at the University of California at Berkeley and has more than 30 years of active development on the core platform.

PostgreSQL has earned a strong reputation for its proven architecture, reliability, data integrity, robust feature set, extensibility, and the dedication of the open source community behind the software to consistently deliver performant and innovative solutions. PostgreSQL runs on all major operating systems, has been ACID-compliant since 2001, and has powerful add-ons such as the popular PostGIS geospatial database extender. It is no surprise that PostgreSQL has become the open source relational database of choice for many people and organisations.

Getting started with using PostgreSQL has never been easier – pick a project you want to build, and let PostgreSQL safely and robustly store your data.

Download and Install PostgreSQL

Please go to below download link and download the Windows version Binary package and install it and follow the steps from the installer.

https://www.postgresql.org/download/

PostgreSQL Download

Create PostgreSQL Database and Table

1. To do this, we will first open the pgAdmin Panel.
   

   Open PostgreSQL pgAdmin Panel

2. It will open the pgAdmin Panel in the browser. Select Server and Right click on Databases to create database.
   

   PostgreSQL Select Create Database

3. Enter the Database name and click on Save to create it.
   

   Create PostgreSQL Database

4. Now select the created database under it expand Schemas and right click on Tables and click on create Table.
   

   PostgreSQL Select Create Table

5. Now enter the table name and go to columns tab.
   

   PostgreSQL Enter Table Name

6. Add the columns by clicking add button and give the desire column name and select the datatype for the same.
   

   PostgreSQL Add Table Columns

7. Now, let’s insert some data using Query Editor.
   

   PostgreSQL Insert Data in Table

8. That’s it, now let’s move forward to read the data from this table using SSIS PostgreSQL Source in the next the section.
   

   PostgreSQL Select Query Data

Getting Started

In order to start, we will show several examples. ZappySys includes an SSIS PostgreSQL Source that will help you extract large amount of data from a PostgreSQL Database. PostgreSQL Source supports Multiple modes (i.e. Table or Query) to read data from PostgreSQL Database and many more operations. Here we are showing you is, How to read data from PostgreSQL collection.

You can connect to your PostgreSQL database by entering your PostgreSQL credentials.

Load PostgreSQL Table Data to CSV File

Let´s start with an example. In this SSIS PostgreSQL Source Task example, we will load the PostgreSQL table data to CSV file.

1. First of All, Drag and drop Data Flow Task from SSIS Toolbox and double click it to edit.
   

   Drag and Drop : Data Flow Task from SSIS Toolbox

2. Drag and Drop PostgreSQL Source Task from the SSIS Toolbox and double click on it to edit it.
   

   PostgreSQL Source

3. Let’s create a connection for PostgreSQL Database.
   

   Create PostgreSQL Database Connection

4. Let’s select the Table mode and select the table and click on preview.
   

   PostgreSQL Table Preview

5. You can also use the query mode to filter the data and do more operation using query. You can find our several Examples also by clicking on <<View Examples>>.
   

   PostgreSQL Query Preview

6. Now let’s add Trash destination Task and edit it and enter the CSV File Path.
   

   Trash Destination : Setup CSV File Path

7. That’s it now execute the package and it will load data from PostgreSQL Table to CSV File.
   

   PostgreSQL : CSV Data

Conclusion

Above all, in this blog, we learned how to Read data from PostgreSQL in SSIS. We used SSIS PostgreSQL Source to read the data from PostgreSQL Table and load data into CSV File. You can download SSIS PowerPack here to try many other scenarios not discussed in this blog along with 70+ other components.

References

Finally, you can use the following links for more information:

• About PostgreSQL
• PostgreSQL Documentation
• PostgreSQL – SELECT Query
• Help File : PostgreSQL Source

The post Load PostgreSQL Table Data to CSV File in SSIS appeared first on ZappySys Blog.