{"id":8538,"date":"2019-12-17T16:55:54","date_gmt":"2019-12-17T16:55:54","guid":{"rendered":"https:\/\/zappysys.com\/blog\/?p=8538"},"modified":"2024-07-01T20:47:45","modified_gmt":"2024-07-01T20:47:45","slug":"load-10-million-rows-from-sql-server-to-snowflake","status":"publish","type":"post","link":"https:\/\/zappysys.com\/blog\/load-10-million-rows-from-sql-server-to-snowflake\/","title":{"rendered":"Load 10M rows from SQL Server to Snowflake in 3 minutes"},"content":{"rendered":"<h2>Introduction<\/h2>\n<p style=\"text-align: justify;\"><img loading=\"lazy\" decoding=\"async\" class=\"size-thumbnail wp-image-8580 align= alignleft\" src=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/sql-server-to-snowflake-150x150.png\" alt=\"\" width=\"150\" height=\"150\" srcset=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/sql-server-to-snowflake-150x150.png 150w, https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/sql-server-to-snowflake-300x300.png 300w, https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/sql-server-to-snowflake.png 400w\" sizes=\"(max-width: 150px) 100vw, 150px\" \/>In this article, we will cover the points on how to load 10 million rows from SQL Server to Snowflake in just 3 minutes.<\/p>\n<p style=\"text-align: justify;\">Snowflake is a data warehousing platform that resides in a cloud. Basically, it is a data warehouse software exposed as a service. It allows integrating many data sources via internal Snowflake Partner apps and loading them into the Snowflake storage engine. Another part of Snowflake is a computing engine that is responsible for serving your SQL queries. Both engines can work independently thus users that are querying a data warehouse are not affected by a data load that is happening at the same time. Snowflake is an elastic service, which means you pay only for the resources used. Specifically, you pay only for each second of the processing time you use.<\/p>\n<p style=\"text-align: justify;\">To show how data loading works in Snowflake, we will take 10 million rows from SQL Server and load them into Snowflake using SSIS and <a href=\"https:\/\/zappysys.com\/products\/ssis-powerpack\/\" target=\"_blank\" rel=\"noopener\">ZappySys SSIS PowerPack<\/a>. These SSIS PowerPack connectors will be used to achieve the task:<\/p>\n<div class=\"content_block\" id=\"custom_post_widget-8706\"><div style=\"display: table-row; background: #f7f7f7;\">\r\n<div style=\"display: table-cell; padding: 1em; border: 1px solid #ccc;\"><img loading=\"lazy\" decoding=\"async\" style=\"vertical-align: middle; width: 50px; height: 50px; max-width: 50px;\" src=\"\/\/zappysys.com\/images\/SSIS-PowerPack\/ssis-export-csv-file-task.png\" alt=\"JSON Parser Transform\" width=\"50\" height=\"50\" \/><\/div>\r\n<div style=\"display: table-cell; padding: 1em; border: 1px solid #ccc; border-left: none; width: 100%;\"><a href=\"\/\/zappysys.com\/products\/ssis-powerpack\/ssis-export-csv-file-task\/\" target=\"_blank\" rel=\"noopener\">Export CSV File Task<\/a><\/div>\r\n<\/div><\/div>\n<div class=\"content_block\" id=\"custom_post_widget-2523\"><h2><span id=\"Prerequisites\">Prerequisites<\/span><\/h2>\r\nBefore we perform the steps listed in this article, you will need to make sure the following prerequisites are met:\r\n<ol style=\"margin-left: 1.5em;\">\r\n \t<li><abbr title=\"SQL Server Integration Services\">SSIS<\/abbr> designer installed.\u00a0Sometimes it is referred to as <abbr title=\"Business Intelligence Development Studio\">BIDS<\/abbr> or <abbr title=\"SQL Server Data Tools\">SSDT<\/abbr> (<a href=\"https:\/\/docs.microsoft.com\/en-us\/sql\/ssdt\/download-sql-server-data-tools-ssdt\" target=\"_blank\" rel=\"noopener\">download it from the Microsoft site<\/a>).<\/li>\r\n \t<li>Basic knowledge of SSIS package\u00a0development using\u00a0<em>Microsoft SQL Server Integration Services<\/em>.<\/li>\r\n \t<li>Make sure\u00a0<span style=\"text-decoration: underline;\"><a href=\"https:\/\/zappysys.com\/products\/ssis-powerpack\/\" target=\"_blank\" rel=\"noopener\">ZappySys SSIS PowerPack<\/a><\/span>\u00a0is installed (<a href=\"https:\/\/zappysys.com\/products\/ssis-powerpack\/download\/\" target=\"_blank\" rel=\"noopener\">download it<\/a>, if you haven't already).<\/li>\r\n \t<li>(<em>Optional step<\/em>)<em>.<\/em>\u00a0<a href=\"https:\/\/zappysys.zendesk.com\/hc\/en-us\/articles\/360035974593\" target=\"_blank\" rel=\"noopener\">Read this article<\/a>, if you are planning to deploy packages to a server and schedule their execution later.<\/li>\r\n<\/ol><\/div>\n<h2>Step-by-step &#8211; How to load 10 million rows from SQL Server to Snowflake in 3 minutes<\/h2>\n<h3>Getting started<\/h3>\n<p style=\"text-align: justify;\">To achieve the goal, we will use a slightly modified Northwind database (example database from Microsoft) and SnowSQL &#8211; a command-line tool provided by Snowflake. So in the first steps, you will need to install the Northwind database and SnowSQL. After that, we will proceed to create a table in Snowflake &#8211; a table we will load the data into &#8211; and a file format which will be used to load data from the Snowflake staging area into the destination table. Once that&#8217;s complete, we will proceed in creating an SSIS package, adding and configuring the connectors, and finally running it to get the results. Let&#8217;s proceed!<\/p>\n<h3>Install a Northwind database<\/h3>\n<p>Download and run the creation script of a modified\u00a0<a href=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/Northwind.zip\">Northwind<\/a>\u00a0database. The only thing that was modified is a &#8220;CustomersForSnowflake&#8221; view added which returns 10M rows.<\/p>\n<h3>Install and configure SnowSQL command-line tool<\/h3>\n<p>Download and install SnowSQL; you will find the instructions on how to do that in\u00a0<a href=\"https:\/\/docs.snowflake.net\/manuals\/user-guide\/snowsql-install-config.html\" target=\"_blank\" rel=\"noopener\">https:\/\/docs.snowflake.net\/manuals\/user-guide\/snowsql-install-config.html<\/a>.<\/p>\n<p>Once installed, you will need to configure the default Snowflake account name, user name, and password:<\/p>\n<ol>\n<li>Go to Windows File Explorer and enter this path:<br \/>\n<code>%USERPROFILE%\\.snowsql\\<\/code><br \/>\nUsually, when entered the path looks similar to this one:<br \/>\n<code>C:\\Users\\myUserName\\.snowsql<\/code><\/li>\n<li>Find a file named <strong>config\u00a0<\/strong>and open it.<\/li>\n<li>Then configure your credentials:<\/li>\n<\/ol>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-8587\" src=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/016-sql-server-to-snowflake-configure-snowsql-username.png\" alt=\"\" width=\"712\" height=\"427\" srcset=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/016-sql-server-to-snowflake-configure-snowsql-username.png 712w, https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/016-sql-server-to-snowflake-configure-snowsql-username-300x180.png 300w\" sizes=\"(max-width: 712px) 100vw, 712px\" \/><br \/>\n<div class=\"su-note\"  style=\"border-color:#e5de9d;border-radius:3px;-moz-border-radius:3px;-webkit-border-radius:3px;\"><div class=\"su-note-inner su-u-clearfix su-u-trim\" style=\"background-color:#FFF8B7;border-color:#ffffff;color:#333333;border-radius:3px;-moz-border-radius:3px;-webkit-border-radius:3px;\"><strong>NOTE:<\/strong> When you deploy the package to a production server, instead of using your own user name, enter the username under which you run SSIS packages, e.g. SQL Server Agent&#8217;s account. Username and password can be specified <a href=\"https:\/\/docs.snowflake.net\/manuals\/user-guide\/snowsql-start.html#connection-syntax\" target=\"_blank\" rel=\"noopener\">as arguments<\/a> in a command-line when executing SnowSQL. A\u00a0password can also be specified in <a href=\"https:\/\/docs.snowflake.net\/manuals\/user-guide\/snowsql-start.html#specifying-passwords-when-connecting\" target=\"_blank\" rel=\"noopener\">Environment variables<\/a>.<\/div><\/div>\n<h3>Create a table in Snowflake<\/h3>\n<p>Login to your Snowflake account, open a Worksheet and execute this query:<\/p>\n<pre class=\"lang:tsql decode:true\">create or replace table Customers(\r\nID number,\r\nCustomerID nchar(5),\r\nCompanyName nvarchar(40),\r\nContactName nvarchar(30),\r\nContactTitle nvarchar(30),\r\nAddress nvarchar(60),\r\nCity nvarchar(15),\r\nRegion nvarchar(15),\r\nPostalCode nvarchar(10),\r\nCountry nvarchar(15),\r\nPhone nvarchar(24),\r\nFax nvarchar(24)\r\n)<\/pre>\n<p>&nbsp;<\/p>\n<p>We will load 10M customers from the Northwind database and load them into this table.<\/p>\n<h3>Create a file format in Snowflake<\/h3>\n<p>Then in the same Worksheet create a file format for zipped CSV files by executing this query:<\/p>\n<pre class=\"lang:tsql decode:true \">create or replace file format GzipCsvFormat\r\ntype = csv\r\nfield_delimiter = ','\r\nnull_if = ('NULL', 'null')\r\nempty_field_as_null = true\r\ncompression = gzip\r\nfield_optionally_enclosed_by = '\"'<\/pre>\n<p>&nbsp;<\/p>\n<p>We will use this file format when loading data from a Snowflake stage to the Snowflake destination table. This file format defines CSV format which is used by ZappySys Export CSV Task in SSIS.<\/p>\n<h3>Create an SSIS package<\/h3>\n<p>We are ready to create a new SSIS package and load some data into Snowflake. We are going to use two methods of how we load data into Snowflake. In one method we will load data into Snowflake&#8217;s local storage, while in the second one we will stage data in Amazon S3 bucket. Decide how you want to stage files, and then choose the appropriate workflow when creating a new package:<\/p>\n<div id=\"attachment_8554\" style=\"width: 640px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-8554\" class=\"wp-image-8554 size-full\" src=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/001-sql-server-to-snowflake-create-ssis-package.png\" alt=\"Loading 3 million rows from SQL Server to Snowflake\" width=\"630\" height=\"519\" srcset=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/001-sql-server-to-snowflake-create-ssis-package.png 630w, https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/001-sql-server-to-snowflake-create-ssis-package-300x247.png 300w\" sizes=\"(max-width: 630px) 100vw, 630px\" \/><p id=\"caption-attachment-8554\" class=\"wp-caption-text\">Loading 10 million rows from SQL Server to Snowflake<\/p><\/div>\n<h3>Add &amp; configure ZappySys Export CSV Task<\/h3>\n<p>Firstly, drag and drop ZappySys Export CSV Task from SSIS toolbox and follow the instructions on how to configure it:<\/p>\n<h4>Configure source<\/h4>\n<ol>\n<li>Proceed with configuring the data source, from which you will be exporting data. We will use the Northwind database as an example:\n<div id=\"attachment_8555\" style=\"width: 647px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-8555\" class=\"wp-image-8555 size-full\" style=\"-webkit-user-drag: none; display: inline-block; margin-bottom: -1ex;\" src=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/002-sql-server-to-snowflake-configure-ole-db-source-connection.png\" alt=\"Export CSV Task: configuring OLE DB Connection to export data from SQL Server to Snowflake\" width=\"637\" height=\"292\" srcset=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/002-sql-server-to-snowflake-configure-ole-db-source-connection.png 637w, https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/002-sql-server-to-snowflake-configure-ole-db-source-connection-300x138.png 300w\" sizes=\"(max-width: 637px) 100vw, 637px\" \/><p id=\"caption-attachment-8555\" class=\"wp-caption-text\">Export CSV Task: configuring OLE DB Connection to export data from SQL Server to Snowflake<\/p><\/div><\/li>\n<li>Then move on and select it and enter the query or table name you want to export data from:\n<div id=\"attachment_8557\" style=\"width: 647px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-8557\" class=\"wp-image-8557 size-full\" style=\"-webkit-user-drag: none; display: inline-block; margin-bottom: -1ex;\" src=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/003-sql-server-to-snowflake-configure-sql-query.png\" alt=\"Export CSV Task: configuring source SQL query for data loading from SQL Server to Snowflake\" width=\"637\" height=\"593\" srcset=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/003-sql-server-to-snowflake-configure-sql-query.png 637w, https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/003-sql-server-to-snowflake-configure-sql-query-300x279.png 300w\" sizes=\"(max-width: 637px) 100vw, 637px\" \/><p id=\"caption-attachment-8557\" class=\"wp-caption-text\">Export CSV Task: configuring source SQL query for data loading from SQL Server to Snowflake<\/p><\/div>\n<p>We will be using this query:<br \/>\n<code>select top 10000000 * from CustomersForSnowflake<\/code><\/li>\n<li>Then in the <em>Split Options<\/em> tab split the exported CSV into many files, e.g. into 50 MB chunks:\n<div id=\"attachment_8558\" style=\"width: 508px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-8558\" class=\"wp-image-8558 size-full\" style=\"-webkit-user-drag: none; display: inline-block; margin-bottom: -1ex;\" src=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/007-sql-server-to-snowflake-split-rows.png\" alt=\"Using data split options in the Export CSV Task\" width=\"498\" height=\"309\" srcset=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/007-sql-server-to-snowflake-split-rows.png 498w, https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/007-sql-server-to-snowflake-split-rows-300x186.png 300w, https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/007-sql-server-to-snowflake-split-rows-436x272.png 436w\" sizes=\"(max-width: 498px) 100vw, 498px\" \/><p id=\"caption-attachment-8558\" class=\"wp-caption-text\">Using data split options in the Export CSV Task<\/p><\/div>\n<div class=\"su-note\"  style=\"border-color:#e5de9d;border-radius:3px;-moz-border-radius:3px;-webkit-border-radius:3px;\"><div class=\"su-note-inner su-u-clearfix su-u-trim\" style=\"background-color:#FFF8B7;border-color:#ffffff;color:#333333;border-radius:3px;-moz-border-radius:3px;-webkit-border-radius:3px;\"><strong>NOTE:<\/strong> Snowflake recommends having files that are 10-100 MB in size when <em><span style=\"text-decoration: underline;\">compressed<\/span><\/em>. So it is perfectly safe to configure the value to 100 MB and above.<\/div><\/div><\/li>\n<\/ol>\n<h4>Configure target<\/h4>\n<p>Depending on which staging approach you chose to use, set the export target to a local path or S3 bucket:<\/p>\n<h5>Using local Snowflake storage<\/h5>\n<p>Just set the appropriate <em>Save Mode<\/em> and a file path:<\/p>\n<div id=\"attachment_8693\" style=\"width: 568px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-8693\" class=\"wp-image-8693 size-full\" src=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/006a-sql-server-to-snowflake-configure-local-target-path-to-export-csv-files-to-1.png\" alt=\"Saving files locally to upload them to Snowflake local stage later\" width=\"558\" height=\"534\" srcset=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/006a-sql-server-to-snowflake-configure-local-target-path-to-export-csv-files-to-1.png 558w, https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/006a-sql-server-to-snowflake-configure-local-target-path-to-export-csv-files-to-1-300x287.png 300w\" sizes=\"(max-width: 558px) 100vw, 558px\" \/><p id=\"caption-attachment-8693\" class=\"wp-caption-text\">Saving files locally to upload them to Snowflake local stage later<\/p><\/div>\n<h5>Using S3 storage<\/h5>\n<p>For storing staging files in S3, follow these steps:<\/p>\n<ol>\n<li>Set\u00a0<em>Save Mode<\/em> to <strong>Save to Connection<\/strong> and select <strong>&lt;New ZS-AWS-STORAGE Connection&gt;<\/strong>:\n<div id=\"attachment_8559\" style=\"width: 559px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-8559\" class=\"wp-image-8559 size-full\" src=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/005-sql-server-to-snowflake-configure-s3-target-connection.png\" alt=\"Export CSV Task: configuring Amazon S3 endpoint as the target for data export\" width=\"549\" height=\"355\" srcset=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/005-sql-server-to-snowflake-configure-s3-target-connection.png 549w, https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/005-sql-server-to-snowflake-configure-s3-target-connection-300x194.png 300w\" sizes=\"(max-width: 549px) 100vw, 549px\" \/><p id=\"caption-attachment-8559\" class=\"wp-caption-text\">Export CSV Task: configuring Amazon S3 endpoint as the target for data export<\/p><\/div><\/li>\n<li>Then select <strong>S3<\/strong> as <em>Storage Service<\/em> and fill in <em>Access and Secret Key<\/em>, select your region (optional):\n<div id=\"attachment_8561\" style=\"width: 576px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-8561\" class=\"wp-image-8561 size-full\" src=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/008-sql-server-to-snowflake-configure-s3-target-connection-entering-access-and-secret-keys.png\" alt=\"Configuring Amazon Connection Manager to store staging data in S3\" width=\"566\" height=\"553\" srcset=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/008-sql-server-to-snowflake-configure-s3-target-connection-entering-access-and-secret-keys.png 566w, https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/008-sql-server-to-snowflake-configure-s3-target-connection-entering-access-and-secret-keys-300x293.png 300w\" sizes=\"(max-width: 566px) 100vw, 566px\" \/><p id=\"caption-attachment-8561\" class=\"wp-caption-text\">Configuring Amazon Connection Manager to store staging data in S3<\/p><\/div><\/li>\n<li>Then in the Export CSV Task window, in <strong>Target<\/strong> tab configure it similarly:\n<div id=\"attachment_8698\" style=\"width: 637px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-8698\" class=\"size-full wp-image-8698\" src=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/006-sql-server-to-snowflake-configure-s3-target-path-to-export-csv-files-to-s3-2.png\" alt=\"Export CSV Task: configuring target to store staging data in S3\" width=\"627\" height=\"593\" srcset=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/006-sql-server-to-snowflake-configure-s3-target-path-to-export-csv-files-to-s3-2.png 627w, https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/006-sql-server-to-snowflake-configure-s3-target-path-to-export-csv-files-to-s3-2-300x284.png 300w\" sizes=\"(max-width: 627px) 100vw, 627px\" \/><p id=\"caption-attachment-8698\" class=\"wp-caption-text\">Export CSV Task: configuring target to store staging data in S3<\/p><\/div>\n<p>Another option you may consider is to use <a href=\"https:\/\/zappysys.com\/blog\/ssis-amazon-s3-storage-task-examples-download-upload-move-delete-files-folders\/\">Amazon Storage Task<\/a> or <a href=\"https:\/\/zappysys.com\/products\/ssis-powerpack\/ssis-azure-blob-storage-task\/\">Azure Storage Task<\/a> to upload files to S3 in a separate step after the Export CSV Step. For this perform the following steps.<\/p>\n<ol>\n<li>On the Target tab, set Save Mode to <strong>Save to Path (Local Disk) instead of Connection to S3 or Azure<\/strong>.<\/li>\n<li>Drag &amp; Drop <a href=\"https:\/\/zappysys.com\/blog\/ssis-amazon-s3-storage-task-examples-download-upload-move-delete-files-folders\/\">Amazon Storage Task<\/a> or <a href=\"https:\/\/zappysys.com\/products\/ssis-powerpack\/ssis-azure-blob-storage-task\/\">Azure Storage Task<\/a>\u00a0 and connect with the previous Export CSV Step<\/li>\n<li>Configure Storage Task to upload Local files to S3 or Azure Blob Storage.<\/li>\n<li>Continue to the next section for more instructions.<\/li>\n<\/ol>\n<\/li>\n<\/ol>\n<h3>Add Execute Process Task to create a staging area<\/h3>\n<p>We are ready to add Execute Process Task to create a staging area in Snowflake. Again, depending on where you will store staging files, Snowflake&#8217;s local storage or Amazon S3, use one of the approaches below:<\/p>\n<p><strong>Create Snowflake local staging<\/strong><\/p>\n<div id=\"attachment_8562\" style=\"width: 788px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-8562\" class=\"wp-image-8562 size-full\" src=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/009-sql-server-to-snowflake-configure-snow-sql-to-create-a-stage.png\" alt=\"Creating a local stage in Snowflake using SnowSQL command-line tool and SSIS\" width=\"778\" height=\"314\" srcset=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/009-sql-server-to-snowflake-configure-snow-sql-to-create-a-stage.png 778w, https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/009-sql-server-to-snowflake-configure-snow-sql-to-create-a-stage-300x121.png 300w, https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/009-sql-server-to-snowflake-configure-snow-sql-to-create-a-stage-768x310.png 768w\" sizes=\"(max-width: 778px) 100vw, 778px\" \/><p id=\"caption-attachment-8562\" class=\"wp-caption-text\">Creating a local stage in Snowflake using SnowSQL command-line tool and SSIS<\/p><\/div>\n<p>File path:<\/p>\n<p><code>C:\\Program Files\\Snowflake SnowSQL\\snowsql.exe<\/code><\/p>\n<p>Arguments:<\/p>\n<p><code>-q \"CREATE OR REPLACE STAGE CustomersStaging\" -d DEMO_DB -s Public<\/code><\/p>\n<div class=\"su-note\"  style=\"border-color:#e5de9d;border-radius:3px;-moz-border-radius:3px;-webkit-border-radius:3px;\"><div class=\"su-note-inner su-u-clearfix su-u-trim\" style=\"background-color:#FFF8B7;border-color:#ffffff;color:#333333;border-radius:3px;-moz-border-radius:3px;-webkit-border-radius:3px;\"><strong>NOTE:<\/strong>\u00a0Replace <strong>DEMO_DB<\/strong> with the database name you are using. Also, do the same thing with schema <strong>Public<\/strong>.<\/div><\/div>\n<p><strong>Create Amazon S3 staging<\/strong><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-8563 size-full\" src=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/011-sql-server-to-snowflake-configure-snow-sql-to-create-a-stage-in-s3.png\" alt=\"Creating an Amazon S3 stage in Snowflake using SnowSQL command-line tool and SSIS\" width=\"737\" height=\"314\" srcset=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/011-sql-server-to-snowflake-configure-snow-sql-to-create-a-stage-in-s3.png 737w, https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/011-sql-server-to-snowflake-configure-snow-sql-to-create-a-stage-in-s3-300x128.png 300w\" sizes=\"(max-width: 737px) 100vw, 737px\" \/><\/p>\n<p>Creating an Amazon S3 stage in Snowflake using SnowSQL command-line tool and SSISFile path:<\/p>\n<p><code>C:\\Program Files\\Snowflake SnowSQL\\snowsql.exe<\/code><\/p>\n<p>Arguments:<\/p>\n<p><code>CREATE OR REPLACE STAGE CustomersStaging url='s3:\/\/your-bucket-name\/destinationFolder\/' credentials=(aws_key_id='AKIAXXXXXXXXXXXXXXXX' aws_secret_key='6p1ayaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaLXz88')<\/code><\/p>\n<h3>Add Execute Process Task to upload files to the staging area (local staging approach only)<\/h3>\n<p>We still need to upload CSV files that were saved locally for local Snowflake staging. So add another Execute Process Task and configure it similarly:<\/p>\n<h3><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-8564 size-full\" style=\"font-size: 16px;\" src=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/010-sql-server-to-snowflake-configure-snow-sql-to-put-CSV-files-into-stage.png\" alt=\"Uploading local CSV files to Snowflake stage using SnowSQL command-line tool and SSIS\" width=\"726\" height=\"314\" srcset=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/010-sql-server-to-snowflake-configure-snow-sql-to-put-CSV-files-into-stage.png 726w, https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/010-sql-server-to-snowflake-configure-snow-sql-to-put-CSV-files-into-stage-300x130.png 300w\" sizes=\"(max-width: 726px) 100vw, 726px\" \/><\/h3>\n<p>Uploading local CSV files to Snowflake stage using SnowSQL command-line tool and SSISFile path:<\/p>\n<p><code>C:\\Program Files\\Snowflake SnowSQL\\snowsql.exe<\/code><\/p>\n<p>Arguments:<\/p>\n<p><code>-q \"PUT file:\/\/e:\/temp\/*.csv @DEMO_DB.PUBLIC.CustomersStaging\"<\/code><\/p>\n<div class=\"su-note\"  style=\"border-color:#e5de9d;border-radius:3px;-moz-border-radius:3px;-webkit-border-radius:3px;\"><div class=\"su-note-inner su-u-clearfix su-u-trim\" style=\"background-color:#FFF8B7;border-color:#ffffff;color:#333333;border-radius:3px;-moz-border-radius:3px;-webkit-border-radius:3px;\"><strong>NOTE:<\/strong>\u00a0e:\/temp\/ is a directory we used in Export CSV Task. Replace <strong>DEMO_DB<\/strong> with the database name you are using. Also, do the same thing with schema <strong>Public<\/strong>.<\/div><\/div>\n<h3>Add Execute Process Task to copy files from the Snowflake\/Amazon S3 stage to Snowflake table<\/h3>\n<p>Finally, add the final Execute Process Task to issue a command to load files from the stage into a real Snowflake table:<\/p>\n<div id=\"attachment_8565\" style=\"width: 736px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-8565\" class=\"wp-image-8565 size-full\" src=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/012-sql-server-to-snowflake-configure-snow-sql-to-copy-data-from-stage-to-table.png\" alt=\"Copying data from a staging area to a Snowflake table using SSIS\" width=\"726\" height=\"313\" srcset=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/012-sql-server-to-snowflake-configure-snow-sql-to-copy-data-from-stage-to-table.png 726w, https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/012-sql-server-to-snowflake-configure-snow-sql-to-copy-data-from-stage-to-table-300x129.png 300w\" sizes=\"(max-width: 726px) 100vw, 726px\" \/><p id=\"caption-attachment-8565\" class=\"wp-caption-text\">Copying data from a staging area to a Snowflake table using SSIS<\/p><\/div>\n<p>File path:<\/p>\n<p><code>C:\\Program Files\\Snowflake SnowSQL\\snowsql.exe<\/code><\/p>\n<p>Arguments:<\/p>\n<p><code>-q \"COPY INTO CUSTOMERS FROM @CustomersStaging file_format = (format_name = 'GZIPCSVFORMAT')\" -d DEMO_DB -s Public<\/code><\/p>\n<h3>Execute the package<\/h3>\n<p>We are ready to execute the package, so just run it. In this example you see the workflow when using Amazon S3 as stage:<\/p>\n<div id=\"attachment_8569\" style=\"width: 359px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-8569\" class=\"wp-image-8569 size-full\" src=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/013-sql-server-to-snowflake-execute-the-package.png\" alt=\"Executing an SSIS package to load data from Snowflake to SQL Server\" width=\"349\" height=\"389\" srcset=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/013-sql-server-to-snowflake-execute-the-package.png 349w, https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/013-sql-server-to-snowflake-execute-the-package-269x300.png 269w\" sizes=\"(max-width: 349px) 100vw, 349px\" \/><p id=\"caption-attachment-8569\" class=\"wp-caption-text\">Executing an SSIS package to load data from Snowflake to SQL Server<\/p><\/div>\n<h3>The Results<\/h3>\n<p>Once the package executes, we can check the results:<\/p>\n<div id=\"attachment_8570\" style=\"width: 363px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-8570\" class=\"wp-image-8570 size-full\" src=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/014-sql-server-to-snowflake-the-results-ssis-package.png\" alt=\"Successful execution of SSIS package when loading data from Snowflake to SQL Server\" width=\"353\" height=\"390\" srcset=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/014-sql-server-to-snowflake-the-results-ssis-package.png 353w, https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/014-sql-server-to-snowflake-the-results-ssis-package-272x300.png 272w\" sizes=\"(max-width: 353px) 100vw, 353px\" \/><p id=\"caption-attachment-8570\" class=\"wp-caption-text\">Successful execution of SSIS package when loading data from Snowflake to SQL Server<\/p><\/div>\n<p>If we go to Snowflake and execute the SELECT query, we see all 10M customers loaded:<\/p>\n<div id=\"attachment_8568\" style=\"width: 728px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-8568\" class=\"wp-image-8568 size-full\" src=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/013-sql-server-to-snowflake-the-results.png\" alt=\"Successful loading of 10 million rows from SQL Server to Snowflake using SSIS and ZappySys SSIS PowerPack\" width=\"718\" height=\"396\" srcset=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/013-sql-server-to-snowflake-the-results.png 718w, https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/013-sql-server-to-snowflake-the-results-300x165.png 300w\" sizes=\"(max-width: 718px) 100vw, 718px\" \/><p id=\"caption-attachment-8568\" class=\"wp-caption-text\">Successful loading of 10 million rows from SQL Server to Snowflake using SSIS and ZappySys SSIS PowerPack<\/p><\/div>\n<p>All done in less than 3 mins:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-8702 size-full\" src=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/017-sql-server-to-snowflake-loads-data-in-less-than-3-mins-e1580146280905.png\" alt=\"Loading 10 million rows from SQL Server to Snowflake using SSIS and ZappySys SSIS PowerPack just in 3 minutes\" width=\"717\" height=\"423\" srcset=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/017-sql-server-to-snowflake-loads-data-in-less-than-3-mins-e1580146280905.png 717w, https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/017-sql-server-to-snowflake-loads-data-in-less-than-3-mins-e1580146280905-300x177.png 300w\" sizes=\"(max-width: 717px) 100vw, 717px\" \/><\/p>\n<h2>Conclusion<\/h2>\n<p style=\"text-align: justify;\">We achieved just what we aimed for &#8211; we loaded 10 million rows from SQL Server to Snowflake; all done in less than 3 minutes! Two approaches were taken into consideration: in one we staged CSV files in the local Snowflake stage and in the other we staged files in the Amazon S3 bucket. To accomplish this we used <a href=\"https:\/\/zappysys.com\/products\/ssis-powerpack\/ssis-export-csv-file-task\/\" target=\"_blank\" rel=\"noopener\">ZappySys Export CSV Task<\/a>, which allowed us to export data from the SQL Server view to CSV format, split files into smaller ones, zip them and store them locally or upload to the Amazon S3 bucket. Finally, we used a standard SSIS Task &#8220;Execute Process Task&#8221; to issue Snowflake commands such as creating the stage area in Snowflake, uploading CSVs into the local stage and loading data into the Snowflake table.<\/p>\n<h2>Download a sample package<\/h2>\n<p><a href=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/Load-10M-rows-from-SQL-Server-into-Snowflake-1.zip\">Load 10M rows from SQL Server into Snowflake.dtsx.zip<\/a><\/p>\n<h2>References<\/h2>\n<p><a href=\"https:\/\/docs.snowflake.net\/manuals\/user-guide\/data-load-bulk.html\" target=\"_blank\" rel=\"noopener\">https:\/\/docs.snowflake.net\/manuals\/user-guide\/data-load-bulk.html<\/a><\/p>\n<p><a href=\"https:\/\/docs.snowflake.net\/manuals\/user-guide\/snowsql.html\" target=\"_blank\" rel=\"noopener\">https:\/\/docs.snowflake.net\/manuals\/user-guide\/snowsql.html<\/a><\/p>\n<p><a href=\"https:\/\/docs.snowflake.net\/manuals\/user-guide\/data-load-s3-create-stage.html\" target=\"_blank\" rel=\"noopener\">https:\/\/docs.snowflake.net\/manuals\/user-guide\/data-load-s3-create-stage.html<\/a><\/p>\n<p><a href=\"https:\/\/docs.snowflake.net\/manuals\/sql-reference\/sql\/create-file-format.html\" target=\"_blank\" rel=\"noopener\">https:\/\/docs.snowflake.net\/manuals\/sql-reference\/sql\/create-file-format.html<\/a><\/p>\n<p><a href=\"https:\/\/docs.snowflake.net\/manuals\/sql-reference\/sql\/put.html\" target=\"_blank\" rel=\"noopener\">https:\/\/docs.snowflake.net\/manuals\/sql-reference\/sql\/put.html<\/a><\/p>\n<p><a href=\"https:\/\/docs.snowflake.net\/manuals\/sql-reference\/sql\/copy-into-table.html\" target=\"_blank\" rel=\"noopener\">https:\/\/docs.snowflake.net\/manuals\/sql-reference\/sql\/copy-into-table.html<\/a><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Introduction In this article, we will cover the points on how to load 10 million rows from SQL Server to Snowflake in just 3 minutes. Snowflake is a data warehousing platform that resides in a cloud. Basically, it is a data warehouse software exposed as a service. It allows integrating many data sources via internal [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":8580,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[43,41,99,127,8,9],"tags":[128,22,129,575,48,164],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.3 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\r\n<title>Load 10M rows from SQL Server to Snowflake in 3 minutes | ZappySys Blog<\/title>\r\n<meta name=\"description\" content=\"This article explains how to load 10 million rows from SQL Server to Snowflake in just 3 minutes by using SSIS and ZappySys SSIS PowerPack toolkit.\" \/>\r\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\r\n<link rel=\"canonical\" href=\"https:\/\/zappysys.com\/blog\/load-10-million-rows-from-sql-server-to-snowflake\/\" \/>\r\n<meta property=\"og:locale\" content=\"en_US\" \/>\r\n<meta property=\"og:type\" content=\"article\" \/>\r\n<meta property=\"og:title\" content=\"Load 10M rows from SQL Server to Snowflake in 3 minutes | ZappySys Blog\" \/>\r\n<meta property=\"og:description\" content=\"This article explains how to load 10 million rows from SQL Server to Snowflake in just 3 minutes by using SSIS and ZappySys SSIS PowerPack toolkit.\" \/>\r\n<meta property=\"og:url\" content=\"https:\/\/zappysys.com\/blog\/load-10-million-rows-from-sql-server-to-snowflake\/\" \/>\r\n<meta property=\"og:site_name\" content=\"ZappySys Blog\" \/>\r\n<meta property=\"article:published_time\" content=\"2019-12-17T16:55:54+00:00\" \/>\r\n<meta property=\"article:modified_time\" content=\"2024-07-01T20:47:45+00:00\" \/>\r\n<meta property=\"og:image\" content=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/sql-server-to-snowflake.png\" \/>\r\n\t<meta property=\"og:image:width\" content=\"400\" \/>\r\n\t<meta property=\"og:image:height\" content=\"400\" \/>\r\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\r\n<meta name=\"author\" content=\"ZappySys\" \/>\r\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\r\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"ZappySys\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"11 minutes\" \/>\r\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/zappysys.com\/blog\/load-10-million-rows-from-sql-server-to-snowflake\/\",\"url\":\"https:\/\/zappysys.com\/blog\/load-10-million-rows-from-sql-server-to-snowflake\/\",\"name\":\"Load 10M rows from SQL Server to Snowflake in 3 minutes | ZappySys Blog\",\"isPartOf\":{\"@id\":\"https:\/\/zappysys.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/zappysys.com\/blog\/load-10-million-rows-from-sql-server-to-snowflake\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/zappysys.com\/blog\/load-10-million-rows-from-sql-server-to-snowflake\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/sql-server-to-snowflake.png\",\"datePublished\":\"2019-12-17T16:55:54+00:00\",\"dateModified\":\"2024-07-01T20:47:45+00:00\",\"author\":{\"@id\":\"https:\/\/zappysys.com\/blog\/#\/schema\/person\/c146068d4cb053724ae5ce85759c3ada\"},\"description\":\"This article explains how to load 10 million rows from SQL Server to Snowflake in just 3 minutes by using SSIS and ZappySys SSIS PowerPack toolkit.\",\"breadcrumb\":{\"@id\":\"https:\/\/zappysys.com\/blog\/load-10-million-rows-from-sql-server-to-snowflake\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/zappysys.com\/blog\/load-10-million-rows-from-sql-server-to-snowflake\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/zappysys.com\/blog\/load-10-million-rows-from-sql-server-to-snowflake\/#primaryimage\",\"url\":\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/sql-server-to-snowflake.png\",\"contentUrl\":\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/sql-server-to-snowflake.png\",\"width\":400,\"height\":400},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/zappysys.com\/blog\/load-10-million-rows-from-sql-server-to-snowflake\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/zappysys.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Load 10M rows from SQL Server to Snowflake in 3 minutes\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/zappysys.com\/blog\/#website\",\"url\":\"https:\/\/zappysys.com\/blog\/\",\"name\":\"ZappySys Blog\",\"description\":\"SSIS \/ ODBC Drivers \/ API Connectors for JSON, XML, Azure, Amazon AWS, Salesforce, MongoDB and more\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/zappysys.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/zappysys.com\/blog\/#\/schema\/person\/c146068d4cb053724ae5ce85759c3ada\",\"name\":\"ZappySys\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/zappysys.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/60165d46d0b33aefb91df61a22b0e1f4?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/60165d46d0b33aefb91df61a22b0e1f4?s=96&d=mm&r=g\",\"caption\":\"ZappySys\"},\"url\":\"https:\/\/zappysys.com\/blog\/author\/gliaskus\/\"}]}<\/script>\r\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Load 10M rows from SQL Server to Snowflake in 3 minutes | ZappySys Blog","description":"This article explains how to load 10 million rows from SQL Server to Snowflake in just 3 minutes by using SSIS and ZappySys SSIS PowerPack toolkit.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/zappysys.com\/blog\/load-10-million-rows-from-sql-server-to-snowflake\/","og_locale":"en_US","og_type":"article","og_title":"Load 10M rows from SQL Server to Snowflake in 3 minutes | ZappySys Blog","og_description":"This article explains how to load 10 million rows from SQL Server to Snowflake in just 3 minutes by using SSIS and ZappySys SSIS PowerPack toolkit.","og_url":"https:\/\/zappysys.com\/blog\/load-10-million-rows-from-sql-server-to-snowflake\/","og_site_name":"ZappySys Blog","article_published_time":"2019-12-17T16:55:54+00:00","article_modified_time":"2024-07-01T20:47:45+00:00","og_image":[{"width":400,"height":400,"url":"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/sql-server-to-snowflake.png","type":"image\/png"}],"author":"ZappySys","twitter_card":"summary_large_image","twitter_misc":{"Written by":"ZappySys","Est. reading time":"11 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/zappysys.com\/blog\/load-10-million-rows-from-sql-server-to-snowflake\/","url":"https:\/\/zappysys.com\/blog\/load-10-million-rows-from-sql-server-to-snowflake\/","name":"Load 10M rows from SQL Server to Snowflake in 3 minutes | ZappySys Blog","isPartOf":{"@id":"https:\/\/zappysys.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/zappysys.com\/blog\/load-10-million-rows-from-sql-server-to-snowflake\/#primaryimage"},"image":{"@id":"https:\/\/zappysys.com\/blog\/load-10-million-rows-from-sql-server-to-snowflake\/#primaryimage"},"thumbnailUrl":"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/sql-server-to-snowflake.png","datePublished":"2019-12-17T16:55:54+00:00","dateModified":"2024-07-01T20:47:45+00:00","author":{"@id":"https:\/\/zappysys.com\/blog\/#\/schema\/person\/c146068d4cb053724ae5ce85759c3ada"},"description":"This article explains how to load 10 million rows from SQL Server to Snowflake in just 3 minutes by using SSIS and ZappySys SSIS PowerPack toolkit.","breadcrumb":{"@id":"https:\/\/zappysys.com\/blog\/load-10-million-rows-from-sql-server-to-snowflake\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/zappysys.com\/blog\/load-10-million-rows-from-sql-server-to-snowflake\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/zappysys.com\/blog\/load-10-million-rows-from-sql-server-to-snowflake\/#primaryimage","url":"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/sql-server-to-snowflake.png","contentUrl":"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2019\/12\/sql-server-to-snowflake.png","width":400,"height":400},{"@type":"BreadcrumbList","@id":"https:\/\/zappysys.com\/blog\/load-10-million-rows-from-sql-server-to-snowflake\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/zappysys.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Load 10M rows from SQL Server to Snowflake in 3 minutes"}]},{"@type":"WebSite","@id":"https:\/\/zappysys.com\/blog\/#website","url":"https:\/\/zappysys.com\/blog\/","name":"ZappySys Blog","description":"SSIS \/ ODBC Drivers \/ API Connectors for JSON, XML, Azure, Amazon AWS, Salesforce, MongoDB and more","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/zappysys.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/zappysys.com\/blog\/#\/schema\/person\/c146068d4cb053724ae5ce85759c3ada","name":"ZappySys","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/zappysys.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/60165d46d0b33aefb91df61a22b0e1f4?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/60165d46d0b33aefb91df61a22b0e1f4?s=96&d=mm&r=g","caption":"ZappySys"},"url":"https:\/\/zappysys.com\/blog\/author\/gliaskus\/"}]}},"_links":{"self":[{"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/posts\/8538"}],"collection":[{"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/comments?post=8538"}],"version-history":[{"count":37,"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/posts\/8538\/revisions"}],"predecessor-version":[{"id":11124,"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/posts\/8538\/revisions\/11124"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/media\/8580"}],"wp:attachment":[{"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/media?parent=8538"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/categories?post=8538"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/tags?post=8538"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}