{"id":5251,"date":"2018-10-29T21:12:58","date_gmt":"2018-10-29T21:12:58","guid":{"rendered":"https:\/\/zappysys.com\/blog\/?p=5251"},"modified":"2018-10-29T21:12:58","modified_gmt":"2018-10-29T21:12:58","slug":"copy-amazon-s3-files-ssis-different-aws-account","status":"publish","type":"post","link":"https:\/\/zappysys.com\/blog\/copy-amazon-s3-files-ssis-different-aws-account\/","title":{"rendered":"Copy Amazon S3 Files in SSIS to different AWS Account"},"content":{"rendered":"

Introduction<\/h2>\n

In our previous blog we saw how to upload data to Amazon S3<\/a>\u00a0now let’s look at how to Copy Amazon Files from one AWS account to another AWS account (Server Side Copy) using SSIS Amazon Storage Task<\/a>. (Must be version v2.7.9<\/strong> or higher)<\/p>\n

If you are doing file copy within same account then there is no issue. Just use Copy File feature. However if you want to copy between multiple AWS Accounts (e.g. Your Company AWS account to Vendor AWS Account) then you have to perform extra steps.<\/p>\n

Prerequisites<\/span><\/h2>\r\nBefore we perform the steps listed in this article, you will need to make sure the following prerequisites are met:\r\n
    \r\n \t
  1. SSIS<\/abbr> designer installed.\u00a0Sometimes it is referred to as BIDS<\/abbr> or SSDT<\/abbr> (download it from the Microsoft site<\/a>).<\/li>\r\n \t
  2. Basic knowledge of SSIS package\u00a0development using\u00a0Microsoft SQL Server Integration Services<\/em>.<\/li>\r\n \t
  3. Make sure\u00a0ZappySys SSIS PowerPack<\/a><\/span>\u00a0is installed (download it<\/a>, if you haven't already).<\/li>\r\n \t
  4. (Optional step<\/em>).<\/em>\u00a0Read this article<\/a>, if you are planning to deploy packages to a server and schedule their execution later.<\/li>\r\n<\/ol><\/div>\n

    Amazon S3 File Copy Scenario<\/h2>\n

    Now let’s think about a scenario where you have to copy some files from Account-A to Account-B. Account-B can be owned by totally different company (may be your Vendor) and you don’t have security control of it.<\/p>\n

    Before we can copy from Account-A to Account-B we first have to Configure permissions in Account-B. Basically when you use SSIS S3 Task for Copy operation it uses Source account (i.e. Account-A) to push files to destination account (Account-B). So you have Allow write permission for Source Account-A in Destination AWS Bucket (i.e. Account-B).<\/p>\n

    Find Canonical ID of Source Account<\/h2>\n
      \n
    1. First login to Account-A and findout Canonical ID (Usually 64-digit long)<\/li>\n
    2. To get Canonical ID click on Your Account Name<\/strong> > My Security Credentials<\/strong><\/li>\n
    3. When prompted click Continue to Security Credentials<\/strong> option.<\/li>\n
    4. Expand Account Identifier and copy Canonical ID\n
      \"How<\/a>

      How to find AWS Account ID and Canonical User ID<\/p><\/div><\/li>\n<\/ol>\n

      Configure Target S3 Bucket Permissions to allow Source Account (Write Access)<\/h2>\n

      Now once you have Source account Canonical User ID, you can proceed to next step.<\/p>\n

        \n
      1. Log in to Target account (i.e. Account B). Where you like to copy files.<\/li>\n
      2. Go to S3 Area and Click on the target bucket where you like to copy files<\/li>\n
      3. Go to Security Tab<\/li>\n
      4. Add Source Account Canonical ID and Check Write Permission<\/strong> (List is Optional for most).\n
        \"Give<\/a>

        Give Write permission in Target AWS S3 Bucket (Enter Amazon Source Account Canonical User ID)<\/p><\/div><\/li>\n<\/ol>\n

        Copy Amazon S3 Files from one Account Bucket to Another<\/h2>\n

        Now once you configure permission on target bucket. We are ready to execute Amazon S3 File Copy Operation in SSIS<\/p>\n

          \n
        1. Open SSIS Package in Visual Studio<\/li>\n
        2. Drag ZS Amazon Storage Task from SSIS Toolbox<\/li>\n
        3. Double click it to configure<\/li>\n
        4. Select Copy File Operation from Action Dropdown<\/li>\n
        5. Click New for Source Connection (Enter Source Account Credentials). Click Test and OK to save.<\/li>\n
        6. Now Click Browse to Select Source Files you like to Copy. You can use Wild card pattern for multiple file copy.
          \nExample:\u00a0\u00a0mysourcebucket\/subfolder\/localsubfile*.csv<\/strong><\/li>\n
        7. Click New for Target Connection (Enter Target Account Credentials). Click Test and OK to save.<\/li>\n
        8. Now Click Browse to Select Target Folder Location where you like to Save Copied files.
          \nExample:\u00a0\u00a0mytargetbucket\/somefolder\/<\/strong><\/li>\n
        9. Click OK to Save<\/li>\n
        10. Execute SSIS Package to test<\/li>\n<\/ol>\n
          \"Copy<\/a>

          Copy Amazon S3 Files using SSIS (Copy Files between multiple Amazon Accounts \/ S3 Buckets)<\/p><\/div>\n

          Conclusion<\/span><\/h2>\n

          In this post you have seen how easy it is to copy S3 Files between multiple AWS accounts in few clicks.\u00a0Try SSIS PowerPack<\/a>\u00a0for free and\u00a0find out yourself how easy it is to Automate Amazon S3 related operations in SSIS.<\/p>\n

           <\/p>\n","protected":false},"excerpt":{"rendered":"

          Introduction In our previous blog we saw how to upload data to Amazon S3\u00a0now let’s look at how to Copy Amazon Files from one AWS account to another AWS account (Server Side Copy) using SSIS Amazon Storage Task. (Must be version v2.7.9 or higher) If you are doing file copy within same account then there […]<\/p>\n","protected":false},"author":1,"featured_media":5263,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[181],"tags":[29,35],"yoast_head":"\r\nCopy Amazon S3 Files in SSIS to different AWS Account | ZappySys Blog<\/title>\r\n<meta name=\"description\" content=\"Copy Amazon S3 Files using SSIS. Configure S3 Bucket Permission to allow intra-account file copy. We will see how to use SSIS Amazon Storage Task for Copy\" \/>\r\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\r\n<link rel=\"canonical\" href=\"https:\/\/zappysys.com\/blog\/copy-amazon-s3-files-ssis-different-aws-account\/\" \/>\r\n<meta property=\"og:locale\" content=\"en_US\" \/>\r\n<meta property=\"og:type\" content=\"article\" \/>\r\n<meta property=\"og:title\" content=\"Copy Amazon S3 Files in SSIS to different AWS Account | ZappySys Blog\" \/>\r\n<meta property=\"og:description\" content=\"Copy Amazon S3 Files using SSIS. Configure S3 Bucket Permission to allow intra-account file copy. We will see how to use SSIS Amazon Storage Task for Copy\" \/>\r\n<meta property=\"og:url\" content=\"https:\/\/zappysys.com\/blog\/copy-amazon-s3-files-ssis-different-aws-account\/\" \/>\r\n<meta property=\"og:site_name\" content=\"ZappySys Blog\" \/>\r\n<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/ZappySys\/\" \/>\r\n<meta property=\"article:published_time\" content=\"2018-10-29T21:12:58+00:00\" \/>\r\n<meta property=\"og:image\" content=\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2018\/10\/amazon-aws-get-canonical-user-id-for-account.png\" \/>\r\n\t<meta property=\"og:image:width\" content=\"837\" \/>\r\n\t<meta property=\"og:image:height\" content=\"588\" \/>\r\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\r\n<meta name=\"author\" content=\"ZappySys\" \/>\r\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\r\n<meta name=\"twitter:creator\" content=\"@https:\/\/twitter.com\/zappysys\/\" \/>\r\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"ZappySys\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\r\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/zappysys.com\/blog\/copy-amazon-s3-files-ssis-different-aws-account\/\",\"url\":\"https:\/\/zappysys.com\/blog\/copy-amazon-s3-files-ssis-different-aws-account\/\",\"name\":\"Copy Amazon S3 Files in SSIS to different AWS Account | ZappySys Blog\",\"isPartOf\":{\"@id\":\"https:\/\/zappysys.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/zappysys.com\/blog\/copy-amazon-s3-files-ssis-different-aws-account\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/zappysys.com\/blog\/copy-amazon-s3-files-ssis-different-aws-account\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2018\/10\/amazon-aws-get-canonical-user-id-for-account.png\",\"datePublished\":\"2018-10-29T21:12:58+00:00\",\"dateModified\":\"2018-10-29T21:12:58+00:00\",\"author\":{\"@id\":\"https:\/\/zappysys.com\/blog\/#\/schema\/person\/2756c237457fbc95d82cb38962f81f82\"},\"description\":\"Copy Amazon S3 Files using SSIS. Configure S3 Bucket Permission to allow intra-account file copy. We will see how to use SSIS Amazon Storage Task for Copy\",\"breadcrumb\":{\"@id\":\"https:\/\/zappysys.com\/blog\/copy-amazon-s3-files-ssis-different-aws-account\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/zappysys.com\/blog\/copy-amazon-s3-files-ssis-different-aws-account\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/zappysys.com\/blog\/copy-amazon-s3-files-ssis-different-aws-account\/#primaryimage\",\"url\":\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2018\/10\/amazon-aws-get-canonical-user-id-for-account.png\",\"contentUrl\":\"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2018\/10\/amazon-aws-get-canonical-user-id-for-account.png\",\"width\":837,\"height\":588,\"caption\":\"How to find AWS Account ID and Canonical User ID\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/zappysys.com\/blog\/copy-amazon-s3-files-ssis-different-aws-account\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/zappysys.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Copy Amazon S3 Files in SSIS to different AWS Account\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/zappysys.com\/blog\/#website\",\"url\":\"https:\/\/zappysys.com\/blog\/\",\"name\":\"ZappySys Blog\",\"description\":\"SSIS \/ ODBC Drivers \/ API Connectors for JSON, XML, Azure, Amazon AWS, Salesforce, MongoDB and more\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/zappysys.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/zappysys.com\/blog\/#\/schema\/person\/2756c237457fbc95d82cb38962f81f82\",\"name\":\"ZappySys\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/zappysys.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/5c9be148088ba9b8af8e955c5f7c22b5?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/5c9be148088ba9b8af8e955c5f7c22b5?s=96&d=mm&r=g\",\"caption\":\"ZappySys\"},\"sameAs\":[\"http:\/\/www.zappysys.com\/\",\"https:\/\/www.facebook.com\/ZappySys\/\",\"https:\/\/twitter.com\/https:\/\/twitter.com\/zappysys\/\"],\"url\":\"https:\/\/zappysys.com\/blog\/author\/admin\/\"}]}<\/script>\r\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Copy Amazon S3 Files in SSIS to different AWS Account | ZappySys Blog","description":"Copy Amazon S3 Files using SSIS. Configure S3 Bucket Permission to allow intra-account file copy. We will see how to use SSIS Amazon Storage Task for Copy","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/zappysys.com\/blog\/copy-amazon-s3-files-ssis-different-aws-account\/","og_locale":"en_US","og_type":"article","og_title":"Copy Amazon S3 Files in SSIS to different AWS Account | ZappySys Blog","og_description":"Copy Amazon S3 Files using SSIS. Configure S3 Bucket Permission to allow intra-account file copy. We will see how to use SSIS Amazon Storage Task for Copy","og_url":"https:\/\/zappysys.com\/blog\/copy-amazon-s3-files-ssis-different-aws-account\/","og_site_name":"ZappySys Blog","article_author":"https:\/\/www.facebook.com\/ZappySys\/","article_published_time":"2018-10-29T21:12:58+00:00","og_image":[{"width":837,"height":588,"url":"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2018\/10\/amazon-aws-get-canonical-user-id-for-account.png","type":"image\/png"}],"author":"ZappySys","twitter_card":"summary_large_image","twitter_creator":"@https:\/\/twitter.com\/zappysys\/","twitter_misc":{"Written by":"ZappySys","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/zappysys.com\/blog\/copy-amazon-s3-files-ssis-different-aws-account\/","url":"https:\/\/zappysys.com\/blog\/copy-amazon-s3-files-ssis-different-aws-account\/","name":"Copy Amazon S3 Files in SSIS to different AWS Account | ZappySys Blog","isPartOf":{"@id":"https:\/\/zappysys.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/zappysys.com\/blog\/copy-amazon-s3-files-ssis-different-aws-account\/#primaryimage"},"image":{"@id":"https:\/\/zappysys.com\/blog\/copy-amazon-s3-files-ssis-different-aws-account\/#primaryimage"},"thumbnailUrl":"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2018\/10\/amazon-aws-get-canonical-user-id-for-account.png","datePublished":"2018-10-29T21:12:58+00:00","dateModified":"2018-10-29T21:12:58+00:00","author":{"@id":"https:\/\/zappysys.com\/blog\/#\/schema\/person\/2756c237457fbc95d82cb38962f81f82"},"description":"Copy Amazon S3 Files using SSIS. Configure S3 Bucket Permission to allow intra-account file copy. We will see how to use SSIS Amazon Storage Task for Copy","breadcrumb":{"@id":"https:\/\/zappysys.com\/blog\/copy-amazon-s3-files-ssis-different-aws-account\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/zappysys.com\/blog\/copy-amazon-s3-files-ssis-different-aws-account\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/zappysys.com\/blog\/copy-amazon-s3-files-ssis-different-aws-account\/#primaryimage","url":"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2018\/10\/amazon-aws-get-canonical-user-id-for-account.png","contentUrl":"https:\/\/zappysys.com\/blog\/wp-content\/uploads\/2018\/10\/amazon-aws-get-canonical-user-id-for-account.png","width":837,"height":588,"caption":"How to find AWS Account ID and Canonical User ID"},{"@type":"BreadcrumbList","@id":"https:\/\/zappysys.com\/blog\/copy-amazon-s3-files-ssis-different-aws-account\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/zappysys.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Copy Amazon S3 Files in SSIS to different AWS Account"}]},{"@type":"WebSite","@id":"https:\/\/zappysys.com\/blog\/#website","url":"https:\/\/zappysys.com\/blog\/","name":"ZappySys Blog","description":"SSIS \/ ODBC Drivers \/ API Connectors for JSON, XML, Azure, Amazon AWS, Salesforce, MongoDB and more","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/zappysys.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/zappysys.com\/blog\/#\/schema\/person\/2756c237457fbc95d82cb38962f81f82","name":"ZappySys","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/zappysys.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/5c9be148088ba9b8af8e955c5f7c22b5?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/5c9be148088ba9b8af8e955c5f7c22b5?s=96&d=mm&r=g","caption":"ZappySys"},"sameAs":["http:\/\/www.zappysys.com\/","https:\/\/www.facebook.com\/ZappySys\/","https:\/\/twitter.com\/https:\/\/twitter.com\/zappysys\/"],"url":"https:\/\/zappysys.com\/blog\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/posts\/5251"}],"collection":[{"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/comments?post=5251"}],"version-history":[{"count":1,"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/posts\/5251\/revisions"}],"predecessor-version":[{"id":5266,"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/posts\/5251\/revisions\/5266"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/media\/5263"}],"wp:attachment":[{"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/media?parent=5251"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/categories?post=5251"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/zappysys.com\/blog\/wp-json\/wp\/v2\/tags?post=5251"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}