{"id":8626,"date":"2019-12-27T12:33:04","date_gmt":"2019-12-27T12:33:04","guid":{"rendered":"https:\/\/zappysys.com\/blog\/?p=8626"},"modified":"2020-01-06T19:43:37","modified_gmt":"2020-01-06T19:43:37","slug":"download-latest-file-amazon-s3-storage-using-ssis","status":"publish","type":"post","link":"https:\/\/zappysys.com\/blog\/download-latest-file-amazon-s3-storage-using-ssis\/","title":{"rendered":"Download the Latest File from Amazon S3 Storage using SSIS"},"content":{"rendered":"

Introduction<\/span><\/h2>\n

\"Amazon<\/a><\/p>\n

In our previous article, we saw\u00a0SSIS Amazon S3 Storage Task examples<\/a>. Now let’s look at how to Download the Latest File from Amazon S3 Storage using SSIS.\u00a0Microsoft SSIS includes the Amazon S3 Storage Task that allows us to upload files to Amazon S3 Storage, download files, creating local and remote directories an more. In this article, we will show how to use the\u00a0SSIS Amazon S3 Storage task<\/a>\u00a0included in ZappySys\u00a0SSIS PowerPack<\/a>.<\/p>\n

In nutshell,\u00a0this post will focus on how to Download the Latest File from Amazon S3 Storage.<\/p>\n

Prerequisites<\/span><\/h2>\r\nBefore we perform the steps listed in this article, you will need to make sure the following prerequisites are met:\r\n
    \r\n \t
  1. SSIS<\/abbr> designer installed.\u00a0Sometimes it is referred to as BIDS<\/abbr> or SSDT<\/abbr> (download it from the Microsoft site<\/a>).<\/li>\r\n \t
  2. Basic knowledge of SSIS package\u00a0development using\u00a0Microsoft SQL Server Integration Services<\/em>.<\/li>\r\n \t
  3. Make sure\u00a0ZappySys SSIS PowerPack<\/a><\/span>\u00a0is installed (download it<\/a>, if you haven't already).<\/li>\r\n \t
  4. (Optional step<\/em>).<\/em>\u00a0Read this article<\/a>, if you are planning to deploy packages to a server and schedule their execution later.<\/li>\r\n<\/ol><\/div><\/div>\n

    What is Amazon S3 Storage<\/span><\/h2>\n

    Amazon Simple Storage Service (Amazon S3) is an object storage service that offers industry-leading scalability, data availability, security, and performance. This means customers of all sizes and industries can use it to store and protect any amount of data for a range of use cases, such as websites, mobile applications, backup and restore, archive, enterprise applications, IoT devices, and big data analytics. Amazon S3 provides easy-to-use management features so you can organize your data and configure finely-tuned access controls to meet your specific business, organizational, and compliance requirements. Amazon S3 is designed for 99.999999999% (11 9\u2019s) of durability, and stores data for millions of applications for companies all around the world.<\/p>\n

    Getting Started<\/span><\/h2>\n

    In order to start, we will show several examples. ZappySys includes an\u00a0SSIS Amazon S3 Storage Task<\/a>\u00a0that will allow you to access\u00a0files\/folders from Amazon S3 Storage to the Local machine, Upload files(s) to Amazon S3 Storage. It will also support Delete, Rename, List, Get Property, Copy, Move, Create, Set Permission \u2026 and many more operations. Here we are showing you is, How to Download the Latest File from Amazon S3 Storage.<\/p>\n

    Step-By-Step to Download the Latest File from Amazon S3 Storage<\/span><\/h2>\n

    Let\u00b4s start with an example. In this SSIS Amazon S3 Storage Task File task example, we will download the latest file using Amazon S3 Storage Task<\/a>.<\/p>\n

      \n
    1. First\u00a0of All, Drag and Drop Amazon S3 Storage Task from SSIS Toolbox and double click it to edit\n
    2. The following options are available in Amazon S3 Storage Task:\n
    3. You can also overwrite files and folder, skip all, overwrite if the source is older, overwrite if the file size is different, rename files and more:\n
    4. Let’s select the Download Amazon file(s) to local directory<\/strong>. Now select\/add The Source path, Check Recursive Scan(*Optional)<\/em> to get all the sub-files and subfolders and files, after that add Target Path if you want to, This option will download files. In Path AccessMode we can use Direct to write the path directly or to use an SSIS variable.\n
    5. Now go to Advanced Filter & Sorting and configure it like below screen to download the latest file only.\n
    6. That’s it now execute the package and it will download the latest file from the Amazon S3 Storage Task to Local File Machine.<\/li>\n
    7. Sometimes you may need to make advanced filtering on file path, file date, size, etc. for that refer to this article<\/a>\u00a0for more details.<\/li>\n<\/ol>\n

      Conclusion<\/h2>\n

      To conclude, we can say that working with Amazon S3 Storage is now very simple. In this article, we looked at how to Download the Latest File from Amazon S3 Storage using SSIS. We used Adnavced Filtering & sorting option. If you liked the tasks you can start using them by downloading SSIS PowerPack from our web site here<\/a>.<\/p>\n

      Thanks for your time.<\/p>\n

      References<\/h2>\n