Introduction
This release brings tons of new features and bug fixes. We have added new connectors for Outlook Mail (Office 365), Shopify, SharePoint and JSON / XML / CSV Generator Transform. It fixes important issues with API Destination, CSV Source, JSON Source and Secure FTP Connection Manager. To see full release notes click here
New Features/Improvements
- NEW: Google Analytics Source – Support v4 API (GA4)
- NEW: API Connector – Outlook Mail (Office 365) – New connector to read / download mail and attachments from Office 365 Mail account
- NEW: API Connector – Shopify – Read / Write Shopify data (e.g. Customers, Products, Orders)
- NEW: All Components – Show meaningful error about decimal data corruption when SSIS cannot handle higher Precision / Scale than defined in Column Metadata
- NEW: All Source Components – Increase ErrorMessage column length to 4000 from 1024
- NEW: API Connector – Google BigQuery – Add Job Location Option for get_query and connection Level
- NEW: API Connector Framework – Add Option TreatBodyAsDirectValue (Body parsed as input data rather than calling URL)
- NEW: API Connector Framework – Add Option to name Dynamic Expanded Columns as CamelCase
- NEW: API Connector Framework – Add support for Dynamic ServiceUrl (e.g. MailChimp API usecase)
- NEW: API Connector Framework – Add Support for SingleDataset in LayoutMap (e.g. <settings singledataset=”True”> – Shopify Connector Usecase
- NEW: API Connector Framework – Allow to pass static values for EndPoint parameters tagged with {$rows$} function (Right now it doesnt work if query endpoint rather than Input Rows – usecase like API Destination)
- NEW: API Connector Framework – Allow to Read data From Local File – (Set <EndPoint Url=”c:\data\file.json” or “.xml” or “.csv”)
- NEW: API Connector Framework – Allow to use Png file as Logo
- NEW: API Connector Framework – CData Property (e.g. LayoutMap, Body) or Property not String Type (i.e. Int, Bool) not working if you set in Template as EndPoint Attribute (i.e. <EndPoint IncludeParentColumns=”True” …. > )
- NEW: API Connector Framework – Expose Layout related Properties – DoNotOutputEmptyArrayProperty, DoNotOutputEmptyNestedProperty, DoNotOutputNullProperty, XmlNameSpaces, XmlPrefix, EnableCustomEscapeSequence, CustomEscapeSequenceRule and more
- NEW: API Connector Framework – Generic Request – Make Content-Type and Request Method visible by default
- NEW: API Connector Framework – If LayoutMap not supplied and one of the URL parameters tagged as Functions={$rows$} and EndPoint RequestFormat=Csv then automatically generate LayoutMap to produce single column Csv
- NEW: API Connector Framework – Provide a way to use multiple Templates (e.g. <EndPoint Name=”get_orders” Template=”Order, Pagination” …. ) – Multi Inheritance
- NEW: API Connectors – SharePoint – Drive list is not refreshed when you change Site for upload_file endpoint Parameters UI (grid)
- NEW: API Destination – Do not throw validation error if Input column is mapped and its MapToParam which is required param
- NEW: API Destination – Move operation dropdown under the table selection
- NEW: API Source, API Destination – Show Parameter help link when user selects Parameter grid entry
- NEW: General – Add option to export Mappings on Columns Tab so its ProperCase for API Connector
- NEW: General – Do not output sensitive information in Log when you change LogLevel=Debugging (header name contains Session, Token or Key mask information in log)
- NEW: General – Provide a way to reset prompts on License Manager – Advanced Tab (e.g. Reset DP Scaling Prompt, New Version Found Prompt)
- NEW: JSON / XML / CSV Generator Transform – Add support for DT_NUMERIC and DT_DECIMAL – Use decimal type for higher precision floating point numbers (Decimal Type upto 38 precision / scale)
- NEW: JSON / XML /CSV Source, Amazon S3 / SFTP / Azure CSV, XML , JSON Source – Update notes for Enable Multi Path Mode – Its not clear that we do not allow pattern search when this option is checked
- NEW: JSON Parser Transform, XML Parser Transform – Provide a better message for Memory is locked error due to Blob Type / Large string and MultiCast usage
- NEW: JSON Source, XML Source, CSV Source – Add an option to redirect web exception on error output (right now it fails component rather redirect)
- NEW: MongoDB, PostgreSql, Redshift Connection Manager – Add help link on how to configure SSH Tunnel (Local Port Forward Technique)
- NEW: Reporting Services Task – Add an option to compress file (as Zip) for export / email attachment
- NEW: Reporting Services Task – Allow option to add Password for Exported Zip file and Excel (xlsx / xls)
- NEW: Secure FTP Connection Manager – Add Support for TLS 1.3
- NEW: Secure FTP Task – Rename file to *.partial during download / upload process to indicate partial file (once transfer done change to original name)
- NEW: Upsert Destination – Give option to sort on custom column for Duplicate Handling (i.e. KeepFirst and KeepLast ) – Right now we sort on Key column (we should rather give option to sort on column like LastUpdatedOn)
Bug fixes
- FIX: API Connector Framework – When Direct Placeholder Function used along with [$SomeParam$] in ValueTemplate of InputColumn then it doesnt evaluate for each row (Using Cached Value rather than Row By Row) – Example [$p1]<<{$value$},FUN_BASE64ENC>>
- FIX: API Connector Framework – When nested column under Unbound node found in LayoutMap not supplied you may see bad JSON created
- FIX: API Connector Framework – Zendesk – When you dont supply requestor / comment your create Ticket call might fail
- FIX: API Destination – For Bulk Operation becomes row by row after first request
- FIX: CSV Source – Issue in output while Carriage Return (CR) inside the double quote
- FIX: General – Improve Machine Registration
- FIX: JSON Source – URL Parameter Pagination mode fails in some cases when API doesnt under + as encoded value for space and user supply encoded space in query (e.g. http://abc.com?id=AAA%20BBB )
- FIX: Licensing – Detect Windows 11 as Desktop OS rather than Server OS
- FIX: OAuth Connection Manager – AWS V4 Provider – Variable Placeholder cause issue in HMAC Signature
- FIX: Reporting Services Task – If Send Email / Export File Fails then temp file is not deleted
- FIX: Secure FTP Connection Manager – Add an option EnsureKeyAcceptable to handle error like – A public key corresponding to the supplied private key was not accepted by the server or the user name is incorrect (Send Key First and use UserId, Password Login )