The post Product release announcements have been moved to the Community Site appeared first on ZappySys Blog.

This release brings tons of new features and bug fixes. We have added new connectors for CosmosDB, Azure DevOps (TFS), ServiceNow, MailChimp, API Drivers and Data Gateway. It includes many enhancements around All Drivers and JSON / XML / CSV Driver.

To see full release notes click here

New Features/Improvements

• NEW: API Driver – CosmosDB – New connector to Read / Write / Query documents and other objects (e.g. Database, Containers)
• NEW: API Driver – Azure DevOps (TFS) – New connector to Read / Write / Query items (e.g. Tasks, Bugs, User Story)
• NEW: API Driver – ServiceNow – New connector to Read / Write / Query tables (e.g. Incidents, Tasks, Users)
• NEW: API Driver – MailChimp – New connector to Read / Write / Query MailChimp data (e.g. Campaigns, Lists, Subscribes, Reports)
• NEW: All API Drivers – Allow bool as alias for boolean type in META clause (e.g. META=’flag: bool’)
• NEW: All API Drivers – Allow just column names without datatype in Meta – use string(2000) as default if type missing (e.g. select * from tbl WITH(META=’col1;col2;col4;col5:int;col6:string(100)’) )
• NEW: Amazon JSON / XML /CSV Driver – Update AWS SDK (Core Driver to v3.7)
• NEW: API Connector Framework – Add Support for Multiple LookupEndPoints based on Parameter count (LookupEndPoint=”ep_by_customerid, ep_by_orderid”)
• NEW: API Driver – HubSpot – Add Upload File endpoint
• NEW: Data Gateway – Encrypt Setting File with user defined password
• NEW: General – Update Client Side Query Engine to v3.40
• NEW: JDBC Bridge Driver – Add logging
• NEW: JSON / XML / CSV Driver – Add option to Create new API Connector File from UI settings on the Preview Tab
• NEW: JSON / XML / CSV Driver – Add support for reading *.tar.gzip file (multiple files in one tar.gzip)
• NEW: JSON / XML / CSV Driver – ClientCertificate not supported if you change SslVersion settings other than Default

Bug fixes

• FIX: All API Drivers – Certain errors not bubbled up to the caller application
• FIX: All API Drivers – When META is set to int, bool, date and you encounter blank data then it throws error about conversion (we should treat blank number, date, bool as null) – Error Input string was not in a correct format.
• FIX: All Drivers – Misleading error is thrown (Value cannot be null) when you run Stored Proc which has syntax issue (i.e. not starting with CREATE PROC statement)
• FIX: All Drivers – Duplicate column names in SELECT cause misleading error (Item Key already added)
• FIX: All Drivers – More than 900 columns throws error – too many SQL variables
• FIX: All Drivers – Preview Tab shows duplicate entries in Table dropdown if you click Dropdown multiple times too quick
• FIX: All Drivers – View Metadata shows wrong code for API Connector XML option (Rather than DataType=xx , it shows Type=xx)
• FIX: API Driver – Always Treat Blank Number, Date, Bool as Null is not working
• FIX: API Driver – Delete / Update clause does not set Table Parameters from WITH clause
• FIX: API Driver – Limit rows coming back from WHERE clause in Update / Delete in Preview (Honor Max Rows setting)
• FIX: JDBC Bridge Driver – Cache Settings not saved
• FIX: JDBC Bridge Driver – Stored Proc doesnt return output
• FIX: JSON / XML / CSV Driver – Direct String option not saved and only works if you use WITH (DATA=xxxx) in SQL, UI option ignored
• FIX: JSON / XML / CSV Drivers – Value for Direct Data and Keep Date As String Option not saved
• FIX: JSON, XML , CSV Driver – Placeholder function doesnt work in URL / Body / Headers (When entered on UI) – Works ok if you override in WITH Clause SRC
• FIX: JSON, XML Driver – Curly bracket in comment section cause error when URL JOIN (e.g. JOIN_1 in WITH ) feature is used – Error – Input string was not in a correct format

The post ODBC PowerPack 1.8.0 released appeared first on ZappySys Blog.

This release brings tons of new features and bug fixes. We have added new connectors for Outlook Mail (Office 365), Shopify, Google BigQuery, JDBC Bridge Driver and JSON / CSV / XML Driver.

To see full release notes click here

New Features/Improvements

• NEW: API Driver – Outlook Mail (Office 365) – New connector to read / download mail and attachments from Office 365 Mail account
• NEW: API Driver – Shopify – New Connector to Read / Write Shopify data (e.g. Customers, Products, Orders)
• NEW: API Connector – Google BigQuery – Add Job Location Option for get_query and connection Level
• NEW: API Connector Framework – Add Option TreatBodyAsDirectValue (Body parsed as input data rather than calling URL)
• NEW: API Connector Framework – Allow to Read data From Local File – (Set <EndPoint Url=”c:\data\file.json” or “.xml” or “.csv”)
• NEW: API Connector Framework – Generic Request – Make Content-Type and Request Method visible by default
• NEW: General – Add API Connector format in View Metadata dialog box
• NEW: JDBC Bridge Driver – Check Java found – If missing then Download JRE in single click
• NEW: JDBC Bridge Driver – Replace Named Pipes to Socket to avoid orphan process / hang / access denied / timeout issues
• NEW: JSON / CSV / XML Driver – Add an option to support high precision / scale decimal numbers (more than 15 digits numbers)
• NEW: JSON, CSV, XML Driver – Add Support for high precision decimal numbers (New Option under Date/Number Handling)

Bug fixes

• FIX: API Connector Framework – When Direct Placeholder Function used along with [$SomeParam$] in ValueTemplate of InputColumn then it doesnt evaluate for each row (Using Cached Value rather than Row By Row) – Example [$p1]<<{$value$},FUN_BASE64ENC>>
• FIX: API Connector Framework – When Key column not declared in InputColumns – Delete / Update might fail – error near “from” ()
• FIX: API Connector Framework – When nested column under Unbound node found in LayoutMap not supplied you may see bad JSON created
• FIX: API Connector Framework – Zendesk – When you dont supply requestor / comment your create Ticket call might fail
• FIX: API Driver – When WHERE clause not supplied DELETE / UPDATE doesnt do anything
• FIX: Data Gateway – CAL is taken by unwanted callers even they are not logged in
• FIX: Data Gateway – Existing connections created before v1.6.0 corrupted (Before Aug 10, 2022)
• FIX: Data Gateway – IP Filter Rules not working for multiple conditions
• FIX: General – Click on Activate License throws misleading error if activation fails – It says could not load file or assembly Rebex.Http
• FIX: General – Preview window Trims error message to 1024 characters
• FIX: JSON Driver, XML Driver – When nested filter used (e.g. $.customers[*].orders ) along with IncludeParentColumns option not working sometimes (Throws error or shows wrong value for parent column)

The post ODBC PowerPack 1.7.0 released appeared first on ZappySys Blog.

This release brings some of new features and had many bug fixes.

To see full release notes click here

New Features/Improvements

• NEW: All Drivers – Add support for Turkey (tr-TR) and Azerbaijani (az-Cyrl) environment
• NEW: JDBC Bridge Driver – Change Driver name from “Jdbc Bridge” to “JDBC Bridge”

Bug fixes

• FIX: All Drivers – Load Connection Settings can only accept string upto 32KB – Longer settings cannot be loaded (Truncated)
• FIX: All Drivers – Load Settings might throw error if new line found – Error-Invalid ConnectionString format. Name value pair is missing for [ newline ]
• FIX: All Drivers – Logging feature is not working as expected sometime (Some Log entries not found in File)
• FIX: API Driver – BigQuery – Data Fetch Request Fired two times
• FIX: API Driver – Query Builder generated SQL for Generic_Request endpoint does not work correctly when you pass Body / Headers (renaming RequestData, RequestMethod works)
• FIX: API Driver, Excel Driver – LogPath, LoggingLevel is not applied correctly via Odbc ConnectionString
• FIX: JDBC Bridge Driver – Copy ConnectionString (without Password) option copies password
• FIX: JDBC Bridge Driver – For some JDBC Views not reported in the Dropdown (Preview Tab) – Problem in Infor JDBC
• FIX: JDBC Bridge Driver – In some apps (like VS Solution Explorer) – Tables / Views / Procs not reported
• FIX: JDBC Bridge Driver – java.exe process is not released from memory in some cases (e.g. Power BI Desktop)
• FIX: JDBC Bridge Driver – Object reference not set error in log when JDBC driver throws error
• FIX: JDBC Bridge Driver, API Driver – Wrong Catalog name is used
• FIX: Salesforce Driver – When you call INSERT with EnableBulkMode you may get error – Could not load file or assembly ZappySys.Json
• FIX: SFTP / Azure Blob Drivers (for CSV / JSON / XML) – You may get error – Could not load file or assembly ZappySys.Json on UI load or execution
• FIX: SFTP CSV / XML / JSON Driver – Detailed Log is not produced

The post ODBC PowerPack 1.6.3 released appeared first on ZappySys Blog.

This release brings some of new features and bug fixes.

To see full release notes click here

New Features/Improvements

• NEW: API Driver – Allow placeholders in ValueTemplate property for Columns with Dynamic Expand option set to true
• NEW: API Driver – Use example values from Input Columns to generate CRUD statements if Connector file supports it
• NEW: API Driver – Zendesk – Show all custom fields when you query Tickets (Previous approach was limited to 5 fields only)
• NEW: API Driver – Zendesk – Update Read Tickets (Incremental) endpoint to support functions in Start Time Parameter. Now you can use date time function (i.e. yesterday, monthstart etc) along with static date (i.e. 2021-01-01 or 2021-01-01 23:59:59) to set
• NEW: Salesforce Driver – Provide an option to supply API Version for Bulk / SOAP API (Right now BULK API version is hardcoded and no way to change, SOAP also same way but work around is there to change Service Type=Other)
• NEW: Salesforce Driver – Update API Version to 55.0 for SOAP and Bulk API to take advantage of new features

Bug fixes

• FIX: API Driver – Some properties like Functions, ValueTemplate, Order, Label etc doesnt work in Param Template
• FIX: API Driver – Stripe – Update endpoints to for date time as input / output rather than Unix timestamp

The post ODBC PowerPack 1.6.2 released appeared first on ZappySys Blog.

This release brings tons of new features and bug fixes. We have added a new connector for Youtube, Stripe, Zoom, Amazon Ads, ManageEngine ServiceDesk Plus and for support add HubSpot and SharePoint.

To see full release notes click here

New Features/Improvements

• NEW: API Driver – Youtube – New connector to read, search Videos / Playlists and other information (like, view, share, title, watch time etc)
• NEW: API Driver – Stripe – New connector to read / write Customers, Orders, Invoices, Products, Subscriptions and more
• NEW: API Driver – Zoom – New connector to read Meetings, Webinars, Attendees and other information from Zoom Service
• NEW: API Driver – Amazon Ads – New connector to read reports for Amazon Ads Account
• NEW: API Driver – ManageEngine ServiceDesk Plus- New Connector to read data from Requests, Tasks, Notes, Worklog and more
• NEW: API Driver – HubSpot – Add support for PrivateApp Authentication (Using Static Access Token)
• NEW: API Driver – SharePoint – Added support for Managed Metadata fields (Show Label, WssId and TermGuid)
• NEW: General – Show user friendly license error when either valid license not found or its expired

Bug fixes

• FIX: All API Drivers – Duplicate Custom Objects entries listed sometimes on Preview Table for Table dropdown
• FIX: All API Drivers – WaitTimeMs conflicts with other property, RetryMode appears twice
• FIX: All Drivers – After you preview 100 queries you start getting error – capacity was less than the current size
• FIX: All Drivers – Generated query should quote around name if it contains @ char
• FIX: All Drivers – Saving Metadata option not working
• FIX: All Drivers – When you use parenthesis or some other invalid chars in DSN names it throws error
• FIX: API Driver – OAuth Generate Token button remains disabled in some cases also not showing count down
• FIX: General – WHERE clause not invoked when called from SELECT * INTO
• FIX: JDBC Bridge Driver – BigInteger error
• FIX: JDBC Bridge Driver – If you choose object with space in the name from non default schema – you might get error – Incorrect syntax near
• FIX: JDBC Bridge Driver – Metadata for string columns not reported correctly (Length always zero)
• FIX: JDBC Bridge Driver – Numeric values might fails to import in apps like SSIS
• FIX: JDBC Bridge Driver – Some datatypes not handled correct way (e.g. variant in MSSQL)
• FIX: ODBC SFTP JSON / XML / CSV Driver – You may get Object must be the same type as the enum error when you click on preview tab (It only happens if DSN not saved)

The post ODBC PowerPack 1.6.1 released appeared first on ZappySys Blog.

This release brings tons of new features and bug fixes. We have added new connectors for CosmosDB, Azure DevOps (TFS), ServiceNow, MailChimp, HubSpot, JIRA, Zoho and REST API Task. It fixes important issues with connectors for Youtube, SharePoint and XML / CSV Source. To see full release notes click here

New Features/Improvements

• NEW: API Connector – CosmosDB – New connector to Read / Write / Query documents and other objects (e.g. Database, Containers)
• NEW: API Connector – Azure DevOps (TFS) – New connector to Read / Write / Query items (e.g. Tasks, Bugs, User Story)
• NEW: API Connector – ServiceNow – New connector to Read / Write / Query tables (e.g. Incidents, Tasks, Users)
• NEW: API Connector – MailChimp – New connector to Read / Write / Query MailChimp data (e.g. Campaigns, Lists, Subscribes, Reports)
• NEW: All Components – Sort Used columns on [A-Z] or [Z-A] button click
• NEW: Amazon Redshift Data Transfer Task – Add support for Redshift Serverless
• NEW: Amazon Storage Connection – Add logic to handle Retry on IllegalLocationConstraintException (UseRegionSpecificEndPoint Advanced option checked but wrong region selected)
• NEW: Amazon Storage Task – Add new action to read Tags for S3 Files (GetAmazonFileTags)
• NEW: Amazon Storage Task – Add option to set Tags for S3 File Upload
• NEW: Amazon Storage Task, Azure Storage Task – Allow to use Variable Placeholders in Metadata
• NEW: API Connection Manager – Automatically Set TrustedDomains on REST Connection UI when user loads Custom Connector File from local path first time (Prompt User)
• NEW: API Connector – Google Drive – Always show Query parameter (Search Criteria) and show common examples in the dropdown
• NEW: API Connector – HubSpot – Add Upload File endpoint
• NEW: API Connector – JIRA – Add OAuth support for authentication
• NEW: API Connector – JIRA – Add support for custom fields with Paragraph datatype
• NEW: API Connector – JIRA – Add support for selecting which custom_fileds you like to output on connection UI or on endpoint level
• NEW: API Connector – JIRA – Improve speed of fetching data by 2x (also reduce number of requests by enhancing last page detection logic)
• NEW: API Connector – SharePoint – Add ‘Filter’ parameter to ‘get_list_items’ and ‘get_list_items_dynamic’ endpoints
• NEW: API Connector – Zoho – Updates to DELETE, SEARCH endpoints
• NEW: API Connector Framework – Add OptionsEndPointSortBy to allow sort by expression for Select Dropdown (e.g. Column1 ASC, Column2 DESC)
• NEW: API Connector Framework – Add Support for DefaultValue in Param / Column (so when Value is blank it will return DefaultValue and ignore ValueTemplate / Functions property)
• NEW: API Connector Framework – Allow <Table Order=”-1″ Expand=”True”… > So you can sort dynamically expanded list by name
• NEW: API Connector Framework – Allow ColumnInfoMap in <Column> Tag to use DataType lookup by field value (equal, contains, regex match)
• NEW: API Connector Framework – Allow Multiple columns in OptionEndPointLabel using comma separated (e.g. ProjectId,FieldName)
• NEW: API Connector Framework – Allow Multiple Filters to join result from multiple arrays e.g. Filter=”$new_rows[*]” ExtraFilters=”$updated_rows[*] :: $error_rows[*]” and ExtraFilterColumns=”Op=New::Op=Updated::Op=Error”
• NEW: API Connector Framework – Allow Parameters in Filter Property (e.g. Filter=”$.[$param$][*]”)
• NEW: API Connector Framework – Allow to disable Table Expand (DoNotValidateTableName)
• NEW: API Connector Framework – For Write Operations (INSERT, UPDATE) – Allow to use Direct Placeholder Functions in Body / URL (right now it only works when Parameter usage found in body, it doesnt work if you do Body={ data : “<<{$rows$},FUN_BASE64ENC>>” } )
• NEW: API Connector Framework – Use EndPoint Parameters with Default when Columns are expanded and no overrides found with parameter name used in DataEndPointParameters
• NEW: Azure Storage Task – Add new action to read Tags for Blob (GetAzureBlobTags)
• NEW: Azure Storage Task – Add option to set Tags for Blob Upload
• NEW: Azure Storage Task – need to improve UI in Metadata tab to show user can use variables in Value column
• NEW: Azure Storage Task – Provide an Action to Read Tags (just like GetMetaData option)
• NEW: General – Add FUN_XML_TO_TEXT to extract data from XML using XPath
• NEW: General – FUN_REGEX_EXTRACT allow to use group name in extract pattern (e.g. \w+@(?<domain>\w+).com{{0,domain}} )
• NEW: General – New Function – FUN_IF – Compare two values and return match or non-match string (e.g. <<Abc|~|Eq|~|Abc|~|Both $1 and $2 same|~|Not same,FUN_IF>> )
• NEW: General – New Function – FUN_IF_REGEX_MATCH – Return If Else Value on Regular Expression match or mismatch (e.g. <<Abc (123)|~|\d+|~|Found $2|~|No found|~|true,FUN_IF_REGEX_MATCH>>
• NEW: General – Update AWS SDK to v3.7 (Add support for IMDSv2 in IAM Role and many more)
• NEW: HTTP Connection Manager – Add [$url-part-regex-(some-regex-here)$] placeholder in HashSignatureFormat
• NEW: HTTP Connection Manager – When you enable Retain Cookie Option with Dynamic Token – You may get error about Cookie format
• NEW: HTTP Connection Manager, JSON / XML / CSV Source, REST API Task, Web API Destination – Allow Cookie Container Feature for SSL Version set other than Default
• NEW: HTTP, OAuth Connection Manager – Throw meaningful error when certificate is null (Failed to load)
• NEW: JSON / XML / CSV Source – Allow to continue on Error for multiple status code (e.g. 404|405) – New Property ErrorStatusCodeToMatchRegex
• NEW: JSON / XML / CSV Source – Add support for reading *.tar.gzip file (multiple files in one tar.gzip)
• NEW: JSON / XML / CSV Source, REST API Task – ClientCertificate not supported if you change SslVersion settings other than Default
• NEW: JSON / XML Generator Transform, Export Task – Add option to output nested JSON /XML as encoded string – Set datatype=”String” for Unbound <map> node (Usecase: MailChimp Bulk API / Azure DevOps Update/Insert)
• NEW: JSON Generator Transform, Export JSON Task – Allow Placeholder Function usage for <map> tag (e.g. <map src=”notes” function=”FUN_BASE64ENC” /> or function=”sometext <<{$value$},FUN_BASE64>> sometext” in Template mode
• NEW: JSON Source – Treat “$” as blank filter
• NEW: JSON Source, XML Source, CSV Source – Allow API Connector Wizard to use Column Metadata for new EndPoint in Connector File
• NEW: JSON Source, XML Source, CSV Source – Include Properties in EndPoint as Default Props when cannot be detected by Wizard as Valid Properties
• NEW: OAuth / HTTP Connection Manager – Add MetaUrl, MetaHeaders, MetaMethod, MetaBody, MetaFilter to get API base URL (dynamic URL case like MailChimp, JIRA OAuth)
• NEW: Regular Expression Parser Task – Add –regex-cs (suffix flag in pattern) for case-sensitive pattern search (Right now searches are not case-sensitive)
• NEW: REST API Task – Allow to continue on Error for multiple status code (e.g. 404|405) – New Property ErrorStatusCodeToMatchRegex
• NEW: REST API Task – Give Options (DisableAutoConvertMultiPartStream and TreatResponseAsMultiPart) to enable / disable multipart detection for stream (Right now we auto detect / convert based on Response Content-Type but no way to enable/disable)
• NEW: REST API Task, JSON / XML / CSV Source – Allow custom content-type in header for MutiPart Upload (e.g. myfilename=@c:\somefile.txt)

Bug fixes

• FIX: All Components – Dataflow components loses the locked column names when sorts Available Columns (i.e. Click [A-Z] –or– [Z-A] toolbar button)
• FIX: All Components – Renaming Output Column Name should not break the flow
• FIX: Amazon Redshift Data Transfer Task – Throw meaningful error when Source SQL Produce blank column name (no alias defined for calculated / static data column)
• FIX: API Connection Manager – Preview works but Test Connection Fails – Embedded API Config Text is empty (Only when you switch to Embedded Mode)
• FIX: API Connector – SharePoint – Refresh Columns might throw error in some cases if you Do not supply SiteId at the EndPoint level (Connection Level value is ignored)
• FIX: API Connector – Youtube – Embedded Provider selection throws error
• FIX: API Connector – YouTube – Improve speed by reducing number of API calls for get_videos (MyVideos Table) – Change Rows Per Page from 2 to 50
• FIX: API Connector Framework – Allow {$rows$} in Functions for Query Type Parameters for Bulk Lookup
• FIX: API Connector Framework – Column Name is used instead of Label is used to generate {$rows$} (when LayoutMap not supplied)
• FIX: API Connector Framework – Columns with same Lable but Different Name cause issue (Last column with same Label takes precedence)
• FIX: API Connector Framework – Common Properties (e.g. Label, Desc, HelpLink) always takes precedence from Template rather than node override
• FIX: API Connector Framework – Duplicate Column Name in Dynamic Template cause issue (Static Column added at EndPoint level and same found in Dynamically Expanded)
• FIX: API Connector Framework – generic_request endpoint is not working when you use Partial URL starts with slash (e.g. /customers) or Full URL (http://abc.com/customers)
• FIX: API Connector Framework – If Service URL contains variable e.g. (https://[$Domain$].zendesk.com) then some bulk endpoints (e.g. BULK Delete / Update / Insert – Using Full Job Style URL from Child EndPoint) might fail
• FIX: API Connector Framework – MaxRows Settings not working for ChildEndPoint
• FIX: API Connector Framework – Paginated request might fail if you use {$rows$} placeholder in URL (it wont replace after first request)
• FIX: API Connector Framework – Query Builder on UI might send blank rather than NULL value for Dependency Parameter (OptionEndPointParameters)
• FIX: Google Analytics Source – Connection Manager set GA4 in Connection Manager + adding filter in GA Source – getting error on PREVIEW
• FIX: Google Analytics Source – ERR_NO_DATA_OR_INVALID_EXPR: No records found in specified table. Manually enter output columns.
• FIX: Google Data Connection Manager – You might get JavaScript Error on Generate OAuth Token
• FIX: HTTP Connection Manager – HashSignature Method sometimes throws error about Position if you use [$url-part-zzz-x-y$] placeholder in HashSignatureFormat
• FIX: Http Connection Manager – JTW token Claims not loaded on UI after save
• FIX: JSON / XML / CSV Source – API Connector File Wizard doesnt add PagingByUrlCurrentPage Property if PagingMode set to URLPath Mode or ByPostData mode
• FIX: JSON / XML / CSV Source – API Connector Wizard Saves Headers as XML rather than Raw format in final connector file
• FIX: JSON / XML / CSV Source – Pagination Mode – ByResponseHeaderRfc5988 – Fails in some cases (e.g. ServiceNow API)
• FIX: JSON Generator Transform – Output as array node not persisted on UI for unbound node
• FIX: JSON Source – API Connector Wizard should set PageStartVariable automatically when Variable is set
• FIX: JSON Source, XML Source – Pagination doesnt stop (goes infinite loop) when you have Error Output attached
• FIX: JSON Source, XML Source – When Suffix used with question mark it doesnt wipe out original parameters from the URL as indicated in the help
• FIX: OAuth – Vsts Provider – response_type sent twice
• FIX: OAuth Connection – If Password / ClientCredentials Grant used and RefreshToken is returned in response then sometimes it may fail request with Unauthorized (due to blank AccessToken)
• FIX: OAuth Connection Manager, API Connection – Use SaveAs dialog rather than Open for Refreshtoken file path
• FIX: REST API Task, JSON / XML Source / Web API Destination – Multi Part Content Response may throw error – startIndex cannot be larger than length of string. Parameter name: startIndex (This only happens if two new lines found before first boundary)
• FIX: Upsert Destination – Cannot select Custom Order By dropdown when Duplicate Handling is changed (its always disabled) – You can use Properties window to change it but not via UI
• FIX: XML / CSV Source – API Connector Wizard doesnt set EndPoint ResponseFormat=Xml or Csv
• FIX: XML Source – You might get error about Could not find my.dtd file when <!DOCTYPE my.dtd> tag found in the XML file (Preview works fine but runtime fails)

The post SSIS PowerPack 5.3.0 released appeared first on ZappySys Blog.

This release brings tons of new features and bug fixes. We have added new connectors for Outlook Mail (Office 365), Shopify, SharePoint and JSON / XML / CSV Generator Transform. It fixes important issues with API Destination, CSV Source, JSON Source and Secure FTP Connection Manager. To see full release notes click here

New Features/Improvements

• NEW: Google Analytics Source – Support v4 API (GA4)
• NEW: API Connector – Outlook Mail (Office 365) – New connector to read / download mail and attachments from Office 365 Mail account
• NEW: API Connector – Shopify – Read / Write Shopify data (e.g. Customers, Products, Orders)
• NEW: All Components – Show meaningful error about decimal data corruption when SSIS cannot handle higher Precision / Scale than defined in Column Metadata
• NEW: All Source Components – Increase ErrorMessage column length to 4000 from 1024
• NEW: API Connector – Google BigQuery – Add Job Location Option for get_query and connection Level
• NEW: API Connector Framework – Add Option TreatBodyAsDirectValue (Body parsed as input data rather than calling URL)
• NEW: API Connector Framework – Add Option to name Dynamic Expanded Columns as CamelCase
• NEW: API Connector Framework – Add support for Dynamic ServiceUrl (e.g. MailChimp API usecase)
• NEW: API Connector Framework – Add Support for SingleDataset in LayoutMap (e.g. <settings singledataset=”True”> – Shopify Connector Usecase
• NEW: API Connector Framework – Allow to pass static values for EndPoint parameters tagged with {$rows$} function (Right now it doesnt work if query endpoint rather than Input Rows – usecase like API Destination)
• NEW: API Connector Framework – Allow to Read data From Local File – (Set <EndPoint Url=”c:\data\file.json” or “.xml” or “.csv”)
• NEW: API Connector Framework – Allow to use Png file as Logo
• NEW: API Connector Framework – CData Property (e.g. LayoutMap, Body) or Property not String Type (i.e. Int, Bool) not working if you set in Template as EndPoint Attribute (i.e. <EndPoint IncludeParentColumns=”True” …. > )
• NEW: API Connector Framework – Expose Layout related Properties – DoNotOutputEmptyArrayProperty, DoNotOutputEmptyNestedProperty, DoNotOutputNullProperty, XmlNameSpaces, XmlPrefix, EnableCustomEscapeSequence, CustomEscapeSequenceRule and more
• NEW: API Connector Framework – Generic Request – Make Content-Type and Request Method visible by default
• NEW: API Connector Framework – If LayoutMap not supplied and one of the URL parameters tagged as Functions={$rows$} and EndPoint RequestFormat=Csv then automatically generate LayoutMap to produce single column Csv
• NEW: API Connector Framework – Provide a way to use multiple Templates (e.g. <EndPoint Name=”get_orders” Template=”Order, Pagination” …. ) – Multi Inheritance
• NEW: API Connectors – SharePoint – Drive list is not refreshed when you change Site for upload_file endpoint Parameters UI (grid)
• NEW: API Destination – Do not throw validation error if Input column is mapped and its MapToParam which is required param
• NEW: API Destination – Move operation dropdown under the table selection
• NEW: API Source, API Destination – Show Parameter help link when user selects Parameter grid entry
• NEW: General – Add option to export Mappings on Columns Tab so its ProperCase for API Connector
• NEW: General – Do not output sensitive information in Log when you change LogLevel=Debugging (header name contains Session, Token or Key mask information in log)
• NEW: General – Provide a way to reset prompts on License Manager – Advanced Tab (e.g. Reset DP Scaling Prompt, New Version Found Prompt)
• NEW: JSON / XML / CSV Generator Transform – Add support for DT_NUMERIC and DT_DECIMAL – Use decimal type for higher precision floating point numbers (Decimal Type upto 38 precision / scale)
• NEW: JSON / XML /CSV Source, Amazon S3 / SFTP / Azure CSV, XML , JSON Source – Update notes for Enable Multi Path Mode – Its not clear that we do not allow pattern search when this option is checked
• NEW: JSON Parser Transform, XML Parser Transform – Provide a better message for Memory is locked error due to Blob Type / Large string and MultiCast usage
• NEW: JSON Source, XML Source, CSV Source – Add an option to redirect web exception on error output (right now it fails component rather redirect)
• NEW: MongoDB, PostgreSql, Redshift Connection Manager – Add help link on how to configure SSH Tunnel (Local Port Forward Technique)
• NEW: Reporting Services Task – Add an option to compress file (as Zip) for export / email attachment
• NEW: Reporting Services Task – Allow option to add Password for Exported Zip file and Excel (xlsx / xls)
• NEW: Secure FTP Connection Manager – Add Support for TLS 1.3
• NEW: Secure FTP Task – Rename file to *.partial during download / upload process to indicate partial file (once transfer done change to original name)
• NEW: Upsert Destination – Give option to sort on custom column for Duplicate Handling (i.e. KeepFirst and KeepLast ) – Right now we sort on Key column (we should rather give option to sort on column like LastUpdatedOn)

Bug fixes

• FIX: API Connector Framework – When Direct Placeholder Function used along with [$SomeParam$] in ValueTemplate of InputColumn then it doesnt evaluate for each row (Using Cached Value rather than Row By Row) – Example [$p1]<<{$value$},FUN_BASE64ENC>>
• FIX: API Connector Framework – When nested column under Unbound node found in LayoutMap not supplied you may see bad JSON created
• FIX: API Connector Framework – Zendesk – When you dont supply requestor / comment your create Ticket call might fail
• FIX: API Destination – For Bulk Operation becomes row by row after first request
• FIX: CSV Source – Issue in output while Carriage Return (CR) inside the double quote
• FIX: General – Improve Machine Registration
• FIX: JSON Source – URL Parameter Pagination mode fails in some cases when API doesnt under + as encoded value for space and user supply encoded space in query (e.g. http://abc.com?id=AAA%20BBB )
• FIX: Licensing – Detect Windows 11 as Desktop OS rather than Server OS
• FIX: OAuth Connection Manager – AWS V4 Provider – Variable Placeholder cause issue in HMAC Signature
• FIX: Reporting Services Task – If Send Email / Export File Fails then temp file is not deleted
• FIX: Secure FTP Connection Manager – Add an option EnsureKeyAcceptable to handle error like – A public key corresponding to the supplied private key was not accepted by the server or the user name is incorrect (Send Key First and use UserId, Password Login )

The post SSIS PowerPack 5.2.0 released appeared first on ZappySys Blog.

This was a minor update release. It have added a new API Connectors for HubSpot, OneDrive, SharePoint and JSON Source. It fixes important issues with API Connection Manager, API Connector, Export XML Task, JSON Driver, XML Driver and JSON Source. To see full release notes click here

New Features/Improvements

• NEW: General – Add Support for Visual Studio 2022 SSIS Designer (VS2022 x64)
• NEW: API Connection Manager – Sort Connectors by name
• NEW: API Connector – Google BigQuery – Add Support for Stored Proc / SQL Query which invokes CRUD / DDL / DML Statements (INSERT, UPDATE, DELETE, CREATE, ALTER)
• NEW: API Connector – Google BigQuery – Performance Enhancements for SQL query / Reduce billing unit per query
• NEW: API Connector – HubSpot – Added error retry on status code 429
• NEW: API Connector – OneDrive – Add Retry Option (Handle too Many API Calls – Status 429)
• NEW: API Connector – OneDrive – Give option to force Login Prompt (e.g. Similar to Clear login cookies)
• NEW: API Connector – SharePoint – Add Retry Option (Handle too Many API Calls – Status 429)
• NEW: API Connector – SharePoint – Give option to force Login Prompt (e.g. Similar to Clear login cookies)
• NEW: API Connector – Zendesk – Search endpoint fails when more than 1000 records returned (Limit of 1000 rows not applied)
• NEW: API Connector Framework – All Connector Files – Use 429 RetryMode as Property rather than Placeholder
• NEW: API Connector Framework – Sort Properties by name in Add New Parameter UI (Type=Property)
• NEW: General – Add support for Turkey (tr-TR) and Azerbaijani (az-Cyrl) environment
• NEW: JSON Source – Create new connector option should set Version=1 and latest EngineVersion for New Connector file being created during wizard
• NEW: MongoDB Source – Show user friendly message – How to read View if you see – QueryFailure flag was Namespace 5ddeb5exxxxxx_yourDB.yourViewName is a view, not a collection
• NEW: PostgreSql Source, Excel Source, Redshift Source, API Source – Add Logging for SQL Query / Table name

Bug fixes

• FIX: API Connection Manager – Authentication help link doesnt show popup help in some cases
• FIX: API Connection Manager – Connection Parameter Grid uses old connection to make DataEndPoint calls
• FIX: API Connection Manager – Embedded Dropdown option for Amazon Ads Connector not working
• FIX: API Connector – Google BigQuery – You might get duplicate rows in some cases (when query is not cached in BQ)
• FIX: API Connector Framework – Dynamic Endpoints are expanded on test connection (Usecase: SharePoint Connector uses root site – Causing UnAuthorized Error)
• FIX: API Connector Framework – Generic_Request EndPoint doesnt work correctly when you supply Body or Headers
• FIX: API Connector Framework – String value with slash ( \ ) or double quote ( ” ) cause issue in Insert, Update, Delete operations
• FIX: Export XML Task – UpperCase not allowed in NameSpace Prefix (i.e. nsA=http://xyz) – You get error prefix not declared
• FIX: General – Placeholder engine doesnt work in some cases when regional settings set to non-english (e.g. Turkish tr-TR)
• FIX: JSON Driver, XML Driver – When nested filter used (e.g. $.customers[*].orders ) along with IncludeParentColumns option not working sometimes (Throws error or shows wrong value for parent column)
• FIX: JSON Source – JSONPath expression with $.customers[*].orders can throw error if mixed case detected for array and object for the same property and you check IncludeParentColumns (e.g. orders: [ {…},{…} ] –OR– orders: {…} }
• FIX: JSON Source – Key Not found exception at runtime when Output as Raw Document Enabled and Include Parent is checked
• FIX: JSON Source – Pagination with NextUrlFromAttribute and NextLink Cursor does not encode variable placeholder
• FIX: JSON Source – parent column value not correct when nested array filter used in JSONPath (e.g. $.customers[*].orders[*] ) – This can happen in Raw Output option too
• FIX: JSON Source – Performance Improvement (when include parent column checked)

The post SSIS PowerPack 5.1.0 released appeared first on ZappySys Blog.

This was a minor update release. It fixes important issues with All Components and API Connector. To see full release notes click here

New Features/Improvements

• NEW: API Connector – Zendesk – Show all custom fields when you query Tickets (Previous approach was limited to 5 fields only)
• NEW: API Connector – Zendesk – Update Read Tickets (Incremental) endpoint to support functions in Start Time Parameter. Now you can use date time function (i.e. yesterday, monthstart etc) along with static date (i.e. 2021-01-01 or 2021-01-01 23:59:59) to set
• NEW: API Framework – Allow placeholders in ValueTemplate property for Columns with Dynamic Expand option set to true
• NEW: Salesforce Connection Manager – Provide an option to supply API Version for Bulk / SOAP API (Right now BULK API version is hardcoded and no way to change, SOAP also same way but work around is there to change Service Type=Other)
• NEW: Salesforce Connection Manager – Update API Version to 55.0 for SOAP and Bulk API to take advantage of new features

Bug fixes

• FIX: All Components – Mapping file export does not encode special characters like “&” which cause issue with import same file throwing error – An error occurred while parsing EntityName. Line XX, position YY.
• FIX: API Connector – Stripe – Update endpoints to for date time as input / output rather than Unix timestamp
• FIX: API Connector Framework – Some properties like Functions, ValueTemplate, Order, Label etc doesnt work in Param Template

The post SSIS PowerPack 5.0.1 released appeared first on ZappySys Blog.