NEW: All Destinations - Provide a summary of total rows / batches processed once done
NEW: All Source Components - Allow to parse Unix Epoch Timestamp value for DateTime column (DT_DBTIMESTAMP)
NEW: API Connection Manager - Added stylesheet link rather than using static CSS for Auth Help Popup to look pretty
NEW: API Connector - ElasticSearch - Added FailIf attribute for usecase like SSIS when INSERT / UPDATE output not consumed and record update/insert fails which needs to be reported as error. Previously it was silent about the error
NEW: API Connector - ElasticSearch - Added support alias in Metadata query
NEW: API Connector - ElasticSearch - Added support for date, bool, int, long, double, float types (Previous version didn't detect datatypes)
NEW: API Connector - ElasticSearch - Added support for dynamic metadata (See MetaDetectionOrder property under Advanced Parameters - Set to Dynamic)
NEW: API Connector - ElasticSearch - Added support for Mixed DateTime with Unix Epoch Timestamp for date type
NEW: API Connector - ElasticSearch - Added support for read geo_shape and geo_point
NEW: API Connector - JIRA - Added Insert/Update/Delete operation for Comment Table
NEW: API Connector - JIRA - Added new tables Groups, ApplicationRoles
NEW: API Connector - Jira - Added read/write support for Team field type (Value listed in customfield_NNN_id and customfield_NNN_name fields)
NEW: API Connector - JIRA - Bulk Write to Issues doesnt work for more than 50 rows
NEW: API Connector - JIRA - Performance improvement for Comments Table Read Operation
NEW: API Connector - OData - Added new properties for OAuth Credentials (DoNotIncludeCredentialsInHeader, DoNotIncludeCredentialsInBody, RenewBeforeSec, ExtraHeaders, ContentType, EnableCodeVerifier, CustomAuthHeader, CustomTokenPrefix and RemoveAuthHeader)
NEW: API Connector - OneDrive - Added an option to list files / folders Shared With Me (new SearchType option)
NEW: API Connector - OneDrive - Added an option to select See Shared DriveId (Dropdown on UI) along with User DriverId (me) in list_files / list_folder and many other endpoints
NEW: API Connector - OneDrive - Added ConvertTo option to download_file endpoint to convert supported files to PDF or HTML format
NEW: API Connector - OneDrive - Added new endpoint copy_item to copy file or folder
NEW: API Connector - OneDrive - Added new endpoint list_files for recursive scan and using OrderBy field for list operation
NEW: API Connector - OneDrive - Added new endpoint move_rename_item to move or rename file or folder
NEW: API Connector - OneDrive - Allow File/Folder ID or Path in most endpoints
NEW: API Connector - OneDrive - Allow Lookup Operation (By ID Param) in Files Table (e.g. SELECT * FROM Files WHERE Id='Abxxx12')
NEW: API Connector - ServiceNow - Added two new options (Query and Fields) in get_table_rows
NEW: API Connector - SharePoint - Added a Default Drive Id parameter at connection level, Updated Auth SiteId Param to have extra option entry
NEW: API Connector - SharePoint - Added a UseRawCache option in get_list_fields to avoid duplicate API calls and fetch Columns metadata faster
NEW: API Connector - SharePoint - Added Insert / Update option for Multi Select Choice Field (Previously not possible)
NEW: API Connector - SharePoint / OneDrive - Added a new option (ConflictBehavior) in upload_file endpoint to replace/rename if target file exists
NEW: API Connector - SharePoint / OneDrive - Added new connection level parameters ExtraHeaders and SearchOptionForNonIndexedFields
NEW: API Connector - SharePoint / OneDrive - Added new parameters OrderBy, SearchType and SearchPath for list_files, list_folders, list_excel_files
NEW: API Connector - SharePoint / OneDrive - Added support for Read/Write CSV and JSON Files (New Tables FileReaderWriterJson, FileReaderWriterCsv)
NEW: API Connector - SharePoint / OneDrive - Use Id rather than Name for SheetId parameter in get_excel_worksheet and get_excel_worksheet_autodetect endpoints
NEW: API Connector - SharePoint Online - Added new endpoint copy_item to copy file or folder
NEW: API Connector - SharePoint Online - Added new endpoint move_rename_item to move or rename file or folder
NEW: API Connector - SharePoint Online, OneDrive - Added webUrlPath column in many endpoints, which list Files and folders. This path included a relative path after /Documents/ part in webUrl
NEW: API Connector - SharePoint Online, OneDrive - Sorted Files and Folders in Dropdown selection on UI
NEW: API Connector - Zoho CRM - Throwing `401 Unauthorized - invalid oauth token` error during Large Data Retrieval After OAuth Token Expiry after almost 1hour
NEW: API Connector Framework - Add Dynamic Option in MetaDetectionOrder (This will ignore Static Metadata incase defined)
NEW: API Connector Framework - Add new option DataEndPointWhere to filter output coming from DataEndPoint to control Expanded objects (e.g. columns, endpoints, tables)
NEW: API Connector Framework - Add option to detect blank and null value for DataTypeMap
NEW: API Connector Framework - Added Item count label for Dropdowns
NEW: API Connector Framework - Added new Auth attribute DefaultServiceUrl (Scenario like Jira OAuth Auth selection should set default Service URL on UI)
NEW: API Connector Framework - Added new EndPoint Property CustomOutputColumns and CustomInputColumns to set Dynamic Metadata without calling API call (useful for generic_request_write Input /Output Mapping)
NEW: API Connector Framework - Added new FailIfExpression property and new FailIF mode ExpressionFound for EndPoint (Use DataTable Expression only used when FailIf=ExpressionFound)
NEW: API Connector Framework - Added new Param Property AllowDuplicateHeader to allow same Header name as Key for Header Type parameter
NEW: API Connector Framework - Added new property InvokeOrder to control which parameters with ValueTemplate replaced first (SharePoint, OneDrive list_file sharedWithMe usecase)
NEW: API Connector Framework - Added new property OptionsEndPointContinueOnError to continue on error if one or more endpoints fails during Union operation (Multi endpoints scenario in OptionsEndPoint)
NEW: API Connector Framework - Added new property WriterDateTimeFormat to set DateTime value format for CSV, XML, JSON document for {$rows$} placeholder
NEW: API Connector Framework - Added Param Setting OptionsEndPointDistinct to UNION multiple results and apply distinct on it
NEW: API Connector Framework - Added support for Prefix "*" in EndPoint FailIfExpression - Prefixing expression cause to scan array records instead of scanning root level (e.g. "*P_error=true" will not cause double scan)
NEW: API Connector Framework - Allow QuotesAroundValue, HasColumnHeaderRow, RowDelimiter Params for When EndPoint set to RequestFormat=Csv (Previous these values were hard coded)
NEW: API Connector Framework - Allow to use parameters in ValueTemplate which invokes nested ValueTemplate
NEW: API Connector Framework - Exposed a new Property DoNotIndentArray to control Indent of Array Attributes (ElasticSearch usecase)
NEW: API Connector Framework - JIRA - Add two extra columns for each Custom User Type Field (customfield_NNN_accountId and customfield_NNN_email)
NEW: API Connector Framework - Shopify - Add support for get_products_count and get_orders_count endpoints
NEW: API Connector Framework - Shopify - Add support for X-Shopify-Api-Features header
NEW: API Connector Framework - Show checked Items in Green color in Multi Select Option Parameters on UI
NEW: API Connector Framework - String Column Length always defaults to 4000 when Expand is defined and ignores user defined Length attribute
NEW: API Connector Framework - You may get error for Param with Key Attribute in Auth which is declared as Type=Property (Default works fine)
NEW: API Destination - Added a new table __DynamicRequest__ to support Generic BULK Write to any URL (Not part of Connector Endpoints)
NEW: API Source, API Destination - Always suffix JSONENC function when user insert string type variable as placeholder on Raw Edit dialogbox
NEW: API Source, API Destination - By default insert JSONENC function in Insert Variable for Parameters Raw Edit UI
NEW: Dynamics CRM Connection Manager - Proxy configuration is not working
NEW: Export Excel File Task - Add OpenPassword / EditPassword for Template Engine file (Set the same Password for output file)
NEW: Export Excel File Task - Always save multiple datasets on tabs rather than file(s) option is not visible
NEW: Google Analytics Source - Added new Case Sensitive operators for Dimension Filter so now you can control case-sensitivity at condition level rather than applying globally for all conditions
NEW: Google Analytics Source - Allow Between operator for Metrics Filter (Use comma to separate from and to value)
NEW: Google Analytics Source - Allow IN operator for Dimensions Filter (Use comma separated list)
NEW: Google Analytics Source - Allow to Set NOT / AND / OR for Metircs and Dimensions separately (Right now, Both Metrics / Dimensions share the same settings)
NEW: Google Analytics Source - Show Profile Specific Custom Metrics / Dimensions (Right now it shows only common Metrics / Dimensions to all Profiles)
NEW: JSON Source - Add option to output data as Raw JSON Document
NEW: OAuth Connection Manager - All Google Providers - Added new feature "Impersonate As User" when using Service Account credentials - Enter Extra Attributes For Token as "user=someuser@abc.com" to enable impersonation
NEW: OAuth Connection Manager - Allow System Headers (e.g. Accept, Content-Type) in ExtraHeaders, Also allow Placeholder Functions along with replacement [$clientid$] ,[$clientsecret$], [$userid$], [$password$] (e.g. x-clientid-hdr:<<[$clientid$],FUN_TRIM>>)
NEW: Upsert Destination - Added better data truncation error message with possible column names (Target Length vs Actual Source Data Length) when you get error - String or binary data would be truncated
NEW: XML Parser Task - Add XPath examples to read from Element or Attribute Value with Namespace
Bug fixes
FIX: All Source Components - Columns Grid doesnt show Lock checkbox on certain resolutions (DPI / Scaling Issue)
FIX: API Connection Manager, OAuth Connection Manager - When you enable CacheToken option and if you have changing refresh token pattern it will use old refresh token from UI rather than file
FIX: API Connector - Amazon Selling Partner (SP-API) - Download file to local disk operation may corrupt the target file rather than overwrite Save to File operation corrupts the target file rather than overwrite completely
FIX: API Connector - Asana - Download file to local disk operation may corrupt the target file rather than overwrite Save to File operation corrupts the target file rather than overwrite completely
FIX: API Connector - Dropbox - Download file to local disk operation may corrupt the target file rather than overwrite Save to File operation corrupts the target file rather than overwrite completely
FIX: API Connector - ElasticSearch - Fixed datatype issue with Insert/Update operation. Now you can update geo_point, geo_shape, nested and object type field as raw JSON (e.g. SET [tags]='["tag1", "tag2"]' ..) or by field path [my_object.field_1]=123 )
FIX: API Connector - Google BigQuery - You may get error 413 Request Entity Too Large in insertAll API call
FIX: API Connector - Google Drive - Download file to local disk operation may corrupt the target file rather than overwrite Save to File operation corrupts the target file rather than overwrite completely
FIX: API Connector - Google Sheets - Download file to local disk operation may corrupt the target file rather than overwrite Save to File operation corrupts the target file rather than overwrite completely
FIX: API Connector - Hubspot - ClientId and Client Secret should be Required If UseCustomApp=True
FIX: API Connector - JIRA - Comments table may not return more than 50 comments per each Issue
FIX: API Connector - JIRA - CustomColumnsRegex is not working correctly
FIX: API Connector - JIRA - Issues / Users tables return one less row due to pagination issue
FIX: API Connector - JIRA - Projects pagination not working (Max 50 projects returned)
FIX: API Connector - OneDrive - Download file to local disk operation may corrupt the target file rather than overwrite Save to File operation corrupts the target file rather than overwrite completely
FIX: API Connector - OneDrive - Folder selection dropdown takes really long time in some cases when many files but less folders
FIX: API Connector - Outlook Mail - Download file to local disk operation may corrupt the target file rather than overwrite Save to File operation corrupts the target file rather than overwrite completely
FIX: API Connector - ServiceNow - Using Basic Auth throws error - Input string was not in a correct format
FIX: API Connector - Sharepoint - Download file to local disk operation may corrupt the target file rather than overwrite Save to File operation corrupts the target file rather than overwrite completely
FIX: API Connector - SharePoint Online - Folder selection dropdown takes really long time in some cases when many files but less folders
FIX: API Connector - SmartSheet - Download file to local disk operation may corrupt the target file rather than overwrite Save to File operation corrupts the target file rather than overwrite completely
FIX: API Connector - SmartSheet - Write operation may fail in app like SSIS if API Target Error Output not attached downstream
FIX: API Connector - Zoho CRM - Token is not renewed in some cases (e.g. SA region) causing Not Authorized error (Specially long running Jobs)
FIX: API Connector Framework - Bool Property Param with blank value may throw error - Object of type 'System.String' cannot be converted to type 'System.Boolean'.
FIX: API Connector Framework - CSV LayoutMap with * (All) generates extra column named "*" in the file
FIX: API Connector Framework - OptionsEndPoint with multiple endpoints may add OptionsExtra for each EndPoint causing duplicate entries in dropdown
FIX: API Connector Framework - Param PropertyScope doesnt honor BatchSize and MaxRequestSize
FIX: API Connector Framework - RequestFormat CSV does not quote values in generated document for {$rows$} because all types detected as Object rather than String, Int, etc
FIX: API Connector Framework - VisibleIf always returns true in some cases (When Parameters in Expression not supplied as override value and default is used)
FIX: API Connector Framework - You may get error - Object reference not set to an instance of an object for some UI dropdown parameter selection where you have defined OptionsEndPointValueColumncolumn and not set OptionsEndPointLabelColumn
FIX: API Destination - All records are not written in some cases when MaxRequestSize is specified and buffer size is grerater than MaxRequestSize (Split needed) in apps like SSIS
FIX: API Destination - May not save Table name after clicking OK
FIX: API Source - When you click Preview you may get error - System.NullReferenceException: Object reference not set to an instance of an object.
FIX: API Source / API Destination - Dropdowns missing on parameter grid for certain resolutions (DPI / Scaling Issue)
FIX: API Source, API Destination - Download file operation corrupts the target file rather than overwrite Save to File operation corrupts the target file rather than overwrite completely
FIX: Azure Storage Task - Download file operation corrupts the target file rather than overwrite Save to File operation corrupts the target file rather than overwrite completely
FIX: Azure Table Storage Source / Destination - You may receive error TlsVersionNotPermitted if Minimum SSL/TLS Version on the storage account is set to Tls 1.2 or Higher
FIX: Compression Task - Compress to GZip operation may corrupt the target file if target file already exists
FIX: Dynamics CRM Destination - Upsert Operation UpsertKeyField not detected unless you enter actual column name rather than Key Name - Throwing a runtime error - Alternate Key {some-name} requires that this set of attributes contains unique values
FIX: Excel Source - You may get error if no record found and you have WHERE clause - System.Data.EvaluateException: Cannot find column [Your-Column-Used-In-Where-Clause]
FIX: Export Excel File Task - Same Master alias joined to multiple child alias not working (e.g. countries.CountyCode=order.CountyCode;countries.CountyCode=invoice.CountyCode will only process first pair)
FIX: Export Excel File Task - When you have long running query in Template Engine it may timeout regardless what you set on Excel Options Tab
FIX: General - License Manager - Logging Tab - Clicking browse Log Folder Location button selecting a file instead of a folder and log files saving to the wrong destination if "\" is not specified
FIX: Google Analytics Source - Allow to supply double (floating point value) for Metrics Filter - Right now all values passed as int64Value
FIX: Google Analytics Source - Dropdown for Dimensions and Metrics not sorted correctly on Filter UI
FIX: Google Analytics Source - NOT Filter is failing with Bad request - Invalid JSON payload received. Unknown name \"notGroup\" at 'dimension_filter': Cannot find field
FIX: Google Analytics Source - TYPE_SECONDS, TYPE_HOURS, TYPE_MILUTES and other similar types detected as string rather than float
FIX: Google Analytics Source - You may get error Input string was not in a correct format. Couldn't store <N.NNNNNN> in {some-field-name} Column. Expected type is Int64.
FIX: JSON / XML / CSV Source - Command Line Source Prefix doesnt work (cmd:>cmd /c "dir /b c:\temp" )
FIX: JSON, XML, CSV Source - use of certain chars with cmd:> option throws invalid path error
FIX: OAuth Connection Manager - When ExpiresInAttr not found then standard expires_in attribute is ignored (Zoho Connector does not renew token in some non-USA region e.g. SA region)
FIX: Reporting Services Task - Export report with Save to file operation may corrupt the target file if target file already exists
FIX: REST API Task - Save to File operation corrupts the target file rather than overwrite completely
FIX: Upsert Destination - Mapping Grid doesnt show checkbox on certain resolutions (DPI / Scaling Issue)