Dataverse enhancements in this release include:
Data Transformation using Python Script
This release introduces the Python language as the de facto scripting language for the creation of custom data transformations in Dataverse.
The Python-based Transform node was introduced as an Experimental node in Dataverse 3.1.4, it is now Generally Available.
As Dataverse transitions from using the Lavastorm proprietary Dataverse script to the Python language, nodes which used the proprietary Dataverse script are being progressively superseded by new Python-based nodes. Some of the new nodes are drop-in replacements for the previous nodes (e.g. Sleep node, Get Metadata node). Where a superseded node allowed the use of script within a property, the new version of the node uses the Python language. Due to the differences in the two scripting languages, the original nodes have been retained and new Python-based nodes have been introduced. The previous version of the node is indicated by ‘(superseded)’ in the node name.
The original nodes are now called:
Agg Ex (Superseded), Band by Strata (Superseded), Filter (Superseded), Remove Duplicates (Superseded), Sort (Superseded), Split (Superseded), Transform (Superseded), Trim Fields (Superseded).
The Sort node now provides a UI control in the property panel that allows you to easily select the fields to sort by and configure the sort order and attributes.
The new Aggregate node is a replacement for the Agg Ex node. It enables you to aggregate data or sub-groups of the data using a number of aggregation methods, e.g. sum, avg, min, max, first (in group), last (in group).
When combining data with different data types, the Cat node now supports the automatic promotion of string data type to unicode data type.
Node property configuration improvements
Some Dataverse library nodes provide default property values. In some circumstances you may want to set a property explicitly to a blank value. You can also restore a Blank property value to its inherited default value using the ‘Restore Default Value’ menu option.
Data Viewer Enhancements
When the Data Viewer is used to add a Filter or Split node to the canvas, the Filter and Split nodes now leverage the Python-based Transform node rather than the previous Dataverse script based Transform node.
Directory View Panels
The width of the side panels in the Directory view can now be adjusted by grabbing the control at the edge of the panels. The panels can also be collapsed/opened by double-clicking on the edge control.
Date times in the Directory view are now displayed in the local format for your system.
A number of issues have been resolved in this release which fix reported issues with Dataverse nodes, improve the import of legacy data flows, streamline interworking with LDAP and improve application stability. Please see the release notes for further details.
For additional detail please visit this article or the full Release Notes (PDF)