Task Factory Data Cleansing Transform

Task Factory users running version 2020.1.4 or older (released prior to May 27, 2020): There's an important Task Factory update. Please visit here for more details.

Data Cleansing Transform

Transform Icon	Transform Description
	The Data Cleansing Transform is used to clean or alter data coming into the transform with rules defined in the UI.

Task Factory Data Cleansing Transform Editor

UI Overview

Name

Select the name of the column to replace.

Action

Select the action to be taken on the data.

Action	Description
Convert string to proper case (Name, Address, Title, Sentence, User)	This allows you to replace the values of an input column with a properly cased output.
Trim Whitespace	Trim all leading and trailing whitespace characters - Trims all whitespace from the beginning and end of the selected input column data. Trim all leading whitespace characters - Trims all the whitespace from the beginning of the selected input column data. Trim all trailing whitespace characters - Trims all the whitespace from the end of the selected input column data.
Trim specified characters	Trim specified characters from start and end - Trims all the specified characters from the beginning and end of the selected input column data. Trim specified characters from start - Trims all the specified characters from the beginning of the selected input column data. Trim specified characters from end - Trims all the specified characters from the end of the selected input column data.
Change Date Format	Allows the conversion of a date from one format to another.
Convert NULL to user defined value	Allows the conversion of a NULL to a user defined value.
Convert blank value to NULL	Allows the conversion of a blank value to a NULL value.
Convert blank value to user defined value	Allows the conversion of a blank value to a user defined value.
Replace alpha/numeric/alphanumeric characters to user defined value	Replaces numeric characters with a user defined value.
Replace specified characters or words with user defined value	Replaces user specified words with a user defined value.
Replace bad date with user defined value	Replaces a bad date with a user defined value.
Replace matching regular expression pattern with user defined value	Replaces a regular expression pattern with a user defined value.
Extract data from input string using regular expression	Extracts data from an input string.
Replace invalid characters that cannot be part of an XML Document	Replaces invalid XML Document characters.
Replace non-printable characters	Replaces non-printable characters.

Defining a Data Cleansing Rule

Choose a column to replace from the Name column of the editor window.
Next, select an action (rule) from the Action column of the editor window. This is the action taken on the data coming in.
Setup the parameters for the selected action. Each parameter has a help tip that shows up at the bottom of the drop down menu. Select the ellipsis at the top right of the help-tip to open the full info window for that parameter.
Each parameter has a type associated with it. This allows you to choose how the transform should fill that parameter value during runtime execution.
Select OK to save the cleansing rule.