Task Factory Data Cleansing Transform

 Task Factory users running version 2020.1.4 or older (released prior to May 27, 2020): There's an important Task Factory update. Please visit here for more details.

Data Cleansing Transform

Transform IconTransform Description
Task Factory Data Cleansing Transform IconThe Data Cleansing Transform is used to clean or alter data coming into the transform with rules defined in the UI.

Task Factory Data Cleansing Transform Editor

UI Overview 

Name

Select the name of the column to replace.

Action 

Select the action to be taken on the data.

Action Description
Convert string to proper case (Name, Address, Title, Sentence, User)This allows you to replace the values of an input column with a properly cased output.
Trim Whitespace
  • Trim all leading and trailing whitespace characters - Trims all whitespace from the beginning and end of the selected input column data.
  • Trim all leading whitespace characters - Trims all the whitespace from the beginning of the selected input column data.
  • Trim all trailing whitespace characters  -  Trims all the whitespace from the end of the selected input column data.
Trim specified characters
  • Trim specified characters from start and end - Trims all the specified characters from the beginning and end of the selected input column data.
  • Trim specified characters from start - Trims all the specified characters from the beginning of the selected input column data.
  • Trim specified characters from end - Trims all the specified characters from the end of the selected input column data.
Change Date FormatAllows the conversion of a date from one format to another.
Convert NULL to user defined valueAllows the conversion of a NULL to a user defined value.
Convert blank value to NULLAllows the conversion of a blank value to a NULL value.
Convert blank value to user defined valueAllows the conversion of a blank value to a user defined value.
Replace alpha/numeric/alphanumeric characters to user defined valueReplaces numeric characters with a user defined value.
Replace specified characters or words with user defined valueReplaces user specified words with a user defined value.
Replace bad date with user defined valueReplaces a bad date with a user defined value.
Replace matching regular expression pattern with user defined valueReplaces a regular expression pattern with a user defined value.
Extract data from input string using regular expressionExtracts data from an input string.
Replace invalid characters that cannot be part of an XML DocumentReplaces invalid XML Document characters.
Replace non-printable charactersReplaces non-printable characters.

Defining a Data Cleansing Rule

  1. Choose a column to replace from the Name column of the editor window.
    Task Factory Data Cleansing Transformation Editor Name drop-down
  2. Next, select an action (rule) from the Action column of the editor window. This is the action taken on the data coming in.
    Task Factory Data Cleansing Transformation Editor Action drop-down
  3. Each parameter has a type associated with it. This allows you to choose how the transform should fill that parameter value during runtime execution.
    Task Factory Data Cleansing Transformation Editor Parameter selection
  4. Select OK to save the cleansing rule.

Additional Information:  See the Task Factory Error Row Handling article for more information about this functionality.