Task Factory Data Cleansing Transform

Data Cleansing Transform

Transform IconTransform Description
Task Factory Data Cleansing Transform IconThe Data Cleansing Transform is used to clean or alter data coming into the transform with rules defined in the UI.

Task Factory Data Cleansing Transform Editor

UI Overview

UI Overview 

Name

Select the name of the column to replace.

Action 

Select the action to be taken on the data.

Action Description
Convert string to proper case (Name, Address, Title, Sentence, User)This allows you to replace the values of an input column with a properly cased output.
Trim Whitespace
  • Trim all leading and trailing whitespace characters - Trims all whitespace from the beginning and end of the selected input column data.
  • Trim all leading whitespace characters - Trims all the whitespace from the beginning of the selected input column data.
  • Trim all trailing whitespace characters  -  Trims all the whitespace from the end of the selected input column data.
Trim specified characters
  • Trim specified characters from start and end - Trims all the specified characters from the beginning and end of the selected input column data.
  • Trim specified characters from start - Trims all the specified characters from the beginning of the selected input column data.
  • Trim specified characters from end - Trims all the specified characters from the end of the selected input column data.
Change Date FormatAllows the conversion of a date from one format to another.
Convert NULL to user defined value
Convert blank value to NULL
Convert blank value to user defined value
Replace alpha/numeric/alphanumeric characters to user defined value
Replace specified characters or words with user defined value
Replace bad date with user defined value
Replace matching regular expression pattern with user defined value
Extract data from input string using regular expression
Replace invalid characters that cannot be part of an XML Document
Replace non-printable characters
Defining a Data Cleansing Rule

Defining a Data Cleansing Rule

  1. Choose a column to replace from the Name column of the editor window.

    Task Factory Data Cleansing Transformation Editor Name drop-down
  2. Next, select an action (rule) from the Action column of the editor window. This is the action taken on the data coming in.
    Task Factory Data Cleansing Transformation Editor Action drop-down
  3. Setup the parameters for the selected action. Each parameter has a help tip that shows up at the bottom of the drop down menu. Select the ellipsis at the top right of the help-tip to open the full info window for that parameter.
    Task Factory Data Cleansing Transformation Editor Message window
  4. Each parameter has a type associated with it. This allows you to choose how the transform should fill that parameter value during runtime execution.
    Task Factory Data Cleansing Transformation Editor Parameter selection
  5. Select OK to save the cleansing rule.

Additional Information:  See the Task Factory Error Row Handling article for more information about this functionality.