Task Factory Google

Connection Manager

Google Cloud OAuth2 Connection Manager

Used with the Google Cloud Source and Google Cloud Rest Destination. Before connecting, users must obtain a Client ID, Client Secret, a Storage Project Id, and a Redirect URL from Google's APIs & Services Credentials dashboard.

Task Factory Google Cloud OAuth2 Connection Manager

To connect to Google Cloud Rest, complete the following:  

OptionDescription
Client IdThe Client ID is found in Google's APIs & Services - Credentials console.
Client SecretThe Client Secret is found in Google's APIs & Services - Credentials console.
Access TokenSelect Get Token to open the Token Getter window.
Storage Project IdEnter the storage Id for your container after you retrieve your access token.

To find this number, select this link and then select the Gear icon on the left side (Settings.) The Storage Project Id is found in the section Identifying your project - x-goog-project-id: 123456789 (In this example, the Storage Project Id is 123456789.)

Token Getter

Task Factory Google Cloud OAuth2 Token Getter

OptionDescription
Redirect UriThe redirect Uri configured in Google's APIs & Services - Credentials console.
Client IdThis field should be auto-completed from the previous window with your Client ID.
Client SecretThis field should be auto-completed from the previous window with your Client Secret.
ScopesSelects which permission to be used in the call:

  • Full Permission 
  • Read Write 
  • Read Only

Additional Information: For more information about Scopes, see Google's Cloud Storage Authentication.

Get Access Token buttonOpens a mini browser within the window to login to your Google account and grant access.

Google Drive Oauth2 Connection Manager

Used with the Google Drive Source and Google Drive Destination. Before connecting, users must obtain a Client ID, Client Secret, and Redirect URL from Google's APIs & Services Credentials dashboard.

Task Factory Google Drive OAuth2 Connection Manager

Connection Settings

To connect to Google Drive, complete the following:  

OptionDescription
Client IdThe Client ID is found in Google's APIs & Services - Credentials console.
Client SecretThe Client Secret is found in Google's APIs & Services - Credentials console.
Access TokenSelect Get Token to open the Token Getter window.
Use Team Drive Select this option if your application uses a Team Drive to share documents with other users.

Token Getter

Task Factory Google Drive OAuth2 Token Getter

OptionDescription
Redirect UriThe redirect Uri configured in Google's APIs & Services - Credentials console.
Client IdThis field should be auto-completed from the previous window with your Client ID.
Client SecretThis field should be auto-completed from the previous window with your Client Secret.
ScopesSelects which permission to be used in the call:

  • Full Permission 
  • Read Only 
  • Access to only files created by this authorization 

Additional Information: For more information about Scopes, see Google's Cloud Storage Authentication.

Get Access Token buttonOpens a mini browser within the window to login to your Google account and grant access.

Task Factory Google Drive OAuth2 Token Getter Full Permission

The Token Getter window automatically closes and the rest of the connection manager automatically completes. A small browser window opens at the bottom of the Token Getter Window. Log in to your Google Drive application's account and select Allow to grant access.

Proxy Configuration

Select the Proxy tab to connect to your Google Drive via a proxy connection.

Task Factory Google Drive OAuth2 Connection Manager Proxy

OptionDescription
Proxy HostIdentifies the proxy address.
Proxy PortIdentifies the port used by the proxy.
Proxy User NameEnter the user name for proxies that require user authentication.
Proxy PasswordEnter the password for proxies that require user authentication.
Source

Google Cloud Rest Source and Google Drive Rest Source

Source

Task Factory Google Drive Source

Begin by creating a connection manager that connects to the service's storage container. 

Format

The following formats are available: 

Delimited Format

Users can manually configure the delimiter , quote identifiers, the lines to skip, and lines to scan. Select Detect Formats to configure these fields automatically. 

Task Factory Google Drive Source Format Delimited

OptionDescription
DelimiterIdentifies the character that separates columns. The default value is the comma (,).
QuoteIdentifies the character used to indicate a value (if present).
Lines To SkipUsers can designate the number of lines to skip at the beginning of the delimited file.
AutoAutomatically detects which lines to skip.
Lines To Scan Determines the number of lines to scan when detecting the file.
 Detect FormatsSelect this button to begin scanning the chosen file. 

Detected Delimited View - After the format is detected, a new view appears that allows users to configure or change different properties of the file.

Json Format

Task Factory Google Drive Source Format Json

OptionDescription
 Root Json PathJson queries can return multiple levels, therefore, this field Identifies the root to be used.
Output ColumnsIn this window, users can add and remove columns, define their name, token path (defined within the raw data), data type, length, precision, scale, and code page.  
Date Parse HandlingSpecifies how date formatted strings are parsed when reading JSON text.

  • None - Strings are not parsed as a date type and are read as strings.
  • DateTime - Date formatted strings are parsed as DateTime.
  • DateTime Offset - Date formatted strings are parsed as DateTimeOffset.
Date Time Zone HandlingSpecifies how to treat time values converted between string and DateTime.

  • Local - Treats the time as local (UTC times will be converted to local times.)
  • Utc - Treats the time as UTC. This will convert local time to UTC.
  • Unspecified - Treats the time as local time if a DateTime is being converted to a string. If a string is being converted to DateTime, convert to a local time if a time zone is specified.
  • RoundtripKind - Time zone is preserved when converting.

Float Parse Handling 

Specifies how floating point numbers are parsed.

  • Double - Floating point numbers are parsed as a double datatype.
  • Decimal - Floating point numbers are parsed as a decimal datatype.

XML Format

Task Factory Google Drive Source Format XML

OptionDescription
 Root XPath Query Xml queries can return multiple levels, therefore, this field Identifies the root to be used.
Namespaces:
  • Prefix - Identifies the prefix used in an xml namespace. Example: In the element \<SalesDetails xmlns:url="http://www.site.com"> the prefix is url.
  • Uri - The url or address identified in the namespace.
ColumnsUsers can create, remove, and configure the name, index (zero-based), data type, length, precision, and scale of the columns being extracted from the file.

Output Columns

Users can select which columns to include/exclude in the output. Additionally, users can rename the columns by selecting into its corresponding output name.

Task Factory Google Drive Source Output Columns

Error Handling

Task Factory Google Drive Source Error Handling

OptionDescription
Not UsedError handling is not used and no error constraint is available.
Ignore FailureAll errors are ignored and the package continues to execute.
Redirect RowAll error rows are directed to an error output.
 Fail Component(Default selection) On error, the component fails and the package execution stops.

Preview

Select Preview Data after configuring the previous tabs to view an output sample.

Task Factory Google Drive Source Preview

Destination

Google Cloud Destination and Google Drive Destination

Target

Begin by creating a connection manager that connects to a Google Storage container. After a connection manager is created, the source window populates with files and folders.  Select the desired file to continue configuration. 

Task Factory Google Drive Destination Target

OptionDescription
Target Item NameDefines the name and extension of the file you would like to create when the component is executed. (For example: MyNewXmlList.xml)

Delimited Format

Task Factory Google Drive Destination Format Delimited

OptionDescription
DelimiterIdentifies the character that separates text.
QuoteIdentifies the character (single or double quote) that indicates value.
Include Header RowWrites the column headers at the beginning of the document.
EncodingSelects which encoding is used to create the document.
CultureUsed to identify the document's language culture.

Json Array Format

Task Factory Google Drive Destination JsonArray

OptionDescription
GenerateSelect to automatically generate the Row Body metadata. (Users can also add custom header and footer data.)
EncodingSelect which encoding is used to create the document.
CultureUsed to identify the document's language culture.

XML Array Format

Task Factory Google Drive Destination XmlArray

OptionDescription
Generate
Select to automatically generate the Row Body metadata. Users can also add custom header and footer data.
Encoding
Select which encoding is used to create the document.
CultureUsed to identify the document's language culture.