Visit the official Paxata Documentation portal for all of your doc needs.

Settings for defining a connector

jmayhewjmayhew Posts: 26 admin
edited December 20, 2018 12:46AM in Admin Corner
This discussion allows you to configure a Connector for a specific remote Data Store. This Connector Configuration will then be available in the Data Library for setting up Data Sources for import and export. The common configuration parameters for all Connectors are described below. For Connector–specific configuration parameters, mouse over the fields in the form. Important: for any optional fields that you leave blank here, be aware that settings applied at the Data Source or Session level take precedence. If you return later to this form and update an optional field that you initially left blank, the settings you apply here will not override the settings already saved at the Data Source or Session level for this connector.
Connection UI Connection Settings

Allows you to connect to a JDBC source for Data Library imports. The following fields are used to define the connection parameters.

General
Name and Description: the name and description users will see for this Connector Configuration.


Database URI
JDBC URL: the JDBC connection string. The schema name can be included in the URL.

Database Visibility
You can control the database, schemas, and tables that are shown to users when they browse a data source during import. For databases, schemas, and tables, you can choose to:

  • "Show only" which returns only the databases, schemas or tables that you specify here.
  • "Hide" which hides the databases, schemas and tables that you specify here.
  • "Show all" which is the default setting to display everything in the data source.


When you select the "Show only" or "Hide" options, a field is provided for specifying the databases, schemas or tables on which you want the option enforced.

Important: These settings are not enforced when users query against the data source; query results still return a complete list of matches. For example, if you choose to "hide" a specific database, the query results will still include that database in the returned results. However, that database will not be displayed to users when they browse the data source.


Import Configuration

Import Configuration
Query Prefetch Size for queries: The batch size used (in rows) when prefetching data on import.

Max Column Size: The maximum size in Unicode characters allowed in a cell when importing or exporting data.

Pre-import SQL: SQL statement to execute before beginning import, after the table’s schema is determined.

Post-import SQL: SQL statement to execute after import completes.


Export Configuration

Export Batch Size: the batch size used when exporting data.

Max VARCHAR Size: the maximum size allowed for a VARCHAR column allowed on export. Columns greater than this size will be created as CLOB columns in the database.

Automatically create table: create a new table automatically on export.

  • If checked, and no table exists - a new table will be created and the data will be populated
  • If unchecked, and the table exists - the records in the existing table will be left intact, and the new records will be added
  • If checked and a table exists - the table is dropped, recreated, and the records will be added to the table
  • If unchecked and there is no table - you will get an error
You have to decide if you want to build a table or not (and make sure the account used in the credentials has the rights to create table, or that specific privilege.

Now - if you want to retain some of the records or the structure, then I would suggest running the pre-export & post-export SQL.  Pre-export would delete what you want to remove, but retain the database structure.  A post command can be issued as a follow up to do activities like rebuild an index or things of that manner.

Pre-export SQL: SQL statement to execute before beginning export, after the table is created if auto-create is enabled.

Post-export SQL: SQL statement to execute after export completes.


Credentials

The user authentication can be done through a Shared Account or an Individual Account. If you chose to authenticate with an individual account, the user will be prompted to enter a username and password to access this Data Source. If you choose to authenticate with a Shared Account, the following fields are required.


User: the username for a shared account used to authenticate to the database.

Password: the password for a shared account used to authenticate to the database.

Role: if roles have been implemented for this database, authenticated users with this user role can perform queries after authentication.

Comments

  • HI, We are struggling to load the data in teradata table through PAXATA. Could you please guide me to get done?
    Thanks
    Mahendra
  • The connection is fine however, getting the error while exporting...
  • Hi Mahendra - can you share the error message?  If you don't want to share here then please email error to [email protected] and copy me ([email protected]) and we will pick up troubleshooting from there.  Thank you!
  • Hi,
      Thanks for your reply. We are getting the below error however, the connection is success when test data source.

    Export

    NamePCS_ADJUSTMENTS_TEST
    StatusFAILED
    Export Issues
    Paxata cannot create a table at this level within the database hierarchy.
    Time StartedMar 5, 2019 3:17 PM
    Time FinishedMar 5, 2019 3:17 PM
    Exported ToPCS_ADJUSTEMENT_V2
    Exported Location/
    Exported By1442272

    Source Dataset

    Dataset NameMahi_RDM_Replace_tg
    DescriptionAnswerSet for project "Mahi_RDM_Replace" version 6
    Version4
    Num Rows185

    Thank you
    Mahendra
  • AkshayAkshay Posts: 94 admin
    Hello Mahendra, 

    Right now your exported location is just a "/", you need to pick an appropriate export path so that Paxata can create a table on that level within the database hierarchy.

    Thank You,
    Akshay
  • Hi Akshay,
      Just, It is worked successfully. As you said, the location is picked the right path now and the data also inserted into respective table. Please find the below log. Many thanks for your support

    Export

    NameSample
    StatusCOMPLETE
    Export Issues
    Time StartedMar 5, 2019 11:53 PM
    Time FinishedMar 5, 2019 11:53 PM
    Exported ToADJUSTEMENT_V2
    Exported Location/SCS03_CORE_VR
    Exported By1442272

    Source Dataset

    Dataset NameSample
    DescriptionAnswerSet for project "Mahi_RDM_Replace" version 5
    Version3
    Num Rows185

    Mahendra
Sign In or Register to comment.