CloverETL Data Profiler
  About CloverETL Data Profiler
  Installation
    Hardware Requirements
    Software Requirements
    Licensing
    Getting CloverETL Data Profiler
  Getting Started
    CloverETL Data Profiler essentials
    Profiling Session Step-by-step
    CloverETL Data Profiler GUI
  Working With Projects
    Creating Projects
    Importing Projects
    Exporting Projects
  Creating Jobs
    File Profiling
    Database Table Profiling
    Excel Sheet Profiling
    Metrics
    Data Sampling
  Modifying Jobs
  Running Jobs
  Reporting Console
    Screens hierarchy
    Reporting Console as Standalone Server
      Integration with CloverETL Server
    Hardware and Software Requirements
    Installation
      Tomcat, Jetty
      Websphere
      Glassfish
      Weblogic
      JBoss
      Default Configuration
    Configuration
      Base Configuration
      Alternative ways of configuration
      Database Support
        Derby
        MSSQL
        MySQL
        Oracle
        PostgreSQL
        JNDI
      Configuring CloverETL Server
        Connection pooling
      User Accounts Settings
    Permissions
      Group-level permissions
      Sandbox-level permissions
      Public API Authorization
    Public API
      Historic Metric Values
      RSS Feed
  Advanced Topics
    Configuration
      Run configurations
      Preferences
    File URL
  Integration with CloverETL
    Using Data Profiler Feature within Designer
      Profiler job (.cpj) editing
      Data Profiler Graph Components
        ProfilerProbe
        ExecuteProfilerJob
    Profiler-Designer Element Sharing
  List of Metrics
  About CloverETL Data Profiler
  Installation
    Hardware Requirements
    Software Requirements
    Licensing
    Getting CloverETL Data Profiler
  Getting Started
    CloverETL Data Profiler essentials
    Profiling Session Step-by-step
    CloverETL Data Profiler GUI
  Working With Projects
    Creating Projects
    Importing Projects
    Exporting Projects
  Creating Jobs
    File Profiling
    Database Table Profiling
    Excel Sheet Profiling
    Metrics
    Data Sampling
  Modifying Jobs
  Running Jobs
  Reporting Console
    Screens hierarchy
    Reporting Console as Standalone Server
      Integration with CloverETL Server
    Hardware and Software Requirements
    Installation
      Tomcat, Jetty
      Websphere
      Glassfish
      Weblogic
      JBoss
      Default Configuration
    Configuration
      Base Configuration
      Alternative ways of configuration
      Database Support
        Derby
        MSSQL
        MySQL
        Oracle
        PostgreSQL
        JNDI
      Configuring CloverETL Server
        Connection pooling
      User Accounts Settings
    Permissions
      Group-level permissions
      Sandbox-level permissions
      Public API Authorization
    Public API
      Historic Metric Values
      RSS Feed
  Advanced Topics
    Configuration
      Run configurations
      Preferences
    File URL
  Integration with CloverETL
    Using Data Profiler Feature within Designer
      Profiler job (.cpj) editing
      Data Profiler Graph Components
        ProfilerProbe
        ExecuteProfilerJob
    Profiler-Designer Element Sharing
  List of Metrics
CloverETL Designer
  Overview
    Family of CloverETL Products
      Introduction
      CloverETL Designer
      CloverETL Server
      CloverETL Cluster
      CloverETL Community Edition
    Getting Additional Information
      Online sources
  Installation
    System Requirements
      Installation types
      Related Links
    Downloading
    Installing
    Starting
    Activating
      Activation using License key
      Activation online
    Other Options of Installation
      Installing Designer as Eclipse Plugin
      Activating Eclipse Plugin
    License Manager
      CloverETL License Dialog
  Configuration
    Runtime Configuration
    Java Configuration
    Engine Configuration
  Using Designer
    Designer User Interface
      CloverETL Designer Panes
        Graph Editor with Palette of Components
        Navigator Pane
        Outline Pane
        Tabs Pane
        Execution Tab
      Keyboard Shortcuts
    Projects
      Creating CloverETL Projects
        CloverETL Project
        CloverETL Server Project
        CloverETL Examples Project
      Structure of CloverETL Projects
        Standard Structure of All CloverETL Projects
        Workspace.prm File
        Opening the CloverETL Perspective
    Graphs
      Creating Empty Graphs
      Creating a Simple Graph in a Few Simple Steps
    Execution
      Successful Graph Execution
      Configuring the Graph Run
        Program Arguments
      Connecting to a Running Job
    Common Dialogs
      URL File Dialog
      Edit Value Dialog
      Open Type Dialog
    Import
      Import CloverETL Projects
      Import from CloverETL Server Sandbox
      Import Graphs
      Import Metadata
        Metadata from XSD
        Metadata from DDL
    Export
      Export Graphs to HTML
      Export to CloverETL Server Sandbox
      Export Image
    Graph tracking
      Enlarging the Font of Displayed Numbers
    Search Functionality
    Working with CloverETL Server
      CloverETL Server Project Basic Principles
      Opening CloverETL Server Projects
      Connecting via HTTP
      Connecting via HTTPS
        Designer has its Own Certificate
        Designer does not have its Own Certificate
      Connecting via proxy server
  ETL Graphs
    Components
      Find / Add Components
        Finding Components
        Adding Components
      Common Properties of All Components
        Edit Component Dialog
        Component Name
        Phases
        Enable/Disable Component
        PassThrough Mode
        Component Allocation
      Common Properties of Most Components
        Metadata Templates
        Time Intervals
        Group Key
          Ordering type
        Sort Key
        Defining Transformations
    Edges
      What Are the Edges?
      Connecting Components by the Edges
      Types of Edges
      Assigning Metadata to the Edges
      Propagating Metadata through the Edges
      Colors of the Edges
      Debugging the Edges
        Enabling Debug
        Selecting Debug Data
        Viewing Debug Data
        Turning Off Debug
      Edge Memory Allocation
    Metadata
      Data Types and Record Types
        Data Types in Metadata
        Record Types
      Data Formats
        Date and Time Format
        Numeric Format
        Boolean Format
        String Format
      Locale and Locale Sensitivity
        Locale
        Locale Sensitivity
      Time Zone
      Autofilling Functions
      Auto-propagated metadata
      Internal Metadata
        Creating Internal Metadata
        Externalizing Internal Metadata
        Exporting Internal Metadata
      External (Shared) Metadata
        Creating External (Shared) Metadata
        Linking External (Shared) Metadata
        Internalizing External (Shared) Metadata
      Creating Metadata
        Extracting Metadata from a Flat File
        Extracting Metadata from an XLS(X) File
        Extracting Metadata from a Database
        Extracting Metadata from a DBase File
        Extracting Metadata from Lotus Notes
        Creating Metadata by User
      Merging existing metadata
      Dynamic Metadata
      Reading Metadata from Special Sources
      Creating Database Table from Metadata and Database Connection
      Metadata Editor
        Basics of Metadata Editor
        Record Pane
        Field Name vs. Label vs. Description
        Details Pane
      Changing and Defining Delimiters
        Changing Record Delimiter
        Changing Default Delimiter
        Defining Non-Default Delimiter for a Field
      Editing Metadata in the Source Code
      Multivalue Fields
        Lists and Maps Support in Components
        Joininig on Lists and Maps (Comparison Rules)
    Connections
      Database Connections
        Internal Database Connections
        External (Shared) Database Connections
        Database Connection Wizard
        Encrypting the Access Password
        Browsing Database and Extracting Metadata from Database Tables
        Windows Authentication on Microsoft SQL Server
          Getting the Native Library
          Installation
        Hive Connection
      JMS Connections
        Internal JMS Connections
        External (Shared) JMS Connections
        Edit JMS Connection Wizard
        Encrypting the Authentication Password
      QuickBase Connections
      Lotus Connections
      Hadoop Connections
        Libraries needed for Hadoop
      MongoDB Connections
    Lookup Tables
      LookupTables in CloverETL Cluster environment
      Internal Lookup Tables
        Creating Internal Lookup Tables
        Externalizing Internal Lookup Tables
        Exporting Internal Lookup Tables
      External (Shared) Lookup Tables
        Creating External (Shared) Lookup Tables
        Linking External (Shared) Lookup Tables
        Internalizing External (Shared) Lookup Tables
      Types of Lookup Tables
        Simple Lookup Table
        Database Lookup Table
        Range Lookup Table
        Persistent Lookup Table
        Aspell Lookup Table
    Sequences
      Internal Sequences
        Creating Internal Sequences
        Externalizing Internal Sequences
        Exporting Internal Sequences
      External (Shared) Sequences
        Creating External (Shared) Sequences
        Linking External (Shared) Sequences
        Internalizing External (Shared) Sequences
      Editing a Sequence
    Parameters
      Internal Parameters
        Externalizing Internal Parameters
      External (Shared) Parameters
        Internalizing External (Shared) Parameters
        XML schema of external parameters
      Graph parameter editor
      Secure graph parameters
      Parameters with CTL Expressions (Dynamic parameters)
      Environment Variables
      Canonizing File Paths
      Using Parameters
    Internal/External Graph Elements
      Internal Graph Elements
      External (Shared) Graph Elements
      Working with Graph Elements
      Advantages of External (Shared) Graph Elements
      Advantages of Internal Graph Elements
      Changes of the Form of Graph Elements
    Dictionary
      Creating a Dictionary
      Using the Dictionary in a Graph
    Notes in the Graphs
    Transformations
  Subgraphs
    Overview
      Introduction
      Design & Execution
      Subgraphs vs. Jobflow
    Using Subgraphs
      Using Subgraphs
      Configuring Subgraphs
    Developing Subgraphs
      Wrapping
      Creating from Scratch
      Making Subgraph Configurable
      Developing and Testing Subgraphs
      Metadata Propagation
    Design Patterns
      Readers
      Writers
      Transformers
      Executors
  Jobflow
    Jobflow Overview
      Introduction
      Important Concepts
      Advanced Concepts
    Jobflow Design Patterns
  Component Reference
    Readers
      Common Properties of Readers
        Supported File URL Formats for Readers
        Viewing Data on Readers
        Input Port Reading
        Incremental Reading
        Selecting Input Records
        Data Policy
        XML Features
        CTL Templates for Readers
        Java Interfaces for Readers
      CloverDataReader
      ComplexDataReader
      DataGenerator
      DBFDataReader
      DBInputTable
      EmailReader
      HadoopReader
      JavaBeanReader
      JMSReader
      JSONExtract
      JSONReader
      LDAPReader
      LotusReader
      MongoDBReader
      MultiLevelReader
      ParallelReader
      QuickBaseRecordReader
      QuickBaseQueryReader
      SpreadsheetDataReader
      UniversalDataReader
      XMLExtract
      XMLReader
      XMLXPathReader
    Writers
      Common Properties of Writers
        Supported File URL Formats for Writers
        Viewing Data on Writers
        Output Port Writing
        How and Where Data Should Be Written
        Selecting Output Records
        Partitioning Output into Different Output Files
        Java Interfaces for Writers
      CloverDataWriter
      DB2DataWriter
      DBFDataWriter
      DBOutputTable
      EmailSender
      HadoopWriter
      InfobrightDataWriter
      InformixDataWriter
      JavaBeanWriter
      JavaMapWriter
      JMSWriter
      JSONWriter
      LDAPWriter
      LotusWriter
      MongoDBWriter
      MSSQLDataWriter
      MySQLDataWriter
      OracleDataWriter
      PostgreSQLDataWriter
      QuickBaseImportCSV
      QuickBaseRecordWriter
      SpreadsheetDataWriter
      StructuredDataWriter
      TableauWriter
      Trash
      UniversalDataWriter
      XMLWriter
    Transformers
      Common Properties of Transformers
        CTL Templates for Transformers
        Java Interfaces for Transformers
      Aggregate
      Concatenate
      DataIntersection
      DataSampler
      Dedup
      Denormalizer
      ExtFilter
      ExtSort
      FastSort
      LoadBalancingPartition
      Merge
      MetaPivot
      Normalizer
      Partition
      Pivot
      Reformat
      Rollup
      SimpleCopy
      SimpleGather
      SortWithinGroups
      XSLTransformer
    Joiners
      Common Properties of Joiners
        Join Types
        Slave Duplicates
        CTL Templates for Joiners
        Java Interfaces for Joiners
      ApproximativeJoin
      Combine
      DBJoin
      ExtHashJoin
      ExtMergeJoin
      LookupJoin
      RelationalJoin
    Job Control
      Common Properties of Job Control
      Barrier
      Condition
      ExecuteGraph
      ExecuteJobflow
      ExecuteMapReduce
      ExecuteProfilerJob
      ExecuteScript
      Fail
      GetJobInput
      KillGraph
      KillJobflow
      Loop
      MonitorGraph
      MonitorJobflow
      SetJobOutput
      Sleep
      Subgraph
      Success
      TokenGather
    File Operations
      Common Properties of File Operations
        Supported URL Formats for File Operations
      CopyFiles
      CreateFiles
      DeleteFiles
      ListFiles
      MoveFiles
    Cluster Components
      Common Properties of Cluster Components
      ClusterPartition
      ClusterLoadBalancingPartition
      ClusterSimpleCopy
      ClusterSimpleGather
      ClusterMerge
      ClusterRepartition
    Data Quality
      Common Properties of Data Quality
      AddressDoctor 5
      EmailFilter
      ProfilerProbe
      Validator
        List of rules
    Others
      Common Properties of Others
      CheckForeignKey
      DBExecute
      HTTPConnector
      JavaExecute
      LookupTableReaderWriter
      MongoDBExecute
      RunGraph
        RunGraph on CloverETL Server
      SequenceChecker
      SystemExecute
      WebServiceClient
  CTL2 - CloverETL Transformation Language
    Overview
    Language Reference
      Program Structure
      Comments
      Import
      Data Types in CTL2
      Literals
      Variables
      Dictionary in CTL2
      Operators
        Arithmetic Operators
        Relational Operators
        Logical Operators
        Assignment Operator
      Simple Statement and Block of Statements
      Control Statements
        Conditional Statements
        Iteration Statements
        Jump Statements
      Error Handling
      Functions
        Message Function
      Conditional Fail Expression
      Accessing Data Records and Fields
      Mapping
      Parameters
      Regular Expressions
    Functions Reference
      Conversion Functions
      Date Functions
      Mathematical Functions
      String Functions
      Container Functions
      Record Functions (dynamic field access)
      Miscellaneous Functions
      Lookup Table Functions
      Sequence Functions
      Custom CTL Functions
      CTL2 Appendix - List of National-specific Characters
    Compatibility
      CTL1 vs. CTL2 Comparison
        Typed Language
        Arbitrary Order of Code Parts
        Compiled Mode
        Access to Graph Elements (Lookups, Sequences, ...)
        Metadata
      Migrating CTL1 to CTL2
  Tutorial
    Creating a Project and a Graph
    Creating a New Data File
    Pasting Components in the Graph Editor Pane
    Connecting Components by the Edges
    Extracting Metadata from the Input File
    Assigning Metadata to the Edges
    Propagating Metadata
    Setting Up Readers (UniversalDataReader)
    Setting Up the ExtFilter Component
    Setting Up the ExtSort Component
    Setting Up Writers (UniversalDataWriter)
    Running the Graph
    Refreshing the Data-Out Folder
    Opening the Output File
  Custom Component
    Creating a Custom Component
      Component Java Definition
      Plugin.xml
    Integrating a Custom Component in CloverETL Designer
      Plug-in Project
      Component XML Definition
      Plug-in Dependencies
      Plug-in Extensions
      Import Requisities
      Plug-in Building
      Troubleshooting
    Tips for Advanced
  Overview
    Family of CloverETL Products
      Introduction
      CloverETL Designer
      CloverETL Server
      CloverETL Cluster
      CloverETL Community Edition
    Getting Additional Information
      Online sources
  Installation
    System Requirements
      Installation types
      Related Links
    Downloading
    Installing
    Starting
    Activating
      Activation using License key
      Activation online
    Other Options of Installation
      Installing Designer as Eclipse Plugin
      Activating Eclipse Plugin
    License Manager
      CloverETL License Dialog
  Configuration
    Runtime Configuration
    Java Configuration
    Engine Configuration
  Using Designer
    Designer User Interface
      CloverETL Designer Panes
        Graph Editor with Palette of Components
        Navigator Pane
        Outline Pane
        Tabs Pane
        Execution Tab
      Keyboard Shortcuts
    Projects
      Creating CloverETL Projects
        CloverETL Project
        CloverETL Server Project
        CloverETL Examples Project
      Structure of CloverETL Projects
        Standard Structure of All CloverETL Projects
        Workspace.prm File
        Opening the CloverETL Perspective
    Graphs
      Creating Empty Graphs
      Creating a Simple Graph in a Few Simple Steps
    Execution
      Successful Graph Execution
      Configuring the Graph Run
        Program Arguments
      Connecting to a Running Job
    Common Dialogs
      URL File Dialog
      Edit Value Dialog
      Open Type Dialog
    Import
      Import CloverETL Projects
      Import from CloverETL Server Sandbox
      Import Graphs
      Import Metadata
        Metadata from XSD
        Metadata from DDL
    Export
      Export Graphs to HTML
      Export to CloverETL Server Sandbox
      Export Image
    Graph tracking
      Enlarging the Font of Displayed Numbers
    Search Functionality
    Working with CloverETL Server
      CloverETL Server Project Basic Principles
      Opening CloverETL Server Projects
      Connecting via HTTP
      Connecting via HTTPS
        Designer has its Own Certificate
        Designer does not have its Own Certificate
      Connecting via proxy server
  ETL Graphs
    Components
      Find / Add Components
        Finding Components
        Adding Components
      Common Properties of All Components
        Edit Component Dialog
        Component Name
        Phases
        Enable/Disable Component
        PassThrough Mode
        Component Allocation
      Common Properties of Most Components
        Metadata Templates
        Time Intervals
        Group Key
          Ordering type
        Sort Key
        Defining Transformations
    Edges
      What Are the Edges?
      Connecting Components by the Edges
      Types of Edges
      Assigning Metadata to the Edges
      Propagating Metadata through the Edges
      Colors of the Edges
      Debugging the Edges
        Enabling Debug
        Selecting Debug Data
        Viewing Debug Data
        Turning Off Debug
      Edge Memory Allocation
    Metadata
      Data Types and Record Types
        Data Types in Metadata
        Record Types
      Data Formats
        Date and Time Format
        Numeric Format
        Boolean Format
        String Format
      Locale and Locale Sensitivity
        Locale
        Locale Sensitivity
      Time Zone
      Autofilling Functions
      Auto-propagated metadata
      Internal Metadata
        Creating Internal Metadata
        Externalizing Internal Metadata
        Exporting Internal Metadata
      External (Shared) Metadata
        Creating External (Shared) Metadata
        Linking External (Shared) Metadata
        Internalizing External (Shared) Metadata
      Creating Metadata
        Extracting Metadata from a Flat File
        Extracting Metadata from an XLS(X) File
        Extracting Metadata from a Database
        Extracting Metadata from a DBase File
        Extracting Metadata from Lotus Notes
        Creating Metadata by User
      Merging existing metadata
      Dynamic Metadata
      Reading Metadata from Special Sources
      Creating Database Table from Metadata and Database Connection
      Metadata Editor
        Basics of Metadata Editor
        Record Pane
        Field Name vs. Label vs. Description
        Details Pane
      Changing and Defining Delimiters
        Changing Record Delimiter
        Changing Default Delimiter
        Defining Non-Default Delimiter for a Field
      Editing Metadata in the Source Code
      Multivalue Fields
        Lists and Maps Support in Components
        Joininig on Lists and Maps (Comparison Rules)
    Connections
      Database Connections
        Internal Database Connections
        External (Shared) Database Connections
        Database Connection Wizard
        Encrypting the Access Password
        Browsing Database and Extracting Metadata from Database Tables
        Windows Authentication on Microsoft SQL Server
          Getting the Native Library
          Installation
        Hive Connection
      JMS Connections
        Internal JMS Connections
        External (Shared) JMS Connections
        Edit JMS Connection Wizard
        Encrypting the Authentication Password
      QuickBase Connections
      Lotus Connections
      Hadoop Connections
        Libraries needed for Hadoop
      MongoDB Connections
    Lookup Tables
      LookupTables in CloverETL Cluster environment
      Internal Lookup Tables
        Creating Internal Lookup Tables
        Externalizing Internal Lookup Tables
        Exporting Internal Lookup Tables
      External (Shared) Lookup Tables
        Creating External (Shared) Lookup Tables
        Linking External (Shared) Lookup Tables
        Internalizing External (Shared) Lookup Tables
      Types of Lookup Tables
        Simple Lookup Table
        Database Lookup Table
        Range Lookup Table
        Persistent Lookup Table
        Aspell Lookup Table
    Sequences
      Internal Sequences
        Creating Internal Sequences
        Externalizing Internal Sequences
        Exporting Internal Sequences
      External (Shared) Sequences
        Creating External (Shared) Sequences
        Linking External (Shared) Sequences
        Internalizing External (Shared) Sequences
      Editing a Sequence
    Parameters
      Internal Parameters
        Externalizing Internal Parameters
      External (Shared) Parameters
        Internalizing External (Shared) Parameters
        XML schema of external parameters
      Graph parameter editor
      Secure graph parameters
      Parameters with CTL Expressions (Dynamic parameters)
      Environment Variables
      Canonizing File Paths
      Using Parameters
    Internal/External Graph Elements
      Internal Graph Elements
      External (Shared) Graph Elements
      Working with Graph Elements
      Advantages of External (Shared) Graph Elements
      Advantages of Internal Graph Elements
      Changes of the Form of Graph Elements
    Dictionary
      Creating a Dictionary
      Using the Dictionary in a Graph
    Notes in the Graphs
    Transformations
  Subgraphs
    Overview
      Introduction
      Design & Execution
      Subgraphs vs. Jobflow
    Using Subgraphs
      Using Subgraphs
      Configuring Subgraphs
    Developing Subgraphs
      Wrapping
      Creating from Scratch
      Making Subgraph Configurable
      Developing and Testing Subgraphs
      Metadata Propagation
    Design Patterns
      Readers
      Writers
      Transformers
      Executors
  Jobflow
    Jobflow Overview
      Introduction
      Important Concepts
      Advanced Concepts
    Jobflow Design Patterns
  Component Reference
    Readers
      Common Properties of Readers
        Supported File URL Formats for Readers
        Viewing Data on Readers
        Input Port Reading
        Incremental Reading
        Selecting Input Records
        Data Policy
        XML Features
        CTL Templates for Readers
        Java Interfaces for Readers
      CloverDataReader
      ComplexDataReader
      DataGenerator
      DBFDataReader
      DBInputTable
      EmailReader
      HadoopReader
      JavaBeanReader
      JMSReader
      JSONExtract
      JSONReader
      LDAPReader
      LotusReader
      MongoDBReader
      MultiLevelReader
      ParallelReader
      QuickBaseRecordReader
      QuickBaseQueryReader
      SpreadsheetDataReader
      UniversalDataReader
      XMLExtract
      XMLReader
      XMLXPathReader
    Writers
      Common Properties of Writers
        Supported File URL Formats for Writers
        Viewing Data on Writers
        Output Port Writing
        How and Where Data Should Be Written
        Selecting Output Records
        Partitioning Output into Different Output Files
        Java Interfaces for Writers
      CloverDataWriter
      DB2DataWriter
      DBFDataWriter
      DBOutputTable
      EmailSender
      HadoopWriter
      InfobrightDataWriter
      InformixDataWriter
      JavaBeanWriter
      JavaMapWriter
      JMSWriter
      JSONWriter
      LDAPWriter
      LotusWriter
      MongoDBWriter
      MSSQLDataWriter
      MySQLDataWriter
      OracleDataWriter
      PostgreSQLDataWriter
      QuickBaseImportCSV
      QuickBaseRecordWriter
      SpreadsheetDataWriter
      StructuredDataWriter
      TableauWriter
      Trash
      UniversalDataWriter
      XMLWriter
    Transformers
      Common Properties of Transformers
        CTL Templates for Transformers
        Java Interfaces for Transformers
      Aggregate
      Concatenate
      DataIntersection
      DataSampler
      Dedup
      Denormalizer
      ExtFilter
      ExtSort
      FastSort
      LoadBalancingPartition
      Merge
      MetaPivot
      Normalizer
      Partition
      Pivot
      Reformat
      Rollup
      SimpleCopy
      SimpleGather
      SortWithinGroups
      XSLTransformer
    Joiners
      Common Properties of Joiners
        Join Types
        Slave Duplicates
        CTL Templates for Joiners
        Java Interfaces for Joiners
      ApproximativeJoin
      Combine
      DBJoin
      ExtHashJoin
      ExtMergeJoin
      LookupJoin
      RelationalJoin
    Job Control
      Common Properties of Job Control
      Barrier
      Condition
      ExecuteGraph
      ExecuteJobflow
      ExecuteMapReduce
      ExecuteProfilerJob
      ExecuteScript
      Fail
      GetJobInput
      KillGraph
      KillJobflow
      Loop
      MonitorGraph
      MonitorJobflow
      SetJobOutput
      Sleep
      Subgraph
      Success
      TokenGather
    File Operations
      Common Properties of File Operations
        Supported URL Formats for File Operations
      CopyFiles
      CreateFiles
      DeleteFiles
      ListFiles
      MoveFiles
    Cluster Components
      Common Properties of Cluster Components
      ClusterPartition
      ClusterLoadBalancingPartition
      ClusterSimpleCopy
      ClusterSimpleGather
      ClusterMerge
      ClusterRepartition
    Data Quality
      Common Properties of Data Quality
      AddressDoctor 5
      EmailFilter
      ProfilerProbe
      Validator
        List of rules
    Others
      Common Properties of Others
      CheckForeignKey
      DBExecute
      HTTPConnector
      JavaExecute
      LookupTableReaderWriter
      MongoDBExecute
      RunGraph
        RunGraph on CloverETL Server
      SequenceChecker
      SystemExecute
      WebServiceClient
  CTL2 - CloverETL Transformation Language
    Overview
    Language Reference
      Program Structure
      Comments
      Import
      Data Types in CTL2
      Literals
      Variables
      Dictionary in CTL2
      Operators
        Arithmetic Operators
        Relational Operators
        Logical Operators
        Assignment Operator
      Simple Statement and Block of Statements
      Control Statements
        Conditional Statements
        Iteration Statements
        Jump Statements
      Error Handling
      Functions
        Message Function
      Conditional Fail Expression
      Accessing Data Records and Fields
      Mapping
      Parameters
      Regular Expressions
    Functions Reference
      Conversion Functions
      Date Functions
      Mathematical Functions
      String Functions
      Container Functions
      Record Functions (dynamic field access)
      Miscellaneous Functions
      Lookup Table Functions
      Sequence Functions
      Custom CTL Functions
      CTL2 Appendix - List of National-specific Characters
    Compatibility
      CTL1 vs. CTL2 Comparison
        Typed Language
        Arbitrary Order of Code Parts
        Compiled Mode
        Access to Graph Elements (Lookups, Sequences, ...)
        Metadata
      Migrating CTL1 to CTL2
  Tutorial
    Creating a Project and a Graph
    Creating a New Data File
    Pasting Components in the Graph Editor Pane
    Connecting Components by the Edges
    Extracting Metadata from the Input File
    Assigning Metadata to the Edges
    Propagating Metadata
    Setting Up Readers (UniversalDataReader)
    Setting Up the ExtFilter Component
    Setting Up the ExtSort Component
    Setting Up Writers (UniversalDataWriter)
    Running the Graph
    Refreshing the Data-Out Folder
    Opening the Output File
  Custom Component
    Creating a Custom Component
      Component Java Definition
      Plugin.xml
    Integrating a Custom Component in CloverETL Designer
      Plug-in Project
      Component XML Definition
      Plug-in Dependencies
      Plug-in Extensions
      Import Requisities
      Plug-in Building
      Troubleshooting
    Tips for Advanced
CloverETL Server
  CloverETL Server
    What is CloverETL Server?
  Installation instructions
    System Requirements for CloverETL Server
    Installing
      Evaluation Server
      Enterprise Server
        Apache Tomcat
        Jetty
        IBM WebSphere
        Glassfish / Sun Java System Application Server
        JBoss AS / JBoss Enterprise Application Platform
        Oracle WebLogic Server
      Installation of CloverETL Server License
        Installation of CloverETL Server License using a web form
        Installation of CloverETL Server License using a license.file property
        Separate License WAR
      Possible issues during installation
    Postinstallation configuration
      Memory Settings
      Maximum Number of Open Files
    Upgrading Server to Newer Version
  Configuration
    Config Sources and Their Priorities
    Examples of DB Connection Configuration
      Embedded Apache Derby
      MySQL
      DB2
      Oracle
      MS SQL
      Postgre SQL
      JNDI DB DataSource
    List of Properties
    Secure configuration properties
    Logging
  Administration
    Temp Space Management
      Overview
      Management
    Secure parameters
    Users and Groups
      LDAP authentication
      Web GUI section Users
      Web GUI section Groups
    Server Side Job files - Sandboxes
      Referencing files from the ETL graph or Jobflow
      Sandbox Content Security and Permissions
      Sandbox Content
      Job config properties
      WebDAV access to sandboxes
        WebDAV clients
        WebDAV authentication/authorization
    CloverETL Server Monitoring
      Standalone server detail
      Cluster overview
      Node detail
      Server Logs
    Server Configuration Migration
      Server Configuration Export
      Server Configuration Import
  Using Graphs
    Graph/Jobflow parameters
      Parameters by execution type
        Executed from Web GUI
        Executed by Launch Service invocation
        Executed by HTTP API run graph operation invocation
        Executed by RunGraph component
        Executed by WS API method executeGraph invocation
        Executed by task "graph execution" by scheduler
        Executed from JMS listener
        Executed by task "Start a graph" by graph/jobflow event listener
        Executed by task "graph execution" by file event listener
      How to add another graph parameters
        Additional "Graph Config Parameters"
        Task "execute_graph" parameters
    Manual task execution
    Scheduling
      Timetable Setting
      Tasks
    Viewing Job Runs - Executions History
    Listeners
      Graph Event Listeners
        Graph Events
        Listener
        Tasks
        Use cases
      Jobflow Event Listeners
        Jobflow Events
        Listener
        Tasks
      JMS messages listeners
      Universal event listeners
        Evaluation Critieria
      File event listeners
        Observed file
        File Events
        Check interval, Task and Use cases
    API
      Simple HTTP API
      JMX mBean
        JMX configuration
        Operations
      SOAP WebService API
        SOAP WS Client
        SOAP WS API authentication/authorization
      Launch Services
        Launch services authentication
        Sending the Data to Launch Service
        Results of the Graph Execution
      CloverETL Server API Extensibility
        Groovy Code API
        Embedded OSGi Framework
    Recommendations for transformations developers
      Add external libraries to app-server classpath
      Another graphs executed by RunGraph component may be executed only in the same JVM instance
    Extensibility - CloverETL Engine Plugins
  Cluster
    Clustering features
      High Availability
      Scalability
        Transformation Requests
        Parallel Data Processing
      Graph allocation examples
      Example of Distributed Execution
        Details of the Example Transformation Design
        Scalability of the Example Transformation
    Cluster configuration
      Mandatory properties
      Optional properties
      Example of 2 node cluster configuration
      Load balancing properties
      Cluster reliability in unreliable network environment
        nodeA can't establish HTTP connection to nodeB
        nodeA can't establish TCP connection (port 7800 by default) to nodeB
        nodeB is killed or it can't connect to the database
        long-term network malfunction may cause hang-on jobs
    Recommendations for Cluster Deployment
  CloverETL Server
    What is CloverETL Server?
  Installation instructions
    System Requirements for CloverETL Server
    Installing
      Evaluation Server
      Enterprise Server
        Apache Tomcat
        Jetty
        IBM WebSphere
        Glassfish / Sun Java System Application Server
        JBoss AS / JBoss Enterprise Application Platform
        Oracle WebLogic Server
      Installation of CloverETL Server License
        Installation of CloverETL Server License using a web form
        Installation of CloverETL Server License using a license.file property
        Separate License WAR
      Possible issues during installation
    Postinstallation configuration
      Memory Settings
      Maximum Number of Open Files
    Upgrading Server to Newer Version
  Configuration
    Config Sources and Their Priorities
    Examples of DB Connection Configuration
      Embedded Apache Derby
      MySQL
      DB2
      Oracle
      MS SQL
      Postgre SQL
      JNDI DB DataSource
    List of Properties
    Secure configuration properties
    Logging
  Administration
    Temp Space Management
      Overview
      Management
    Secure parameters
    Users and Groups
      LDAP authentication
      Web GUI section Users
      Web GUI section Groups
    Server Side Job files - Sandboxes
      Referencing files from the ETL graph or Jobflow
      Sandbox Content Security and Permissions
      Sandbox Content
      Job config properties
      WebDAV access to sandboxes
        WebDAV clients
        WebDAV authentication/authorization
    CloverETL Server Monitoring
      Standalone server detail
      Cluster overview
      Node detail
      Server Logs
    Server Configuration Migration
      Server Configuration Export
      Server Configuration Import
  Using Graphs
    Graph/Jobflow parameters
      Parameters by execution type
        Executed from Web GUI
        Executed by Launch Service invocation
        Executed by HTTP API run graph operation invocation
        Executed by RunGraph component
        Executed by WS API method executeGraph invocation
        Executed by task "graph execution" by scheduler
        Executed from JMS listener
        Executed by task "Start a graph" by graph/jobflow event listener
        Executed by task "graph execution" by file event listener
      How to add another graph parameters
        Additional "Graph Config Parameters"
        Task "execute_graph" parameters
    Manual task execution
    Scheduling
      Timetable Setting
      Tasks
    Viewing Job Runs - Executions History
    Listeners
      Graph Event Listeners
        Graph Events
        Listener
        Tasks
        Use cases
      Jobflow Event Listeners
        Jobflow Events
        Listener
        Tasks
      JMS messages listeners
      Universal event listeners
        Evaluation Critieria
      File event listeners
        Observed file
        File Events
        Check interval, Task and Use cases
    API
      Simple HTTP API
      JMX mBean
        JMX configuration
        Operations
      SOAP WebService API
        SOAP WS Client
        SOAP WS API authentication/authorization
      Launch Services
        Launch services authentication
        Sending the Data to Launch Service
        Results of the Graph Execution
      CloverETL Server API Extensibility
        Groovy Code API
        Embedded OSGi Framework
    Recommendations for transformations developers
      Add external libraries to app-server classpath
      Another graphs executed by RunGraph component may be executed only in the same JVM instance
    Extensibility - CloverETL Engine Plugins
  Cluster
    Clustering features
      High Availability
      Scalability
        Transformation Requests
        Parallel Data Processing
      Graph allocation examples
      Example of Distributed Execution
        Details of the Example Transformation Design
        Scalability of the Example Transformation
    Cluster configuration
      Mandatory properties
      Optional properties
      Example of 2 node cluster configuration
      Load balancing properties
      Cluster reliability in unreliable network environment
        nodeA can't establish HTTP connection to nodeB
        nodeA can't establish TCP connection (port 7800 by default) to nodeB
        nodeB is killed or it can't connect to the database
        long-term network malfunction may cause hang-on jobs
    Recommendations for Cluster Deployment