ParallelPartition

Not available in Community Designer

Short Description
Ports
Metadata
ParallelPartition Attributes
Details
Compatibility
See also

Short Description

ParallelPartition distributes incoming data records among different CloverETL Cluster workers. The algorithm of the component is derived from the regular Partition component.

ComponentSame input metadataSorted inputsInputsOutputsJavaCTLAuto-propagated metadata
ParallelPartition
yes
no
11[1][2][2]
yes

[1]  The single output port represents multiple virtual output ports.

[2]  ParallelPartition can use either a transformation or two other attributes (Ranges and/or Partition key). A transformation must be defined unless at least one of the attributes is specified.

Ports

Port typeNumberRequiredDescriptionMetadata
Input0
yes
For input data recordsAny
Output0
yes
For output data recordsInput 0

Metadata

ParallelPartition propagates metadata in both directions. The component does not change priority of propagated metadata.

The component has no metadata templates.

The component does not require any specific metadata fields on its ports.

ParallelPartition Attributes

ParallelPartition has same attributes as Partition. See Partition Attributes.

Details

ParallelPartition distributes incoming data records among different CloverETL Cluster workers.

The algorithm of this component is derived from the regular Partition component. For more details about attributes and other component specific behavior, see the documentation of the Partition component.

If the Ranges attribute is used for partitioning, the number of defined ranges must match the allocation of the following component. Use the Add and Remove toolbar buttons to adjust the number of defined ranges:

This component belongs to a group of cluster components that allows the change from a single-worker allocation to a multiple-worker allocation. So the allocation of the component preceding the ParallelPartition component has to provide just a single worker. The allocation of the component following the ParallelPartition component can provide multiple workers.

[Note]Note

For more information about this component, see the CloverETL Cluster documentation (part of CloverETL Server documentation).

Compatibility

3.4

The component is available since version 3.4.

4.3.0-M2

In 4.3.0-M2, ClusterPartition was renamed to ParallelPartition.

See also

ParallelLoadBalancingPartition
ParallelMerge
ParallelRepartition
ParallelSimpleCopy
ParallelSimpleGather
Partition
Common Properties of Components
Specific Attribute Types
Common Properties of Data Partitioning Components