Parallelism Spec PPS

Spec #

This is a top-level attribute of the pipeline spec.

{
  "pipeline": {...},
  "transform": {...},
  "parallelismSpec": {
    "constant": int
  },
  ...
}

Behavior #

HPE Machine Learning Data Management starts the number of workers that you specify. For example, set "constant":10 to use 10 workers.

• The default value is 1

When to Use #

Warning

Because spouts and services are designed to be single instances, do not modify the default parallism_spec value for these pipelines.