Batch Processor Node is used to execute tasks in parallel batches until all elements of the batch array are traversed. It belongs to Basic Node and supports configuring input variables, batch processing parallel cap, batch array, and batch body (workflow), executing specific workflows in parallel.
Note:
Difference Between Batch Processor Node and Loop Node: Loop Node processes array elements serially, executes the loop body workflow in sequence, and allows conditional judgment on each loop execution result to achieve early termination. Batch Processing Node processes array elements in parallel batches without early termination, suitable for parallel processing scenarios with large amounts of data, such as parallel analysis of media articles and data preprocessing.
Directions
Input Variables
Input variables take effect only within the same node and cannot be used cross-node. Support up to 50 input variables to meet scene requirements. Click "Add" to configure input variables as follows.
Configuration
Description
Variable Name
The variable name can only contain letters, digits, or underscores, must start with a letter or underscore, and is mandatory.
Data source
The data source of this variable supports two options: "refer" and "input". "Refer" allows selecting output variables from all preceding nodes, while "input" supports manually filling in a fixed value.
Type
The data type of this variable cannot be selected and defaults to the variable type of "refer" or the string type of "input".
Batch Processing Settings
Used to set the batch processing execution process, including the following two items:
Max parallel batches: Indicates the number of parallel batch processing tasks, used to control how many batch operations can execute simultaneously. Supports a setting range of 1–10. When set to 1, it performs serial execution, with the same effect as the "traverse all elements" function of a loop node.
Batch array: Refers to the array used for executing batch processing tasks. The system will sequentially extract elements from the batch processing array and execute the batch operations according to the batch processing parallel cap.
Note:
Batch array can only select array type of variables, such as array<string>, array<int>, array<object>.
Batch Processor Body
The workflow for batch processing supports selecting workflows in awaiting release and released statuses. After selecting a workflow, the page will automatically display its input variables and support users in setting the data sources for these variables.
Batch Processor Body Input Variable
Batch Processor Body Input Variable refers to the selected input variable of the batch processing workflow, supporting referencing input variables of the processing node as well as elements in an array (introduced via the item field, for example, if the batch processing array is arrObj, use arrObj.Item to reference elements in the array).
Output Variable
The output variable processed by this node includes the aggregated Results after batch processing (data type: array<object>) as well as runtime Error info (data type: object, this field is empty during normal operation). Manual addition is not supported.
Application Example
Batch analyze social media articles, output the label and positive and negative emotion.
Batch Processor Node configuration is as follows:
FAQs
If the number of array elements in batch processing exceeds the Max parallel batches, how to handle it?
At this point, the system will run elements in the batch processing array sequentially based on the parallel capacity limit, while other elements will wait via the queuing mechanism.
