Filters can perform rule-based filtering on data, such as filtering by field size. Only data that meets the rules will be retained.
Must-Knows
Filters perform character-by-character exact matching, and it is important to note case sensitivity. During the matching process, no standardization is performed on the strings.
Values to be matched follow JSON rules: quoted strings, digits, and unquoted keywords true, false, and null.
Matching by Prefix
Key-value matching is performed by comparing prefixes in the data.
Take the data {"password":"topicname"} for example. If you specify the prefix matching value for password as top, then {"password":"topicname"} can be matched successfully.
Matching by Suffix
Key-value matching is performed by comparing suffixes in the data.
Take the data {"password":"topicname"} for example. If you specify the suffix matching value for password as name, then {"password":"topicname"} can be matched successfully.
Matching by Contains
Matching is performed by specifying an existing field in the data.
Take the data {"password":"topicname"} for example. If you specify the contains matching value for password as na, then {"password":"topicname"} can be matched successfully.
Matching by Exclusion
Matching is performed by specifying a field with any value except the provided one.
Take the data {"password":"topicname"} for example. If you specify the exclusion matching value for password as topicname, then only {"password":"topicname"} cannot be matched successfully.
Matching by Value
Matching is performed by specifying the value or range of a field.
Take the data { "numeric": 10} for example. If you specify the matching value for numeric as <15, then { "numeric": 10} can be matched successfully.
Note:
To specify that the value is greater than 10, input: >10.
To specify that the value is greater than or equal to 10, input: >=10.
To specify that the value is greater than or equal to 10 and less than or equal to 20, input: >=10&<=20.
To specify that the value is greater than or equal to 10 or less than or equal to 5, input: >=10|<=5.
Matching by IP Address
Matching is performed by specifying the IP address of a field in the data.
The input content is a classless inter-domain routing (CIDR) address. For example, if you input 1.2.3.4/24, all IP addresses starting with 1.2.3. in the first 24 bits will be matched.
Matching by Filtering Out NULL Data
Matching is performed by filtering out data where the field value is NULL.
If this rule is enabled, the system will check whether the value of the specified field is NULL.
If the field value is NULL, the data record will be filtered out and will not be processed or stored.