Skip to main content

filter

Acknowledges all records that get passed to the filter.

Description​

Acknowledges all records that get passed to the filter, so the records will be filtered out if the condition provided to the processor is evaluated to true.

Important: Make sure to add a condition to this processor, otherwise all records will be filtered out.

Configuration parameters​

version: 2.2
pipelines:
  - id: example
    status: running
    connectors:
      # define source and destination ...
    processors:
      - id: example
        plugin: "filter"

Examples​

Filter out the record​

Configuration parameters​

version: 2.2
pipelines:
  - id: example
    status: running
    connectors:
      # define source and destination ...
    processors:
      - id: example
        plugin: "filter"

Record difference​

Before
After
1
-
{
2
-
  "position": null,
3
-
  "operation": "create",
4
-
  "metadata": {
5
-
    "key1": "val1"
6
-
  },
7
-
  "key": null,
8
-
  "payload": {
9
-
    "before": {
10
-
      "bar": "baz"
11
-
    },
12
-
    "after": {
13
-
      "foo": "bar"
14
-
    }
15
-
  }
16
-
}


scarf pixel conduit-site-docs-processors