CSV processor
CSV processor
Extracts fields from CSV line out of a single text field within a document. Any empty field in CSV will be skipped.
Table 10. CSV Options
Name | Required | Default | Description |
---|---|---|---|
| yes | - | The field to extract data from |
| yes | - | The array of fields to assign extracted values to |
| no | , | Separator used in CSV, has to be single character string |
| no | “ | Quote used in CSV, has to be single character string |
| no |
| If |
| no |
| Trim whitespaces in unquoted fields |
| no | - | Value used to fill empty fields, empty fields will be skipped if this is not provided. Empty field is one with no value (2 consecutive separators) or empty quotes ( |
| no | - | Description of the processor. Useful for describing the purpose of the processor or its configuration. |
| no | - | Conditionally execute the processor. See Conditionally run a processor. |
| no |
| Ignore failures for the processor. See Handling pipeline failures. |
| no | - | Handle failures for the processor. See Handling pipeline failures. |
| no | - | Identifier for the processor. Useful for debugging and metrics. |
{
"csv": {
"field": "my_field",
"target_fields": ["field1", "field2"]
}
}
If the trim
option is enabled then any whitespace in the beginning and in the end of each unquoted field will be trimmed. For example with configuration above, a value of A, B
will result in field field2
having value {nbsp}B
(with space at the beginning). If trim
is enabled A, B
will result in field field2
having value B
(no whitespace). Quoted fields will be left untouched.