Language analyzers

A set of analyzers aimed at analyzing specific language text. The following types are supported: arabic, armenian, basque, bengali, brazilian, bulgarian, catalan, cjk, czech, danish, dutch, english, estonian, finnish, french, galician, german, greek, hindi, hungarian, indonesian, irish, italian, latvian, lithuanian, norwegian, persian, portuguese, romanian, russian, sorani, spanish, swedish, turkish, thai.

Configuring language analyzers

Stopwords

All analyzers support setting custom stopwords either internally in the config, or by using an external stopwords file by setting stopwords_path. Check Stop Analyzer for more details.

Excluding words from stemming

The stem_exclusion parameter allows you to specify an array of lowercase words that should not be stemmed. Internally, this functionality is implemented by adding the keyword_marker token filter with the keywords set to the value of the stem_exclusion parameter.

The following analyzers support setting custom stem_exclusion list: arabic, armenian, basque, bengali, bulgarian, catalan, czech, dutch, english, finnish, french, galician, german, hindi, hungarian, indonesian, irish, italian, latvian, lithuanian, norwegian, portuguese, romanian, russian, sorani, spanish, swedish, turkish.

Reimplementing language analyzers

The built-in language analyzers can be reimplemented as custom analyzers (as described below) in order to customize their behaviour.

If you do not intend to exclude words from being stemmed (the equivalent of the stem_exclusion parameter above), then you should remove the keyword_marker token filter from the custom analyzer configuration.

arabic analyzer

The arabic analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /arabic_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "arabic_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_arabic_" 
  9.         },
  10.         "arabic_keywords": {
  11.           "type":       "keyword_marker",
  12.           "keywords":   ["مثال"] 
  13.         },
  14.         "arabic_stemmer": {
  15.           "type":       "stemmer",
  16.           "language":   "arabic"
  17.         }
  18.       },
  19.       "analyzer": {
  20.         "rebuilt_arabic": {
  21.           "tokenizer":  "standard",
  22.           "filter": [
  23.             "lowercase",
  24.             "decimal_digit",
  25.             "arabic_stop",
  26.             "arabic_normalization",
  27.             "arabic_keywords",
  28.             "arabic_stemmer"
  29.           ]
  30.         }
  31.       }
  32.     }
  33.   }
  34. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

armenian analyzer

The armenian analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /armenian_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "armenian_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_armenian_" 
  9.         },
  10.         "armenian_keywords": {
  11.           "type":       "keyword_marker",
  12.           "keywords":   ["օրինակ"] 
  13.         },
  14.         "armenian_stemmer": {
  15.           "type":       "stemmer",
  16.           "language":   "armenian"
  17.         }
  18.       },
  19.       "analyzer": {
  20.         "rebuilt_armenian": {
  21.           "tokenizer":  "standard",
  22.           "filter": [
  23.             "lowercase",
  24.             "armenian_stop",
  25.             "armenian_keywords",
  26.             "armenian_stemmer"
  27.           ]
  28.         }
  29.       }
  30.     }
  31.   }
  32. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

basque analyzer

The basque analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /basque_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "basque_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_basque_" 
  9.         },
  10.         "basque_keywords": {
  11.           "type":       "keyword_marker",
  12.           "keywords":   ["Adibidez"] 
  13.         },
  14.         "basque_stemmer": {
  15.           "type":       "stemmer",
  16.           "language":   "basque"
  17.         }
  18.       },
  19.       "analyzer": {
  20.         "rebuilt_basque": {
  21.           "tokenizer":  "standard",
  22.           "filter": [
  23.             "lowercase",
  24.             "basque_stop",
  25.             "basque_keywords",
  26.             "basque_stemmer"
  27.           ]
  28.         }
  29.       }
  30.     }
  31.   }
  32. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

bengali analyzer

The bengali analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /bengali_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "bengali_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_bengali_" 
  9.         },
  10.         "bengali_keywords": {
  11.           "type":       "keyword_marker",
  12.           "keywords":   ["উদাহরণ"] 
  13.         },
  14.         "bengali_stemmer": {
  15.           "type":       "stemmer",
  16.           "language":   "bengali"
  17.         }
  18.       },
  19.       "analyzer": {
  20.         "rebuilt_bengali": {
  21.           "tokenizer":  "standard",
  22.           "filter": [
  23.             "lowercase",
  24.             "decimal_digit",
  25.             "bengali_keywords",
  26.             "indic_normalization",
  27.             "bengali_normalization",
  28.             "bengali_stop",
  29.             "bengali_stemmer"
  30.           ]
  31.         }
  32.       }
  33.     }
  34.   }
  35. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

brazilian analyzer

The brazilian analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /brazilian_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "brazilian_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_brazilian_" 
  9.         },
  10.         "brazilian_keywords": {
  11.           "type":       "keyword_marker",
  12.           "keywords":   ["exemplo"] 
  13.         },
  14.         "brazilian_stemmer": {
  15.           "type":       "stemmer",
  16.           "language":   "brazilian"
  17.         }
  18.       },
  19.       "analyzer": {
  20.         "rebuilt_brazilian": {
  21.           "tokenizer":  "standard",
  22.           "filter": [
  23.             "lowercase",
  24.             "brazilian_stop",
  25.             "brazilian_keywords",
  26.             "brazilian_stemmer"
  27.           ]
  28.         }
  29.       }
  30.     }
  31.   }
  32. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

bulgarian analyzer

The bulgarian analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /bulgarian_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "bulgarian_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_bulgarian_" 
  9.         },
  10.         "bulgarian_keywords": {
  11.           "type":       "keyword_marker",
  12.           "keywords":   ["пример"] 
  13.         },
  14.         "bulgarian_stemmer": {
  15.           "type":       "stemmer",
  16.           "language":   "bulgarian"
  17.         }
  18.       },
  19.       "analyzer": {
  20.         "rebuilt_bulgarian": {
  21.           "tokenizer":  "standard",
  22.           "filter": [
  23.             "lowercase",
  24.             "bulgarian_stop",
  25.             "bulgarian_keywords",
  26.             "bulgarian_stemmer"
  27.           ]
  28.         }
  29.       }
  30.     }
  31.   }
  32. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

catalan analyzer

The catalan analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /catalan_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "catalan_elision": {
  7.           "type":       "elision",
  8.           "articles":   [ "d", "l", "m", "n", "s", "t"],
  9.           "articles_case": true
  10.         },
  11.         "catalan_stop": {
  12.           "type":       "stop",
  13.           "stopwords":  "_catalan_" 
  14.         },
  15.         "catalan_keywords": {
  16.           "type":       "keyword_marker",
  17.           "keywords":   ["example"] 
  18.         },
  19.         "catalan_stemmer": {
  20.           "type":       "stemmer",
  21.           "language":   "catalan"
  22.         }
  23.       },
  24.       "analyzer": {
  25.         "rebuilt_catalan": {
  26.           "tokenizer":  "standard",
  27.           "filter": [
  28.             "catalan_elision",
  29.             "lowercase",
  30.             "catalan_stop",
  31.             "catalan_keywords",
  32.             "catalan_stemmer"
  33.           ]
  34.         }
  35.       }
  36.     }
  37.   }
  38. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

cjk analyzer

You may find that icu_analyzer in the ICU analysis plugin works better for CJK text than the cjk analyzer. Experiment with your text and queries.

The cjk analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /cjk_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "english_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  [ 
  9.             "a", "and", "are", "as", "at", "be", "but", "by", "for",
  10.             "if", "in", "into", "is", "it", "no", "not", "of", "on",
  11.             "or", "s", "such", "t", "that", "the", "their", "then",
  12.             "there", "these", "they", "this", "to", "was", "will",
  13.             "with", "www"
  14.           ]
  15.         }
  16.       },
  17.       "analyzer": {
  18.         "rebuilt_cjk": {
  19.           "tokenizer":  "standard",
  20.           "filter": [
  21.             "cjk_width",
  22.             "lowercase",
  23.             "cjk_bigram",
  24.             "english_stop"
  25.           ]
  26.         }
  27.       }
  28.     }
  29.   }
  30. }

The default stopwords can be overridden with the stopwords or stopwordspath parameters. The default stop words are almost the same as the _english set, but not exactly the same.

czech analyzer

The czech analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /czech_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "czech_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_czech_" 
  9.         },
  10.         "czech_keywords": {
  11.           "type":       "keyword_marker",
  12.           "keywords":   ["příklad"] 
  13.         },
  14.         "czech_stemmer": {
  15.           "type":       "stemmer",
  16.           "language":   "czech"
  17.         }
  18.       },
  19.       "analyzer": {
  20.         "rebuilt_czech": {
  21.           "tokenizer":  "standard",
  22.           "filter": [
  23.             "lowercase",
  24.             "czech_stop",
  25.             "czech_keywords",
  26.             "czech_stemmer"
  27.           ]
  28.         }
  29.       }
  30.     }
  31.   }
  32. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

danish analyzer

The danish analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /danish_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "danish_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_danish_" 
  9.         },
  10.         "danish_keywords": {
  11.           "type":       "keyword_marker",
  12.           "keywords":   ["eksempel"] 
  13.         },
  14.         "danish_stemmer": {
  15.           "type":       "stemmer",
  16.           "language":   "danish"
  17.         }
  18.       },
  19.       "analyzer": {
  20.         "rebuilt_danish": {
  21.           "tokenizer":  "standard",
  22.           "filter": [
  23.             "lowercase",
  24.             "danish_stop",
  25.             "danish_keywords",
  26.             "danish_stemmer"
  27.           ]
  28.         }
  29.       }
  30.     }
  31.   }
  32. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

dutch analyzer

The dutch analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /dutch_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "dutch_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_dutch_" 
  9.         },
  10.         "dutch_keywords": {
  11.           "type":       "keyword_marker",
  12.           "keywords":   ["voorbeeld"] 
  13.         },
  14.         "dutch_stemmer": {
  15.           "type":       "stemmer",
  16.           "language":   "dutch"
  17.         },
  18.         "dutch_override": {
  19.           "type":       "stemmer_override",
  20.           "rules": [
  21.             "fiets=>fiets",
  22.             "bromfiets=>bromfiets",
  23.             "ei=>eier",
  24.             "kind=>kinder"
  25.           ]
  26.         }
  27.       },
  28.       "analyzer": {
  29.         "rebuilt_dutch": {
  30.           "tokenizer":  "standard",
  31.           "filter": [
  32.             "lowercase",
  33.             "dutch_stop",
  34.             "dutch_keywords",
  35.             "dutch_override",
  36.             "dutch_stemmer"
  37.           ]
  38.         }
  39.       }
  40.     }
  41.   }
  42. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

english analyzer

The english analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /english_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "english_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_english_" 
  9.         },
  10.         "english_keywords": {
  11.           "type":       "keyword_marker",
  12.           "keywords":   ["example"] 
  13.         },
  14.         "english_stemmer": {
  15.           "type":       "stemmer",
  16.           "language":   "english"
  17.         },
  18.         "english_possessive_stemmer": {
  19.           "type":       "stemmer",
  20.           "language":   "possessive_english"
  21.         }
  22.       },
  23.       "analyzer": {
  24.         "rebuilt_english": {
  25.           "tokenizer":  "standard",
  26.           "filter": [
  27.             "english_possessive_stemmer",
  28.             "lowercase",
  29.             "english_stop",
  30.             "english_keywords",
  31.             "english_stemmer"
  32.           ]
  33.         }
  34.       }
  35.     }
  36.   }
  37. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

estonian analyzer

The estonian analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /estonian_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "estonian_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_estonian_" 
  9.         },
  10.         "estonian_keywords": {
  11.           "type":       "keyword_marker",
  12.           "keywords":   ["näide"] 
  13.         },
  14.         "estonian_stemmer": {
  15.           "type":       "stemmer",
  16.           "language":   "estonian"
  17.         }
  18.       },
  19.       "analyzer": {
  20.         "rebuilt_estonian": {
  21.           "tokenizer":  "standard",
  22.           "filter": [
  23.             "lowercase",
  24.             "estonian_stop",
  25.             "estonian_keywords",
  26.             "estonian_stemmer"
  27.           ]
  28.         }
  29.       }
  30.     }
  31.   }
  32. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

finnish analyzer

The finnish analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /finnish_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "finnish_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_finnish_" 
  9.         },
  10.         "finnish_keywords": {
  11.           "type":       "keyword_marker",
  12.           "keywords":   ["esimerkki"] 
  13.         },
  14.         "finnish_stemmer": {
  15.           "type":       "stemmer",
  16.           "language":   "finnish"
  17.         }
  18.       },
  19.       "analyzer": {
  20.         "rebuilt_finnish": {
  21.           "tokenizer":  "standard",
  22.           "filter": [
  23.             "lowercase",
  24.             "finnish_stop",
  25.             "finnish_keywords",
  26.             "finnish_stemmer"
  27.           ]
  28.         }
  29.       }
  30.     }
  31.   }
  32. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

french analyzer

The french analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /french_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "french_elision": {
  7.           "type":         "elision",
  8.           "articles_case": true,
  9.           "articles": [
  10.               "l", "m", "t", "qu", "n", "s",
  11.               "j", "d", "c", "jusqu", "quoiqu",
  12.               "lorsqu", "puisqu"
  13.             ]
  14.         },
  15.         "french_stop": {
  16.           "type":       "stop",
  17.           "stopwords":  "_french_" 
  18.         },
  19.         "french_keywords": {
  20.           "type":       "keyword_marker",
  21.           "keywords":   ["Example"] 
  22.         },
  23.         "french_stemmer": {
  24.           "type":       "stemmer",
  25.           "language":   "light_french"
  26.         }
  27.       },
  28.       "analyzer": {
  29.         "rebuilt_french": {
  30.           "tokenizer":  "standard",
  31.           "filter": [
  32.             "french_elision",
  33.             "lowercase",
  34.             "french_stop",
  35.             "french_keywords",
  36.             "french_stemmer"
  37.           ]
  38.         }
  39.       }
  40.     }
  41.   }
  42. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

galician analyzer

The galician analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /galician_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "galician_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_galician_" 
  9.         },
  10.         "galician_keywords": {
  11.           "type":       "keyword_marker",
  12.           "keywords":   ["exemplo"] 
  13.         },
  14.         "galician_stemmer": {
  15.           "type":       "stemmer",
  16.           "language":   "galician"
  17.         }
  18.       },
  19.       "analyzer": {
  20.         "rebuilt_galician": {
  21.           "tokenizer":  "standard",
  22.           "filter": [
  23.             "lowercase",
  24.             "galician_stop",
  25.             "galician_keywords",
  26.             "galician_stemmer"
  27.           ]
  28.         }
  29.       }
  30.     }
  31.   }
  32. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

german analyzer

The german analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /german_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "german_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_german_" 
  9.         },
  10.         "german_keywords": {
  11.           "type":       "keyword_marker",
  12.           "keywords":   ["Beispiel"] 
  13.         },
  14.         "german_stemmer": {
  15.           "type":       "stemmer",
  16.           "language":   "light_german"
  17.         }
  18.       },
  19.       "analyzer": {
  20.         "rebuilt_german": {
  21.           "tokenizer":  "standard",
  22.           "filter": [
  23.             "lowercase",
  24.             "german_stop",
  25.             "german_keywords",
  26.             "german_normalization",
  27.             "german_stemmer"
  28.           ]
  29.         }
  30.       }
  31.     }
  32.   }
  33. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

greek analyzer

The greek analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /greek_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "greek_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_greek_" 
  9.         },
  10.         "greek_lowercase": {
  11.           "type":       "lowercase",
  12.           "language":   "greek"
  13.         },
  14.         "greek_keywords": {
  15.           "type":       "keyword_marker",
  16.           "keywords":   ["παράδειγμα"] 
  17.         },
  18.         "greek_stemmer": {
  19.           "type":       "stemmer",
  20.           "language":   "greek"
  21.         }
  22.       },
  23.       "analyzer": {
  24.         "rebuilt_greek": {
  25.           "tokenizer":  "standard",
  26.           "filter": [
  27.             "greek_lowercase",
  28.             "greek_stop",
  29.             "greek_keywords",
  30.             "greek_stemmer"
  31.           ]
  32.         }
  33.       }
  34.     }
  35.   }
  36. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

hindi analyzer

The hindi analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /hindi_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "hindi_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_hindi_" 
  9.         },
  10.         "hindi_keywords": {
  11.           "type":       "keyword_marker",
  12.           "keywords":   ["उदाहरण"] 
  13.         },
  14.         "hindi_stemmer": {
  15.           "type":       "stemmer",
  16.           "language":   "hindi"
  17.         }
  18.       },
  19.       "analyzer": {
  20.         "rebuilt_hindi": {
  21.           "tokenizer":  "standard",
  22.           "filter": [
  23.             "lowercase",
  24.             "decimal_digit",
  25.             "hindi_keywords",
  26.             "indic_normalization",
  27.             "hindi_normalization",
  28.             "hindi_stop",
  29.             "hindi_stemmer"
  30.           ]
  31.         }
  32.       }
  33.     }
  34.   }
  35. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

hungarian analyzer

The hungarian analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /hungarian_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "hungarian_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_hungarian_" 
  9.         },
  10.         "hungarian_keywords": {
  11.           "type":       "keyword_marker",
  12.           "keywords":   ["példa"] 
  13.         },
  14.         "hungarian_stemmer": {
  15.           "type":       "stemmer",
  16.           "language":   "hungarian"
  17.         }
  18.       },
  19.       "analyzer": {
  20.         "rebuilt_hungarian": {
  21.           "tokenizer":  "standard",
  22.           "filter": [
  23.             "lowercase",
  24.             "hungarian_stop",
  25.             "hungarian_keywords",
  26.             "hungarian_stemmer"
  27.           ]
  28.         }
  29.       }
  30.     }
  31.   }
  32. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

indonesian analyzer

The indonesian analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /indonesian_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "indonesian_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_indonesian_" 
  9.         },
  10.         "indonesian_keywords": {
  11.           "type":       "keyword_marker",
  12.           "keywords":   ["contoh"] 
  13.         },
  14.         "indonesian_stemmer": {
  15.           "type":       "stemmer",
  16.           "language":   "indonesian"
  17.         }
  18.       },
  19.       "analyzer": {
  20.         "rebuilt_indonesian": {
  21.           "tokenizer":  "standard",
  22.           "filter": [
  23.             "lowercase",
  24.             "indonesian_stop",
  25.             "indonesian_keywords",
  26.             "indonesian_stemmer"
  27.           ]
  28.         }
  29.       }
  30.     }
  31.   }
  32. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

irish analyzer

The irish analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /irish_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "irish_hyphenation": {
  7.           "type":       "stop",
  8.           "stopwords":  [ "h", "n", "t" ],
  9.           "ignore_case": true
  10.         },
  11.         "irish_elision": {
  12.           "type":       "elision",
  13.           "articles":   [ "d", "m", "b" ],
  14.           "articles_case": true
  15.         },
  16.         "irish_stop": {
  17.           "type":       "stop",
  18.           "stopwords":  "_irish_" 
  19.         },
  20.         "irish_lowercase": {
  21.           "type":       "lowercase",
  22.           "language":   "irish"
  23.         },
  24.         "irish_keywords": {
  25.           "type":       "keyword_marker",
  26.           "keywords":   ["sampla"] 
  27.         },
  28.         "irish_stemmer": {
  29.           "type":       "stemmer",
  30.           "language":   "irish"
  31.         }
  32.       },
  33.       "analyzer": {
  34.         "rebuilt_irish": {
  35.           "tokenizer":  "standard",
  36.           "filter": [
  37.             "irish_hyphenation",
  38.             "irish_elision",
  39.             "irish_lowercase",
  40.             "irish_stop",
  41.             "irish_keywords",
  42.             "irish_stemmer"
  43.           ]
  44.         }
  45.       }
  46.     }
  47.   }
  48. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

italian analyzer

The italian analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /italian_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "italian_elision": {
  7.           "type": "elision",
  8.           "articles": [
  9.                 "c", "l", "all", "dall", "dell",
  10.                 "nell", "sull", "coll", "pell",
  11.                 "gl", "agl", "dagl", "degl", "negl",
  12.                 "sugl", "un", "m", "t", "s", "v", "d"
  13.           ],
  14.           "articles_case": true
  15.         },
  16.         "italian_stop": {
  17.           "type":       "stop",
  18.           "stopwords":  "_italian_" 
  19.         },
  20.         "italian_keywords": {
  21.           "type":       "keyword_marker",
  22.           "keywords":   ["esempio"] 
  23.         },
  24.         "italian_stemmer": {
  25.           "type":       "stemmer",
  26.           "language":   "light_italian"
  27.         }
  28.       },
  29.       "analyzer": {
  30.         "rebuilt_italian": {
  31.           "tokenizer":  "standard",
  32.           "filter": [
  33.             "italian_elision",
  34.             "lowercase",
  35.             "italian_stop",
  36.             "italian_keywords",
  37.             "italian_stemmer"
  38.           ]
  39.         }
  40.       }
  41.     }
  42.   }
  43. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

latvian analyzer

The latvian analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /latvian_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "latvian_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_latvian_" 
  9.         },
  10.         "latvian_keywords": {
  11.           "type":       "keyword_marker",
  12.           "keywords":   ["piemērs"] 
  13.         },
  14.         "latvian_stemmer": {
  15.           "type":       "stemmer",
  16.           "language":   "latvian"
  17.         }
  18.       },
  19.       "analyzer": {
  20.         "rebuilt_latvian": {
  21.           "tokenizer":  "standard",
  22.           "filter": [
  23.             "lowercase",
  24.             "latvian_stop",
  25.             "latvian_keywords",
  26.             "latvian_stemmer"
  27.           ]
  28.         }
  29.       }
  30.     }
  31.   }
  32. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

lithuanian analyzer

The lithuanian analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /lithuanian_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "lithuanian_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_lithuanian_" 
  9.         },
  10.         "lithuanian_keywords": {
  11.           "type":       "keyword_marker",
  12.           "keywords":   ["pavyzdys"] 
  13.         },
  14.         "lithuanian_stemmer": {
  15.           "type":       "stemmer",
  16.           "language":   "lithuanian"
  17.         }
  18.       },
  19.       "analyzer": {
  20.         "rebuilt_lithuanian": {
  21.           "tokenizer":  "standard",
  22.           "filter": [
  23.             "lowercase",
  24.             "lithuanian_stop",
  25.             "lithuanian_keywords",
  26.             "lithuanian_stemmer"
  27.           ]
  28.         }
  29.       }
  30.     }
  31.   }
  32. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

norwegian analyzer

The norwegian analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /norwegian_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "norwegian_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_norwegian_" 
  9.         },
  10.         "norwegian_keywords": {
  11.           "type":       "keyword_marker",
  12.           "keywords":   ["eksempel"] 
  13.         },
  14.         "norwegian_stemmer": {
  15.           "type":       "stemmer",
  16.           "language":   "norwegian"
  17.         }
  18.       },
  19.       "analyzer": {
  20.         "rebuilt_norwegian": {
  21.           "tokenizer":  "standard",
  22.           "filter": [
  23.             "lowercase",
  24.             "norwegian_stop",
  25.             "norwegian_keywords",
  26.             "norwegian_stemmer"
  27.           ]
  28.         }
  29.       }
  30.     }
  31.   }
  32. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

persian analyzer

The persian analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /persian_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "char_filter": {
  6.         "zero_width_spaces": {
  7.             "type":       "mapping",
  8.             "mappings": [ "\\u200C=>\\u0020"] 
  9.         }
  10.       },
  11.       "filter": {
  12.         "persian_stop": {
  13.           "type":       "stop",
  14.           "stopwords":  "_persian_" 
  15.         }
  16.       },
  17.       "analyzer": {
  18.         "rebuilt_persian": {
  19.           "tokenizer":     "standard",
  20.           "char_filter": [ "zero_width_spaces" ],
  21.           "filter": [
  22.             "lowercase",
  23.             "decimal_digit",
  24.             "arabic_normalization",
  25.             "persian_normalization",
  26.             "persian_stop"
  27.           ]
  28.         }
  29.       }
  30.     }
  31.   }
  32. }

Replaces zero-width non-joiners with an ASCII space.

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

portuguese analyzer

The portuguese analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /portuguese_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "portuguese_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_portuguese_" 
  9.         },
  10.         "portuguese_keywords": {
  11.           "type":       "keyword_marker",
  12.           "keywords":   ["exemplo"] 
  13.         },
  14.         "portuguese_stemmer": {
  15.           "type":       "stemmer",
  16.           "language":   "light_portuguese"
  17.         }
  18.       },
  19.       "analyzer": {
  20.         "rebuilt_portuguese": {
  21.           "tokenizer":  "standard",
  22.           "filter": [
  23.             "lowercase",
  24.             "portuguese_stop",
  25.             "portuguese_keywords",
  26.             "portuguese_stemmer"
  27.           ]
  28.         }
  29.       }
  30.     }
  31.   }
  32. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

romanian analyzer

The romanian analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /romanian_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "romanian_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_romanian_" 
  9.         },
  10.         "romanian_keywords": {
  11.           "type":       "keyword_marker",
  12.           "keywords":   ["exemplu"] 
  13.         },
  14.         "romanian_stemmer": {
  15.           "type":       "stemmer",
  16.           "language":   "romanian"
  17.         }
  18.       },
  19.       "analyzer": {
  20.         "rebuilt_romanian": {
  21.           "tokenizer":  "standard",
  22.           "filter": [
  23.             "lowercase",
  24.             "romanian_stop",
  25.             "romanian_keywords",
  26.             "romanian_stemmer"
  27.           ]
  28.         }
  29.       }
  30.     }
  31.   }
  32. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

russian analyzer

The russian analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /russian_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "russian_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_russian_" 
  9.         },
  10.         "russian_keywords": {
  11.           "type":       "keyword_marker",
  12.           "keywords":   ["пример"] 
  13.         },
  14.         "russian_stemmer": {
  15.           "type":       "stemmer",
  16.           "language":   "russian"
  17.         }
  18.       },
  19.       "analyzer": {
  20.         "rebuilt_russian": {
  21.           "tokenizer":  "standard",
  22.           "filter": [
  23.             "lowercase",
  24.             "russian_stop",
  25.             "russian_keywords",
  26.             "russian_stemmer"
  27.           ]
  28.         }
  29.       }
  30.     }
  31.   }
  32. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

sorani analyzer

The sorani analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /sorani_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "sorani_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_sorani_" 
  9.         },
  10.         "sorani_keywords": {
  11.           "type":       "keyword_marker",
  12.           "keywords":   ["mînak"] 
  13.         },
  14.         "sorani_stemmer": {
  15.           "type":       "stemmer",
  16.           "language":   "sorani"
  17.         }
  18.       },
  19.       "analyzer": {
  20.         "rebuilt_sorani": {
  21.           "tokenizer":  "standard",
  22.           "filter": [
  23.             "sorani_normalization",
  24.             "lowercase",
  25.             "decimal_digit",
  26.             "sorani_stop",
  27.             "sorani_keywords",
  28.             "sorani_stemmer"
  29.           ]
  30.         }
  31.       }
  32.     }
  33.   }
  34. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

spanish analyzer

The spanish analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /spanish_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "spanish_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_spanish_" 
  9.         },
  10.         "spanish_keywords": {
  11.           "type":       "keyword_marker",
  12.           "keywords":   ["ejemplo"] 
  13.         },
  14.         "spanish_stemmer": {
  15.           "type":       "stemmer",
  16.           "language":   "light_spanish"
  17.         }
  18.       },
  19.       "analyzer": {
  20.         "rebuilt_spanish": {
  21.           "tokenizer":  "standard",
  22.           "filter": [
  23.             "lowercase",
  24.             "spanish_stop",
  25.             "spanish_keywords",
  26.             "spanish_stemmer"
  27.           ]
  28.         }
  29.       }
  30.     }
  31.   }
  32. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

swedish analyzer

The swedish analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /swedish_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "swedish_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_swedish_" 
  9.         },
  10.         "swedish_keywords": {
  11.           "type":       "keyword_marker",
  12.           "keywords":   ["exempel"] 
  13.         },
  14.         "swedish_stemmer": {
  15.           "type":       "stemmer",
  16.           "language":   "swedish"
  17.         }
  18.       },
  19.       "analyzer": {
  20.         "rebuilt_swedish": {
  21.           "tokenizer":  "standard",
  22.           "filter": [
  23.             "lowercase",
  24.             "swedish_stop",
  25.             "swedish_keywords",
  26.             "swedish_stemmer"
  27.           ]
  28.         }
  29.       }
  30.     }
  31.   }
  32. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

turkish analyzer

The turkish analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /turkish_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "turkish_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_turkish_" 
  9.         },
  10.         "turkish_lowercase": {
  11.           "type":       "lowercase",
  12.           "language":   "turkish"
  13.         },
  14.         "turkish_keywords": {
  15.           "type":       "keyword_marker",
  16.           "keywords":   ["örnek"] 
  17.         },
  18.         "turkish_stemmer": {
  19.           "type":       "stemmer",
  20.           "language":   "turkish"
  21.         }
  22.       },
  23.       "analyzer": {
  24.         "rebuilt_turkish": {
  25.           "tokenizer":  "standard",
  26.           "filter": [
  27.             "apostrophe",
  28.             "turkish_lowercase",
  29.             "turkish_stop",
  30.             "turkish_keywords",
  31.             "turkish_stemmer"
  32.           ]
  33.         }
  34.       }
  35.     }
  36.   }
  37. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.

This filter should be removed unless there are words which should be excluded from stemming.

thai analyzer

The thai analyzer could be reimplemented as a custom analyzer as follows:

  1. PUT /thai_example
  2. {
  3.   "settings": {
  4.     "analysis": {
  5.       "filter": {
  6.         "thai_stop": {
  7.           "type":       "stop",
  8.           "stopwords":  "_thai_" 
  9.         }
  10.       },
  11.       "analyzer": {
  12.         "rebuilt_thai": {
  13.           "tokenizer":  "thai",
  14.           "filter": [
  15.             "lowercase",
  16.             "decimal_digit",
  17.             "thai_stop"
  18.           ]
  19.         }
  20.       }
  21.     }
  22.   }
  23. }

The default stopwords can be overridden with the stopwords or stopwords_path parameters.