Analyzers

General Purpose Analyzers

Keyword

The Keyword Analyzer does not perform any analysis on the input text. It creates a single token representing the entire input. This is useful for fields where you only want exact matches. For example, a field containing keywords or tags that may contain spaces that another analyzer might interpret as token boundaries.

Simple

The simple analyzer performs only minimal analysis on the input.

• Tokenizer - Unicode
• Token Filters
  • Lowercase

Standard

The Standard Analyzer is like the Simple Analyzer but also adds English stop word removal.

• Tokenizer - Unicode
• Token Filters
  • Lowercase
  • English Stop Token

Detect Language

The Detect Language Analyzer is used to examine input text, use heuristics to determine a best guess at the language, and index the ISO 639 Language Code.

• Tokenizer - Single
• Token Filters
  • Lowercase
  • CLD2

Language Specific Analyzers

• Danish
• Dutch
• English
• Finnish
• French
• Hungarian
• Italian
• German
• Norwegian
• Persian
• Portuguese
• Romanian
• Russian
• Sorani
• Spanish
• Swedish
• Thai
• Turkish