Keyword type family
The keyword family includes the following field types:
keyword
, which is used for structured content such as IDs, email addresses, hostnames, status codes, zip codes, or tags.constant_keyword
for keyword fields that always contain the same value.wildcard
, which optimizes log lines and similar keyword values for grep-like wildcard queries.
Keyword fields are often used in sorting, aggregations, and term-level queries, such as term
.
Avoid using keyword fields for full-text search. Use the text
field type instead.
Keyword field type
Below is an example of a mapping for a basic keyword
field:
PUT my-index-000001
{
"mappings": {
"properties": {
"tags": {
"type": "keyword"
}
}
}
}
Mapping numeric identifiers
Not all numeric data should be mapped as a numeric field data type. Elasticsearch optimizes numeric fields, such as integer
or long
, for range
queries. However, keyword
fields are better for term
and other term-level queries.
Identifiers, such as an ISBN or a product ID, are rarely used in range
queries. However, they are often retrieved using term-level queries.
Consider mapping a numeric identifier as a keyword
if:
- You don’t plan to search for the identifier data using
range
queries. - Fast retrieval is important.
term
query searches onkeyword
fields are often faster thanterm
searches on numeric fields.
If you’re unsure which to use, you can use a multi-field to map the data as both a keyword
and a numeric data type.
Parameters for basic keyword fields
The following parameters are accepted by keyword
fields:
Mapping field-level query time boosting. Accepts a floating point number, defaults to | |
Should the field be stored on disk in a column-stride fashion, so that it can later be used for sorting, aggregations, or scripting? Accepts | |
Should global ordinals be loaded eagerly on refresh? Accepts | |
Multi-fields allow the same string value to be indexed in multiple ways for different purposes, such as one field for search and a multi-field for sorting and aggregations. | |
Do not index any string longer than this value. Defaults to | |
Should the field be searchable? Accepts | |
What information should be stored in the index, for scoring purposes. Defaults to | |
Whether field-length should be taken into account when scoring queries. Accepts | |
Accepts a string value which is substituted for any explicit | |
Whether the field value should be stored and retrievable separately from the | |
Which scoring algorithm or similarity should be used. Defaults to | |
How to pre-process the keyword prior to indexing. Defaults to | |
| Whether full text queries should split the input on whitespace when building a query for this field. Accepts |
Metadata about the field. |
Constant keyword field type
Constant keyword is a specialization of the keyword
field for the case that all documents in the index have the same value.
PUT logs-debug
{
"mappings": {
"properties": {
"@timestamp": {
"type": "date"
},
"message": {
"type": "text"
},
"level": {
"type": "constant_keyword",
"value": "debug"
}
}
}
}
constant_keyword
supports the same queries and aggregations as keyword
fields do, but takes advantage of the fact that all documents have the same value per index to execute queries more efficiently.
It is both allowed to submit documents that don’t have a value for the field or that have a value equal to the value configured in mappings. The two below indexing requests are equivalent:
POST logs-debug/_doc
{
"date": "2019-12-12",
"message": "Starting up Elasticsearch",
"level": "debug"
}
POST logs-debug/_doc
{
"date": "2019-12-12",
"message": "Starting up Elasticsearch"
}
However providing a value that is different from the one configured in the mapping is disallowed.
In case no value
is provided in the mappings, the field will automatically configure itself based on the value contained in the first indexed document. While this behavior can be convenient, note that it means that a single poisonous document can cause all other documents to be rejected if it had a wrong value.
Before a value has been provided (either through the mappings or from a document), queries on the field will not match any documents. This includes exists
queries.
The value
of the field cannot be changed after it has been set.
Parameters for constant keyword fields
The following mapping parameters are accepted:
Metadata about the field. | |
| The value to associate with all documents in the index. If this parameter is not provided, it is set based on the first document that gets indexed. |
Wildcard field type
A wildcard
field stores values optimised for wildcard grep-like queries. Wildcard queries are possible on other field types but suffer from constraints:
text
fields limit matching of any wildcard expressions to individual tokens rather than the original whole value held in a fieldkeyword
fields are untokenized but slow at performing wildcard queries (especially patterns with leading wildcards).
Internally the wildcard
field indexes the whole field value using ngrams and stores the full string. The index is used as a rough filter to cut down the number of values that are then checked by retrieving and checking the full values. This field is especially well suited to run grep-like queries on log lines. Storage costs are typically lower than those of keyword
fields but search speeds for exact matches on full terms are slower.
You index and search a wildcard field as follows
PUT my-index-000001
{
"mappings": {
"properties": {
"my_wildcard": {
"type": "wildcard"
}
}
}
}
PUT my-index-000001/_doc/1
{
"my_wildcard" : "This string can be quite lengthy"
}
GET my-index-000001/_search
{
"query": {
"wildcard": {
"my_wildcard": {
"value": "*quite*lengthy"
}
}
}
}
Parameters for wildcard fields
The following parameters are accepted by wildcard
fields:
Do not index any string longer than this value. Defaults to |
Limitations
wildcard
fields are untokenized like keyword fields, so do not support queries that rely on word positions such as phrase queries.