Elasticsearch version 7.0.0-rc2

Also see Breaking changes in 7.0.0.

Deprecations

Analysis

• Remove nGram and edgeNGram token filter names (#38911) #39070 (issues: #30209, #38911)

Graph

• Deprecate types in _graph/explore calls. #40466

Enhancements

CCR

• Introduce forget follower API #39718 (issue: #37165)

Cluster Coordination

• Remove timeout task after completing cluster state publication #40411
• Use default discovery implementation for single-node discovery #40036
• Do not log unsuccessful join attempt each time #39756

Distributed

• Allow retention lease operations under blocks #39089 (issues: #34648, #37165)
• Remove retention leases when unfollowing #39088 (issues: #34648, #37165)
• Introduce retention lease state file #39004 (issues: #37165, #38588, #39032)
• Enable soft-deletes by default for 7.0+ indices #38929 (issue: #36141)

Engine

• Also mmap cfs files for hybridfs #38940 (issue: #36668)

Infra/Core

• Enhancements to IndicesQueryCache. #39099 (issue: #37117)

Infra/Packaging

• Add no-jdk distributions #39882

Machine Learning

• [ML] Allow stop unassigned datafeed and relax unset upgrade mode wait #39034

Mapping

• Introduce a parameter suppress_types_warnings. #38923

Recovery

• Do not wait for advancement of checkpoint in recovery #39006 (issues: #38949, #39000)

SQL

• SQL: add “fuzziness” option to QUERY and MATCH function predicates #40529 (issue: #40495)
• SQL: add “validate.properties” property to JDBC’s allowed list of settings #39050 (issue: #38068)

Search

• Avoid BytesRef’s copying in ScriptDocValues’s Strings #29581 (issue: #29567)

Security

• Types removal security index template #39705 (issue: #38637)
• Types removal security index template #39542 (issue: #38637)

Snapshot/Restore

• Mark Deleted Snapshot Directories with Tombstones #40228 (issue: #39852)

Store

• Add option to force load term dict into memory #39741

Features/Monitoring

• Remove types from internal monitoring templates and bump to api 7 #39888 (issue: #38637)

Features/Watcher

• Remove the index type from internal watcher indexes #39761 (issue: #38637)

Infra/Core

• Change zone formatting for all printers #39568 (issue: #38471)

Bug fixes

Analysis

• Fix PreConfiguredTokenFilters getSynonymFilter() implementations #38839 (issue: #38793)

Audit

• LoggingAuditTrail correctly handle ReplicatedWriteRequest #39925 (issue: #39555)

Authentication

• Correct authenticate response for API key #39684
• Fix security index auto-create and state recovery race #39582

CCR

• Fix shard follow task startup error handling #39053 (issue: #38779)
• Filter out upgraded version index settings when starting index following #38838 (issue: #38835)

CRUD

• Store Pending Deletions Fix #40345 (issue: #40249)
• ShardBulkAction ignore primary response on primary #38901

Cluster Coordination

• Do not perform cleanup if Manifest write fails with dirty exception #40519 (issue: #39077)
• Cache compressed cluster state size #39827 (issue: #39806)
• Drop node if asymmetrically partitioned from master #39598
• Fixing the custom object serialization bug in diffable utils. #39544
• Clean GatewayAllocator when stepping down as master #38885

Distributed

• Enforce retention leases require soft deletes #39922 (issue: #39914)
• Treat TransportService stopped error as node is closing #39800 (issue: #39584)
• Use cause to determine if node with primary is closing #39723 (issue: #39584)
• Don’t ack if unable to remove failing replica #39584 (issue: #39467)
• Fix NPE on Stale Index in IndicesService #38891 (issue: #38845)

Engine

• Advance max_seq_no before add operation to Lucene #38879 (issue: #31629)

Features/Features

• Deprecation check for indices with very large numbers of fields #39869 (issue: #39851)

Features/ILM

• Correct ILM metadata minimum compatibility version #40569 (issue: #40565)
• Handle null retention leases in WaitForNoFollowersStep #40477

Features/Ingest

• Ingest ingest then create index #39607 (issues: #32758, #32786, #36545)

Features/Monitoring

• Don’t emit deprecation warnings on calls to the monitoring bulk API. #39805 (issue: #39336)

Features/Watcher

• Fix Watcher stats class cast exception #39821 (issue: #39780)
• Use any index specified by .watches for Watcher #39541 (issue: #39478)
• Resolve concurrency with watcher trigger service #39092 (issue: #39087)

Geo

• Geo Point parse error fix #40447 (issue: #17617)

Highlighting

• Bug fix for AnnotatedTextHighlighter - port of 39525 #39750 (issue: #39525)

Infra/Core

• Allow single digit milliseconds in strict date parsing #40676 (issue: #40403)
• Parse composite patterns using ClassicFormat.parseObject #40100 (issue: #39916)
• Bat scripts to work with JAVA_HOME with parantheses #39712 (issues: #30606, #33405, #38578, #38624)
• Change licence expiration date pattern #39681 (issue: #39136)
• Fix DateFormatters.parseMillis when no timezone is given #39100 (issue: #39067)
• Don’t close caches while there might still be in-flight requests. #38958 (issue: #37117)

Infra/Packaging

• Use TAR instead of DOCKER build type before 6.7.0 #40723 (issues: #39378, #40511)

Infra/REST API

• Update spec files that erroneously documented parts as optional #39122
• ilm.explain_lifecycle documents human again #39113
• Index on rollup.rollup_search.json is a list #39097

MULTIPLE AREA LABELS

• metric on watcher stats is a list not an enum #39114

Machine Learning

• [ML] Fix datafeed skipping first bucket after lookback when aggs are … #39859 (issue: #39842)
• [ML] refactoring lazy query and agg parsing #39776 (issue: #39528)
• [ML] Stop the ML memory tracker before closing node #39111 (issue: #37117)

Mapping

• Optimise rejection of out-of-range long values #40325 (issues: #26137, #40323)

Recovery

• Recover peers from translog, ignoring soft deletes #38904 (issue: #37165)
• Retain history for peer recovery using leases #38855

Rollup

• Remove timezone validation on rollup range queries #40647

SQL

• SQL: Fix display size for DATE/DATETIME #40669
• SQL: have LIKE/RLIKE use wildcard and regexp queries #40628 (issue: #40557)
• SQL: Fix getTime() methods in JDBC #40484
• SQL: SYS TABLES: enumerate tables of requested types #40535 (issue: #40348)
• SQL: passing an input to the CLI “freezes” the CLI after displaying an error message #40164 (issue: #40557)
• SQL: Wrap ZonedDateTime parameters inside scripts #39911 (issue: #39877)
• SQL: ConstantProcessor can now handle NamedWriteable #39876 (issue: #39875)
• SQL: Extend the multi dot field notation extraction to lists of values #39823 (issue: #39738)
• SQL: values in datetime script aggs should be treated as long #39773 (issue: #37042)
• SQL: Don’t allow inexact fields for MIN/MAX #39563 (issue: #39427)
• SQL: Fix merging of incompatible multi-fields #39560 (issue: #39547)
• SQL: fix COUNT DISTINCT column name #39537 (issue: #39511)
• SQL: Enable accurate hit tracking on demand #39527 (issue: #37971)
• SQL: ignore UNSUPPORTED fields for JDBC and ODBC modes in SYS COLUMNS #39518 (issue: #39471)
• SQL: enforce JDBC driver - ES server version parity #38972 (issue: #38775)
• SQL: fall back to using the field name for column label #38842 (issue: #38831)

Search

• Fix Fuzziness#asDistance(String) #39643 (issue: #39614)

Security

• Remove dynamic objects from security index #40499 (issue: #35460)
• Fix libs:ssl-config project setup #39074
• Do not create the missing index when invoking getRole #39039

Snapshot/Restore

• Blob store compression fix #39073

Upgrades

Snapshot/Restore

• plugins/repository-gcs: Update google-cloud-storage/core to 1.59.0 #39748 (issue: #39366)

Search

• Upgrade to Lucene 8.0.0 GA #39992 (issue: #39640)