Elasticsearch version 7.0.0-rc1

Also see Breaking changes in 7.0.0-rc1.

Breaking changes

Distributed

Features/Features

  • Remove Migration Upgrade and Assistance APIs #40075 (issue: #40014)

Deprecations

Cluster Coordination

  • Deprecate size in cluster state response #39951 (issue: #39806)

Infra/Packaging

  • Deprecate fallback to java on PATH #37990

New features

Allocation

Security

  • Switch internal security index to “.security-7” #39337 (issue: #39284)

Enhancements

CCR

  • Reduce retention lease sync intervals #40302
  • Renew retention leases while following #39335 (issues: #37165, #38718)
  • Reduce refresh when lookup term in FollowingEngine #39184
  • Integrate retention leases to recovery from remote #38829 (issue: #37165)
  • Enable removal of retention leases #38751 (issue: #37165)

Client

  • Fixed required fields and paths list #39358

Discovery-Plugins

  • Adds connect and read timeouts to discovery-gce #28193 (issue: #24313)

Distributed

  • Introduce retention lease actions #38756 (issue: #37165)
  • Add dedicated retention lease exceptions #38754 (issue: #37165)
  • Copy retention leases when trim unsafe commits #37995 (issue: #37165)

Docs Infrastructure

  • Align generated release notes with doc standards #39234 (issue: #39155)

Engine

  • Explicitly advance max_seq_no before indexing #39473 (issue: #38879)

Infra/Core

  • Add details about what acquired the shard lock last #38807 (issue: #30290)

Infra/Packaging

  • Use bundled JDK in Docker images #40238
  • Upgrade bundled JDK and Docker images to JDK 12 #40229
  • Bundle java in distributions #38013 (issue: #31845)

Infra/Settings

  • Provide a clearer error message on keystore add #39327 (issue: #39324)

Percolator

  • Make the type parameter optional when percolating existing documents. #39987 (issue: #39963)
  • Add support for selecting percolator query candidate matches containing geo_point based queries #26040

SQL

  • Enhance checks for inexact fields #39427 (issue: #38501)
  • Change the default precision for CURRENT_TIMESTAMP function #39391 (issue: #39288)

Bug fixes

Aggregations

  • Skip sibling pipeline aggregators reduction during non-final reduce #40101 (issue: #40059)
  • Extend nextDoc to delegate to the wrapped doc-value iterator for date_nanos #39176 (issue: #39107)
  • Only create MatrixStatsResults on final reduction #38130 (issue: #37587)

Authentication

  • Allow non super users to create API keys #40028 (issue: #40029)
  • Use consistent view of realms for authentication #38815 (issue: #30301)

CCR

  • Safe publication of AutoFollowCoordinator #40153 (issue: #38560)
  • Enable reading auto-follow patterns from x-content #40130 (issue: #40128)
  • Stop auto-followers on shutdown #40124
  • Protect against the leader index being removed #39351 (issue: #39308)
  • Handle the fact that ShardStats instance may have no commit or seqno stats #38782 (issue: #38779)
  • Fix LocalIndexFollowingIT#testRemoveRemoteConnection() test #38709 (issue: #38695)

CRUD

  • Cascading primary failure lead to MSU too low #40249

Cluster Coordination

  • Fix node tool cleanup #39389
  • Avoid serialising state if it was already serialised #39179

Distributed

  • Ignore waitForActiveShards when syncing leases #39224 (issue: #39089)
  • Fix synchronization in LocalCheckpointTracker#contains #38755 (issues: #33871, #38633)

Engine

  • Bubble up exception when processing NoOp #39338 (issue: #38898)
  • ReadOnlyEngine should update translog recovery state information #39238

Features/Features

  • Only count some fields types for deprecation check #40166

Features/ILM

  • Handle failure to release retention leases in ILM #39281 (issue: #39181)

Features/Watcher

  • Use non-ILM template setting up watch history template & ILM disabled #39325 (issue: #38805)
  • Only flush Watcher’s bulk processor if Watcher is enabled #38803 (issue: #38798)

Infra/Core

  • Correct name of basic_date_time_no_millis #39367

Infra/Packaging

  • Some elasticsearch-cli tools could not be run not from ES_HOME #39937
  • Obsolete pre 7.0 noarch package in rpm #39472 (issue: #39414)
  • Suppress error message when /proc/sys/vm/max_map_count is not exists. #35933

Infra/REST API

  • Fix #38623 remove xpack namespace REST API #38625
  • Remove the “xpack” namespace from the REST API #38623

Recovery

  • Create retention leases file during recovery #39359 (issue: #37165)

SQL

  • Add missing handling of IP field in JDBC #40384 (issue: #40358)
  • Fix metric aggs on date/time to not return double #40377 (issues: #39492, #40376)
  • CAST supports both SQL and ES types #40365 (issue: #40282)
  • Fix RLIKE bug and improve testing for RLIKE statement #40354 (issues: #34609, #39931)
  • Unwrap the first value in an array in case of array leniency #40318 (issue: #40296)
  • Preserve original source for cast/convert function #40271 (issue: #40239)
  • Fix LIKE function equality by considering its pattern as well #40260 (issue: #39931)
  • Fix issue with optimization on queries with ORDER BY/LIMIT #40256 (issue: #40211)
  • Rewrite ROUND and TRUNCATE functions with a different optional parameter handling method #40242 (issue: #40001)
  • Fix issue with getting DATE type in JDBC #40207
  • Fix issue with date columns returned always in UTC #40163 (issue: #40152)
  • Add multi_value_field_leniency inside FieldHitExtractor #40113 (issue: #39700)
  • Fix incorrect ordering of groupings (GROUP BY) based on orderings (ORDER BY) #40087 (issue: #39956)
  • Fix bug with JDBC timezone setting and DATE type #39978 (issue: #39915)
  • Use underlying exact field for LIKE/RLIKE #39443 (issue: #39442)

Search

  • Serialize top-level pipeline aggs as part of InternalAggregations #40177 (issues: #40059, #40101)
  • CCS: Skip empty search hits when minimizing round-trips #40098 (issues: #32125, #40067)
  • CCS: Disable minimizing round-trips when dfs is requested #40044 (issue: #32125)

Upgrades

Discovery-Plugins

  • Bump jackson-databind version for AWS SDK #39183

Engine

  • Upgrade to Lucene 8.0.0-snapshot-ff9509a8df #39350
  • Upgrade to Lucene 8.0.0 #39992 (issue: #39640)

Features/Ingest

  • Bump jackson-databind version for ingest-geoip #39182

Security

  • Upgrade the bouncycastle dependency to 1.61 #40017 (issue: #40011)