13.13. Release 0.240
Warning
There is a bug in LambdaDefinitionExpression canonicalization introduced since 0.238. For more details, go to #15424.
Highlights
- Add ability to spill window functions to local disk when a worker is out of memory.
- Add support for inlining SQL functions at query planning time.
- Add support for limit pushdown through union.
- Add
geometry_from_geojson()
andgeometry_as_geojson()
to convert geometries from and to GeoJSON format.
Details
General Changes
- Fix compiler error due to incorrect LambdaDefinitionExpression canonicalization.
- Fix compiler error in certain situations where sql functions with same lambda are used multiple times.
- Add
IF EXISTS
andIF NOT EXISTS
syntax toALTER TABLE
. - Add
query.max-scan-physical-bytes
configuration andquery_max_scan_physical_bytes
session properties to limit total number of bytes read from storage during table scan. The default limit is 1PB. - Add support for inlining SQL functions at query planning time. This feature is enabled by default, and can be disabled with the
inline_sql_functions
session property. - Add
geometry_from_geojson()
andgeometry_as_geojson()
to convert geometries from and to GeoJSON format. - Add support for pushdown of dereference expressions for querying nested data. This can be enabled with the
pushdown_dereference_enabled
session property or theexperimental.pushdown-dereference-enabled
configuration property. - Use local private credentials (json key file) to refresh GCS access token. Usage : presto-cli –extra-credential hive.gcs.credentials.path=”${PRIVATE_KEY_JSON_PATH}”.
- Add ability to spill window functions to local disk when a worker is out of memory.
- Add support for limit pushdown through union.
Thrift Connector Changes
- Rename
presto-thrift-connector-api
topresto-thrift-api
and have separate packages for datatypes, valuesets and connector.
Verifier Changes
- Fix an issue where Verifier fails to start when failure resolver is disabled.
- Add configuration property
test_name
, to be passed in to the client info blob. - Add support to implement customized way of launching Presto queries.
- Add support to populate client info for the queries issued by Verifier.
- Add support to resubmit verification if test query fails with
HIVE_PARTITION_OFFLINE
. - Add support to run helper queries on a separate cluster other than the control cluster.
- Add support to skip running control queries and comparing results. This can be enabled by configuration property
skip-control
.
Cassandra Changes
- Add TLS security support.
Druid Changes
- Add support for union all operation with more than 1 druid source.
- Add support for filter on top of Aggregation.
- Fix unhandled HTTP response error for druid client.
Elasticserarch Changes
- Add support for IP data type.
Geospatial Changes
- Improve
geometry_to_bing_tiles()
performance. It is 50x faster on complex polygons, the limit on polygon complexity is removed, and some correctness bugs have been fixed. - Add geometry_to_dissolved_bing_tiles function, which dissolves complete sets of child tiles to their parent.
- Introduce
bing_tile_children()
andbing_tile_parent()
functions to get parents and children of a Bing tile.
Hive Changes
- Fix parquet statistics when min/max is not set.
- Improve split generation performance.
- Add support for Hudi realtime input format for hudi realtime queries.
- Add support for splitting hive files when skip.header.line.count=1.
- Allow presto-hive to use custom parquet input formats.
Kafka Changes
- Support
INSERT
in Kafka connector.
SPI Changes
- Allow procedures to accept optional parameters.