History

For a full list of releases, seegithub.Downloads are available on thedownloads page.

1.21.0 / 2019-09-11

This release comes two months after 1.20.0. It includes more than 100 resolvedissues, comprising a large number of new features as well as general improvementsand bug-fixes.

It is worth highlighting that Calcite now:

• supports implicit type coercion in various contexts(CALCITE-2302);
• allows transformations of Pig Latin scripts into algebraic plans(CALCITE-3122);
• provides an implementation for the main features of MATCH_RECOGNIZE in theEnumerable convention(CALCITE-1935);
• supports correlated ANY/SOME/ALL sub-queries(CALCITE-3031);
• introduces anonymous types based on ROW, ARRAY, and nested collection(CALCITE-3233,CALCITE-3231,CALCITE-3250);
• brings new join algorithms for the Enumerable convention(CALCITE-2979,CALCITE-2973,CALCITE-3284).

Compatibility: This release is testedon Linux, macOS, Microsoft Windows;using Oracle JDK 8, 9, 10, 11, 12, 13 and OpenJDK 8, 9, 10, 11, 12, 13;Guava versions 19.0 to 27.1-jre;Apache Druid version 0.14.0-incubating;other software versions as specified in pom.xml.

Breaking Changes

• Core parser config.fmpp#dataTypeParserMethods should return SqlTypeNameSpecinstead of SqlIdentifier.
• The description of converter rules has slightly changed(CALCITE-3115).In some rare cases this may lead to a Rule description … is not validexception. The exception can easily disappear by changing the name of theConvention which causes the problem.

New features

• [CALCITE-2973][CALCITE-3284]Allow joins (hash, semi, anti) that have equi conditions to be executed using ahash join algorithm (Lai Zhou)
• [CALCITE-2302]Implicit type cast support
• [CALCITE-3122]Convert Pig Latin scripts into Calcite relational algebra and Calcite SQL(Khai Tran)
• [CALCITE-2979]Add a block-based nested loop join algorithm (Khawla Mouhoubi)
• [CALCITE-3263]Add MD5, SHA1 SQL functions (Shuming Li)
• [CALCITE-3204]Implement jps command for OS adapter (Qianjin Xu)
• [CALCITE-3260]Add Expressions.evaluate(Node), a public API for evaluating linq4j expressions(Wang Yanlin)
• [CALCITE-3280]Add REGEXP_REPLACE function in Oracle, MySQL libraries (Shuming Li)
• [CALCITE-3111]Add RelBuilder.correlate method, and allow custom implementations ofCorrelate in RelDecorrelator (Juhwan Kim)
• [CALCITE-3252]Add CONVERT_TIMEZONE, TO_DATE and TO_TIMESTAMP non-standard SQL functions(Lindsey Meyer)
• [CALCITE-3235]Add CONCAT function for Redshift (Ryan Fu)
• [CALCITE-3250]Support nested collection type for SqlDataTypeSpec
• [CALCITE-1935]Implement MATCH_RECOGNIZE (Julian Feinauer, Zhiqiang-He)
• [CALCITE-2843]Support PostgreSQL cast operator (::) (Muhammad Gelbana)
• [CALCITE-3233]Support ROW type for SqlDataTypeSpec
• [CALCITE-3231]Support ARRAY type for SqlDataTypeSpec
• [CALCITE-2624]Add a rule to copy a sort below a join operator (Khawla Mouhoubi)
• [CALCITE-3031]Support for correlated ANY/SOME/ALL sub-query (Vineet Garg)
• [CALCITE-2510]Implement CHR function (Sergey Tsvetkov, Chunwei Lei)
• [CALCITE-3176]File adapter for parsing JSON files
• [CALCITE-3144]Add rule, AggregateCaseToFilterRule, that converts SUM(CASE WHEN b THEN xEND) to SUM(x) FILTER (WHERE b)
• [CALCITE-2995]Implement DAYNAME，MONTHNAME functions; add locale connection property(xuqianjin)
• [CALCITE-2460][CALCITE-2459] Add TO_BASE64, FROM_BASE64 SQL functions (Wenhui Tang)
• [CALCITE-3063]Parse and process PostgreSQL posix regular expressions

Bug-fixes, API changes and minor enhancements

• [CALCITE-3321]Set casing rules for BigQuery SQL dialect (Lindsey Meyer)
• [CALCITE-3115]Cannot add JdbcRule instances that have different JdbcConvention to sameVolcanoPlanner’s RuleSet (Wenhui Tang, Igor Guzenko)
• [CALCITE-3309]Refactor generatePredicate method from EnumerableNestedLoopJoin,EnumerableHashJoin, and EnumerableBatchNestedLoopJoin into a single location
• [CALCITE-3310]Approximate and exact aggregate calls are recognized as the same duringSQL-to-RelNode conversion
• [CALCITE-3292]SqlToRelConverter#substituteSubQuery fails with NullPointerException whenconverting SqlUpdate (Jin Xing)
• [CALCITE-3297]PigToSqlAggregateRule should be applied on multi-set projection to produce anoptimal plan (Igor Guzenko)
• [CALCITE-3295]Add aggregate call name in serialized json string for RelNode (Wang Yanlin)
• [CALCITE-3296]Decorrelator shouldn’t give empty value when fetch and offset values are nullin Sort rel (Juhwan Kim)
• [CALCITE-3283]RelSubset does not contain its best RelNode (Xiening Dai)
• [CALCITE-3210]JDBC adapter should generate CAST(NULL AS type) rather than NULLconditionally (Wang Weidong)
• [CALCITE-3220]JDBC adapter now transforms TRIM to TRIM, LTRIM or RTRIM when targetis Hive (Jacky Woo)
• [CALCITE-3228]Error while applying rule ProjectScanRule: interpreter
• [CALCITE-3223]Materialized view fails to match when there is non-RexInputRef in theprojects (Jin Xing)
• [CALCITE-3257]RelMetadataQuery cache is not invalidated when log trace is enabled(Xiening Dai)
• [CALCITE-3138]RelStructuredTypeFlattener doesn’t restructure ROW type fields (Igor Guzenko)
• [CALCITE-3251]BinaryExpression evaluate method support full numeric types in Primitive(xy2953396112)
• [CALCITE-3259]Align ‘Property’ in the serialized XML string of RelXmlWriter (Wang Yanlin)
• [CALCITE-3167]Make equals and hashCode methods final in AbstractRelNode, and removeoverriding methods in EnumerableTableScan (Jin Xing)
• [CALCITE-3089]Deprecate EquiJoin
• [CALCITE-3267]Remove method SqlDataTypeSpec#deriveType(RelDataTypefactory)
• [CALCITE-3214]Add UnionToUnionRule for materialization matching (refine rule name) (Jin Xing)
• [CALCITE-3214]Add UnionToUnionRule for materialization matching (Jin Xing)
• [CALCITE-3249]`Substitution#getRexShuttle does not consider RexLiteral (Jin Xing)
• [CALCITE-3229]UnsupportedOperationException for UPDATE with IN query
• [CALCITE-3236]Handle issues found in static code analysis (DonnyZone)
• [CALCITE-3238]Support Time Zone suffix of DateTime types for SqlDataTypeSpec
• [CALCITE-3159]Remove DISTINCT flag from calls to MIN, MAX, BIT_OR, BIT_ANDaggregate functions (xuqianjin)
• [CALCITE-3237]IndexOutOfBoundsException when generating deeply nested Java code from linq4j(Sahith Nallapareddy)
• [CALCITE-3234]For boolean properties, empty string should mean “true”
• [CALCITE-3226]RelBuilder doesn’t keep the alias when scan from an expanded view (Jin Xing)
• [CALCITE-3198]Enhance RexSimplify to handle (x <> a or x <> b)
• [CALCITE-3101]Don’t push non-equi join conditions into Project below Join
• [CALCITE-3227]IndexOutOfBoundsException when checking candidate parent match’s inputordinal in VolcanoRuleCall
• [CALCITE-3177]Ensure correct deserialization of relational algebra
• [CALCITE-3218]Syntax error while parsing DATEADD function (which is valid on Redshift)(Lindsey Meyer)
• Deprecate RexBuilder.constantNull(), because it produces untyped NULLliterals that make planning difficult
• [CALCITE-3191]In JDBC adapter for MySQL, implement Values by generating SELECT withoutFROM
• [CALCITE-3147]In JDBC adapter, accommodate the idiosyncrasies of how BigQuery (standard SQL)quotes character literals and identifiers
• [CALCITE-3131]In LatticeSuggester, record whether columns are used as “dimensions” or“measures”
• [CALCITE-3175]AssertionError while serializing to JSON a RexLiteral with Enum type(Wang Yanlin)
• [CALCITE-3225]JoinToMultiJoinRule should not match semi- or anti-LogicalJoin
• [CALCITE-3215]Simplification may have not fully simplified IS NOT NULL expressions
• [CALCITE-3192]Simplification may weaken OR conditions containing inequalities
• [CALCITE-3211]List of MutableRel may fail to be identified by SubstitutionVisitor duringmatching (Jin Xing)
• [CALCITE-3207]Fail to convert Join with LIKE condition to SQL statement (wojustme)
• [CALCITE-2496]Return 0 in case of EXTRACT(MILLI/MICRO/NANOSECOND FROM date)(Sergey Nuyanzin, Chunwei Lei)
• [CALCITE-3109]Improvements on algebraic operators to express recursive queries (RepeatUnionand TableSpool)
• [CALCITE-3209]When calling MutableMultiRel.setInput, exception thrown (Jin Xing)
• [CALCITE-3195]Handle a UDF that throws checked exceptions in the Enumerable code generator(DonnyZone)
• [CALCITE-3118]VolcanoRuleCall should look at RelSubset rather than RelSet when checkingchild ordinal of a parent operand (Botong Huang)
• [CALCITE-3201]SqlValidator throws exception for SQL insert target table with virtual columns
• [CALCITE-3182]Trim unused fields for plan of materialized-view before matching (Jin Xing)
• [CALCITE-3174]IS NOT DISTINCT FROM condition pushed from Filter to Join is notcollapsed (Bohdan Kazydub)
• [CALCITE-3166]Make RelBuilder configurable
• [CALCITE-3113]Equivalent MutableAggregates with different row types should match with eachother (Jin Xing)
• CALCITE-3187:Make decimal type inference overridable (Praveen Kumar)
• [CALCITE-3145]RelBuilder.aggregate throws IndexOutOfBoundsException if groupKey isnon-empty and there are duplicate aggregate functions
• Change type of SqlStdOperatorTable.GROUPING field to public class
• [CALCITE-3196]In Frameworks, add interface BasePrepareAction (a functional interface) anddeprecate abstract class PrepareAction
• [CALCITE-3183]During field trimming, Filter is copied with wrong traitSet (Juhwan Kim)
• [CALCITE-3189]Multiple fixes for Oracle SQL dialect
• [CALCITE-3165]Project#accept(RexShuttle shuttle) does not update rowType
• [CALCITE-3188]IndexOutOfBoundsException in ProjectFilterTransposeRule when executingSELECT COUNT
• [CALCITE-3160]Failed to materialize when the aggregate function uses group key (DonnyZone)
• [CALCITE-3170]ANTI join on conditions push down generates wrong plan
• [CALCITE-3169]decorrelateRel method should return when meeting SEMI/ANTI join inRelDecorrelator
• [CALCITE-3171]SemiJoin on conditions push down throws IndexOutOfBoundsException
• [CALCITE-3172]RelBuilder#empty does not keep aliases
• [CALCITE-3121]VolcanoPlanner hangs due to sub-query with dynamic star
• [CALCITE-3152]Unify throws in SQL parser
• [CALCITE-3125]Remove completely class CorrelateJoinType
• [CALCITE-3133]Remove completely class SemiJoinType
• [CALCITE-3126]Remove deprecated SemiJoin usage completely
• [CALCITE-3146]Support the detection of nested aggregations for JdbcAggregate inSqlImplementor (Wenhui Tang)
• [CALCITE-3155]Empty LogicalValues can not be converted to UNION ALL without operands whichcan not be unparsed (Musbah EL FIL)
• [CALCITE-3151]RexCall’s Monotonicity is not considered in determining a Calc’s collation
• [CALCITE-2801]Check input type in AggregateUnionAggregateRule when remove the bottomAggregate (Hequn Cheng)
• [CALCITE-3149]RelDataType CACHE in RelDataTypeFactoryImpl can’t be garbage collected
• [CALCITE-3060]MutableProject should be generated based on INVERSE_SURJECTION mapping(DonnyZone)
• [CALCITE-3148]Validator throws IndexOutOfBoundsException for SqlInsert when source andsink have non-equal number of fields

Build and test suite

• [CALCITE-3322]Remove duplicate test case in RelMetadataTest
• [CALCITE-3314]CVSS dependency-check-maven fails for calcite-pig, calcite-piglet,calcite-spark
• [CALCITE-3315]Multiple failures in Druid IT tests due to implicit casts
• [CALCITE-3307]PigRelExTest, PigRelOpTest and PigScriptTest fail on Windows
• In SqlFunctionsTest, replace assertEquals and assertNull with assertThat
• [CALCITE-3258]Upgrade jackson-databind from 2.9.9 to 2.9.9.3, and kafka-clients from 2.0.0to 2.1.1
• [CALCITE-3222]Fix code style issues introduced by [CALCITE-3031] (Vineet Garg)
• More compiler fixes, and cosmetic changes
• Fix compiler warnings
• Update stale tests in DruidAdapter
• Following[CALCITE-2804],fix incorrect expected Druid query in test caseDruidAdapterIT#testCastToTimestamp (Justin Szeluga)
• [CALCITE-3153]Improve testing in TpcdsTest using assertEqual instead of printing results
• Fix javadoc error
• Fix compilation warnings after Mongo java driver upgrade
• [CALCITE-3179]Bump Jackson from 2.9.8 to 2.9.9 (Fokko Driesprong)
• [CALCITE-3157]Mongo java driver upgrade: 3.5.0 -> 3.10.2
• [CALCITE-3156]Mongo adapter. Replace fongo with Mongo Java Server for tests
• [CALCITE-3168]Add test for invalid literal of SQL parser

Web site and documentation

• [CALCITE-3303]Release Calcite 1.21.0
• [CALCITE-3311]Add doc to site for implicit type coercion
• [CALCITE-3262]Refine doc of SubstitutionVisitor (Jin Xing)
• [CALCITE-2835]Markdown errors on the Geode adapter page
• Site: Update Apache links on homepage to HTTPS
• Update favicon for new logo
• [CALCITE-3136]Fix the default rule description of ConverterRule (TANG Wen-hui)
• [CALCITE-3184]Add the new logo to the website
• Update example announcement
• Add committer names to 1.20.0 release notes
• Add 1.20.0 release date
• Add 1.20.0 release announcement

1.20.0 / 2019-06-24

This release comes three months after 1.19.0. It includes a large number of bug fixes,and additional SQL functions. There is now also explicit support for anti-joins.Several new operators have been added to the algebra to allow support for recursive queries.An adapter has also been added for Apache Kafka.

Compatibility: This release is testedon Linux, macOS, Microsoft Windows;using Oracle JDK 8, 9, 10, 11, 12, 13 and OpenJDK 8, 9, 10, 11, 12, 13;Guava versions 19.0 to 27.1-jre;Apache Druid version 0.14.0-incubating;other software versions as specified in pom.xml.

Breaking Changes

• Make EnumerableMergeJoin extend Join instead of EquiJoin
• Correlate use JoinRelType instead of SemiJoinType
• Rename EnumerableThetaJoin to EnumerableNestedLoopJoin
• Rename EnumerableJoin to EnumerableHashJoin
• Remove SemiJoinFactory from RelBuilder, method semiJoin now returns a LogicalJoinwith join type JoinRelType.SEMI instead of a SemiJoin
• Rules: SemiJoinFilterTransposeRule, SemiJoinJoinTransposeRule, SemiJoinProjectTransposeRuleand SemiJoinRemoveRule match LogicalJoin with join type SEMI instead of SemiJoin.
• SemiJoin, EnumerableSemiJoin, SemiJoinType and CorrelateJoinType, and methods that use them,are deprecated for quick removal in 1.21
• The Elasticsearch adapter no longer supports Elasticsearch types.Calcite table names will reflect index names in Elasticsearch (as opposed to types).We recommend use of Elasticsearch 6.2 (or later) with Calcite.

New features

• [CALCITE-2822] Allow MultiJoin rules with any project/filter (Siddharth Teotia)
• [CALCITE-2968] New AntiJoin relational expression
• [CALCITE-2721] Support parsing record-type [DOT] member-functions
• [CALCITE-3005] Implement string functions: LEFT, RIGHT (xuqianjin)
• [CALCITE-2812] Add algebraic operators to allow expressing recursive queries
• [CALCITE-2913] Adapter for Apache Kafka (Mingmin Xu)
• [CALCITE-3084] Implement JDBC string functions: ASCII, REPEAT, SPACE, SOUNDEX, DIFFERENC (pingle wang)
• [CALCITE-2985] Implement JSON_STORAGE_SIZE function (xuqianjin)
• [CALCITE-2601] Add REVERSE function (pingle wang)
• [CALCITE-2712] Add rule to remove null-generating side of a Join
• [CALCITE-2965] Implement string functions: REPEAT, SPACE, SOUNDEX, DIFFERENCE
• [CALCITE-2975] Implement JSON_REMOVE function (xuqianjin)
• [CALCITE-2933] Add timestamp extract for casts from timestamp type to other types
• [CALCITE-3011] Support left and right outer joins with AggregateJoinTransposeRule (Vineet Garg)
• [CALCITE-2427] Allow sub-queries in DML statements (Pressenna Sockalingasamy)
• [CALCITE-2914] Add a new statistic provider, to improve how LatticeSuggester deduces foreign keys
• [CALCITE-2754] Implement LISTAGG function (Sergey Nuyanzin, Chunwei Lei)
• [CALCITE-1172] Add rule to flatten two Aggregate operators into one
• [CALCITE-2892] Add the JSON_KEYS function (xuqianjin)
• [CALCITE-883] Support RESPECT NULLS, IGNORE NULLS option for LEAD, LAG, FIRST_VALUE, LAST_VALUE, NTH_VALUE functions (Chunwei Lei)
• [CALCITE-2920] In RelBuilder, add antiJoin method (Ruben Quesada Lopez)
• [CALCITE-1515] In RelBuilder, add functionScan method to create TableFunctionScan (Chunwei Lei)
• [CALCITE-2658] Add ExchangeRemoveConstantKeysRule that removes constant keys from Exchange or SortExchange (Chunwei Lei)
• [CALCITE-2729] Introducing WindowReduceExpressionsRule (Chunwei Lei)
• [CALCITE-2808] Add the JSON_LENGTH function (xuqianjin)
• [CALCITE-589] Extend unifyAggregates method to work with Grouping Sets
• [CALCITE-2908] Implement SQL LAST_DAY function (Chunwei Lei)

Bug-fixes, API changes and minor enhancements

• [CALCITE-3119] Deprecate Linq4j CorrelateJoinType (in favor of JoinType)
• [CALCITE-3087] AggregateOnProjectToAggregateUnifyRule ignores Project incorrectly when its Mapping breaks ordering (DonnyZone)
• [CALCITE-2744] Remove usage of deprecated API in MockSqlOperatorTable
• [CALCITE-3123] In RelBuilder, eliminate duplicate aggregate calls
• [CALCITE-3116] Upgrade to Avatica 1.15
• [CALCITE-2744] RelDecorrelator use wrong output map for LogicalAggregate decorrelate (godfreyhe and Danny Chan)
• [CALCITE-2804] Fix casting to timestamps in Druid
• [CALCITE-3107] Upgrade commons-dbcp2 from 2.5.0 to 2.6.0 (Fokko Driesprong)
• [CALCITE-3106] Upgrade commons-pool2 from 2.6.0 to 2.6.2 (Fokko Driesprong)
• [CALCITE-2944] Deprecate Aggregate indicator and remove fields where possible
• [CALCITE-3098] Upgrade SQLLine to 1.8.0
• [CALCITE-2742] Read values of USER and SYSTEM_USER variables from DataContext (Siddharth Teotia, Jacques Nadeau)
• [CALCITE-3082] Fix NPE in SqlUtil#getSelectListItem
• [CALCITE-3093] Remove JDBC connection calls from PlannerImpl
• [CALCITE-3095] Add several system properties to control enabling/disabling of rules and traits
• [CALCITE-2696] Improve design of join-like relational expressions
• [CALCITE-3097] GROUPING SETS breaks on sets of size > 1 due to precedence issues (Steven Talbot)
• [CALCITE-3022] Babel: Various SQL parsing issues
• [CALCITE-3047] In JDBC adapter, expose multiple schemas of the back-end database
• [CALCITE-3048] Improve how JDBC adapter deduces current schema on Redshift
• Javadoc typos (Wenhui Tang, Muhammad Gelbana)
• [CALCITE-3096] In RelBuilder, make alias method idempotent
• [CALCITE-3055] Use pair of relNode’s rowType and digest as unique key for cache in RelOptPlanner (KazydubB)
• [CALCITE-3077] Rewrite CUBE&ROLLUP queries in SparkSqlDialect (DonnyZone)
• [CALCITE-3090] Remove Central configuration
• [CALCITE-2807] Fix IS NOT DISTINCT FROM expression identification in RelOptUtil#pushDownJoinConditions()
• [CALCITE-3050] Integrate SqlDialect and SqlParser.Config
• [CALCITE-3023] Upgrade elastic search to 7.x (Takako Shimamoto)
• [CALCITE-3067] Splunk adapter cannot parse right session keys from Splunk 7.2 (Shawn Chen)
• [CALCITE-3076] AggregateJoinTransposeRule throws error for unique under aggregate keys when generating merged calls
• [CALCITE-3068] testSubprogram() does not test whether subprogram gets re-executed
• [CALCITE-3072] Generate right SQL for FLOOR&SUBSTRING functions in SparkSqlDialect (DonnyZone)
• [CALCITE-3074] Move MySQL’s JSON operators to SqlLibraryOperators
• [CALCITE-3062] Do not populate provenanceMap if not debug
• [CALCITE-2282] Remove sql operator table from parser
• [CALCITE-3052] Error while applying rule MaterializedViewAggregateRule(Project-Aggregate): ArrayIndexOutOfBoundsException
• [CALCITE-3066] RelToSqlConverter may incorrectly throw an AssertionError for some decimal literals
• [CALCITE-3028] Support FULL OUTER JOIN with AggregateJoinTransposeRule (Vineet Garg)
• [CALCITE-3017] Improve null handling of JsonValueExpressionOperator
• [CALCITE-2936] Simplify EXISTS or NOT EXISTS sub-query that has “GROUP BY ()”
• [CALCITE-2803] ProjectTransposeJoinRule messes INDF expressions
• [CALCITE-3061] Query with WITH clause fails when alias is the same as the table with rolled up column
• [CALCITE-3017] Re-organize how we represent built-in operators that are not in the standard operator table
• [CALCITE-3056] Elasticsearch adapter. Invalid result with cast function on raw queries
• [CALCITE-3046] CompileException when inserting casted value of composited user defined type into table
• [CALCITE-3054] Elasticsearch adapter. Avoid scripting for simple projections
• [CALCITE-3039] In Interpreter, min() incorrectly returns maximum double value (dijkspicy)
• [CALCITE-3049] When simplifying “IS NULL” and “IS NOT NULL”, simplify the operand first
• [CALCITE-3003] AssertionError when GROUP BY nested field (Will Yu)
• [CALCITE-3012] Column uniqueness metadata provider may return wrong result for FULL OUTER JOIN operator (Vineet Garg)
• [CALCITE-3045] NullPointerException when casting null literal to composite user defined type
• [CALCITE-3030] SqlParseException when using component identifier for setting in merge statements (Danny Chan)
• [CALCITE-3029] Java-oriented field type is wrongly forced to be NOT NULL after being converted to SQL-oriented
• [CALCITE-2292] Query result is wrong when table is implemented with FilterableTable and the sql has multiple where conditions
• [CALCITE-2998] RexCopier should support all rex types (Chunwei Lei, Alexander Shilov)
• [CALCITE-2982] SqlItemOperator should throw understandable exception message for incorrect operand type (pengzhiwei)
• Revert “[CALCITE-3021] ArrayEqualityComparer should use Arrays#deepEquals/deepHashCode instead of Arrays#equals/hashCode (Ruben Quesada Lopez)
• [CALCITE-3021] ArrayEqualityComparer should use Arrays#deepEquals/deepHashCode instead of Arrays#equals/hashCode
• [CALCITE-2453] Parse list of SQL statements separated with a semicolon (Chunwei Lei, charbel yazbeck)
• [CALCITE-3004] RexOver is incorrectly pushed down in ProjectSetOpTransposeRule and ProjectCorrelateTransposeRule (Chunwei Lei)
• [CALCITE-3001] Upgrade to Apache Druid 0.14.0-incubating
• Following [CALCITE-3010], remove redundant non-reserved keyword definitions
• [CALCITE-2993] ParseException may be thrown for legal SQL queries due to incorrect “LOOKAHEAD(1)” hints
• [CALCITE-3010] In SQL parser, move JsonValueExpression into Expression
• [CALCITE-3009] DiffRepository should ensure that XML resource file does not contain duplicate test names
• [CALCITE-2986] Wrong results with = ANY sub-query (Vineet Garg)
• [CALCITE-2962] RelStructuredTypeFlattener generates wrong types for nested column when flattenProjection (Will Yu)
• [CALCITE-3007] Type mismatch for ANY sub-query in project (Vineet Garg)
• [CALCITE-2865] FilterProjectTransposeRule generates wrong traitSet when copyFilter/Project is true (Ruben Quesada Lopez)
• [CALCITE-2343] PushProjector with OVER expression causes infinite loop (Chunwei Lei)
• [CALCITE-2994] Least restrictive type among structs does not consider nullability
• [CALCITE-2991] getMaxRowCount should return 1 for an Aggregate with constant keys (Vineet Garg)
• [CALCITE-1338] JoinProjectTransposeRule should not pull a literal up through the null-generating side of a join (Chunwei Lei)
• [CALCITE-2977] Exception is not thrown when there are ambiguous field in select list
• [CALCITE-2739] NPE is thrown if the DEFINE statement contains IN in MATCH_RECOGNIZE
• [CALCITE-896] Remove Aggregate if grouping columns are unique and all functions are splittable
• [CALCITE-2456] VolcanoRuleCall doesn’t match unordered child operand when the operand is not the first operand. PruneEmptyRules UNION and MINUS with empty inputs cause infinite cycle. (Zuozhi Wang)
• [CALCITE-2847] Optimize global LOOKAHEAD for SQL parsers
• [CALCITE-2976] Improve materialized view rewriting coverage with disjunctive predicates
• [CALCITE-2954] SubQueryJoinRemoveRule and SubQueryProjectRemoveRule passing on empty set instead of set of correlation id (Vineet Garg)
• [CALCITE-2930] IllegalStateException when FilterCorrelateRule matches a SEMI or ANTI Correlate (Ruben Quesada Lopez)
• [CALCITE-2004] Push join predicate down into inner relation for lateral join
• [CALCITE-2820] Avoid reducing certain aggregate functions when it is not necessary (Siddharth Teotia)
• [CALCITE-2928] When resolving user-defined functions (UDFs), use the case-sensitivity of the current connection (Danny Chan)
• [CALCITE-2900] RelStructuredTypeFlattener generates wrong types on nested columns (Will Yu)
• [CALCITE-2941] EnumerableLimitRule on Sort with no collation creates EnumerableLimit with wrong traitSet and cluster (Ruben Quesada Lopez)
• [CALCITE-2909] Optimize Enumerable SemiJoin with lazy computation of innerLookup (Ruben Quesada Lopez)
• [CALCITE-2903] Exception thrown when decorrelating query with TEMPORAL TABLE
• [CALCITE-2958] Upgrade SQLLine to 1.7.0
• [CALCITE-2796] JDBC adapter fix for ROLLUP on MySQL 5
• In RelFieldCollation, add a withX copy method
• [CALCITE-2953] LatticeTest.testTileAlgorithm2 and LatticeTest.testTileAlgorithm3 fail intermittently
• [CALCITE-574] Remove org.apache.calcite.util.Bug.CALCITE_461_FIXED
• [CALCITE-2951] Support decorrelating a sub-query that has aggregate with grouping sets (Haisheng Yuan)
• [CALCITE-2946] RelBuilder wrongly skips creation of Aggregate that prunes columns if input produces one row at most
• [CALCITE-2943] Materialized view rewriting logic calls getApplicableMaterializations each time the rule is triggered
• [CALCITE-2942] Materialized view rewriting logic instantiates RelMetadataQuery each time the rule is triggered

Build and test suite

• Fix test exception caused by slightly different error message from regex in JDK 13
• Following [CALCITE-2812] Disable parallel execution of parameterized test to avoid hanging
• [CALCITE-35] More test cases to guard against providing a broken fix for parenthesized join (Muhammad Gelbana)
• [CALCITE-3034] CSV test case description does not match it’s code logic (FaxianZhao)
• Mongo adapter. Mongo checker validates only first line of the Bson query in tests
• [CALCITE-3053] Add a test to ensure that all functions are documented in the SQL reference
• [CALCITE-2961] Enable Travis to test against JDK 13

Web site and documentation

• [CALCITE-2952] Document JDK 12 support
• Site: Add Danny Chan as committer
• Site: Improve contribution guidelines for JIRA
• [CALCITE-2846] Document Oracle-specific functions, such as NVL and LTRIM, in the SQL reference
• Site: Add new committers and PMC (Chunwei Lei, Ruben Quesada Lopez, Zhiwei Peng and Stamatis Zampetakis)
• [CALCITE-3006] Example code on site cannot compile (Chunwei Lei)
• Site: Add guidelines for JIRA’s fix version field
• Site: Update content of “Not implemented” since JSON_LENGH has already been added
• Site: Improve documentation for MySQL-specific JSON operators
• [CALCITE-2927] The Javadoc and implement of RuleQueue.computeImportance() is inconsistent (Meng Wang)
• Update instructions for publishing site; we previously used subversion, now we use git
• Site: Add Alibaba MaxCompute to powered-by page
• Site: Add new committers (Haisheng Yuan, Hongze Zhang and Stamatis Zampetakis)
• [CALCITE-2952] Add JDK 12 as tested to 1.19.0 history

1.19.0 / 2019-03-25

This release comes three months after 1.18.0. It includes more than 80 resolvedissues, comprising of a few new features as well as general improvementsand bug-fixes. Among others, there have been significant improvements in JSONquery support.

Compatibility: This release is testedon Linux, macOS, Microsoft Windows;using Oracle JDK 8, 9, 10, 11, 12 and OpenJDK 8, 9, 10, 11, 12;Guava versions 19.0 to 27.1-jre;Druid version 0.11.0;other software versions as specified in pom.xml.

New features

• [CALCITE-1912]Support FOR SYSTEM_TIME AS OF in regular queries
• [CALCITE-2786]Add order by clause support for JSON_ARRAYAGG
• [CALCITE-2791]Add the JSON_TYPE function
• [CALCITE-2864]Add the JSON_DEPTH function
• [CALCITE-2881]Add the JSON_PRETTY function
• [CALCITE-2770]Add bitwise aggregate functions BIT_AND, BIT_OR
• [CALCITE-2799]Allow alias in HAVING clause for aggregate functions

Bug-fixes, API changes and minor enhancements

• [CALCITE-1513]Correlated NOT IN query throws AssertionError
• [CALCITE-1726]Sub-query in FILTER is left untransformed
• [CALCITE-2249]AggregateJoinTransposeRule generates non-equivalent nodes if Aggregatecontains a DISTINCT aggregate function
• [CALCITE-2288]Type assertion error when reducing partially-constant expression
• [CALCITE-2290]Type mismatch during flattening
• [CALCITE-2301]JDBC adapter: use query timeout from the top-level statement
• [CALCITE-2338]Make simplification API more conservative
• [CALCITE-2344]Avoid inferring $0 = null predicate from $0 IS NULL when $0 is notnullable
• [CALCITE-2375]EnumerableDefaults.join_() leaks connections
• [CALCITE-2437]FilterMultiJoinMergeRule doesn’t combine postFilterCondition
• [CALCITE-2454]Avoid treating Project(x=1) and Project(x=1) equal when the type of 1 isint in the first rel and long in the second
• [CALCITE-2463]Silence ERROR logs from CalciteException, SqlValidatorException
• [CALCITE-2464]Allow to set nullability for columns of structured types
• [CALCITE-2471]RelNode description includes all tree when recomputed
• [CALCITE-2554]Enrich enumerable join operators with order-preserving information
• [CALCITE-2582]FilterProjectTransposeRule does not always simplify the new filter condition
• [CALCITE-2599]Support ASCII(string) in SqlFunctions
• [CALCITE-2621]Add rule to execute semi-joins with correlation
• [CALCITE-2623]Add specific translation for POSITION, MOD and set operators in BigQueryand Hive SQL dialects
• [CALCITE-2625]ROW_NUMBER, RANK generating invalid SQL
• [CALCITE-2629]Unnecessary call to CatalogReader#getAllSchemaObjects in CatalogScope
• [CALCITE-2635]getMonotonocity is slow on wide tables
• [CALCITE-2674]SqlIdentifier same name with built-in function but with escape charactershould be still resolved as an identifier
• [CALCITE-2677]Struct types with one field are not mapped correctly to Java classes
• [CALCITE-2703]Reduce code generation and class loading overhead when executing queries inEnumerableConvention
• [CALCITE-2722]SqlImplementor.createLeftCall method throws StackOverflowError
• [CALCITE-2727]Materialized view rewriting bails out incorrectly when a view does not containany table reference
• [CALCITE-2733]Use catalog and schema from JDBC connect string to retrieve tables if specified
• [CALCITE-2750]PI operator is incorrectly identified as dynamic function
• [CALCITE-2755]Expose document _id field when querying ElasticSearch
• [CALCITE-2762]Quidem env variable is always false if its name is separated by dot(“.”)
• [CALCITE-2778]Remove ClosableAllocation, ClosableAllocationOwner,CompoundClosableAllocation
• [CALCITE-2782]Use server time zone by default if time zone is not specified in the user connection string
• [CALCITE-2783]“COALESCE(s, TRUE) = TRUE” and “(s OR s IS UNKNOWN) = TRUE” causesNullPointerException
• [CALCITE-2785]In EnumerableAggregate, wrong result produced If there are sorted aggregatesand non-sorted aggregates at the same time
• [CALCITE-2787]JSON aggregate calls with different null clause get incorrectly merged whileconverting from SQL to relational algebra
• [CALCITE-2790]AggregateJoinTransposeRule incorrectly pushes down distinct count into join
• [CALCITE-2797]Support APPROX_COUNT_DISTINCT aggregate function in ElasticSearch
• [CALCITE-2798]Optimizer should remove ORDER BY in sub-query, provided it has no LIMIT orOFFSET
• [CALCITE-2802]In Druid adapter, use of range conditions like '2010-01-01' < TIMESTAMP leadsto incorrect results
• [CALCITE-2805]Can’t specify port with Cassandra adapter in connection string
• [CALCITE-2806]Cassandra adapter doesn’t allow uppercase characters in table names
• [CALCITE-2811]Update version of Cassandra driver
• [CALCITE-2814]In ElasticSearch adapter, fix GROUP BY when using raw item access(e.g. _MAP* [‘a.b.c’])
• [CALCITE-2817]Make CannotPlanException more informative
• [CALCITE-2827]Allow CONVENTION.NONE planning with VolcanoPlanner
• [CALCITE-2838]Simplification: Remove redundant IS TRUE checks
• [CALCITE-2839]Simplify comparisons against BOOLEAN literals
• [CALCITE-2840]RexNode simplification logic should use more specific UnknownAs modes
• [CALCITE-2841]Simplification: push negation into Case expression
• [CALCITE-2842]Computing RexCall digest containing IN expressions leads to exceptions
• [CALCITE-2848]Simplifying a CASE statement's first branch should ignore its safety
• [CALCITE-2850]Geode adapter: support BOOLEAN column as filter operand
• [CALCITE-2852]RexNode simplification does not traverse unknown functions
• [CALCITE-2856]Emulating COMMA JOIN as CROSS JOIN for SparkSqlDialect
• [CALCITE-2858]Improvements in JSON writer and reader for plans
• [CALCITE-2859]Centralize Calcite system properties
• [CALCITE-2863]In ElasticSearch adapter, query fails when filtering directly on _MAP
• [CALCITE-2887]Improve performance of RexLiteral.toJavaString()
• [CALCITE-2897]Reduce expensive calls to Class.getSimpleName()
• [CALCITE-2899]Deprecate RelTraitPropagationVisitor and remove its usages
• [CALCITE-2890]In ElasticSearch adapter, combine any_value with other aggregation functionsfailed
• [CALCITE-2891]Alias suggester failed to suggest name based on original name incrementally
• [CALCITE-2894]RelMdPercentageOriginalRows throws NullPointerException when explainingplan with all attributes
• [CALCITE-2902]Improve performance of AbstractRelNode.computeDigest()
• [CALCITE-2929]Simplification of IS NULL checks are incorrectly assuming that CASTs arepossible
• Improve Graphviz dump in CannotPlanException: make boxes shorter, printcomposite traits if they were simplified
• Make SparkHandlerImpl singleton thread-safe
• Remove usage of userConfig attribute in ElasticSearch adapter
• In ElasticSearch adapter, remove dead (or unnecessary) code

Build and test suite

• [CALCITE-2732]Upgrade PostgreSQL driver version
• [CALCITE-2759]Update maven-remote-resources-plugin to 1.6.0
• [CALCITE-2765]Bump Janino compiler dependency to 3.0.11
• [CALCITE-2768]PlannerTest ignores top-level ORDER BY clause (RootRel.collation)
• [CALCITE-2788]Building error for sub-project of calcite on maven-checkstyle-plugin
• [CALCITE-2779]Remove references to StringBuffer
• [CALCITE-2875]Some misspellings in RelOptListener
• [CALCITE-2895]Some arguments are undocumented in constructor of LogicalAggregate
• [CALCITE-2836]Remove maven-compiler-plugin from calcite-plus module pom.xml
• [CALCITE-2878]Avoid throw new RuntimeException(e) in tests
• [CALCITE-2916]Upgrade jackson to 2.9.8
• [CALCITE-2925]Exclude maven-wrapper.jar from source distribution
• [CALCITE-2931]In Mongo adapter, compare Bson (not string) query representation in tests
• [CALCITE-2932]DruidAdapterIT regression after 1.17 release
• Improve messages for tests based on CalciteAssert
• Add JUnit category for extremely slow tests, launch them in a separate Travis job
• Fix sqlline by removing redundant slf4j dependency (log4j-over-slf4j) fromcassandra-all

Web site and documentation

• Switch from maven:alpine to maven image for generating javadoc whenbuilding the site
• Update instructions for pushing to the git site repository
• [CALCITE-2734]Site: Update mongo documentation to reflect filename changes
• Site: Add commit message guidelines for contributors (Stamatis Zampetakis)
• Site: Add Zoltan Haindrich as committer
• Site: Elastic query example on _MAP
• Site: fix JSON syntax error at file adapter page (Marc Prud’hommeaux)
• Site: fix typo at the main page (Marc Prud’hommeaux)
• [CALCITE-2436]Steps for building site under Windows; fix misprint in SQL Language page
• Site: News item for release 1.18
• Site: Rename MapD to OmniSci, and update logos
• Update site for new repository
• Update git URL
• Site: ElasticAdapter mention supported versions (and support schedule)
• Site: Improve documentation for ElasticSearch Adapter
• Site: Update PMC chair
• Update year in NOTICE

1.18.0 / 2018-12-21

With over 200 commits from 36 contributors, this is the largestCalcite release ever. To the SQL dialect, we addedJSONfunctions andlinearregression functions, theWITHINGROUP clause for aggregate functions; there is a newutilityto recommend lattices based on past queries,and improvements to expression simplification, the SQL advisor,and the Elasticsearch and Apache Geode adapters.

Compatibility: This release is testedon Linux, macOS, Microsoft Windows;using Oracle JDK 8, 9, 10, 11 and OpenJDK 10, 11;Guava versions 19.0 to 27.0.1-jre;Druid version 0.11.0;other software versions as specified in pom.xml.

New features

• [CALCITE-2662]In Planner, allow parsing a stream (Reader) instead of a String(Enrico Olivelli)
• [CALCITE-2699]TIMESTAMPADD function now applies to DATE and TIME as well as TIMESTAMP(xuqianjin)
• [CALCITE-563]In JDBC adapter, push bindable parameters down to the underlying JDBC datasource (Vladimir Sitnikov, Piotr Bojko)
• [CALCITE-2663]In DDL parser, add CREATE and DROP FUNCTION (ambition119)
• [CALCITE-2266]Implement SQL:2016 JSON functions: JSON_EXISTS, JSON_VALUE, JSON_QUERY,JSON_OBJECT, JSON_OBJECTAGG, JSON_ARRAY, JSON_ARRAYAGG, x IS JSONpredicate (Hongze Zhang)
• [CALCITE-2224]Support WITHIN GROUP clause for aggregate functions (Hongze Zhang)
• [CALCITE-2405]In Babel parser, make 400 reserved keywords including YEAR, SECOND, DESCnon-reserved
• [CALCITE-1870]Lattice suggester
• [CALCITE-2571]TRIM function now trims more than one character (Andrew Pilloud)
• [CALCITE-2112]Add Maven wrapper for Calcite (Ratandeep S. Ratti)
• [CALCITE-1026]Allow models in YAML format
• [CALCITE-2402]Implement regression functions: COVAR_POP, COVAR_SAMP, REGR_COUNT,REGR_SXX, REGR_SYY
• SQL advisor (SqlAdvisor):
  • [CALCITE-2479]Automatically quote identifiers that look like SQL keywords
  • [CALCITE-2478]Purge fromclause when _suggest token is located in one of theFROM sub-queries
  • [CALCITE-2477]Scalar sub-queries
  • [CALCITE-2476]Produce hints when sub-query with * is present in query
  • [CALCITE-2475]Support MINUS
  • [CALCITE-2473]Support — comments
  • [CALCITE-2434]Hints for nested tables and schemas
  • [CALCITE-2433]Configurable quoting characters
• Relational algebra builder (RelBuilder):
  • [CALCITE-2661]Add methods for creating Exchange and SortExchangerelational expressions (Chunwei Lei)
  • [CALCITE-2654]Add a fluent API for building complex aggregate calls
  • [CALCITE-2441]RelBuilder.scan should expand TranslatableTable and views
  • [CALCITE-2647]Add a groupKey method that assumes only one grouping set
  • [CALCITE-2470]project method should combine expressions if the underlyingnode is a Project
• Elasticsearch adapter:
  • [CALCITE-2679]Implement DISTINCT and GROUP BY without aggregate functions (Siyuan Liu)
  • [CALCITE-2689]Allow grouping on non-textual fields like DATE and NUMBER
  • [CALCITE-2651]Enable scrolling for basic search queries
  • [CALCITE-2585]Support NOT operator
  • [CALCITE-2578]Support ANY_VALUE aggregate function
  • [CALCITE-2528]Support Aggregate (Andrei Sereda)
• Apache Geode adapter:
  • [CALCITE-2709]Allow filtering on DATE, TIME, TIMESTAMP fields (Sandeep Chada)
  • [CALCITE-2671]GeodeFilter now converts multiple OR predicates (on same attribute) intoa single IN SET (Sandeep Chada)
  • [CALCITE-2498]Geode adapter wrongly quotes BOOLEAN values as strings (Andrei Sereda)

Bug-fixes, API changes and minor enhancements

• [CALCITE-2670]Combine similar JSON aggregate functions in operator table
• [CALCITE-2468]Validator throws IndexOutOfBoundsException when trying to infer operand typefrom STRUCT return type (Rong Rong)
• [CALCITE-2596]When translating correlated variables in enumerable convention, convertnot-null boxed primitive values to primitive (Stamatis Zampetakis)
• [CALCITE-2684]RexBuilder gives AssertionError when creating integer literal larger than263 (Ruben Quesada Lopez)
• [CALCITE-2719]In JDBC adapter for MySQL, fix cast to INTEGER and BIGINT (Piotr Bojko)
• [CALCITE-2713]JDBC adapter may generate casts on PostgreSQL for VARCHAR type exceeding maxlength
• [CALCITE-2529]All numbers are in the same type family (Andrew Pilloud)
• [CALCITE-2701]Make generated Baz classes immutable (Stamatis Zampetakis)
• [CALCITE-2619]Reduce string literal creation cost by deferring and caching charsetconversion (Ted Xu)
• [CALCITE-2720]RelMetadataQuery.getTableOrigin throws IndexOutOfBoundsException ifRelNode has no columns (Zoltan Haindrich)
• [CALCITE-2717]Use Interner instead of LoadingCache to cache traits, and so allow traitsto be garbage-collected (Haisheng Yuan)
• [CALCITE-2542]In SQL parser, allow .field to follow any expression, not just tables andcolumns (Rong Rong)
• [CALCITE-2637]In SQL parser, allow prefix ‘-‘ between BETWEEN and AND (Qi Yu)
• [CALCITE-2632]Ensure that RexNode and its sub-classes implement hashCode and equalsmethods (Zoltan Haindrich)
• [CALCITE-2494]RexFieldAccess should implement equals and hashCode methods
• [CALCITE-2715]In JDBC adapter, do not generate character set in data types for MS SQL Server(Piotr Bojko)
• [CALCITE-2714]Make BasicSqlType immutable, and now SqlTypeFactory.createWithNullabilitycan reuse existing type if possible (Ruben Quesada Lopez)
• [CALCITE-2687]IS DISTINCT FROM could lead to exceptions in ReduceExpressionsRule(Zoltan Haindrich)
• [CALCITE-2673]SqlDialect supports pushing of all functions by default
• [CALCITE-2675]Type validation error as ReduceExpressionsRule fails to preserve typenullability (Zoltan Haindrich)
• [CALCITE-2669]RelMdTableReferences should check whether references inferred from input arenull for Union/Join operators
• Following[CALCITE-2031]remove incorrect “Not implemented” message
• [CALCITE-2668]Support for left/right outer join in RelMdExpressionLineage
• Fix invocation of deprecated constructor of SqlAggFunction (Hongze Zhang)
• [CALCITE-2652]SqlNode to SQL conversion fails if the join condition references a BOOLEANcolumn (Zoltan Haindrich)
• [CALCITE-2657]In RexShuttle, use RexCall.clone instead of new RexCall (Chunwei Lei)
• [CALCITE-2605]Support semi-join via EnumerableCorrelate (Ruben Quesada Lopez)
• [CALCITE-2605]Support left outer join via EnumerableCorrelate
• [CALCITE-1174]When generating SQL, translate SUM0(x) to COALESCE(SUM(x), 0)
• RelBuilder.toString()
• [CALCITE-2617]Add a variant of FilterProjectTransposeRule that can push down a Filterthat contains correlated variables (Stamatis Zampetakis)
• [CALCITE-2638]Constant reducer should not treat as constant an RexInputRef that points to acall to a dynamic or non-deterministic function (Danny Chan)
• [CALCITE-2628]JDBC adapter throws NullPointerException while generating GROUP BY queryfor MySQL
• [CALCITE-2404]Implement access to structured-types in enumerable runtime(Stamatis Zampetakis)
• [CALCITE-2622]RexFieldCollation.toString() method is not deterministic
• [CALCITE-2611]Linq4j code generation failure if one side of an OR contains UNKNOWN(Zoltan Haindrich)
• Canonize simple cases for composite traits in trait factory
• [CALCITE-2591]EnumerableDefaults#mergeJoin should throw error and not return incorrectresults when inputs are not ordered (Enrico Olivelli)
• Test case for[CALCITE-2592]EnumerableMergeJoin is never taken
• [CALCITE-2526]Add test for OR with nullable comparisons (pengzhiwei)
• [CALCITE-2413]Use raw signatures for classes with generics when producing Java code
• In Elasticsearch adapter, remove redundant null check inCompoundQueryExpression
• [CALCITE-2562]Remove dead code in StandardConvertletTable#convertDatetimeMinus
• Avoid NullPointerException when FlatList contains null elements
• [CALCITE-2561]Remove dead code in Lattice constructor
• Apply small refactorings to Calcite codebase (Java 5, Java 7, Java 8)
• [CALCITE-2572]SQL standard semantics for SUBSTRING function (Andrew Pilloud)
• Remove dead code: Compatible, CompatibleGuava11
• Remove “Now, do something with table” from standard output when implementingsequences
• [CALCITE-2444]Handle IN expressions when converting SqlNode to SQL (Zoltan Haindrich)
• [CALCITE-2537]Use litmus for VolcanoPlanner#validate
• [CALCITE-2546]Reduce precision of Profiler’s surprise and cardinality attributes toavoid floating point discrepancies (Alisha Prabhu)
• [CALCITE-2563]Materialized view rewriting may swap columns in equivalent classes incorrectly
• [CALCITE-2551]SqlToRelConverter gives ClassCastException while handling IN insideWHERE NOT CASE (pengzhiwei)
• Remove redundant new expression in constant array creation
• [CALCITE-2474]SqlAdvisor: avoid NPE in lookupFromHints where FROM is empty
• [CALCITE-2418]Remove matchRecognize field of SqlSelect
• [CALCITE-2514]Add SqlIdentifier conversion to ITEM operator for dynamic tables inExtendedExpander (Arina Ielchiieva)
• [CALCITE-2491]Refactor NameSet, NameMap, and NameMultimap
• [CALCITE-2520]Make SparkHandlerImpl#compile silent by default, print code incalcite.debug=true mode only
• [CALCITE-1026]Remove unused import
• [CALCITE-2483]Druid adapter, when querying Druid segment metadata, throws when row number islarger than Integer.MAX_VALUE (Hongze Zhang)
• Support AND, OR, COALESCE, IS [NOT] DISTINCT in RexUtil#op
• [CALCITE-2495]Support encoded URLs in org.apache.calcite.util.Source, and use it for URL→ File conversion in tests
• [CALCITE-2271]Join of two views with window aggregates produces incorrect results or throwsNullPointerException
• [CALCITE-2481]NameSet assumes lower-case characters have greater codes, which does not holdfor certain characters
• [CALCITE-2480]NameSet.contains wrongly returns false when element in set is upper-caseand seek is lower-case
• [CALCITE-2465]Enable use of materialized views for any planner
• [CALCITE-2446]Lateral joins do not work when saved as custom views (Piotr Bojko)
• [CALCITE-2447]POWER, ATAN2 functions fail with NoSuchMethodException
• Typo in HepPlanner trace message (Dylan)
• [CALCITE-2416]AssertionError when determining monotonicity (Alina Ipatina)
• Java 8: use Map.computeIfAbsent when possible
• [CALCITE-2431]SqlUtil.getAncestry throws AssertionError when providing completion hintsfor sub-schema
• [CALCITE-2430]RelDataTypeImpl.getFieldList throws AssertionError when SQL Advisor inspectsnon-struct field
• [CALCITE-2429]SqlValidatorImpl.lookupFieldNamespace throws NullPointerException when SQLAdvisor observes non-existing field
• [CALCITE-2422]Query with unnest of column from nested sub-query fails when dynamic table isused
• [CALCITE-2417]RelToSqlConverter throws ClassCastException with structs (Benoit Hanotte)
• Upgrades:
  • [CALCITE-2716]Upgrade to Avatica 1.13.0
  • [CALCITE-2711]Upgrade SQLLine to 1.6.0
  • [CALCITE-2570]Upgrade forbiddenapis to 2.6 for JDK 11 support
  • [CALCITE-2486]Upgrade Apache parent POM to version 21
  • [CALCITE-2467]Upgrade owasp-dependency-check maven plugin to 3.3.1
  • [CALCITE-2559]Update Checkstyle to 7.8.2
  • [CALCITE-2497]Update Janino version to 3.0.9
• Expression simplification (RexSimplify):
  • [CALCITE-2731]RexProgramBuilder makes unsafe simplifications to CASE expressions (ZoltanHaindrich)
  • [CALCITE-2730]RelBuilder incorrectly simplifies a Filter with duplicate conjunction toempty (Stamatis Zampetakis)
  • [CALCITE-2726]ReduceExpressionRule may oversimplify filter conditions containing NULLvalues
  • [CALCITE-2695]Simplify casts that are only widening nullability (Zoltan Haindrich)
  • [CALCITE-2631]General improvements in simplifying CASE
  • [CALCITE-2639]FilterReduceExpressionsRule causes ArithmeticException at execution time
  • [CALCITE-2620]Simplify COALESCE(NULL, x) → x (pengzhiwei)
  • [CALCITE-1413]Enhance boolean case statement simplifications (Zoltan Haindrich)
  • [CALCITE-2615]When simplifying NOT-AND-OR, RexSimplify incorrectly applies predicatesdeduced for operands to the same operands (Zoltan Haindrich)
  • [CALCITE-2604]When simplifying an expression, say whether an UNKNOWN value will beinterpreted as is, or as TRUE or FALSE
  • [CALCITE-2438]Fix wrong results for IS NOT FALSE(FALSE) (zhiwei.pzw) (Zoltan Haindrich)
  • [CALCITE-2506]Simplifying COALESCE(+ nullInt, +vInt()) results inAssertionError: result mismatch (pengzhiwei)
  • [CALCITE-2580]Simplifying COALESCE(NULL > NULL, TRUE) produces wrong result filterexpressions (pengzhiwei)
  • [CALCITE-2586]CASE with repeated branches gives AssertionError(pengzhiwei)
  • [CALCITE-2590]Remove redundant CAST when operand has exactly the same type as it is casted to
  • Implement fuzzy generator for CASE expressions
  • [CALCITE-2556]Simplify NOT TRUE → FALSE, and NOT FALSE → TRUE (pengzhiwei)
  • [CALCITE-2581]Avoid errors in simplifying UNKNOWN AND NOT (UNKNOWN OR …) (pengzhiwei)
  • [CALCITE-2527]Simplify (c IS NULL) OR (c IS …) might result in AssertionError: resultmismatch (pengzhiwei)
  • Display random failure of Rex fuzzer in build logs to inspire further fixes
  • [CALCITE-2567]Simplify IS NULL(NULL) to TRUE (pengzhiwei)
  • [CALCITE-2555]RexSimplify: Simplify x >= NULL to UNKNOWN (pengzhiwei)
  • [CALCITE-2504]Add randomized test for better code coverage of rex node create andsimplification
  • [CALCITE-2469]Simplify (NOT x) IS NULL → x IS NULL (pengzhiwei);also, simplify f(x, y) IS NULL → x IS NULL OR y IS NULL if f is astrong operator
  • [CALCITE-2327]Simplify AND(x, y, NOT(y)) → AND(x, null, IS NULL(y))
  • [CALCITE-2327]Avoid simplification of x AND NOT(x) to FALSE for nullable x
  • [CALCITE-2505]AssertionError when simplifying IS [NOT] DISTINCT expressions(Haisheng Yuan)

Build and test suite

• [CALCITE-2678]RelBuilderTest#testRelBuilderToString fails on Windows (Stamatis Zampetakis)
• [CALCITE-2660]OsAdapterTest now checks whether required commands are available
• [CALCITE-2655]Enable Travis to test against JDK 12
• Ensure that tests are not calling checkSimplify3 with expected,expectedFalse, expectedTrue all the same
• Geode adapter tests: Removed unnecessary try/final block in RefCountPolicy
• Add license to TestKtTest and add apache-rat:check to Travis CI
• [CALCITE-2112]Add Apache license header to maven-wrapper.properties
• [CALCITE-2588]Run Geode adapter tests with an embedded instance
• [CALCITE-2594]Ensure forbiddenapis and maven-compiler use the correct JDK version
• [CALCITE-2642]Checkstyle complains that maven-wrapper.properties is missing a header
• commons:commons-pool2 is used in tests only, so use scope=test for it
• Make findbugs:jsr305 dependency optional
• [CALCITE-2458]Add Kotlin as a test dependency
• Make build scripts Maven 3.3 compatible
• Fix JavaDoc warnings for Java 9+, and check JavaDoc in Travis CI
• Unwrap invocation target exception from QuidemTest#test
• [CALCITE-2518]Add failOnWarnings to maven-javadoc-plugin configuration
• Silence Pig, Spark, and Elasticsearch logs in tests
• [CALCITE-1894]CsvTest.testCsvStream failing often: add @Ignore since the test is known tofail
• [CALCITE-2535]Enable SqlTester.checkFails (previously it was a no-op) (Hongze Zhang)
• [CALCITE-2558]Improve re-compilation times by skipping parser.java update on each build
• Increase timeout for Cassandra daemon startup for CassandraAdapterTest
• [CALCITE-2412]Add Windows CI via AppVeyor (Sergey Nuyanzin)
• Reduce HepPlannerTest#testRuleApplyCount complexity
• [CALCITE-2523]Guard PartiallyOrderedSetTest#testPosetBitsLarge withCalciteAssert.ENABLE_SLOW
• [CALCITE-2521]Guard RelMetadataTest#testMetadataHandlerCacheLimit withCalciteAssert.ENABLE_SLOW
• [CALCITE-2484]Add SqlValidatorDynamicTest to CalciteSuite
• [CALCITE-2484]Move dynamic tests to a separate class like SqlValidatorDynamicTest, andavoid reuse of MockCatalogReaderDynamic
• [CALCITE-2522]Remove e.printStackTrace() from CalciteAssert#returns
• [CALCITE-2512]Move StreamTest#ROW_GENERATOR to Table.scan().iterator to make it notshared between threads (Sergey Nuyanzin)
• Skip second Checkstyle execution during Travis CI build
• [CALCITE-2519]Silence ERROR logs from CalciteException, SqlValidatorException duringtests
• [CALCITE-1026]Fix ModelTest#testYamlFileDetection when source folder has spaces
• MockCatalogReader is used in testing, so cache should be disabled there toavoid thread conflicts and/or stale results
• [CALCITE-311]Add a test-case for Filter after Window aggregate
• [CALCITE-2462]RexProgramTest: replace nullLiteral → nullInt,unknownLiteral → nullBool for brevity
• [CALCITE-2462]RexProgramTest: move “rex building” methods to base class
• SqlTestFactory: use lazy initialization of objects
• [CALCITE-2435]Refactor SqlTestFactory
• [CALCITE-2428]Cassandra unit test fails to parse JDK version string (Andrei Sereda)
• [CALCITE-2419]Use embedded Cassandra for tests

Web site and documentation

• Add geospatial category to DOAP file
• [CALCITE-2577]Update links on download page to HTTPS
• [CALCITE-2574]Update download page to include instructions for verifying a downloadedartifact
• Update build status badges in README.md
• [CALCITE-2705]Site: Remove duplicate “selectivity” in list of metadata types (Alan Jin)
• Site: Add Andrei Sereda as committer
• Site: Update Julian Hyde’s affiliation
• Update Michael Mior’s affiliation
• Site: Add instructions for updating PRs based on the discussion in the devlist (Stamatis Zampetakis)
• Site: Add committer Sergey Nuyanzin
• Site: News item for release 1.17.0

1.17.0 / 2018-07-16

Compatibility: This release is testedon Linux, macOS, Microsoft Windows;using Oracle JDK 8, 9, 10;Guava versions 19.0 to 23.0;Druid version 0.11.0;other software versions as specified in pom.xml.

This release comes four months after 1.16.0. It includes more than 90 resolvedissues, comprising a large number of new features as well as general improvementsand bug-fixes. Among others:

Implemented Babel SQL parserthat accepts all SQL dialects.Allowed JDK 8 language level for core module.Calcite has been upgraded to use Avatica 1.12.0

New features

• [CALCITE-873]Add a planner rule, SortRemoveConstantKeysRule, that removes constant keys from Sort (Atri Sharma)
• [CALCITE-2045]CREATE TYPE (Shuyi Chen)
• [CALCITE-2216]Improve extensibility of AggregateReduceFunctionsRule (Fabian Hueske)
• [CALCITE-2227]Standards-compliant column ordering for NATURAL JOIN and JOIN USING
• [CALCITE-2280]Babel SQL parser
• [CALCITE-2286]Support timestamp type for Druid adapter
• [CALCITE-2304]In Babel parser, allow Hive-style syntax LEFT SEMI JOIN
• [CALCITE-2321]A union of CHAR columns of different lengths can now (based on a conformance setting) yield a VARCHAR column (Hequn Cheng)

Bug-fixes, API changes and minor enhancements

• [CALCITE-531]LATERAL combined with window function or table function
• [CALCITE-1167]OVERLAPS should match even if operands are in (high, low) order
• [CALCITE-1436]Support MIN/MAX functions (Muhammad Gelbana)
• [CALCITE-1866]JDBC adapter generates incorrect code when pushing FLOOR to MySQL (Kang Wang, Sergey Nuyanzin)
• [CALCITE-1916]Use Teradata’s TPC-DS generator and run tests against TPC-DS at small scale
• [CALCITE-1949]CalciteStatement should call AvaticaStatement close_(), to avoid memory leak (Kevin Risden)
• [CALCITE-2053]Resolve Java user-defined functions that have Double and BigDecimal arguments (余启)
• [CALCITE-2063]Add JDK 10 to .travis.yml
• [CALCITE-2159]Support dynamic row type in UNNEST (Chunhui Shi)
• [CALCITE-2164]Fix alerts raised by lgtm.com (Malcolm Taylor)
• [CALCITE-2188]JDBC adapter generates invalid SQL for DATE/INTERVAL arithmetic (Rahul Raj)
• [CALCITE-2201]Pass RelBuilder into RelDecorrelator and RelStructuredTypeFlattener (Volodymyr Vysotskyi)
• [CALCITE-2205]JoinPushTransitivePredicatesRule should not create Filter on top of equivalent Filter (Vitalii Diravka)
• [CALCITE-2206]JDBC adapter incorrectly pushes windowed aggregates down to HSQLDB (Pavel Gubin)
• [CALCITE-2220]SqlToRelConverter generates incorrect ordinal while flattening a record-valued field (Shuyi Chen)
• [CALCITE-2222]Add Quarter timeunit as a valid unit to pushdown to Druid
• [CALCITE-2225]Upgrade Apache parent POM to version 19, and support OpenJDK 10
• [CALCITE-2226]Druid adapter: Substring operator converter does not handle non-constant literals correctly
• [CALCITE-2229]Allow sqlsh to be run from path, not just current directory
• [CALCITE-2232]Assertion error on AggregatePullUpConstantsRule while adjusting Aggregate indices
• [CALCITE-2236]Druid adapter: Avoid duplication of fields names during Druid query planing
• [CALCITE-2237]Upgrade Maven Surefire plugin to 2.21.0 (Kevin Risden)
• [CALCITE-2238]Fix Pig and Spark adapter failures with JDK 10
• [CALCITE-2240]Extend rule to push predicates into CASE statement (Zoltan Haindrich)
• [CALCITE-2242]Using custom RelBuilder for FilterRemoveIsNotDistinctFromRule (Vitalii Diravka)
• [CALCITE-2247]Simplify AND and OR conditions using predicates (Zoltan Haindrich)
• [CALCITE-2253]Fix matching predicate for JdbcProjectRule rule
• [CALCITE-2255]Add JDK 11 to Travis CI
• [CALCITE-2259]Allow Java 8 syntax
• [CALCITE-2261]Switch core module to JDK 8 (Enrico Olivelli)
• [CALCITE-2262]Druid adapter: Allow count(*) to be pushed when other aggregate functions are present
• [CALCITE-2264]In JDBC adapter, do not push down a call to a user-defined function (UDF) (Piotr Bojko)
• [CALCITE-2265]Allow comparison of ROW values (Dylan Adams)
• [CALCITE-2267]Thread-safe generation of AbstractRelNode.id (Zhong Yu)
• [CALCITE-2275]Do not push down NOT condition in JOIN (Vitalii Diravka)
• [CALCITE-2276]Allow explicit ROW value constructor in SELECT clause and elsewhere (Danny Chan)
• [CALCITE-2277]Skip SemiJoin operator in materialized view-based rewriting algorithm
• [CALCITE-2278]AggregateJoinTransposeRule fails to split aggregate call if input contains an aggregate call and has distinct rows (Haisheng Yuan)
• [CALCITE-2281]Return type of the TIMESTAMPADD function has wrong precision (Sudheesh Katkam)
• [CALCITE-2287]FlatList.equals() throws StackOverflowError (Zhen Wang, Zhong Yu)
• [CALCITE-2291]Support Push Project past Correlate (Chunhui Shi)
• [CALCITE-2293]Upgrade forbidden-apis to 2.5 (for JDK 10)
• [CALCITE-2299]TIMESTAMPADD(SQL_TSI_FRAC_SECOND) should be nanoseconds (Sergey Nuyanzin)
• [CALCITE-2303]In EXTRACT function, support MICROSECONDS, MILLISECONDS, EPOCH, ISODOW, ISOYEAR and DECADE time units (Sergey Nuyanzin)
• [CALCITE-2305]JDBC adapter generates invalid casts on PostgreSQL, because PostgreSQL does not have TINYINT and DOUBLE types
• [CALCITE-2306]AssertionError in RexLiteral.getValue3 with null literal of type DECIMAL (Godfrey He)
• [CALCITE-2309]Dialects: Hive dialect does not support charsets in constants
• [CALCITE-2314]Verify RexNode transformations by evaluating before and after expressions against sample values
• [CALCITE-2316]Elasticsearch adapter should not convert queries to lower-case (Andrei Sereda)
• [CALCITE-2318]NumberFormatException while starting SQLLine
• [CALCITE-2319]Set correct dimension type for druid expressions with result type boolean (nsihantmonu51)
• [CALCITE-2320]Filtering UDF when converting Filter to JDBCFilter (Piotr Bojko)
• [CALCITE-2323]Apply “defaultNullCollation” configuration parameter when translating ORDER BY inside OVER (John Fang)
• [CALCITE-2324]EXTRACT function: HOUR, MINUTE and SECOND parts of a DATE must be zero (Sergey Nuyanzin)
• [CALCITE-2329]Improve rewrite for “constant IN (sub-query)”
• [CALCITE-2331]Evaluation of predicate (A or B) and C fails for Elasticsearch adapter (Andrei Sereda)
• [CALCITE-2332]Wrong simplification of FLOOR(CEIL(x)) to FLOOR(x)
• [CALCITE-2333]Stop releasing zips
• [CALCITE-2334]Extend simplification of expressions with CEIL function over date types
• [CALCITE-2341]Fix ImmutableBitSetTest for jdk11
• [CALCITE-2342]Fix improper use of assert
• [CALCITE-2345]Running Unit tests with Fongo and integration tests with real mongo instance (Andrei Sereda)
• [CALCITE-2347]Running ElasticSearch in embedded mode for unit tests of ES adapter (Andrei Sereda)
• [CALCITE-2353]Allow user to override SqlSetOption (Andrew Pilloud)
• [CALCITE-2355]Implement multiset operations (Sergey Nuyanzin)
• [CALCITE-2357]Freemarker dependency override issue in fmpp maven plugin (yanghua)
• [CALCITE-2358]Use null literal instead of empty string (b-slim)
• [CALCITE-2359]Inconsistent results casting intervals to integers (James Duong)
• [CALCITE-2364]Fix timezone issue (in test) between Mongo DB and local JVM (Andrei Sereda)
• [CALCITE-2365]Upgrade avatica to 1.12
• [CALCITE-2366]Add support for ANY_VALUE aggregate function (Gautam Parai)
• [CALCITE-2368]Fix misc.iq and scalar.iq quidem unit tests failures on Windows
• [CALCITE-2369]Fix OsAdapterTest failure on windows (Sergey Nuyanzin)
• [CALCITE-2370]Fix failing mongo IT tests when explicit order was not specified (Andrei Sereda)
• [CALCITE-2376]Unify ES2 and ES5 adapters. Migrate to low-level ES rest client as main transport (Andrei Sereda)
• [CALCITE-2379]CVSS dependency-check-maven fails for calcite-spark and calcite-ubenchmark modules
• [CALCITE-2380]Javadoc generation failure in Elasticsearch2 adapter (Andrei Sereda)
• [CALCITE-2381]Add information for authenticating against maven repo, GPG keys and version numbers to HOWTO
• [CALCITE-2382]Sub-query join lateral table function (pengzhiwei)
• [CALCITE-2383]NTH_VALUE window function (Sergey Nuyanzin)
• [CALCITE-2384]Performance issue in getPulledUpPredicates (Zoltan Haindrich)
• [CALCITE-2387]Fix for date/timestamp cast expressions in Druid adapter
• [CALCITE-2388]Upgrade from commons-dbcp to commons-dbcp2 version 2.4.0
• [CALCITE-2391]Aggregate query with UNNEST or LATERAL fails with ClassCastException
• [CALCITE-2392]Prevent columns permutation for NATURAL JOIN and JOIN USING when dynamic table is used
• [CALCITE-2396]Allow NULL intervals in TIMESTAMPADD and DATETIME_PLUS functions (James Duong)
• [CALCITE-2398]SqlSelect must call into SqlDialect for unparse (James Duong)
• [CALCITE-2403]Upgrade quidem to 0.9
• [CALCITE-2409]SparkAdapterTest fails on Windows when ‘/tmp’ directory does not exist(Sergey Nuyanzin)

1.16.0 / 2018-03-14

Compatibility: This release is testedon Linux, macOS, Microsoft Windows;using Oracle JDK 8, 9, 10;Guava versions 19.0 to 23.0;Druid version 0.11.0;other software versions as specified in pom.xml.

This release comes three months after 1.15.0. It includes more than 80 resolvedissues, comprising a large number of new features as well as general improvementsand bug-fixes to Calcite core. Among others:

• Calcite has been upgraded to useAvatica 1.11.0,which was recently released.
• Moreover, a new adapter toread data from Apache Geodewas added in this release. In addition, more progress has been made for the existing adapters,e.g., the Druid adapter can generateSCAN queries rather than SELECT queriesfor more efficient execution and it can pushmore work to Druid using its new expressions capabilities,and the JDBC adapter now supports the SQL dialect used by Jethro Data.
• Finally, this releasedrops support for JDK 1.7 andsupport for Guava versions earlier than 19.

New features

• [CALCITE-1265]In JDBC adapter, push OFFSET and FETCH to data source
• [CALCITE-2059]Apache Geode adapter (Christian Tzolov)
• [CALCITE-2077]Druid adapter: Use SCAN query rather than SELECT query (Nishant Bangarwa)
• [CALCITE-2128]In JDBC adapter, add SQL dialect for Jethro Data (Jonathan Doron)
• [CALCITE-2170]Use Druid Expressions capabilities to improve the amount of work that can be pushed to Druid

Bug-fixes, API changes and minor enhancements

• [CALCITE-1054]NPE caused by wrong code generation for Timestamp fields
• [CALCITE-1188]NullPointerException in EXTRACT with WHERE … IN clause if field has null value
• [CALCITE-1427]Code generation incorrect (does not compile) for DATE, TIME and TIMESTAMP fields
• [CALCITE-1658]DateRangeRules incorrectly rewrites EXTRACT calls (Nishant Bangarwa)
• [CALCITE-1697]Update Mongo driver version to 3.5.0 (Vladimir Dolzhenko)
• [CALCITE-2002]DISTINCT applied to VALUES returns wrong result
• [CALCITE-2009]Possible bug in interpreting ( IN ) OR ( IN ) logic
• [CALCITE-2020]Upgrade org.incava java-diff
• [CALCITE-2027]Drop support for Java 7 (JDK 1.7)
• [CALCITE-2034]FileReaderTest fails with path containing spaces
• [CALCITE-2066]RelOptUtil.splitJoinCondition() could not split condition with case after applying FilterReduceExpressionsRule (Volodymyr Vysotskyi)
• [CALCITE-2071]Query with IN and OR in WHERE clause returns wrong result (Vineet Garg)
• [CALCITE-2072]Enable spatial functions by adding ‘fun=spatial’ to JDBC connect string
• [CALCITE-2075]SparkAdapterTest UT fails
• [CALCITE-2076]Upgrade to Druid 0.11.0 (Nishant Bangarwa)
• [CALCITE-2080]Query with NOT IN operator and literal throws AssertionError: ‘Cast for just nullability not allowed’ (Volodymyr Vysotskyi)
• [CALCITE-2081]Query with windowed aggregates under both sides of a JOIN throws NullPointerException (Zhen Wang)
• [CALCITE-2084]SqlValidatorImpl.findTable() method incorrectly handles table schema with few schema levels (Volodymyr Vysotskyi)
• [CALCITE-2088]Add more complex end-to-end tests in “plus” module, using Chinook data set (Piotr Bojko)
• [CALCITE-2089]Druid adapter: Push filter on floor(time) to Druid (Nishant Bangarwa)
• [CALCITE-2090]Extend Druid Range Rules to extract interval from Floor (Nishant Bangarwa)
• [CALCITE-2091]Improve DruidQuery cost function, to ensure that EXTRACT gets pushed as an interval if possible
• [CALCITE-2092]Allow passing custom RelBuilder into SqlToRelConverter
• [CALCITE-2093]OsAdapterTest in Calcite Plus does not respect locale (Piotr Bojko)
• [CALCITE-2094]Druid adapter: Count(*) returns null instead of 0 when condition filters all rows
• [CALCITE-2095]Druid adapter: Push always true and always true expressions as Expression Filters
• [CALCITE-2096]Druid adapter: Remove extra dummy_aggregator
• [CALCITE-2097]Druid adapter: Push Aggregate and Filter operators containing metric columns to Druid
• [CALCITE-2098]Push filters to Druid Query Scan when we have OR of AND clauses
• [CALCITE-2099]Code generated for GROUP BY inside UNION does not compile (Zhen Wang)
• [CALCITE-2101]Druid adapter: Push count(column) using Druid filtered aggregate
• [CALCITE-2102]Ignore duplicate ORDER BY keys, and ensure RelCollation contains no duplicates (John Fang)
• [CALCITE-2104]Add separate rules for AggregateUnionAggregateRule to reduce potential matching cost in VolcanoPlanner (lincoln-lil)
• [CALCITE-2105]AggregateJoinTransposeRule fails when process aggregate without group keys (jingzhang)
• [CALCITE-2107]Timezone not passed as part of granularity when passing TimeExtractionFunction to Druid (Nishant Bangarwa)
• [CALCITE-2108]AggregateJoinTransposeRule fails when process aggregateCall above SqlSumEmptyIsZeroAggFunction without groupKeys (jingzhang)
• [CALCITE-2110]ArrayIndexOutOfBoundsException in RexSimplify when using ReduceExpressionsRule.JOIN_INSTANCE
• [CALCITE-2111]Make HepPlanner more efficient by applying rules depth-first
• [CALCITE-2113]Push column pruning to druid when Aggregate cannot be pushed (Nishant Bangarwa)
• [CALCITE-2114]Re-enable DruidAggregateFilterTransposeRule
• [CALCITE-2116]The digests are not same for the common sub-expressions in HepPlanner (LeoWangLZ)
• [CALCITE-2118]RelToSqlConverter should only generate “*” if field names match (Sam Waggoner)
• [CALCITE-2122]In DateRangeRules, make either TIMESTAMP or DATE literal, according to target type (Nishant Bangarwa)
• [CALCITE-2124]AggregateExpandDistinctAggregatesRule should make SUM nullable if there is no GROUP BY (Godfrey He)
• [CALCITE-2127]In Interpreter, allow a node to have more than one consumer
• [CALCITE-2133]Allow SqlGroupedWindowFunction to specify returnTypeInference in its constructor (Shuyi Chen)
• [CALCITE-2135]If there is an aggregate function inside an OVER clause, validator should treat query as an aggregate query (Volodymyr Tkach)
• [CALCITE-2137]Materialized view rewriting not being triggered for some join queries
• [CALCITE-2139]Upgrade checkstyle
• [CALCITE-2143]RelToSqlConverter produces incorrect SQL with aggregation (Sam Waggoner)
• [CALCITE-2147]GroupingSets involving rollup resulting into an incorrect plan (Ravindar Munjam)
• [CALCITE-2154]Upgrade jackson to 2.9.4
• [CALCITE-2156]In DateRangeRules, compute FLOOR and CEIL of TIMESTAMP WITH LOCAL TIMEZONE in local time zone (Nishant Bangarwa)
• [CALCITE-2162]Exception when accessing sub-field of sub-field of composite Array element (Shuyi Chen)
• [CALCITE-2178]Extend expression simplifier to work on datetime CEIL/FLOOR functions
• [CALCITE-2179]General improvements for materialized view rewriting rule
• [CALCITE-2180]Invalid code generated for negative of byte and short values
• [CALCITE-2183]Implement RelSubset.copy method (Alessandro Solimando)
• [CALCITE-2185]Additional unit tests for Spark Adapter (Alessandro Solimando)
• [CALCITE-2187]Fix build issue caused by CALCITE-2170
• [CALCITE-2189]RelMdAllPredicates fast bail out creates mismatch with RelMdTableReferences
• [CALCITE-2190]Extend SubstitutionVisitor.splitFilter to cover different order of operands
• [CALCITE-2191]Drop support for Guava versions earlier than 19
• [CALCITE-2192]RelBuilder wrongly skips creating an Aggregate that prunes columns, if input is unique
• [CALCITE-2195]AggregateJoinTransposeRule fails to aggregate over unique column (Zhong Yu)
• [CALCITE-2196]Tweak janino code generation to allow debugging (jingzhang)
• [CALCITE-2197]Test failures on Windows
• [CALCITE-2200]Infinite loop for JoinPushTransitivePredicatesRule
• [CALCITE-2207]Enforce Java version via maven-enforcer-plugin (Kevin Risden)
• [CALCITE-2213]Geode integration tests are failing

Web site and documentation

• [CALCITE-2024]Submit a journal paper on Calcite to VLDB Journal or ACM SIGMOD Record (Edmon Begoli)
• [CALCITE-2203]Calcite site redirect links to Avatica broken with jekyll-redirect-from 0.12+ (Kevin Risden)

1.15.0 / 2017-12-11

Compatibility: This release is testedon Linux, macOS, Microsoft Windows;using Oracle JDK 7, 8, 9, 10;Guava versions 14.0 to 23.0;Druid version 0.10.0;other software versions as specified in pom.xml.

This release comes three months after 1.14.0. It includes than 44 resolvedissues, mostly modest improvements and bug-fixes, but here are somefeatures of note:

• [CALCITE-707]adds DDL commands to Calcite for the first time, including CREATE and DROPcommands for schemas, tables, foreign tables, views, and materialized views.We know that DDL syntax is a matter of taste, so we added the extensions to anew “server” module, leaving the “core” parser unchanged;
• [CALCITE-2061]allows dynamic parameters in the LIMIT and OFFSET and clauses;
• [CALCITE-1913]refactors the JDBC adapter to make it easier to plug in a new SQL dialect;
• [CALCITE-1616]adds a data profiler, an algorithm that efficiently analyzes large data setswith many columns, estimating the number of distinct values in columns andgroups of columns, and finding functional dependencies. The improvedstatistics are used by the algorithm that designs summary tables for alattice.

Calcite now supports JDK 10 and Guava 23.0. (It continues to run onJDK 7, 8 and 9, and on versions of Guava as early as 14.0.1. The defaultversion of Guava remains 19.0, the latest version compatible with JDK 7and the Cassandra adapter’s dependencies.)

This is the lastrelease that will support JDK 1.7.

New features

• [CALCITE-1616]Data profiler
• [CALCITE-2061]Dynamic parameters in OFFSET, FETCH and LIMIT clauses (Enrico Olivelli)
• [CALCITE-707]Add “server” module, with built-in support for simple DDL statements
• [CALCITE-2041]When ReduceExpressionRule simplifies a nullable expression, allow the resultto change type to NOT NULL
• [CALCITE-2058]Support JDK 10
• [CALCITE-2016]Make item + dot operators work for array (e.g. SELECT orders[5].color FROM t(Shuyi Chen)
• [CALCITE-2035]Allow approximate aggregate functions, and add APPROX_COUNT_DISTINCT
• [CALCITE-1990]Make RelDistribution extend RelMultipleTrait (LeoWangLZ)
• [CALCITE-1867]Allow user-defined grouped window functions (Timo Walther)
• [CALCITE-2031]ST_X and ST_Y GIS functions
• [CALCITE-1913]Pluggable SQL dialects for JDBC adapter: Replace usages of DatabaseProductwith dialect methods, and introduce a configurable SqlDialectFactory(Christian Beikov)

Bug-fixes, API changes and minor enhancements

• [CALCITE-2078]Aggregate functions in OVER clause (Liao Xintao)
• [CALCITE-2070]Git test fails when run from source distro
• [CALCITE-1808]JaninoRelMetadataProvider loading cache might cause OutOfMemoryError
• [CALCITE-2069]RexSimplify.removeNullabilityCast() always removes cast for operand withANY type (Volodymyr Vysotskyi)
• [CALCITE-2074]Simplification of point ranges that are open above or below yields wrongresults
• [CALCITE-2005]Test failures on Windows
• Add ImmutableBitSet.set(int, boolean)
• [CALCITE-2054]Error while validating UPDATE with dynamic parameter in SET clause (EnricoOlivelli)
• [CALCITE-2055]Check year, month, day, hour, minute and second ranges for date and timeliterals (Volodymyr Vysotskyi)
• [CALCITE-2051]Rules using Aggregate might check for simple grouping sets incorrectly
• Add parameter to SqlCallBinding.getOperandLiteralValue(int) to specifydesired value type
• [CALCITE-2039]AssertionError when pushing project to ProjectableFilterableTable
• [CALCITE-2050]Exception when pushing post-aggregates into Druid
• [CALCITE-2043]Use custom RelBuilder implementation in some rules (Volodymyr Vysotskyi)
• [CALCITE-2044]Tweak cost of BindableTableScan to make sure Project is pushed throughAggregate (Luis Fernando Kauer)
• [CALCITE-2012]Replace LocalInterval by Interval in Druid adapter
• [CALCITE-1984]Incorrect rewriting with materialized views using DISTINCT in aggregatefunctions
• [CALCITE-1876]In CSV example, tweak cost to ensure that Project is pushed throughAggregate (Luis Fernando Kauer)
• [CALCITE-2037]Modify parser template to allow sub-projects to override SqlStmt syntax(Roman Kulyk)
• [CALCITE-2019]Druid’s time column is NOT NULL, so push COUNT(druid_time_column) as if itwere COUNT(*)
• [CALCITE-2034]FileReaderTest fails with path containing spaces (Marc Prud’hommeaux)
• [CALCITE-2028]SubQueryRemoveRule should create Join, not Correlate, for un-correlatedsub-queries (Liao Xintao)
• [CALCITE-2029]Query with IS DISTINCT FROM condition in WHERE or JOIN clause fails withAssertionError, “Cast for just nullability not allowed” (Volodymyr Vysotskyi)
• [CALCITE-1998]Hive ORDER BY null values (Abbas Gadhia)
• [CALCITE-2014]Look for saffron.properties file in classpath rather than in workingdirectory (Arina Ielchiieva)
• [CALCITE-1910]NullPointerException on filtered aggregators using IN
• [CALCITE-1762]Upgrade to Spark 2.X
• [CALCITE-2008]Fix braces in TRIM signature
• [CALCITE-2007]Fix RexSimplify behavior when literals come first
• [CALCITE-2006]Push IS NULL and IS NOT NULL predicates to Druid
• [CALCITE-1996]In JDBC adapter, generate correct VALUES syntax
• [CALCITE-2001]JDBC driver should return “SYSTEM TABLE” rather than “SYSTEM_TABLE”
• [CALCITE-1995]Remove terms from Filter if predicates indicate they are always true orfalse
• [CALCITE-1983]Push =and <> operations with numeric cast on dimensions to Druid
• [CALCITE-1960]RelMdPredicates.getPredicates is slow if there are many equivalent columns(Rheet Wong)
• Make Travis CI builds work (Christian Beikov)
• [CALCITE-1987]Implement EXTRACT for JDBC (Pavel Gubin)
• [CALCITE-1988]Various code quality issues
• [CALCITE-1986]Add RelBuilder.match and methods for building patterns (Dian Fu)
• [CALCITE-1980]RelBuilder.aggregate should rename underlying fields if groupKey contains an alias
• [CALCITE-1946]JDBC adapter should generate sub-SELECT if dialect does not support nestedaggregate functions (Pawel Ruchaj)
• [CALCITE-1976]linq4j: support List and Map literals

Web site and documentation

• Update PMC Chair
• [CALCITE-2052]Remove SQL code style from materialized views documentation
• [CALCITE-2036]Fix “next” link in powered_by.html
• [CALCITE-2038]Fix incomplete sentence in tutorial
• [CALCITE-2021]Document the interfaces that you can use to extend Calcite
• Javadoc fixes (Alexey Roytman)
• Add two talks, and committer Christian Beikov
• Fix URL in FileSchemaFactory javadoc (Marc Prud’hommeaux)
• [CALCITE-1989]Check dependencies for vulnerabilities each release

1.14.0 / 2017-09-06

This release brings some big new features.The GEOMETRY data type was added along with 35 associated functions as the start of support for Simple Feature Access.There are also two new adapters.Firstly, the Elasticsearch 5 adapter which now exists in parallel with the previous Elasticsearch 2 adapter.Additionally there is now an OS adapter which exposes operating system metrics as relational tables.ThetaSketch and HyperUnique support has also been added to the Druid adapter.

Several minor improvements are added as well including improved MATCH_RECOGNIZE support, quantified comparison predicates, and ARRAY and MULTISET support for UDFs.A full list of new features is given below.

There are also a few breaking changes.The return type of RANK and other aggregate functions has been changed.There also changes to Aggregate in order to improve compatibility with Apache Hive.Finally, the Schema#snapshot() interface has been upgraded to allow for more flexible versioning.

Compatibility: This release is testedon Linux, macOS, Microsoft Windows;using Oracle JDK 1.7, 1.8, 9;Guava versions 14.0 to 21.0;Druid version 0.11.0;other software versions as specified in pom.xml.

New features

• [CALCITE-1968] OpenGIS Simple Feature Access SQL 1.2.1: add GEOMETRY data type and first 35 functionsAdd Spatial page, document GIS functions in SQL reference (indicatingwhich ones are implemented), and add “countries” data set for testing.
• [CALCITE-1967] Elasticsearch 5 adapter (Christian Beikov)
• [CALCITE-1911] In MATCH_RECOGNIZE, support WITHIN sub-clause (Dian Fu)
• [CALCITE-1897] Add ‘%’ operator as an alternative to ‘MOD’ (sunjincheng)
• [CALCITE-1787] Add ThetaSketch and HyperUnique support to Calcite via rolled up columns (Zain Humayun)
• [CALCITE-1896] OS adapter and sqlsh
  • Vmstat table function for sqlsh
• [CALCITE-1864] Allow NULL literal as argument
• [CALCITE-1834] Allow user-defined functions to have arguments that are ARRAY or MULTISET (Ankit Singhal)
• [CALCITE-1886] Support "LIMIT [offset,] row_count", per MySQL (Kaiwang Chen)
• [CALCITE-1845] Quantified comparison predicates (SOME, ANY, ALL)
• [CALCITE-1709] Support mixing table columns with extended columns in DML (Rajeshbabu Chintaguntla)

Bug-fixes, API changes and minor enhancements

• [CALCITE-1931]Change the return type of RANK and other aggregate functions.Various aggregate functions that used to return INTEGER now return othertypes: RANK, DENSE_RANK, and NTILE now return BIGINT;CUME_DIST and PERCENT_RANK now return DOUBLE.(This is a breaking change.)
• [CALCITE-1947] Add TIME/TIMESTAMP with local time zone types to optimizer
• [CALCITE-1972] Create .sha512 and .md5 digests for release artifacts
• [CALCITE-1941] Refine interface Schema#snapshot()(This is a breaking change.)
• [CALCITE-1069] In Aggregate, deprecate indicators, and allow GROUPING to be used as an aggregate function(This is a breaking change.)
• [CALCITE-1969] Annotate user-defined functions as strict and semi-strict
• [CALCITE-1945] Make return types of AVG, VARIANCE, STDDEV and COVAR customizable via RelDataTypeSystem
• [CALCITE-1966] Allow normal views to act as materialization table (Christian Beikov)
• [CALCITE-1953] Rewrite "NOT (x IS FALSE)" to "x IS NOT FALSE"; "x IS TRUE" would be wrong
• [CALCITE-1943] Add back NavigationExpander and NavigationReplacer in SqlValidatorImpl (Dian Fu)
• [CALCITE-1963] Upgrade checkstyle, and fix code to comply
• [CALCITE-1944] Window function applied to sub-query that returns dynamic star gets wrong plan (Volodymyr Vysotskyi)
• [CALCITE-1954] Column from outer join should be null, whether or not it is aliased
• [CALCITE-1959] Reduce the amount of metadata and tableName calls in Druid (Zain Humayun)
• [CALCITE-1930] Fix AggregateExpandDistinctAggregatesRule when there are multiple AggregateCalls referring to the same input
• [CALCITE-1936] Allow ROUND() and TRUNCATE() to take one operand, defaulting scale to 0
• [CALCITE-1931] Change the return type of RANK and other aggregate functions
• [CALCITE-1932] Project.getPermutation() should return null if not a permutation (e.g. repeated InputRef)
• [CALCITE-1925] In JaninoRelMetadataProvider, cache null values (Ted Xu)
• [CALCITE-1849] Support RexSubQuery in RelToSqlConverter
• [CALCITE-1909] Output rowType of Match should include PARTITION BY and ORDER BY columns
• [CALCITE-1929] Deprecate class RelDataTypeFactory.FieldInfoBuilder
• [CALCITE-1895] MSSQL’s SUBSTRING operator has different syntax (Chris Baynes)
• [CALCITE-1919] NullPointerException when target in ReflectiveSchema belongs to root package (Lim Chee Hau)
• [CALCITE-1907] Table function with 1 column gives ClassCastException
• [CALCITE-1841] Create handlers for JDBC dialect-specific generated SQL (Chris Baynes)
• [CALCITE-1898] LIKE must match ‘.’ (period) literally
• [CALCITE-1900] Detect cyclic views and give useful error message
• [CALCITE-1893] Add MYSQL_5 conformance
• [CALCITE-1883] HepPlanner should force garbage collect whenever a root registered (Ted Xu)
• [CALCITE-1889] Accept compound identifiers in SqlValidatorUtil.checkIdentifierListForDuplicates() (Rajeshbabu Chintaguntla)
• [CALCITE-1881] Can’t distinguish overloaded user-defined functions that have DATE and TIMESTAMP arguments (余启)
• [CALCITE-1803] Push Project that follows Aggregate down to Druid (Junxian Wu)
• [CALCITE-1828] Push the FILTER clause into Druid as a Filtered Aggregator (Zain Humayun)
• [CALCITE-1871] Nesting LAST within PREV is not parsed correctly for MATCH_RECOGNIZE
• [CALCITE-1877] Move the Pig test data files into target for the test runtime
• [CALCITE-1815] Switch Pig adapter to depend on avatica-core instead of full avatica
• [CALCITE-1826] Generate dialect-specific SQL for FLOOR operator when in a GROUP BY (Chris Baynes)
• [CALCITE-1842] Sort.computeSelfCost() calls makeCost()`` with arguments in wrong order (Junxian Wu)
• [CALCITE-1874] In Frameworks, make SqlToRelConverter configurable
• [CALCITE-1873] In a “GROUP BY ordinal” query, validator gives invalid “Expression is not being grouped” error if column has alias
• [CALCITE-1833] User-defined aggregate functions with more than one parameter (hzyuemeng1)
• [CALCITE-1860] Duplicate null predicates cause NullPointerException in RexUtil (Ruidong Li)
• [CALCITE-1859] NPE in validate method of VolcanoPlanner
• [CALCITE-1818] Handle SqlKind.DYNAMIC (parameters) in SqlImplementor (Dylan Adams)
• [CALCITE-1856] Add option StructKind.PEEK_FIELDS_NO_EXPAND, similar to PEEK_FIELDS but is not expanded in "SELECT *" (Shuyi Chen)

Web site and documentation

• Add committer Chris Baynes
• Add DataEngConf talk
• [CALCITE-1901] SQL reference should say that “ONLY” is required after “FETCH … ROWS”

1.13.0 / 2017-06-20

This release comes three months after 1.12.0. It includes more than 75 resolved issues, comprisinga large number of new features as well as general improvements and bug-fixes.

First, Calcite has been upgraded to useAvatica 1.10.0,which was recently released.

Moreover, Calcite core includes improvements which aim at making it more powerful, stable and robust.In addition to numerous bux-fixes, we have implemented anew materialized view rewriting algorithmand new metadata providers whichshould prove useful for data processing systems relying on Calcite.

In this release, we have also completed the work tosupport the MATCH_RECOGNIZE clauseused in complex-event processing (CEP).

In addition, more progress has been made for the different adapters.For instance, the Druid adapter now relies onDruid 0.10.0 andit can generate more efficient plans where most of the computation can be pushed to Druid,e.g., using extraction functions.

There is one minor but potentially breaking API change inCALCITE-1788, requiring changes in the parameterlists of parser extension methods.

Compatibility: This release is testedon Linux, macOS, Microsoft Windows;using Oracle JDK 1.7, 1.8, 9;Guava versions 14.0 to 21.0;Druid version 0.10.0;other software versions as specified in pom.xml.

New features

• [CALCITE-1570]Add MATCH_RECOGNIZE operator, for event pattern-matching
  • [CALCITE-1647]Classifier and match_number syntax support for MATCH_RECOGNIZE
  • [CALCITE-1646]Partition by and order by syntax support for MATCH_RECOGNIZE (Zhiqiang-He)
  • [CALCITE-1645]Row per match syntax support for MATCH_RECOGNIZE (Zhiqiang-He)
  • [CALCITE-1644]Subset clause syntax support for MATCH_RECOGNIZE (Zhiqiang-He)
  • [CALCITE-1643]AFTER MATCH sub-clause of MATCH_RECOGNIZE clause (Zhiqiang-He)
  • [CALCITE-1642]Support MEASURES clause in MATCH_RECOGNIZE (Zhiqiang-He)
• [CALCITE-1853]Push Count distinct into Druid when approximate results are acceptable (Zain Humayun)
• [CALCITE-1829]Add TIME/TIMESTAMP/DATE datatype handling to RexImplicationChecker
• [CALCITE-1613]Implement EXTRACT for time unit DOW, DOY; and fix CENTURY
• [CALCITE-1807]Upgrade to Avatica 1.10
• [CALCITE-1802]Add post-aggregation step for Union in materialized view rewriting
• [CALCITE-1795]Extend materialized view rewriting to produce rewritings using Union operators
• [CALCITE-1797]Support view partial rewriting in aggregate materialized view rewriting
• [CALCITE-1791]Support view partial rewriting in join materialized view rewriting
• [CALCITE-1731]Rewriting of queries using materialized views with joins and aggregates
• [CALCITE-1780]Add required Order and requiresOver parameters to the constructor of SqlUserDefinedAggregate Function (SunJincheng)
• [CALCITE-1306]Allow GROUP BY and HAVING to reference SELECT expressions by ordinal and alias (Rajeshbabu Chintaguntla)
• [CALCITE-1781]Allow expression in CUBE and ROLLUP
• [CALCITE-1771]Upgrade to Druid 0.10.0 (Nishant Bangarwa)
• [CALCITE-1772]Add a hook to allow RelNode expressions to be executed by JDBC driver
• [CALCITE-1766]Support system functions having no args with parenthesis too (Ankit Singhal)
• [CALCITE-1760]Implement utility method to identify lossless casts
• [CALCITE-1682]New metadata providers for expression column origin and all predicates in plan
• [CALCITE-1753]Push expressions into null-generating side of a join if they are “strong” (null-preserving)
• [CALCITE-1759]Add SQL:2014 reserved words to parser
• [CALCITE-476]Support distinct aggregates in window functions
• [CALCITE-1738]Support CAST of literal values in filters pushed to Druid (Remus Rusanu)
• [CALCITE-1758]Push to Druid OrderBy/Limit operation over time dimension and additional columns (Slim Bouguerra)
• [CALCITE-1707]Push Extraction filter on Year/Month/Day to druid (Slim Bouguerra)
• [CALCITE-1725]Push project aggregate of time extract to druid (Slim Bouguerra)
• [CALCITE-1747]RelMdColumnUniqueness for HepRelVertex
• [CALCITE-1749]Push filter conditions partially into Druid
• [CALCITE-1730]Upgrade Druid to 0.9.2 (Nishant Bangarwa)
• [CALCITE-1702]Support extended columns in DML (Kevin Liew)

Bug-fixes, API changes and minor enhancements

• [CALCITE-1855]Fix float values in Cassandra adapter
• [CALCITE-1848]Rename MySource to FileSource (Darion Yaphet)
• [CALCITE-1852]Fix for UnionMergeRule to deal correctly with EXCEPT
• [CALCITE-1850]Extend UnionMergeRule to deal with more than 2 branches (Pengcheng Xiong)
• [CALCITE-1805]Druid adapter incorrectly pushes down COUNT(c); Druid only supports COUNT(*)
• [CALCITE-1846]Metadata pulled up predicates should skip non-deterministic calls (Ted Xu)
• [CALCITE-1819]Druid Adapter does not push the boolean operator <> as a filter correctly (Zain Humayun)
• [CALCITE-1798]In JDBC adapter, generate dialect-specific SQL for FLOOR operator (Chris Baynes)
• [CALCITE-1812]Provide RelMetadataQuery from planner to rules and invalidate in transformTo (Remus Rusanu)
• [CALCITE-1804]Cannot assign NOT NULL array to NULLABLE array (Ankit Singhal)
• [CALCITE-1810]Allow NULL for ARRAY constructor (Ankit Singhal)
• [CALCITE-1830]ProcessBuilder is security sensitive; move it to test suite to prevent accidents
• [CALCITE-1816]JaninoRelMetadataProvider generated classes leak ACTIVE nodes on exception (Remus Rusanu)
• [CALCITE-1690]Calcite timestamp literals cannot express precision above millisecond, TIMESTAMP(3)
• [CALCITE-1664]CAST(<string> as TIMESTAMP) adds part of sub-second fraction to the value
• [CALCITE-1742]Create a read-consistent view of CalciteSchema for each statement compilation
• [CALCITE-1800]JDBC adapter fails on query with UNION in FROM clause (Viktor Batytskyi, Minji Kim)
• [CALCITE-1788]Simplify handling of position in the parser
• [CALCITE-1782]AggregateExpandDistinctAggregatesRule should work on Aggregate instead of LogicalAggregate (Haohui Mai)
• [CALCITE-1293]Bad code generated when argument to COUNT(DISTINCT) is a GROUP BY column
• [CALCITE-1770]CAST(NULL AS …) gives NPE (Slim Bouguerra)
• [CALCITE-1777]WHERE FALSE causes AssertionError (Slim Bouguerra)
• [CALCITE-1778]Query with WHERE CASE throws AssertionError “Cast for just nullability not allowed”
• [CALCITE-1773]Add Test sql validator test for Pattern skip syntax in MATCH_RECOGNIZE (Zhiqiang-He)
• [CALCITE-1761]TUMBLE/HOP/SESSION_START/END do not resolve time field correctly
• [CALCITE-1765]Druid adapter fail when the extract granularity is not supported (Slim Bouguerra)
• [CALCITE-1767]Fix join/aggregate rewriting rule when same table is referenced more than once
• [CALCITE-1764]Adding sort ordering type for druid sort json field (Slim Bouguerra)
• [CALCITE-715]Add PERIOD type constructor and period operators (CONTAINS, PRECEDES, etc.)
• [CALCITE-1456]Change SubstitutionVisitor to use generic RelBuilder instead of Logical instances of the operators when possible
• [CALCITE-1763]Recognize lossless casts in join/aggregate materialized view rewriting rule
• [CALCITE-1639]TIMESTAMPADD(MONTH, …) should return last day of month if the day overflows
• [CALCITE-1754]In Csv adapter, convert DATE and TIME values to int, and TIMESTAMP values to long (Hongbin Ma)
• [CALCITE-1751]PigRelBuilderStyleTest test cases are flapping
• [CALCITE-1750]Fix unit test failures when the path to the repository contains spaces
• [CALCITE-1724]Wrong comparison for floats/double type in Druid (Slim Bouguerra)
• [CALCITE-1734]Select query result not parsed correctly with druid 0.9.2 (Nishant Bangarwa)
• [CALCITE-1732]IndexOutOfBoundsException when using LATERAL TABLE with more than one field (Godfrey He)
• [CALCITE-1722]Druid adapter uses un-scaled value of DECIMAL literals (Slim Bouguerra)
• [CALCITE-1723]Match DruidProjectFilterTransposeRule against DruidQuery (Nishant Bangarwa)
• [CALCITE-1714]Do not push group by on druid metrics fields (Slim Bouguerra)

Web site and documentation

• Michael Mior joins PMC
• Add 3 new committers (Zhiqiang-He, Kevin Liew, Slim Bouguerra)
• [CALCITE-1854]Fix value range of TINYINT in documentation (James Xu)
• [CALCITE-1827]Document TIMESTAMPADD, TIMESTAMPDIFF functions (SunJincheng)
• [CALCITE-1796]Update materialized views documentation
• [CALCITE-1566]Better documentation on the use of materialized views

1.12.0 / 2017-03-24

Features of note this release areJDK 9 support,the new file/web and Apache Pig adapters,general improvements to the Druid adapter,more helpful error messages if you get a table or column name wrong,improved the plans for correlated sub-queries,support for TUMBLE, HOP and SESSION window functions in streaming and regular queries,experimental support for MATCH_RECOGNIZE clause for complex-event processing (CEP),several new built-in functions to comply with the ODBC/JDBC standard.

Compatibility: This release is testedon Linux, macOS, Microsoft Windows;using Oracle JDK 1.7, 1.8, 9;Guava versions 14.0 to 21.0;Druid version 0.9.1.1;other software versions as specified in pom.xml.

New features

• [CALCITE-1666]Support for modifiable views with extended columns (Kevin Liew)
• [CALCITE-1655]Druid adapter: add IN filter (Slim Bouguerra)
• [CALCITE-1641]Add parser and validator support for MATCH_RECOGNIZE, a new clause forcomplex-event processing (CEP) (Zhiqiang-He)
  • [CALCITE-1686]Only allow FINAL and other functions inside MATCH_RECOGNIZE (Zhiqiang-He)
  • [CALCITE-1689]Remove PATTERN_DEFINE_AS in SqlStdOperatorTable; MATCH_RECOGNIZE now usesAS (Zhiqiang-He)
• [CALCITE-1668]Simplify 1 = 1 to TRUE, 1 > 2 to FALSE (Kevin Risden)
• [CALCITE-1598]Pig adapter (Eli Levine)
• [CALCITE-1661]Druid adapter: Support aggregation functions on DECIMAL columns
• [CALCITE-1615]Support HOP and SESSION functions in the GROUP BY clause(Julian Hyde and Haohui Mai)
• [CALCITE-1494]More efficient plan for correlated sub-queries, omitting value-generatingscans where possible
• [CALCITE-1638]Simplify $x = $x to $x is not null
• [CALCITE-884]File adapter (Henry Olson)
  • [CALCITE-1704]Execute queries on CSV files using simple sqlline command
  • [CALCITE-1676]Scan directory for .csv, .json and .gz files
  • Allow multiple Calcite columns to be derived from one HTML column,e.g. Location → Lat, Lon
  • Improved pattern match: added matchSeq to allow selection of_n_th match
  • Add replace patterns to cell parsing logic
  • Add handling for tables without <TH> elements
  • Unit tests using local files (URL tests are contingent on networkaccess)
  • Ability to parse HTML, CSV and JSON from local files
  • Combine the optiq-webproject with code from theCSV adapter
• [CALCITE-1652]Allow GROUPING function to have multiple arguments, like GROUPING_ID
• [CALCITE-1634]Make RelBuilder.distinct no-op if input is already distinct; use it inRelDecorrelator
• [CALCITE-1635]Add MinRowCount metadata
• [CALCITE-1628]Add an alternative match pattern for SemiJoinRule
• [CALCITE-1618]SortProjectTransposeRule should check for monotonicity preserving CAST
• [CALCITE-1510]In INSERT/UPSERT without an explicit target column list, allow fewer sourcecolumns than table (Kevin Liew)
  • Check for default value only when target field is null(Rajeshbabu Chintaguntla)
• [CALCITE-1603]Support TUMBLE window function in the GROUP BY clause (Julian Hyde andHaohui Mai)
• [CALCITE-1606]Add datetime scalar functions (Laurent Goujon)
• [CALCITE-1604]Add JDBC/ODBC scalar functions DATABASE, IFNULL, USER (Laurent Goujon)
• [CALCITE-1549]More helpful error message when schema, table or column not found
• [CALCITE-420]Add REPLACE function, callable with and without JDBC escape syntax (RiccardoTommasini)
• [CALCITE-1557]Add numeric scalar functions (Laurent Goujon)
• [CALCITE-1258]JDK9

Bug-fixes, API changes and minor enhancements

• [CALCITE-1716]Fix Cassandra integration tests
• [CALCITE-1715]Downgrade to Guava 19.0 to fix Cassandra incompatibility
• [CALCITE-1706]Disable DruidAggregateFilterTransposeRule, because it causes fine-grainedaggregations to be pushed to Druid
• [CALCITE-1695]Add class RexSimplify, providing an explicit RexExecutor for methods tosimplify RexNodes
• [CALCITE-1694]Pig adapter: Use the shaded Avatica dependency instead
• [CALCITE-1561]Make PigTest cluster aware of data files; hopefully this will preventintermittent test failures (Eli Levine)
• [CALCITE-1696]Support RexLocalRef for EXPLAIN PLAN AS JSON
• [CALCITE-1683]Druid-specific rules to transpose Filter with other relations(Nishant Bangarwa)
• [CALCITE-1684]Change default precision of VARCHAR and VARBINARY types from 1 to“unspecified” (Kevin Liew)
• [CALCITE-1691]ClassCastException in RelOptUtil.containsNullableFields, attempting toconvert executor to RexExecutorImpl
• [CALCITE-1688]Infinite loop during materialization substitution if query contains Union,Minus or Intersect
• [CALCITE-1665]HAVING support in RelToSqlConverter (Zhiqiang He)
• [CALCITE-1673]In CSV adapter, query with ORDER BY or GROUP BY on TIMESTAMP columnthrows CompileException (Gangadhar Kairi)
• [CALCITE-1674]LIKE does not match value that contains newline (Mark Payne)
• [CALCITE-1675]Two-level column name cannot be resolved in ORDER BY
• [CALCITE-1667]Forbid calls to JDK APIs that use the default locale, time zone or characterset
• [CALCITE-1656]Improve cost function in DruidQuery to encourage early column pruning(Nishant Bangarwa)
• [CALCITE-1664]CAST('<string>' as TIMESTAMP) wrongly adds part of sub-second fraction to thevalue
• [CALCITE-1659]Simplifying CAST('YYYY-MM-DD hh:mm:ss.SSS' as TIMESTAMP) should round thesub-second fraction (Remus Rusanu)
• [CALCITE-1439]Handle errors during constant reduction
• [CALCITE-1653]Pass an expression executor to RexUtil.simplify for constant reduction (RemusRusanu)
• [CALCITE-1601]DateRangeRules loses OR filters
• [CALCITE-1637]Add mutable equivalents for all relational expressions (e.g. MutableFilter)
• [CALCITE-1621]Add a cast around the NULL literal in aggregate rules (Anton Mushin)
  • Add RexBuilder.makeNullLiteral(RelDataType)
• [CALCITE-1649]Data type mismatch in EnumerableMergeJoin
• [CALCITE-1636]JDBC adapter generates wrong SQL for self join with sub-query (Zhiqiang-He)
• [CALCITE-1633]In plans, output Correlate.joinType attribute in lower-case, same asJoin.joinType
• [CALCITE-1632]Return type of “datetime + interval” expression
• [CALCITE-365]AssertionError while translating query with WITH and correlated sub-query
• [CALCITE-1623]Make sure DATE, TIME and TIMESTAMP literals have Calendar with GMTtimezone
• [CALCITE-1619]CAST is ignored by rules pushing operators into DruidQuery
• [CALCITE-1617]Druid adapter: Send timestamp literals to Druid as local time, not UTC
• [CALCITE-1500]Decouple materialization and lattice substitution from VolcanoPlanner
• [CALCITE-1589]Druid adapter: timeseries query shows all days, even if no data
• [CALCITE-1572]JdbcSchema throws exception when detecting nullable columns (Wu Xiang)
• [CALCITE-1610]RelBuilder sort-combining optimization treats aliases incorrectly (JessBalint)
• [CALCITE-1595]RelBuilder.call throws NullPointerException if argument types are invalid(Jess Balint)
• [CALCITE-1602]Remove uses of deprecated APIs
• [CALCITE-1569]Code generation for fields of type java.sql.Date (Zhen Wang)
• [CALCITE-1582]RelToSqlConverter doesn’t handle cartesian join (Jess Balint)
• [CALCITE-1597]Obsolete Util.newInternal, .pre, .post, .permAssert andThrowables.propagate
• [CALCITE-1586]JDBC adapter generates wrong SQL if UNION has more than two inputs (ZhiqiangHe)
• [CALCITE-1535]Give error if column referenced in ORDER BY is ambiguous (Zhen Wang)
• [CALCITE-1594]ConventionTraitDef.getConversionData() is not thread-safe
• [CALCITE-1577]Druid adapter: Incorrect result - limit on timestamp disappears
• [CALCITE-1587]Druid adapter: topN query returns approximate results
• [CALCITE-1578]Druid adapter: wrong semantics of topN query limit with granularity
• Druid adapter: Add enum Granularity
• [CALCITE-1592]SqlToRelConverter throws UnsupportedOperationException if query hasNOT … NOT IN
• [CALCITE-1590]Support Guava version 21.0
• [CALCITE-1575]Literals may lose precision during expression reduction
• [CALCITE-1546]Wrong plan for NOT IN sub-queries with disjunction
• [CALCITE-1574]Memory leak in maven
• [CALCITE-1571]Could not resolve view with SimpleCalciteSchema
• [CALCITE-1558]AggregateExpandDistinctAggregatesRule gets field mapping wrong if group keyis used in aggregate function (Zhenghua Gao)
• [CALCITE-1562]Update jsr305 from 1.3.9 to 3.0.1
• [CALCITE-1563]In case-insensitive connection, non-existent tables use alphabeticallypreceding table
• [CALCITE-1544]AggregateJoinTransposeRule fails to preserve row type (Kurt Young)
• [CALCITE-1543]Correlated scalar sub-query with multiple aggregates gives AssertionError(Kurt Young)

Web site and documentation

• Maryann Xue joins PMC
• Add 3 new committers (Gian Merlino, Jess Balint, Laurent Goujon)
• [CALCITE-1657]Release Calcite 1.12.0
• [CALCITE-1677]Replace duplicate avatica docs with a redirect
• [CALCITE-1685]Site: defaultNullCollation key listed as materializationsEnabled(Kevin Liew)
• Add MapD to Powered byCalcite page (Todd Mostak)
• Diagram of logos of projects and products powered by Calcite
• [CALCITE-1622]Bugs in website example code (Damjan Jovanovic)

1.11.0 / 2017-01-09

Nearly three months after the previous release, there is a long listof improvements and bug-fixes, many of them making planner rulessmarter.

Several adapters have improvements:

• The JDBC adapter can now push down DML (INSERT, UPDATE, DELETE),windowed aggregates (OVER), IS NULL and IS NOT NULL operators.
• The Cassandra adapter now supports authentication.
• Several key bug-fixes in the Druid adapter.

For correlated and uncorrelated sub-queries, we generate moreefficient plans (for example, in some correlated queries we no longerrequire a sub-query to generate the values of the correlatingvariable), can now handle multiple correlations, and have also fixed afew correctness bugs.

New SQL syntax:

• CROSS APPLY and OUTER APPLY;
• MINUS as a synonym for EXCEPT;
• an AS JSON option for the EXPLAIN command;
• compound identifiers in the target list of INSERT, allowing you toinsert into individual fields of record-valued columns (or columnfamilies if you are using the Apache Phoenix adapter).

A variety of new and extended built-in functions: CONVERT, LTRIM,RTRIM, 3-parameter LOCATE and POSITION, RAND, RAND_INTEGER,and SUBSTRING applied to binary types.

There are minor but potentially breaking API changes inCALCITE-1519 andCALCITE-1530.See the cases for more details.

Compatibility: This release is testedon Linux, macOS, Microsoft Windows;using Oracle JDK 1.7, 1.8;Guava versions 14.0 to 19.0;Druid version 0.9.1.1;other software versions as specified in pom.xml.

New features

• [CALCITE-1551]Preserve alias in RelBuilder.project (Jess Balint)
• [CALCITE-1552]Add RAND function, returning DOUBLE values in the range 0..1
• [CALCITE-1414]Add RAND_INTEGER function, which returns a random integer modulo N (JulianFeinauer)
• [CALCITE-1540]Support multiple columns in PARTITION BY clause of window function(Hongbin Ma)
• [CALCITE-1534]Allow compound identifiers in INSERT target column list
• [CALCITE-1529]Support CREATE TABLE in tests (and only in tests)
• [CALCITE-1527]Support DML in the JDBC adapter (Christian Tzolov)
• [CALCITE-1523]In RelBuilder, add field method to reference input to join by alias (JessBalint)
• [CALCITE-1524]Add a project to the planner root so that rules know which output fields areused
• [CALCITE-1425]Support two-level column structure in INSERT/UPDATE/MERGE
• [CALCITE-1472]Support CROSS/OUTER APPLY syntax (Jark Wu)
• [CALCITE-1506]Push OVER clause to underlying SQL via JDBC adapter (Christian Tzolov)
• [CALCITE-1509]Allow overriding the convertlet table in CalcitePrepareImpl (Gian Merlino)
• [CALCITE-1483]Generate simpler logic for NOT IN if we can deduce that the key is never null
• [CALCITE-1497]Infer IS NOT NULL, and project predicates
• [CALCITE-1489]Add rule, AggregateValuesRule, that applies to an Aggregate on an emptyrelation (Gian Merlino)
• [CALCITE-1447]Implement INTERSECT DISTINCT by rewriting to UNION ALL and counting(Pengcheng Xiong)
• [CALCITE-1389]Add a rewrite rule to use materialized views with joins
• [CALCITE-1125]MINUS as a synonym for EXCEPT (enabled in Oracle10 conformance)(Chandni Singh)
• [CALCITE-1453]Support ANY type with binary comparison and arithmetic operators(Jungtaek Lim)
• [CALCITE-1444]Add CONVERT function (Laurent Goujon)
• [CALCITE-1448]Add rules to flatten and prune Intersect and Minus;flatten set-operators if the top is DISTINCT and bottom is ALL
• [CALCITE-1426]Support customized star expansion in Table
• [CALCITE-1454]Allow custom implementations of SqlConformance
• [CALCITE-1417]In RelBuilder, simplify “CAST(literal TO type)” to a literal when possible
• [CALCITE-1443]Add authentication support in Cassandra adapter
• [CALCITE-1404]Implement FILTER on aggregate functions in Interpreter
• [CALCITE-1418]Implement SUBSTRING function for BINARY and VARBINARY (Jungtaek Lim)
• [CALCITE-1422]In JDBC adapter, allow IS NULL and IS NOT NULL operators in generated SQLjoin condition (Viktor Batytskyi)
• [CALCITE-1419]Implement JDBC functions: LTRIM, RTRIM and 3-parameter LOCATE andPOSITION (Jungtaek Lim)
• [CALCITE-917]Add AS JSON as output option for EXPLAIN

Bug-fixes, API changes and minor enhancements

• [CALCITE-1559]Convert example models to stricter JSON
• [CALCITE-1560]Remove avatica directory from sqlline’s class path
• Remove non-ASCII characters from Java source files
• [CALCITE-1511]Decorrelation fails if query has more than one EXISTS in WHERE clause
• [CALCITE-1555]Improve RelNode validation
• [CALCITE-1548]Instantiate function objects once per query
• Add lock to JdbcAdapterTest, to ensure that tests that modify data run inseries
• [CALCITE-1519]Standardize on “sub-query” rather than “subquery” in class names and comments
• [CALCITE-1493]Wrong plan for NOT IN correlated queries
• [CALCITE-1526]Use Strong to infer whether a predicate’s inputs may be null
• [CALCITE-1530]Create a visitor to traverse linq4j expressions without mutating them, andrename Visitor to Shuttle
• [CALCITE-1507]OFFSET cannot be pushed through a JOIN if the non-preserved side of outerjoin is not count-preserving
• [CALCITE-1522]Fix error message for SetOp with incompatible args (Jess Balint)
• [CALCITE-1532]In HttpUtils, don’t log HTTP requests; they may contain user name, password
• [CALCITE-1037]Column uniqueness is calculated incorrectly for Correlate (Alexey Makhmutov)
• [CALCITE-1495]SemiJoinRule should not apply to RIGHT and FULL JOIN, and should stripLEFT JOIN
• [CALCITE-1516]Upgrade hydromatic-resource-maven-plugin, and re-work SaffronProperties
• [CALCITE-1498]Avoid LIMIT with trivial ORDER BY being pushed through JOIN endlessly
• [CALCITE-1501]EnumerableUnion should use array comparator when row format is ARRAY (DayueGao)
• [CALCITE-1502]AssertionError in ReduceExpressionsRule when CASE is used with optionalvalue and literal (Serhii Harnyk)
• Cosmetic changes, and deprecate some methods
• [CALCITE-1486]Invalid “Invalid literal” error for complex expression
• [CALCITE-1488]ValuesReduceRule should ignore empty Values
• [CALCITE-1384]Extension point for ALTER statements (Gabriel Reid)
• [CALCITE-1484]Upgrade Apache parent POM to version 18
• [CALCITE-1482]Fix leak on CassandraSchema creation
• [CALCITE-1479]AssertionError in ReduceExpressionsRule on multi-column IN sub-query(Gian Merlino)
• Upgrade Quidem
• [CALCITE-1416]Make classes implement AutoCloseable where possible (Chinmay Kolhatkar)
• [CALCITE-1474]Upgrade aggdesigner
• [CALCITE-1270]Upgrade to avatica-1.9, sqlline-1.2.0
• [CALCITE-1461]Hard-coded class name in JaninoRelMetadataProvider breaks shading (Jark Wu)
• [CALCITE-1465]Store constants as a derived field in RelOptPredicateList
• [CALCITE-1429]Druid adapter must send fromNext when requesting rows from Druid (JiarongWei)
• [CALCITE-1430]In Druid adapter, pagingIdentifiers might have more than one value (JiarongWei)
• [CALCITE-1442]Interval fractional second precision returns wrong value (Laurent Goujon)
• [CALCITE-1434]User-defined aggregate function that uses a generic interface (Arun Mahadevan)
• [CALCITE-1431]RelDataTypeFactoryImpl.copyType() did not copy StructKind
• [CALCITE-1424]Druid type is called FLOAT, not DOUBLE (Jiarong Wei)
• [CALCITE-1415]Add sub-query support for RelStructuredTypeFlattener

Web site and documentation

• Change PMC chair
• [CALCITE-1459]Add Apache Apex to “Powered By” page (Chinmay Kolhatkar)

1.10.0 / 2016-10-12

This release comes shortly after 1.9.0. It includes mainly bug-fixes for the core andDruid adapter. For the latest, we fixed animportant issue thatprevented us from handling consistently time dimensions in different time zones.

Compatibility: This release is testedon Linux, Mac OS X, Microsoft Windows;using Oracle JDK 1.7, 1.8;Guava versions 14.0 to 19.0;Druid version 0.9.1.1;other software versions as specified in pom.xml.

New feature

• [CALCITE-1374]Support operator != as an alternative to <>

Bug-fixes, API changes and minor enhancements

• [CALCITE-1378]ArrayIndexOutOfBoundsException in sql-to-rel conversion for two-level columns
• [CALCITE-1379]When expanding STAR, expand sub-fields in RecordType columns of StructKind.PEEK_FIELDS and StructKind.PEEK_FIELDS_DEFAULT
• [CALCITE-1381]Function quantifier should be retained in a cloned Sql call (zhengdong)
• [CALCITE-1386]ITEM operator ignores the value type of the collection, assigns to Object variable (Jungtaek Lim)
• [CALCITE-1392]Druid default time column not properly recognized
• [CALCITE-1394]Using CoreMatchers.containsString causes javadoc errors
• [CALCITE-1396]isDeterministic only explores top RexCall
• [CALCITE-1397]ClassCastException in FilterReduceExpressionsRule
• [CALCITE-1398]Change visibility of RelFieldTrimmer utility methods
• [CALCITE-1400]AggregatePullUpConstantsRule might adjust aggregation function parameters indices wrongly
• [CALCITE-1402]Druid Filter translation incorrect if input reference is in RHS of comparison
• [CALCITE-1403]DruidAdapterIT broken
• [CALCITE-1420]Allow Calcite JDBC Driver minor version to be greater than 9

Web site and documentation

• [CALCITE-1393]Exclude packages org.apache.calcite.benchmarks.generated, org.openjdk.jmh from javadoc

1.9.0 / 2016-09-22

This release includes extensions and fixes for the Druid adapter. New features wereadded, such as the capability torecognize and translate Timeseries and TopN Druid queries.Moreover, this release contains multiple bug-fixes over the initial implementation of theadapter. It is worth mentioning that most of these fixes were contributed by Druid developers,which demonstrates the good reception of the adapter by that community.

We have added new SQL features too, e.g.,support for LATERAL TABLE.There are multiple interesting extensions to the planner rules that should contribute toobtain better plans, such asavoiding doing the same join twicein the presence of COUNT DISTINCT, or being able tosimplify the expressionsin the plan further. In addition, we implemented a rule toconvert predicates on EXTRACT function calls into date ranges.The rule is not specific to Druid; however, in principle, it will be useful to identifyfilter conditions on the time dimension of Druid data sources.

Finally, the release includes more than thirty bug-fixes, minor enhancements and internalchanges to planner rules and APIs.

Compatibility: This release is testedon Linux, Mac OS X, Microsoft Windows;using Oracle JDK 1.7, 1.8;Guava versions 14.0 to 19.0;other software versions as specified in pom.xml.

New features

• [CALCITE-1208]Improve two-level column structure handling
• [CALCITE-1227]Add streaming CSV table (Zhen Wang)
• [CALCITE-1309]Support LATERAL TABLE (Jark Wu)

Druid adapter

• [CALCITE-1292]Druid metadata query is very slow (Michael Spector)
• [CALCITE-1324]Druid metadata query throws exception if there are non-standard aggregators (Martin Karlsch)
• [CALCITE-1343]Broken Druid query
• [CALCITE-1348]In Druid adapter, adjust how SegmentMetadataQuery is used to detect types (Gian Merlino)
• [CALCITE-1357]Recognize Druid Timeseries and TopN queries in DruidQuery
• [CALCITE-1358]Push filters on time dimension to Druid

Planner rules

• [CALCITE-1220]Further extend simplify for reducing expressions
• [CALCITE-1288]Avoid doing the same join twice if count(distinct) exists (Gautam Parai)
• [CALCITE-1289]RexUtil.simplifyCase() should account for nullability
• [CALCITE-1290]When converting to CNF, fail if the expression size exceeds a threshold
• [CALCITE-1334]Convert predicates on EXTRACT function calls into date ranges
• [CALCITE-1342]ProjectPusher should use rel factories when creating new rels, e.g. project/filter
• [CALCITE-1365]Introduce UnionPullUpConstantsRule

Bug-fixes, API changes and minor enhancements

• [CALCITE-30]Implement Statement.cancel method
• [CALCITE-308]Wrong result when using DATE+INTERVAL arithmetics
• [CALCITE-319]Table aliases should follow case-sensitivity policy
• [CALCITE-528]Creating output row type of a Join does not obey case-sensitivity flags
• [CALCITE-991]Create separate SqlFunctionCategory values for table functions and macros (Julien Le Dem)
• [CALCITE-1043]RexOptUtil does not support function table other than SqlStdOperatorTable
• [CALCITE-1095]NOT precedence
• [CALCITE-1148]Trait conversion broken for RelTraits other than Convention
• [CALCITE-1278]CalciteSignature’s ColumnMetaData for DELETE should be same as INSERT
• [CALCITE-1283]Nullability incorrectly assigned in SqlTypeFactory.leastRestrictiveSqlType()
• [CALCITE-1284]Move Quidem tests from JdbcTest into their own class
• [CALCITE-1297]RelBuilder should rename fields without creating an identity Project (Jark Wu)
• [CALCITE-1302]Create SqlTypeName values for each interval range, e.g. YEAR_MONTH
• [CALCITE-1305]Case-insensitive table aliases and GROUP BY
• [CALCITE-1310]Infer type of arguments to BETWEEN operator (Yiming Liu)
• [CALCITE-1312]Return type of TIMESTAMP_ADD applied to a DATE should be TIMESTAMP if unit is smaller than DAY
• [CALCITE-1313]Validator should derive type of expression in ORDER BY
• [CALCITE-1314]Intermittent failure in SqlParserTest.testGenerateKeyWords
• [CALCITE-1321]In-list to join optimization should have configurable in-list size (Gautam Parai)
• [CALCITE-1327]Nested aggregate windowed query fails (Gautam Parai)
• [CALCITE-1330]DB2 does not support character sets in data type
• [CALCITE-1332]JDBC adapter for DB2 should always use aliases for tables: x.y.z AS z
• [CALCITE-1333]AggFunctions supported by JdbcAggregate should depend on SqlKind, instead of operator instance
• [CALCITE-1336]Add view name to the ViewExpander (Julien Le Dem)
• [CALCITE-1337]Lazy evaluate RexCall digests (Ted Xu)
• [CALCITE-1340]Window aggregates invalid error/error messages in some cases (Gautam Parai)
• [CALCITE-1344]Incorrect inferred precision when BigDecimal value is less than 1
• [CALCITE-1346]Invalid nested window aggregate query with alias (Gautam Parai)
• [CALCITE-1360]Custom schema in file in current directory gives NullPointerException
• [CALCITE-1366]Metadata provider should not pull predicates up through GROUP BY
• [CALCITE-1370]In SqlKind, add OTHER_DDL to DDL enum set (Rajeshbabu Chintaguntla)
• [CALCITE-1372]Calcite generate wrong field names in JDBC adapter

Web site and documentation

• [CALCITE-1229]Restore API and Test API links to site
• [CALCITE-1325]Druid adapter requires Guava 14.0 or higher
• [CALCITE-1329]As part of release, generate a file containing multiple digests

1.8.0 / 2016-06-13

This release adds adapters forElasticsearch andDruid.It is also now easier tomake a JDBC connection based upon a single adapter.

There are several new SQL features: UNNEST withmultiple arguments,MAP argumentsand with a JOIN;a DESCRIBE statement;and a TRANSLATEfunction like the one in Oracle and PostgreSQL.We also added support forSELECT without FROM(equivalent to the VALUES clause, and widely used in MySQL and PostgreSQL),and added aconformanceparameter to allow you to selectively enable this and other SQL features.

And a couple of dozen bug-fixes and enhancements to planner rules and APIs.

Compatibility: This release is testedon Linux, Mac OS X, Microsoft Windows;using Oracle JDK 1.7, 1.8;Guava versions 14.0 to 19.0;other software versions as specified in pom.xml.

New features

• [CALCITE-1177]Extend list of supported time units in EXTRACT, CEIL and FLOOR functions(Venki Korukanti)
• [CALCITE-1259]Allow connecting to a single schema without writing a model
• [CALCITE-750]Support aggregates within windowed aggregates (Gautam Parai)
• [CALCITE-1250]UNNEST applied to MAP data type (Johannes Schulte)
• [CALCITE-1253]Elasticsearch adapter (Subhobrata Dey)
• [CALCITE-1228]Bind parameters in INSERT
• [CALCITE-1120]SELECT without FROM (Jimmy Xiang)
• [CALCITE-855]UNNEST with multiple arguments
• [CALCITE-1225]UNNEST with JOIN
• [CALCITE-1115]Add TRANSLATE function with 3 parameters, like the one in Oracle (JavanshirYelchiyev)
• [CALCITE-1168]Add DESCRIBE statement (Arina Ielchiieva)
• [CALCITE-1121]Druid adapter
  • [CALCITE-1276]In Druid adapter, deduce tables and columns if not specified
• [CALCITE-1207]Allow numeric connection properties, and ‘K’, ‘M’, ‘G’ suffixes

Planner rules

• [CALCITE-1235]Fully push down LIMIT + OFFSET in Cassandra
• [CALCITE-1216]Rule to convert Filter-on-Scan to materialized view (Amogh Margoor)
• [CALCITE-1200]Extend RelOptUtil.splitJoinCondition to handle IS NOT DISTINCT FROM(Venki Korukanti)
• [CALCITE-1211]Allow free use of CassandraSort for LIMIT
• [CALCITE-1210]Allow UUID filtering in Cassandra
• [CALCITE-1182]Add ProjectRemoveRule to pre-processing program of materializationsubstitution

Bug-fixes, API changes and minor enhancements

• [CALCITE-1281]Druid adapter wrongly returns all numeric values as int or float
• [CALCITE-1279]Druid “select” query gives ClassCastException
• [CALCITE-1277]Rat fails on source distribution due to git.properties
• Update KEYS
• [CALCITE-1252]Handle ANY type in RexBuilder.ensureType and TypeFactory.leastRestrictive(Mehand Baid, Minji Kim)
• [CALCITE-1151]Fix SqlSetOption to correctly handle SqlOperator.createCall(Sudheesh Katkam, Minji Kim)
• [CALCITE-1106]Expose constructor for ProjectJoinTransposeRule (Minji Kim)
• [CALCITE-1107]Make SqlSumEmptyIsZeroAggFunction constructor public (Minji Kim)
• [CALCITE-1269]Replace IntList with Guava Ints class
• [CALCITE-1239]Upgrade to avatica-1.8.0
• [CALCITE-1266]RelBuilder.field gets offsets wrong
• [CALCITE-1264]Litmus argument interpolation (Chris Baynes)
• [CALCITE-1245]Allow RelBuilder.scan to take qualified table name (Chris Baynes)
• Move code from Enumerables to EnumerableDefaults
• [CALCITE-1246]Cleanup duplicate variables in JoinPushThroughJoinRule (Yi Xinglu)
• [CALCITE-1241]Add a Freemarker variable for adding non reserved keyword list to Parser.jjtemplate (Venki Korukanti)
  • Create a table in SqlParserTest of reserved keywords from various versionsof the SQL standard
• [CALCITE-1150]Add dynamic record type and dynamic star for schema-on-read table
• [CALCITE-1238]Unparsing a query with LIMIT but no ORDER BY gives invalid SQL (EmmanuelBastien)
• [CALCITE-1230]Add SQLSTATE reference data as enum SqlState in Avatica, anddeprecate SqlStateCodes in Calcite
• [CALCITE-1199]Incorrect trimming of CHAR when performing cast to VARCHAR
• [CALCITE-1219]Add method SqlOperatorBinding.isOperandLiteral() (Hsuan-Yi Chu)
• [CALCITE-1222]DatabaseMetaData.getColumnLabel returns null when query has ORDER BY
• [CALCITE-1215]Fix missing override in CassandraTable
• [CALCITE-1212]Fix NPE on some Cassandra projects
• Remove trailing spaces from all source files
• Move HTTP utilities from Splunk adapter to core
• Test case for[PHOENIX-2767],non-constant in IN
• [CALCITE-1166]Disallow sub-classes of RelOptRuleOperand
• Remove all calls to deprecated methods
• Add class ConsList
• More of [CALCITE-999]Clean up maven POM files
• [CALCITE-1204]Fix invalid Javadoc and suppress checkstyle “errors”
• [CALCITE-1170]Allow SqlSetOperator to be overridden, as a regular SqlOperator can(Hsuan-Yi Chu)
• [CALCITE-746]Allow apache-rat to be run outside of release process

Web site and documentation

• [CALCITE-1273]Following[CALCITE-306],update references to EnumerableTableAccessRel to EnumerableTableScan
• Fix typo in SQL (Yi Xinglu)
• Site: add committer, and post slides/video from Polyalgebra talk
• [CALCITE-1203]Update to github-pages-67
• [CALCITE-1202]Lock version of Jekyll for bundler
• Site: add upcoming talks, and fix link to Apache phonebook

1.7.0 / 2016-03-22

This is the first Apache Calcite release sinceAvatica became an independent project.Calcite now depends on Avatica in thesame way as it does other libraries, via a Maven dependency. To seeAvatica-related changes, see therelease notes for Avatica 1.7.1.

We have addedan adapter forApache Cassandra.You can map a Cassandra keyspace into Calcite as a schema, CassandraCQL tables as tables, and execute SQL queries on them, which Calciteconverts into CQL.Cassandra can define and maintain materialized views but the adaptergoes further: it can transparently rewrite a query to use amaterialized view even if the view is not mentioned in the query.

This release adds anOracle-compatibility mode.If you add fun=oracle to your JDBC connect string, you get all ofthe standard operators and functions plus Oracle-specific functionsDECODE, NVL, LTRIM, RTRIM, GREATEST and LEAST. We lookforward to adding more functions, and compatibility modes for otherdatabases, in future releases.

We’ve replaced our use of JUL (java.util.logging)with SLF4J. SLF4J provides an API which Calcite can useindependent of the logging implementation. This ultimately provides additionalflexibility to users, allowing them to configure Calcite’s logging within theirown chosen logging framework. This work was done in[CALCITE-669].

For users experienced with configuring JUL in Calcite previously, there are somedifferences as some the JUL logging levels do not exist in SLF4J: FINE,FINER, and FINEST, specifically. To deal with this, FINE was mappedto SLF4J’s DEBUG level, while FINER and FINEST were mapped to SLF4J’s TRACE.

Compatibility: This release is testedon Linux, Mac OS X, Microsoft Windows;using Oracle JDK 1.7, 1.8;Guava versions 12.0.1 to 19.0;other software versions as specified in pom.xml.

New features

• [CALCITE-1124]Add TIMESTAMPADD, TIMESTAMPDIFF functions (Arina Ielchiieva)
• [CALCITE-1066]Add Oracle function table, and functions DECODE, NVL, LTRIM, RTRIM,GREATEST, LEAST
• [CALCITE-1080]Cassandra adapter (Michael Mior)
• [CALCITE-1062]In validation, lookup a (possibly overloaded) operator from an operatortable (Hsuan-Yi Chu)
• [CALCITE-551]Sub-query inside aggregate function

Planner rules

• [CALCITE-1158]Make AggregateRemoveRule extensible
• [CALCITE-1116]Extend simplify for reducing expressions
• [CALCITE-1104]Materialized views in Cassandra (Michael Mior)
• [CALCITE-1130]Add support for operators IS NULL and IS NOT NULL inRexImplicationChecker (Amogh Margoor)
• [CALCITE-1129]Extend JoinUnionTransposeRule to match Union instead of LogicalUnion(Vasia Kalavri)
• [CALCITE-1109]Fix up condition when pushing Filter through Aggregate (Amogh Margoor)
• [CALCITE-1100]If constant reduction no-ops, don’t create a new RelNode (Hsuan-Yi Chu)
• [CALCITE-1076]Update RelMdDistribution to match other metadata APIs (Ted Xu)
• [CALCITE-1056]In RelBuilder, simplify predicates, and optimize away WHERE FALSE
• [CALCITE-1059]Not valid to convert Aggregate on empty to empty if its GROUP BY key is empty

Bug-fixes, API changes and minor enhancements

• [CALCITE-1147]Allow multiple providers for the same kind of metadata
• [CALCITE-1153]Invalid cast created during SQL Join in Oracle (Chris Atkinson)
• [CALCITE-1146]Wrong path in CSV example model (wanglan)
• [CALCITE-1156]Increase Jetty version to 9.2.15.v20160210
• [CALCITE-1064]Address problematic maven-remote-resources-plugin
• In TimeUnit add WEEK, QUARTER, MICROSECOND values, and change type ofmultiplier
• Deprecate SqlLiteral.SqlSymbol; SqlSymbol can now wrap any enum
• [CALCITE-1078]Detach avatica from the core calcite Maven project
  • [CALCITE-1077]Switch Calcite to the released Avatica 1.7.1
  • Update groupId when Calcite POMs reference Avatica modules
  • [CALCITE-1137]Exclude Avatica from Calcite source release
• [CALCITE-1111]Upgrade Guava, and test on a range of Guava versions
• [CALCITE-1054]Wrong code generation for TIMESTAMP values that may be NULL
• [CALCITE-604]Tune metadata by generating a dispatcher at runtime
• [CALCITE-1063]Flat lists for 4, 5, 6 elements
• Add Orinoco schema (streaming retail data), accessible from Quidem scripts
• [CALCITE-1097]Exception when executing query with too many aggregation columns (chenzhifa)
• Add tests for leap days
• [CALCITE-553]In maven, enable compiler profiles by default
• [CALCITE-1031]In prepared statement, CsvScannableTable.scan is called twice
• [CALCITE-1046]Matchers for testing SQL query results
• [CALCITE-1083]SqlNode.equalsDeep has O(n ^ 2) performance
• [CALCITE-998]Exception when calling STDDEV_SAMP, STDDEV_POP (Matthew Shaer)
• [CALCITE-1071]Improve hash functions
• [CALCITE-1072]CSV adapter incorrectly parses TIMESTAMP values after noon (Chris Albright)
• [CALCITE-669]Mass removal of Java Logging for SLF4J
• [CALCITE-1068]Deprecate Stacks
• [CALCITE-1067]Test failures due to clashing temporary table names
• [CALCITE-864]Correlation variable has incorrect row type if it is populated by right sideof a Join
• [CALCITE-1021]Upgrade Jackson
• [CALCITE-999]Clean up maven POM files

Web site and documentation

• [CALCITE-1112]“Powered by Calcite” page
• Add SQL-Gremlin to Adapters page
• [CALCITE-1090]Revise Streaming SQL specification
• Appoint Josh Elser to PMC
• Add “Streaming SQL” talk
• [CALCITE-623]Add a small blurb to the site about Jenkins for CI
• [CALCITE-1070]Upgrade to new Apache logo
• Document how to announce a release
• [CALCITE-1074]Delete old releases from mirroring system

1.6.0 / 2016-01-22

As usual in this release, there are new SQL features, improvements toplanning rules and Avatica, and lots of bug-fixes. We’ll spotlight acouple of features make it easier to handle complex queries.

[CALCITE-816]allows you to represent sub-queries (EXISTS, IN and scalar) asRexSubQuery, a kind of expression in the relational algebra. Untilnow, the sql-to-rel converter was burdened with expanding sub-queries,and people creating relational algebra directly (or via RelBuilder)could only create ‘flat’ relational expressions. Now we have plannerrules to expand and de-correlate sub-queries.

Metadata is the fuel that powers query planning. It includestraditional query-planning statistics such as cost and row-countestimates, but also information such as which columns form uniquekeys, unique and what predicates are known to apply to a relationalexpression’s output rows. From the predicates we can deduce whichcolumns are constant, and following[CALCITE-1023]we can now remove constant columns from GROUP BY keys.

Metadata is often computed recursively, and it is hard to safely andefficiently calculate metadata on a graph of RelNodes that is large,frequently cyclic, and constantly changing.[CALCITE-794]introduces a context to each metadata call. That context can detectcyclic metadata calls and produce a safe answer to the metadatarequest. It will also allow us to add finer-grained caching andfurther tune the metadata layer.

Compatibility: This release is testedon Linux, Mac OS X, Microsoft Windows;using Oracle JDK 1.7, 1.8;other software versions as specified in pom.xml.

New features

• [CALCITE-816]Represent sub-query as a RexNode
• [CALCITE-854]Implement UNNEST … WITH ORDINALITY
• [CALCITE-1003]Utility to convert RelNode to SQL (Amogh Margoor)
  • [CALCITE-1010]FETCH/LIMIT and OFFSET in RelToSqlConverter (Amogh Margoor)
  • Move code from JdbcImplementor and JdbcRules to new classSqlImplementor
  • Deduce dialect’s null collation from DatabaseMetaData
  • Fix RelToSqlConverterTest on Windows
• Following[CALCITE-897],empty string for boolean properties means true
• [CALCITE-992]Validate and resolve sequence reference as a Table object
• [CALCITE-968]Stream-to-relation and stream-to-stream joins (Milinda Pathirage)
• [CALCITE-1041]User-defined function that returns DATE or TIMESTAMP value
• [CALCITE-986]User-defined function with DATE or TIMESTAMP parameters
• [CALCITE-958]Overloaded Table Functions with named arguments (Julien Le Dem)
• [CALCITE-970]If NULLS FIRST/NULLS LAST not specified, sort NULL values high

Avatica features and bug-fixes

• [CALCITE-1040]Differentiate better between arrays and scalars in protobuf
• [CALCITE-934]Use an OS-assigned ephemeral port for CalciteRemoteDriverTest
• [CALCITE-767]Create Avatica RPC endpoints for commit and rollback commands
• [CALCITE-983]Handle nulls in ErrorResponse’s protobuf representation better
• [CALCITE-989]Add server’s address in each response
• Fix some bugs found by static analysis
• Make all equals and hashCode methods uniform
• [CALCITE-962]Propagate the cause, not just the cause’s message, from JdbcMeta

Planner rules

• [CALCITE-1057]Add RelMetadataProvider parameter to standard planner Programs
• [CALCITE-1055]SubQueryRemoveRule should create Correlate, not Join, for correlatedsub-queries
• [CALCITE-978]Enable customizing constant folding rule behavior when a Filter simplifiesto false (Jason Altekruse)
• [CALCITE-977]Make the constant expression Executor configurable in FrameworkConfig(Jason Altekruse)
• [CALCITE-1058]Add method RelBuilder.empty, and rewrite LIMIT 0 and WHERE FALSE to it
• [CALCITE-996]Simplify predicate when we create a Filter operator
• Simplify RexProgram, in particular (NOT CASE … END) IS TRUE, whichoccurs in when NOT IN is expanded
• Fix variant of[CALCITE-923]that occurs in RelOptRulesTest.testPushFilterPastProject
• [CALCITE-1023]and[CALCITE-1038]Planner rule that removes Aggregate keys that are constant
• [CALCITE-1018]SortJoinTransposeRule not firing due to getMaxRowCount(RelSubset) returningnull
• [CALCITE-1019]RelMdUtil.checkInputForCollationAndLimit() was wrong with alreadySortedcheck
• Not safe to use ‘=’ for predicates on constant expressions that might be null
• [CALCITE-993]Pull up all constant expressions, not just literals, as predicates
• [CALCITE-1005]Handle null in getMaxRowCount for Aggregate (Mike Hinchey)
• [CALCITE-995]Sort transpose rules might fall in an infinite loop
• [CALCITE-987]Pushing LIMIT 0 results in an infinite loop (Pengcheng Xiong)
• [CALCITE-988]FilterToProjectUnifyRule.invert(MutableRel, MutableRel, MutableProject)works incorrectly
• [CALCITE-969]Composite EnumerableSort with DESC wrongly sorts NULL values low
• [CALCITE-959]Add description to SortProjectTransposeRule’s constructor

Bug-fixes, API changes and minor enhancements

• [CALCITE-1060]Fix test deadlock by initializing DriverManager before registering AlternatingDriver
• [CALCITE-1047]ChunkList.clear throws AssertionError
• [CALCITE-1053]CPU spin, ReflectiveRelMetadataProvider.apply waiting for HashMap.get
• Upgrade toolbox, to fix line length issue on Windows
• [CALCITE-1051]Underflow exception due to scaling IN clause literals (Frankie Bollaert)
• [CALCITE-975]Allow Planner to return validated row type together with SqlNode
• [CALCITE-1020]Add MILLISECOND in TimeUnit (Pengcheng Xiong)
• [CALCITE-794]Detect cycles when computing statistics(This is a breaking change.)
• Tune algorithm that deduces the return type of AND expression
• [CALCITE-842]Decorrelator gets field offsets confused if fields have been trimmed
• Fix NullPointerException in SqlJoin.toString()
• Add ImmutableBitSet.rebuild()
• [CALCITE-915]Tests now unset ThreadLocal values on exit
• [CALCITE-1036]DiffRepository should not insert new resources at the end of the repository
• [CALCITE-955]Litmus (continuation-passing style for methods that check invariants)
• RelBuilder.project now does nothing if asked to project the identity withthe same field names
• Deprecate some Util methods, and upgrade last Maven modules to JDK 1.7
• Document RelOptPredicateList
• Add ImmutableNullableList.copyOf(Iterable)
• Fix “endPosTable already set” error from javac
• Add benchmark of Parser.create(sql).parseQuery()
• [CALCITE-1042]Ensure that FILTER is BOOLEAN NOT NULL
• [CALCITE-1039]Assign a SqlKind value for each built-in aggregate function
• [CALCITE-1030]JSON ModelHandler calling SchemaPlus.setCacheEnabled() causesUnsupportedOperationException when using SimpleCalciteSchema
• [CALCITE-1028]Move populate materializations after sql-to-rel conversion
• [CALCITE-1034]Use a custom checker for code style rules that Checkstyle cannot express
• [CALCITE-1032]Verify javadoc of private methods
• [CALCITE-1015]OFFSET 0 causes AssertionError (Zhen Wang)
• [CALCITE-1024]In a planner test, if a rule should have no effect, state that explicitly
• [CALCITE-1016]GROUP BY constant on empty relation should return 0 rows
• [CALCITE-1022]Rename .oq Quidem files to .iq
• [CALCITE-980]Fix AND and OR implementation in Enumerable convention
• [CALCITE-459]When parsing SQL, allow single line comment on last line (Zhen Wang)
• [CALCITE-1009]SelfPopulatingList is not thread-safe
• [CALCITE-1008]Replace Closeable with AutoCloseable
• [CALCITE-1001]Upgrade to quidem-0.7
• [CALCITE-990]In VolcanoPlanner, populate RelOptRuleCall.nodeInputs for operands of type“any”
• [CALCITE-966]VolcanoPlanner now clears ruleNames in order to avoid rule nameconflicting error
• Factor user-defined function tests from JdbcTest to UdfTest, and classesinto Smalls
• [CALCITE-974]Exception while validating DELETE (Yuri Au Yong)
• [CALCITE-964]Rename timezone connection property to timeZone

Web site and documentation

• Avatica
  • [CALCITE-1033]Introduce Avatica protobuf documentation
  • [CALCITE-1029] Add “purpose” descriptions to Avatica JSON docs
  • [CALCITE-984]Massive cleanup of Avatica JSON docs
• [CALCITE-861]Be explicit that mvn test needs to be invoked
• [CALCITE-997]Document keywords
• [CALCITE-979]Broken links in web site
• [CALCITE-961]Web site: Add downloads and Apache navigation links
• [CALCITE-960]Download links for pgp, md5, KEYS files, and direct from mirrors
• Remove embedded date-stamps from javadoc; add javadoc for test classes
• [CALCITE-965]Link to downloads page from each release news item

1.5.0 / 2015-11-06

Our first release as a top-level Apache project!

Avatica has undergone major improvements,including a new RPC layer that usesprotocol buffers,support for DML statements, better support for bind variables andunique identifiers for connections and statements.

There are lots of improvements to planner rules, and the logicthat replaces relational expressions with equivalent materializations.

We continue to find more uses forRelBuilder.We now recommend that you use RelBuilder whenever you createrelational expressions within a planner rule; the rule can then bere-used to create different sub-classes of relational expression, andthe builder will perform simple optimizations automatically.

Using RelBuilder we built Piglet,a subset of the classic Hadoop languagePig.Pig is particularly interesting because it makes heavy use of nestedmulti-sets. You can follow this example to implement your own querylanguage, and immediately taking advantage of Calcite’s back-ends andoptimizer rules. It’s all just algebra, after all!

New features

• [CALCITE-911]Add a variant of CalciteSchema that does not cache sub-objects
• [CALCITE-845]Derive SUM’s return type by a customizable policy (Maryann Xue)
• [CALCITE-916]Support table function that implements ScannableTable
  • Example table function that generates mazes and their solutions
• [CALCITE-941]Named, optional and DEFAULT arguments to function calls;support named arguments when calling table functions and table macros
• [CALCITE-910]Improve handling of ARRAY, MULTISET, STRUCT types
• [CALCITE-879]COLLECT aggregate function
• [CALCITE-546]Allow table, column and field called ‘*’
• [CALCITE-893]Theta join in JDBC adapter
• Linq4j: Implement EnumerableDefaults methods (MiNG)
• [CALCITE-823]Add ALTER … RESET statement (Sudheesh Katkam)
• [CALCITE-881]Allow schema.table.column references in GROUP BY
• [CALCITE-852]DDL statements
• [CALCITE-851]Add original SQL string as a field in the parser
• [CALCITE-819]Add RelRoot, a contract for the result of a relational expression

Avatica features and bug-fixes

• [CALCITE-951]Print the server-side stack in the local exception (Josh Elser)
• [CALCITE-936]Make HttpServer configurable (Navis Ryu)
• [CALCITE-903]Enable Avatica client to recover from missing server-side state (Josh Elser)
• [CALCITE-921]Fix incorrectness when calling getString() on binary data (Josh Elser)
• [CALCITE-913]Construct proper ColumnMetaData for arrays (Josh Elser)
• [CALCITE-871]In JdbcMeta, register each statement using an id from a generator (BrunoDumon)
• [CALCITE-645]Implement AvaticaSqlException to pass server-side exception information toclients (Josh Elser)
• [CALCITE-912]Add Avatica OpenConnectionRequest (Bruno Dumon)
• [CALCITE-919]Avoid setScale on BigDecimal when scale is 0 (Josh Elser)
• [CALCITE-927]Call finagle for all calls that return ResultSetResponses (Josh Elser)
• [CALCITE-705]DML in Avatica, and split Execute out from Fetch request (Yeong Wei)
• [CALCITE-914]Add JsonSubType for ExecuteResponse, and fix JSON docs (Josh Elser)
• [CALCITE-905]getTables returns empty result in JdbcMeta (Jan Van Besien)
• [CALCITE-906]Avatica JdbcMeta statement IDs are not unique
• [CALCITE-866]Break out Avatica documentation and add JSON reference (Josh Elser)
• [CALCITE-843]AvaticaConnection.getAutoCommit throws NullPointerException
• [CALCITE-840]Protocol buffer serialization over HTTP for Avatica Server (Josh Elser)

Materializations

• [CALCITE-952]Organize applicable materializations in reversed topological order (MaryannXue)
• [CALCITE-890]Register all combinations of materialization substitutions (Maryann Xue)
• [CALCITE-891]When substituting materializations, match TableScan without Project(Maryann Xue)
• [CALCITE-890]Register all combinations of materialization substitutions (Maryann Xue)
• [CALCITE-925]Match materialized views when predicates contain strings and ranges (AmoghMargoor)
• [CALCITE-793]Planner requires unnecessary collation when using materialized view (MaryannXue)
• [CALCITE-825]Allow user to specify sort order of an ArrayTable

Planner rules

• [CALCITE-953]Improve RelMdPredicates to deal with RexLiteral (Pengcheng Xiong)
• [CALCITE-939]Variant of SortUnionTransposeRule for order-preserving Union(Maryann Xue)
• [CALCITE-931]Wrong collation trait in SortJoinTransposeRule for right joins(Maryann Xue)
• [CALCITE-938]More accurate rowCount for Aggregate applied to already unique keys(Maryann Xue)
• [CALCITE-935]Improve how ReduceExpressionsRule handles duplicate constraints (PengchengXiong)
• [CALCITE-922]Extract value of an INTERVAL literal (Hsuan-Yi Chu)
• [CALCITE-889]Implement SortUnionTransposeRule (Pengcheng Xiong)
• [CALCITE-909]Make ReduceExpressionsRule extensible
• [CALCITE-856]Make more rules extensible
• [CALCITE-902]Match nullability when reducing expressions in a Project
• [CALCITE-895]Simplify “(CASE … END) = constant” inside AND or OR (Hsuan-Yi Chu)
• [CALCITE-828]Use RelBuilder in rules rather than type-specific RelNode factories
• [CALCITE-892]Implement SortJoinTransposeRule
• [CALCITE-876]After pushing LogicalProject past LogicalWindow, adjust references toconstants properly (Hsuan-Yi Chu)
• [CALCITE-844]Push Project through Window (Hsuan-Yi Chu)
• [CALCITE-841]Redundant windows when window function arguments are expressions (Hsuan-YiChu)
• [CALCITE-846]Push Aggregate with Filter through Union(all)

RelBuilder and Piglet

• [CALCITE-933]RelBuilder.scan() now gives a nice exception if the table does not exist(Andy Grove)
• Fix Piglet DUMP applied to multisets and structs
• Multisets and COLLECT in Piglet
• [CALCITE-785]Add “Piglet”, a subset of Pig Latin on top of Calcite algebra
• [CALCITE-869]Add VALUES command to Piglet
• [CALCITE-868]Add API to execute queries expressed as RelNode
• In RelBuilder, build expressions by table alias

Bug-fixes, API changes and minor enhancements

• [CALCITE-948]Indicator columns not preserved by RelFieldTrimmer
• Fix Windows issues (line endings and checkstyle suppressions)
• [CALCITE-937]User-defined function within view
• [CALCITE-926]Rules fail to match because of missing link to parent equivalence set(Maryann Xue)
• [CALCITE-908]Bump protobuf to 3.0.0-beta-1, fix deprecations and update docs (Josh Elser)
• [CALCITE-932]Fix muddled columns when RelFieldTrimmer is applied to Aggregate
• [CALCITE-930]Now Calcite is a top-level project, remove references to “incubating”
• [CALCITE-929]Calls to AbstractRelNode may result in NPE
• [CALCITE-923]Type mismatch when converting LEFT JOIN to INNER
• [CALCITE-666]Anti-semi-joins against JDBC adapter give wrong results (Yeong Wei)
• [CALCITE-918]createProject in RelOptUtil should uniquify field names
• [CALCITE-792]Obsolete RelNode.isKey and isDistinct methods
• Allow FlatLists of different length to be compared
• [CALCITE-898]Type of ‘Java * INTEGER' should be BIGINT
• [CALCITE-894]Do not generate redundant column alias for the left relation whentranslating IN sub-query (Maryann Xue)
• [CALCITE-897]Enable debugging using “-Dcalcite.debug”
• [CALCITE-885]Add Oracle test environment
• [CALCITE-888]Overlay window loses PARTITION BY list (Hsuan-Yi Chu)
• [CALCITE-886]System functions in GROUP BY clause
• [CALCITE-860]Correct LICENSE file for generated web site
• [CALCITE-882]Allow web site to be deployed not as the root directory of the web server(Josh Elser)
• Upgrade parent POM to apache-17
• [CALCITE-687]Synchronize HSQLDB at a coarse level using a Lock (Josh Elser)
• [CALCITE-870]Remove copyright content from archers.json
• Replace Stack with ArrayDeque
• [CALCITE-874]ReflectiveRelMetadataProvider is not thread-safe
• Add LogicalWindow.create()
• Add ImmutableBitSet.get(int, int)
• [CALCITE-865]Unknown table type causes NullPointerException in JdbcSchema
  • Add table types used by Oracle and DB2
• [CALCITE-862]JdbcSchema gives NullPointerException on non-standard column type (MarcPrud’hommeaux)
• [CALCITE-847]AVG window function in GROUP BY gives AssertionError (Hsuan-Yi Chu)
• [CALCITE-827]Calcite incorrectly permutes columns of OVER query (Hsuan-Yi Chu)
• [CALCITE-809]TableScan does not support large/infinite scans (Jesse Yates)
• Lazily create exception only when it needs to be thrown (Marc Prud’hommeaux)
• [CALCITE-812]Make JSON reader and writer use properly quoted key names (MarcPrud’hommeaux)
• [CALCITE-820]Validate that window functions have OVER clause (Hsuan-Yi Chu)
• [CALCITE-824]Type inference when converting IN clause to semijoin (Josh Wills)

1.4.0-incubating / 2015-09-02

In addition to a large number of bug-fixes and minor enhancements,this release includes improvements to lattices and materialized views,and adds a builder API so that you can easily create relationalalgebra expressions.

New features

• [CALCITE-748] Add RelBuilder, builder for expressions in relational algebra
• [CALCITE-758] Use more than one lattice in the same query (Rajat Venkatesh)
• [CALCITE-761] Pre-populated materializations (Maryann Xue)
• [CALCITE-786] Detect if materialized view can be used to rewrite a query innon-trivial cases (Amogh Margoor)
• [CALCITE-732] Implement multiple distinct-COUNT using GROUPING SETS
• Add various BitSet and ImmutableBitSet utilities

Web site updates

• [CALCITE-810] Add committers’ organizations to the web site
• Add news item (XLDB best lighting talk), and some talks
• Fix javadoc links
• Add license notice for web site
• Wrap file header in HTML comments
• How to release
• Move disclaimer out of every page’s footer and into home page and downloadspage
• For web site files, add license headers where possible, apache-ratexclusions otherwise
• Calcite DOAP
• [CALCITE-355] Web site

Bug-fixes, API changes and minor enhancements

• [CALCITE-741] Ensure that the source release’s DEPENDENCIES file includes all moduledependencies
• [CALCITE-743] Ensure only a single source assembly is executed
• [CALCITE-850] Remove push down expressions from FilterJoinRule and create a new rulefor it
• [CALCITE-834] StackOverflowError getting predicates from the metadata provider
• [CALCITE-833] RelOptUtil.splitJoinCondition incorrectly splits a join condition(Hsuan-Yi Chu)
• [CALCITE-822] Add a unit test case to test collation of LogicalAggregate
• [CALCITE-822] Revert incorrect LogicalAggregate collation inferring logic made inCALCITE-783
• [CALCITE-826] Use ProjectFactory in AggregateJoinTranposeRule and FilterJoinRule
• [CALCITE-821] Frameworks gives NPE when FrameworkConfig has no default schema
• [CALCITE-811] Extend JoinProjectTransposeRule with option to support outer joins
• [CALCITE-805] Add support for using an alternative grammar specification for left andright curly braces. Additionally, add support for including addition tokenmanager declarations
• [CALCITE-803] Add MYSQL_ANSI Lexing policy
• [CALCITE-717] Compare BINARY and VARBINARY on unsigned byte values (Low Chin Wei)
• [CALCITE-814] RexBuilder reverses precision and scale of DECIMAL literal
• [CALCITE-813] Upgrade updateCount, maxRows from int to long
• [CALCITE-714] When de-correlating, push join condition into sub-query
• [CALCITE-751] Push aggregate with aggregate functions through join
• Add RelBuilder.avg
• [CALCITE-806] ROW_NUMBER should emit distinct values
• Document JSON model, making javadoc consistent with the model reference
• [CALCITE-808] Optimize ProjectMergeRule
• [CALCITE-791] Optimize RelOptUtil.pushFilterPastProject
• [CALCITE-783] Infer collation of Project using monotonicity (Milinda Pathirage)
• Change the argument types of SqlOperator.getMonotonicity to allow it to beused for RexNode as well as SqlNode
• [CALCITE-800] Window function defined within another window function should be invalid(Hsuan-Yi Chu)
• [CALCITE-787] Star table wrongly assigned to materialized view (Amogh Margoor)
• Remove duplicate resources from XML test reference files
• [CALCITE-795] Loss of precision when sending a decimal number via the remote JSONservice (Lukáš Lalinský)
• [CALCITE-774] When GROUP BY is present, ensure that window function operands onlyrefer to grouping keys (Hsuan-Yi Chu)
• [CALCITE-799] Incorrect result for HAVING count(*) > 1
• [CALCITE-801] NullPointerException using USING on table alias with column aliases
• [CALCITE-390] Infer predicates for semi-join
• [CALCITE-789] MetaImpl.MetaCatalog should expose TABLE_CAT instead of TABLE_CATALOG
• [CALCITE-752] Add back sqlline as a dependency to csv example
• [CALCITE-780] HTTP error 413 when sending a long string to the Avatica server
• In RelBuilder, calling sort then limit has same effect as callingsortLimit
• Add Ord.reverse
• [CALCITE-788] Allow EnumerableJoin to be sub-classed (Li Yang)
• [CALCITE-280] BigDecimal underflow (Li Yang)
• [CALCITE-763] Missing translation from Sort to MutableSort (Maryann Xue)
• [CALCITE-770] Ignore window aggregates and ranking functions when finding aggregatefunctions
• [CALCITE-765] Set Content-Type from the RPC server to application/json (Lukáš Lalinský)
• Fix Windows line-endings in RelBuilderTest
• [CALCITE-727] Constant folding involving CASE and NULL
• Related to[CALCITE-758],speed up matching by not considering tiles separately from othermaterialized views
• Test case and workaround for[CALCITE-760] Aggregate recommender blows up if row count estimate is too high
• [CALCITE-753] Aggregate operators may derive row types with duplicate column names
• [CALCITE-457] Push condition of non-ansi join into join operator
• Change jsonRequest encoding to UTF-8 (Guitao Ding)
• [CALCITE-757] Fix expansion of view of another view (Venki Korukanti)
• Fix coverity warnings
• Remove deprecated SqlTypeName methods
• [CALCITE-754] Validator error when resolving OVER clause of JOIN query
• [CALCITE-429] Cardinality provider for use by lattice algorithm
• [CALCITE-740] Redundant WHERE clause causes wrong result in MongoDB adapter
• [CALCITE-665] ClassCastException in MongoDB adapter
• Separate TableFactory from suggested table name, so one TableFactory can beused for several tables
• [CALCITE-749] Add MaterializationService.TableFactory (Rajat Venkatesh)
• [CALCITE-718] Enable fetch to work for Statement.execute() for Avatica (Xavier Leong)
• [CALCITE-712] Obey setMaxRows for statement execute (Xavier Leong)
• Add LoggingLocalJsonService, to make it easier to test that JDBC requestscause the right RPCs
• [CALCITE-708] Implement DatabaseMetaData.getTypeInfo (Xavier Leong)
• Enable Travis CI on new-master branch and bug-fix branches named“NNN-description”
• Clean up
• Upgrade tpcds
• Make JdbcTest.testVersion more permissive, so that version.major andversion.minor can be set just before a release, rather than just after as atpresent

1.3.0-incubating / 2015-05-30

Mainly bug-fixes, but this release adds support formodifiable viewsandfiltered aggregate functionsand various improvements to Avatica.

New features

• [CALCITE-505]Support modifiable view
• [CALCITE-704]FILTER clause for aggregate functions
• [CALCITE-522]In remote JDBC driver, transmit static database properties as a map
• [CALCITE-661]Remote fetch in Calcite JDBC driver
• Support Date, Time, Timestamp parameters

API changes

• [CALCITE-722]Rename markdown files to lower-case
• [CALCITE-697]Obsolete class RelOptQuery
• [CALCITE-693]Allow clients to control creation of RelOptCluster
• [CALCITE-691]Allow projects to supply alternate SQL parser
• [CALCITE-675]Enable AggregateProjectMergeRule in standard rule set
• [CALCITE-679]Factory method for SemiJoin
• [CALCITE-674]Add a SWAP_OUTER static instance to JoinCommuteRule (Maryann Xue)
• [CALCITE-735]Primitive.DOUBLE.min should be large and negative

Bug-fixes and internal changes

• [CALCITE-688]splitCondition does not behave correctly when one side of the conditionreferences columns from different inputs
• [CALCITE-259]Using sub-queries in CASE statement against JDBC tables generates invalidOracle SQL (Yeong Wei)
• In sample code in README.md, rename optiq to calcite (Ethan)
• [CALCITE-720]VolcanoPlanner.ambitious comment doc is inconsistent (Santiago M. Mola)
• [CALCITE-729]IndexOutOfBoundsException in ROLLUP query on JDBC data source
• [CALCITE-733]Multiple distinct-COUNT query gives wrong results
• [CALCITE-730]ClassCastException in table from CloneSchema
• [CALCITE-728]Test suite hangs on Windows
• [CALCITE-723]Document lattices
• [CALCITE-515]Add Apache headers to markdown files
• Upgrade quidem
• [CALCITE-716]Scalar sub-query and aggregate function in SELECT or HAVING clause givesAssertionError
• [CALCITE-694]Scan HAVING clause for sub-queries and IN-lists (Hsuan-Yi Chu)
• Upgrade hydromatic-resource-maven-plugin
• [CALCITE-710]Identical conditions in the WHERE clause cause AssertionError (SeanHsuan-Yi Chu)
• [CALCITE-695]Do not add SINGLE_VALUE aggregate function to a sub-query that will neverreturn more than one row (Hsuan-Yi Chu)
• Add tests for scalar sub-queries, including test cases for[CALCITE-709]Errors with LIMIT inside scalar sub-query
• [CALCITE-702]Add validator test for monotonic expressions
• [CALCITE-699]In Avatica, synchronize access to Calendar
• [CALCITE-700]Pass time zone into tests
• [CALCITE-698]For GROUP BY (), areColumnsUnique() should return true for any key
• Disable tests that fail under JDK 1.7 due to[CALCITE-687]
• Add “getting started” to HOWTO
• [CALCITE-692]Add back sqlline as a dependency
• [CALCITE-677]RemoteDriverTest.testTypeHandling fails east of Greenwich
• Disable test for[CALCITE-687]Make RemoteDriverTest.testStatementLifecycle thread-safe
• [CALCITE-686]SqlNode.unparse produces invalid SQL
• [CALCITE-507]Update HOWTO.md with running integration tests
• Add H2 integration test
• Add PostgreSQL integration test
• [CALCITE-590]Update MongoDB test suite to calcite-test-dataset
• Add CalciteAssert.assertArrayEqual for more user-friendly asserts
• [CALCITE-585]Avatica JDBC methods should throw SQLFeatureNotSupportedException (Ng JiunnJye)
• [CALCITE-671]ByteString does not deserialize properly as a FetchRequest parameter value
• [CALCITE-676]AssertionError in GROUPING SETS query
• [CALCITE-678]SemiJoinRule mixes up fields when Aggregate.groupSet is not field #0

1.2.0-incubating / 2015-04-07

A short release, less than a month after 1.1.

There have been many changes to Avatica, hugely improving its coverage of theJDBC API and overall robustness. A new provider, JdbcMeta, allowsyou to remote an existing JDBC driver.

[CALCITE-606]improves how the planner propagates traits such as collation anddistribution among relational expressions.

[CALCITE-613]and [CALCITE-307]improve implicit and explicit conversions in SQL.

New features

• [CALCITE-366]Support Aggregate push down in bushy joins (Jesus Camacho Rodriguez)
• [CALCITE-613]Implicitly convert character values in comparisons
• [CALCITE-307]Implement CAST between date-time types
• [CALCITE-634]Allow ORDER BY aggregate function in SELECT DISTINCT, provided that itoccurs in SELECT clause (Sean Hsuan-Yi Chu)
• In linq4j, implement firstOrDefault, single, and singleOrDefault methods(Daniel Cooper)
• JDBC adapter
  • [CALCITE-631]Push theta joins down to JDBC adapter (Ng Jiunn Jye)
  • [CALCITE-657]NullPointerException when executing JdbcAggregate.implementmethod (Yuri Au Yong)
• Metadata
  • [CALCITE-659]Missing types in averageTypeValueSize method in RelMdSize(Jesus Camacho Rodriguez)
  • [CALCITE-650]Add metadata for average size of a tuple in SemiJoin (JesusCamacho Rodriguez)
  • [CALCITE-649]Extend splitCondition method in RelOptUtil to handle multiplejoins on the same key (Jesus Camacho Rodriguez)

Avatica features and bug-fixes

• [CALCITE-670]AvaticaPreparedStatement should support execute() andexecuteUpdate() (Nick Dimiduk)
• [CALCITE-641]Implement logging throughout Avatica server (Nick Dimiduk)
• [CALCITE-646]AvaticaStatement.execute method broken over remote JDBC (Yeong Weiand Julian Hyde)
• [CALCITE-660]Improve Avatica date support
• [CALCITE-655]Implement ConnectionSync RPC (Nick Dimiduk)
• [CALCITE-654]Tighten up AvaticaStatement.execute semantics (Nick Dimiduk)
• [CALCITE-658]Cleanup dependency usage (Nick Dimiduk)
• [CALCITE-652]Move server pieces of avatica into avatica-server (Nick Dimiduk)
• [CALCITE-651]In JdbcMeta, convert property definitions to an enum (Nick Dimiduk)
• [CALCITE-640]Avatica server should expire stale connections/statements (Nick Dimiduk)
• [CALCITE-639]Open up permissions on avatica server components (Nick Dimiduk)
• [CALCITE-637]Implement Avatica CloseConnection RPC (Nick Dimiduk)
• [CALCITE-636]Connection isolation for Avatica clients (Nick Dimiduk)
• [CALCITE-626]Implement CloseStatement RPC (Nick Dimiduk)
• [CALCITE-630]Flesh out AvaticaParameter.setObject (Nick Dimiduk)
• [CALCITE-627]Add Avatica support for getTableTypes, getColumns (Xavier FH Leong)
• [CALCITE-618]Add Avatica support for getTables (Julian Hyde and Nick Dimiduk)

API changes

• [CALCITE-617]Check at initialization time in CachingInvocationHandler that MD provideris not null (Jesus Camacho Rodriguez)
• [CALCITE-638]SQL standard REAL is 4 bytes, FLOAT is 8 bytes

Bug-fixes and internal changes

• [CALCITE-672]SQL ANY type should be nullable (Jinfeng Ni)
• Disable tests, pending[CALCITE-673]Timeout executing joins against MySQL
• Fix traits in MongoDB adapter, and NullPointerException in JdbcTest
• [CALCITE-662]Query validation fails when an ORDER BY clause is used with WITH CLAUSE
• [CALCITE-606]Fix trait propagation and add test case
• Remove checkstyle Eclipse properties from git tracking
• [CALCITE-644]Increase check style line limit to 100 chars (Nick Dimiduk)
• [CALCITE-648]Update ProjectMergeRule description for new naming convention (Jinfeng Ni)
• [CALCITE-625]README.md linking to the wrong page of optiq-csv (hongbin ma)
• [CALCITE-632]Sort order returned by SUPERCLASS_COMPARATOR inReflectiveRelMetadataProvider is inconsistent (Jesus CamachoRodriguez)
• [CALCITE-335]Remove uses of linq4j Functions.adapt
• [CALCITE-592]Upgrade to Guava 14.0.1
• [CALCITE-596]JDBC adapter incorrectly reads null values as 0 (Ng Jiunn Jye)
• [CALCITE-633]WITH … ORDER BY cannot find table
• [CALCITE-614]IN clause in CASE in GROUP BY gives AssertionError
• [CALCITE-619]Slim down dependencies in parent POM

1.1.0-incubating / 2015-03-13

This Calcite release makes it possible to exploit physical propertiesof relational expressions to produce more efficient plans, introducingcollation and distribution as traits, Exchange relational operator,and several new forms of metadata.

We add experimental support for streaming SQL.

This release drops support for JDK 1.6; Calcite now requires 1.7 orlater.

We have introduced static create methods for many sub-classes ofRelNode. We strongly suggest that you use these rather thancalling constructors directly.

New features

• SQL
  • [CALCITE-602]Streaming queries (experimental)
  • [CALCITE-588]Allow TableMacro to consume maps and collections
  • [CALCITE-583]Operator || mishandles ANY type (Sean Hsuan-Yi Chu)
• Planner rule improvements
  • [CALCITE-445]Pull up filters rejected by a ProjectableFilterableTable
  • [CALCITE-600]Use SetOpFactory in rules containing Union operator (JesusCamacho Rodriguez)
  • [CALCITE-603]Metadata providers for size, memory, parallelism
    • [CALCITE-607]Change visibility of constructor in metadata providers for size,memory, parallelism (Jesus Camacho Rodriguez)
    • [CALCITE-608]Exception is thrown when RelMdDistribution for Projectoperator is called (Jesus Camacho Rodriguez)
• Collation and distribution as traits
  • [CALCITE-88]Add collation as a trait and a kind of RelNode metadata
  • [CALCITE-569]ArrayIndexOutOfBoundsException when deducing collation (Aman Sinha)
  • [CALCITE-581]Add LogicalSort relational expression, and make Sort abstract
  • [CALCITE-526]Add EnumerableMergeJoin, which exploits sorted inputs
  • [CALCITE-71]Provide a way to declare that tables are sorted
  • [CALCITE-576]Make RelCollation trait and AbstractRelNode.getCollationList consistent
  • [CALCITE-254]Propagate RelCollation on aliased columns in JoinRule
  • [CALCITE-569]ArrayIndexOutOfBoundsException when deducing collation
  • [CALCITE-594]Add RelDistribution trait and Exchange relational expression

API changes

• Many sub-classes of RelNode now have a static create methodwhich automatically sets up traits such as collation anddistribution. The constructors are not marked deprecated, but westrongly suggest that you use the create method if it exists.
• [CALCITE-591]Drop support for Java 1.6 (and JDBC 4.0)
• [CALCITE-587]Upgrade jetty-server to 9.2.7.v20150116 and port avatica-server HttpServer(Trevor Hartman)
• [CALCITE-577]Revert temporary API changes introduced in[CALCITE-575]
• Add means to create Context instances by wrapping objects and by chainingcontexts
• [CALCITE-599]EquiJoin in wrong package (Jesus Camacho Rodriguez)
• [CALCITE-573]Use user-given names in RelOptUtil.createProject and createRename
• [CALCITE-572]Remove Project.flags (methods are deprecated, to be removed before 2.0)

Bug-fixes and internal changes

• Remove the LICENSE file of calcite-example-csv (the formeroptiq-csv) and move its history into main history
• [CALCITE-615]AvaticaParameter should be Jackson serializable (Nick Dimiduk)
• [CALCITE-612]Update AvaticaStatement to handle cancelled queries (Parth Chandra)
• [CALCITE-605]Reduce dependency on third-party maven repositories
• [CALCITE-611]Method setAggChildKeys should take into account indicator columns ofAggregate operator (Jesus Camacho Rodriguez)
• [CALCITE-566]ReduceExpressionsRule requires planner to have an Executor
• Refactor TableScanNode.create method
• [CALCITE-593]Validator in Frameworks should expand identifiers (Jinfeng Ni)
• Australian time-zones changed in tzdata2014f, Java 1.8.0_31
• [CALCITE-580]Average aggregation on an Integer column throws ClassCastException
• In Travis, ask Surefire to print results to screen
• [CALCITE-586]Prevent JSON serialization of Signature.internalParameters

1.0.0-incubating / 2015-01-31

Calcite’s first major release.

Since the previous release we have re-organized the into the org.apache.calcitenamespace. To make migration of your code easier, we have described themapping from old to new class namesas an attachment to[CALCITE-296].

The release adds SQL support for GROUPING SETS, EXTEND, UPSERT and sequences;a remote JDBC driver;improvements to the planner engine and built-in planner rules;improvements to the algorithms that implement the relational algebra,including an interpreter that can evaluate queries without compilation;and fixes about 30 bugs.

New features

• SQL
  • [CALCITE-494]Support NEXT/CURRENT VALUE FOR syntax for using sequences
  • [CALCITE-492]Support UPSERT statement in parser
  • [CALCITE-493]Add EXTEND clause, for defining columns and their types at query/DML time
  • [CALCITE-497]Support optional qualifier for column name references
  • [CALCITE-356]Allow column references of the form schema.table.column
  • [CALCITE-462]Allow table functions in LATERAL expression
  • [CALCITE-282]Add {fn QUARTER(date)} function (Benoy Antony)
  • Grouping sets
    • [CALCITE-370]Support GROUPING SETS, CUBE, ROLLUP in SQL and algebra
    • [CALCITE-512]Add GROUP_ID,GROUPING_ID, GROUPING functions
• Planner rule improvements
  • [CALCITE-92]Optimize away Project that merely renames fields
  • Detect and merge duplicate predicates AND(x, y, x) to AND(x, y) in morecircumstances
  • [CALCITE-557]Speed up planning by never creating AbstractConverter
  • [CALCITE-545]When a projected expression can only have one value, replace with thatconstant
  • Grouping sets
    • [CALCITE-542]Support for Aggregate with grouping sets in RelMdColumnOrigins (JesusCamacho Rodriguez)
    • [CALCITE-533]Support for grouping sets in FilterAggregateTransposeRule (Jesus CamachoRodriguez)
    • [CALCITE-532]Support for grouping sets in AggregateFilterTransposeRule (Jesus CamachoRodriguez)
    • [CALCITE-513]Support for grouping sets in AggregateProjectMergeRule (Jesus CamachoRodriguez)
    • [CALCITE-510]Support for grouping sets in AggregateExpandDistinctAggregatesRule (JesusCamacho Rodriguez)
    • [CALCITE-502]Support for grouping sets in AggregateUnionTransposeRule (Jesus CamachoRodriguez)
    • [CALCITE-503]Tests to check rules on Aggregate operator without grouping sets (JesusCamacho Rodriguez)
• Algorithms
  • [CALCITE-451]Implement theta join, inner and outer, in enumerable convention
  • [CALCITE-489]Update Correlate mechanics and implement EnumerableCorrelate (aka nestedloops join)
  • [CALCITE-544]Implement Union in interpreter
  • [CALCITE-562]Implement inner Join in interpreter and improve handling of scalar expressions
  • [CALCITE-543]Implement Aggregate (including GROUPING SETS) in interpreter (JacquesNadeau)
  • In progress towards[CALCITE-558]add BINDABLE convention (but ENUMERABLE is still the default), and addArrayBindable and Scalar interfaces
• Remote driver
  • [CALCITE-93]Calcite RPC server
  • [CALCITE-94]Remote JDBC driver
  • Make JsonHandler and JsonService thread-safe

API changes

• The great code re-org
  • [CALCITE-296]Re-organize package structure
  • [CALCITE-419]Naming convention for planner rules
  • [CALCITE-306]Standardize code style for “import package.*;”
  • [CALCITE-474]Clean up rule naming in order to support enabling/disabling rules
  • [CALCITE-460]Add ImmutableBitSet and replace uses of BitSet
  • [CALCITE-479]Migrate RelNode.getChildExps to RelNode.accept(RexShuttle)
  • [CALCITE-527]Drop rowType field and constructor/copy argument of Calc
• Add linq4j and example-csv modules
  • Remove unused packages in linq4j, and fix checkstyle issues in linq4j and csv
  • Add calcite-linq4j and calcite-example-csv as POM sub-modules
  • Import ‘optiq-csv’ project as ‘example/csv/’, and add Apache headers
  • Import ‘linq4j’ project, and add Apache headers
  • [CALCITE-478]Move CSV tutorial (Siva Narayanan)
• [CALCITE-464]Make parser accept configurable max length for SQL identifier
• [CALCITE-465]Remove OneRow and Empty relational expressions; Values will suffice

Bug-fixes and internal changes

• Build improvements
  • [CALCITE-541]Update maven-source-plugin to 2.4 to get speedup in jdk 1.8
  • [CALCITE-537]Skip overwrite of NOTICE, DEPENDENCIES, and LICENSE files
  • [CALCITE-538]Generate Parser.jj only at first build
  • [CALCITE-539]Avoid rewrite of org-apache-calcite-jdbc.properties
  • [CALCITE-540]Create git.properties file only at first build. This saves time indevelopment at a cost of stale git.properties
  • [CALCITE-536]Add @PackageMarker to package-info.java so maven-compiler skipscompilation when the sources are unchanged
  • [CALCITE-535]Support skip overwrite in hydromatic-resource
• [CALCITE-582]EnumerableTableScan broken when table has single column
• [CALCITE-575]Variant of ProjectRemoveRule that considers a project trivial only if itsfield names are identical (John Pullokkaran)
• [CALCITE-571]ReduceExpressionsRule tries to reduce SemiJoin condition to non-equicondition
• [CALCITE-568]Upgrade to a version of pentaho-aggdesigner that does not pull inservlet-api
• [CALCITE-567]Make quidem dependency have scope “test”
• [CALCITE-570]ReduceExpressionsRule throws “duplicate key” exception
• [CALCITE-561]Upgrade parent POM
• [CALCITE-458]ArrayIndexOutOfBoundsException when using just a single column in interpreter
• Fix spurious extra row from FULL JOIN
• [CALCITE-554]Outer join over NULL keys generates wrong result
• [CALCITE-489]Teach CalciteAssert to respect multiple settings
• [CALCITE-516]GROUP BY on a CASE expression containing IN predicate fails (Aman Sinha)
• [CALCITE-552]Upgrade tpcds (which depends on an old version of guava)
• Copy identifier when fully-qualifying, so column aliases have the right case
• [CALCITE-548]Extend induce method to return CUBE and ROLLUP (Jesus Camacho Rodriguez)
  • Simplify Group.induce by assuming that group sets are sorted
• Test case for[CALCITE-212]Join condition with OR
• [CALCITE-550]Case-insensitive matching of sub-query columns fails
  • Add more unit tests (Jinfeng Ni)
• [CALCITE-448]FilterIntoJoinRule creates filters containing invalid RexInputRef
• When registering a RelNode, be tolerant if it is equivalent to a RelNodewith different traits
• [CALCITE-547]Set nullability while inferring return type of item(any,…) operator
• In Travis CI, enable containers, and cache .m2 directory
• [CALCITE-534]Missing implementation of ResultSetMetaData.getColumnClassName (KnutForkalsrud)
• [CALCITE-506]Update EnumerableRelImplementor.stash so it is suitable for all kinds ofclasses
• Merge join algorithm for Enumerables
• Efficient Enumerable over random-access list
• Add a test that calls all functions with arguments of all types that theyclaim to accept
• [CALCITE-511]copy method in LogicalAggregate not copying the indicator value properly
• Add a model that has lattices and works against HSQLDB
• [CALCITE-509]RelMdColumnUniqueness uses ImmutableBitSet.Builder twice, getsNullPointerException
• [CALCITE-488]Enumerable<Holder> does not work if where Holder is a custom classwith a single field; Calcite tries to treat it as SCALAR due to prematureJavaRowFormat.optimize
• [CALCITE-352]Throw exception if ResultSet.next() is called after close()
• [CALCITE-403]Enumerable gives NullPointerException with NOT on nullable expression
• [CALCITE-469]Update example/csv README.md instructions
• Document WITH, LATERAL, GROUPING SETS, CUBE, ROLLUP;add descriptions for all built-in functions and operators
• [CALCITE-470]Print warning when column type hint is not understood;Update EMPS.deptno column Integer → int
• Fix Linq4j.product; the cartesian product of 0 attributes is one row of 0attributes
• Update link optiq-mat-plugin → mat-calcite-plugin
• [CALCITE-467]Incorrect namespace in package-info.java
• Add headers, to appease the RAT
• [CALCITE-446]CSV adapter should read from directory relative to the model file
• Add examples of scannable and filterable tables, matching[CALCITE-436]Simpler SPI to query Table
• Fix JdbcTest.testVersion now that version is 1.0
• Update release HOWTO

0.9.2-incubating / 2014-11-05

A fairly minor release, and last release before we rename all of thepackages and lots of classes, in what we expect to call 1.0. If youhave an existing application, it’s worth upgrading to this first,before you move on to 1.0.

New features

• [CALCITE-436]Simpler SPI to query Table

API changes

• [CALCITE-447]Change semi-join rules to make use of factories
• [CALCITE-442Add RelOptRuleOperand constructor that takes a predicate

Bug-fixes and internal changes

• [CALCITE-397]SELECT DISTINCT * on reflective schema gives ClassCastException at runtime
• Various lattice improvements.
• sqlline: Looking for class-path in inconsistent locations.
• Re-order test suite, so that fast tests are run first.
• [CALCITE-444]Filters wrongly pushed into full outer join
• Make it more convenient to unit test RelMetadataQuery, and add some moretests for[CALCITE-443]
• [CALCITE-443]getPredicates from a Union is not correct
• Update references to web sites, git repositories, jira, mailing lists,travis CI now that [INFRA-8413] is fixed
• [CALCITE-435]FilterAggregateTransposeRule loses conditions that cannot be pushed
• [CALCITE-435]LoptOptimizeJoinRule incorrectly re-orders outer joins
• [CALCITE-439]SqlValidatorUtil.uniquify() may not terminate under some conditions
• [CALCITE-438]Push predicates through SemiJoinRel
• Add test case for LIKE … ESCAPE.
• HOWTO: Modify release instructions.
• Update DiffRepository documentation.
• Add tests for windowed aggregates without ORDER BY. (Works already.)

0.9.1-incubating / 2014-10-02

This is the first release as Calcite. (The project was previously called Optiq.)

New features

• [CALCITE-430]Rename project from Optiq to Calcite
• [CALCITE-426]Pool JDBC data sources, to make it easier to pool connections
• [CALCITE-416]Execute logical RelNodes using an interpreter
• [CALCITE-376]Move SqlRun into its own artifact,Quidem.
• [CALCITE-269]MongoDB result sets larger than 16MB
• [CALCITE-373]NULL values in NOT IN sub-queries
• SQL functions:
  • [CALCITE-422]Add REGR_SXX and REGR_SYY regression functions
  • [CALCITE-421]Add COVAR_POP and COVAR_SAMP aggregate functions
• Planner rules:
  • [CALCITE-425]Add FilterAggregateTransposeRule, that pushes a filter through anaggregate
  • [CALCITE-399]Factorize common AND factors out of OR predicates
  • [CALCITE-404]MergeProjectRule should not construct RexPrograms for simple mappings
  • [CALCITE-394]Add RexUtil.toCnf(), to convert expressions to conjunctive normal form(CNF)
  • [CALCITE-389]MergeFilterRule should flatten AND condition
• Lattices:
  • [CALCITE-428]Use optimization algorithm to suggest which tiles of a lattice tomaterialize
  • [CALCITE-410]Allow lattice tiles to satisfy a query by rolling up
  • [CALCITE-406]Add tile and measure elements to lattice model element
  • Now, a lattice can materialize an aggregate-join and use it in a subsequentquery.
  • [CALCITE-402]Lattice should create materializations on demand
  • [CALCITE-344]Lattice data structure
• Field trimmer:
  • [CALCITE-408]Make FieldTrimmer work with RelNode base classes
  • [CALCITE-388]Handle semi-joins in field trimmer
  • [CALCITE-395]Make FieldTrimmer.trimFields(SetOp) generate ProjectRel instead ofCalcRel
  • [CALCITE-393]If no fields are projected from a table, field trimmer should project adummy expression

API changes

• [CALCITE-413]Add RelDataTypeSystem plugin, allowing different max precision of aDECIMAL
• In Planner, query de-correlation no longer requires state in aSqlToRelConverter.
• Factories:
  • [CALCITE-392]RelFieldTrimmer should use factory to create new rel nodes
  • [CALCITE-382]Refactoring rules to use factories
  • [CALCITE-398]Move CalcRel.createProject methods to RelOptUtil
  • [CALCITE-396]Change return type of JoinFactory.createJoin(); add SemiJoinFactory

Bug-fixes and internal changes

• [CALCITE-386]Fix NOTICE
• Add tests inspired by Derby bugs.
• Add recent presentation to README.md.
• [CALCITE-427]Off-by-one issues in RemoveDistinctAggregateRule,AggregateFilterTransposeRule
• [CALCITE-414]Bad class name in sqlline shell script
• Bad package name in package-info.java was causing errors in Eclipse.
• [CALCITE-412]RelFieldTrimmer: when trimming SortRel, the collation and trait set don’tmatch
• Add test case for[CALCITE-411]Duplicate column aliases
• [CALCITE-407]RemoveTrivialProjectRule drops child node’s traits
• [CALCITE-409]PushFilterPastProjectRule should not push filters past windowed aggregates
• Fix tests on Windows.
• Don’t load FoodMartQuerySet unless we have to. It’s big.
• Enable connection pooling in test suite.
• [CALCITE-384]Add apache- prefix to tarball and directory within tarball
• Freeze hive fmpp > freemarker plugin dependency.
• Upgrade Janino
• Removed hardcoded foodmart schema information
• [CALCITE-387]CompileException when cast TRUE to nullable boolean
• Temporary fix for[CALCITE-390]Transitive inference (RelMdPredicates) doesn’t handle semi-join
• [CALCITE-385]Change comment style for Java headers
• Disable test that is inconistent between JDK 1.7 and 1.8.
• Fix git-commit-id-plugin error when running in Travis-CI.
• [CALCITE-381]Remove plugin versions from the <plugins> tag in root pom
• [CALCITE-383]Each jar should have a git.properties file describing its exact version
• Fix mvn site on JDK 1.8 and enable in Travis-CI.
• Status icon based on master branch, not whichever branch happened to buildmost recently.
• HOWTO:
  • Document how to build from git, and how to get jars from maven repo.
  • Optiq web site
  • Template emails for Apache votes
  • Update JIRA cases following release
  • Instructions for making and verifying a release

0.9.0-incubating / 2014-08-19

This is the first release under the Apache incubator process.

New features

• [CALCITE-371]Implement JOIN whose ON clause contains mixed equi and theta
• [CALCITE-369]Add EnumerableSemiJoinRel, implementation of semi-join in enumerableconvention
• Add class Strong, for detecting null-rejecting predicates.
• [CALCITE-368]Add SemiJoinRule, planner rule to convert project-join-aggregate into semi-join
• [CALCITE-367]PushFilterPastJoinRule should strengthen join type
• Add EquiJoinRel, base class for joins known to be equi-joins.
• Implement CAST(<string> AS <datetime>) and<datetime> + <interval>.
• [CALCITE-360]Introduce a rule to infer predicates from equi-join conditions
• [CALCITE-349]Add heuristic join-optimizer that can generate bushy joins
• [CALCITE-346]Add commutative join rule
• [CALCITE-347]In SqlRun, add !plan command
• [CALCITE-314]Allow simple UDFs based on methods
• [CALCITE-327]Rules should use base class to find rule match & use factory for objectcreation
• [CALCITE-316]In SqlRun, match output regardless of order if ORDER BY not present
• [CALCITE-300]Support multiple parameters in COUNT(DISTINCT x, y, …)

API changes

• [CALCITE-343]RelDecorrelator should build its own mappings, not inherit from SqlToRelConverter
• Remove deprecated methods.
• Convert Hook to use Guava Function (was linq4j Function1).
• Add fluent method withHook, to more easily add hooks in tests.
• [CALCITE-321]Add support for overriding implementation of CompoundIdentifier inSqlParser.
• [CALCITE-322]Add support for SqlExplain, SqlOrderBy and SqlWith to supportSqlShuttle use.
• [CALCITE-323]Override SqlUnresolvedFunction.inferReturnType() to return ANY typeso framework implementors can support late bound function implementations.
• [CALCITE-324]Add ViewExpander for Planner in Frameworks. Expose additionalproperties of ViewTable to allow subclassing.
• [CALCITE-247]Add Context and FrameworkConfig

Bug-fixes and internal changes

• [CALCITE-380]Downgrade to Guava 11.0.2
• Move several .md files into new ‘doc’ directory, to keep the root directory simple.
• Add DISCLAIMER
• Update history and HOWTO
• [CALCITE-377]UnregisteredDriver should catch, log and re-throw NoClassDefFoundError
• Inherit maven-release-plugin from Apache POM.
• Test case for[CALCITE-373]NOT IN and NULL values
• [CALCITE-372]Change LoptOptimizeJoinRule & PushFilterPast* rules to use factory
• Upgrade maven-checkstyle-plugin.
• Add class Holder, a mutable slot that can contain one object.
• Remove the 2-minute wait at the top of the hour for tests ofCURRENT_TIME, etc.
• Tune ImmutableIntList’s iterators.
• [CALCITE-364]Validator rejects valid WITH … ORDER BY query
• [CALCITE-363]Use dependencyManagement and pluginManagement in POM files
• Add FilterFactory.
• Add README file, incubation disclaimers, and how-to build and running tests.
• Add KEYS and start how-to for making snapshots and releases.
• Capital case component names; inherit license info from Apache parent POM.
• Only run apache-rat and git-commit-id-plugin in “release” maven profile.
• [CALCITE-348]Add Apache RAT as maven plugin
• Change license headers from “Julian Hyde” to “ASF”; add headers where missing.
• Fix build breakage on JDK 1.6 due to missing method BitSet.previousClearBit.
• Refactor test infrastructure to allow testing against heuristic bushy-joinoptimizer.
• Add methods and tests for BitSets, and re-organize tests.
• [CALCITE-354]Change maven groupId to “org.apache.optiq”
• Specify return type when calling RexBuilder.makeCall, if possible.
• Eliminate duplicate conditions in RexProgramBuilder.addCondition, notRexBuilder.makeCall as previously.
• [CALCITE-345]AssertionError in RexToLixTranslator comparing to date literal
• Restore PushFilterPastJoinRule to RelDecorrelator; interim pending[CALCITE-343]fix.
• [CALCITE-340]Fix bug in SqlToRelConverter when push expressions in join conditions intoProjectRel.
• [CALCITE-313]Query decorrelation fails
• While unifying a RelNode tree with a materialized view expression,switch representation to MutableRels.
• [CALCITE-305]Unit test failure on release candidates
• [CALCITE-325]Use Java list instead of Guava list to avoid null checks in case ofSqlTypeExplicitPrecedenceList.
• [CALCITE-326]Fix RelOptUtil ANY type check.
• [CALCITE-303]Migrate issue URLs
• [CALCITE-331]Precision/scale compatibility checks should always succeed for ANY type
• In SqlRun, allow !plan after !ok for same SQL statement.
• [CALCITE-318]Add unit test for SqlRun
• Fix a bug where composite SELECT DISTINCT would return duplicate rows.

0.8 / 2014-06-27

New features

• [CALCITE-310] Implement LEAD, LAG and NTILE windowed aggregates
• Reduce COUNT(not-null-expression) to COUNT()
• [CALCITE-292] Improve windowed aggregate return types
• [CALCITE-302] Use heuristic rule to plan queries with large numbers of joins
• [CALCITE-283]Add TPC-DS data generator
• [CALCITE-294]Implement DENSE_RANK windowed aggregate function
• SqlRun utility
  • [CALCITE-290]Add SqlRun, an idempotent utility for running SQL test scripts
  • Add “!skip” command to SqlRun.
  • Add MySQL formatting mode to SqlRun.

API changes

• Re-organize planner initialization,to make it easier to use heuristic join order.
• [CALCITE-301]Add Program interface, a planner phase more general than current RuleSet
• [CALCITE-263]Add operand type that will cause a rule to fire when a new subset is created
• Clean up and document SqlKind.
  • Add IS_NOT_TRUE and IS_NOT_FALSE SqlKind enums.
  • Add SqlKind.IS_NOT_NULL enum value, and use where possible,including for IS_NOT_UNKNOWN operator.

Bug-fixes and internal changes

• [CALCITE-312]Trim non-required fields before WindowRel
• [CALCITE-311]Wrong results when filtering the results of windowed aggregation
• More tests for WITH … ORDER BY
• [CALCITE-309]WITH … ORDER BY query gives AssertionError
• Enable MultiJoinRel and some other planner rule tests.
• Add ImmutableNullableList and UnmodifiableArrayList,and remove calls to Arrays.asList.
• Add method IntPair.zip.
• Reimplement regular and windowed aggregates
• Switch from github to Apache JIRA for issues tracking.
  • In release history, update issue URLs from github to Apache JIRA
• The Apache mailing list is now the official mailing list. Add presentations.
• Add test for overloaded UDF.
• Add tests for NOT IN where sub-query returns NULL values.
• [CALCITE-288]Add tests for windowed aggregation based on Postgres reference queries
• [CALCITE-286]Error casting MongoDB date
• [CALCITE-284]Window functions range defaults to CURRENT ROW
• [CALCITE-285]Window functions throw exception without ORDER BY
• Test case for[CALCITE-285].
• [CALCITE-281]EXTRACT function’s SQL return type is BIGINT but implemented as Java int

0.7 / 2014-05-13

New features

• Implement table functions.
• Arrays and multi-sets:
  • [CALCITE-267]Improve support for ARRAY data type
  • Better type information for JDBC Array; nested array now possible.
  • Implement JOIN LATERAL and JOIN UNNEST.
  • Implement the UNNEST relational operator, and various improvementsto ARRAY and MULTISET data types.
  • Represent ARRAY columns as Java lists.
  • Implement CARDINALITY(ARRAY) SQL operator.
• Implement scalar sub-query in SELECT clause.
• [CALCITE-273]Support column alias in WITH queries (common table expressions)
• Windowed aggregates:
  • Aggregate over constants, e.g. SUM(1) OVER (ROWS 10 PRECEDING);
  • UNBOUNDED PRECEDING window range;
  • Windowed aggregates computed over primitive scalars.
• Fix return type inference for aggregate calls. If the GROUP BY clause isempty, SUM may return null.
• [CALCITE-37]Document JSON model file format (as model.md).
• [CALCITE-238]Add adapter that generates TPC-H data
• Improve exception message in AvaticaConnection; addExceptionMessageTest.
• Implement micro-benchmarks viaJMH.

API changes

• Provide an option to create root schema without the “metadata” schema.
• Schema SPI:
  • [CALCITE-175]Modify Schema SPI to allow caching
  • Get sub-schemas defined by a Schema SPI, and cache their OptiqSchemawrappers. (Tobi Vollebregt and Julian Hyde)
• SqlAdvisor callable from client via JDBC.

Bug-fixes and internal changes

• Add Apache incubator proposal.
• Rename RELEASE.md to HISTORY.md.
• Upgrade maven-release-plugin.
• Upgrade to linq4j-0.3.
• Code generation improvements:
• Move code-generation optimizer to linq4j;
• Improve translation of strict functions;
• Mark most methods in SqlFunctions as @Deterministic;
• Support static final constants generated by linq4j.
• Avoid excessive box and unbox of primitives when using Object[] storage.
• In JDBC result set, avoid row computation on each accessor call.
• Test composite join conditions in various flavors of outer join.
• Use fromTrait of the just previously converted RelNode insteadof the original RelNode.
• Disable a MongoDB test, pending[CALCITE-270].
• Hush warnings from SplunkAdapterTest if Splunk is not available.
• [CALCITE-252]Scalar sub-query that returns 0 rows should become NULL value
• SplunkAdapterTest now uses the same Foodmart database as JdbcTest.
• [CALCITE-242]SplunkAdapterTest fails
• Remove some obsolete classes.
• [CALCITE-205]Suspicious map.get in VolcanoPlanner.reregister

0.6 / 2014-04-11

New features

• [CALCITE-214]Modify Frameworks to allow Schema to be re-usedObsoletes name field of ReflectiveSchema.
• [CALCITE-237]Allow user-defined aggregate functions (UDAs) to be defined in a model
• [CALCITE-227]Extend EXTRACT function to support DATE, TIME and TIMESTAMP values
• [CALCITE-222]User-defined table macros
• [CALCITE-179]Optiq on Windows
  • Add sqlline.bat and fix issues running sqlline under Cygwin.
• [CALCITE-195]Push aggregation into MongoDB adapter
• [CALCITE-193]Implement OFFSET and LIMIT in MongoDB adapter
• [CALCITE-164]Improve query performance of optiq over MongoDB
• Add Phoenix (HBase) SQL dialect (Bruno Dumon)

API changes

• Obsolete RexImpTable.AggregateImplementor and rename AggImplementor2.(This is a breaking change.)
• Convert CombinedParser.jj into freemarker template to allowcustom parser implementations. (Venki Korukanti)
• Extend Planner to pass a custom ConvertletTable and custom SQL parser.
• In Frameworks, add a way to specify list of TraitDefs that will be usedby planner. (Jinfeng Ni)
• [CALCITE-198]Use RexExecutor to evaluate projections and filters
• [CALCITE-219]Parse ALTER scope SET option = value statement
• [CALCITE-215]A Schema should not have to remember its name and parent(This is a breaking change.)
• [CALCITE-180]Common base class for TableFunction, ScalarFunction(This is a breaking change.)
• Add methods for dealing with symbols; deprecateSqlLiteral.booleanValue(SqlNode), SqlLiteral.symbolValue(SqlNode).
• Add RelOptPlanner.clear(); now it is safe to call transform twice.(Jinfeng Ni)
• Remove APIs deprecated for 0.5.
• Move around some operator classes and singletons.

Bug-fixes and internal changes

• Upgrade to linq4j-0.2.
• FETCH and LIMIT are ignored during SQL-to-RelNode translation.(Venki Korukanti)
• [CALCITE-245]Off-by-one translation of ON clause of JOIN
• [CALCITE-191]Rotate time/date/timestamp vals to local timezone
• [CALCITE-244]RelOptTableImpl.create always expects QueryableTable type inOptiqSchema.TableEntry
• [CALCITE-225]Optiq doesn’t correctly decorrelate queries
• Clean up package-info. Remove duplicates in test packages so theydon’t conflict with those in non-test packages.
• Add Pair.adjacents(Iterable).
• [CALCITE-199]Various ANY type conditions aren’t correctly being considered(Jacques Nadeau)
• Add files to .gitignore that shouldn’t be checked in when usingEclipse. (Jacques Nadeau)
• Add class ControlFlowException, and make it base class ofexisting control-flow exception classes.
• [CALCITE-232]Sum and avg of empty set should be null as per SQL specification
• Add SqlUnresolvedFunction, to improve how return type ofuser-defined functions is resolved. (Vladimir Sitnikov)
• [CALCITE-228]Error while compiling generated Java code when using UDF in expression
• [CALCITE-226]User-defined functions should work without explicit schema prefix
• [CALCITE-229]Join between different JDBC schemas not implementable
• [CALCITE-230]RemoveSortRule derives trait set from sort, should derive it from sort’s child
• Test view and sub-query with ORDER BY and LIMIT.
• [CALCITE-223]Add NOTICE and LICENSE files in all generated JAR files
• [CALCITE-209]Consistent strategy for line-endings in testsConvert uses of NL in tests to Linux newline “\n”.This makes string constants simpler.
• [CALCITE-218]Functions case sensitive when using Lex.MYSQL
• Add tests that a query with aggregate expressions in the SELECTclause is considered an aggregate query, even if there is no GROUP BY.
• [CALCITE-216]Inconsistent use of provided operator table causes inability toadd aggregate functions
• [CALCITE-200]Javadoc generation fails under JDK 1.8
• Add class XmlOutput (based on org.eigenbase.xom.XMLOutput) and removedependency on eigenbase-xom.
• Performance: Don’t create stack-trace for exceptions used for control-flow.(Vladimir Sitnikov)
• Performance: Tune RexProgramBuilder by using Pair rather than String asexpression key. (Vladimir Sitnikov)
• Fix NPE using TRIM function with JDBC. (Bruno Dumon)
• Add dependency onhydromatic-resource-maven-pluginand obsolete our copy of the resource framework.
• Fix race condition in SpaceList.
• In planner, use RelTrait.subsumes rather than equals in an assert.(Jinfeng Ni)

0.5 / 2014-03-14

New features

• Allow quoting, quotedCasing, unquotedCasing, and caseSensitiveproperties to be specified explicitly (Vladimir Sitnikov)
• Recognize more kinds of materializations, including filter-on-project (whereproject contains expressions) and some kinds of aggregation.
• [CALCITE-128]Support WITH queries (common table expressions)
• [CALCITE-53]Allow WHEN clause in simple CASE expression to have multiple values
• [CALCITE-156]Optiq should recognize ‘SYSTEM TABLE’, ‘JOIN’, ‘INDEX’ as table types
• Support querying ARRAY columns from JDBC source. (Gabriel Reid)

API changes

• AddProjectRelBase.copy(RelTraitSet, RelNode, List<RexNode>, RelDataType)and make ProjectRelBase.copy(RelTraitSet, RelNode) final.(This is a breaking change for sub-classes of ProjectRelBase.)
• Change RexBuilder.makeRangeReference parameter type.
• RexBuilder.makeInputRef replaces RelOptUtil.createInputRef.
• [CALCITE-160]Allow comments in schema definitions
• [CALCITE-147]Create a new kind of SqlCall that keeps operands in fields, not an operandsarray
  • Very widely used parse tree nodes with complex operands, includingSqlSelect, SqlJoin, SqlInsert, and a new node type SqlOrderBy, arenow sub-classes of SqlCall but not SqlBasicCall.
  • (This is a breaking change to code that assumes that, say,SqlSelect has an operands field.)
• Convert all enum constants to upper-case.(This is a breaking change.)

Bug-fixes and internal changes

• Generate optiq-core-VERSION-tests.jar not parent-VERSION-tests.jar.
• [CALCITE-176]ORDER BY expression doesn’t work with SELECT *
• Fix VARCHAR casts sent to hsqldb source (Bruno Dumon)
• [CALCITE-143]Remove dependency on eigenbase-resgen
• [CALCITE-173]Case-insensitive table names are not supported for Casing.UNCHANGED
• DATE.getLimit now returns Calendar in GMT time zone (Vladimir Sitnikov)
• Set en_US locale in tests that match against error numbers, dates(Vladimir Sitnikov)
• Use 1 test thread per CPU to avoid thread starvation on dual core CPUs(Vladimir Sitnikov)
• [CALCITE-174]Move hsqldb to test scope
• Add unit tests for RexExecutorImpl.
• Correct JSON model examples in Javadoc comments. (Karel Vervaeke)
• Move test reference logs from src/test/java to src/test/resources(reduces the number of ‘untracked files’ reported by git)
• Tune Util.SpaceList, fix race condition, and move into new utility classSpaces.
• [CALCITE-163]Equi-join warning
• [CALCITE-157]Handle SQLFeatureNotSupported when calling setQueryTimeout(Karel Vervaeke)
• Fix Optiq on Windows. (All tests and checkstyle checks pass.)
• In checkstyle, support Windows-style file separator, otherwise build fails inWindows due to suppressions not used. (Vladimir Sitnikov)
• Enable MongoDB tests when -Dcalcite.test.mongodb=true.
• Cleanup cache exception-handling and an assert.
• [CALCITE-153]Error using MongoDB adapter: Failed to set setXIncludeAware(true)
• Disable spark engine unless Spark libraries are on the class path andspark=true is specified in the connect string.
• Fix path to mongo-zips-model.json in HOWTO. (Mariano Luna)
• Fix bug deriving the type of a join-key.
• Fix the value of ONE_MINUS_EPSILON.
• [CALCITE-158]Optiq fails when call Planner.transform() multiple times, each withdifferent ruleset
• [CALCITE-148] Less verbose description of collation. Also, optimize RelTraitSet creation and amortize RelTraitSet.toString().
• Add generics to SQL parser.
• [CALCITE-145]Unexpected upper-casing of keywords when using java lexer
• Remove duplicate maven-source-plugin.
• [CALCITE-141]Downgrade to guava-11.0.2. (This is necessary for Hadoop compatibility.Later versions of Guava can also be used.)
• Upgrade to spark-0.9.0. (Because this version of spark is available frommaven-central, we can make optiq-spark part of the regular build, and removethe spark profile.)

0.4.18 / 2014-02-14

API and functionality changes

• Configurable lexical policy
  • [CALCITE-33]SQL parser should allow different identifier quoting
  • [CALCITE-34]Policy for case-sensitivity of identifiers should be configurable
  • New connect-string parameter “lex”, with allowable values“ORACLE”, “MYSQL”, “SQL_SERVER”, “JAVA” sets policy to be like thosedatabases, in terms of quote string, whether quoted and unquotedidentifiers are converted to upper/lower case, and whetheridentifiers are matched case-sensitively. “JAVA” is case-sensitive,even for unquoted identifiers. It should be possiblefor each connection to have its own settings for these. Objectsshared between sessions (views, materialized views) mightrequire more work.
  • Added various internals to make it easy for developers to do theright thing. When you need to look up a schema, table orcolumn/field name, you should use a catalog reader, and it willapply the right case-sensitivity policy.
  • Enable optiq consumer to utilize different lexical settings inFrameworks/Planner. (Jacques Nadeau)
• [CALCITE-115]Add a PARSE_TREE hook point with SqlNode parameter
• Change planner rules to use ProjectFactory for creatingprojects. (John Pullokkaran)
• [CALCITE-131]Add interfaces for metadata (statistics)(This is a breaking change.)
• Update Avatica to allow Cursor & Accessor implementations to throwSQLException. (Jacques Nadeau)
• Separate cost model (RelOptCostFactory) from planner. AllowVolcanoPlanner to be sub-classed with different cost factory.
  • Remove references to VolcanoCost from RelSubset, so clients canuse a different RelOptCost. (Harish Butani)
  • Make VolcanoCost immutable.
• Break SqlTypeStrategies into OperandTypes, ReturnTypes andInferTypes, and rename its static members to upper-case, percheckstyle. (This is a breaking change.)
• Add a mechanism for defining configuration parameters and have themappear in the responses to AvaticaDatabaseMetaData methods.
• [CALCITE-113]User-defined scalar functions
• Add rules to short-cut a query if LIMIT 0 is present. Also removesort, aggregation, join if their inputs are known to be empty, andpropagate the fact that the relational expressions are known to beempty up the tree. (We already do this for union, filter, project.)
• RexNode and its sub-classes are now immutable.

Bug-fixes and internal changes

• [CALCITE-16]Upgrade to janino-2.7
• Upgrade to guava-15.0 (guava-14.0.1 still allowed), sqlline-1.1.7,maven-surefire-plugin-2.16, linq4j-0.1.13.
• [CALCITE-136]Support Hive dialect
• [CALCITE-138]SqlDataTypeSpec.clone handles collection types wrong
• [CALCITE-137]If a subset is created that is subsumed by an existing subset, its‘best’ is not assigned
  • If best rel in a Volcano subset doesn’t have metadata, see ifother rels have metadata.
• [CALCITE-127]EnumerableCalcRel can’t support 3+ AND conditions (Harish Butani)
• Fix push-down of datetime literals to JDBC data sources.
• Add Util.startsWith(List, List) and Util.hashCode(double).
• Add maven-checkstyle-plugin, enable in “verify” phase, and fix exceptions.
• Fix SqlValidator to rely on RelDataType to do field name matching. FixRelDataTypeImpl to correctly use the case sensitive flag rather thanignoring it.
• [CALCITE-119]Comparing Java type long with SQL type INTEGER gives wrong answer
• Enable multi-threaded testing, and fix race conditions.
  • Two of the race conditions involved involving trait caches. Theother was indeterminacy in type system when precision was notspecified but had a default; now we canonize TIME to TIME(0), forinstance.
• Convert files to us-ascii.
• Work around[JANINO-169].
• Refactor SQL validator testing infrastructure so SQL parser isconfigurable.
• Add optiq-mat-plugin to README.
• Fix the check for duplicate subsets in a rule match.
• [CALCITE-112]Java boolean column should be treated as SQL boolean
• Fix escaped unicode characters above 0x8000. Add tests for unicodestrings.

0.4.17 / 2014-01-13

API changes

• [CALCITE-106]Make Schema and Table SPIs simpler to implement, and make themre-usable across connections(This is a breaking change.)
• Make it easier to define sub-classes of rule operands. The new classRelOptRuleOperandChildren contains the children of an operand andthe policy for dealing with them. Existing rules now use the newmethods to construct operands: operand(), leaf(), any(), none(),unordered(). The previous methods are now deprecated and will beremoved before 0.4.18. (This is a breaking change.)
• [CALCITE-101]Enable phased access to the Optiq engine
• List-handling methods in Util: add methods skipLast, last, skip;remove subList, butLast.
• Convert SqlIdentifier.names from String[] to ImmutableList<String>.
• Rename OptiqAssert.assertThat() to that(), to avoid clash with junit’sAssert.assertThat().
• Usability improvements for RelDataTypeFactory.FieldInfoBuilder. Itnow has a type-factory, so you can just call build().
• Rework HepProgramBuilder into a fluent API.
• [CALCITE-105]Externalize RelNode to and from JSON

Tuning

• If EnumerableAggregateRel has no aggregate functions, generate a call to Enumerable.distinct(), thereby saving the effort of building trivial accumulators.
• Default rule set now does not introduce CalcRel until a later phaseof planning. This reduces the number of trivial projects and calcscreated, merged, and elimated.
• Reduce the amount of time spent creating record types thatalready exist.
• More efficient implementation of Util.isDistinct for small lists.
• When an internal record has 0 fields, rather than generating asynthetic class and lots of instances that are all the same, use thenew Unit class, which is a singleton.
• To take advantage of asymmetric hash join added recently in linq4j,tweak cost of EnumerableJoinRel so that join is cheaper if thelarger input is on the left, and more expensive if it is a cartesianproduct.
• [CALCITE-70]Joins seem to be very expensive in memory
• Make planning process more efficient by not sorting the list ofmatched rules each cycle. It is sorted if tracing is enabled;otherwise we scan to find the most important element. For this list,replace LinkedList with ChunkList, which has an O(1) remove and add,a fast O(n) get, and fast scan.

Other

• [CALCITE-87]Constant folding
  • Rules for constant-expression reduction, and to simplify/eliminateVALUES operator.
• Graph algorithms: Implement breadth-first iterator and cycle-detector.
• Fix bug in planner which occurred when two RelNodes have identicaldigest but different row-type.
• Fix link to optiq-csv tutorial.
• Fix bugs in RemoveTrivialProjectRule.strip, JdbcProjectRel.implementand SortRel.computeSelfCost.
• Reformat code, and remove @author tags.
• Upgrade to eigenbase-xom-1.3.4, eigenbase-properties-1.1.4,eigenbase-resgen-1.3.6.
• Upgrade to linq4j-0.1.12.
• [CALCITE-97]Correlated EXISTS
• Fix a bug in VolcanoCost.
• Add class FoodMartQuerySet, that contains the 6,700 foodmart queries.
• Fix factory class names in UnregisteredDriver
• [CALCITE-96]LIMIT against a table in a clone schema causes UnsupportedOperationException
• Disable spark module by default.
• Allow CloneSchema to be specified in terms of url, driver, user,password; not just dataSource.
• Wrap internal error in SQLException.

0.4.16 / 2013-11-24

• [CALCITE-69]Can’t join on string columns and other problems with expressions in the joincondition
• [CALCITE-74]JOIN … USING fails in 3-way join with UnsupportedOperationException.
• [CALCITE-65]Fix issues in the JDBC driver, and in particular to DatabaseMetaData methods,to make Squirrel-SQL run better.
• Fix JDBC column, table, schema names for when the table is not in a schema ofdepth 1.
• [CALCITE-85]Adding a table to the root schema causes breakage in OptiqPrepareImpl
• [CALCITE-84]Extract Optiq’s JDBC driver as a new JDBC driver framework, Avatica.Other projects can use this to implement a JDBC driver by implementingjust a few methods. If you wish to use Optiq’s JDBC driver, you willnow need to include optiq-avatica.jar in addition to optiq-core.jar.Avatica does not depend on anything besides the standard Java library.
• Support for parameters in PreparedStatement.
• First steps in recognizing complex materializations. Internally we introduce aconcept called a “star table”, virtual table composed of real tables joinedtogether via many-to-one relationships. The queries that definematerializations and end-user queries are canonized in terms of star tables.Matching (not done yet) will then be a matter of looking for sort, groupBy,project. It is not yet possible to define a star in an Optiq model file.
• Add section to HOWTOon implementing adapters.
• Fix data type conversions when creating a clone table in memory.
• Fix how strings are escaped in JsonBuilder.
• Test suite now depends on an embedded hsqldb database, so you can runmvn test right after pulling from git. You can instead use aMySQL database if you specify ‘-Dcalcite.test.db=mysql’, but you need tomanually populate it.
• Fix a planner issue which occurs when the left and right children of join arethe same relational expression, caused by a self-join query.
• [CALCITE-76]Precedence of the item operator, map[index]; remove the spacebefore ‘[’ when converting parse tree to string.
• Allow CAST(expression AS ANY), and fix an issue with the ANY typeand NULL values.
• Handle null timestamps and dates coming out of JDBC adapter.
• Add jdbcDriver attribute to JDBC schema in model, for driversthat do not auto-register.
• Allow join rules to match any subclass of JoinRelBase.
• Push projects, filters and sorts down to MongoDB. (Fixes[CALCITE-57],[CALCITE-60] and[CALCITE-72].)
• Add instructions for loading FoodMart data set into MongoDB, and how to enabletracing.
• Now runs on JDK 1.8 (still runs on JDK 1.6 and JDK 1.7).
• Upgrade to junit-4.11 (avoiding the dodgy junit-4.1.12).
• Upgrade to linq4j-0.1.11.

0.4.15 / 2013-10-14

• Lots of good stuff that this margin is too small to contain. SeeSQL language reference andJSON model reference.

Optiq-csv release history

Optiq-csv-0.3 was the last independent release of optiq-csv. Fromcalcite-0.9.2 onwards, the code was included as thecalcite-example-csv module.

• Upgrade to calcite-0.9.1
• Support gzip-compressed CSV and JSON files (recognized by ‘.gz’ suffix)
• Cleanup, and fix minor timezone issue in a test
• Support for date types (date, time, timestamp) (Martijn van den Broek)
• Upgrade to optiq-0.8, optiq-avatica-0.8, linq4j-0.4
• Add support for JSON files (recognized by ‘.json’ suffix)
• Upgrade maven-release-plugin to version 2.4.2
• Upgrade to optiq-0.6, linq4j-0.2
• Add NOTICE and LICENSE files in generated JAR file

0.3 / 2014-03-21

• Upgrade to optiq-0.5
• Add workaround to[JLINE2-62]to sqlline.bat (windows) and sqlline (windows using cygwin)
• Fix classpath construction: sqlline.bat copies dependencies totarget/dependencies; sqlline constructs target/classpath.txt
• Build, checkstyle and tests now succeed on windows (both native and cygwin)
• Models can now contain comments
• [OPTIQ-CSV-2]Update tutorial to reflect changes to Optiq’s JDBC adapter

0.2 / 2014-02-18

• Add test case for[CALCITE-112]
• Add sqlline.bat, Windows SQL shell (based on fix for[DRILL-338])
• Upgrade to optiq-0.4.18, sqlline-1.1.7
• Return a single object for single-col enumerator (Gabriel Reid)
• Enable maven-checkstyle-plugin; fix checkstyle exceptions

0.1 / 2014-01-13

• Add release notes and history
• Enable maven-release-plugin
• Upgrade to optiq-0.4.17, linq4j-0.1.12, sqlline-1.1.6
• Upgrade tutorial for new Schema and Table SPIs
• Fixes for optiq SPI changes in[CALCITE-106]
• Enable oraclejdk8 in Travis CI
• Fix bug where non-existent directory would give NPE; instead print warning
• Add an example of a planner rule
• Add CsvTableFactory, an example of a custom table
• Add a view to tutorial
• Split into scenario with a “simple” schema that generates tables(CsvTable) that just execute and a “smart” schema that generatestables (CsvSmartTable) that undergo optimization
• Make CsvEnumerator a top-level class
• Implement the algorithms to sniff names and types from the firstrow, and to return an enumerator of all rows
• Read column types from header of CSV file

Linq4j release history

Linq4j-0.4 was the last independent release of linq4j. Fromcalcite-0.9.2 onwards, the code was included as calcite-linq4j, andfeatures added to linq4j in a particular calcite release are describedwith the other changes in that release.

0.4 / 2014-05-28

• Fix #27,“Incorrectly inlines non-final variable”.
• Maven build process now deploys web site.
• Implement Enumerable methods: any, all,contains with EqualityComparer, first, first with predicate.

0.3 / 2014-04-21

• Move optimizer visitor from optiq to linq4j; addExpressionType.modifiesLvalue to avoid invalid inlining.
• Fix #17,“Assign constant expressions to ‘static final’ members”;add @Deterministic annotation to help deduce which expressions areconstant.
• Multi-pass optimization: some of the variables might be avoided andinlined after the first pass.
• Various other peephole optimizations: Boolean.valueOf(const),‘not’ expressions (!const, !!a, !(a==b), !(a!=b), !(a>b),etc.),‘?’ expressions coming from CASE (a ? booleanConstant : b and a? b : booleanConstant).
• Implement left, right and full outer join.
• Clean build on cygwin/Windows.

0.2 / 2014-04-11

• Fix #8,“Javadoc generation fails under JDK 1.8”.
• Fix #15,“Expressions.ifThenElse does not work”.
• Use HashMap for searching of declarations to reuse; consider bothoptimizing and optimize flags when reusing.
• Implement equals and hashCode for expressions. Hash codes forcomplex expressions are cached into a field of the expression.
• Add example, com.example.Linq4jExample.
• Fix optimizing away parameter declarations in assignment target.
• Support Windows path names in checkstyle-suppresions.
• Support Statement.toString via ExpressionWriter.
• Use AtomicInteger for naming of ParameterExpressions to avoidconflicts in multithreaded usage
• Cleanup: use Functions.adapt rather than new AbstractList
• Add NOTICE and LICENSE files in generated JAR file.
• Optimize select() if selector is identity.
• Enable checkstyle.

0.1.13 / 2014-01-20

• Remove spurious “null” generated when converting expression to string.
• Allow a field declaration to not have an initializer.
• Add Primitive.defaultValue.
• Enable oraclejdk8 in Travis CI.

0.1.12 / 2013-12-07

• Add release notes.
• Fix implementation of Enumerable.asEnumerable inDefaultQueryable (inherited by most classes that implementQueryable).

0.1.11 / 2013-11-06

• Initial commit