Subqueries

SQL subqueries enable reuse of the results from a selection query within another query.

Overview

CockroachDB supports two kinds of subqueries:

Data writes in subqueries

When a subquery contains a data-modifying statement (INSERT,DELETE, etc.), the data modification is always executed tocompletion even if the surrounding query only uses a subset of theresult rows.

This is true both for subqueries defined using the (…) or […]notations, and those defined usingWITH.

For example:

  1. > SELECT *
  2.    FROM [INSERT INTO t(x) VALUES (1), (2), (3) RETURNING x]
  3.   LIMIT 1;

This query always inserts 3 rows into t, even though the surroundingquery only observes 1 row using LIMIT.

Correlated subqueries

New in v19.1: CockroachDB's cost-based optimizer supports most correlated subqueries.

A subquery is said to be "correlated" when it uses table or column names defined in the surrounding query.

For example, to find every customer with at least one order, run:

  1. > SELECT
  2.       c.name
  3.   FROM
  4.       customers AS c
  5.   WHERE
  6.       EXISTS(
  7.           SELECT * FROM orders AS o WHERE o.customer_id = c.id
  8.       );

The subquery is correlated because it uses c defined in the surrounding query.

Limitations

The cost-based optimizer supports most correlated subqueries, with the following exceptions:

  • Correlated subqueries that generate side effects inside a CASE statement.

  • Correlated subqueries that result in implicit LATERAL joins. Given a cross-join expression a,b, if b is an application of a set-returning function that references a variable defined in the surrounding query, the LATERAL keyword is assumed as shown below.

  1. > SELECT
  2.       e.last_name, s.salary, noise
  3.   FROM
  4.       employees AS e,
  5.       salaries AS s,
  6.       -- Join with a set-returning function implies LATERAL below
  7.       generate_series(0, s.salary, 10000) AS noise
  8.   WHERE
  9.       e.emp_no = s.emp_no
  10.   ORDER BY
  11.       s.salary DESC
  12.   LIMIT
  13.       10;
  1. ERROR:  no data source matches prefix: s

For more information, see the Github issue tracking LATERAL join implementation.

Note that the example above uses the employees data set that is also used in our Migrate from MySQL instructions (and the MySQL docs).

Note:

If you come across an unsupported correlated subquery other than those described above, please file a Github issue.

Performance best practices

Note:

CockroachDB is currently undergoing major changes to evolve and improve the performance of subqueries. The restrictions and workarounds listed in this section will be lifted or made unnecessary over time.

  • Scalar subqueries currently disable the distribution of the execution of a query. To ensure maximum performance on queries that process a large number of rows, make the client application compute the subquery results ahead of time and pass these results directly in the surrounding query.

  • The results of scalar subqueries are currently loaded entirely into memory when the execution of the surrounding query starts. To prevent execution errors due to memory exhaustion, ensure that subqueries return as few results as possible.

See also

Was this page helpful?
YesNo