Indexes
Indexes improve your database's performance by helping SQL locate data without having to look through every row of a table.
How do indexes work?
When you create an index, CockroachDB "indexes" the columns you specify, which creates a copy of the columns and then sorts their values (without sorting the values in the table itself).
After a column is indexed, SQL can easily filter its values using the index instead of scanning each row one-by-one. On large tables, this greatly reduces the number of rows SQL has to use, executing queries exponentially faster.
For example, if you index an INT
column and then filter it WHERE <indexed column> = 10
, SQL can use the index to find values starting at 10 but less than 11. In contrast, without an index, SQL would have to evaluate every row in the table for values equaling 10. This is also known as a "full table scan", and it can be very bad for query performance.
Creation
Each table automatically has an index created called primary
, which indexes either its primary key or—if there is no primary key—a unique value for each row known as rowid
. We recommend always defining a primary key because the index it creates provides much better performance than letting CockroachDB use rowid
.
The primary
index helps filter a table's primary key but doesn't help SQL find values in any other columns. However, you can use secondary indexes to improve the performance of queries using columns not in a table's primary key. You can create them:
- At the same time as the table with the
INDEX
clause ofCREATE TABLE
. In addition to explicitly defined indexes, CockroachDB automatically creates secondary indexes for columns with theUNIQUE
constraint. - For existing tables with
CREATE INDEX
. - By applying the
UNIQUE
constraint to columns withALTER TABLE
, which automatically creates an index of the constrained columns.
To create the most useful secondary indexes, you should also check out our best practices.
Selection
Because each query can use only a single index, CockroachDB selects the index it calculates will scan the fewest rows (i.e., the fastest). For more detail, check out our blog post Index Selection in CockroachDB, which will show you how to use the EXPLAIN
statement for your query to see which index is being used.
To override CockroachDB's index selection, you can also force queries to use a specific index (also known as "index hinting").
Storage
CockroachDB stores indexes directly in your key-value store. You can find more information in our blog post Mapping Table Data to Key-Value Storage.
Locking
Tables are not locked during index creation thanks to CockroachDB's schema change procedure.
Performance
Indexes create a trade-off: they greatly improve the speed of queries, but may slightly slow down writes to an affected column (because new values have to be written for both the table and the index).
To maximize your indexes' performance, we recommend following a few best practices.
Best practices
We recommend creating indexes for all of your common queries. To design the most useful indexes, look at each query's WHERE
and FROM
clauses, and create indexes that:
- Index all columns in the
WHERE
clause. - Store columns that are only in the
FROM
clause.
Tip:
For more information about how to tune CockroachDB's performance, see SQL Performance Best Practices and the Performance Tuning tutorial.
Indexing columns
When designing indexes, it's important to consider which columns you index and the order you list them. Here are a few guidelines to help you make the best choices:
- Each table's primary key (which we recommend always defining) is automatically indexed. The index it creates (called
primary
) cannot be changed, nor can you change the primary key of a table after it's been created, so this is a critical decision for every table. - Queries can benefit from an index even if they only filter a prefix of its columns. For example, if you create an index of columns
(A, B, C)
, queries filtering(A)
or(A, B)
can still use the index. However, queries that do not filter(A)
will not benefit from the index.This feature also lets you avoid using single-column indexes. Instead, use the column as the first column in a multiple-column index, which is useful to more queries. - Columns filtered in the
WHERE
clause with the equality operators (=
orIN
) should come first in the index, before those referenced with inequality operators (<
,>
). - Indexes of the same columns in different orders can produce different results for each query. For more information, see our blog post on index selection—specifically the section "Restricting the search space."
Storing columns
Storing a column optimizes the performance of queries that retrieve its values (i.e., in the FROM
clause) but do not filter them. This is because indexing values is only useful when they're filtered, but it's still faster for SQL to retrieve values in the index it's already scanning rather than reaching back to the table itself.
However, for SQL to use stored columns, queries must filter another column in the same index.
Example
If you wanted to optimize the performance of the following queries:
> SELECT col1 FROM tbl WHERE col1 = 10;
> SELECT col1, col2, col3 FROM tbl WHERE col1 = 10 AND col2 > 1;
You could create a single index of col1
and col2
that stores col3
:
> CREATE INDEX ON tbl (col1, col2) STORING (col3);