What is Citus?
Citus is an open source extension to Postgres that distributes data and queries across multiple nodes in a cluster. Because Citus is an extension (not a fork) to Postgres, when you use Citus, you are also using Postgres. You can leverage the latest Postgres features, tooling, and ecosystem.
Citus transforms Postgres into a distributed database with features like sharding, a distributed SQL engine, reference tables, and distributed tables. The Citus combination of parallelism, keeping more data in memory, and higher I/O bandwidth can lead to significant performance improvements for multi-tenant SaaS applications, customer-facing real-time analytics dashboards, and time series workloads.
Three Ways to Get Citus:
Open source: You can download Citus open source, or visit the Citus repo on GitHub.
Enterprise software: Citus Enterprise is available as a software subscription along with 24x7 support, for those who want to manage Citus manually.
Managed database service: Citus is available on Azure as Hyperscale (Citus), a built-in deployment option in the Azure Database for PostgreSQL managed service.
How Far Can Citus Scale?
Citus scales horizontally by adding worker nodes, and vertically by upgrading workers/coordinator. In practice our customers have achieved the following scale, with room to grow even more:
-
- 5-10B rows ingested per day
-
700+ billion events
1.4PB of data on a 70-node Citus database cluster
-
- >2.6B rows of data added per month
-
80B rows updated/day
20-node Citus database cluster on Google Cloud
2.4TB memory, 1280 cores, and 80TB of data
…with plans to grow to 45 nodes
-
- 1.6PB of time series data
For more customers and statistics, see our customer stories.
When to Use Citus
Multi-Tenant Database
Most B2B applications already have the notion of a tenant, customer, or account built into their data model. In this model, the database serves many tenants, each of whose data is separate from other tenants.
Citus provides full SQL coverage for this workload, and enables scaling out your relational database to 100K+ tenants. Citus also adds new features for multi-tenancy. For example, Citus supports tenant isolation to provide performance guarantees for large tenants, and has the concept of reference tables to reduce data duplication across tenants.
These capabilities allow you to scale out your tenants’ data across many machines, and easily add more CPU, memory, and disk resources. Further, sharing the same database schema across multiple tenants makes efficient use of hardware resources and simplifies database management.
Some advantages of Citus for multi-tenant applications:
Fast queries for all tenants
Sharding logic in the database, not the application
Hold more data than possible in single-node PostgreSQL
Scale out without giving up SQL
Maintain performance under high concurrency
Fast metrics analysis across customer base
Easily scale to handle new customer signups
Isolate resource usage of large and small customers
Real-Time Analytics
Citus supports real-time queries over large datasets. Commonly these queries occur in rapidly growing event systems or systems with time series data. Example use cases include:
Analytic dashboards with subsecond response times
Exploratory queries on unfolding events
Large dataset archival and reporting
Analyzing sessions with funnel, segmentation, and cohort queries
Citus’ benefits here are its ability to parallelize query execution and scale linearly with the number of worker databases in a cluster. Some advantages of Citus for real-time applications:
Maintain sub-second responses as the dataset grows
Analyze new events and new data as it happens, in real-time
Parallelize SQL queries
Scale out without giving up SQL
Maintain performance under high concurrency
Fast responses to dashboard queries
Use one database, not a patchwork
Rich PostgreSQL data types and extensions
Considerations for Use
Citus extends PostgreSQL with distributed functionality, but it is not a drop-in replacement that scales out all workloads. A performant Citus cluster involves thinking about the data model, tooling, and choice of SQL features used.
A good way to think about tools and SQL features is the following: if your workload aligns with use-cases described here and you happen to run into an unsupported tool or query, then there’s usually a good workaround.
When Citus is Inappropriate
Some workloads don’t need a powerful distributed database, while others require a large flow of information between worker nodes. In the first case Citus is unnecessary, and in the second not generally performant. Here are some examples:
When single-node Postgres can support your application and you do not expect to grow
Offline analytics, without the need for real-time ingest nor real-time queries
Analytics apps that do not need to support a large number of concurrent users
Queries that return data-heavy ETL results rather than summaries