SSB Test Performance

Overview

We present the SSB Test results for MatrixOne with different hardwares and query modes.

For instructions to reproduce the SSB test results listed here, see SSB Test with MatrixOne, and if you fail to achieve similar results, there is likely a problem in either the hardware, workload, or test design.

In v0.2.0, both single table and multiple tables can work in MatrixOne, and we compared results of MatrixOne with other similar database products. Through the clear comparison of the bar chart, you will see that MatrixOne has an obvious advantage in the query processing time.

Recommended server specification: x86 CPU with 16 cores and 64GB memory, with CentOS 7+ OS.

note

The following test results are the average of the three tests in seconds.

In order to show the single-table query performance, we combine five tables into a flat table called lineorder_flat.

Standalone node&Single table

We use standalone service to execute flat table(lineorder_flat) queries with MatrixOne, and compared the results with ClickHouse in the same configuration.
The table lineorder_flat has 600 million rows data and takes up 220 GB of space.

Info

The following server was used: AMD EPYC™ Rome CPU 2.6GHz/3.3GHz, 16 physical cores total, 32 GiB Memory.

Query IDMatrixOne v0.2.0ClickHouse v21.11.4.14
Q22.713.82
Q3.14.235.01
Q3.211.0521.34
Q4.12.943.1
Q4.24.275.32
Q4.316.9126.32
SUM42.1164.91

柱状图

Standalone node&Multiple tables

With a standalone server again, now we execute multiple tables queries on the original tables of SSB Test.
There are 600 million rows of data in all, and the main table takes up 67 GB of space.

Query IDMatrixOne v0.2.0ClickHouse v21.11.4.14Starrocks v1.19.3
Q213.628.0515.83
Q3.112.9427.8116.98
Q3.223.5654.8429.25
Q4.113.9627.216.77
Q4.219.7241.8221.54
Q4.346.0785.9935.95
SUM129.85265.71136.37

柱状图

Cluster&Multiple tables

There are three nodes in the cluster, each of which is installed as standalone version, and process time is shorter than that of standclone node, demonstrating the overall performance will improve as the number of nodes increases.

Query IDMatrixOne v0.2.0Starrocks v1.19.3
Q24.946.08
Q3.15.856.27
Q3.29.679.79
Q4.16.056.87
Q4.26.879.51
Q4.320.115.55
SUM53.4854.07

柱状图

Limitations

We didn’t finished all the quiries of SSB Test in MatrixOne v0.2.0 because:

  • The filter command WHERE is not surpported
  • The table cannot be partitioned currently, so commands as PARTITION series are not surpported

Learn More

This page shows the results of SSB Test with MatrixOne. For information on other benchmarks that are available when trying out MatrixOne, see the following: