Bulk Load Overview

MatrixOne supports using the LOAD DATA command to insert many rows into MatrixOne tables and the SOURCE command to import table structures and data into the entire database.

LOAD DATA

MatrixOne supports the LOAD DATA command for importing csv and jsonline files from either the local file system or S3-compatible object storage.

Import the different file types

According to the different file types, MatrixOne currently mainly supports importing .csv or jsonlines:

• For how to import .csv format, see Load csv format data.
• For how to import .jl format, see Load jsonlines format data.

Import data from different data storage locations

According to the different data storage locations, MatrixOne supports importing data from local and importing data from S3(Simple Storage Service).

• For how to import data from local host, see Load csv format data or Load jsonlines format data.
• For how to import data from S3, see Load data from S3.

SOURCE

MatrixOne supports using the SOURCE command to import the entire database structure (including table structures and data) by executing SQL statements from an external SQL script file. The SOURCE command may not perform as well as the LOAD DATA command when processing large amounts of data because it needs to parse and execute each SQL statement.

• Load data by using the source

More import capabilities

• MatrixOne supports the parallel loading of data files: when the data file is large, to improve the loading speed, MatrixOne also supports parallel loading, see the LOAD DATA parameter description for importing data.
• In a MatrixOne distributed cluster, in addition to importing data locally and from the public cloud object storage S3 to MatrixOne, you can also import data through the local Minio component. For details, see Import data from local Minio to MatrixOne