Programming - Native API

Dependencies

  • JDK >= 1.8
  • Maven >= 3.1

How to install in local maven repository

In root directory:

mvn clean install -pl session -am -DskipTests

Using IoTDB Native API with Maven

  1. <dependencies>
  2.     <dependency>
  3.       <groupId>org.apache.iotdb</groupId>
  4.       <artifactId>iotdb-session</artifactId>
  5.       <version>0.11.1</version>
  6.     </dependency>
  7. </dependencies>

Native APIs

Here we show the commonly used interfaces and their parameters in the Native API:

  • Initialize a Session

    1. Session(String host, int rpcPort)
    3. Session(String host, String rpcPort, String username, String password)
    5. Session(String host, int rpcPort, String username, String password)

  • Open a Session

    1. Session.open()

  • Close a Session

    1. ​Session.close()

  • Set storage group

    1. void setStorageGroup(String storageGroupId)

    ​

  • Delete one or several storage groups

    1. void deleteStorageGroup(String storageGroup)
    2. void deleteStorageGroups(List<String> storageGroups)

  • Create one or multiple timeseries

    1. void createTimeseries(String path, TSDataType dataType,
    2.         TSEncoding encoding, CompressionType compressor, Map<String, String> props,
    3.         Map<String, String> tags, Map<String, String> attributes, String measurementAlias)
    5. void createMultiTimeseries(List<String> paths, List<TSDataType> dataTypes,
    6.         List<TSEncoding> encodings, List<CompressionType> compressors,
    7.         List<Map<String, String>> propsList, List<Map<String, String>> tagsList,
    8.         List<Map<String, String>> attributesList, List<String> measurementAliasList)

  • Delete one or several timeseries

    1. void deleteTimeseries(String path)
    2. void deleteTimeseries(List<String> paths)

  • Delete data before or equal to a timestamp of one or several timeseries

    1. void deleteData(String path, long time)
    2. void deleteData(List<String> paths, long time)

  • Insert a Record，which contains multiple measurement value of a device at a timestamp. Without type info the server has to do type inference, which may cost some time

    1. void insertRecord(String deviceId, long time, List<String> measurements, List<String> values)

  • Insert a Tablet，which is multiple rows of a device, each row has the same measurements

    1. void insertTablet(Tablet tablet)

  • Insert multiple Tablets

    1. void insertTablets(Map<String, Tablet> tablet)

  • Insert multiple Records. Without type info the server has to do type inference, which may cost some time

    1. void insertRecords(List<String> deviceIds, List<Long> times, 
    2.                      List<List<String>> measurementsList, List<List<String>> valuesList)

  • Insert a Record，which contains multiple measurement value of a device at a timestamp. With type info the server has no need to do type inference, which leads a better performance

    1. void insertRecord(String deviceId, long time, List<String> measurements,
    2.      List<TSDataType> types, List<Object> values)

  • Insert multiple Records. With type info the server has no need to do type inference, which leads a better performance

    1. void insertRecords(List<String> deviceIds, List<Long> times,
    2.       List<List<String>> measurementsList, List<List<TSDataType>> typesList,
    3.       List<List<Object>> valuesList)

Native APIs for profiling network cost

  • Test the network and client cost of insertRecords. This method NOT insert data into database and server just return after accept the request, this method should be used to test other time cost in client

    1. void testInsertRecords(List<String> deviceIds, List<Long> times,
    2.                 List<List<String>> measurementsList, List<List<String>> valuesList)

    or

    1. void testInsertRecords(List<String> deviceIds, List<Long> times,
    2.       List<List<String>> measurementsList, List<List<TSDataType>> typesList,
    3.       List<List<Object>> valuesList)

  • Test the network and client cost of insertRecord. This method NOT insert data into database and server just return after accept the request, this method should be used to test other time cost in client

    1. void testInsertRecord(String deviceId, long time, List<String> measurements, List<String> values)

    or

    1. void testInsertRecord(String deviceId, long time, List<String> measurements,
    2.       List<TSDataType> types, List<Object> values)

  • Test the network and client cost of insertTablet. This method NOT insert data into database and server just return after accept the request, this method should be used to test other time cost in client

    1. void testInsertTablet(Tablet tablet)

Sample code

To get more information of the following interfaces, please view session/src/main/java/org/apache/iotdb/session/Session.java

The sample code of using these interfaces is in example/session/src/main/java/org/apache/iotdb/SessionExample.java，which provides an example of how to open an IoTDB session, execute a batch insertion.

Session Pool for Native API

We provide a connection pool (`SessionPool) for Native API. Using the interface, you need to define the pool size.

If you can not get a session connection in 60 seconds, there is a warning log but the program will hang.

If a session has finished an operation, it will be put back to the pool automatically. If a session connection is broken, the session will be removed automatically and the pool will try to create a new session and redo the operation.

For query operations:

  1. When using SessionPool to query data, the result set is SessionDataSetWrapper;
  2. Given a SessionDataSetWrapper, if you have not scanned all the data in it and stop to use it, you have to call SessionPool.closeResultSet(wrapper) manually;
  3. When you call hasNext() and next() of a SessionDataSetWrapper and there is an exception, then you have to call SessionPool.closeResultSet(wrapper) manually;
  4. You can call getColumnNames() of SessionDataSetWrapper to get the column names of query result;

Examples: session/src/test/java/org/apache/iotdb/session/pool/SessionPoolTest.java

Or example/session/src/main/java/org/apache/iotdb/SessionPoolExample.java

0.9-0.10 Session Interface Updates

Significant chages are made in IoTDB session of version 0.10 compared to version 0.9. A large numbers of new interfaces are added, and some old interfaces have new names or parameters. Besides, all exceptions thrown by session interfaces are changed from IoTDBSessionExeception to IoTDBConnectionException or StatementExecutionExeception. The detailed modifications are listed as follows.

Method name modifications

insert()

Insert a Record，which contains deviceId, timestamp of the record and multiple measurement values

  1. void insert(String deviceId, long time, List<String> measurements, List<String> values)

The method name has been changed to insertRecord() in 0.10 version

  1. void insertRecord(String deviceId, long time, List<String> measurements, List<String> values)

insertRowInBatch()

Insert multiple Records, which contains all the deviceIds, timestamps of the records and multiple measurement values

  1. void insertRowInBatch(List<String> deviceIds, List<Long> times, List<List<String>> measurementsList,   
  2.                       List<List<String>> valuesList)

The method name has been changed to insertRecords() in 0.10 version

  1. void insertRecords(List<String> deviceIds, List<Long> times, List<List<String>> measurementsList, 
  2.                    List<List<String>> valuesList)

insertBatch()

In 0.9, insertBatch is used for insertion in terms of “RowBatch” structure.

  1. void insertBatch(RowBatch rowBatch)

As “Tablet” replaced “RowBatch” in 0.10, the name has been changed to insertTablet()

  1. void insertTablet(Tablet tablet)

testInsertRow()

To test the responsiveness of insertRow()

  1. void testInsertRow(String deviceId, long time, List<String> measurements, List<String> values)

The method name has been changed to testInsertRecord() in 0.10 version

  1. void testInsertRecord(String deviceId, long time, List<String> measurements, List<String> values)

testInsertRowInBatch()

To test the responsiveness of insertRowInBatch()

  1. void testInsertRowInBatch(List<String> deviceIds, List<Long> times, List<List<String>> measurementsList, 
  2.                           List<List<String>> valuesList)

The method name has been changed to testInsertRecords() in 0.10 version

  1. void testInsertRecords(List<String> deviceIds, List<Long> times, List<List<String>> measurementsList, 
  2.                        List<List<String>> valuesList)

testInsertBatch

To test the responsiveness of insertBatch()

  1. void testInsertBatch(RowBatch rowBatch)

The method name has been changed to testInsertTablet() in 0.10 version

  1. void testInsertTablet(Tablet tablet)

New Interfaces

  1. void open(boolean enableRPCCompression)

Open a session, with a parameter to specify whether to enable RPC compression. Please pay attention that this RPC compression status of client must comply with the status of IoTDB server

  1. void insertRecord(String deviceId, long time, List<String> measurements,
  2.       List<TSDataType> types, List<Object> values)

Insert one record, in a way that user has to provide the type information of each measurement, which is different from the original insertRecord() interface. The values should be provided in their primitive types. This interface is more proficient than the one without type parameters.

  1. void insertRecords(List<String> deviceIds, List<Long> times, List<List<String>> measurementsList, 
  2.                    List<List<TSDataType>> typesList, List<List<Object>> valuesList)

Insert multiple records with type parameters. This interface is more proficient than the one without type parameters.

  1. void insertTablet(Tablet tablet, boolean sorted)

An additional insertTablet() interface that providing a “sorted” parameter indicating if the tablet is in order. A sorted tablet may accelerate the insertion process.

  1. void insertTablets(Map<String, Tablet> tablets)

A new insertTablets() for inserting multiple tablets.

  1. void insertTablets(Map<String, Tablet> tablets, boolean sorted)

insertTablets() with an additional “sorted” parameter.

  1. void testInsertRecord(String deviceId, long time, List<String> measurements, List<TSDataType> types, 
  2.                       List<Object> values)
  3. void testInsertRecords(List<String> deviceIds, List<Long> times, List<List<String>> measurementsList, 
  4.                       List<List<TSDataType>> typesList, List<List<Object>> valuesList)
  5. void testInsertTablet(Tablet tablet, boolean sorted)
  6. void testInsertTablets(Map<String, Tablet> tablets)
  7. void testInsertTablets(Map<String, Tablet> tablets, boolean sorted)

The above interfaces are newly added to test responsiveness of new insert interfaces.

  1. void createTimeseries(String path, TSDataType dataType, TSEncoding encoding, CompressionType compressor,     
  2.                       Map<String, String> props, Map<String, String> tags, Map<String, String> attributes, 
  3.                       String measurementAlias)

Create a timeseries with path, datatype, encoding and compression. Additionally, users can provide props, tags, attributes and measurementAlias。

  1. void createMultiTimeseries(List<String> paths, List<TSDataType> dataTypes, List<TSEncoding> encodings, 
  2.                            List<CompressionType> compressors, List<Map<String, String>> propsList, 
  3.                            List<Map<String, String>> tagsList, List<Map<String, String>> attributesList, 
  4.                            List<String> measurementAliasList)

Create multiple timeseries with a single method. Users can provide props, tags, attributes and measurementAlias as well for detailed timeseries information.

  1. boolean checkTimeseriesExists(String path)

Add a method to check whether the specific timeseries exists.