Ecosystem Integration

Grafana-IoTDB-Connector

Grafana is an open source volume metrics monitoring and visualization tool, which can be used to display time series data and application runtime analysis. Grafana supports Graphite, InfluxDB and other major time series databases as data sources. IoTDB-Grafana-Connector is a connector which we developed to show time series data in IoTDB by reading data from IoTDB and sends to Grafana(https://grafana.com/Grafana-Connector (Not Recommended) - 图1open in new window). Before using this tool, make sure Grafana and IoTDB are correctly installed and started.

Installation and deployment

Install Grafana

Install data source plugin

After downloading this plugin, use the grafana-cli tool to install SimpleJson from the commandline:

  1. grafana-cli plugins install grafana-simple-json-datasource

Alternatively, manually download the .zip file and unpack it into grafana plugins directory.

  • {grafana-install-directory}\data\plugins\ (Windows)
  • /var/lib/grafana/plugins (Linux)
  • /usr/local/var/lib/grafana/plugins(Mac)

Then you need to restart grafana server, then you can use browser to visit grafana.

If you see “SimpleJson” in “Type” of “Add data source” pages, then it is install successfully.

Or, if you meet following errors:

  1. Unsigned plugins were found during plugin initialization. Grafana Labs cannot guarantee the integrity of these plugins. We recommend only using signed plugins.
  2. The following plugins are disabled and not shown in the list below:

Please try to find config file of grafana(eg. customer.ini in windows, and /etc/grafana/grafana.ini in linux), then add following configuration:

  1. allow_loading_unsigned_plugins = "grafana-simple-json-datasource"

Start Grafana

If Unix is used, Grafana will start automatically after installing, or you can run sudo service grafana-server start command. See more information hereGrafana-Connector (Not Recommended) - 图4open in new window.

If Mac and homebrew are used to install Grafana, you can use homebrew to start Grafana. First make sure homebrew/services is installed by running brew tap homebrew/services, then start Grafana using: brew services start grafana. See more information hereGrafana-Connector (Not Recommended) - 图5open in new window.

If Windows is used, start Grafana by executing grafana-server.exe, located in the bin directory, preferably from the command line. See more information hereGrafana-Connector (Not Recommended) - 图6open in new window.

IoTDB installation

See https://github.com/apache/iotdbGrafana-Connector (Not Recommended) - 图7open in new window

IoTDB-Grafana-Connector installation

  1. git clone https://github.com/apache/iotdb.git

Start IoTDB-Grafana-Connector

  • Option one

Import the entire project, after the maven dependency is installed, directly runiotdb/grafana-connector/rc/main/java/org/apache/iotdb/web/grafanadirectory TsfileWebDemoApplication.java, this grafana connector is developed by springboot

  • Option two

In /grafana/target/directory

  1. cd iotdb
  2. mvn clean package -pl grafana-connector -am -Dmaven.test.skip=true
  3. cd grafana/target
  4. java -jar iotdb-grafana-connector-{version}.war

If following output is displayed, then iotdb-grafana-connector connector is successfully activated.

  1. $ java -jar iotdb-grafana-connector-{version}.war
  3.   .   ____          _            __ _ _
  4.  /\\ / ___'_ __ _ _(_)_ __  __ _ \ \ \ \
  5. ( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \
  6.  \\/  ___)| |_)| | | | | || (_| |  ) ) ) )
  7.   '  |____| .__|_| |_|_| |_\__, | / / / /
  8.  =========|_|==============|___/=/_/_/_/
  9.  :: Spring Boot ::        (v1.5.4.RELEASE)
  10. ...

To configure properties, move the grafana-connector/src/main/resources/application.properties to the same directory as the war package (grafana/target)

Explore in Grafana

The default port of Grafana is 3000, see http://localhost:3000/Grafana-Connector (Not Recommended) - 图8open in new window

Username and password are both “admin” by default.

Add data source

Select Data Sources and then Add data source, select SimpleJson in Type and URL is http://localhost:8888Grafana-Connector (Not Recommended) - 图9open in new window. After that, make sure IoTDB has been started, click “Save & Test”, and “Data Source is working” will be shown to indicate successful configuration. Grafana-Connector (Not Recommended) - 图10

Grafana-Connector (Not Recommended) - 图11

Design in dashboard

Add diagrams in dashboard and customize your query. See http://docs.grafana.org/guides/getting_started/Grafana-Connector (Not Recommended) - 图12open in new window

Grafana-Connector (Not Recommended) - 图13

config grafana

  1. # ip and port of IoTDB 
  2. spring.datasource.url=jdbc:iotdb://127.0.0.1:6667/
  3. spring.datasource.username=root
  4. spring.datasource.password=root
  5. spring.datasource.driver-class-name=org.apache.iotdb.jdbc.IoTDBDriver
  6. server.port=8888
  7. # Use this value to set timestamp precision as "ms", "us" or "ns", which must to be same with the timestamp
  8. # precision of Apache IoTDB engine.
  9. timestamp_precision=ms
  11. # Use this value to set down sampling true/false
  12. isDownSampling=true
  13. # defaut sampling intervals
  14. interval=1m
  15. # aggregation function to use to downsampling the data (int, long, float, double)
  16. # COUNT, FIRST_VALUE, LAST_VALUE, MAX_TIME, MAX_VALUE, AVG, MIN_TIME, MIN_VALUE, NOW, SUM
  17. continuous_data_function=AVG
  18. # aggregation function to use to downsampling the data (boolean, string)
  19. # COUNT, FIRST_VALUE, LAST_VALUE, MAX_TIME, MIN_TIME, NOW
  20. discrete_data_function=LAST_VALUE

The specific configuration information of interval is as follows

<1h: no sampling

1h~1d : intervals = 1m

1d~30d:intervals = 1h

>30d：intervals = 1d

After configuration, please re-run war package

  1. java -jar iotdb-grafana-connector-{version}.war