Introduction
Fixstars recently performed benchmarks that compared time series databases GridDB and InfluxDB using one AWS instance with a CentOS 6.9 image. The tests were done using YCSB-TS framework, a fork of YCSB benchmarking tool meant for testing Time Series databases. The tests were ran with two datasets: one which could be held primarily in-memory (100M records) and one that would require performing disk I/O (400M records).
Benchmark Results
GridDB’s in-memory oriented architecture outperformed InfluxDB by a noticeable margin. The results provide strong evidence of GridDB being the stronger Time Series database. GridDB provided superior performance in both in-memory and out-of-memory operations. Results are shown below.
GridDB proved to be much more scalable than InfluxDB when the size of the database rose from 100M to 400M records. GridDB was able to maintain the same relative LOAD throughput through this increase. As the size of the database grew, GridDB’s LOAD throughput was also over 6 times higher than InfluxDB. GridDB’s read throughput dropped by around 74% while InfluxDB’s throughput dropped by over 81%. When comparing scan performance, GridDB’s throughput dropped by 60% while InfluxDB’s throughput dropped by over 75%.
It is also important to note that on average GridDB used less CPU resources than InfluxDB while still managing to provide higher throughput and lower latencies in query (read and scan queries) operations.
Read Performance
The read phase of our testing on YCSB-TS performed a series of read queries that would search for rows with a specific TIMESTAMP key. These timestamp keys would be generated by YCSB-TS.
When comparing read operations using the 100M record dataset, GridDB had over 8 times the throughput than that InfluxDB. For the 400M record dataset, GridDB had up to 10 times the throughput of InfluxDB.
It should also be noted that GridDB had around 10-11% the latency of InfluxDB for read operations.
Scan Performance
The scan workload would perform a series of general Scan queries or aggregation queries such as AVERAGE, SUM, and COUNT. All scan operations would use a random time-range generated by YCSB-TS.
YCSB-TS measured the throughput for all scan operations (SCAN, COUNT, AVERAGE, SUM) during testing. On the 100 million record dataset, GridDB had around 5 times the throughput of InfluxDB. With a dataset of 400 million records, GridDB maintained 4 times the throughput of InfluxDB.
For general SCAN operations (not an aggregation operation), GridDB had only 13%-26% the latency of InfluxDB. In the case of aggregation operations, GridDB had 15%-26% the latency of InfluxDB.
Testing Process
A single C4.2xLarge AWS instance was used to run both YCSB-TS and the database that was being tested. Benchmarks began by loading a database of either 100 or 400 million 50 byte records into both GridDB and InfluxDB. Once the load phase completed, YCSB-TS would perform a series of read or scan operations. The data would be distributed amongst 8 containers using 128 threads.
Reference
-
The full report detailing the results, methodologies, configurations and practices used for the benchmark test can be found in the full whitepaper.
-
GridDB Community Edition was used for benchmark testing. InfluxDB version 1.3.6 Open-Source Edition was used as the InfluxDB database.
-
InfluxDB is a Time Series database written in Go developed by InfluxData
-
YCSB-TS is a fork of the modular framework YCSB (Yahoo Cloud Serving Benchmark) and was built to test performance of NoSQL Time Series databases (TSDB’s).
-
The connector to YCSB-TS for GridDB was built using GridDB’s Java API.
-
Fixstars also previously completed a GridDB vs. Cassandra Benchmark Comparison. The Summary and Full Report can be found here.
If you have any questions about the blog, please create a Stack Overflow post here https://stackoverflow.com/questions/ask?tags=griddb .
Make sure that you use the “griddb” tag so our engineers can quickly reply to your questions.