JMeter integration with InfluxDB and Grafana

-
JMeter GUI is a huge resource-intensive mode which is meant for test recording, developing and debugging. Executing and monitoring the test/results with GUI becomes very challenging and non-realistic method on massive load. 

When planning to run load tests with massive load, the standard way to use JMeter is in Non-GUI mode (Command Line Interface). By initiating the Run in cmd, users can save resources and ensure their test results are of reliable. 

there is another drawback with JMeter when running JMeter in non-GUI Mode, real-time monitoring of results is not possible as the user have to wait for the test to finish.

Therefore, this article will help you to enable real time monitoring the results of JMeter during the execution done in Non-GUI mode.

By using this method we can obtain:
  • Live results
  • Clear graphs for metrics
  • Ability to compare two or more load tests
  • Stores the monitoring data as long as JMeter results in the same backend
JMeter integration with influxdb and Grafana
JMeter integration with Influxdb and Grafana

Tools used

The following tools are used in JMeter Real Time Monitoring
  • Apache JMeter
  • Influxdb
  • Grafana
Step 1: Install and Configure Influxdb

Influxdb is a time series database (successive measurements made over a time interval) which has inbuilt HTTP-based management console and provides flexible data storage.
                 Example: influxd.exe –config Influxdb.conf


  • Launch Influxdb by running influx.exe file to create the database
  • Once Influx.exe command line interface is opened create new database as shown in the below image
          create database JMeterInflux_Demo

  • Check the database is created successfully or not by running "show databases" command in the same screen

Step 2: Install and Configure Grafana

Grafana is a standard dashboard used for performance monitoring. It needs a data source and is
the reason why it is configured to Influxdb. Grafana makes easy to construct the right queries and
customize the display properties, so that perfect Dashboard can be created.
  • Download Grafana latest version from https://grafana.com/grafana/download
  • Unzip the downloaded file
  • Start Grafana by execution bin/grafana-server.exe
  • Launch Grafana in browser, using http://localhost:3000
  • Login if required (Credentials: admin/admin). You can create user when you launch Grafana for the first time
Step 3: Configuring Influxdb data source in Grafana

Steps to configure Influxdb in Grafana:
  • Click on configuration icon and select Data Sources sub menu as shown in the below image
  • Enter the details shown in the below images and click Save & Test button



Step 4: Install Dashboard in Grafana

Grafana is providing different inbuilt dashboards.
  • Navigate to https://grafana.com/dashboards url
  • Search for JMeter dashboards
  • Download JSON file for any JMeter dashboard (there are many default dashboards available in grafana portal). Alternatively you can create your own dashboards if you are familiar with Grafana
  • Now login to Grafana server (http://localhost:3000)
  • Click + icon and then import the the downloaded JSON as shown in the below picture
  • Upload JSON file, it may ask to provide name or else you can edit the default name


Step 5: Setup Backend Listener in JMeter scripts

Backend Listener in JMeter is used to send the results to a database “InfluxDB” during the test execution. JMeter uses graphite protocol to write the values to InfluxDB. By configuring “Grafana” a dashboard the graphs can be monitored while running the test in JMeter.

Below are the steps to configure backend listener in Jmeter script:
  • Add “Backend Listener” to JMeter script
  • Select “InfluxdbBackendListenerClient” in Backend Listener Implementation and edit below details
    • influxdbUrl
    • application
    • testTitle

  • Once these setup is completed and run the script, you can start seeing the metrics in the Grafana dashboard. 

Happy Testing !

Comments

Post a Comment

Popular posts from this blog

Read Data From A CSV File In Random Order - Apache JMeter

-
Image
The default CSV Data Set Config element could only read records in sequential order. But the "Random CSV Data Set" plugin can help you to read the data in random order from a CSV file. This post helps you to install and use this plugin. How to Install Random CSV Data Set Plugin Using Plugin Manager Open Plugin Manager on JMeter Search for "Random CSV Data Set" under "Available Plugins" tab Select "Random CSV Data Set" checkbox Click "Apply Changes and Restart JMeter" button How to Install Random CSV Data Set Plugin Manually Navigate to https://jmeter-plugins.org/ page Search for "Random CSV Data Set" in Search field Click on version number to download the plugin (It's recommended to use the latest version) Once download is completed, extract the ZIP file and copy the jar files to the specified location Restart the JMeter to effect the changes How to Use Ran...
Read more

How to add arguments to HTTP Sampler in dynamically in JMeter

-
Image
Sometimes you need to send the arguments with HTTP Request that will be changing dynamically for each iteration/user (argument names and count). Lets take an example, where user have to select all the "in stock" products and these items may change randomly for each user or iteration. During recording,  we got 6 in stock items so JMeter captured 6 products ids as shown in the below image. if we try to replay the script, it may vary. In this case we have to dynamically construct/add the request parameters based on the "in stock" count. We can use JMeter scripting capabilities to achieve this (using any of the BeanShell Preprocessors). Steps: 1. Capture all the product ids which has "in stock" status using correlation (in order to capture all the occurrences, we will use Match No as "-1") 2. Based on the product ids count we can construct request arguments using BeanShell Preprocessor or JSR223 Preprocessor 3. Add BeanShell Pr...
Read more

How To Simulate Different Network Speeds In JMeter

-
By default JMeter can send the requests as fast as it can. But it's not a realistic scenario, real users don't choke the server/application with non-stop download. In real time, users may access the application with different network speeds - meaning connection speed will vary for each user. So it's always good to test your application under different network bandwidths for better performance. If you are testing a mobile application, it is recommended to test the app with different network speeds as the mobile users access the app with cellular network. This article can help you to simulate and control virtual users bandwidth in JMeter. Simulating Different Network Speeds Using JMeter JMeter does give you the option to limit outgoing bandwidth in order to simulate different network speeds. The bandwidth can be controlled through these two properties in jmeter.properties file: httpclient.socket.http.cps=0 httpclient.socket.https.cps=0 Formula To Calculate CPS ...
Read more