This is a plugin that allows you to use JMH in the same way as JUnit. Here are the features that are already implemented:

1. @Benchmark method generation
2. Running a separate @Benchmark method
3. Running all the benchmarks in a class

First of all, you must have jmh-core and jmh-generator-annprocess on the classpath of your module.

After that install the plugin. You can do this directly from IDEA — search for JMH in plugin repositories.

Then you can use the plugin the same way you use JUnit. To generate a new benchmark method run Generate... action. Press Alt+Insert or in MacOS Ctrl + N. Or just right click in your editor pane and select Generate micro benchmark.

To run a separate benchmark method move the cursor to the method declaration and invoke Run action. Press Ctrl + Shift + F10. Do the same actions to run all the benchmarks in a class, just move your cursor to the class declaration.

Invoking Run actions will create a new configuration with default parameters JMH provides. If you want to change these parameters just edit this configuration. To edit default parameters for all your benchmarks, modify the "JMH" run configuration template.

Please, note that when running a benchmark Annotation processing must be enabled in your IDE.

A brief research shows that benchmark results are affected, but not that much. The whole research is described in Research results. Long story short, the maximum means difference observed was 2.2%.

The following screenshot configures JMH to run the benchmark org.openjdk.bench.java.util.UUIDBench.fromString using the async-profiler from a customized java.library.path

Under Windows the following error might show up:

ERROR: org.openjdk.jmh.runner.RunnerException:
ERROR: Exception while trying to acquire the JMH lock (C:\WINDOWS\/jmh.lock):

This is caused by running JMH benchmarks with an empty environment. To fix this error, define a TMP or TEMP environment variable which points to a writable directory. Alternatively, specify the JVM argument java.io.tmpdir and set it to a writable directory, for instance -Djava.io.tmpdir=C:\temp.

To understand the plugin sources please read

• Run Configurations Architectural Overview
• Run Configuration Management

• Gradle JMH Plugin
• Jenkins JMH Plugin
• Teamcity JMH Plugin