It should be possible to run a single test instead of a full test case. The notation should be:

IDL> mgunit, 'mytest_ut::test1'

There should be an easily usable GUI test runner.

It would be useful to be able to insert an event handler (an EVENT_FUNC?) into the top-level base which would record each event in a file. Then a separate event player would be needed to play back the events recorded previously. This would need a mechanism to handle widget identifiers in the events that would not necessarily be the same in the playback (maybe by using UNAMEs?).

On line 504 of mguttestsuite__define.pro :
if folder[0] eq '/' then $
folder is a string, and folder[0] is meant to get the first character of the string. That line should be changed to:
if strmid(folder, 0, 1) eq '/' then $

As is, it does not allow for absolute paths as indicated in the documentation.

Adding the ability to do property based testing to mgunit would help find more bugs.

To do property based tests, you would write methods that take parameters and don't start with "test." Then the actual test methods would call a routine, mgunit_proptest, that calls the test method with the given keywords.

For example, to test the routine mg_n_smallest:

function mg_n_smallest_ut::check_size, array=array, n=n
  compile_opt strictarr

  result = mg_n_smallest(arr, n)
  assert, n_elements(result) eq n
  return, 1
end

function mg_n_smallest_ut::test_size
  compile_opt strictarr

  mgunit_proptest, self, 'check_size', $
                   array=mgunit_array(mgunit_float()), $
                   n=mgunit_long(min_value=0)

  return, 1
end

pro mg_n_smallest_ut__define
  compile_opt strictarr

  define = { mg_n_smallest_ut, inherits MGutLibTestCase }
end

Other features:

• mgunit should write an explicit unit test when a property based test fails.

Hi Michael Galloy,

I came across a bug in mgunit 1.5.0 the other day and wanted to send it your way.

In creating a certain test I keep getting the failure:

% Restored file: MGUNIT.
"All tests" test suite starting (1 test suite/case, 1 test)
  "mmm_test_mmm_make_mgunit_fail_ut" test case starting (1 test)
    test_for_error: failed "IDL_CONTAINER::ADD: Object reference type required in this context: RESULT1." (0.001862 seconds)
  Results: 0 / 1 tests passed, 0 skipped
Results: 0 / 1 tests passed, 0 skipped

I'm currently using unzipped mgunit 1.5.0 but found the test to pass when I went back and used mgunit 1.4.0.

Here is a link to the code to reproduce it:

https://gist.github.com/andywinhold/fdd820f44b14fbceed50

Skipped tests should be kept track of, so the test runner could, for example, say at the end: "3/4 tests passed, 1 skipped".

Should use more realistic examples from idllib or GPULib.

It is not currently possible to simply check out trunk and "make dist". The Makefile attempts to build the API docs, which relies on idldoc, which is not included in the source distribution. Please either add the necessary files to the project, enhance the Makefile to grab the necessary files with wget, or pull in the necessary files through svn:externals.

It is not currently possible to simple check out trunk and "make dist". The source relies on mg_src_root, which is not included in the source distribution. If maintained as a separate project, please pull in with svn:externals.

We need a script or CMake target to builds the docs, compile the code into a .sav file, build the .zip files, etc. in order to consistently make the distribution (in two varieties: dist and srcdist).

Is there a built in way to multi-thread a suite of mgunit tests, perhaps utilizing your mg_pool() class? It would be great to have a keyword option on mgunit directly and have it utilize mg_pool() internally to divide up the tests, aggregate the logs, etc. I'm working with a suite of tests that currently takes over an hour to run, so this would be a huge benefit.

Hi,

Nice framework, but got an 'OPENW: Null filename not allowed' with
IDL> mguint, 'mytest_ut', /junit
due to _filename being set to ''. The change below resolves the issue:

--- a/mgunit/src/mgunit.pro
+++ b/mgunit/src/mgunit.pro
@@ -146,7 +146,7 @@ pro mgunit, tests, $

 for i = 0L, n_elements(runnerName) - 1L do begin
   f = n_elements(f) eq 0L ? 0L : i mod n_elements(filename)

•  _filename = n_elements(filename) eq 0L ? '' : filename[f]
  

•  _filename = n_elements(filename) eq 0L ? !NULL : filename[f]
  

  _color = (keyword_set(color) || mgunit_findIfTty()) $
  && (n_elements(filename) eq 0L || strlen(filename[f]) eq 0L)
  testRunner->add, obj_new(runnerName[i], $