Giter Club home page Giter Club logo

op-benchmark-recipes's Introduction

op-benchmark-recipes

Performance Benchmark Recipes for Power-based systems

op-benchmark-recipes's People

Contributors

basuv avatar johnjmar avatar johnjmartinez avatar mzipse avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

op-benchmark-recipes's Issues

intro readmes

Todo for main page and another for std. benchmarks

Error running SpecJBB test

Hi @johnjmar

Can you let me know if you've run into this error with iBM Java (that you've in-built into your benchmarking suite) ?

root@ubuntu:/home/ubuntu/op-benchmark-recipes/standard-benchmarks/Java/SPEC-jbb2015/18-06-14_174600# cat controller.log
Error: A JNI error has occurred, please check your installation and try again
Exception in thread "main" java.lang.NoClassDefFoundError: joptsimple.HelpFormatter
at java.lang.J9VMInternals.prepareClassImpl(Native Method)
at java.lang.J9VMInternals.prepare(J9VMInternals.java:291)
at java.lang.Class.getMethod(Class.java:1216)
at sun.launcher.LauncherHelper.validateMainClass(LauncherHelper.java:556)
at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:538)
Caused by: java.lang.ClassNotFoundException: joptsimple.HelpFormatter
at java.net.URLClassLoader.findClass(URLClassLoader.java:607)
at java.lang.ClassLoader.loadClassHelper(ClassLoader.java:850)
at java.lang.ClassLoader.loadClass(ClassLoader.java:829)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:325)
at java.lang.ClassLoader.loadClass(ClassLoader.java:809)
... 5 more

cpu2017 on P8 miscompares with 500.perlbench_r

I'm running CPU2017 on a P8 machine built with xlC/at11.0 and getting miscompares with 500.perlbench_r:

Any idea?

Running Benchmarks
Running (#1) 500.perlbench_r test base P8_4S (1 copy) [2018-08-10 19:39:24]
Error with '/home/cpu2017/bin/specinvoke -d /home/cpu2017//p8_4S/benchspec/CPU/500.perlbench_r/run/run_base_test_P8_4S.0000 -f compare.cmd -E -e compare.err -o compare.stdout'; no non-empty output files exist
Command returned exit code 1

***** Miscompare of test.out; for details see**
/home/cpu2017//p8_4S/benchspec/CPU/500.perlbench_r/run/run_base_test_P8_4S.0000/test.out.mis
Invalid run; unable to continue.
If you wish to ignore errors please use '-I' or ignore_errors

The log for this run is in /home/cpu2017//p8_4S/result/CPU2017.002.log
The debug log for this run is in /home/cpu2017//p8_4S/result/CPU2017.002.log.debug

  • Temporary files were NOT deleted; keeping temporaries such as
  • /home/cpu2017//p8_4S/result/CPU2017.002.log.debug and
  • /home/cpu2017//p8_4S/tmp/CPU2017.002
  • (These may be large!)

runcpu finished at 2018-08-10 19:40:02; 44 total seconds elapsed
[root@localhost cpu2017]# cat /home/cpu2017//p8_4S/benchspec/CPU/500.perlbench_r/run/run_base_test_P8_4S.0000/test.out.mis
0254: t/run/noswitch .............................. ok
t/run/noswitch ..............................
^
'test.out' short
[root@localhost cpu2017]#

Issue with specjbb while running composite max jops metrixs

./amd-composite-mjops-2G-2P-GNx64-280w-jdk17-1TB-nps2.sh: line 118: 5528 Killed numactl --cpunodebind=0 --interleave=0 $JAVA $JAVA_OPTS $SPEC_OPTS -jar $jar -m COMPOSITE $MODE_ARGS 2> composite.log > composite.out

I have no idea why this is happening at 81% of load

H2O.ai benchmark ?

Is there any H2O.ai benchmark for openpower?
Wondering if someone work on this already.

Error running latter

Hi @johnjmar
Can you let me know if you've run into error with Memory/Latter
Build the binaries of stream and lat_mem_rd as the instruction. When executed latter.sh, the process stuck in this line β€œlat_mem_rd 5i3000 128 0 0 72”.
analysis the usage of lat_men_rd

Usage: ./lat_mem_rd [-P <parallelism>] [-W <warmup>] [-N <repetitions>] [-t] len [stride...]

So the _ARGS for lat_men_rd is wrong I think
So we should Modify some part

@@ -96,7 +96,7 @@

     # Store the current prefetch and SMT settings
     CURR_PREFETCH=`ppc64_cpu --dscr | sed 's/DSCR is //'`
-    CURR_SMT=`ppc64_cpu --smt | sed "s/SMT=//" | xargs`
+    CURR_SMT=`ppc64_cpu --smt | awk -F "is|=" '{print $2}'`

     for _PREFETCH in ${LTPREFETCH_SET}
     do
@@ -120,7 +120,7 @@

             for _CHIP in ${LTCHIP_SET}
             do
-                _ARGS="${LTITERS}i${LT_BUFSIZE} ${LT_STRIDESIZE} ${_CHIP} ${LTCHIP_SET}"
+                _ARGS="-N ${LTITERS} ${LT_BUFSIZE} ${LT_STRIDESIZE}"
                 _OF1="${LTNAME_LAT}.${_CHIP}.${LTNAME_OUT}"

                 if [[ ${LTRUN_PMCOUNT} == "TRUE" ]]
@@ -148,7 +148,7 @@

     for _CHIP in ${LTCHIP_SET}
     do
-        _ARGS="${LTPATH}/${LTCMD} 60 128 ${_CHIP}"
+        _ARGS="${LTPATH}/${LTCMD} 60 128"
         _OF3="${_CHIP}.cache.out"
         Log "${_ARGS}"
         ${_ARGS} >> ${_OF3} 2>&1
@@ -615,3 +615,4 @@
     rm -r ${LTDATADIR}
 fi
 exit 0
+

And the usage of lat_mem_rd do not support to choose chip.maybe,the source code need to modify again.

Error running Multichase

Hi @johnjmar
Can you let me know if you've run into error with Memory/Multichase

clone the official multichase github repository, It showed error messages when we tried to build the binary.

./gen_expand 200 >expand.h.tmp
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
	LANGUAGE = (unset),
	LC_ALL = (unset),
	LC_CTYPE = "UTF-8",
	LANG = "en_US.UTF-8"
    are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
mv expand.h.tmp expand.h
cc -std=gnu99 -g -O2 -fomit-frame-pointer -fno-unroll-loops -Wall -Wstrict-prototypes -Wmissing-prototypes -Wshadow -Wmissing-declarations -Wnested-externs -Wpointer-arith -W -Wno-unused-parameter -Werror -pthread   -c -o multichase.o multichase.c
cc -std=gnu99 -g -O2 -fomit-frame-pointer -fno-unroll-loops -Wall -Wstrict-prototypes -Wmissing-prototypes -Wshadow -Wmissing-declarations -Wnested-externs -Wpointer-arith -W -Wno-unused-parameter -Werror -pthread   -c -o permutation.o permutation.c
cc -std=gnu99 -g -O2 -fomit-frame-pointer -fno-unroll-loops -Wall -Wstrict-prototypes -Wmissing-prototypes -Wshadow -Wmissing-declarations -Wnested-externs -Wpointer-arith -W -Wno-unused-parameter -Werror -pthread   -c -o arena.o arena.c
cc -std=gnu99 -g -O2 -fomit-frame-pointer -fno-unroll-loops -Wall -Wstrict-prototypes -Wmissing-prototypes -Wshadow -Wmissing-declarations -Wnested-externs -Wpointer-arith -W -Wno-unused-parameter -Werror -pthread   -c -o util.o util.c
cc -g -O2 -static -pthread  multichase.o permutation.o arena.o util.o  -lrt -o multichase
/usr/bin/ld: cannot find -lrt
/usr/bin/ld: cannot find -lpthread
/usr/bin/ld: cannot find -lc
collect2: error: ld returned 1 exit status
make: *** [multichase] Error 1

When we modify the below command, delete the parameter "-static" in Makefile

@@ -12,7 +12,7 @@
 # limitations under the License.
 #
 CFLAGS=-std=gnu99 -g -O2 -fomit-frame-pointer -fno-unroll-loops -Wall -Wstrict-prototypes -Wmissing-prototypes -Wshadow -Wmissing-declarations -Wnested-externs -Wpointer-arith -W -Wno-unused-parameter -Werror -pthread
-LDFLAGS=-g -O2 -pthread
+LDFLAGS=-g -O2 -static -pthread
 LDLIBS=-lrt

We successfully built the binary

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    πŸ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. πŸ“ŠπŸ“ˆπŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❀️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.