Giter Club home page Giter Club logo

passionlab / combblas Goto Github PK

View Code? Open in Web Editor NEW
57.0 57.0 20.0 250.14 MB

The Combinatorial BLAS (CombBLAS) is an extensible distributed-memory parallel graph library offering a small but powerful set of linear algebra primitives specifically targeting graph analytics.

License: Other

C++ 49.52% CMake 0.26% C 35.33% MATLAB 1.59% Shell 5.66% Makefile 0.68% Roff 0.56% Jupyter Notebook 0.74% Python 0.30% HTML 5.24% Rich Text Format 0.01% Objective-C 0.11% Perl 0.01%

combblas's People

Contributors

aydinbuluc avatar azadcse avatar drew-parsons avatar esaliya avatar gabe-raulet avatar giuliaguidi avatar roguzsel avatar taufique71 avatar tkonolige avatar vbharadwaj-bk avatar yusukenagasaka avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

combblas's Issues

Doesn't respect multilib structure

Files matching a file type that is not allowed:
   usr/lib/libCombBLAS.so.1.16.0
   usr/lib/libUsortlib.so
   usr/lib/libGraphGenlib.so
 * ERROR: sci-libs/CombBLAS-0_pre20220331::guru failed:
 *   multilib-strict check failed!

Please use include(GNUInstallDirs) and ${CMAKE_INSTALL_LIBDIR} instead of hardcoding lib

g++5.5 build failed and g++6.5 build success on ubuntu16.04

root@fbc66d582c7a:/projects/CombBLAS-master/_build# cmake -DCMAKE_INSTALL_PREFIX=/opt/CombBLAS ..
-- The C compiler identification is GNU 5.5.0
-- The CXX compiler identification is GNU 5.5.0
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Found MPI_C: /usr/lib/openmpi/lib/libmpi.so
-- Found MPI_CXX: /usr/lib/openmpi/lib/libmpi_cxx.so;/usr/lib/openmpi/lib/libmpi.so
-- Try OpenMP C flag = [-fopenmp]
-- Performing Test OpenMP_FLAG_DETECTED
-- Performing Test OpenMP_FLAG_DETECTED - Success
-- Try OpenMP CXX flag = [-fopenmp]
-- Performing Test OpenMP_FLAG_DETECTED
-- Performing Test OpenMP_FLAG_DETECTED - Success
-- Found OpenMP: -fopenmp
-- Performing Test COMPILER_HAS_HIDDEN_VISIBILITY
-- Performing Test COMPILER_HAS_HIDDEN_VISIBILITY - Success
-- Performing Test COMPILER_HAS_HIDDEN_INLINE_VISIBILITY
-- Performing Test COMPILER_HAS_HIDDEN_INLINE_VISIBILITY - Success
-- Performing Test COMPILER_HAS_DEPRECATED_ATTR
-- Performing Test COMPILER_HAS_DEPRECATED_ATTR - Success
-- Configuring done
-- Generating done
-- Build files have been written to: /projects/CombBLAS-master/_build
root@fbc66d582c7a:/projects/CombBLAS-master/_build# make
Scanning dependencies of target GraphGenlib
[ 1%] Building C object graph500-1.2/generator/CMakeFiles/GraphGenlib.dir/btrd_binomial_distribution.c.o
[ 2%] Building C object graph500-1.2/generator/CMakeFiles/GraphGenlib.dir/splittable_mrg.c.o
[ 4%] Building C object graph500-1.2/generator/CMakeFiles/GraphGenlib.dir/mrg_transitions.c.o
[ 5%] Building C object graph500-1.2/generator/CMakeFiles/GraphGenlib.dir/graph_generator.c.o
[ 6%] Building C object graph500-1.2/generator/CMakeFiles/GraphGenlib.dir/permutation_gen.c.o
[ 8%] Building C object graph500-1.2/generator/CMakeFiles/GraphGenlib.dir/make_graph.c.o
[ 9%] Building C object graph500-1.2/generator/CMakeFiles/GraphGenlib.dir/utils.c.o
[ 10%] Building C object graph500-1.2/generator/CMakeFiles/GraphGenlib.dir/scramble_edges.c.o
[ 12%] Linking C static library libGraphGenlib.a
[ 12%] Built target GraphGenlib
Scanning dependencies of target Usortlib
[ 13%] Building CXX object usort/CMakeFiles/Usortlib.dir/src/parUtils.cpp.o
[ 15%] Building CXX object usort/CMakeFiles/Usortlib.dir/src/binUtils.cpp.o
[ 16%] Linking CXX static library libUsortlib.a
[ 16%] Built target Usortlib
Scanning dependencies of target CombBLAS
[ 17%] Building CXX object CMakeFiles/CombBLAS.dir/src/CommGrid.cpp.o
[ 19%] Building C object CMakeFiles/CombBLAS.dir/src/mmio.c.o
/projects/CombBLAS-master/src/mmio.c: In function ‘mm_read_mtx_crd_size’:
/projects/CombBLAS-master/src/mmio.c:138:22: warning: format ‘%lld’ expects argument of type ‘long long int ’, but argument 3 has type ‘int64_t * {aka long int }’ [-Wformat=]
if (sscanf(line, "%lld %lld %lld", M, N, nz) == 3)
^
/projects/CombBLAS-master/src/mmio.c:138:22: warning: format ‘%lld’ expects argument of type ‘long long int ’, but argument 4 has type ‘int64_t * {aka long int }’ [-Wformat=]
/projects/CombBLAS-master/src/mmio.c:138:22: warning: format ‘%lld’ expects argument of type ‘long long int ’, but argument 5 has type ‘int64_t * {aka long int }’ [-Wformat=]
/projects/CombBLAS-master/src/mmio.c:144:36: warning: format ‘%lld’ expects argument of type ‘long long int ’, but argument 3 has type ‘int64_t * {aka long int }’ [-Wformat=]
num_items_read = fscanf(f, "%lld %lld %lld", M, N, nz);
^
/projects/CombBLAS-master/src/mmio.c:144:36: warning: format ‘%lld’ expects argument of type ‘long long int ’, but argument 4 has type ‘int64_t * {aka long int }’ [-Wformat=]
/projects/CombBLAS-master/src/mmio.c:144:36: warning: format ‘%lld’ expects argument of type ‘long long int ’, but argument 5 has type ‘int64_t * {aka long int }’ [-Wformat=]
[ 20%] Building CXX object CMakeFiles/CombBLAS.dir/src/MPIType.cpp.o
[ 21%] Building CXX object CMakeFiles/CombBLAS.dir/src/MPIOp.cpp.o
[ 23%] Building CXX object CMakeFiles/CombBLAS.dir/src/MemoryPool.cpp.o
[ 24%] Building CXX object CMakeFiles/CombBLAS.dir/src/hash.cpp.o
[ 26%] Linking CXX static library libCombBLAS.a
[ 26%] Built target CombBLAS
Scanning dependencies of target BlockedSpGEMM
[ 27%] Building CXX object ReleaseTests/CMakeFiles/BlockedSpGEMM.dir/BlockedSpGEMM.cpp.o
In file included from /projects/CombBLAS-master/include/CombBLAS/Friends.h:35:0,
from /projects/CombBLAS-master/include/CombBLAS/SpMat.cpp:32,
from /projects/CombBLAS-master/include/CombBLAS/SpMat.h:178,
from /projects/CombBLAS-master/include/CombBLAS/SpTuples.h:38,
from /projects/CombBLAS-master/include/CombBLAS/CombBLAS.h:121,
from /projects/CombBLAS-master/ReleaseTests/BlockedSpGEMM.cpp:4:
/projects/CombBLAS-master/include/CombBLAS/SpHelper.h: In instantiation of ‘static void combblas::SpHelper::ProcessLines(std::vector<_RealType>&, std::vector<_RealType>&, std::vector&, std::vector<std::__cxx11::basic_string >&, int, int, bool) [with IT1 = long int; NT1 = double]’:
/projects/CombBLAS-master/include/CombBLAS/SpParMat.cpp:3842:27: required from ‘void combblas::SpParMat<IT, NT, DER>::ParallelReadMM(const string&, bool, _BinaryOperation) [with _BinaryOperation = combblas::maximum; IT = long int; NT = double; DER = combblas::SpDCCols<long int, double>; std::__cxx11::string = std::__cxx11::basic_string]’
/projects/CombBLAS-master/ReleaseTests/BlockedSpGEMM.cpp:44:46: required from here
/projects/CombBLAS-master/include/CombBLAS/SpHelper.h:156:23: warning: format ‘%lld’ expects argument of type ‘long long int
’, but argument 3 has type ‘int64_t
{aka long int
}’ [-Wformat=]
sscanf(itr->c_str(), "%lld %lld %lg", &ii, &jj, &vv);
^
/projects/CombBLAS-master/include/CombBLAS/SpHelper.h:156:23: warning: format ‘%lld’ expects argument of type ‘long long int
’, but argument 4 has type ‘int64_t
{aka long int
}’ [-Wformat=]
/projects/CombBLAS-master/include/CombBLAS/SpHelper.h:165:23: warning: format ‘%lld’ expects argument of type ‘long long int
’, but argument 3 has type ‘int64_t
{aka long int
}’ [-Wformat=]
sscanf(itr->c_str(), "%lld %lld %lld", &ii, &jj, &vv);
^
/projects/CombBLAS-master/include/CombBLAS/SpHelper.h:165:23: warning: format ‘%lld’ expects argument of type ‘long long int
’, but argument 4 has type ‘int64_t
{aka long int
}’ [-Wformat=]
/projects/CombBLAS-master/include/CombBLAS/SpHelper.h:165:23: warning: format ‘%lld’ expects argument of type ‘long long int*’, but argument 5 has type ‘int64_t* {aka long int*}’ [-Wformat=]
/projects/CombBLAS-master/include/CombBLAS/SpHelper.h:174:23: warning: format ‘%lld’ expects argument of type ‘long long int*’, but argument 3 has type ‘int64_t* {aka long int*}’ [-Wformat=]
sscanf(itr->c_str(), "%lld %lld", &ii, &jj);
^
/projects/CombBLAS-master/include/CombBLAS/SpHelper.h:174:23: warning: format ‘%lld’ expects argument of type ‘long long int*’, but argument 4 has type ‘int64_t* {aka long int*}’ [-Wformat=]
In file included from /projects/CombBLAS-master/include/CombBLAS/SpParMat.h:464:0,
from /projects/CombBLAS-master/include/CombBLAS/CombBLAS.h:124,
from /projects/CombBLAS-master/ReleaseTests/BlockedSpGEMM.cpp:4:
/projects/CombBLAS-master/include/CombBLAS/SpParMat.cpp: In instantiation of ‘std::vector<std::vector<combblas::SpParMat<IT, NT, DER> > > combblas::SpParMat<IT, NT, DER>::BlockSplit(int, int) [with IT = long int; NT = double; DER = combblas::SpDCCols<long int, double>]’:
/projects/CombBLAS-master/include/CombBLAS/BlockSpGEMM.h:39:13: required from ‘combblas::BlockSpGEMM<IT, NTA, DERA, NTB, DERB>::BlockSpGEMM(combblas::SpParMat<IT, NT, DER>&, combblas::SpParMat<IT, NTB, DERB>&, int, int, int) [with IT = long int; NTA = double; DERA = combblas::SpDCCols<long int, double>; NTB = double; DERB = combblas::SpDCCols<long int, double>]’
/projects/CombBLAS-master/ReleaseTests/BlockedSpGEMM.cpp:56:57: required from here
/projects/CombBLAS-master/include/CombBLAS/SpParMat.cpp:2803:3: error: converting to ‘std::vector<std::tuple<long int, long int, double>, std::allocator<std::tuple<long int, long int, double> > >::value_type {aka std::tuple<long int, long int, double>}’ from initializer list would use explicit constructor ‘constexpr std::tuple< >::tuple(_UElements&& ...) [with _UElements = {long int&, long int&, double&}; = void; _Elements = {long int, long int, double}]’
btuples[rbid][cbid][owner].push_back({ridx_l, cidx_l, tuples.numvalue(i)});
^
ReleaseTests/CMakeFiles/BlockedSpGEMM.dir/build.make:62: recipe for target 'ReleaseTests/CMakeFiles/BlockedSpGEMM.dir/BlockedSpGEMM.cpp.o' failed
make[2]: *** [ReleaseTests/CMakeFiles/BlockedSpGEMM.dir/BlockedSpGEMM.cpp.o] Error 1
CMakeFiles/Makefile2:1155: recipe for target 'ReleaseTests/CMakeFiles/BlockedSpGEMM.dir/all' failed
make[1]: *** [ReleaseTests/CMakeFiles/BlockedSpGEMM.dir/all] Error 2
Makefile:138: recipe for target 'all' failed
make: *** [all] Error 2

Many tests fail on FreeBSD

$ CTEST_OUTPUT_ON_FAILURE=1 make test
===>  Testing for CombBLAS-2.0.0
-- Configuring done
-- Generating done
-- Build files have been written to: /disk-samsung/freebsd-ports/math/combblas/work/.build
ninja: no work to do.
[  0% 1/1] cd /disk-samsung/freebsd-ports/math/combblas/work/.build && /usr/local/bin/ctest --force-new-ctest-process
Test project /disk-samsung/freebsd-ports/math/combblas/work/.build
      Start  1: GenMMWrite_Test
 1/20 Test  #1: GenMMWrite_Test ..................   Passed   15.56 sec
      Start  2: Multiplication_Test
 2/20 Test  #2: Multiplication_Test ..............***Failed    0.06 sec
COMBBLAS: Matrix-market file ../TESTDATA/rmat_scale16_A.mtx can not be found
Abort(3004) on node 0 (rank 0 in comm 0): application called MPI_Abort(MPI_COMM_WORLD, 3004) - process 0

      Start  3: SpGEMM3D_Test
 3/20 Test  #3: SpGEMM3D_Test ....................***Failed    1.03 sec
COMBBLAS: Matrix-market file ../TESTDATA/rmat_scale16_A.mtx can not be found
Abort(3004) on node 0 (rank 0 in comm 0): application called MPI_Abort(MPI_COMM_WORLD, 3004) - process 0

      Start  4: HashSpGEMMTest
 4/20 Test  #4: HashSpGEMMTest ...................***Failed    0.06 sec
COMBBLAS: Matrix-market file ../TESTDATA/rmat_scale16_A.mtx can not be found
Abort(3004) on node 0 (rank 0 in comm 0): application called MPI_Abort(MPI_COMM_WORLD, 3004) - process 0

      Start  5: Reduction_Test
 5/20 Test  #5: Reduction_Test ...................***Failed    0.05 sec
Problem reading binary input file
COMBBLAS: Input file doesn't exist

===================================================================================
=   BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
=   PID 95220 RUNNING AT yv.noip.me
=   EXIT CODE: 11
=   CLEANING UP REMAINING PROCESSES
=   YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
===================================================================================
YOUR APPLICATION TERMINATED WITH THE EXIT STRING: Segmentation fault (signal 11)
This typically refers to a problem with your application.
Please see the FAQ page for debugging suggestions

      Start  6: Iterator_Test
 6/20 Test  #6: Iterator_Test ....................***Failed    0.05 sec
Problem reading binary input file
COMBBLAS: Input file doesn't exist

===================================================================================
=   BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
=   PID 95226 RUNNING AT yv.noip.me
=   EXIT CODE: 11
=   CLEANING UP REMAINING PROCESSES
=   YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
===================================================================================
YOUR APPLICATION TERMINATED WITH THE EXIT STRING: Segmentation fault (signal 11)
This typically refers to a problem with your application.
Please see the FAQ page for debugging suggestions

      Start  7: Transpose_Test
 7/20 Test  #7: Transpose_Test ...................***Failed    0.06 sec
Problem reading binary input file
COMBBLAS: Input file doesn't exist
Problem reading binary input file

===================================================================================
=   BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
=   PID 95232 RUNNING AT yv.noip.me
=   EXIT CODE: 11
=   CLEANING UP REMAINING PROCESSES
=   YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
===================================================================================
YOUR APPLICATION TERMINATED WITH THE EXIT STRING: Segmentation fault (signal 11)
This typically refers to a problem with your application.
Please see the FAQ page for debugging suggestions

      Start  8: Indexing_Test
 8/20 Test  #8: Indexing_Test ....................***Failed    0.06 sec
One of the input vector files do not exist, aborting
Abort(3004) on node 0 (rank 0 in comm 0): application called MPI_Abort(MPI_COMM_WORLD, 3004) - process 0

      Start  9: SpAsgn_Test
 9/20 Test  #9: SpAsgn_Test ......................***Failed    0.05 sec
One of the input vector files do not exist, aborting
Abort(3004) on node 0 (rank 0 in comm 0): application called MPI_Abort(MPI_COMM_WORLD, 3004) - process 0

      Start 10: GalerkinNew_Test
10/20 Test #10: GalerkinNew_Test .................***Failed    0.06 sec
Problem reading binary input file
COMBBLAS: Input file doesn't exist
Problem reading binary input file

===================================================================================
=   BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
=   PID 95250 RUNNING AT yv.noip.me
=   EXIT CODE: 11
=   CLEANING UP REMAINING PROCESSES
=   YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
===================================================================================
YOUR APPLICATION TERMINATED WITH THE EXIT STRING: Segmentation fault (signal 11)
This typically refers to a problem with your application.
Please see the FAQ page for debugging suggestions

      Start 11: FindSparse_Test
11/20 Test #11: FindSparse_Test ..................***Failed    0.07 sec
Problem reading binary input file
COMBBLAS: Input file doesn't exist

===================================================================================
=   BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
=   PID 95256 RUNNING AT yv.noip.me
=   EXIT CODE: 11
=   CLEANING UP REMAINING PROCESSES
=   YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
===================================================================================
YOUR APPLICATION TERMINATED WITH THE EXIT STRING: Segmentation fault (signal 11)
This typically refers to a problem with your application.
Please see the FAQ page for debugging suggestions

      Start 12: BetwCent_Test
12/20 Test #12: BetwCent_Test ....................***Failed    0.06 sec
COMBBLAS: Matrix-market file ../TESTDATA/SCALE16BTW-TRANSBOOL//input.mtx can not be found
Abort(3004) on node 0 (rank 0 in comm 0): application called MPI_Abort(MPI_COMM_WORLD, 3004) - process 0

      Start 13: TopDownBFS_Test
13/20 Test #13: TopDownBFS_Test ..................   Passed   17.61 sec
      Start 14: DirOptBFS_Test
14/20 Test #14: DirOptBFS_Test ...................***Timeout 1500.04 sec
COMBBLAS Warning: It is dangerous to create (matrix) objects without specifying the communicator, are you sure you want to create this object in MPI_COMM_WORLD?
COMBBLAS Warning: It is dangerous to create (matrix) objects without specifying the communicator, are you sure you want to create this object in MPI_COMM_WORLD?
COMBBLAS Warning: It is dangerous to create (matrix) objects without specifying the communicator, are you sure you want to create this object in MPI_COMM_WORLD?
Forcing scale to : 17
Using fast vertex permutations; skipping edge permutations (like v2.1)
graph_generation:               0.324727 s
Generated renamed edge lists
Generation took 0.326023 seconds
Warning: Using smaller indices for the matrix than DistEdgeList
Local matrices are 65536-by-65536
Created Sparse Matrix (with int32 local indices and values)
Calculated degrees in 0.00875277 seconds
Converted to Boolean and removed 213 loops
As a whole: 131072 rows and 131072 columns and 1864974 nonzeros
Reductions done
Intersection of colsums and rowsums found
Found non-isolated vertices
As a whole: 131072 rows and 131072 columns and 1864974 nonzeros
Dropped isolated vertices from input
As a whole: 90133 rows and 90133 columns and 1864974 nonzeros
Converted to 32-bit integers
Symmetricized
Optimization buffers set
Generation took 0.326023 seconds
Threading activated with 8 threads
As a whole: 90133 rows and 90133 columns and 3729948 nonzeros
65.9311 seconds elapsed for Kernel #1
As a whole: 90133 rows and 90133 columns and 3729948 nonzeros
Load balance: 1.01522
As a whole, Degrees array has length 90133
0.982048 0.330817 0.699284 0.0607193 0.0194015 0.794178 0.57059 0.245031 0.873026 0.317977 0.0491786 0.979907 0.875608 0.129842 0.862386 0.413525 0.361783 0.548102 0.665159 0.670179 0.654605 0.643731 0.663619 0.0460819 0.796801 0.067343 0.201118 0.178936 0.996204 0.54739 0.0149317 0.577831 0.0934394 0.702221 0.117062 0.00765376 0.142813 0.986832 0.666466 0.625108 0.21412 0.222159 0.298794 0.329842 0.91975 0.845635 0.341476 0.443175 0.8611 0.0348575 0.232313 0.609914 0.604632 0.0941811 0.828735 0.37962 0.91916 0.731879 0.133098 0.64359 0.429148 0.604913 0.941981 0.875231 
88514 29817 63028 5472 1748 71581 51428 22085 78688 28660 4432 88321 78921 11703 77729 37272 32608 49402 59952 60405 59001 58021 59813 4153 71818 6069 18127 16128 89790 49337 1345 52081 8421 63293 10551 689 12872 88946 60070 56342 19299 20023 26931 29729 82899 76219 30778 39944 77613 3141 20939 54973 54497 8488 74696 34216 82846 65966 11996 58008 38680 54522 84903 78887 
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              2        0.64482
 0d             10        3.15497
  s           1532        0.77065
 1d           3321        3.95219
  s        1163385        0.72454
  c                       0.00008
 2u           3321        2.51861
 3u          73633        2.81285
 4u          13049        2.91452
  c                       0.00000
 5d              0        4.15866
  s              0        0.77063
0th starting vertex was 88514
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 23.288 seconds
MTEPS: 0.0900515
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              4        0.78240
 0d              8        3.47820
  s          15001        0.78688
 1d           8850        4.15153
  s        1554514        0.71648
  c                       0.00011
 2u           8850        2.37756
 3u          74836        2.98516
 4u           6346        2.77439
  c                       0.00000
 5d              0        3.96541
  s              0        0.62856
1th starting vertex was 29817
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 23.7841 seconds
MTEPS: 0.0881734
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              4        0.77067
 0d              9        3.44508
  s           2008        0.73496
 1d           4361        3.76312
  s        1276877        0.72310
  c                       0.00008
 2u           4361        2.34511
 3u          74680        2.55811
 4u          10956        2.37753
  c                       0.00000
 5d              0        3.56533
  s              0        0.59407
2th starting vertex was 63028
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 21.7055 seconds
MTEPS: 0.096617
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s             87        0.60130
 0d            120        3.16744
  s         162302        0.75798
 1d          37937        3.56543
  s        1857288        0.77076
  c                       0.00024
 2u          37937        2.40577
 3u          51152        2.74136
 4u            863        2.40726
  c                       0.00000
 5d              0        3.43492
  s              0        0.73265
3th starting vertex was 5472
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 21.1006 seconds
MTEPS: 0.0993869
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              1        0.74259
 0d            114        2.94672
  s         120723        0.77297
 1d          33777        4.12217
  s        1881717        0.77614
  c                       0.00022
 2u          33777        2.56534
 3u          55069        2.53857
 4u           1110        2.94453
  c                       0.00000
 5d              0        3.98722
  s              0        0.65764
4th starting vertex was 1748
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 23.1559 seconds
MTEPS: 0.0905653
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              5        0.71466
 0d             10        3.35061
  s           5938        0.65809
 1d          10019        3.76343
  s        1631249        0.65199
  c                       0.00011
 2u          10019        2.82097
 3u          74357        2.77353
 4u           5660        2.71363
  c                       0.00000
 5d              0        3.61629
  s              0        0.74086
5th starting vertex was 71581
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 22.6911 seconds
MTEPS: 0.0924204
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s             18        0.59413
 0d             25        3.14753
  s          48827        0.61496
 1d          20581        3.91188
  s        1831863        0.77101
  c                       0.00016
 2u          20581        2.72401
 3u          66991        2.54169
 4u           2469        2.75916
  c                       0.00000
 5d              0        4.14811
  s              0        0.79170
6th starting vertex was 51428
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 22.7273 seconds
MTEPS: 0.0922733
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              0        0.79211
 0d              9        3.52673
  s          16177        0.71338
 1d           9662        3.57604
  s        1591140        0.77601
  c                       0.00011
 2u           9662        2.58169
 3u          74535        2.76322
 4u           5841        2.77325
  c                       0.00001
 5d              0        4.32020
  s              0        0.62159
7th starting vertex was 22085
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 22.6236 seconds
MTEPS: 0.0926961
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              3        0.59408
 0d              6        3.46710
  s          13217        0.78325
 1d           7921        4.15875
  s        1516618        0.75724
  c                       0.00010
 2u           7921        2.67395
 3u          75117        2.55387
 4u           6998        2.76119
  c                       0.00000
 5d              0        3.75774
  s              0        0.59409
8th starting vertex was 78688
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 22.4054 seconds
MTEPS: 0.0935991
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              5        0.59409
 0d             11        3.07360
  s           8776        0.79200
 1d           7156        4.21853
  s        1479572        0.77605
  c                       0.00010
 2u           7156        2.57979
 3u          75452        2.38443
 4u           7420        2.76213
  c                       0.00000
 5d              0        3.93748
  s              0        0.76522
9th starting vertex was 28660
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 22.8266 seconds
MTEPS: 0.0918719
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s             24        0.73909
 0d             46        3.33708
  s          36750        0.77064
 1d          16987        3.86272
  s        1783450        0.78138
  c                       0.00015
 2u          16987        2.35637
 3u          69832        2.38171
 4u           3202        2.76140
  c                       0.00000
 5d              0        4.01297
  s              0        0.77061
10th starting vertex was 4432
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 22.9471 seconds
MTEPS: 0.0913895
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              1        0.59408
 0d             10        3.10120
  s          26564        0.76421
 1d          14584        4.29269
  s        1740465        0.77070
  c                       0.00014
 2u          14584        2.60561
 3u          71638        2.77468
 4u           3829        2.77386
  c                       0.00000
 5d              0        4.08254
  s              0        0.77604
11th starting vertex was 88321
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 23.0929 seconds
MTEPS: 0.0908123
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              1        0.61214
 0d              3        3.17277
  s           6531        0.77600
 1d           5147        3.75379
  s        1325298        0.77069
  c                       0.00009
 2u           5147        2.59647
 3u          75104        2.77348
 4u           9766        2.50681
  c                       0.00000
 5d              0        3.96067
  s              0        0.59408
12th starting vertex was 78921
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 21.9938 seconds
MTEPS: 0.0953505
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              0        0.59408
 0d              1        2.66836
  s           2886        0.75593
 1d           2906        3.33437
  s        1075933        0.70210
  c                       0.00006
 2u           2906        2.67392
 3u          72587        2.93502
 4u          14489        2.75181
  c                       0.00000
 5d              0        3.94957
  s              0        0.78082
13th starting vertex was 11703
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 22.2749 seconds
MTEPS: 0.0941473
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s             34        0.77062
 0d            105        3.24570
  s         138715        0.59409
 1d          34394        3.98816
  s        1863435        0.77093
  c                       0.00022
 2u          34394        2.79906
 3u          54476        2.77341
 4u           1097        2.57057
  c                       0.00000
 5d              0        3.29945
  s              0        0.68960
14th starting vertex was 77729
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 21.9226 seconds
MTEPS: 0.0956602
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              1        0.78269
 0d              3        3.42436
  s           2365        0.77063
 1d           1942        3.93907
  s         899725        0.79201
  c                       0.00008
 2u           1942        2.76357
 3u          70041        2.46478
 4u          17976        2.37735
  c                       0.00000
 5d              0        4.09609
  s              0        0.70797
15th starting vertex was 37272
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 22.3949 seconds
MTEPS: 0.0936429
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              0        0.77062
 0d              2        3.26879
  s           2848        0.77063
 1d           3584        4.17809
  s        1174374        0.77069
  c                       0.00008
 2u           3584        2.59782
 3u          73930        2.37781
 4u          12487        2.37740
  c                       0.00000
 5d              0        3.56514
  s              0        0.59420
16th starting vertex was 32608
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 21.2812 seconds
MTEPS: 0.0985436
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              3        0.59408
 0d              8        3.15203
  s           2739        0.68423
 1d           3512        4.07347
  s        1180970        0.66372
  c                       0.00008
 2u           3512        2.52364
 3u          74156        2.61322
 4u          12322        2.39023
  c                       0.00000
 5d              0        3.87241
  s              0        0.77599
17th starting vertex was 49402
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 21.8237 seconds
MTEPS: 0.096094
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              0        0.65357
 0d              1        3.28380
  s             34        0.59407
 1d            129        2.92543
  s         172965        0.64202
 2d          37656        4.16423
  s        1843987        0.74763
  c                       0.00024
 3u          37656        2.75101
 4u          51348        2.60296
 5u            939        2.59808
  c                       0.00000
 6d              0        3.51082
  s              0        0.77062
18th starting vertex was 59952
Number iterations: 7
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 25.7241 seconds
MTEPS: 0.0815235
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              0        0.69214
 0d             38        3.46103
  s          15051        0.77599
 1d          12265        4.15957
  s        1697083        0.77619
  c                       0.00012
 2u          12265        2.38793
 3u          73168        2.77343
 4u           4577        2.37739
  c                       0.00000
 5d              0        3.56574
  s              0        0.59407
19th starting vertex was 60405
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 22.0284 seconds
MTEPS: 0.0952011
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              1        0.59408
 0d             13        3.04116
  s          10874        0.66686
 1d           8660        4.20918
  s        1560173        0.62743
  c                       0.00011
 2u           8660        2.53906
 3u          75052        2.37750
 4u           6321        2.74526
  c                       0.00000
 5d              0        4.11430
  s              0        0.77065
20th starting vertex was 59001
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 22.4846 seconds
MTEPS: 0.0932694
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              4        0.71916
 0d             11        3.02302
  s          29645        0.77061
 1d          13982        3.57438
  s        1721406        0.59417
  c                       0.00013
 2u          13982        2.37861
 3u          72045        2.37749
 4u           4017        2.56907
  c                       0.00000
 5d              0        4.14250
  s              0        0.77061
21th starting vertex was 58021
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 21.7128 seconds
MTEPS: 0.0965848
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              1        0.75404
 0d              1        2.79791
  s             43        0.72653
 1d            119        3.35051
  s         128043        0.77063
 2d          35000        3.96898
  s        1878361        0.61471
  c                       0.00022
 3u          35000        2.76306
 4u          53913        2.64788
 5u           1039        2.59821
  c                       0.00000
 6d              0        3.52724
  s              0        0.76747
22th starting vertex was 59813
Number iterations: 7
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 26.154 seconds
MTEPS: 0.0801836
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              0        0.59408
 0d              1        2.75068
  s             13        0.75526
 1d             35        3.14179
  s          69307        0.77066
 2d          23420        3.92697
  s        1843985        0.76075
  c                       0.00017
 3u          23420        2.73994
 4u          64503        2.81725
 5u           2112        2.42144
  c                       0.00000
 6d              0        3.04969
  s              0        0.77599
23th starting vertex was 4153
Number iterations: 7
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 25.7939 seconds
MTEPS: 0.0813031
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s            118        0.79202
 0d            351        3.32148
  s         316807        0.77636
  c                       0.00006
 1u            351        2.37831
 2u          50021        2.75646
 3u          39251        2.38790
 4u            450        2.37718
  c                       0.00000
 5d              0        3.48170
  s              0        0.77062
24th starting vertex was 71818
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 19.2493 seconds
MTEPS: 0.108945
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              0        0.59408
 0d              1        2.75973
  s            308        0.74017
 1d            359        3.14758
  s         321352        0.77062
  c                       0.00007
 2u            359        2.73201
 3u          50193        2.37781
 4u          39062        2.41344
 5u            459        2.77953
  c                       0.00000
25th starting vertex was 6069
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 19.7904 seconds
MTEPS: 0.105967
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              0        0.77062
 0d              1        3.35787
  s          11348        0.66456
 1d           7056        3.34562
  s        1463561        0.79204
  c                       0.00007
 2u           7056        2.18361
 3u          75284        2.78606
 4u           7693        2.67602
  c                       0.00000
 5d              0        3.75725
  s              0        0.60958
26th starting vertex was 18127
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 21.912 seconds
MTEPS: 0.0957066
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              0        0.61279
 0d              1        3.54025
  s             72        0.67881
 1d            121        3.03437
  s         134013        0.78135
 2d          35246        3.58263
  s        1874616        0.73802
  c                       0.00025
 3u          35246        2.77447
 4u          53655        2.17943
 5u           1049        2.92758
  c                       0.00000
 6d              0        3.48130
  s              0        0.71765
27th starting vertex was 16128
Number iterations: 7
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 26.5468 seconds
MTEPS: 0.0789972
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              0        0.59408
 0d              2        2.77292
  s            198        0.78144
 1d            381        3.94449
  s         355863        0.62541
  c                       0.00006
 2u            381        2.37853
 3u          51976        2.37805
 4u          37321        2.56983
 5u            394        2.77313
  c                       0.00000
28th starting vertex was 89790
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 19.5663 seconds
MTEPS: 0.10718
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              0        0.59582
 0d              6        3.57163
  s           6341        0.77600
 1d           5371        4.17249
  s        1351592        0.59469
  c                       0.00009
 2u           5371        2.46028
 3u          75260        2.45809
 4u           9388        2.77968
  c                       0.00000
 5d              0        4.18345
  s              0        0.77063
29th starting vertex was 49337
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 23.0637 seconds
MTEPS: 0.0909275
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s            122        0.62434
 0d            137        2.94927
  s         179782        0.78960
 1d          39837        3.89254
  s        1848936        0.67610
  c                       0.00023
 2u          39837        2.46853
 3u          49325        2.80562
 4u            772        2.57527
  c                       0.00000
 5d              0        3.27589
  s              0        0.69704
30th starting vertex was 1345
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 21.6003 seconds
MTEPS: 0.0970876
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s             23        0.59408
 0d             47        2.98312
  s          87376        0.59409
 1d          27313        3.93944
  s        1865266        0.65639
  c                       0.00019
 2u          27313        2.84339
 3u          61062        2.79014
 4u           1647        2.61411
  c                       0.00000
 5d              0        4.16631
  s              0        0.63437
31th starting vertex was 52081
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 22.4303 seconds
MTEPS: 0.093495
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s             14        0.65366
 0d             36        2.77057
  s          77794        0.70339
 1d          24498        3.78677
  s        1848322        0.77078
  c                       0.00018
 2u          24498        2.76882
 3u          63597        2.75781
 4u           1938        2.77534
  c                       0.00000
 5d              0        4.15773
  s              0        0.73014
32th starting vertex was 8421
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 23.4902 seconds
MTEPS: 0.0892764
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              7        0.73060
 0d            121        3.42262
  s         201443        0.78142
  c                       0.00006
 1u            121        2.57623
 2u          40203        2.53207
 3u          48973        2.37749
 4u            777        2.37727
  c                       0.00000
33th starting vertex was 63293
Number iterations: 5
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 15.0192 seconds
MTEPS: 0.139629
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s             13        0.59408
 0d             34        3.13085
  s          17804        0.61010
 1d          13431        3.75862
  s        1727428        0.59415
  c                       0.00013
 2u          13431        2.37864
 3u          72466        2.38042
 4u           4119        2.37738
  c                       0.00000
 5d              0        3.55096
  s              0        0.73365
34th starting vertex was 10551
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 20.9235 seconds
MTEPS: 0.100228
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              0        0.73122
 0d              3        3.02650
  s          41044        0.73052
 1d          16235        4.18966
  s        1758270        0.73478
  c                       0.00014
 2u          16235        2.77369
 3u          70428        2.68718
 4u           3397        2.62640
  c                       0.00000
 5d              0        4.14229
  s              0        0.77405
35th starting vertex was 689
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 23.0526 seconds
MTEPS: 0.0909714
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              0        0.59400
 0d              1        3.07782
  s            792        0.77061
 1d           1091        3.24883
  s         629782        0.65410
  c                       0.00007
 2u           1091        2.75289
 3u          63722        2.76320
 4u          25077        2.94852
 5u            183        2.57177
  c                       0.00000
36th starting vertex was 12872
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 20.4345 seconds
MTEPS: 0.102626
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              0        0.62235
 0d              2        3.34501
  s           3761        0.66924
 1d           3061        3.36605
  s        1100920        0.78139
  c                       0.00007
 2u           3061        2.63462
 3u          73170        2.55384
 4u          13766        2.37739
  c                       0.00000
 5d              0        3.56515
  s              0        0.75519
37th starting vertex was 88946
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 21.0353 seconds
MTEPS: 0.0996956
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              0        0.59408
 0d              1        2.88829
  s           2921        0.72662
 1d           2848        3.18326
  s        1053198        0.77067
  c                       0.00007
 2u           2848        2.39805
 3u          72567        2.58411
 4u          14584        2.52490
  c                       0.00000
 5d              0        3.86607
  s              0        0.75714
38th starting vertex was 60070
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 21.8452 seconds
MTEPS: 0.0959992
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              4        0.59880
 0d             13        3.44876
  s           7703        0.76532
 1d           8561        4.06855
  s        1563032        0.62119
  c                       0.00010
 2u           8561        2.33495
 3u          75056        2.53434
 4u           6413        2.37740
  c                       0.00000
 5d              0        3.56535
  s              0        0.59408
39th starting vertex was 56342
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 21.6211 seconds
MTEPS: 0.0969943
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              2        0.59409
 0d              3        3.00199
  s          12213        0.59409
 1d           7262        3.42851
  s        1473692        0.77068
  c                       0.00010
 2u           7262        2.37852
 3u          75175        2.37769
 4u           7602        2.75822
  c                       0.00000
 5d              0        4.19616
  s              0        0.66932
40th starting vertex was 19299
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 21.253 seconds
MTEPS: 0.0986743
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              2        0.77064
 0d             31        3.34325
  s          86277        0.76730
 1d          26496        3.97356
  s        1861971        0.77053
  c                       0.00024
 2u          26496        2.38330
 3u          61841        2.74865
 4u           1701        2.37737
  c                       0.00000
 5d              0        3.56492
  s              0        0.59407
41th starting vertex was 20023
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 22.1299 seconds
MTEPS: 0.0947643
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              0        0.59408
 0d              1        3.25414
  s            879        0.72297
 1d           1056        3.62178
  s         662596        0.78143
  c                       0.00007
 2u           1056        2.77441
 3u          64120        2.37774
 4u          24709        2.55424
 5u            188        2.73529
  c                       0.00000
42th starting vertex was 26931
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 19.617 seconds
MTEPS: 0.106903
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s            155        0.59442
 0d            380        2.76187
  s         339821        0.78294
  c                       0.00006
 1u            380        2.37847
 2u          51791        2.37786
 3u          37518        2.37724
 4u            384        2.58418
  c                       0.00000
 5d              0        3.06734
  s              0        0.68540
43th starting vertex was 29729
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 18.767 seconds
MTEPS: 0.111745
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s             10        0.63772
 0d             34        3.18356
  s          34039        0.68576
 1d          17684        3.56546
  s        1804477        0.77602
  c                       0.00015
 2u          17684        2.39290
 3u          69388        2.37766
 4u           2954        2.37727
  c                       0.00000
 5d              0        3.56778
  s              0        0.59407
44th starting vertex was 82899
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 20.9239 seconds
MTEPS: 0.100226
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              3        0.79201
 0d              6        3.08586
  s           3061        0.74739
 1d           2840        4.43859
  s        1056869        0.77606
  c                       0.00008
 2u           2840        2.63637
 3u          72335        2.37763
 4u          14796        2.77325
  c                       0.00000
 5d              0        4.30843
  s              0        0.59409
45th starting vertex was 76219
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 23.5264 seconds
MTEPS: 0.089139
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s             13        0.77063
 0d            108        2.75076
  s         111481        0.77595
 1d          32532        4.04652
  s        1881839        0.61560
  c                       0.00024
 2u          32532        2.78402
 3u          56214        2.33444
 4u           1215        2.57000
  c                       0.00000
 5d              0        4.17325
  s              0        0.77063
46th starting vertex was 30778
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 23.1223 seconds
MTEPS: 0.0906969
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              1        0.74162
 0d             16        3.32175
  s          44601        0.78674
 1d          17491        3.74243
  s        1783174        0.59414
  c                       0.00015
 2u          17491        2.38026
 3u          69477        2.37746
 4u           3081        2.55372
  c                       0.00000
 5d              0        4.12092
  s              0        0.63968
47th starting vertex was 39944
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 21.8232 seconds
MTEPS: 0.096096
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              4        0.59408
 0d             10        3.42813
  s          13066        0.77062
 1d           8924        3.60340
  s        1562959        0.68089
  c                       0.00013
 2u           8924        2.75266
 3u          74921        2.63245
 4u           6189        2.75019
  c                       0.00000
 5d              0        3.81058
  s              0        0.68015
48th starting vertex was 77613
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 22.9356 seconds
MTEPS: 0.0914353
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              1        0.61525
 0d              3        2.75089
  s           1335        0.72213
 1d           1367        3.81645
  s         761959        0.77605
  c                       0.00006
 2u           1367        2.92411
 3u          67146        2.60806
 4u          21419        2.75527
  c                       0.00000
 5d              0        3.81818
  s              0        0.77284
49th starting vertex was 3141
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 23.0985 seconds
MTEPS: 0.0907904
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              4        0.59408
 0d             19        3.17011
  s          12077        0.76599
 1d           9143        3.59200
  s        1576896        0.59413
  c                       0.00011
 2u           9143        2.37846
 3u          74870        2.37238
 4u           6013        2.62336
  c                       0.00000
 5d              0        3.96071
  s              0        0.78665
50th starting vertex was 20939
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 21.242 seconds
MTEPS: 0.0987251
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              0        0.67418
 0d              1        3.38305
  s           1107        0.77063
 1d           1077        3.41118
  s         658647        0.77066
  c                       0.00007
 2u           1077        2.82665
 3u          64330        2.77350
 4u          24491        2.37812
  c                       0.00001
 5d              0        3.60553
  s              0        0.77061
51th starting vertex was 54973
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 22.3792 seconds
MTEPS: 0.0937084
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s            217        0.63597
 0d            420        3.36685
  s         382266        0.78622
  c                       0.00006
 1u            420        2.76995
 2u          54268        2.57023
 3u          35047        2.90910
 4u            339        2.82069
  c                       0.00000
52th starting vertex was 54497
Number iterations: 5
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 15.9204 seconds
MTEPS: 0.131726
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              0        0.59408
 0d              8        3.07031
  s          12127        0.66425
 1d           7945        4.15909
  s        1515493        0.72500
  c                       0.00015
 2u           7945        2.55470
 3u          75170        2.57544
 4u           6914        2.76799
  c                       0.00000
 5d              0        4.03507
  s              0        0.65164
53th starting vertex was 8488
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 22.7019 seconds
MTEPS: 0.0923765
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              2        0.59410
 0d              4        3.54504
  s           3991        0.67984
 1d           3245        3.86543
  s        1121815        0.75325
  c                       0.00008
 2u           3245        2.51630
 3u          73366        2.61481
 4u          13390        2.48125
  c                       0.00000
 5d              0        4.04755
  s              0        0.77061
54th starting vertex was 74696
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 22.8275 seconds
MTEPS: 0.0918681
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              0        0.77063
 0d              5        2.78074
  s          39483        0.77590
 1d          15827        3.96085
  s        1752558        0.77069
  c                       0.00014
 2u          15827        2.57056
 3u          70730        2.37731
 4u           3500        2.63278
  c                       0.00000
 5d              0        3.56510
  s              0        0.59407
55th starting vertex was 34216
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 22.4207 seconds
MTEPS: 0.0935351
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s            233        0.78132
 0d            370        3.37405
  s         353113        0.77588
  c                       0.00007
 1u            370        2.53452
 2u          52673        2.57569
 3u          36664        2.92199
 4u            367        2.57517
  c                       0.00000
56th starting vertex was 82846
Number iterations: 5
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 15.9218 seconds
MTEPS: 0.131714
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              3        0.59657
 0d              6        3.29257
  s           1518        0.69426
 1d           2310        4.12151
  s         980198        0.77731
  c                       0.00007
 2u           2310        2.37837
 3u          71146        2.37762
 4u          16514        2.37755
  c                       0.00000
 5d              0        3.75752
  s              0        0.79200
57th starting vertex was 65966
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 21.4626 seconds
MTEPS: 0.0977105
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s            111        0.78131
 0d            342        3.18336
  s         339756        0.77062
  c                       0.00007
 1u            342        2.60731
 2u          51180        2.35586
 3u          38138        2.54332
 4u            414        2.37734
  c                       0.00000
58th starting vertex was 11996
Number iterations: 5
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 15.4123 seconds
MTEPS: 0.136068
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              0        0.59408
 0d              1        3.35595
  s           3180        0.77063
 1d           2959        3.33991
  s        1061186        0.78674
  c                       0.00012
 2u           2959        2.37823
 3u          72602        2.74164
 4u          14427        2.77894
  c                       0.00002
 5d              0        4.05730
  s              0        0.71659
59th starting vertex was 58008
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 21.9219 seconds
MTEPS: 0.0956633
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              0        0.77615
 0d              3        3.28928
  s           1798        0.65999
 1d           2205        3.56515
  s         958686        0.59449
  c                       0.00007
 2u           2205        2.77393
 3u          71019        2.61492
 4u          16747        2.62374
  c                       0.00000
 5d              0        4.33000
  s              0        0.79015
60th starting vertex was 38680
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 22.6654 seconds
MTEPS: 0.0925253
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s              2        0.60719
 0d             29        3.16088
  s          39857        0.77062
 1d          19871        4.16131
  s        1833786        0.66541
  c                       0.00016
 2u          19871        2.73114
 3u          67631        2.72651
 4u           2534        2.63722
  c                       0.00000
 5d              0        3.96016
  s              0        0.59408
61th starting vertex was 54522
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 22.9332 seconds
MTEPS: 0.0914447
Total communication (average so far): 0
A BFS iteration is starting
param 90133 vertices with 3729948 edges
186497 up and 181 down
  s             24        0.59408
 0d             38        3.12690
  s          69484        0.74969
 1d          23670        4.15994
  s        1849655        0.77074
  c                       0.00018
 2u          23670        2.51224
 3u          64309        2.55912
 4u           2051        2.77744
  c                       0.00000
 5d              0        3.86664
  s              0        0.77642
62th starting vertex was 84903
Number iterations: 6
Number of vertices found: 90075
Number of edges traversed: 2097123
BFS time: 22.4557 seconds
MTEPS: 0.0933892
Total communication (average so far): 0
A BFS iteration is starting

      Start 15: FBFS_Test
15/20 Test #15: FBFS_Test ........................***Failed    0.66 sec
Using synthetic data, which we ALWAYS permute for load balance
We only balance the original input, we don't repermute after each filter change
BFS is run on UNDIRECTED graph, hence hitting CCs, and TEPS is bidirectional
Forcing scale to : 16
graph_generation:               0.122206 s
Generated renamed edge lists
Converted to Boolean and removed 149 loops
As a whole: 65536 rows and 65536 columns and 909896 nonzeros
I/O (or generation) took 0.347164 seconds
As a whole: 65536 rows and 65536 columns and 909896 nonzeros
All degrees calculated
Load balance: 1.00815
Symmetricized

===================================================================================
=   BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
=   PID 95361 RUNNING AT yv.noip.me
=   EXIT CODE: 11
=   CLEANING UP REMAINING PROCESSES
=   YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
===================================================================================
YOUR APPLICATION TERMINATED WITH THE EXIT STRING: Segmentation fault (signal 11)
This typically refers to a problem with your application.
Please see the FAQ page for debugging suggestions

      Start 16: FMIS_Test
16/20 Test #16: FMIS_Test ........................***Failed    0.58 sec
COMBBLAS Warning: It is dangerous to create (matrix) objects without specifying the communicator, are you sure you want to create this object in MPI_COMM_WORLD?
Using synthetic data, which we ALWAYS permute for load balance
We only balance the original input, we don't repermute after each filter change
BFS is run on UNDIRECTED graph, hence hitting CCs, and TEPS is bidirectional
Forcing scale to : 17
graph_generation:               0.098421 s
Generated renamed edge lists
Converted to Boolean and removed 75 loops
As a whole: 131072 rows and 131072 columns and 619978 nonzeros
Generation took 0.374992 seconds
As a whole: 131072 rows and 131072 columns and 619978 nonzeros
All degrees calculated
Load balance: 1.02317
Symmetricized

===================================================================================
=   BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
=   PID 95367 RUNNING AT yv.noip.me
=   EXIT CODE: 11
=   CLEANING UP REMAINING PROCESSES
=   YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
===================================================================================
YOUR APPLICATION TERMINATED WITH THE EXIT STRING: Segmentation fault (signal 11)
This typically refers to a problem with your application.
Please see the FAQ page for debugging suggestions

      Start 17: RCM_Test
17/20 Test #17: RCM_Test .........................   Passed    6.69 sec
      Start 18: BPML_Test
18/20 Test #18: BPML_Test ........................   Passed   61.28 sec
      Start 19: BPMM_Test
19/20 Test #19: BPMM_Test ........................   Passed   13.79 sec
      Start 20: SpMSpVBench_test
20/20 Test #20: SpMSpVBench_test .................   Passed   30.26 sec

30% tests passed, 14 tests failed out of 20

Total Test time (real) = 1648.07 sec

The following tests FAILED:
	  2 - Multiplication_Test (Failed)
	  3 - SpGEMM3D_Test (Failed)
	  4 - HashSpGEMMTest (Failed)
	  5 - Reduction_Test (Failed)
	  6 - Iterator_Test (Failed)
	  7 - Transpose_Test (Failed)
	  8 - Indexing_Test (Failed)
	  9 - SpAsgn_Test (Failed)
	 10 - GalerkinNew_Test (Failed)
	 11 - FindSparse_Test (Failed)
	 12 - BetwCent_Test (Failed)
	 14 - DirOptBFS_Test (Timeout)
	 15 - FBFS_Test (Failed)
	 16 - FMIS_Test (Failed)
Errors while running CTest

Version: 2.0
FreeBSD 13.1

Illegal Operand from MTRand::initialize()

I get the following error when using another library based on this CombBLAS code:

[e16-24:11747:0:11747] Caught signal 4 (Illegal instruction: illegal operand)
/project/aoberai_286/jlclough/trilinos_project/tpls_install/combblas/include/psort/MersenneTwister.h: [ MTRand::initialize() ]  
...                                                                                                                                                                                                                                   290       int i = 1;                                         
291       *s++ = seed & 0xffffffffUL;         
292       for( ; i < N; ++i )                                                                                                                                                                
==>   293       {                                                                                                                                                                                                                           294               *s++ = ( 1812433253UL * ( *r ^ (*r >> 30) ) + i ) & 0xffffffffUL;                                                                      
295               r++;                                                         
296       }    
==== backtrace (tid:  11747) ====                                                                                                                                                                                                      
0 0x000000000042383c MTRand::initialize()  
/project/aoberai_286/jlclough/trilinos_project/tpls_install/combblas/include/psort/MersenneTwister.h:293                                                                                   
1 0x000000000042383c MTRand::seed()  
/project/aoberai_286/jlclough/trilinos_project/tpls_install/combblas/include/psort/MersenneTwister.h:218                                                                                         
2 0x000000000042383c MTRand::MTRand()  
/project/aoberai_286/jlclough/trilinos_project/tpls_install/combblas/include/psort/MersenneTwister.h:138                                                                                       
3 0x000000000042383c __static_initialization_and_destruction_0()  
/project/aoberai_286/jlclough/trilinos_project/tpls_src/CombBLAS/Applications/BipartiteMatchings/BPMaximalMatching.h:17                                             
4 0x000000000042383c _GLOBAL__sub_I_c2cpp_GetAWPM.cpp()  
/project/aoberai_286/jlclough/trilinos_project/tpls_src/superlu_dist-5.4.0/SRC/c2cpp_GetAWPM.cpp:63                                                                          
5 0x000000000054c66d __libc_csu_init()  ???:0                                                                                                                                                                                         
6 0x00000000000224e5 __libc_start_main()  ???:0                                                                                                                                                                                       
7 0x0000000000423af4 _start()  ???:0                                                                                                                                                                                                 
=================================

This has been a heisen-bug for me. I have the same CombBLAS version installed on another machine but haven't seen this error. Additionally, I only sometimes get this error; I haven't figured out a pattern or exact way to replicate it yet (sorry). My current workaround is to wait about 10 minutes and try again.

I was hoping there was a more permanent solution to this. Any ideas or advice?

Some other helpful info:

  • My CombBLAS version is from this commit: e6c55bd
  • The other library is SuperLU-Dist. I'm using version 5.4.0. (link to library)
  • The machine I have not had this problem on is a desktop:
    • It's running Ubuntu 19.10
    • I'm using gcc v9.2.1 and openmpi v3.1.3
  • The machine I am having this problem on is USC's HPC:
    • It's running CentOS 7.7.1908
    • I'm using gcc v9.2.0 and openmpi v4.0.2
  • I also get a similar "Illegal Operand" error when running ctest. These also come and go at seemingly random intervals; either they all pass or none of them do. When they do not pass, I get this output (example from ctest's test 1):
[e13-11:12671:0:12671] Caught signal 4 (Illegal instruction: illegal operand)                                                                                                                                                         
==== backtrace (tid:  12671) ====                                                                                                                                                                                                      
0 0x0000000000411501 combblas::DistEdgeList<long>::GenGraph500Data()  ???:0                                                                                                                                                           
1 0x000000000040d32b main()  ???:0                                                                                                                                                                                                    
2 0x0000000000022555 __libc_start_main()  ???:0                                                                                                                                                                                       
3 0x000000000040d984 _start()  ???:0                                                                                                                                                                                                 
=================================
  • I did read the nearby comment in MTRand::initialize() left by Matsumoto referencing Knuth's TAOCP and found a copy here. I don't have much background in this haven't gleaned much the cited passage.

Let me know if you need any other information from me. Thank you!

CombBLAS causes multiple definition of GlobalMT and ThreadBuffLenForBinning in SuperLU-Dist

CombBLAS provides BipartiteMatchings as an Application. But SuperLU-Dist uses CombBLAS's BipartiteMatchings ApproxWeightPerfectMatching.h and BPMaximalMatching.h when built with CombBLAS support (c2cpp_GetHWPM.cpp).

CombBLAS uses a handful of global definitions in these headers. This means that when linked in a library the way SuperLU-Dist uses, these definitions are exposed and triggered a multiple definition error, e.g. https://buildd.debian.org/status/fetch.php?pkg=superlu-dist&arch=s390x&ver=8.1.2%2Bdfsg1-1%2Bb2&stamp=1691085601&raw=0

CMakeFiles/superlu_dist.dir/z_c2cpp_GetHWPM.cpp.o:/usr/include/CombBLAS/BipartiteMatchings/BPMaximalMatching.h:17: multiple definition of `GlobalMT'; CMakeFiles/superlu_dist.dir/d_c2cpp_GetHWPM.cpp.o:/usr/include/CombBLAS/BipartiteMatchings/BPMaximalMatching.h:17: first defined here
/usr/bin/ld: CMakeFiles/superlu_dist.dir/z_c2cpp_GetHWPM.cpp.o: in function `combblas::ThreadBuffLenForBinning(int, int)':
/usr/include/CombBLAS/BipartiteMatchings/ApproxWeightPerfectMatching.h:401: multiple definition of `combblas::ThreadBuffLenForBinning(int, int)'; CMakeFiles/superlu_dist.dir/d_c2cpp_GetHWPM.cpp.o:/usr/include/CombBLAS/BipartiteMatchings/ApproxWeightPerfectMatching.h:401: first defined here
collect2: error: ld returned 1 exit status
make[3]: *** [SRC/CMakeFiles/superlu_dist.dir/build.make:2995: SRC/libsuperlu_dist.so.8.1.2] Error 1

The problem was previously raised for SuperLU-Dist at xiaoyeli/superlu_dist#40 and xiaoyeli/superlu_dist#60 . In Issue#60 a patch was suggested for CombBLAS 1.6 used by GNU at https://github.com/guix-mirror/guix/blob/master/gnu/packages/patches/combinatorial-blas-awpm.patch

Some elements of this patch have now been applied in CombBLAS 2.0.0. The "../" path to CombBLAS.h is fixed and t1Comp definitions removed. But other parts of the patch still need to be applied, as shown by the error message above. GlobalMT needs to be moved to a local definition and ThreadBuffLenForBinning needs to be inlined.

A debian version of the patch is https://salsa.debian.org/science-team/combblas/-/blob/master/debian/patches/AWPM_library_38dd27e.patch

Tests not passed because of timeout

Hi all.

Some tests are not passing because of timeout; i'm testing CombBLAS-2.0.0 in Fedora 39 x86_64 + GCC-13.2.1 + OpenMPI-4.1.5

/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:526       Start  1: GenMMWrite_Test
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:687 
1: Test command: /usr/lib64/openmpi/bin/mpiexec "-n" "4" "/builddir/build/BUILD/CombBLAS-2.0.0/build/openmpi/ReleaseTests/GenWrMat" "20" "16" "1" "scale20_ef16_symmetric.mtx"
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:695 1: Working Directory: /builddir/build/BUILD/CombBLAS-2.0.0/build/openmpi/ReleaseTests
/builddir/build/BUILD/cmake-3.27.1/Source/cmCTest.cxx:309    Current_Time: Aug 05 10:58 UTC
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:806 1: Test timeout computed to be: 1500
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:39 1: graph_generation:               1.882488 s
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:39 1: Generated renamed edge lists
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:39 1: Generation took 1.88297 seconds
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:39 1: Warning: Using smaller indices for the matrix than DistEdgeList
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:39 1: Local matrices are 524288-by-524288
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:39 1: Created Sparse Matrix (with int32 local indices and values)
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:39 1: Removed 412 loops
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:39 1: As a whole: 1048576 rows and 1048576 columns and 15700517 nonzeros
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:39 1: Symmetricized
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:39 1: Load balance: 1.01662
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:985  1/15 Test  #1: GenMMWrite_Test ..................
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:988 Testing GenMMWrite_Test ... 
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:256 ***Timeout 1500.11 sec
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:260 graph_generation:               1.882488 s
Generated renamed edge lists
Generation took 1.88297 seconds
Warning: Using smaller indices for the matrix than DistEdgeList
Local matrices are 524288-by-524288
Created Sparse Matrix (with int32 local indices and values)
Removed 412 loops
As a whole: 1048576 rows and 1048576 columns and 15700517 nonzeros
Symmetricized
Load balance: 1.01662
/builddir/build/BUILD/cmake-3.27.1/Source/cmCTest.cxx:309    Current_Time: Aug 05 11:23 UTC
...
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestMultiProcessHandler.cxx:168 test 2
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:526       Start  2: Multiplication_Test
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:687 
2: Test command: /usr/lib64/openmpi/bin/mpiexec "-n" "4" "/builddir/build/BUILD/CombBLAS-2.0.0/build/openmpi/ReleaseTests/MultTest" "../TESTDATA/rmat_scale16_A.mtx" "../TESTDATA/rmat_scale16_B.mtx" "../TESTDATA/rmat_scale16_productAB.mtx" "../TESTDATA/x_65536_halfdense.txt" "../TESTDATA/y_65536_halfdense.txt"
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:695 2: Working Directory: /builddir/build/BUILD/CombBLAS-2.0.0/build/openmpi/ReleaseTests
/builddir/build/BUILD/cmake-3.27.1/Source/cmCTest.cxx:309    Current_Time: Aug 05 11:23 UTC
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:806 2: Test timeout computed to be: 1500
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:39 2: Matrix is Float
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:39 2: Total number of nonzeros expected across all processors is 490228
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:39 2: File is 8909455 bytes
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:985  2/15 Test  #2: Multiplication_Test ..............
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:988 Testing Multiplication_Test ... 
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:256 ***Timeout 1500.07 sec
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:260 Matrix is Float
Total number of nonzeros expected across all processors is 490228
File is 8909455 bytes
/builddir/build/BUILD/cmake-3.27.1/Source/cmCTest.cxx:309    Current_Time: Aug 05 11:48 UTC
...
builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:526       Start  3: SpGEMM3D_Test
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:687 
3: Test command: /usr/lib64/openmpi/bin/mpiexec "-n" "16" "/builddir/build/BUILD/CombBLAS-2.0.0/build/openmpi/ReleaseTests/SpGEMM3DTest" "../TESTDATA/rmat_scale16_A.mtx" "../TESTDATA/rmat_scale16_B.mtx" "../TESTDATA/rmat_scale16_productAB.mtx"
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:695 3: Working Directory: /builddir/build/BUILD/CombBLAS-2.0.0/build/openmpi/ReleaseTests
/builddir/build/BUILD/cmake-3.27.1/Source/cmCTest.cxx:309    Current_Time: Aug 05 11:48 UTC
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:806 3: Test timeout computed to be: 1500
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:39 3: Matrix is Float
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:39 3: Total number of nonzeros expected across all processors is 490228
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:39 3: File is 8909455 bytes
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:39 3: Matrix is Float
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:39 3: Total number of nonzeros expected across all processors is 490265
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:39 3: File is 8897883 bytes
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:985  3/15 Test  #3: SpGEMM3D_Test ....................
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:988 Testing SpGEMM3D_Test ... 
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:256 ***Timeout 1500.11 sec
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:260 Matrix is Float
Total number of nonzeros expected across all processors is 490228
File is 8909455 bytes
Matrix is Float
Total number of nonzeros expected across all processors is 490265
File is 8897883 bytes
/builddir/build/BUILD/cmake-3.27.1/Source/cmCTest.cxx:309    Current_Time: Aug 05 12:13 UTC
...
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:526       Start 10: BetwCent_Test
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:687 
10: Test command: /usr/lib64/openmpi/bin/mpiexec "-n" "4" "/builddir/build/BUILD/CombBLAS-2.0.0/build/openmpi/Applications/betwcent" "../TESTDATA/SCALE16BTW-TRANSBOOL/" "10" "96"
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:695 10: Working Directory: /builddir/build/BUILD/CombBLAS-2.0.0/build/openmpi/Applications
/builddir/build/BUILD/cmake-3.27.1/Source/cmCTest.cxx:309    Current_Time: Aug 05 12:14 UTC
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:806 10: Test timeout computed to be: 1500
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:39 10: Matrix is Float
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:39 10: Total number of nonzeros expected across all processors is 490563
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:39 10: File is 6706976 bytes
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:985 10/15 Test #10: BetwCent_Test ....................
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:988 Testing BetwCent_Test ... 
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:256 ***Timeout 1500.10 sec
/builddir/build/BUILD/cmake-3.27.1/Source/CTest/cmCTestRunTest.cxx:260 Matrix is Float
Total number of nonzeros expected across all processors is 490563
File is 6706976 bytes
/builddir/build/BUILD/cmake-3.27.1/Source/cmCTest.cxx:309    Current_Time: Aug 05 12:39 UTC

CMake's configuration:

+ /usr/bin/cmake -S . -B redhat-linux-build -DCMAKE_C_FLAGS_RELEASE:STRING=-DNDEBUG -DCMAKE_CXX_FLAGS_RELEASE:STRING=-DNDEBUG -DCMAKE_Fortran_FLAGS_RELEASE:STRING=-DNDEBUG -DCMAKE_VERBOSE_MAKEFILE:BOOL=ON -DCMAKE_INSTALL_DO_STRIP:BOOL=OFF -DCMAKE_INSTALL_PREFIX:PATH=/usr -DINCLUDE_INSTALL_DIR:PATH=/usr/include -DLIB_INSTALL_DIR:PATH=/usr/lib64 -DSYSCONF_INSTALL_DIR:PATH=/etc -DSHARE_INSTALL_PREFIX:PATH=/usr/share -DLIB_SUFFIX=64 -DBUILD_SHARED_LIBS:BOOL=ON -B build/openmpi -S ./ -DCMAKE_INSTALL_PREFIX=/usr -DMPI_C_COMPILER:FILEPATH=/usr/lib64/openmpi/bin/mpicc -DMPI_CXX_COMPILER:FILEPATH=/usr/lib64/openmpi/bin/mpic++ -DMPIEXEC_NUMPROC_FLAG=-n -DMPIEXEC_MAX_NUMPROCS:STRING=8 -DMPI_C_HEADER_DIR:PATH=/usr/include/openmpi-ppc64le -DMPI_C_ADDITIONAL_INCLUDE_DIRS:STRING=/usr/include/openmpi-ppc64le -DMPI_CXX_HEADER_DIR:PATH=/usr/include/openmpi-ppc64le -DMPI_CXX_ADDITIONAL_INCLUDE_DIRS:STRING=/usr/include/openmpi-ppc64le -DMPI_LIB:PATH=/usr/lib64/openmpi/lib -DMPI_INCLUDE:PATH=/usr/include/openmpi-ppc64le
CMake Deprecation Warning at CMakeLists.txt:1 (cmake_minimum_required):
  Compatibility with CMake < 3.5 will be removed from a future version of
  CMake.
  Update the VERSION argument <min> value or use a ...<max> suffix to tell
  CMake that the project does not need compatibility with older versions.
-- The C compiler identification is GNU 13.2.1
-- The CXX compiler identification is GNU 13.2.1
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: /usr/lib64/openmpi/bin/mpicc - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /usr/lib64/openmpi/bin/mpic++ - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Found MPI_C: /usr/lib64/openmpi/bin/mpicc (found version "3.1") 
-- Found MPI_CXX: /usr/lib64/openmpi/bin/mpic++ (found version "3.1") 
-- Found MPI: TRUE (found version "3.1")  
-- Found OpenMP_C: -fopenmp (found version "4.5") 
-- Found OpenMP_CXX: -fopenmp (found version "4.5") 
-- Found OpenMP: TRUE (found version "4.5")  
-- Performing Test COMPILER_HAS_HIDDEN_VISIBILITY
-- Performing Test COMPILER_HAS_HIDDEN_VISIBILITY - Success
-- Performing Test COMPILER_HAS_HIDDEN_INLINE_VISIBILITY
-- Performing Test COMPILER_HAS_HIDDEN_INLINE_VISIBILITY - Success
-- Performing Test COMPILER_HAS_DEPRECATED_ATTR
-- Performing Test COMPILER_HAS_DEPRECATED_ATTR - Success
-- Configuring done (5.8s)
-- Generating done (0.2s)

Does the library provide the SpMM operation (sparse matrix times skinny dense matrix)?

In the paper describing the state of the library in version 2.0, you say that you've introduced the SpMM operation. However, I can not find the mentioned function in the code. Do you expect a user to craft it on their own using SpMV? If so, could you please provide some hints on how to do it quickly and efficiently, or am I overlooking something?

Four tests fail

Building the CombBLAS 2.0 release on Linux (Debian unstable) with OpenMPI 4.1.5, 4 out of 20 fail, running via ctest (/usr/bin/ctest --force-new-ctest-process --verbose -j8),

80% tests passed, 4 tests failed out of 20

Total Test time (real) = 970.11 sec

The following tests FAILED:
          8 - Indexing_Test (Failed)
          9 - SpAsgn_Test (Failed)
         15 - FBFS_Test (Failed)
         16 - FMIS_Test (Failed)

These are different to the failing tests in #15 , which seems to be driven by missing files.

The failing test output is,

Indexing_Test:

test 8
      Start  8: Indexing_Test

8: Test command: /usr/bin/mpiexec "-n" "4" "/projects/mathlibs/build/combblas/obj-x86_64-linux-gnu/ReleaseTests/IndexingTest" "../TESTDATA" "B_100x100.txt" "B_10x30_Indexed.txt" "rand10outta100.txt" "rand30outta100.txt"
8: Working Directory: /projects/mathlibs/build/combblas/obj-x86_64-linux-gnu/ReleaseTests
8: Test timeout computed to be: 1500
8: Indexing working correctly
8: Elements stored on proc 0: {(0,0.234), (1,0.829), (2,0.221), (3,0.454), (4,0.096), (5,0.399), (6,0.895), (7,0.156), (8,0.052), (9,0.709), (10,0.305), (11,0.669), (12,0.493), (13,0.619), (14,0.736), (15,0.615), (16,0.124), (17,0.831), (18,0.958), (19,0.284), (20,0.411), (21,0.473
8: Elements stored on proc 1: {(0,0.196), (1,0.571), (2,0.482), (3,0.09), (4,0.79), (5,0.939), (6,0.684), (7,0.465), (8,0.236), (9,0.713), (10,0.32), (11,0.748), (12,0.771), (13,0.123), (14,0.79), (15,0.06), (16,0.82), (17,0.506), (18,0.859), (19,0.268), (20,0.49), (21,0.01), (22,0
8: Elements stored on proc 2: {(0,0.159), (1,0.811), (2,0.198), (3,0.163), (4,0.779), (5,0.241), (6,0.623), (7,0.955), (8,0.258), (9,0.861), (10,0.104), (11,0.381), (12,0.657), (13,0.356), (14,0.083), (15,0.712), (16,0.413), (17,0.488), (18,0.646), (19,0.99), (20,0.523), (21,0.034)
8: Elements stored on proc 3: {(0,0.609), (1,0.557), (2,0.926), (3,0.481), (4,0.218), (5,0.92), (6,0.049), (7,0.052), (8,0.424), (9,0.214), (10,0.606), (11,0.385), (12,0.848), (13,0.583), (14,0.586), (15,0.615), (16,0.797), (17,0.48), (18,0.378), (19,0.66), (20,0.169), (21,0.258),
8: COMBBLAS Warning: It is dangerous to create (vector) objects without specifying the communicator, are you sure you want to create this object in MPI_COMM_WORLD?
8: COMBBLAS Warning: It is dangerous to create (vector) objects without specifying the communicator, are you sure you want to create this object in MPI_COMM_WORLD?
8: [sandy:2061479] *** An error occurred in MPI_Alltoallv
8: [sandy:2061479] *** reported by process [2022768641,1]
8: [sandy:2061479] *** on communicator MPI COMMUNICATOR 3 DUP FROM 0
8: [sandy:2061479] *** MPI_ERR_TRUNCATE: message truncated
8: [sandy:2061479] *** MPI_ERRORS_ARE_FATAL (processes in this communicator will now abort,
8: [sandy:2061479] ***    and potentially your MPI job)
8: [sandy:2061523] *** Process received signal ***
8: [sandy:2061523] Signal: Segmentation fault (11)
8: [sandy:2061523] Signal code: Address not mapped (1)
8: [sandy:2061523] Failing at address: 0x78a63cc0
8: [sandy:2061523] [ 0] /lib/x86_64-linux-gnu/libc.so.6(+0x3c510)[0x7fa666c5a510]
8: [sandy:2061523] [ 1] /lib/x86_64-linux-gnu/libc.so.6(+0x152449)[0x7fa666d70449]
8: [sandy:2061523] [ 2] /usr/lib/x86_64-linux-gnu/libopen-pal.so.40(opal_convertor_pack+0xaf)[0x7fa6670ae0df]
8: [sandy:2061523] [ 3] /usr/lib/x86_64-linux-gnu/libmpi.so.40(ompi_datatype_sndrcv+0x1fe)[0x7fa66729055e]
8: [sandy:2061523] [ 4] /usr/lib/x86_64-linux-gnu/libmpi.so.40(ompi_coll_base_alltoallv_intra_basic_linear+0x2bf)[0x7fa6672decaf]
8: [sandy:2061523] [ 5] /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_tuned.so(ompi_coll_tuned_alltoallv_intra_dec_fixed+0x42)[0x7fa6649e6fa2]
8: [sandy:2061523] [ 6] /usr/lib/x86_64-linux-gnu/libmpi.so.40(PMPI_Alltoallv+0x1b5)[0x7fa667293315]
8: [sandy:2061523] [ 7] /projects/mathlibs/build/combblas/obj-x86_64-linux-gnu/ReleaseTests/IndexingTest(+0x1b151)[0x562012e18151]
8: [sandy:2061523] [ 8] /projects/mathlibs/build/combblas/obj-x86_64-linux-gnu/ReleaseTests/IndexingTest(_ZN8combblas11SpParHelper13KeyValuePSortIdiiEESt6vectorISt4pairIT_T0_ESaIS6_EEPS6_T1_PSA_RKP19ompi_communicator_t+0x3bb)[0x562012e3ac7b]
8: [sandy:2061523] [ 9] /projects/mathlibs/build/combblas/obj-x86_64-linux-gnu/ReleaseTests/IndexingTest(_ZN8combblas14FullyDistSpVecIidE4sortEv+0x284)[0x562012e3af34]
8: [sandy:2061523] [10] /projects/mathlibs/build/combblas/obj-x86_64-linux-gnu/ReleaseTests/IndexingTest(_Z4TopKIidESt4pairIN8combblas12FullyDistVecIT_S3_EENS2_IS3_T0_EEERNS1_14FullyDistSpVecIS3_S5_EES3_+0x247)[0x562012e3b3a7]
8: [sandy:2061523] [11] /projects/mathlibs/build/combblas/obj-x86_64-linux-gnu/ReleaseTests/IndexingTest(main+0xa2c)[0x562012e12ebc]
8: [sandy:2061523] [12] /lib/x86_64-linux-gnu/libc.so.6(+0x276ca)[0x7fa666c456ca]
8: [sandy:2061523] [13] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0x85)[0x7fa666c45785]
8: [sandy:2061523] [14] /projects/mathlibs/build/combblas/obj-x86_64-linux-gnu/ReleaseTests/IndexingTest(_start+0x21)[0x562012e13981]
8: [sandy:2061523] *** End of error message ***
8: [sandy:2061354] 2 more processes have sent help message help-mpi-errors.txt / mpi_errors_are_fatal
8: [sandy:2061354] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages
 3/20 Test  #8: Indexing_Test ....................***Failed   20.56 sec

SpAsgn_Test:

test 9
      Start  9: SpAsgn_Test

9: Test command: /usr/bin/mpiexec "-n" "4" "/projects/mathlibs/build/combblas/obj-x86_64-linux-gnu/ReleaseTests/SpAsgnTest" "../TESTDATA" "A_100x100.txt" "A_with20x30hole.txt" "dense_20x30matrix.txt" "A_wdenseblocks.txt" "20outta100.txt" "30outta100.txt"
9: Working Directory: /projects/mathlibs/build/combblas/obj-x86_64-linux-gnu/ReleaseTests
9: Test timeout computed to be: 1500
9: Pruning is working
9: SpAsgn working correctly
9: COMBBLAS Warning: It is dangerous to create (vector) objects without specifying the communicator, are you sure you want to create this object in MPI_COMM_WORLD?
9: COMBBLAS Warning: It is dangerous to create (vector) objects without specifying the communicator, are you sure you want to create this object in MPI_COMM_WORLD?
9: [sandy:2061949] *** An error occurred in MPI_Alltoallv
9: [sandy:2061949] *** reported by process [2060517377,0]
9: [sandy:2061949] *** on communicator MPI COMMUNICATOR 3 DUP FROM 0
9: [sandy:2061949] *** MPI_ERR_COUNT: invalid count argument
9: [sandy:2061949] *** MPI_ERRORS_ARE_FATAL (processes in this communicator will now abort,
9: [sandy:2061949] ***    and potentially your MPI job)
9: [sandy:2061930] 3 more processes have sent help message help-mpi-errors.txt / mpi_errors_are_fatal
9: [sandy:2061930] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages
11/20 Test  #9: SpAsgn_Test ......................***Failed  155.20 sec

FBFS_Test:

test 15
      Start 15: FBFS_Test

15: Test command: /usr/bin/mpiexec "-n" "4" "/projects/mathlibs/build/combblas/obj-x86_64-linux-gnu/Applications/fbfs" "Gen" "16"
15: Working Directory: /projects/mathlibs/build/combblas/obj-x86_64-linux-gnu/Applications
15: Test timeout computed to be: 1500
15: Using synthetic data, which we ALWAYS permute for load balance
15: We only balance the original input, we don't repermute after each filter change
15: BFS is run on UNDIRECTED graph, hence hitting CCs, and TEPS is bidirectional
15: Forcing scale to : 16
15: graph_generation:               1.415538 s
15: Generated renamed edge lists
15: Converted to Boolean and removed 149 loops
15: As a whole: 65536 rows and 65536 columns and 909896 nonzeros
15: I/O (or generation) took 9.55391 seconds
15: As a whole: 65536 rows and 65536 columns and 909896 nonzeros
15: All degrees calculated
15: Load balance: 1.00815
15: [sandy:2062597] *** Process received signal ***
15: Symmetricized
15: --------------------------------------------------------------------------
15: Primary job  terminated normally, but 1 process returned
15: a non-zero exit code. Per user-direction, the job has been aborted.
15: --------------------------------------------------------------------------
15: --------------------------------------------------------------------------
15: mpiexec noticed that process rank 0 with PID 0 on node sandy exited on signal 11 (Segmentation fault).
15: --------------------------------------------------------------------------
 8/20 Test #15: FBFS_Test ........................***Failed   24.88 sec

FMIS_Test:

test 16
      Start 16: FMIS_Test

16: Test command: /usr/bin/mpiexec "-n" "4" "/projects/mathlibs/build/combblas/obj-x86_64-linux-gnu/Applications/fmis" "17"
16: Working Directory: /projects/mathlibs/build/combblas/obj-x86_64-linux-gnu/Applications
16: Test timeout computed to be: 1500
16: COMBBLAS Warning: It is dangerous to create (matrix) objects without specifying the communicator, are you sure you want to create this object in MPI_COMM_WORLD?
16: Using synthetic data, which we ALWAYS permute for load balance
16: We only balance the original input, we don't repermute after each filter change
16: BFS is run on UNDIRECTED graph, hence hitting CCs, and TEPS is bidirectional
16: Forcing scale to : 17
16: Generated renamed edge lists
16: graph_generation:               0.647811 s
16: Converted to Boolean and removed 75 loops
16: As a whole: 131072 rows and 131072 columns and 619978 nonzeros
16: Generation took 6.18405 seconds
16: As a whole: 131072 rows and 131072 columns and 619978 nonzeros
16: All degrees calculated
16: Load balance: 1.02317
16: Symmetricized
16: --------------------------------------------------------------------------
16: Primary job  terminated normally, but 1 process returned
16: a non-zero exit code. Per user-direction, the job has been aborted.
16: --------------------------------------------------------------------------
16: --------------------------------------------------------------------------
16: mpiexec noticed that process rank 0 with PID 0 on node sandy exited on signal 11 (Segmentation fault).
16: --------------------------------------------------------------------------
10/20 Test #16: FMIS_Test ........................***Failed   26.22 sec

CombBLAS releases

Hi all.

Is it expected a CombBLAS release in future as continuation of CombBLAS-1.6.0-beta2?

Error while linking CXX executable lcc

While compiling CombBLAS, I find link error messages indicating

 undefined reference to `cblas_allgathertime'
 undefined reference to `cblas_alltoalltime'
 undefined reference to `cblas_localspmvtime'
 undefined reference to `cblas_mergeconttime'
 undefined reference to `cblas_transvectime' 

Here is an excerpt from the output of executing make :

...
[ 93%] Linking CXX executable lcc
CMakeFiles/lcc.dir/LargestCC.cpp.o: In function `void combblas::AllGatherVector<long, long>(ompi_communicator_t*&, int, long, int*&, long*&, int*&, long*&, int&, bool)':
LargestCC.cpp:(.text._ZN8combblas15AllGatherVectorIllEEvRP19ompi_communicator_tiT_RPiRPT0_S6_S9_Rib[_ZN8combblas15AllGatherVectorIllEEvRP19ompi_communicator_tiT_RPiRPT0_S6_S9_Rib]+0x325): undefined reference to `cblas_allgathertime'
...

Browsing through the online documentation, I find these variables defined in other source files, e.g. TopDownBFS.cpp and FilteredBFS.cpp, but not in LargestCC.cpp.

Windows VisualStudio 2019 (CMake) build ?

Any plans to get this to build in Windows (VS2019 using CMake mode) ? I think it is pretty close. There are a few headers problems (like unistd.h and sys/time) but these can be fixed . There is some small assembly code which needs to be changed to work in VS (uses GCC syntax) , and there are 2 functions which give errors because the old "Variable Length arrays" which is not C++ standard and which is not supported at all (no extension) for Microsoft tools. One is in \combblas\usort\src\parUtils.cpp (for sure VA) and another is probably same but implies a lot of templates, so it may be a different problem in \combblas\include\CombBLAS\mtSpGEMM.h Everything else builds, there are a few packages required but using vcpkg package manager they are found and build, so all dependencies are there.

SpParMat3D Fails to Recognize Headers from parfriends.h

I have a patch for this, but there is probably a better workaround. Compiling SpParMat3D.cpp gets the following error:

/global/homes/v/vbharadw/diBELLA.2D/CombBLAS/install/include/CombBLAS/SpParMat3D.cpp:739:44: error: 'LocalHybridSpGEMM' was not declared in this scope SpTuples<IT,NT> * C_cont = LocalHybridSpGEMM<SR, NT> ^~~~~~~~~~~~~~~~~ /global/homes/v/vbharadw/diBELLA.2D/CombBLAS/install/include/CombBLAS/SpParMat3D.cpp:739:64: error: expected primary-expression before ',' token SpTuples<IT,NT> * C_cont = LocalHybridSpGEMM<SR, NT> ^ /global/homes/v/vbharadw/diBELLA.2D/CombBLAS/install/include/CombBLAS/SpParMat3D.cpp:763:42: error: 'MultiwayMerge' was not declared in this scope SpTuples<IT,NT> * C_tuples = MultiwayMerge<SR>(tomerge, C_m, C_n, true); ^~~~~~~~~~~~~ /global/homes/v/vbharadw/diBELLA.2D/CombBLAS/install/include/CombBLAS/SpParMat3D.cpp:763:58: error: expected primary-expression before '>' token SpTuples<IT,NT> * C_tuples = MultiwayMerge<SR>(tomerge, C_m, C_n, true); ^ /global/homes/v/vbharadw/diBELLA.2D/CombBLAS/install/include/CombBLAS/SpParMat3D.cpp:983:64: error: expected primary-expression before ',' token SpTuples<IT, NT> * merged_tuples = MultiwayMerge<SR, IT, NT>(recvChunks, recvChunks[0]->getnrow(), recvChunks[0]->getncol(), false); // Do not delete

The LocalHybridSpGEMM and MultiwayMerge header files should be included by parfriends.h (which is included by SpParMat3D.cpp), but for some reason it cannot find those headers. I fixed it by directly including the header files mtSpGEMM.h and MultiwayMerge.h in SpParMat3D.cpp, but this required also adding header guards within those respective files to avoid redefinition with parfriends.h. There is probably a better way to fix this, but just documenting this issue for now.

build fails with Intel 19.1

-- The C compiler identification is Intel 19.1.0.20200306
-- The CXX compiler identification is Intel 19.1.0.20200306
-- Check for working C compiler: /mpcdf/soft/SLE_12/packages/x86_64/intel_parallel_studio/2020.1/compilers_and_libraries_2020.1.217/linux/mpi/intel64/bin/mpiicc
-- Check for working C compiler: /mpcdf/soft/SLE_12/packages/x86_64/intel_parallel_studio/2020.1/compilers_and_libraries_2020.1.217/linux/mpi/intel64/bin/mpiicc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /mpcdf/soft/SLE_12/packages/x86_64/intel_parallel_studio/2020.1/compilers_and_libraries_2020.1.217/linux/mpi/intel64/bin/mpiicpc
-- Check for working CXX compiler: /mpcdf/soft/SLE_12/packages/x86_64/intel_parallel_studio/2020.1/compilers_and_libraries_2020.1.217/linux/mpi/intel64/bin/mpiicpc -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Found MPI_C: /mpcdf/soft/SLE_12/packages/x86_64/intel_parallel_studio/2020.1/compilers_and_libraries_2020.1.217/linux/mpi/intel64/bin/mpiicc (found version "3.1")
-- Found MPI_CXX: /mpcdf/soft/SLE_12/packages/x86_64/intel_parallel_studio/2020.1/compilers_and_libraries_2020.1.217/linux/mpi/intel64/bin/mpiicpc (found version "3.1")
-- Found MPI: TRUE (found version "3.1")
-- Found OpenMP_C: -qopenmp (found version "5.0")
-- Found OpenMP_CXX: -qopenmp (found version "5.0")
-- Found OpenMP: TRUE (found version "5.0")
-- Performing Test COMPILER_HAS_HIDDEN_VISIBILITY
-- Performing Test COMPILER_HAS_HIDDEN_VISIBILITY - Success
-- Performing Test COMPILER_HAS_HIDDEN_INLINE_VISIBILITY
-- Performing Test COMPILER_HAS_HIDDEN_INLINE_VISIBILITY - Success
-- Performing Test COMPILER_HAS_DEPRECATED_ATTR
-- Performing Test COMPILER_HAS_DEPRECATED_ATTR - Success
-- Configuring done
-- Generating done
-- Build files have been written to: /u/iholod/bin/CombBLAS/build

[ 47%] Building CXX object ReleaseTests/CMakeFiles/GalerkinNew.dir/GalerkinNew.cpp.o
/u/iholod/bin/CombBLAS/include/CombBLAS/SpParMat.cpp(2803): error: no instance of overloaded function "std::vector<_Tp, _Alloc>::push_back [with _Tp=std::tuple<IT={int64_t={long}}, IT={int64_t={long}}, NT={double}>, _Alloc=std::allocator<std::tuple<IT={int64_t={long}}, IT={int64_t={long}}, NT={double}>>]" matches the argument list
argument types are: ({...})
object type is: std::vector<std::tuple<IT, IT, NT>, std::allocator<std::tuple<IT, IT, NT>>>
btuples[rbid][cbid][owner].push_back({ridx_l, cidx_l, tuples.numvalue(i)});
^
/usr/include/c++/4.8/bits/stl_vector.h(919): note: this candidate was rejected because arguments do not match
push_back(value_type&& __x)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.