|
|
|
|
HPM Counter Statistics | ||||
---|---|---|---|---|
Event | Ntasks | Avg | Min(rank) | Max(rank) |
Communication Event Statistics (0.00% detail, 4.4160e+03 error) | |||||||
---|---|---|---|---|---|---|---|
Buffer Size | Ncalls | Total Time | Min Time | Max Time | %MPI | %Wall | |
MPI_Iprobe | 0 | 53465089953 | 11764.758 | 0.000e+00 | 8.538e-02 | 266.41 | 112.38 |
MPI_Test | 0 | 45720158632 | 8508.112 | 0.000e+00 | 1.571e-01 | 192.67 | 81.27 |
MPI_Testall | 0 | 7716512353 | 8325.106 | 0.000e+00 | 8.372e-02 | 188.52 | 79.53 |
MPI_Allreduce | 8 | 2032128 | 2815.649 | 2.980e-05 | 6.352e-02 | 63.76 | 26.90 |
MPI_Allreduce | 4 | 1368576 | 1346.763 | 2.694e-05 | 1.051e-02 | 30.50 | 12.87 |
MPI_Waitall | 65536 | 781009 | 597.451 | 1.502e-05 | 1.273e-02 | 13.53 | 5.71 |
MPI_Send | 28 | 15535661 | 732.655 | 0.000e+00 | 8.664e-02 | 16.59 | 7.00 |
MPI_Send | 4 | 12883249 | 482.123 | 0.000e+00 | 6.220e-02 | 10.92 | 4.61 |
MPI_Isend | 8 | 32322401 | 391.943 | 0.000e+00 | 9.487e-02 | 8.88 | 3.74 |
MPI_Waitall | 20480 | 46927 | 20.794 | 1.907e-06 | 8.019e-03 | 0.47 | 0.20 |
MPI_Waitall | 80 | 6898 | 2.053 | 0.000e+00 | 5.033e-03 | 0.05 | 0.02 |
MPI_Waitall | 8192 | 121654 | 16.083 | 9.537e-07 | 1.558e-02 | 0.36 | 0.15 |
MPI_Waitall | 57344 | 219137 | 156.588 | 1.502e-05 | 1.270e-02 | 3.55 | 1.50 |
MPI_Waitall | 64 | 5009 | 1.316 | 0.000e+00 | 5.025e-03 | 0.03 | 0.01 |
MPI_Waitall | 32768 | 654945 | 157.517 | 3.815e-06 | 8.829e-03 | 3.57 | 1.50 |
MPI_Waitall | 4096 | 139723 | 38.244 | 0.000e+00 | 3.974e-02 | 0.87 | 0.37 |
MPI_Waitall | 2560 | 114493 | 28.777 | 0.000e+00 | 2.238e-02 | 0.65 | 0.27 |
MPI_Waitall | 2048 | 306139 | 42.109 | 0.000e+00 | 1.598e-02 | 0.95 | 0.40 |
MPI_Waitall | 10240 | 377609 | 33.193 | 9.537e-07 | 1.558e-02 | 0.75 | 0.32 |
MPI_Waitall | 96 | 6369 | 2.078 | 0.000e+00 | 1.558e-02 | 0.05 | 0.02 |
MPI_Recv | 8 | 17719554 | 125.272 | 0.000e+00 | 3.416e-02 | 2.84 | 1.20 |
MPI_Waitall | 640 | 88026 | 18.108 | 0.000e+00 | 1.107e-02 | 0.41 | 0.17 |
MPI_Waitall | 16384 | 31368 | 9.710 | 2.146e-06 | 5.305e-03 | 0.22 | 0.09 |
MPI_Waitall | 12288 | 49494 | 14.735 | 1.907e-06 | 4.665e-03 | 0.33 | 0.14 |
MPI_Waitall | 768 | 109565 | 15.855 | 9.537e-07 | 3.894e-02 | 0.36 | 0.15 |
MPI_Scan | 4 | 138240 | 84.737 | 7.606e-05 | 2.531e-03 | 1.92 | 0.81 |
MPI_Waitall | 1792 | 84855 | 16.389 | 0.000e+00 | 1.603e-02 | 0.37 | 0.16 |
MPI_Waitall | 512 | 87008 | 26.425 | 0.000e+00 | 3.919e-02 | 0.60 | 0.25 |
MPI_Waitall | 1024 | 138345 | 21.646 | 0.000e+00 | 1.558e-02 | 0.49 | 0.21 |
MPI_Isend | 4 | 42313462 | 77.258 | 0.000e+00 | 6.956e-02 | 1.75 | 0.74 |
MPI_Waitall | 5120 | 188504 | 33.223 | 9.537e-07 | 1.557e-02 | 0.75 | 0.32 |
MPI_Isend | 12288 | 5803984 | 46.224 | 0.000e+00 | 9.091e-04 | 1.05 | 0.44 |
MPI_Waitall | 1536 | 22066 | 9.789 | 9.537e-07 | 1.406e-02 | 0.22 | 0.09 |
MPI_Waitall | 1280 | 35477 | 13.401 | 0.000e+00 | 1.248e-02 | 0.30 | 0.13 |
MPI_Waitall | 896 | 119725 | 15.736 | 0.000e+00 | 1.558e-02 | 0.36 | 0.15 |
MPI_Waitall | 3584 | 30469 | 17.489 | 9.537e-07 | 1.560e-02 | 0.40 | 0.17 |
MPI_Waitall | 256 | 48245 | 18.099 | 0.000e+00 | 3.943e-02 | 0.41 | 0.17 |
MPI_Waitall | 7168 | 19537 | 3.285 | 9.537e-07 | 2.729e-03 | 0.07 | 0.03 |
MPI_Waitall | 28672 | 177585 | 40.717 | 3.815e-06 | 6.875e-03 | 0.92 | 0.39 |
MPI_Isend | 16 | 4501453 | 11.102 | 0.000e+00 | 3.442e-02 | 0.25 | 0.11 |
MPI_Bcast | 4 | 262656 | 38.726 | 0.000e+00 | 4.131e-03 | 0.88 | 0.37 |
MPI_Waitall | 320 | 55445 | 21.620 | 0.000e+00 | 3.942e-02 | 0.49 | 0.21 |
MPI_Waitall | 112 | 6448 | 2.367 | 0.000e+00 | 1.552e-02 | 0.05 | 0.02 |
MPI_Waitall | 224 | 17309 | 6.604 | 0.000e+00 | 3.944e-02 | 0.15 | 0.06 |
MPI_Waitall | 192 | 12769 | 5.006 | 0.000e+00 | 3.921e-02 | 0.11 | 0.05 |
MPI_Waitall | 6144 | 194430 | 32.753 | 9.537e-07 | 1.558e-02 | 0.74 | 0.31 |
MPI_Waitall | 655360 | 10648 | 33.643 | 1.449e-03 | 5.647e-03 | 0.76 | 0.32 |
MPI_Waitall | 384 | 48259 | 18.210 | 9.537e-07 | 3.940e-02 | 0.41 | 0.17 |
MPI_Waitall | 448 | 42168 | 14.660 | 0.000e+00 | 3.913e-02 | 0.33 | 0.14 |
MPI_Waitall | 458752 | 13041 | 29.472 | 9.091e-04 | 4.355e-03 | 0.67 | 0.28 |
MPI_Waitall | 160 | 11171 | 4.572 | 0.000e+00 | 8.320e-02 | 0.10 | 0.04 |
MPI_Waitall | 393216 | 11114 | 28.659 | 7.141e-04 | 5.470e-03 | 0.65 | 0.27 |
MPI_Waitall | 81920 | 34150 | 28.322 | 2.098e-05 | 3.280e-03 | 0.64 | 0.27 |
MPI_Waitall | 24576 | 32218 | 27.286 | 1.907e-06 | 7.755e-03 | 0.62 | 0.26 |
MPI_Waitall | 49152 | 32752 | 17.397 | 1.097e-05 | 9.900e-03 | 0.39 | 0.17 |
MPI_Waitall | 128 | 11870 | 4.766 | 0.000e+00 | 3.924e-02 | 0.11 | 0.05 |
MPI_Waitall | 3072 | 14571 | 15.489 | 9.537e-07 | 1.563e-02 | 0.35 | 0.15 |
MPI_Waitall | 327680 | 12204 | 22.752 | 3.781e-04 | 4.742e-03 | 0.52 | 0.22 |
MPI_Waitall | 196608 | 15674 | 21.421 | 6.008e-05 | 4.287e-03 | 0.49 | 0.20 |
MPI_Isend | 24 | 2694914 | 7.057 | 0.000e+00 | 3.480e-02 | 0.16 | 0.07 |
MPI_Waitall | 229376 | 15819 | 20.067 | 3.231e-04 | 4.030e-03 | 0.45 | 0.19 |
MPI_Isend | 32 | 6359499 | 11.369 | 0.000e+00 | 2.692e-02 | 0.26 | 0.11 |
MPI_Waitall | 98304 | 30183 | 16.592 | 1.812e-05 | 2.861e-03 | 0.38 | 0.16 |
MPI_Irecv | 8 | 14602847 | 2.097 | 0.000e+00 | 2.813e-05 | 0.05 | 0.02 |
MPI_Waitall | 40960 | 36422 | 14.741 | 8.106e-06 | 3.158e-03 | 0.33 | 0.14 |
MPI_Waitall | 0 | 838837 | 11.402 | 0.000e+00 | 1.706e-02 | 0.26 | 0.11 |
MPI_Isend | 12 | 5616059 | 14.179 | 0.000e+00 | 4.296e-02 | 0.32 | 0.14 |
MPI_Irecv | 12288 | 5803984 | 8.104 | 0.000e+00 | 7.381e-04 | 0.18 | 0.08 |
MPI_Isend | 64 | 4634546 | 6.522 | 0.000e+00 | 8.112e-03 | 0.15 | 0.06 |
MPI_Isend | 40 | 4395748 | 7.486 | 0.000e+00 | 3.167e-02 | 0.17 | 0.07 |
MPI_Waitall | 114688 | 21291 | 11.908 | 4.816e-05 | 2.840e-03 | 0.27 | 0.11 |
MPI_Waitall | 163840 | 14914 | 11.812 | 2.885e-05 | 3.059e-03 | 0.27 | 0.11 |
MPI_Isend | 1536 | 2899090 | 3.419 | 0.000e+00 | 1.020e-03 | 0.08 | 0.03 |
MPI_Waitall | 131072 | 14233 | 11.273 | 2.217e-05 | 2.793e-03 | 0.26 | 0.11 |
MPI_Isend | 6144 | 4998900 | 10.735 | 0.000e+00 | 1.049e-04 | 0.24 | 0.10 |
MPI_Isend | 48 | 4299238 | 6.576 | 0.000e+00 | 3.253e-02 | 0.15 | 0.06 |
MPI_Waitall | 262144 | 5217 | 10.053 | 3.500e-04 | 4.653e-03 | 0.23 | 0.10 |
MPI_Isend | 80 | 2605119 | 3.576 | 0.000e+00 | 7.761e-04 | 0.08 | 0.03 |
MPI_Waitall | 14336 | 7617 | 2.189 | 2.146e-06 | 2.449e-03 | 0.05 | 0.02 |
MPI_Isend | 56 | 4122697 | 5.878 | 0.000e+00 | 4.794e-03 | 0.13 | 0.06 |
MPI_Waitall | 524288 | 2904 | 8.839 | 1.313e-03 | 6.659e-03 | 0.20 | 0.08 |
MPI_Isend | 128 | 2496515 | 2.947 | 0.000e+00 | 2.720e-04 | 0.07 | 0.03 |
MPI_Isend | 96 | 2759791 | 3.475 | 0.000e+00 | 4.306e-03 | 0.08 | 0.03 |
MPI_Irecv | 4 | 49650470 | 8.057 | 0.000e+00 | 8.189e-02 | 0.18 | 0.08 |
MPI_Isend | 20 | 2579835 | 7.786 | 0.000e+00 | 2.090e-02 | 0.18 | 0.07 |
MPI_Isend | 112 | 2389029 | 2.951 | 0.000e+00 | 1.320e-02 | 0.07 | 0.03 |
MPI_Isend | 28 | 2565751 | 6.120 | 0.000e+00 | 3.508e-02 | 0.14 | 0.06 |
MPI_Isend | 192 | 1891070 | 1.942 | 0.000e+00 | 8.329e-03 | 0.04 | 0.02 |
MPI_Isend | 224 | 2127117 | 2.241 | 0.000e+00 | 8.888e-04 | 0.05 | 0.02 |
MPI_Isend | 16384 | 352747 | 4.767 | 0.000e+00 | 6.769e-04 | 0.11 | 0.05 |
MPI_Irecv | 28 | 17787874 | 4.679 | 0.000e+00 | 8.199e-02 | 0.11 | 0.04 |
MPI_Isend | 160 | 1005841 | 1.061 | 0.000e+00 | 4.101e-05 | 0.02 | 0.01 |
MPI_Isend | 256 | 1444126 | 1.546 | 0.000e+00 | 6.039e-04 | 0.03 | 0.01 |
MPI_Comm_size | 0 | 40945688 | 2.146 | 0.000e+00 | 8.101e-02 | 0.05 | 0.02 |
MPI_Comm_rank | 0 | 37962396 | 2.139 | 0.000e+00 | 3.290e-04 | 0.05 | 0.02 |
MPI_Isend | 10240 | 168790 | 2.749 | 0.000e+00 | 7.470e-04 | 0.06 | 0.03 |
MPI_Isend | 768 | 2258556 | 2.739 | 0.000e+00 | 8.082e-05 | 0.06 | 0.03 |
MPI_Isend | 32768 | 134474 | 2.401 | 0.000e+00 | 3.390e-04 | 0.05 | 0.02 |
MPI_Isend | 14336 | 203737 | 2.340 | 0.000e+00 | 6.909e-04 | 0.05 | 0.02 |
MPI_Isend | 8192 | 187340 | 1.648 | 0.000e+00 | 7.112e-04 | 0.04 | 0.02 |
MPI_Irecv | 16384 | 352747 | 1.596 | 0.000e+00 | 7.610e-04 | 0.04 | 0.02 |
MPI_Isend | 640 | 1520601 | 1.588 | 0.000e+00 | 8.202e-05 | 0.04 | 0.02 |
MPI_Recv | 4 | 5546241 | 1.579 | 0.000e+00 | 1.295e-03 | 0.04 | 0.02 |
MPI_Isend | 40960 | 101221 | 1.462 | 0.000e+00 | 6.950e-04 | 0.03 | 0.01 |
MPI_Irecv | 81920 | 86016 | 1.450 | 0.000e+00 | 7.930e-04 | 0.03 | 0.01 |
MPI_Irecv | 6144 | 4764482 | 1.437 | 0.000e+00 | 2.194e-05 | 0.03 | 0.01 |
MPI_Isend | 81920 | 86016 | 1.402 | 0.000e+00 | 5.539e-04 | 0.03 | 0.01 |
MPI_Irecv | 14336 | 203737 | 1.336 | 0.000e+00 | 8.309e-04 | 0.03 | 0.01 |
Load balance by task: HPM counters |
---|
by MPI rank, by MPI time |
Load balance by task: memory, flops, timings |
by MPI rank, by MPI time |
Communication balance by task (sorted by MPI time) |
by MPI rank , time detail by MPI time , time detail by rank , call list |
Message Buffer Size Distributions: time |
|
Message Buffer Size Distributions: Ncalls |
|
Communication Topology : point to point data flow |
|