|
|
## Scaling Study on 3iyf
|
|
|
|
|
|
| Trial | | # nodes | # tasks | # tasks per node | # CPUs per task | # GPU per task | | CPUs/node used | GPUs/node used | # images/rank | # images total | small problem | N_binning (set in parms.py) | N_Orientations | N_batch_size | check_convergence | -b | -d | spinifel version | Total time (s) | # images | Loading | Slicing | OM | Merging | Phasing |
|
|
|
|-----------------|-----------------------------|---------|---------|------------------|-----------------|----------------|--|----------------|----------------|---------------|----------------|---------------|-----------------------------|----------------|--------------|-------------------|----|----|-------------------|-----------------|-----------------------|---------|---------|------|---------|---------|
|
|
|
| 2022-02-19T2311 | PM, 3iyf, clean, vary nodes | 1 | | 4 | | 1 | | 40 | | 1500 | | | | 10000 | 100 | no | 0 | | Development | 708.8 | 1 node, 6K images | 1.7 | 121 | 62.6 | 510.9 | 12 |
|
|
|
| 2022-02-19T2311 | | 2 | | 4 | | 1 | | 40 | | 1500 | | | | 10000 | | | | | | 693.8 | 2 nodes, 12K images | 5.1 | 121.4 | 62.7 | 491 | 13.85 |
|
|
|
| 2022-02-26T1501 | | 4 | | 4 | | 1 | | 40 | | 1500 | | | | 10000 | | | | | | 708 | 4 nodes, 24K images | 3.2 | 121.3 | 62.4 | 504.3 | 16.5 |
|
|
|
| 2022-02-19T2311 | | 8 | | 4 | | 1 | | 40 | | 1500 | | | | 10000 | | | | | | 870.3 | 8 nodes, 48K images | 3.5 | 12.5 | 62.7 | 668.2 | 13.9 |
|
|
|
| 2022-02-19T2311 | | 16 | | 4 | | 1 | | 40 | | 1500 | | | | 10000 | | | | | | 800.4 | 16 nodes, 96K images | 10.28 | 121.6 | 62.7 | 590.4 | 15.8 |
|
|
|
| 2022-02-19T2311 | | 32 | | 4 | | 1 | | 40 | | 1500 | | | | 10000 | | | | | | 717.63 | 32 nodes, 182K images | 12.5 | 121.722 | 62.6 | 499.1 | 20.4 |
|
|
|
| 2022-03-04T2035 | | 64 | | 4 | | 1 | | 40 | | 1500 | | | | 10000 | | | | | | 716.3 | 64 nodes, 384K images | 7.2 | 121.649 | 62.7 | 502.3 | 21.1 |
|
|
|
|
|
|
![SpiniFEL_Weak_Scaling_Perlmutter__10K_Orientations__3IYF](uploads/55eb929a00d730680dfc40fa27995432/SpiniFEL_Weak_Scaling_Perlmutter__10K_Orientations__3IYF.png)
|
|
|
|
|
|
| Trial | | # nodes | # tasks | # tasks per node | # CPUs per task | # GPU per task | | CPUs/node used | GPUs/node used | # images/rank | # images total | small problem | N_binning (set in parms.py) | N_Orientations | N_batch_size | check_convergence | -b | -d | spinifel version | | # Orientations | Loading | Slicing | OM | Merging | Phasing |
|
|
|
|-----------------|------------------------------|---------|---------|------------------|-----------------|----------------|--|----------------|----------------|---------------|----------------|---------------|-----------------------------|----------------|--------------|-------------------|----|----|-------------------|--------|----------------|---------|---------|-------|---------|---------|
|
|
|
| 2022-02-23T2243 | PM, 3iyf, clean, vary orient | 32 | | 4 | | 1 | | 40 | | 1500 | | | | 8000 | | | | | | 940.58 | 8000 | 7.3 | 351.2 | 49.9 | 507.9 | 29 |
|
|
|
| 2022-02-23T2243 | | 32 | | 4 | | 1 | | 40 | | 1500 | | | | 16000 | | | | | | 1345 | 16000 | 4.44 | 692.1 | 99.8 | 517.4 | 24.4 |
|
|
|
| 2022-02-23T2243 | | 32 | | 4 | | 1 | | 40 | | 1500 | | | | 32000 | | | | | | 2143.3 | 32000 | 6.3 | 1366.7 | 199.3 | 568.2 | 16.6 |
|
|
|
| 2022-03-06T1328 | | 32 | | 4 | | 1 | | 40 | | 1500 | | | | 64000 | | | | | | 1772.5 | 64000 | 19.9 | 779.2 | 398.5 | 552.6 | 16.14 |
|
|
|
| 2022-02-23T2243 | | 32 | | 4 | | 1 | | 40 | | 1500 | | | | 128000 | | | | | | 2902.1 | 128000 | 4.8 | 1558.1 | 797.1 | 518.1 | 18.8 |
|
|
|
|
|
|
![SpiniFEL_on_128_Ranks_on_Perlmutter_Varying_Number_Orientations](uploads/78af3ab1d9791ffd019f45976c7a6773/SpiniFEL_on_128_Ranks_on_Perlmutter_Varying_Number_Orientations.png) |
|
|
\ No newline at end of file |