... | ... | @@ -2,17 +2,17 @@ In the previous examples (Quick-Start Guides), we read SPI images from hdf5 file |
|
|
|
|
|
As of 6/2/22, Psana2 enabled versions of Spinifel live in separated branches. Please contact Mona [psana2-mpi branch](https://gitlab.osti.gov/mtip/spinifel/-/tree/psana2) or Seema (Legion) for more information.
|
|
|
|
|
|
This guideline is for running on Cori using simulated data converted from hdf5 format (3iyf_sim_400k.h5). For running with larger data set or on Summit, please see the last section for detail on locations of the data.
|
|
|
This guideline is for running on Cori using data from several runs from amo06516. The data are combined into one run (run 90). For running with larger data set or on Summit, please see the last section for detail on locations of the data.
|
|
|
|
|
|
## Setup toml file
|
|
|
|
|
|
From the default toml file, set the following parameters to enable PSANA2.
|
|
|
```toml
|
|
|
[psana]
|
|
|
enable = true
|
|
|
ps_dir = "/global/cfs/cdirs/m2859/data/3iyf/xtc2"
|
|
|
exp = "xpptut15"
|
|
|
runnum = 1
|
|
|
enable = true
|
|
|
ps_dir = "/global/cfs/cdirs/m2859/data/amo06516"
|
|
|
exp = "amo06516"
|
|
|
runnum = 90
|
|
|
```
|
|
|
|
|
|
PSANA2 has several options for scaling the reading process. The tmol parameters above omit these options and assume default values. You can also modify these options (right now showing the default values) in the tmol file.
|
... | ... | @@ -42,7 +42,7 @@ salloc -N 1 -t 4:00:00 -C gpu --gpus=1 -A m1759 -q special --tasks-per-node=10 |
|
|
#!/bin/bash
|
|
|
srun -n 3 -G 1 python -m spinifel --settings=./settings/cgpu_mpi.toml --mode=mpi
|
|
|
```
|
|
|
## Comparing output with hdf5
|
|
|
## [Obsolete - Done with previous test data (3iyf)] Comparing output with hdf5
|
|
|
|
|
|
Two log files below were generated after running spinifel with psana2 using the instruction above. No. of images per rank is set to 1000 and No. of max generations is 3. Note that for hdf5 run, we use srun -n 1 (instead of -n 3) since there are no reserved cores for the hdf5 version.
|
|
|
- [On-screen output from Xtc2](On-screen output from Xtc2)
|
... | ... | |