|
|
1. Working interactively
|
|
|
|
|
|
```bash
|
|
|
module purge
|
|
|
module load cgpu gcc cuda openmpi fftw python
|
|
|
```
|
|
|
|
|
|
**Note:** the default version of Git on Summit is pretty old, we recommend that you run `module load git`. Failure to do so might result in unusual behavior around submodules (cf not in pt 2 below) and Git LFS
|
|
|
|
|
|
2. Build (approx. 40 mins):
|
|
|
1. Build (approx. 40 mins):
|
|
|
|
|
|
```bash
|
|
|
git clone --recursive http://gitlab.osti.gov/mtip/spinifel.git
|
... | ... | @@ -17,26 +8,22 @@ |
|
|
|
|
|
**Note:** the repository uses submodules. Either clone with `--recursive` (as above) or run `git submodule update --init` after cloning. To force a reset of the submodule versions, please run `scripts/update_submodules.sh`
|
|
|
|
|
|
3. Run interactively:
|
|
|
|
|
|
```bash
|
|
|
bsub -W 1:00 -nnodes 1 -alloc_flags gpumps -P CHM137 -Is /bin/bash
|
|
|
DATA_DIR=/gpfs/alpine/proj-shared/chm137/data/spi DATA_FILENAME=2CEX-10k-2.h5 ./scripts/run_summit_mult.sh -m -n 1 -a 1 -g 1 -r 1 -d 1 -c -f -t 1 -s -v
|
|
|
```
|
|
|
2. Run interactively:
|
|
|
|
|
|
**New!** The version on the `jpb/settings` branch no longer requires the launch script. The command above can be run using:
|
|
|
```bash
|
|
|
source ./setup/env.sh
|
|
|
jsrun -n1 -a1 -g1 python -m spinifel --default-settings=summit_quickstart.toml --mode=mpi
|
|
|
module purge
|
|
|
module load cgpu gcc cuda openmpi fftw python
|
|
|
salloc -N 1 -t 4:00:00 -C gpu --gpus=1 -A m1759 -q special --tasks-per-node=10
|
|
|
./scripts/run_cori.sh -m -n 1 -t 1 -d 1 -g 1 -c -f
|
|
|
```
|
|
|
|
|
|
Or run as batch script (approx. 40 mins):
|
|
|
|
|
|
```bash
|
|
|
DATA_DIR=/gpfs/alpine/proj-shared/chm137/data/spi DATA_FILENAME=2CEX-10k-2.h5 bsub submit_summit.sh
|
|
|
DATA_DIR=$SCRATCH/spinifel_data DATA_FILENAME=2CEX-10k-2.h5 bsub submit_cori_gpu.sh
|
|
|
```
|
|
|
|
|
|
4. Visualize results saved to out_dir:
|
|
|
`/gpfs/alpine/proj-shared/chm137/\<username\>/spinifel_output`
|
|
|
3. Visualize results saved to out_dir:
|
|
|
`$SCRATCH/spinifel_output`
|
|
|
Download using:
|
|
|
`scp $USER@dtn.ccs.ornl.gov:/path/yourfile /local/path/of/your/file` |
|
|
`scp $USER@cori.nersc.gov:/path/yourfile /local/path/of/your/file` |