Skip to content

Add psana2 with streaming

Monarin Uervirojnangkoorn requested to merge psana2 into development

This merge fixes some issues with the current mpi-psana2 (new comm_compute is added) and add psana2 streaming option (with mode=psana2).

The reference check gives following result at Generation 20 when running on corigpu (following QuickStart guideline).

###########################

Generation 20/20

###########################.
Match tot:158.65s. slice=83.71s. match=73.88s. slice_oh=0.00s. match_oh=1.05s.
Orientations matched in 161.10s.
WARNING: CG did not converge at rlambda = 0.009174451535658204.
summary = [(0, 0.009174451535658204, 0.38474797725707166, 0.28914907118689465)].
Keeping result from rank 0: v1=0.38474797725707166 and v2=0.28914907118689465.
Rank 0 got AC in 2055 iterations.
AC recovered in 98.38s.
heights: [439.].
widths: [0].
skews: [1.0156696].
Keeping result from rank 0: skew=1.02.
Problem phased in 91.75s.
Alignment CC after rotation is: 0.789.
Map had to be inverted.
Final CC between unzoomed / unfiltered volumes is: 0.789.
Estimated resolution from FSC: 21.8 Angstrom.
Results saved in /global/cscratch1/sd/monarin/spinifel_output.
Successfully completed in 7274.91s.

There are some issues seen on Ascent that may need to be addressed.

  • MPI Call after Finalize (issue#55) #55
  • pytest fails when call modules that import mpi4py (issue#56 - only on Ascent/Summit) #56 (closed)

Merge request reports