Started working on galaxy PGC063930 at Thu Jun 25 03:32:08 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 299.83662 -52.231871399999996 --width 387 --height 387 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-25T03:32:13.760452 legacypipe git version: DR9.5.2-150-g3ed0fdf5 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '299.83662', '-52.231871399999996', '--width', '387', '--height', '387', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 299.83662 -52.231871399999996 --width 387 --height 387 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 299.83662 -52.231871399999996 Starting process 59814 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.057924 MB Starting process 59815 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.057928 MB Starting process 59816 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.057928 MB Starting process 59817 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.057876 MB Starting process 59819 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.05794 MB Starting process 59822 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.057944 MB Starting process 59824 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.057944 MB Starting process 59825 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.057944 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-25T03:32:17.260955 Keeping 21 CCDs: c4d_150928_235246_ooi_z_ls9.fits.fz c4d_150928_235246_ooi_z_ls9-N20 z exptime 90.0 propid 2012B-0001 seeing 1.06 MJD 57293.993 object DES survey hex -582-521 tiling 6 c4d_150912_010255_ooi_g_ls9.fits.fz c4d_150912_010255_ooi_g_ls9-N20 g exptime 90.0 propid 2012B-0001 seeing 1.53 MJD 57277.042 object DES survey hex -582-521 tiling 6 c4d_150912_010058_ooi_r_ls9.fits.fz c4d_150912_010058_ooi_r_ls9-N20 r exptime 90.0 propid 2012B-0001 seeing 1.45 MJD 57277.041 object DES survey hex -582-521 tiling 6 c4d_130831_235707_ooi_g_ls9.fits.fz c4d_130831_235707_ooi_g_ls9-S25 g exptime 90.0 propid 2012B-0001 seeing 1.19 MJD 56535.998 object DES survey hex -582-521 tiling 3 c4d_130901_013104_ooi_r_ls9.fits.fz c4d_130901_013104_ooi_r_ls9-S25 r exptime 90.0 propid 2012B-0001 seeing 0.91 MJD 56536.063 object DES survey hex -582-521 tiling 3 c4d_160909_235459_ooi_z_ls9.fits.fz c4d_160909_235459_ooi_z_ls9-S21 z exptime 90.0 propid 2012B-0001 seeing 1.88 MJD 57640.995 object DES survey hex -611-532 tiling 7 c4d_160929_000425_ooi_r_ls9.fits.fz c4d_160929_000425_ooi_r_ls9-S21 r exptime 90.0 propid 2012B-0001 seeing 0.97 MJD 57660.001 object DES survey hex -611-532 tiling 7 c4d_160929_000621_ooi_g_ls9.fits.fz c4d_160929_000621_ooi_g_ls9-S21 g exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 57660.003 object DES survey hex -611-532 tiling 7 c4d_160910_234044_ooi_z_ls9.fits.fz c4d_160910_234044_ooi_z_ls9-S21 z exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 57641.985 object DES survey hex -611-532 tiling 7 c4d_170912_005509_ooi_z_v1.fits.fz c4d_170912_005509_ooi_z_v1-S16 z exptime 90.0 propid 2012B-0001 seeing 1.46 MJD 58008.038 object DES survey hex -611-532 tiling 9 c4d_170912_005113_ooi_r_v1.fits.fz c4d_170912_005113_ooi_r_v1-S16 r exptime 90.0 propid 2012B-0001 seeing 1.72 MJD 58008.036 object DES survey hex -611-532 tiling 9 c4d_170923_000749_ooi_r_v1.fits.fz c4d_170923_000749_ooi_r_v1-S16 r exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 58019.005 object DES survey hex -611-532 tiling 9 c4d_170923_001545_ooi_g_v1.fits.fz c4d_170923_001545_ooi_g_v1-S16 g exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 58019.011 object DES survey hex -611-532 tiling 9 c4d_170923_001545_ooi_g_v1.fits.fz c4d_170923_001545_ooi_g_v1-S21 g exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 58019.011 object DES survey hex -611-532 tiling 9 c4d_170923_000749_ooi_r_v1.fits.fz c4d_170923_000749_ooi_r_v1-S21 r exptime 90.0 propid 2012B-0001 seeing 1.02 MJD 58019.005 object DES survey hex -611-532 tiling 9 c4d_170912_005113_ooi_r_v1.fits.fz c4d_170912_005113_ooi_r_v1-S21 r exptime 90.0 propid 2012B-0001 seeing 1.72 MJD 58008.036 object DES survey hex -611-532 tiling 9 c4d_170912_005509_ooi_z_v1.fits.fz c4d_170912_005509_ooi_z_v1-S21 z exptime 90.0 propid 2012B-0001 seeing 1.46 MJD 58008.038 object DES survey hex -611-532 tiling 9 c4d_170912_002838_ooi_g_v1.fits.fz c4d_170912_002838_ooi_g_v1-S1 g exptime 90.0 propid 2012B-0001 seeing 1.86 MJD 58008.020 object DES survey hex -582-521 tiling 8 c4d_170918_011430_ooi_g_v1.fits.fz c4d_170918_011430_ooi_g_v1-S1 g exptime 90.0 propid 2012B-0001 seeing 1.02 MJD 58014.052 object DES survey hex -582-521 tiling 8 c4d_170918_011230_ooi_r_v1.fits.fz c4d_170918_011230_ooi_r_v1-S1 r exptime 90.0 propid 2012B-0001 seeing 0.90 MJD 58014.050 object DES survey hex -582-521 tiling 8 c4d_170907_015254_ooi_z_v1.fits.fz c4d_170907_015254_ooi_z_v1-S1 z exptime 90.0 propid 2012B-0001 seeing 0.95 MJD 58003.078 object DES survey hex -582-521 tiling 8 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a9d4-z-20160909T235241_oi[S21,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9620e86-r-20150912T005835_oi[N20,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9632a12-r-20130901T013104_oi[S25,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962c605-g-20160929T000400_oi[S21,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962fa53-g-20130831T235707_oi[S25,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_961f01b-g-20150912T010033_oi[N20,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96218ab-z-20150928T235027_oi[N20,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962d087-r-20160929T000201_oi[S21,noinherit][2046,4094][real]: DES sur Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-r-20170912T005113_oi[S16,noinherit][2046,4094][real]: DE Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-z-20170912T005509_oi[S16,noinherit][2046,4094][real]: DE Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-g-20170923T001545_oi[S21,noinherit][2046,4094][real]: DE Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-g-20170923T001545_oi[S16,noinherit][2046,4094][real]: DE Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-r-20170912T005113_oi[S21,noinherit][2046,4094][real]: DE Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a9d4-z-20160910T233824_oi[S21,noinherit][2046,4094][real]: DES sur Zeroing out 8106 weight-map pixels below quantization error (= median 5.21e-05) The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-z-20170912T005509_oi[S21,noinherit][2046,4094][real]: DE Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-r-20170923T000749_oi[S21,noinherit][2046,4094][real]: DE Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-r-20170923T000749_oi[S16,noinherit][2046,4094][real]: DE Zeroing out 7740 weight-map pixels below quantization error (= median 4.15e-06) The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-g-20170912T002838_oi[S1,noinherit][2046,4094][real]: DES Zeroing out 8127 weight-map pixels below quantization error (= median 0.000172) The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170917_8f9b913-g-20170918T011430_oi[S1,noinherit][2046,4094][real]: DES Zeroing out 5434 weight-map pixels below quantization error (= median 0.000174) The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170917_8f9b913-r-20170918T011230_oi[S1,noinherit][2046,4094][real]: DES Zeroing out 5419 weight-map pixels below quantization error (= median 5.15e-05) The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170906_8f8458f-z-20170907T015254_oi[S1,noinherit][2046,4094][real]: DES Stage tims : Wall: 18.91 s, CPU: 2.79 s, VmPeak: 998 MB, VmSize: 998 MB, VmRSS: 192 MB, VmData: 225 MB, maxrss: 0.196728 MB Stage tims finished: 2020-06-25T03:32:36.174907 Zeroing out 5423 weight-map pixels below quantization error (= median 4.35e-06) Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9620e86-r-20150912T005835_oi[N20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-r-20170912T005113_oi[S16,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-z-20170912T005509_oi[S21,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a9d4-z-20160909T235241_oi[S21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a9d4-z-20160910T233824_oi[S21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Zeroing out 5612 weight-map pixels below quantization error (= median 4.13e-05) WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96218ab-z-20150928T235027_oi[N20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-r-20170923T000749_oi[S21,noinherit][2046,4094][real]: DE [astropy.io.fits.card] Zeroing out 8127 weight-map pixels below quantization error (= median 4.12e-05) WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962c605-g-20160929T000400_oi[S21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-r-20170923T000749_oi[S16,noinherit][2046,4094][real]: DE [astropy.io.fits.card] Zeroing out 1604 weight-map pixels below quantization error (= median 0.000212) WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9632a12-r-20130901T013104_oi[S25,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-z-20170912T005509_oi[S16,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-g-20170912T002838_oi[S1,noinherit][2046,4094][real]: DES [astropy.io.fits.card] Zeroing out 1697 weight-map pixels below quantization error (= median 0.000229) WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962fa53-g-20130831T235707_oi[S25,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-g-20170923T001545_oi[S16,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170917_8f9b913-g-20170918T011430_oi[S1,noinherit][2046,4094][real]: DES [astropy.io.fits.card] Resources for stage tims : 7.767 s worker CPU, 110.401 s worker Wall, Wall: 18.915 s, Cores in use: 0.56, Total efficiency (on 8 cores): 7.0 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-tims.p Running stage refs Zeroing out 1973 weight-map pixels below quantization error (= median 2.61e-06) WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962d087-r-20160929T000201_oi[S21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-r-20170912T005113_oi[S21,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170906_8f8458f-z-20170907T015254_oi[S1,noinherit][2046,4094][real]: DES [astropy.io.fits.card] Running stage refs at 2020-06-25T03:32:36.220363 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10970.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11071.fits Matched 19 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/metrics/cus/reference-custom-299836m52231.fits Stage refs : Wall: 8.73 s, CPU: 7.87 s, VmPeak: 1076 MB, VmSize: 1072 MB, VmRSS: 267 MB, VmData: 299 MB, maxrss: 0.273752 MB Stage refs finished: 2020-06-25T03:32:44.948244 Zeroing out 2036 weight-map pixels below quantization error (= median 4.79e-05) WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_961f01b-g-20150912T010033_oi[N20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-g-20170923T001545_oi[S21,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170917_8f9b913-r-20170918T011230_oi[S1,noinherit][2046,4094][real]: DES [astropy.io.fits.card] Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 8.729 s, Cores in use: 0.90, Total efficiency (on 8 cores): 11.3 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-06-25T03:32:46.910139 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/metrics/cus/outlier-mask-custom-299836m52231.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/metrics/cus/outliers-pre-custom-299836m52231.jpg Image c4d_170923_001545_ooi_g_v1-S16 g : masking 0 positive outlier pixels and 79 negative outlier pixels Image c4d_160929_000621_ooi_g_ls9-S21 g : masking 726 positive outlier pixels and 117 negative outlier pixels Image c4d_170912_002838_ooi_g_v1-S1 g : masking 2015 positive outlier pixels and 0 negative outlier pixels Image c4d_170918_011430_ooi_g_v1-S1 g : masking 2265 positive outlier pixels and 0 negative outlier pixels Image c4d_170912_005113_ooi_r_v1-S16 r : masking 276 positive outlier pixels and 0 negative outlier pixels Image c4d_170923_000749_ooi_r_v1-S16 r : masking 140 positive outlier pixels and 114 negative outlier pixels Image c4d_170912_005113_ooi_r_v1-S21 r : masking 2335 positive outlier pixels and 0 negative outlier pixels Image c4d_170923_000749_ooi_r_v1-S21 r : masking 785 positive outlier pixels and 0 negative outlier pixels Image c4d_150912_010058_ooi_r_ls9-N20 r : masking 1203 positive outlier pixels and 0 negative outlier pixels Image c4d_160929_000425_ooi_r_ls9-S21 r : masking 0 positive outlier pixels and 195 negative outlier pixels Image c4d_170918_011230_ooi_r_v1-S1 r : masking 514 positive outlier pixels and 0 negative outlier pixels Image c4d_160910_234044_ooi_z_ls9-S21 z : masking 256 positive outlier pixels and 0 negative outlier pixels Image c4d_170912_005509_ooi_z_v1-S21 z : masking 0 positive outlier pixels and 623 negative outlier pixels Image c4d_160909_235459_ooi_z_ls9-S21 z : masking 5115 positive outlier pixels and 0 negative outlier pixels Image c4d_170907_015254_ooi_z_v1-S1 z : masking 0 positive outlier pixels and 464 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/metrics/cus/outlier-mask-custom-299836m52231.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/metrics/cus/outliers-post-custom-299836m52231.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/metrics/cus/outliers-masked-pos-custom-299836m52231.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/metrics/cus/outliers-masked-neg-custom-299836m52231.jpg Stage outliers : Wall: 2.27 s, CPU: 1.73 s, VmPeak: 1082 MB, VmSize: 1082 MB, VmRSS: 301 MB, VmData: 329 MB, maxrss: 0.30776 MB Stage outliers finished: 2020-06-25T03:32:49.178598 Resources for stage outliers : 3.177 s worker CPU, 3.179 s worker Wall, Wall: 2.270 s, Cores in use: 2.16, Total efficiency (on 8 cores): 27.0 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-06-25T03:32:49.228251 Stage halos : Wall: 1.84 s, CPU: 1.26 s, VmPeak: 1082 MB, VmSize: 1082 MB, VmRSS: 301 MB, VmData: 329 MB, maxrss: 0.308248 MB Stage halos finished: 2020-06-25T03:32:51.071019 Resources for stage halos : 2.190 s worker CPU, 3.861 s worker Wall, Wall: 1.844 s, Cores in use: 1.87, Total efficiency (on 8 cores): 23.4 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-25T03:32:51.126291 PSF sigmas in coadd pixels: ['2.48', '1.93', '1.65', '1.81', '1.91', '3.03', '1.66'] Using average PSF sigma 2.066588244931668 Gaussian PSF norm 0.13650265962061814 vs pixelized 0.11653395 average tim pixel scale / coadd scale: 1.001000716851165 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.36', '1.49', '1.57', '2.79', '1.59', '1.65', '2.80', '1.45'] Using average PSF sigma 1.9625436599179096 Gaussian PSF norm 0.14373937127374675 vs pixelized 0.12122967 average tim pixel scale / coadd scale: 1.001020670788032 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.72', '3.06', '1.71', '2.38', '2.37', '1.55'] Using average PSF sigma 2.1308613833364203 Gaussian PSF norm 0.13238533204453923 vs pixelized 0.10907221 average tim pixel scale / coadd scale: 1.0009533834540576 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.40 s, CPU: 0.41 s, VmPeak: 1082 MB, VmSize: 1082 MB, VmRSS: 302 MB, VmData: 329 MB, maxrss: 0.309612 MB Stage fit_on_coadds finished: 2020-06-25T03:32:51.529469 Resources for stage fit_on_coadds : 0.722 s worker CPU, 0.722 s worker Wall, Wall: 0.405 s, Cores in use: 2.79, Total efficiency (on 8 cores): 34.9 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-06-25T03:32:51.543953 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 91 potential peaks Of 91 potential peaks: 33 in veto map, 15 cut by saddle test, 0 cut by aper test, 43 kept SED z : 43 new peaks Found 103 potential peaks Of 103 potential peaks: 78 in veto map, 11 cut by saddle test, 0 cut by aper test, 14 kept SED r : 14 new peaks Found 77 potential peaks Of 77 potential peaks: 66 in veto map, 6 cut by saddle test, 0 cut by aper test, 5 kept SED g : 5 new peaks Found 106 potential peaks Of 106 potential peaks: 91 in veto map, 11 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 121 potential peaks Of 121 potential peaks: 105 in veto map, 14 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 68 new sources Median coadd sky for g : -7.387935e-05 Median coadd sky for r : -2.5746758e-05 Median coadd sky for z : 0.0002662326 Stage srcs : Wall: 1.26 s, CPU: 1.17 s, VmPeak: 1082 MB, VmSize: 1082 MB, VmRSS: 303 MB, VmData: 329 MB, maxrss: 0.310188 MB Stage srcs finished: 2020-06-25T03:32:52.805735 Resources for stage srcs : 0.180 s worker CPU, 0.180 s worker Wall, Wall: 1.263 s, Cores in use: 1.07, Total efficiency (on 8 cores): 13.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-25T03:32:52.854700 Blob 1 of 34, id: 11, sources: 47, size: 287x323, npix 50101, brick X: 15,302, Y: 64,387, one pixel: 120 64 Blob 2 of 34, id: 19, sources: 5, size: 66x69, npix 2416, brick X: 321,387, Y: 148,217, one pixel: 380 148 Blob 3 of 34, id: 31, sources: 3, size: 64x58, npix 1952, brick X: 221,285, Y: 329,387, one pixel: 263 329 Blob 4 of 34, id: 1, sources: 3, size: 52x46, npix 1532, brick X: 186,238, Y: 0,46, one pixel: 189 0 Blob 5 of 34, id: 4, sources: 2, size: 47x36, npix 1180, brick X: 12,59, Y: 5,41, one pixel: 26 5 Blob 6 of 34, id: 30, sources: 1, size: 34x46, npix 1124, brick X: 353,387, Y: 319,365, one pixel: 378 319 Blob 7 of 34, id: 20, sources: 1, size: 39x40, npix 1104, brick X: 27,66, Y: 188,228, one pixel: 42 188 Blob 8 of 34, id: 10, sources: 1, size: 40x40, npix 1099, brick X: 0,40, Y: 54,94, one pixel: 18 54 Blob 9 of 34, id: 17, sources: 2, size: 45x38, npix 886, brick X: 0,45, Y: 115,153, one pixel: 10 115 Blob 7 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 1011 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147148 MB Blob 10 of 34, id: 21, sources: 2, size: 26x46, npix 803, brick X: 0,26, Y: 210,256, one pixel: 8 210 Blob 8 finished, total: Wall: 1.01 s, CPU: 0.87 s, VmPeak: 1015 MB, VmSize: 722 MB, VmRSS: 146 MB, VmData: 185 MB, maxrss: 0.149628 MB Blob 11 of 34, id: 32, sources: 1, size: 26x37, npix 728, brick X: 0,26, Y: 334,371, one pixel: 6 334 Measuring 1 iterative sources Blob 3 finished, total: Wall: 1.64 s, CPU: 1.64 s, VmPeak: 1024 MB, VmSize: 722 MB, VmRSS: 149 MB, VmData: 185 MB, maxrss: 0.152368 MB Blob 12 of 34, id: 29, sources: 1, size: 32x32, npix 702, brick X: 203,235, Y: 319,351, one pixel: 216 319 Blob 5 finished, total: Wall: 1.88 s, CPU: 1.88 s, VmPeak: 959 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.150604 MB Blob 13 of 34, id: 2, sources: 2, size: 33x23, npix 493, brick X: 255,288, Y: 0,23, one pixel: 261 0 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.83495, -52.24626), pm (-4.8, -6.7), parallax 0.166 with NanoMaggies: g=17.8, r=17.1, z=17.5 Reset brightness to NanoMaggies: g=17.7, r=17.2, z=17 Blob 4 finished, total: Wall: 2.19 s, CPU: 2.12 s, VmPeak: 1025 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151328 MB Blob 14 of 34, id: 15, sources: 1, size: 34x24, npix 490, brick X: 314,348, Y: 104,128, one pixel: 338 104 Measuring 2 iterative sources Blob 9 finished, total: Wall: 1.61 s, CPU: 1.61 s, VmPeak: 1011 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147148 MB Blob 11 finished, total: Wall: 0.95 s, CPU: 0.95 s, VmPeak: 1024 MB, VmSize: 722 MB, VmRSS: 149 MB, VmData: 185 MB, maxrss: 0.152368 MB Blob 15 of 34, id: 9, sources: 1, size: 28x27, npix 481, brick X: 299,327, Y: 45,72, one pixel: 311 45 Blob 16 of 34, id: 22, sources: 1, size: 26x26, npix 417, brick X: 27,53, Y: 229,255, one pixel: 38 229 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.82759, -52.24797), pm (0.8, -4.0), parallax 2.678 with NanoMaggies: g=13.1, r=12.5, z=12.3 Reset brightness to NanoMaggies: g=13.5, r=13, z=12.8 Blob 13 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 1025 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151328 MB Blob 17 of 34, id: 8, sources: 1, size: 23x27, npix 404, brick X: 143,166, Y: 34,61, one pixel: 155 34 Measuring 1 iterative sources Blob 12 finished, total: Wall: 1.29 s, CPU: 1.29 s, VmPeak: 959 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.150604 MB Blob 18 of 34, id: 26, sources: 1, size: 24x24, npix 365, brick X: 303,327, Y: 279,303, one pixel: 313 279 Measuring 1 iterative sources Blob 16 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 1025 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151328 MB Blob 19 of 34, id: 5, sources: 1, size: 19x27, npix 353, brick X: 368,387, Y: 5,32, one pixel: 380 5 Blob 17 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 959 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.150604 MB Blob 20 of 34, id: 27, sources: 1, size: 23x24, npix 320, brick X: 359,382, Y: 297,321, one pixel: 370 297 Blob 15 finished, total: Wall: 1.01 s, CPU: 1.01 s, VmPeak: 1024 MB, VmSize: 722 MB, VmRSS: 149 MB, VmData: 185 MB, maxrss: 0.152368 MB Blob 21 of 34, id: 25, sources: 1, size: 19x24, npix 317, brick X: 368,387, Y: 268,292, one pixel: 377 268 Blob 14 finished, total: Wall: 1.21 s, CPU: 1.21 s, VmPeak: 1011 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147148 MB Blob 22 of 34, id: 14, sources: 1, size: 20x24, npix 316, brick X: 367,387, Y: 101,125, one pixel: 376 101 Blob 6 finished, total: Wall: 4.09 s, CPU: 3.95 s, VmPeak: 1015 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151412 MB Blob 23 of 34, id: 23, sources: 1, size: 22x22, npix 293, brick X: 320,342, Y: 249,271, one pixel: 329 249 Blob 18 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 1025 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151328 MB Blob 24 of 34, id: 6, sources: 1, size: 21x22, npix 272, brick X: 132,153, Y: 16,38, one pixel: 141 16 Blob 21 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 1011 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147148 MB Blob 25 of 34, id: 18, sources: 1, size: 21x21, npix 270, brick X: 306,327, Y: 129,150, one pixel: 314 129 Blob 10 finished, total: Wall: 3.23 s, CPU: 3.23 s, VmPeak: 1015 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151976 MB Blob 26 of 34, id: 7, sources: 1, size: 22x21, npix 269, brick X: 106,128, Y: 20,41, one pixel: 115 20 Measuring 1 iterative sources Blob 20 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 1024 MB, VmSize: 722 MB, VmRSS: 149 MB, VmData: 185 MB, maxrss: 0.152368 MB Blob 27 of 34, id: 16, sources: 1, size: 21x22, npix 261, brick X: 48,69, Y: 109,131, one pixel: 57 109 Blob 19 finished, total: Wall: 0.88 s, CPU: 0.88 s, VmPeak: 959 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.150604 MB Blob 28 of 34, id: 0, sources: 2, size: 23x17, npix 252, brick X: 139,162, Y: 0,17, one pixel: 141 0 Blob 22 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 1015 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151412 MB Blob 29 of 34, id: 28, sources: 1, size: 18x22, npix 240, brick X: 0,18, Y: 309,331, one pixel: 7 309 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.81355, -52.23402), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=22.6, r=21, z=19.6 Reset brightness to NanoMaggies: g=22, r=21, z=20.5 Measuring 1 iterative sources Blob 23 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 1025 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151328 MB Blob 30 of 34, id: 12, sources: 1, size: 20x21, npix 230, brick X: 91,111, Y: 65,86, one pixel: 100 65 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.84175, -52.24631), pm (1.1, -3.8), parallax 0.845 with NanoMaggies: g=20.3, r=19.2, z=19.3 Reset brightness to NanoMaggies: g=20.7, r=19.4, z=18.6 Blob 28 finished, total: Wall: 0.09 s, CPU: 0.08 s, VmPeak: 1015 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151412 MB Blob 31 of 34, id: 24, sources: 1, size: 19x20, npix 218, brick X: 33,52, Y: 260,280, one pixel: 41 260 Blob 30 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 1015 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151412 MB Blob 32 of 34, id: 3, sources: 1, size: 19x16, npix 193, brick X: 293,312, Y: 0,16, one pixel: 298 0 Blob 25 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 1015 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151976 MB Blob 33 of 34, id: 13, sources: 1, size: 16x18, npix 174, brick X: 371,387, Y: 78,96, one pixel: 379 78 Blob 2 finished, total: Wall: 4.71 s, CPU: 4.71 s, VmPeak: 1021 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.152048 MB Blob 34 of 34, id: 33, sources: 1, size: 18x17, npix 162, brick X: 203,221, Y: 358,375, one pixel: 211 358 Blob 26 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 1024 MB, VmSize: 722 MB, VmRSS: 149 MB, VmData: 185 MB, maxrss: 0.152368 MB Blob 34 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 1024 MB, VmSize: 722 MB, VmRSS: 149 MB, VmData: 185 MB, maxrss: 0.152368 MB Blob 32 finished, total: Wall: 0.20 s, CPU: 0.20 s, VmPeak: 1015 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151976 MB Blob 31 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 1015 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151412 MB Blob 24 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 1011 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147148 MB Blob 33 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 1021 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.152048 MB Blob 29 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 1025 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151328 MB Blob 27 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 959 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.150604 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.01663, ee1=-0.0296427, ee2=0.122142 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.84750, -52.21759), pm (-1.9, -4.7), parallax -0.292 with NanoMaggies: g=19.6, r=19.1, z=19 Reset brightness to NanoMaggies: g=19.6, r=19.1, z=18.9 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.83859, -52.21663), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=20.8, r=(flux -9.15), z=19.7 Reset brightness to NanoMaggies: g=22, r=21, z=20.5 Measuring 6 iterative sources Blob 1 finished, total: Wall: 37.11 s, CPU: 37.11 s, VmPeak: 1016 MB, VmSize: 728 MB, VmRSS: 160 MB, VmData: 191 MB, maxrss: 0.19704 MB Old catalog: 100 New catalog: 92 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/metrics/cus/blobs-custom-299836m52231.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/metrics/cus/all-models-custom-299836m52231.fits Stage fitblobs : Wall: 38.01 s, CPU: 0.90 s, VmPeak: 1082 MB, VmSize: 1082 MB, VmRSS: 303 MB, VmData: 329 MB, maxrss: 0.310572 MB Stage fitblobs finished: 2020-06-25T03:33:30.868196 Resources for stage fitblobs : 71.595 s worker CPU, 72.104 s worker Wall, Wall: 38.015 s, Cores in use: 1.91, Total efficiency (on 8 cores): 23.8 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-06-25T03:33:30.888688 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/tmp-legacysurvey-custom-299836m52231-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/tmp-legacysurvey-custom-299836m52231-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/tmp-legacysurvey-custom-299836m52231-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/tmp-legacysurvey-custom-299836m52231-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-resid.jpg Stage coadds : Wall: 2.51 s, CPU: 1.20 s, VmPeak: 1088 MB, VmSize: 1088 MB, VmRSS: 308 MB, VmData: 335 MB, maxrss: 0.315128 MB Stage coadds finished: 2020-06-25T03:33:33.401702 Resources for stage coadds : 4.698 s worker CPU, 7.976 s worker Wall, Wall: 2.514 s, Cores in use: 2.35, Total efficiency (on 8 cores): 29.3 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-06-25T03:33:33.503680 Cut to 2 unWISE tiles Reading WISE tile 3004m515 band 1 Reading WISE tile 3004m515 band 2 Reading WISE tile 3004m515 band 3 Reading WISE tile 3004m515 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3008m531 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3008m531 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3008m531 band 2 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3008m531 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.38 s, CPU: 1.05 s, VmPeak: 1024 MB, VmSize: 1005 MB, VmRSS: 152 MB, VmData: 192 MB, maxrss: 0.193628 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.25 s, CPU: 0.64 s, VmPeak: 1025 MB, VmSize: 999 MB, VmRSS: 145 MB, VmData: 186 MB, maxrss: 0.20834 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.25 s, CPU: 0.66 s, VmPeak: 1011 MB, VmSize: 1000 MB, VmRSS: 148 MB, VmData: 187 MB, maxrss: 0.211772 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.26 s, CPU: 0.67 s, VmPeak: 1015 MB, VmSize: 1003 MB, VmRSS: 152 MB, VmData: 190 MB, maxrss: 0.212808 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/tmp-legacysurvey-custom-299836m52231-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/tmp-legacysurvey-custom-299836m52231-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 6.25 s, CPU: 1.05 s, VmPeak: 1088 MB, VmSize: 1088 MB, VmRSS: 308 MB, VmData: 335 MB, maxrss: 0.31564 MB Stage wise_forced finished: 2020-06-25T03:33:39.748977 Resources for stage wise_forced : 9.109 s worker CPU, 11.180 s worker Wall, Wall: 6.247 s, Cores in use: 1.63, Total efficiency (on 8 cores): 20.3 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-06-25T03:33:39.771749 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/tractor-i/cus/tractor-custom-299836m52231.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/tractor/cus/tractor-custom-299836m52231.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/tractor/cus/brick-custom-299836m52231.sha256sum Stage writecat : Wall: 1.32 s, CPU: 1.11 s, VmPeak: 1220 MB, VmSize: 1092 MB, VmRSS: 310 MB, VmData: 335 MB, maxrss: 0.448416 MB Stage writecat finished: 2020-06-25T03:33:41.090798 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.320 s, Cores in use: 0.84, Total efficiency (on 8 cores): 10.5 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-writecat.p All done: 99.442 s worker CPU, 209.608 s worker Wall, Wall: 83.975 s, Cores in use: 1.42, Total efficiency (on 8 cores): 17.7 % Finished galaxy PGC063930 in 1.555 minutes. Started working on galaxy PGC063930 at Fri Jul 10 05:41:14 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 299.83662 -52.231871399999996 --width 387 --height 387 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-07-10T05:41:14.831939 legacypipe git version: DR9.5.4-29-gc7a53233 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '299.83662', '-52.231871399999996', '--width', '387', '--height', '387', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 299.83662 -52.231871399999996 --width 387 --height 387 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 299.83662 -52.231871399999996 Starting process 18868 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058304 MB Starting process 18871 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058308 MB Starting process 18872 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058308 MB Starting process 18875 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058308 MB Starting process 18877 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058308 MB Starting process 18878 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058312 MB Starting process 18880 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058316 MB Starting process 18881 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05832 MB Starting process 18886 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05832 MB Starting process 18888 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05832 MB Starting process 18891 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05832 MB Starting process 18892 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05832 MB Starting process 18897 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05832 MB Starting process 18898 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058324 MB Starting process 18903 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058328 MB Starting process 18905 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058332 MB Starting process 18908 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058336 MB Starting process 18910 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058336 MB Starting process 18913 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058336 MB Starting process 18914 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058344 MB Starting process 18916 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058348 MB Starting process 18918 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058348 MB Starting process 18919 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058348 MB Starting process 18922 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058348 MB Starting process 18924 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058352 MB Starting process 18927 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058352 MB Starting process 18929 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05836 MB Starting process 18930 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05836 MB Starting process 18935 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05836 MB Starting process 18937 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05836 MB Starting process 18939 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05836 MB Starting process 18940 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 634 MB, VmSize: 634 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05836 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-07-10T05:41:15.054080 Keeping 21 CCDs: c4d_150928_235246_ooi_z_ls9.fits.fz c4d_150928_235246_ooi_z_ls9-N20 z exptime 90.0 propid 2012B-0001 seeing 1.06 MJD 57293.993 object DES survey hex -582-521 tiling 6 c4d_150912_010255_ooi_g_ls9.fits.fz c4d_150912_010255_ooi_g_ls9-N20 g exptime 90.0 propid 2012B-0001 seeing 1.53 MJD 57277.042 object DES survey hex -582-521 tiling 6 c4d_150912_010058_ooi_r_ls9.fits.fz c4d_150912_010058_ooi_r_ls9-N20 r exptime 90.0 propid 2012B-0001 seeing 1.45 MJD 57277.041 object DES survey hex -582-521 tiling 6 c4d_130831_235707_ooi_g_ls9.fits.fz c4d_130831_235707_ooi_g_ls9-S25 g exptime 90.0 propid 2012B-0001 seeing 1.19 MJD 56535.998 object DES survey hex -582-521 tiling 3 c4d_130901_013104_ooi_r_ls9.fits.fz c4d_130901_013104_ooi_r_ls9-S25 r exptime 90.0 propid 2012B-0001 seeing 0.91 MJD 56536.063 object DES survey hex -582-521 tiling 3 c4d_160909_235459_ooi_z_ls9.fits.fz c4d_160909_235459_ooi_z_ls9-S21 z exptime 90.0 propid 2012B-0001 seeing 1.88 MJD 57640.995 object DES survey hex -611-532 tiling 7 c4d_160929_000425_ooi_r_ls9.fits.fz c4d_160929_000425_ooi_r_ls9-S21 r exptime 90.0 propid 2012B-0001 seeing 0.97 MJD 57660.001 object DES survey hex -611-532 tiling 7 c4d_160929_000621_ooi_g_ls9.fits.fz c4d_160929_000621_ooi_g_ls9-S21 g exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 57660.003 object DES survey hex -611-532 tiling 7 c4d_160910_234044_ooi_z_ls9.fits.fz c4d_160910_234044_ooi_z_ls9-S21 z exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 57641.985 object DES survey hex -611-532 tiling 7 c4d_170912_005509_ooi_z_v1.fits.fz c4d_170912_005509_ooi_z_v1-S16 z exptime 90.0 propid 2012B-0001 seeing 1.46 MJD 58008.038 object DES survey hex -611-532 tiling 9 c4d_170912_005113_ooi_r_v1.fits.fz c4d_170912_005113_ooi_r_v1-S16 r exptime 90.0 propid 2012B-0001 seeing 1.72 MJD 58008.036 object DES survey hex -611-532 tiling 9 c4d_170923_000749_ooi_r_v1.fits.fz c4d_170923_000749_ooi_r_v1-S16 r exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 58019.005 object DES survey hex -611-532 tiling 9 c4d_170923_001545_ooi_g_v1.fits.fz c4d_170923_001545_ooi_g_v1-S16 g exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 58019.011 object DES survey hex -611-532 tiling 9 c4d_170923_001545_ooi_g_v1.fits.fz c4d_170923_001545_ooi_g_v1-S21 g exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 58019.011 object DES survey hex -611-532 tiling 9 c4d_170923_000749_ooi_r_v1.fits.fz c4d_170923_000749_ooi_r_v1-S21 r exptime 90.0 propid 2012B-0001 seeing 1.02 MJD 58019.005 object DES survey hex -611-532 tiling 9 c4d_170912_005113_ooi_r_v1.fits.fz c4d_170912_005113_ooi_r_v1-S21 r exptime 90.0 propid 2012B-0001 seeing 1.72 MJD 58008.036 object DES survey hex -611-532 tiling 9 c4d_170912_005509_ooi_z_v1.fits.fz c4d_170912_005509_ooi_z_v1-S21 z exptime 90.0 propid 2012B-0001 seeing 1.46 MJD 58008.038 object DES survey hex -611-532 tiling 9 c4d_170912_002838_ooi_g_v1.fits.fz c4d_170912_002838_ooi_g_v1-S1 g exptime 90.0 propid 2012B-0001 seeing 1.86 MJD 58008.020 object DES survey hex -582-521 tiling 8 c4d_170918_011430_ooi_g_v1.fits.fz c4d_170918_011430_ooi_g_v1-S1 g exptime 90.0 propid 2012B-0001 seeing 1.02 MJD 58014.052 object DES survey hex -582-521 tiling 8 c4d_170918_011230_ooi_r_v1.fits.fz c4d_170918_011230_ooi_r_v1-S1 r exptime 90.0 propid 2012B-0001 seeing 0.90 MJD 58014.050 object DES survey hex -582-521 tiling 8 c4d_170907_015254_ooi_z_v1.fits.fz c4d_170907_015254_ooi_z_v1-S1 z exptime 90.0 propid 2012B-0001 seeing 0.95 MJD 58003.078 object DES survey hex -582-521 tiling 8 The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-g-20170923T001545_oi[S16,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-r-20170912T005113_oi[S21,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-r-20170912T005113_oi[S16,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-g-20170923T001545_oi[S21,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170917_8f9b913-g-20170918T011430_oi[S1,noinherit][2046,4094][real]: DES The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-z-20170912T005509_oi[S21,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-z-20170912T005509_oi[S16,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-r-20170923T000749_oi[S21,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-r-20170923T000749_oi[S16,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-g-20170912T002838_oi[S1,noinherit][2046,4094][real]: DES The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170917_8f9b913-r-20170918T011230_oi[S1,noinherit][2046,4094][real]: DES The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170906_8f8458f-z-20170907T015254_oi[S1,noinherit][2046,4094][real]: DES The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962fa53-g-20130831T235707_oi[S25,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9632a12-r-20130901T013104_oi[S25,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962d087-r-20160929T000201_oi[S21,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a9d4-z-20160910T233824_oi[S21,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9620e86-r-20150912T005835_oi[N20,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962c605-g-20160929T000400_oi[S21,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96218ab-z-20150928T235027_oi[N20,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a9d4-z-20160909T235241_oi[S21,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_961f01b-g-20150912T010033_oi[N20,noinherit][2046,4094][real]: DES sur Stage tims : Wall: 5.53 s, CPU: 0.88 s, VmPeak: 1000 MB, VmSize: 1000 MB, VmRSS: 192 MB, VmData: 226 MB, maxrss: 0.196252 MB Stage tims finished: 2020-07-10T05:41:20.582304 Zeroing out 8106 weight-map pixels below quantization error (= median 5.21e-05) WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-r-20170912T005113_oi[S16,noinherit][2046,4094][real]: DE [astropy.io.fits.card] Zeroing out 5419 weight-map pixels below quantization error (= median 5.15e-05) WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-r-20170912T005113_oi[S21,noinherit][2046,4094][real]: DE [astropy.io.fits.card] Zeroing out 8127 weight-map pixels below quantization error (= median 0.000172) WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-g-20170923T001545_oi[S16,noinherit][2046,4094][real]: DE [astropy.io.fits.card] Zeroing out 5434 weight-map pixels below quantization error (= median 0.000174) WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-g-20170923T001545_oi[S21,noinherit][2046,4094][real]: DE [astropy.io.fits.card] Zeroing out 5423 weight-map pixels below quantization error (= median 4.35e-06) Zeroing out 1697 weight-map pixels below quantization error (= median 0.000229) Zeroing out 8127 weight-map pixels below quantization error (= median 4.12e-05) WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-z-20170912T005509_oi[S21,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170917_8f9b913-g-20170918T011430_oi[S1,noinherit][2046,4094][real]: DES [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-r-20170923T000749_oi[S16,noinherit][2046,4094][real]: DE [astropy.io.fits.card] Zeroing out 2036 weight-map pixels below quantization error (= median 4.79e-05) WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170917_8f9b913-r-20170918T011230_oi[S1,noinherit][2046,4094][real]: DES [astropy.io.fits.card] Zeroing out 1973 weight-map pixels below quantization error (= median 2.61e-06) WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170906_8f8458f-z-20170907T015254_oi[S1,noinherit][2046,4094][real]: DES [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962fa53-g-20130831T235707_oi[S25,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962d087-r-20160929T000201_oi[S21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96218ab-z-20150928T235027_oi[N20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_961f01b-g-20150912T010033_oi[N20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a9d4-z-20160909T235241_oi[S21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Resources for stage tims : 25.155 s worker CPU, 83.961 s worker Wall, Wall: 5.531 s, Cores in use: 4.71, Total efficiency (on 32 cores): 14.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-tims.p Running stage refs Zeroing out 7740 weight-map pixels below quantization error (= median 4.15e-06) WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-z-20170912T005509_oi[S16,noinherit][2046,4094][real]: DE [astropy.io.fits.card] Zeroing out 1604 weight-map pixels below quantization error (= median 0.000212) WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-g-20170912T002838_oi[S1,noinherit][2046,4094][real]: DES [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9632a12-r-20130901T013104_oi[S25,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a9d4-z-20160910T233824_oi[S21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962c605-g-20160929T000400_oi[S21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9620e86-r-20150912T005835_oi[N20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Running stage refs at 2020-07-10T05:41:21.031681 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10970.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11071.fits Matched 19 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/metrics/cus/reference-custom-299836m52231.fits Stage refs : Wall: 7.85 s, CPU: 7.49 s, VmPeak: 1079 MB, VmSize: 1074 MB, VmRSS: 268 MB, VmData: 299 MB, maxrss: 0.274056 MB Stage refs finished: 2020-07-10T05:41:28.880605 Zeroing out 5612 weight-map pixels below quantization error (= median 4.13e-05) WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-r-20170923T000749_oi[S21,noinherit][2046,4094][real]: DE [astropy.io.fits.card] Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 7.852 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-07-10T05:41:29.406573 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/metrics/cus/outlier-mask-custom-299836m52231.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/metrics/cus/outliers-pre-custom-299836m52231.jpg Image c4d_160929_000621_ooi_g_ls9-S21 g : masking 726 positive outlier pixels and 117 negative outlier pixels Image c4d_170923_001545_ooi_g_v1-S16 g : masking 0 positive outlier pixels and 79 negative outlier pixels Image c4d_170912_002838_ooi_g_v1-S1 g : masking 2015 positive outlier pixels and 0 negative outlier pixels Image c4d_170918_011430_ooi_g_v1-S1 g : masking 2265 positive outlier pixels and 0 negative outlier pixels Image c4d_170923_000749_ooi_r_v1-S16 r : masking 140 positive outlier pixels and 114 negative outlier pixels Image c4d_170912_005113_ooi_r_v1-S16 r : masking 276 positive outlier pixels and 0 negative outlier pixels Image c4d_170923_000749_ooi_r_v1-S21 r : masking 785 positive outlier pixels and 0 negative outlier pixels Image c4d_160929_000425_ooi_r_ls9-S21 r : masking 0 positive outlier pixels and 195 negative outlier pixels Image c4d_150912_010058_ooi_r_ls9-N20 r : masking 1203 positive outlier pixels and 0 negative outlier pixels Image c4d_170912_005113_ooi_r_v1-S21 r : masking 2335 positive outlier pixels and 0 negative outlier pixels Image c4d_170918_011230_ooi_r_v1-S1 r : masking 514 positive outlier pixels and 0 negative outlier pixels Image c4d_170912_005509_ooi_z_v1-S21 z : masking 0 positive outlier pixels and 623 negative outlier pixels Image c4d_160909_235459_ooi_z_ls9-S21 z : masking 5115 positive outlier pixels and 0 negative outlier pixels Image c4d_160910_234044_ooi_z_ls9-S21 z : masking 256 positive outlier pixels and 0 negative outlier pixels Image c4d_170907_015254_ooi_z_v1-S1 z : masking 0 positive outlier pixels and 464 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/metrics/cus/outlier-mask-custom-299836m52231.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/metrics/cus/outliers-post-custom-299836m52231.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/metrics/cus/outliers-masked-pos-custom-299836m52231.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/metrics/cus/outliers-masked-neg-custom-299836m52231.jpg Stage outliers : Wall: 1.67 s, CPU: 1.03 s, VmPeak: 1084 MB, VmSize: 1084 MB, VmRSS: 302 MB, VmData: 331 MB, maxrss: 0.309396 MB Stage outliers finished: 2020-07-10T05:41:31.073080 Resources for stage outliers : 3.358 s worker CPU, 3.995 s worker Wall, Wall: 1.669 s, Cores in use: 2.63, Total efficiency (on 32 cores): 8.2 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-07-10T05:41:31.410220 Stage halos : Wall: 0.31 s, CPU: 0.11 s, VmPeak: 1084 MB, VmSize: 1084 MB, VmRSS: 303 MB, VmData: 332 MB, maxrss: 0.309888 MB Stage halos finished: 2020-07-10T05:41:31.720769 Resources for stage halos : 2.685 s worker CPU, 2.744 s worker Wall, Wall: 0.314 s, Cores in use: 8.91, Total efficiency (on 32 cores): 27.9 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-07-10T05:41:32.084626 PSF sigmas in coadd pixels: ['2.48', '1.93', '1.65', '1.81', '1.91', '3.03', '1.66'] Using average PSF sigma 2.066588244931668 Gaussian PSF norm 0.13650265962061814 vs pixelized 0.11653396 average tim pixel scale / coadd scale: 1.001000716851165 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.36', '1.49', '1.57', '2.79', '1.59', '1.65', '2.80', '1.45'] Using average PSF sigma 1.9625436599179096 Gaussian PSF norm 0.14373937127374675 vs pixelized 0.12122967 average tim pixel scale / coadd scale: 1.001020670788032 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.72', '3.06', '1.71', '2.38', '2.37', '1.55'] Using average PSF sigma 2.1308613833364203 Gaussian PSF norm 0.13238533204453923 vs pixelized 0.10907221 average tim pixel scale / coadd scale: 1.0009533834540576 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.44 s, CPU: 0.46 s, VmPeak: 1084 MB, VmSize: 1084 MB, VmRSS: 305 MB, VmData: 332 MB, maxrss: 0.31184 MB Stage fit_on_coadds finished: 2020-07-10T05:41:32.528062 Resources for stage fit_on_coadds : 0.665 s worker CPU, 0.665 s worker Wall, Wall: 0.446 s, Cores in use: 2.53, Total efficiency (on 32 cores): 7.9 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-07-10T05:41:32.610577 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 93 potential peaks Of 93 potential peaks: 35 in veto map, 15 cut by saddle test, 0 cut by aper test, 43 kept SED z : 43 new peaks Found 105 potential peaks Of 105 potential peaks: 81 in veto map, 10 cut by saddle test, 0 cut by aper test, 14 kept SED r : 14 new peaks Found 78 potential peaks Of 78 potential peaks: 66 in veto map, 7 cut by saddle test, 0 cut by aper test, 5 kept SED g : 5 new peaks Found 107 potential peaks Of 107 potential peaks: 91 in veto map, 12 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 122 potential peaks Of 122 potential peaks: 105 in veto map, 15 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 68 new sources Median coadd sky for g : -7.38793e-05 Median coadd sky for r : -2.5746758e-05 Median coadd sky for z : 0.0002662326 Stage srcs : Wall: 0.96 s, CPU: 0.90 s, VmPeak: 1084 MB, VmSize: 1084 MB, VmRSS: 305 MB, VmData: 332 MB, maxrss: 0.31236 MB Stage srcs finished: 2020-07-10T05:41:33.572122 Resources for stage srcs : 0.178 s worker CPU, 0.178 s worker Wall, Wall: 0.964 s, Cores in use: 1.12, Total efficiency (on 32 cores): 3.5 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-07-10T05:41:33.674049 Blob 1 of 34, id: 11, sources: 47, size: 287x323, npix 50101, brick X: 15,302, Y: 64,387, one pixel: 120 64 Blob 2 of 34, id: 19, sources: 5, size: 66x69, npix 2416, brick X: 321,387, Y: 148,217, one pixel: 380 148 Blob 3 of 34, id: 31, sources: 3, size: 64x58, npix 1952, brick X: 221,285, Y: 329,387, one pixel: 263 329 Blob 4 of 34, id: 1, sources: 3, size: 52x46, npix 1532, brick X: 186,238, Y: 0,46, one pixel: 189 0 Blob 5 of 34, id: 4, sources: 2, size: 47x36, npix 1180, brick X: 12,59, Y: 5,41, one pixel: 26 5 Blob 6 of 34, id: 30, sources: 1, size: 34x46, npix 1124, brick X: 353,387, Y: 319,365, one pixel: 378 319 Blob 7 of 34, id: 20, sources: 1, size: 39x40, npix 1104, brick X: 27,66, Y: 188,228, one pixel: 42 188 Blob 8 of 34, id: 10, sources: 1, size: 40x40, npix 1099, brick X: 0,40, Y: 54,94, one pixel: 18 54 Blob 9 of 34, id: 17, sources: 2, size: 45x38, npix 886, brick X: 0,45, Y: 115,153, one pixel: 10 115 Blob 10 of 34, id: 21, sources: 2, size: 26x46, npix 803, brick X: 0,26, Y: 210,256, one pixel: 8 210 Blob 11 of 34, id: 32, sources: 1, size: 26x37, npix 728, brick X: 0,26, Y: 334,371, one pixel: 6 334 Blob 12 of 34, id: 29, sources: 1, size: 32x32, npix 702, brick X: 203,235, Y: 319,351, one pixel: 216 319 Blob 13 of 34, id: 2, sources: 2, size: 33x23, npix 493, brick X: 255,288, Y: 0,23, one pixel: 261 0 Blob 14 of 34, id: 15, sources: 1, size: 34x24, npix 490, brick X: 314,348, Y: 104,128, one pixel: 338 104 Blob 15 of 34, id: 9, sources: 1, size: 28x27, npix 481, brick X: 299,327, Y: 45,72, one pixel: 311 45 Blob 16 of 34, id: 22, sources: 1, size: 26x26, npix 417, brick X: 27,53, Y: 229,255, one pixel: 38 229 Blob 17 of 34, id: 8, sources: 1, size: 23x27, npix 404, brick X: 143,166, Y: 34,61, one pixel: 155 34 Blob 18 of 34, id: 26, sources: 1, size: 24x24, npix 365, brick X: 303,327, Y: 279,303, one pixel: 313 279 Blob 19 of 34, id: 5, sources: 1, size: 19x27, npix 353, brick X: 368,387, Y: 5,32, one pixel: 380 5 Blob 20 of 34, id: 27, sources: 1, size: 23x24, npix 320, brick X: 359,382, Y: 297,321, one pixel: 370 297 Blob 21 of 34, id: 25, sources: 1, size: 19x24, npix 317, brick X: 368,387, Y: 268,292, one pixel: 377 268 Blob 22 of 34, id: 14, sources: 1, size: 20x24, npix 316, brick X: 367,387, Y: 101,125, one pixel: 376 101 Blob 23 of 34, id: 23, sources: 1, size: 22x22, npix 293, brick X: 320,342, Y: 249,271, one pixel: 329 249 Blob 24 of 34, id: 6, sources: 1, size: 21x22, npix 272, brick X: 132,153, Y: 16,38, one pixel: 141 16 Blob 25 of 34, id: 18, sources: 1, size: 21x21, npix 270, brick X: 306,327, Y: 129,150, one pixel: 314 129 Blob 26 of 34, id: 7, sources: 1, size: 22x21, npix 269, brick X: 106,128, Y: 20,41, one pixel: 115 20 Blob 27 of 34, id: 16, sources: 1, size: 21x22, npix 261, brick X: 48,69, Y: 109,131, one pixel: 57 109 Blob 28 of 34, id: 0, sources: 2, size: 23x17, npix 252, brick X: 139,162, Y: 0,17, one pixel: 141 0 Blob 29 of 34, id: 28, sources: 1, size: 18x22, npix 240, brick X: 0,18, Y: 309,331, one pixel: 7 309 Blob 30 of 34, id: 12, sources: 1, size: 20x21, npix 230, brick X: 91,111, Y: 65,86, one pixel: 100 65 Blob 31 of 34, id: 24, sources: 1, size: 19x20, npix 218, brick X: 33,52, Y: 260,280, one pixel: 41 260 Blob 32 of 34, id: 3, sources: 1, size: 19x16, npix 193, brick X: 293,312, Y: 0,16, one pixel: 298 0 Blob 33 of 34, id: 13, sources: 1, size: 16x18, npix 174, brick X: 371,387, Y: 78,96, one pixel: 379 78 Blob 30 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 1008 MB, VmSize: 718 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143152 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.84175, -52.24631), pm (1.1, -3.8), parallax 0.845 with NanoMaggies: g=20.3, r=19.2, z=19.3 Reset brightness to NanoMaggies: g=20.7, r=19.4, z=18.6 Blob 28 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 1008 MB, VmSize: 718 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.14444 MB Blob 34 of 34, id: 33, sources: 1, size: 18x17, npix 162, brick X: 203,221, Y: 358,375, one pixel: 211 358 Blob 34 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 1008 MB, VmSize: 718 MB, VmRSS: 143 MB, VmData: 180 MB, maxrss: 0.14628 MB Blob 31 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 942 MB, VmSize: 721 MB, VmRSS: 133 MB, VmData: 182 MB, maxrss: 0.136256 MB Blob 26 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 686 MB, VmSize: 686 MB, VmRSS: 111 MB, VmData: 164 MB, maxrss: 0.113412 MB Blob 25 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 941 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 187 MB, maxrss: 0.143004 MB Blob 32 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 1013 MB, VmSize: 724 MB, VmRSS: 147 MB, VmData: 186 MB, maxrss: 0.150152 MB Blob 33 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 1008 MB, VmSize: 718 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143152 MB Blob 17 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 100 MB, VmData: 146 MB, maxrss: 0.102496 MB Blob 22 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 943 MB, VmSize: 721 MB, VmRSS: 133 MB, VmData: 182 MB, maxrss: 0.135836 MB Blob 23 finished, total: Wall: 0.45 s, CPU: 0.45 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 100 MB, VmData: 146 MB, maxrss: 0.102168 MB Blob 21 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 1011 MB, VmSize: 718 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.144908 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.82759, -52.24797), pm (0.8, -4.0), parallax 2.678 with NanoMaggies: g=13.1, r=12.5, z=12.3 Reset brightness to NanoMaggies: g=13.5, r=13, z=12.8 Blob 13 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 950 MB, VmSize: 723 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151364 MB Blob 20 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 943 MB, VmSize: 721 MB, VmRSS: 134 MB, VmData: 182 MB, maxrss: 0.137548 MB Blob 24 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 1006 MB, VmSize: 718 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145792 MB Blob 29 finished, total: Wall: 0.63 s, CPU: 0.63 s, VmPeak: 947 MB, VmSize: 721 MB, VmRSS: 135 MB, VmData: 182 MB, maxrss: 0.138136 MB Blob 18 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 690 MB, VmSize: 690 MB, VmRSS: 115 MB, VmData: 168 MB, maxrss: 0.117512 MB Blob 8 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 1007 MB, VmSize: 718 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145192 MB Measuring 1 iterative sources Blob 27 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 1007 MB, VmSize: 723 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.15144 MB Measuring 1 iterative sources Blob 16 finished, total: Wall: 0.88 s, CPU: 0.88 s, VmPeak: 1006 MB, VmSize: 718 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.1456 MB Blob 11 finished, total: Wall: 0.90 s, CPU: 0.90 s, VmPeak: 683 MB, VmSize: 660 MB, VmRSS: 95 MB, VmData: 138 MB, maxrss: 0.106964 MB Blob 19 finished, total: Wall: 0.90 s, CPU: 0.90 s, VmPeak: 662 MB, VmSize: 662 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095104 MB Blob 7 finished, total: Wall: 1.00 s, CPU: 1.00 s, VmPeak: 947 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 187 MB, maxrss: 0.143072 MB Blob 15 finished, total: Wall: 1.05 s, CPU: 1.05 s, VmPeak: 687 MB, VmSize: 687 MB, VmRSS: 113 MB, VmData: 165 MB, maxrss: 0.115752 MB Blob 14 finished, total: Wall: 1.08 s, CPU: 1.08 s, VmPeak: 1007 MB, VmSize: 723 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151068 MB Blob 12 finished, total: Wall: 1.24 s, CPU: 1.24 s, VmPeak: 686 MB, VmSize: 686 MB, VmRSS: 114 MB, VmData: 164 MB, maxrss: 0.11624 MB Blob 9 finished, total: Wall: 1.26 s, CPU: 1.26 s, VmPeak: 689 MB, VmSize: 689 MB, VmRSS: 113 MB, VmData: 166 MB, maxrss: 0.115432 MB Blob 5 finished, total: Wall: 1.58 s, CPU: 1.58 s, VmPeak: 1011 MB, VmSize: 718 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143636 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.83495, -52.24626), pm (-4.8, -6.7), parallax 0.166 with NanoMaggies: g=17.8, r=17.1, z=17.5 Reset brightness to NanoMaggies: g=17.7, r=17.2, z=17 Blob 4 finished, total: Wall: 1.61 s, CPU: 1.61 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 118 MB, VmData: 171 MB, maxrss: 0.120872 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 1.71 s, CPU: 1.71 s, VmPeak: 952 MB, VmSize: 718 MB, VmRSS: 143 MB, VmData: 180 MB, maxrss: 0.146424 MB Measuring 2 iterative sources Measuring 1 iterative sources Blob 10 finished, total: Wall: 2.71 s, CPU: 2.71 s, VmPeak: 947 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 187 MB, maxrss: 0.143612 MB Blob 6 finished, total: Wall: 3.03 s, CPU: 3.03 s, VmPeak: 1006 MB, VmSize: 724 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.15208 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.81355, -52.23402), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=22.6, r=21, z=19.6 Reset brightness to NanoMaggies: g=22, r=21, z=20.5 Measuring 1 iterative sources Blob 2 finished, total: Wall: 3.60 s, CPU: 3.60 s, VmPeak: 1006 MB, VmSize: 718 MB, VmRSS: 143 MB, VmData: 179 MB, maxrss: 0.145924 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.01663, ee1=-0.0296427, ee2=0.122142 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.84750, -52.21759), pm (-1.9, -4.7), parallax -0.292 with NanoMaggies: g=19.6, r=19.1, z=19 Reset brightness to NanoMaggies: g=19.6, r=19.1, z=18.9 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.83859, -52.21663), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=20.8, r=(flux -9.15), z=19.7 Reset brightness to NanoMaggies: g=22, r=21, z=20.5 Measuring 6 iterative sources Blob 1 finished, total: Wall: 44.12 s, CPU: 44.12 s, VmPeak: 731 MB, VmSize: 701 MB, VmRSS: 143 MB, VmData: 178 MB, maxrss: 0.175572 MB Old catalog: 100 New catalog: 92 T_dup: tabledata object with 1 rows and 62 columns: a_g_val () shape (1,) dtype float32 astrometric_excess_noise () shape (1,) dtype float32 astrometric_excess_noise_sig () shape (1,) dtype float32 astrometric_n_good_obs_al () shape (1,) dtype int16 astrometric_n_obs_al () shape (1,) dtype int16 astrometric_params_solved () shape (1,) dtype uint8 astrometric_sigma5d_max () shape (1,) dtype float32 astrometric_weight_al () shape (1,) dtype float32 ba () shape (1,) dtype float32 dec () shape (1,) dtype float64 dec_ivar () shape (1,) dtype float32 decam_mag_g () shape (1,) dtype float32 decam_mag_r () shape (1,) dtype float32 decam_mag_z () shape (1,) dtype float32 donotfit () shape (1,) dtype bool duplicated_source () shape (1,) dtype bool e_bp_min_rp_val () shape (1,) dtype float32 freezeparams () shape (1,) dtype bool hmag () shape (1,) dtype float32 ibx () shape (1,) dtype int32 iby () shape (1,) dtype int32 in_bounds () shape (1,) dtype bool isbright () shape (1,) dtype bool iscluster () shape (1,) dtype bool isgaia () shape (1,) dtype bool isgalaxy () shape (1,) dtype uint8 islargegalaxy () shape (1,) dtype bool ismedium () shape (1,) dtype bool istycho () shape (1,) dtype bool jmag () shape (1,) dtype float32 keep_radius () shape (1,) dtype float32 kmag () shape (1,) dtype float32 mag () shape (1,) dtype float32 mask_mag () shape (1,) dtype float32 pa () shape (1,) dtype float32 parallax () shape (1,) dtype float32 parallax_ivar () shape (1,) dtype float32 phot_bp_mean_flux_over_error () shape (1,) dtype float32 phot_bp_mean_mag () shape (1,) dtype float32 phot_bp_n_obs () shape (1,) dtype int16 phot_bp_rp_excess_factor () shape (1,) dtype float32 phot_g_mean_flux_over_error () shape (1,) dtype float32 phot_g_mean_mag () shape (1,) dtype float32 phot_g_n_obs () shape (1,) dtype int16 phot_rp_mean_flux_over_error () shape (1,) dtype float32 phot_rp_mean_mag () shape (1,) dtype float32 phot_rp_n_obs () shape (1,) dtype int16 phot_variable_flag () shape (1,) dtype bool pmdec () shape (1,) dtype float32 pmdec_ivar () shape (1,) dtype float32 pmra () shape (1,) dtype float32 pmra_ivar () shape (1,) dtype float32 pointsource () shape (1,) dtype bool ra () shape (1,) dtype float64 ra_ivar () shape (1,) dtype float32 radius () shape (1,) dtype float32 radius_pix () shape (1,) dtype int64 ref_cat () shape (1,) dtype ) shape (1,) dtype float32 ref_id () shape (1,) dtype int64 source_id () shape (1,) dtype int64 zguess () shape (1,) dtype float32 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/metrics/cus/blobs-custom-299836m52231.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/metrics/cus/all-models-custom-299836m52231.fits Stage fitblobs : Wall: 44.43 s, CPU: 0.43 s, VmPeak: 1084 MB, VmSize: 1084 MB, VmRSS: 305 MB, VmData: 332 MB, maxrss: 0.312728 MB Stage fitblobs finished: 2020-07-10T05:42:18.104354 Resources for stage fitblobs : 74.972 s worker CPU, 74.990 s worker Wall, Wall: 44.434 s, Cores in use: 1.70, Total efficiency (on 32 cores): 5.3 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-07-10T05:42:18.213106 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/tmp-legacysurvey-custom-299836m52231-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/tmp-legacysurvey-custom-299836m52231-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/tmp-legacysurvey-custom-299836m52231-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/tmp-legacysurvey-custom-299836m52231-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-resid.jpg Stage coadds : Wall: 3.26 s, CPU: 0.70 s, VmPeak: 1088 MB, VmSize: 1088 MB, VmRSS: 310 MB, VmData: 337 MB, maxrss: 0.317508 MB Stage coadds finished: 2020-07-10T05:42:21.475032 Resources for stage coadds : 41.600 s worker CPU, 57.637 s worker Wall, Wall: 3.265 s, Cores in use: 12.96, Total efficiency (on 32 cores): 40.5 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-07-10T05:42:21.585682 Cut to 2 unWISE tiles Reading WISE tile 3004m515 band 1 Reading WISE tile 3004m515 band 2 Reading WISE tile 3004m515 band 3 Reading WISE tile 3004m515 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3008m531 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3008m531 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3008m531 band 2 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3008m531 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.24 s, CPU: 0.55 s, VmPeak: 1070 MB, VmSize: 1070 MB, VmRSS: 218 MB, VmData: 258 MB, maxrss: 0.223576 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.44 s, CPU: 1.29 s, VmPeak: 1007 MB, VmSize: 1004 MB, VmRSS: 153 MB, VmData: 192 MB, maxrss: 0.192344 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.26 s, CPU: 0.59 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 147 MB, VmData: 186 MB, maxrss: 0.208408 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.27 s, CPU: 0.59 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 145 MB, VmData: 186 MB, maxrss: 0.203372 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/tmp-legacysurvey-custom-299836m52231-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/tmp-legacysurvey-custom-299836m52231-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.39 s, CPU: 0.52 s, VmPeak: 1088 MB, VmSize: 1088 MB, VmRSS: 311 MB, VmData: 337 MB, maxrss: 0.318212 MB Stage wise_forced finished: 2020-07-10T05:42:24.978795 Resources for stage wise_forced : 9.818 s worker CPU, 9.388 s worker Wall, Wall: 3.397 s, Cores in use: 3.05, Total efficiency (on 32 cores): 9.5 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-07-10T05:42:25.073369 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/coadd/cus/custom-299836m52231/legacysurvey-custom-299836m52231-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/tractor-i/cus/tractor-custom-299836m52231.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/tractor/cus/tractor-custom-299836m52231.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/tractor/cus/brick-custom-299836m52231.sha256sum Stage writecat : Wall: 0.74 s, CPU: 0.70 s, VmPeak: 1221 MB, VmSize: 1093 MB, VmRSS: 313 MB, VmData: 337 MB, maxrss: 0.451084 MB Stage writecat finished: 2020-07-10T05:42:25.812184 Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.742 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC063930/PGC063930-largegalaxy-writecat.p All done: 158.440 s worker CPU, 233.567 s worker Wall, Wall: 70.874 s, Cores in use: 2.43, Total efficiency (on 32 cores): 7.6 % Finished galaxy PGC063930 in 1.209 minutes.