Started working on galaxy PGC163383_GROUP at Wed Aug 5 22:37:46 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 326.60906932921904 -10.411814628022993 --width 491 --height 491 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T22:37:48.665295 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '326.60906932921904', '-10.411814628022993', '--width', '491', '--height', '491', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 326.60906932921904 -10.411814628022993 --width 491 --height 491 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 326.60906932921904 -10.411814628022993 Starting process 16682 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB Starting process 16683 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 16684 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 16685 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 16686 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 16687 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 16688 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 16689 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16690 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16691 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 16692 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 16693 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 16694 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 16695 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 16696 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 16697 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 16698 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 16699 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 16700 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 16701 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 16702 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 16703 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 16704 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 16705 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 16706 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 16707 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 16708 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 16709 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 16710 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 16711 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 16712 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 16713 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T22:37:49.375818 Keeping 14 CCDs: c4d_180516_085912_ooi_r_ls9-S24 r expnum 746804 exptime 72.0 propid 2014B-0404 seeing 0.95 MJD 58254.374 object DECaLS_11755_r decam/CP/V4.8.2a/CP20180515/c4d_180516_085912_ooi_r_ls9.fits.fz c4d_170719_043641_ooi_g_ls9-S24 g expnum 659982 exptime 136.0 propid 2014B-0404 seeing 1.58 MJD 57953.190 object DECaLS_11755_g decam/CP/V4.8.2/CP20170718/c4d_170719_043641_ooi_g_ls9.fits.fz c4d_160813_025106_ooi_z_ls9-S24 z expnum 563506 exptime 80.0 propid 2014B-0404 seeing 0.84 MJD 57613.117 object DECaLS_11755_z decam/CP/V4.8.2a/CP20160812/c4d_160813_025106_ooi_z_ls9.fits.fz c4d_180906_010419_ooi_g_ls9-S6 g expnum 769488 exptime 56.0 propid 2014B-0404 seeing 0.89 MJD 58367.045 object DECaLS_59187_g decam/CP/V4.8.2a/CP20180905/c4d_180906_010419_ooi_g_ls9.fits.fz c4d_180906_010419_ooi_g_ls9-S5 g expnum 769488 exptime 56.0 propid 2014B-0404 seeing 0.91 MJD 58367.045 object DECaLS_59187_g decam/CP/V4.8.2a/CP20180905/c4d_180906_010419_ooi_g_ls9.fits.fz c4d_180905_021236_ooi_g_ls9-S3 g expnum 769005 exptime 56.0 propid 2014B-0404 seeing 1.08 MJD 58366.092 object DECaLS_51301_g decam/CP/V4.8.2a/CP20180904/c4d_180905_021236_ooi_g_ls9.fits.fz c4d_180903_012042_ooi_r_ls9-S23 r expnum 768257 exptime 53.0 propid 2014B-0404 seeing 1.35 MJD 58364.056 object DECaLS_27627_r decam/CP/V4.8.2a/CP20180902/c4d_180903_012042_ooi_r_ls9.fits.fz c4d_180904_010106_ooi_g_ls9-S23 g expnum 768666 exptime 115.0 propid 2014B-0404 seeing 1.33 MJD 58365.042 object DECaLS_27627_g decam/CP/V4.8.2a/CP20180903/c4d_180904_010106_ooi_g_ls9.fits.fz c4d_180917_002246_ooi_z_ls9-S23 z expnum 774575 exptime 80.0 propid 2014B-0404 seeing 1.09 MJD 58378.016 object DECaLS_27627_z decam/CP/V4.8.2a/CP20180916/c4d_180917_002246_ooi_z_ls9.fits.fz c4d_180916_005619_ooi_z_ls9-S22 z expnum 774137 exptime 91.0 propid 2014B-0404 seeing 1.39 MJD 58377.039 object DECaLS_43499_z decam/CP/V4.8.2a/CP20180915/c4d_180916_005619_ooi_z_ls9.fits.fz c4d_180911_023211_ooi_r_ls9-S22 r expnum 771856 exptime 59.0 propid 2014B-0404 seeing 1.21 MJD 58372.106 object DECaLS_43499_r decam/CP/V4.8.2a/CP20180910/c4d_180911_023211_ooi_r_ls9.fits.fz c4d_170822_020854_ooi_r_ls9-N29 r expnum 670270 exptime 52.0 propid 2014B-0404 seeing 0.95 MJD 57987.090 object DECaLS_11774_r decam/CP/V4.8.2a/CP20170821/c4d_170822_020854_ooi_r_ls9.fits.fz c4d_170722_041701_ooi_g_ls9-N29 g expnum 660875 exptime 96.0 propid 2014B-0404 seeing 1.02 MJD 57956.177 object DECaLS_11774_g decam/CP/V4.8.2a/CP20170721/c4d_170722_041701_ooi_g_ls9.fits.fz c4d_160813_030011_ooi_z_ls9-N29 z expnum 563511 exptime 80.0 propid 2014B-0404 seeing 0.91 MJD 57613.124 object DECaLS_11774_z decam/CP/V4.8.2a/CP20160812/c4d_160813_030011_ooi_z_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ba61-g-20170719T043332_oi[S24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560631-r-20180516T085912_oi[S24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180903T012042_oi[S23,noinherit][2046,4094][real]: DECaLS_2762 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952e102-z-20180916T005619_oi[S22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180911T023211_oi[S22,noinherit][2046,4094][real]: DECaLS_4349 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T002246_oi[S23,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954922e-z-20160813T024855_oi[S24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T021236_oi[S3,noinherit][2046,4094][real]: DECaLS_5 Clipping 15 pixels with anomalously large oow values: max 0.0731237 vs median 0.0530831 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e77a-g-20180906T010419_oi[S6,noinherit][2046,4094][real]: DECaLS_5 Clipping 2 pixels with anomalously large oow values: max 0.0524548 vs median 0.040082 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e77a-g-20180906T010419_oi[S5,noinherit][2046,4094][real]: DECaLS_5 Clipping 1 pixels with anomalously large oow values: max 0.0515685 vs median 0.0390964 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9521d7c-r-20170822T020854_oi[N29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951d93e-g-20170722T041431_oi[N29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954922e-z-20160813T025800_oi[N29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180904T010106_oi[S23,noinherit][2046,4094][real]: DECaLS_2762 Stage tims : Wall: 24.52 s, CPU: 0.86 s, VmPeak: 1006 MB, VmSize: 1006 MB, VmRSS: 196 MB, VmData: 230 MB, maxrss: 0.200728 MB Stage tims finished: 2020-08-05T22:38:13.895733 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ba61-g-20170719T043332_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180903T012042_oi[S23,noinherit][2046,4094][real]: DECaLS_2762 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952e102-z-20180916T005619_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180911T023211_oi[S22,noinherit][2046,4094][real]: DECaLS_4349 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9521d7c-r-20170822T020854_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T021236_oi[S3,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e77a-g-20180906T010419_oi[S6,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e77a-g-20180906T010419_oi[S5,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954922e-z-20160813T024855_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954922e-z-20160813T025800_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951d93e-g-20170722T041431_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 7.923 s worker CPU, 207.818 s worker Wall, Wall: 24.522 s, Cores in use: 0.36, Total efficiency (on 32 cores): 1.1 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560631-r-20180516T085912_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180904T010106_oi[S23,noinherit][2046,4094][real]: DECaLS_2762 [astropy.io.fits.card] Running stage refs at 2020-08-05T22:38:14.363459 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07348.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07220.fits Matched 19 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/metrics/cus/reference-custom-326609m10411.fits Stage refs : Wall: 5.15 s, CPU: 2.47 s, VmPeak: 1039 MB, VmSize: 1034 MB, VmRSS: 226 MB, VmData: 258 MB, maxrss: 0.231112 MB Stage refs finished: 2020-08-05T22:38:19.515469 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T002246_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 5.154 s, Cores in use: 0.48, Total efficiency (on 32 cores): 1.5 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T22:38:19.561550 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/metrics/cus/outlier-mask-custom-326609m10411.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/metrics/cus/outliers-pre-custom-326609m10411.jpg Image c4d_180905_021236_ooi_g_ls9-S3 g : masking 1176 positive outlier pixels and 0 negative outlier pixels Image c4d_180904_010106_ooi_g_ls9-S23 g : masking 1863 positive outlier pixels and 0 negative outlier pixels Image c4d_170722_041701_ooi_g_ls9-N29 g : masking 1019 positive outlier pixels and 344 negative outlier pixels Image c4d_180903_012042_ooi_r_ls9-S23 r : masking 7967 positive outlier pixels and 144 negative outlier pixels Image c4d_180911_023211_ooi_r_ls9-S22 r : masking 179 positive outlier pixels and 0 negative outlier pixels Image c4d_180917_002246_ooi_z_ls9-S23 z : masking 537 positive outlier pixels and 0 negative outlier pixels Image c4d_180916_005619_ooi_z_ls9-S22 z : masking 1467 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/metrics/cus/outlier-mask-custom-326609m10411.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/metrics/cus/outliers-post-custom-326609m10411.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/metrics/cus/outliers-masked-pos-custom-326609m10411.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/metrics/cus/outliers-masked-neg-custom-326609m10411.jpg Stage outliers : Wall: 1.97 s, CPU: 1.23 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 270 MB, VmData: 303 MB, maxrss: 0.27606 MB Stage outliers finished: 2020-08-05T22:38:21.534395 Resources for stage outliers : 3.103 s worker CPU, 3.703 s worker Wall, Wall: 1.975 s, Cores in use: 2.20, Total efficiency (on 32 cores): 6.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T22:38:21.581380 Stage halos : Wall: 0.81 s, CPU: 0.45 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 270 MB, VmData: 303 MB, maxrss: 0.276452 MB Stage halos finished: 2020-08-05T22:38:22.387605 Resources for stage halos : 1.112 s worker CPU, 1.992 s worker Wall, Wall: 0.809 s, Cores in use: 1.94, Total efficiency (on 32 cores): 6.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T22:38:26.157887 PSF sigmas in coadd pixels: ['2.56', '1.44', '1.47', '1.76', '2.16', '1.66'] Using average PSF sigma 1.8407224670404363 Gaussian PSF norm 0.15325221309839165 vs pixelized 0.121824384 average tim pixel scale / coadd scale: 1.0010954145900193 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.54', '2.19', '1.97', '1.54'] Using average PSF sigma 1.8090492712210846 Gaussian PSF norm 0.15593538344230276 vs pixelized 0.124402694 average tim pixel scale / coadd scale: 1.0011252071370746 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.37', '1.76', '2.26', '1.48'] Using average PSF sigma 1.7181001855364424 Gaussian PSF norm 0.16418995478182766 vs pixelized 0.12932532 average tim pixel scale / coadd scale: 1.0010359794583938 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-copsf-z.fits.fz Stage fit_on_coadds : Wall: 2.06 s, CPU: 0.47 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 272 MB, VmData: 303 MB, maxrss: 0.278048 MB Stage fit_on_coadds finished: 2020-08-05T22:38:28.217189 Resources for stage fit_on_coadds : 0.704 s worker CPU, 0.704 s worker Wall, Wall: 2.061 s, Cores in use: 0.57, Total efficiency (on 32 cores): 1.8 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T22:38:28.314630 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 91 potential peaks Of 91 potential peaks: 25 in veto map, 9 cut by saddle test, 0 cut by aper test, 57 kept SED z : 57 new peaks Found 146 potential peaks Of 146 potential peaks: 123 in veto map, 14 cut by saddle test, 0 cut by aper test, 9 kept SED r : 9 new peaks Found 145 potential peaks Of 145 potential peaks: 115 in veto map, 15 cut by saddle test, 0 cut by aper test, 15 kept SED g : 15 new peaks Found 147 potential peaks Of 147 potential peaks: 119 in veto map, 19 cut by saddle test, 0 cut by aper test, 9 kept SED Flat : 9 new peaks Found 150 potential peaks Of 150 potential peaks: 128 in veto map, 17 cut by saddle test, 0 cut by aper test, 5 kept SED Red : 5 new peaks Adding 95 new sources Median coadd sky for g : -3.828763e-05 Median coadd sky for r : -2.1815498e-05 Median coadd sky for z : 0.00020934548 Stage srcs : Wall: 1.63 s, CPU: 1.53 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 272 MB, VmData: 303 MB, maxrss: 0.27858 MB Stage srcs finished: 2020-08-05T22:38:29.944543 Resources for stage srcs : 0.251 s worker CPU, 0.251 s worker Wall, Wall: 1.632 s, Cores in use: 1.09, Total efficiency (on 32 cores): 3.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T22:38:30.785449 Blob 1 of 51, id: 8, sources: 17, size: 301x218, npix 26169, brick X: 154,455, Y: 114,332, one pixel: 199 114 Blob 2 of 51, id: 0, sources: 7, size: 181x116, npix 9383, brick X: 196,377, Y: 0,116, one pixel: 201 0 Blob 3 of 51, id: 1, sources: 12, size: 149x141, npix 8320, brick X: 342,491, Y: 0,141, one pixel: 368 0 Blob 4 of 51, id: 4, sources: 6, size: 118x108, npix 6879, brick X: 65,183, Y: 65,173, one pixel: 134 65 Blob 5 of 51, id: 29, sources: 2, size: 38x64, npix 1658, brick X: 355,393, Y: 313,377, one pixel: 368 313 Blob 6 of 51, id: 14, sources: 1, size: 52x48, npix 1617, brick X: 112,164, Y: 177,225, one pixel: 129 177 Blob 7 of 51, id: 26, sources: 3, size: 49x55, npix 1361, brick X: 442,491, Y: 288,343, one pixel: 453 288 Blob 8 of 51, id: 18, sources: 2, size: 43x53, npix 1299, brick X: 70,113, Y: 202,255, one pixel: 95 202 Blob 9 of 51, id: 20, sources: 3, size: 41x54, npix 1233, brick X: 380,421, Y: 219,273, one pixel: 390 219 Blob 10 of 51, id: 30, sources: 3, size: 51x40, npix 1129, brick X: 9,60, Y: 335,375, one pixel: 50 335 Blob 11 of 51, id: 16, sources: 2, size: 39x52, npix 1092, brick X: 34,73, Y: 185,237, one pixel: 52 185 Blob 12 of 51, id: 38, sources: 2, size: 51x34, npix 1092, brick X: 352,403, Y: 400,434, one pixel: 380 400 Blob 13 of 51, id: 2, sources: 1, size: 37x37, npix 908, brick X: 71,108, Y: 37,74, one pixel: 87 37 Blob 14 of 51, id: 27, sources: 1, size: 38x33, npix 814, brick X: 114,152, Y: 302,335, one pixel: 130 302 Blob 15 of 51, id: 39, sources: 2, size: 38x34, npix 763, brick X: 220,258, Y: 406,440, one pixel: 229 406 Blob 16 of 51, id: 22, sources: 1, size: 30x32, npix 625, brick X: 120,150, Y: 240,272, one pixel: 134 240 Blob 17 of 51, id: 9, sources: 1, size: 29x29, npix 554, brick X: 346,375, Y: 120,149, one pixel: 358 120 Blob 18 of 51, id: 32, sources: 2, size: 25x32, npix 547, brick X: 465,490, Y: 357,389, one pixel: 476 357 Blob 19 of 51, id: 48, sources: 1, size: 28x28, npix 507, brick X: 322,350, Y: 463,491, one pixel: 336 463 Blob 20 of 51, id: 25, sources: 1, size: 28x28, npix 500, brick X: 82,110, Y: 284,312, one pixel: 93 284 Blob 21 of 51, id: 5, sources: 2, size: 22x38, npix 496, brick X: 14,36, Y: 86,124, one pixel: 23 86 Blob 22 of 51, id: 3, sources: 1, size: 31x27, npix 472, brick X: 13,44, Y: 57,84, one pixel: 22 57 Blob 23 of 51, id: 12, sources: 2, size: 34x22, npix 463, brick X: 398,432, Y: 147,169, one pixel: 406 147 Blob 24 of 51, id: 31, sources: 1, size: 27x27, npix 459, brick X: 218,245, Y: 335,362, one pixel: 230 335 Blob 25 of 51, id: 35, sources: 1, size: 29x27, npix 458, brick X: 188,217, Y: 388,415, one pixel: 206 388 Blob 26 of 51, id: 46, sources: 2, size: 32x31, npix 458, brick X: 382,414, Y: 453,484, one pixel: 403 453 Blob 27 of 51, id: 17, sources: 1, size: 25x26, npix 414, brick X: 296,321, Y: 188,214, one pixel: 307 188 Blob 28 of 51, id: 19, sources: 2, size: 20x31, npix 407, brick X: 442,462, Y: 207,238, one pixel: 450 207 Blob 29 of 51, id: 7, sources: 1, size: 26x24, npix 391, brick X: 236,262, Y: 103,127, one pixel: 246 103 Blob 30 of 51, id: 6, sources: 2, size: 24x29, npix 377, brick X: 203,227, Y: 90,119, one pixel: 217 90 Blob 31 of 51, id: 23, sources: 1, size: 25x24, npix 354, brick X: 418,443, Y: 243,267, one pixel: 428 243 Blob 32 of 51, id: 47, sources: 1, size: 24x23, npix 329, brick X: 449,473, Y: 455,478, one pixel: 459 455 Blob 33 of 51, id: 33, sources: 1, size: 23x23, npix 327, brick X: 228,251, Y: 361,384, one pixel: 238 361 Blob 30 finished, total: Wall: 0.44 s, CPU: 0.44 s, VmPeak: 956 MB, VmSize: 730 MB, VmRSS: 147 MB, VmData: 185 MB, maxrss: 0.15054 MB Blob 34 of 51, id: 41, sources: 1, size: 22x24, npix 327, brick X: 145,167, Y: 412,436, one pixel: 154 412 Blob 26 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 674 MB, VmSize: 672 MB, VmRSS: 97 MB, VmData: 143 MB, maxrss: 0.0994 MB Blob 35 of 51, id: 34, sources: 1, size: 23x23, npix 308, brick X: 98,121, Y: 380,403, one pixel: 108 380 Blob 13 finished, total: Wall: 0.83 s, CPU: 0.82 s, VmPeak: 957 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146692 MB Blob 14 finished, total: Wall: 0.83 s, CPU: 0.82 s, VmPeak: 940 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147216 MB Blob 36 of 51, id: 11, sources: 1, size: 22x22, npix 304, brick X: 441,463, Y: 145,167, one pixel: 450 145 Blob 33 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 956 MB, VmSize: 730 MB, VmRSS: 147 MB, VmData: 185 MB, maxrss: 0.15054 MB Blob 37 of 51, id: 13, sources: 1, size: 23x22, npix 295, brick X: 69,92, Y: 162,184, one pixel: 78 162 Blob 38 of 51, id: 37, sources: 1, size: 22x22, npix 292, brick X: 60,82, Y: 398,420, one pixel: 69 398 Blob 20 finished, total: Wall: 0.87 s, CPU: 0.87 s, VmPeak: 922 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146272 MB Blob 39 of 51, id: 42, sources: 1, size: 21x21, npix 288, brick X: 276,297, Y: 435,456, one pixel: 284 435 Blob 32 finished, total: Wall: 0.84 s, CPU: 0.83 s, VmPeak: 673 MB, VmSize: 672 MB, VmRSS: 98 MB, VmData: 143 MB, maxrss: 0.099856 MB Blob 27 finished, total: Wall: 0.87 s, CPU: 0.86 s, VmPeak: 940 MB, VmSize: 722 MB, VmRSS: 140 MB, VmData: 177 MB, maxrss: 0.14302 MB Blob 40 of 51, id: 44, sources: 1, size: 22x22, npix 282, brick X: 429,451, Y: 440,462, one pixel: 439 440 Blob 41 of 51, id: 10, sources: 1, size: 22x21, npix 281, brick X: 56,78, Y: 137,158, one pixel: 64 137 Measuring 1 iterative sources Blob 31 finished, total: Wall: 0.90 s, CPU: 0.89 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 119 MB, VmData: 169 MB, maxrss: 0.122216 MB Blob 42 of 51, id: 24, sources: 1, size: 21x21, npix 250, brick X: 461,482, Y: 253,274, one pixel: 471 253 Measuring 1 iterative sources Blob 17 finished, total: Wall: 0.97 s, CPU: 0.97 s, VmPeak: 674 MB, VmSize: 673 MB, VmRSS: 98 MB, VmData: 144 MB, maxrss: 0.100208 MB Blob 43 of 51, id: 36, sources: 1, size: 21x20, npix 247, brick X: 322,343, Y: 388,408, one pixel: 332 388 Blob 29 finished, total: Wall: 0.95 s, CPU: 0.94 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 120 MB, VmData: 167 MB, maxrss: 0.123116 MB Blob 44 of 51, id: 28, sources: 1, size: 21x19, npix 219, brick X: 69,90, Y: 305,324, one pixel: 78 305 Blob 28 finished, total: Wall: 1.00 s, CPU: 0.98 s, VmPeak: 956 MB, VmSize: 723 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.145024 MB Blob 45 of 51, id: 40, sources: 1, size: 19x20, npix 218, brick X: 100,119, Y: 409,429, one pixel: 108 409 Blob 21 finished, total: Wall: 1.05 s, CPU: 1.05 s, VmPeak: 954 MB, VmSize: 714 MB, VmRSS: 128 MB, VmData: 169 MB, maxrss: 0.143636 MB Blob 46 of 51, id: 43, sources: 1, size: 20x20, npix 209, brick X: 403,423, Y: 439,459, one pixel: 412 439 Blob 16 finished, total: Wall: 1.14 s, CPU: 1.13 s, VmPeak: 677 MB, VmSize: 676 MB, VmRSS: 101 MB, VmData: 147 MB, maxrss: 0.103684 MB Blob 47 of 51, id: 21, sources: 1, size: 18x19, npix 189, brick X: 468,486, Y: 226,245, one pixel: 476 226 Blob 45 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 954 MB, VmSize: 714 MB, VmRSS: 128 MB, VmData: 169 MB, maxrss: 0.143636 MB Blob 48 of 51, id: 49, sources: 1, size: 15x19, npix 188, brick X: 0,15, Y: 471,490, one pixel: 4 471 Blob 36 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 940 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.14758 MB Blob 49 of 51, id: 50, sources: 1, size: 18x18, npix 180, brick X: 425,443, Y: 473,491, one pixel: 433 473 Blob 35 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 957 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146692 MB Blob 50 of 51, id: 15, sources: 1, size: 18x18, npix 171, brick X: 466,484, Y: 184,202, one pixel: 474 184 Measuring 1 iterative sources Blob 15 finished, total: Wall: 1.23 s, CPU: 1.23 s, VmPeak: 676 MB, VmSize: 676 MB, VmRSS: 101 MB, VmData: 147 MB, maxrss: 0.103764 MB Blob 51 of 51, id: 45, sources: 1, size: 17x17, npix 145, brick X: 465,482, Y: 441,458, one pixel: 473 441 Blob 40 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 940 MB, VmSize: 722 MB, VmRSS: 140 MB, VmData: 177 MB, maxrss: 0.14302 MB Blob 22 finished, total: Wall: 1.24 s, CPU: 1.24 s, VmPeak: 940 MB, VmSize: 727 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148928 MB Blob 18 finished, total: Wall: 1.25 s, CPU: 1.24 s, VmPeak: 675 MB, VmSize: 673 MB, VmRSS: 99 MB, VmData: 145 MB, maxrss: 0.101392 MB Blob 47 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 954 MB, VmSize: 714 MB, VmRSS: 128 MB, VmData: 169 MB, maxrss: 0.143636 MB Blob 23 finished, total: Wall: 1.26 s, CPU: 1.26 s, VmPeak: 955 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144788 MB Blob 49 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 957 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146692 MB Blob 42 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 674 MB, VmSize: 673 MB, VmRSS: 98 MB, VmData: 144 MB, maxrss: 0.100404 MB Blob 50 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 676 MB, VmSize: 676 MB, VmRSS: 101 MB, VmData: 147 MB, maxrss: 0.103892 MB Blob 24 finished, total: Wall: 1.30 s, CPU: 1.30 s, VmPeak: 700 MB, VmSize: 700 MB, VmRSS: 119 MB, VmData: 171 MB, maxrss: 0.121792 MB Blob 43 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 697 MB, VmSize: 696 MB, VmRSS: 120 MB, VmData: 167 MB, maxrss: 0.123312 MB Blob 41 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 699 MB, VmSize: 698 MB, VmRSS: 120 MB, VmData: 169 MB, maxrss: 0.122416 MB Blob 25 finished, total: Wall: 1.39 s, CPU: 1.38 s, VmPeak: 702 MB, VmSize: 702 MB, VmRSS: 120 MB, VmData: 173 MB, maxrss: 0.12326 MB Blob 46 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 677 MB, VmSize: 676 MB, VmRSS: 101 MB, VmData: 147 MB, maxrss: 0.103816 MB Blob 19 finished, total: Wall: 1.50 s, CPU: 1.49 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 119 MB, VmData: 167 MB, maxrss: 0.121492 MB Blob 39 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 673 MB, VmSize: 672 MB, VmRSS: 98 MB, VmData: 143 MB, maxrss: 0.100016 MB Blob 34 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 674 MB, VmSize: 672 MB, VmRSS: 97 MB, VmData: 143 MB, maxrss: 0.0995 MB Measuring 1 iterative sources Measuring 1 iterative sources Blob 38 finished, total: Wall: 0.85 s, CPU: 0.84 s, VmPeak: 922 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146272 MB Blob 8 finished, total: Wall: 1.77 s, CPU: 1.76 s, VmPeak: 672 MB, VmSize: 671 MB, VmRSS: 97 MB, VmData: 142 MB, maxrss: 0.099328 MB Blob 44 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 956 MB, VmSize: 723 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.145024 MB Blob 51 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 940 MB, VmSize: 722 MB, VmRSS: 140 MB, VmData: 177 MB, maxrss: 0.14302 MB Blob 11 finished, total: Wall: 2.04 s, CPU: 2.03 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.098008 MB Blob 6 finished, total: Wall: 2.07 s, CPU: 2.06 s, VmPeak: 678 MB, VmSize: 678 MB, VmRSS: 104 MB, VmData: 149 MB, maxrss: 0.106088 MB Blob 12 finished, total: Wall: 2.05 s, CPU: 2.04 s, VmPeak: 677 MB, VmSize: 677 MB, VmRSS: 102 MB, VmData: 148 MB, maxrss: 0.104812 MB Blob 37 finished, total: Wall: 1.21 s, CPU: 1.21 s, VmPeak: 956 MB, VmSize: 730 MB, VmRSS: 149 MB, VmData: 185 MB, maxrss: 0.152412 MB Blob 48 finished, total: Wall: 0.89 s, CPU: 0.89 s, VmPeak: 940 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.14758 MB Blob 10 finished, total: Wall: 2.19 s, CPU: 2.19 s, VmPeak: 960 MB, VmSize: 714 MB, VmRSS: 127 MB, VmData: 169 MB, maxrss: 0.143604 MB Blob 7 finished, total: Wall: 2.31 s, CPU: 2.29 s, VmPeak: 939 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146516 MB Blob 9 finished, total: Wall: 2.47 s, CPU: 2.46 s, VmPeak: 676 MB, VmSize: 674 MB, VmRSS: 99 MB, VmData: 145 MB, maxrss: 0.10116 MB Blob 5 finished, total: Wall: 2.70 s, CPU: 2.70 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 113 MB, VmData: 167 MB, maxrss: 0.115944 MB Blob 4 finished, total: Wall: 3.30 s, CPU: 3.30 s, VmPeak: 954 MB, VmSize: 712 MB, VmRSS: 127 MB, VmData: 167 MB, maxrss: 0.143664 MB Measuring 4 iterative sources Blob 2 finished, total: Wall: 8.74 s, CPU: 8.73 s, VmPeak: 954 MB, VmSize: 727 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149976 MB Measuring 5 iterative sources Blob 3 finished, total: Wall: 12.93 s, CPU: 12.92 s, VmPeak: 959 MB, VmSize: 728 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.1506 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.39803, ee1=-0.708892, ee2=0.434804 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.08961, ee1=-0.0883812, ee2=0.168144 Measuring 7 iterative sources Blob 1 finished, total: Wall: 32.07 s, CPU: 32.07 s, VmPeak: 738 MB, VmSize: 727 MB, VmRSS: 163 MB, VmData: 198 MB, maxrss: 0.17834 MB Old catalog: 114 New catalog: 120 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/metrics/cus/blobs-custom-326609m10411.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/metrics/cus/all-models-custom-326609m10411.fits Stage fitblobs : Wall: 33.52 s, CPU: 1.21 s, VmPeak: 1045 MB, VmSize: 1042 MB, VmRSS: 270 MB, VmData: 300 MB, maxrss: 0.278852 MB Stage fitblobs finished: 2020-08-05T22:39:04.304297 Resources for stage fitblobs : 104.649 s worker CPU, 105.106 s worker Wall, Wall: 33.521 s, Cores in use: 3.16, Total efficiency (on 32 cores): 9.9 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T22:39:04.332209 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/tmp-legacysurvey-custom-326609m10411-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/tmp-legacysurvey-custom-326609m10411-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/tmp-legacysurvey-custom-326609m10411-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/tmp-legacysurvey-custom-326609m10411-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-resid.jpg Stage coadds : Wall: 4.72 s, CPU: 0.95 s, VmPeak: 1066 MB, VmSize: 1033 MB, VmRSS: 262 MB, VmData: 291 MB, maxrss: 0.30188 MB Stage coadds finished: 2020-08-05T22:39:09.054022 Resources for stage coadds : 31.616 s worker CPU, 35.290 s worker Wall, Wall: 4.724 s, Cores in use: 6.89, Total efficiency (on 32 cores): 21.5 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-05T22:39:09.079571 Cut to 1 unWISE tiles Reading WISE tile 3261m107 band 1 Reading WISE tile 3261m107 band 2 Reading WISE tile 3261m107 band 3 Reading WISE tile 3261m107 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.23 s, CPU: 0.54 s, VmPeak: 1072 MB, VmSize: 1072 MB, VmRSS: 210 MB, VmData: 251 MB, maxrss: 0.214744 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.45 s, CPU: 1.43 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 151 MB, VmData: 191 MB, maxrss: 0.191764 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.19 s, CPU: 0.43 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 143 MB, VmData: 184 MB, maxrss: 0.2057 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.19 s, CPU: 0.46 s, VmPeak: 1008 MB, VmSize: 1008 MB, VmRSS: 149 MB, VmData: 188 MB, maxrss: 0.209988 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/tmp-legacysurvey-custom-326609m10411-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/tmp-legacysurvey-custom-326609m10411-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.87 s, CPU: 0.67 s, VmPeak: 1066 MB, VmSize: 1037 MB, VmRSS: 267 MB, VmData: 295 MB, maxrss: 0.30188 MB Stage wise_forced finished: 2020-08-05T22:39:11.947086 Resources for stage wise_forced : 5.867 s worker CPU, 5.634 s worker Wall, Wall: 2.870 s, Cores in use: 2.28, Total efficiency (on 32 cores): 7.1 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T22:39:12.245572 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/coadd/cus/custom-326609m10411/legacysurvey-custom-326609m10411-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/tractor-i/cus/tractor-custom-326609m10411.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/tractor/cus/tractor-custom-326609m10411.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/tractor/cus/brick-custom-326609m10411.sha256sum Stage writecat : Wall: 1.21 s, CPU: 1.06 s, VmPeak: 1181 MB, VmSize: 1053 MB, VmRSS: 281 MB, VmData: 307 MB, maxrss: 0.418408 MB Stage writecat finished: 2020-08-05T22:39:13.451466 Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 1.209 s, Cores in use: 0.88, Total efficiency (on 32 cores): 2.8 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-writecat.p All done: 155.233 s worker CPU, 360.506 s worker Wall, Wall: 84.107 s, Cores in use: 1.98, Total efficiency (on 32 cores): 6.2 % Finished galaxy PGC163383_GROUP in 1.455 minutes. Started working on galaxy PGC163383_GROUP at Mon Aug 10 15:00:14 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 326.6088781914892 -10.411803874695872 --width 487 --height 487 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-10T15:00:16.275025 legacypipe git version: DR9.5.11-watershed-6-g6a2880fc Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '326.6088781914892', '-10.411803874695872', '--width', '487', '--height', '487', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 326.6088781914892 -10.411803874695872 --width 487 --height 487 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 326.6088781914892 -10.411803874695872 Starting process 21419 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 21420 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 21421 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 21422 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 21423 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059472 MB Starting process 21424 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059484 MB Starting process 21425 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059484 MB Starting process 21426 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 21427 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 21428 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 21429 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 21430 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 21431 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 21432 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 21433 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 21434 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-10T15:00:17.851435 Keeping 14 CCDs: c4d_180516_085912_ooi_r_ls9-S24 r expnum 746804 exptime 72.0 propid 2014B-0404 seeing 0.95 MJD 58254.374 object DECaLS_11755_r decam/CP/V4.8.2a/CP20180515/c4d_180516_085912_ooi_r_ls9.fits.fz c4d_170719_043641_ooi_g_ls9-S24 g expnum 659982 exptime 136.0 propid 2014B-0404 seeing 1.58 MJD 57953.190 object DECaLS_11755_g decam/CP/V4.8.2/CP20170718/c4d_170719_043641_ooi_g_ls9.fits.fz c4d_160813_025106_ooi_z_ls9-S24 z expnum 563506 exptime 80.0 propid 2014B-0404 seeing 0.84 MJD 57613.117 object DECaLS_11755_z decam/CP/V4.8.2a/CP20160812/c4d_160813_025106_ooi_z_ls9.fits.fz c4d_180906_010419_ooi_g_ls9-S6 g expnum 769488 exptime 56.0 propid 2014B-0404 seeing 0.89 MJD 58367.045 object DECaLS_59187_g decam/CP/V4.8.2a/CP20180905/c4d_180906_010419_ooi_g_ls9.fits.fz c4d_180906_010419_ooi_g_ls9-S5 g expnum 769488 exptime 56.0 propid 2014B-0404 seeing 0.91 MJD 58367.045 object DECaLS_59187_g decam/CP/V4.8.2a/CP20180905/c4d_180906_010419_ooi_g_ls9.fits.fz c4d_180905_021236_ooi_g_ls9-S3 g expnum 769005 exptime 56.0 propid 2014B-0404 seeing 1.08 MJD 58366.092 object DECaLS_51301_g decam/CP/V4.8.2a/CP20180904/c4d_180905_021236_ooi_g_ls9.fits.fz c4d_180903_012042_ooi_r_ls9-S23 r expnum 768257 exptime 53.0 propid 2014B-0404 seeing 1.35 MJD 58364.056 object DECaLS_27627_r decam/CP/V4.8.2a/CP20180902/c4d_180903_012042_ooi_r_ls9.fits.fz c4d_180904_010106_ooi_g_ls9-S23 g expnum 768666 exptime 115.0 propid 2014B-0404 seeing 1.33 MJD 58365.042 object DECaLS_27627_g decam/CP/V4.8.2a/CP20180903/c4d_180904_010106_ooi_g_ls9.fits.fz c4d_180917_002246_ooi_z_ls9-S23 z expnum 774575 exptime 80.0 propid 2014B-0404 seeing 1.09 MJD 58378.016 object DECaLS_27627_z decam/CP/V4.8.2a/CP20180916/c4d_180917_002246_ooi_z_ls9.fits.fz c4d_180916_005619_ooi_z_ls9-S22 z expnum 774137 exptime 91.0 propid 2014B-0404 seeing 1.39 MJD 58377.039 object DECaLS_43499_z decam/CP/V4.8.2a/CP20180915/c4d_180916_005619_ooi_z_ls9.fits.fz c4d_180911_023211_ooi_r_ls9-S22 r expnum 771856 exptime 59.0 propid 2014B-0404 seeing 1.21 MJD 58372.106 object DECaLS_43499_r decam/CP/V4.8.2a/CP20180910/c4d_180911_023211_ooi_r_ls9.fits.fz c4d_170822_020854_ooi_r_ls9-N29 r expnum 670270 exptime 52.0 propid 2014B-0404 seeing 0.95 MJD 57987.090 object DECaLS_11774_r decam/CP/V4.8.2a/CP20170821/c4d_170822_020854_ooi_r_ls9.fits.fz c4d_170722_041701_ooi_g_ls9-N29 g expnum 660875 exptime 96.0 propid 2014B-0404 seeing 1.02 MJD 57956.177 object DECaLS_11774_g decam/CP/V4.8.2a/CP20170721/c4d_170722_041701_ooi_g_ls9.fits.fz c4d_160813_030011_ooi_z_ls9-N29 z expnum 563511 exptime 80.0 propid 2014B-0404 seeing 0.91 MJD 57613.124 object DECaLS_11774_z decam/CP/V4.8.2a/CP20160812/c4d_160813_030011_ooi_z_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180904T010106_oi[S23,noinherit][2046,4094][real]: DECaLS_2762 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T021236_oi[S3,noinherit][2046,4094][real]: DECaLS_5 Clipping 15 pixels with anomalously large oow values: max 0.0731237 vs median 0.0530831 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954922e-z-20160813T024855_oi[S24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e77a-g-20180906T010419_oi[S6,noinherit][2046,4094][real]: DECaLS_5 Clipping 2 pixels with anomalously large oow values: max 0.0524548 vs median 0.040082 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e77a-g-20180906T010419_oi[S5,noinherit][2046,4094][real]: DECaLS_5 Clipping 1 pixels with anomalously large oow values: max 0.0515685 vs median 0.0390964 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ba61-g-20170719T043332_oi[S24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180903T012042_oi[S23,noinherit][2046,4094][real]: DECaLS_2762 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T002246_oi[S23,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560631-r-20180516T085912_oi[S24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952e102-z-20180916T005619_oi[S22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9521d7c-r-20170822T020854_oi[N29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954922e-z-20160813T025800_oi[N29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180911T023211_oi[S22,noinherit][2046,4094][real]: DECaLS_4349 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951d93e-g-20170722T041431_oi[N29,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 11.75 s, CPU: 1.67 s, VmPeak: 1006 MB, VmSize: 1006 MB, VmRSS: 196 MB, VmData: 229 MB, maxrss: 0.200376 MB Stage tims finished: 2020-08-10T15:00:29.602143 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954922e-z-20160813T024855_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954922e-z-20160813T025800_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180904T010106_oi[S23,noinherit][2046,4094][real]: DECaLS_2762 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ba61-g-20170719T043332_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9521d7c-r-20170822T020854_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180903T012042_oi[S23,noinherit][2046,4094][real]: DECaLS_2762 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952e102-z-20180916T005619_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560631-r-20180516T085912_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180911T023211_oi[S22,noinherit][2046,4094][real]: DECaLS_4349 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951d93e-g-20170722T041431_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 8.869 s worker CPU, 113.882 s worker Wall, Wall: 11.753 s, Cores in use: 0.90, Total efficiency (on 16 cores): 5.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T021236_oi[S3,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e77a-g-20180906T010419_oi[S6,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e77a-g-20180906T010419_oi[S5,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T002246_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-08-10T15:00:29.689067 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07348.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07220.fits Matched 19 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/metrics/cus/reference-custom-326608m10411.fits Stage refs : Wall: 3.88 s, CPU: 3.41 s, VmPeak: 1039 MB, VmSize: 1034 MB, VmRSS: 225 MB, VmData: 258 MB, maxrss: 0.23044 MB Stage refs finished: 2020-08-10T15:00:33.565304 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.878 s, Cores in use: 0.88, Total efficiency (on 16 cores): 5.5 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-10T15:00:33.693601 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/metrics/cus/outlier-mask-custom-326608m10411.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/metrics/cus/outliers-pre-custom-326608m10411.jpg Image c4d_180905_021236_ooi_g_ls9-S3 g : masking 1108 positive outlier pixels and 0 negative outlier pixels Image c4d_180904_010106_ooi_g_ls9-S23 g : masking 1941 positive outlier pixels and 0 negative outlier pixels Image c4d_170722_041701_ooi_g_ls9-N29 g : masking 955 positive outlier pixels and 367 negative outlier pixels Image c4d_180911_023211_ooi_r_ls9-S22 r : masking 153 positive outlier pixels and 0 negative outlier pixels Image c4d_180903_012042_ooi_r_ls9-S23 r : masking 7757 positive outlier pixels and 0 negative outlier pixels Image c4d_160813_025106_ooi_z_ls9-S24 z : masking 44 positive outlier pixels and 0 negative outlier pixels Image c4d_180917_002246_ooi_z_ls9-S23 z : masking 531 positive outlier pixels and 0 negative outlier pixels Image c4d_180916_005619_ooi_z_ls9-S22 z : masking 1432 positive outlier pixels and 0 negative outlier pixels Image c4d_160813_030011_ooi_z_ls9-N29 z : masking 77 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/metrics/cus/outlier-mask-custom-326608m10411.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/metrics/cus/outliers-post-custom-326608m10411.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/metrics/cus/outliers-masked-pos-custom-326608m10411.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/metrics/cus/outliers-masked-neg-custom-326608m10411.jpg Stage outliers : Wall: 1.94 s, CPU: 1.37 s, VmPeak: 1044 MB, VmSize: 1044 MB, VmRSS: 268 MB, VmData: 300 MB, maxrss: 0.274724 MB Stage outliers finished: 2020-08-10T15:00:35.636081 Resources for stage outliers : 3.209 s worker CPU, 3.288 s worker Wall, Wall: 1.944 s, Cores in use: 2.36, Total efficiency (on 16 cores): 14.7 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-10T15:00:36.033692 Stage halos : Wall: 0.49 s, CPU: 0.35 s, VmPeak: 1044 MB, VmSize: 1044 MB, VmRSS: 269 MB, VmData: 301 MB, maxrss: 0.275108 MB Stage halos finished: 2020-08-10T15:00:36.524793 Resources for stage halos : 1.228 s worker CPU, 1.437 s worker Wall, Wall: 0.493 s, Cores in use: 3.20, Total efficiency (on 16 cores): 20.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-10T15:00:36.574410 PSF sigmas in coadd pixels: ['2.56', '1.44', '1.47', '1.76', '2.16', '1.66'] Using average PSF sigma 1.8407224670404363 Gaussian PSF norm 0.15325221309839165 vs pixelized 0.12182511 average tim pixel scale / coadd scale: 1.0010954145900193 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.54', '2.19', '1.97', '1.54'] Using average PSF sigma 1.8090492712210846 Gaussian PSF norm 0.15593538344230276 vs pixelized 0.124401055 average tim pixel scale / coadd scale: 1.0011252071370746 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.37', '1.76', '2.26', '1.48'] Using average PSF sigma 1.7181001855364424 Gaussian PSF norm 0.16418995478182766 vs pixelized 0.12932494 average tim pixel scale / coadd scale: 1.0010359794583938 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.47 s, CPU: 0.48 s, VmPeak: 1044 MB, VmSize: 1044 MB, VmRSS: 273 MB, VmData: 303 MB, maxrss: 0.27928 MB Stage fit_on_coadds finished: 2020-08-10T15:00:37.048127 Resources for stage fit_on_coadds : 0.774 s worker CPU, 0.774 s worker Wall, Wall: 0.475 s, Cores in use: 2.65, Total efficiency (on 16 cores): 16.6 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-10T15:00:37.065197 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 89 potential peaks Of 89 potential peaks: 26 in veto map, 8 cut by saddle test, 0 cut by aper test, 55 kept SED z : 55 new peaks Found 137 potential peaks Of 137 potential peaks: 113 in veto map, 14 cut by saddle test, 0 cut by aper test, 10 kept SED r : 10 new peaks Found 143 potential peaks Of 143 potential peaks: 113 in veto map, 14 cut by saddle test, 0 cut by aper test, 16 kept SED g : 16 new peaks Found 145 potential peaks Of 145 potential peaks: 118 in veto map, 19 cut by saddle test, 0 cut by aper test, 8 kept SED Flat : 8 new peaks Found 150 potential peaks Of 150 potential peaks: 129 in veto map, 17 cut by saddle test, 0 cut by aper test, 4 kept SED Red : 4 new peaks Adding 93 new sources Median coadd sky for g : -3.894115e-05 Median coadd sky for r : -2.065674e-05 Median coadd sky for z : 0.00023767835 Stage srcs : Wall: 0.99 s, CPU: 0.90 s, VmPeak: 1044 MB, VmSize: 1044 MB, VmRSS: 241 MB, VmData: 303 MB, maxrss: 0.27928 MB Stage srcs finished: 2020-08-10T15:00:38.050505 Resources for stage srcs : 0.237 s worker CPU, 0.237 s worker Wall, Wall: 0.987 s, Cores in use: 1.15, Total efficiency (on 16 cores): 7.2 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-10T15:00:38.288200 Blob 1 of 52, id: 9, sources: 16, size: 301x220, npix 26168, brick X: 149,450, Y: 112,332, one pixel: 194 112 Blob 2 of 52, id: 1, sources: 12, size: 149x139, npix 8228, brick X: 338,487, Y: 0,139, one pixel: 360 0 Blob 3 of 52, id: 2, sources: 5, size: 160x88, npix 7944, brick X: 213,373, Y: 26,114, one pixel: 237 26 Blob 4 of 52, id: 5, sources: 6, size: 119x108, npix 6883, brick X: 60,179, Y: 63,171, one pixel: 129 63 Blob 5 of 52, id: 30, sources: 2, size: 38x64, npix 1675, brick X: 350,388, Y: 311,375, one pixel: 363 311 Blob 6 of 52, id: 15, sources: 1, size: 52x47, npix 1599, brick X: 107,159, Y: 175,222, one pixel: 125 175 Blob 7 of 52, id: 19, sources: 2, size: 43x52, npix 1299, brick X: 65,108, Y: 200,252, one pixel: 90 200 Blob 8 of 52, id: 0, sources: 2, size: 65x28, npix 1278, brick X: 193,258, Y: 0,28, one pixel: 196 0 Blob 9 of 52, id: 21, sources: 3, size: 41x54, npix 1233, brick X: 376,417, Y: 217,271, one pixel: 385 217 Blob 10 of 52, id: 40, sources: 2, size: 51x35, npix 1108, brick X: 347,398, Y: 397,432, one pixel: 377 397 Blob 11 of 52, id: 32, sources: 3, size: 51x40, npix 1102, brick X: 4,55, Y: 333,373, one pixel: 46 333 Blob 12 of 52, id: 17, sources: 2, size: 36x52, npix 1023, brick X: 30,66, Y: 183,235, one pixel: 47 183 Blob 13 of 52, id: 27, sources: 2, size: 43x39, npix 1013, brick X: 437,480, Y: 286,325, one pixel: 448 286 Blob 14 of 52, id: 3, sources: 1, size: 37x37, npix 908, brick X: 66,103, Y: 35,72, one pixel: 82 35 Blob 15 of 52, id: 28, sources: 1, size: 37x33, npix 798, brick X: 110,147, Y: 300,333, one pixel: 126 300 Blob 16 of 52, id: 41, sources: 2, size: 38x34, npix 759, brick X: 215,253, Y: 404,438, one pixel: 224 404 Blob 17 of 52, id: 23, sources: 1, size: 31x32, npix 626, brick X: 115,146, Y: 238,270, one pixel: 129 238 Blob 14 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 940 MB, VmSize: 728 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.1489 MB Blob 18 of 52, id: 10, sources: 1, size: 29x29, npix 564, brick X: 341,370, Y: 118,147, one pixel: 353 118 Blob 15 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 954 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 180 MB, maxrss: 0.146736 MB Blob 19 of 52, id: 34, sources: 2, size: 25x32, npix 533, brick X: 460,485, Y: 355,387, one pixel: 472 355 Blob 16 finished, total: Wall: 1.37 s, CPU: 1.36 s, VmPeak: 954 MB, VmSize: 731 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152228 MB Blob 20 of 52, id: 26, sources: 1, size: 28x29, npix 503, brick X: 77,105, Y: 281,310, one pixel: 90 281 Blob 13 finished, total: Wall: 1.69 s, CPU: 1.68 s, VmPeak: 957 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 187 MB, maxrss: 0.15242 MB Blob 21 of 52, id: 6, sources: 2, size: 22x37, npix 498, brick X: 10,32, Y: 84,121, one pixel: 18 84 Blob 8 finished, total: Wall: 1.77 s, CPU: 1.77 s, VmPeak: 959 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149252 MB Blob 22 of 52, id: 4, sources: 1, size: 31x27, npix 473, brick X: 9,40, Y: 55,82, one pixel: 17 55 Measuring 1 iterative sources Blob 7 finished, total: Wall: 1.81 s, CPU: 1.81 s, VmPeak: 954 MB, VmSize: 712 MB, VmRSS: 127 MB, VmData: 167 MB, maxrss: 0.143712 MB Blob 23 of 52, id: 50, sources: 1, size: 27x26, npix 471, brick X: 318,345, Y: 461,487, one pixel: 331 461 Blob 17 finished, total: Wall: 1.05 s, CPU: 1.05 s, VmPeak: 940 MB, VmSize: 728 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.1489 MB Blob 24 of 52, id: 33, sources: 1, size: 27x27, npix 470, brick X: 214,241, Y: 333,360, one pixel: 225 333 Blob 18 finished, total: Wall: 1.07 s, CPU: 1.07 s, VmPeak: 954 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 180 MB, maxrss: 0.146736 MB Blob 25 of 52, id: 48, sources: 2, size: 32x31, npix 458, brick X: 378,410, Y: 451,482, one pixel: 398 451 Blob 6 finished, total: Wall: 2.03 s, CPU: 2.03 s, VmPeak: 940 MB, VmSize: 727 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149256 MB Blob 26 of 52, id: 37, sources: 1, size: 28x27, npix 456, brick X: 184,212, Y: 386,413, one pixel: 201 386 Blob 12 finished, total: Wall: 2.18 s, CPU: 2.17 s, VmPeak: 956 MB, VmSize: 730 MB, VmRSS: 147 MB, VmData: 185 MB, maxrss: 0.150084 MB Blob 27 of 52, id: 13, sources: 2, size: 33x22, npix 450, brick X: 394,427, Y: 145,167, one pixel: 402 145 Blob 10 finished, total: Wall: 2.20 s, CPU: 2.20 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 99 MB, VmData: 145 MB, maxrss: 0.1015 MB Blob 28 of 52, id: 18, sources: 1, size: 25x26, npix 413, brick X: 292,317, Y: 186,212, one pixel: 303 186 Blob 21 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 959 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149252 MB Blob 29 of 52, id: 8, sources: 1, size: 26x25, npix 401, brick X: 231,257, Y: 100,125, one pixel: 243 100 Blob 19 finished, total: Wall: 1.13 s, CPU: 1.13 s, VmPeak: 954 MB, VmSize: 731 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152228 MB Blob 30 of 52, id: 20, sources: 2, size: 21x31, npix 394, brick X: 437,458, Y: 205,236, one pixel: 446 205 Blob 11 finished, total: Wall: 2.57 s, CPU: 2.57 s, VmPeak: 922 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146524 MB Blob 31 of 52, id: 7, sources: 2, size: 23x29, npix 366, brick X: 199,222, Y: 88,117, one pixel: 213 88 Measuring 1 iterative sources Blob 20 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 957 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 187 MB, maxrss: 0.15242 MB Blob 32 of 52, id: 24, sources: 1, size: 24x24, npix 353, brick X: 414,438, Y: 241,265, one pixel: 423 241 Blob 24 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 954 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 180 MB, maxrss: 0.146736 MB Blob 33 of 52, id: 31, sources: 1, size: 21x24, npix 337, brick X: 466,487, Y: 317,341, one pixel: 476 317 Blob 25 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 940 MB, VmSize: 727 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149256 MB Blob 34 of 52, id: 49, sources: 1, size: 23x23, npix 336, brick X: 445,468, Y: 453,476, one pixel: 454 453 Measuring 1 iterative sources Blob 9 finished, total: Wall: 3.06 s, CPU: 3.06 s, VmPeak: 939 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14968 MB Blob 31 finished, total: Wall: 0.43 s, CPU: 0.43 s, VmPeak: 957 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 187 MB, maxrss: 0.15242 MB Blob 35 of 52, id: 43, sources: 1, size: 23x24, npix 318, brick X: 140,163, Y: 410,434, one pixel: 150 410 Blob 22 finished, total: Wall: 1.26 s, CPU: 1.26 s, VmPeak: 954 MB, VmSize: 712 MB, VmRSS: 127 MB, VmData: 167 MB, maxrss: 0.143712 MB Blob 36 of 52, id: 35, sources: 1, size: 23x23, npix 317, brick X: 223,246, Y: 359,382, one pixel: 233 359 Blob 37 of 52, id: 12, sources: 1, size: 23x22, npix 306, brick X: 436,459, Y: 143,165, one pixel: 445 143 Measuring 1 iterative sources Blob 28 finished, total: Wall: 0.83 s, CPU: 0.83 s, VmPeak: 959 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149252 MB Blob 38 of 52, id: 36, sources: 1, size: 22x22, npix 304, brick X: 94,116, Y: 378,400, one pixel: 103 378 Blob 5 finished, total: Wall: 3.39 s, CPU: 3.38 s, VmPeak: 940 MB, VmSize: 727 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.14998 MB Blob 39 of 52, id: 14, sources: 1, size: 23x22, npix 302, brick X: 64,87, Y: 160,182, one pixel: 73 160 Blob 26 finished, total: Wall: 1.21 s, CPU: 1.21 s, VmPeak: 956 MB, VmSize: 730 MB, VmRSS: 147 MB, VmData: 185 MB, maxrss: 0.150084 MB Blob 40 of 52, id: 39, sources: 1, size: 22x22, npix 283, brick X: 56,78, Y: 396,418, one pixel: 64 396 Blob 29 finished, total: Wall: 0.88 s, CPU: 0.88 s, VmPeak: 954 MB, VmSize: 731 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152228 MB Blob 36 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 954 MB, VmSize: 712 MB, VmRSS: 127 MB, VmData: 167 MB, maxrss: 0.143712 MB Blob 23 finished, total: Wall: 1.65 s, CPU: 1.65 s, VmPeak: 940 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149584 MB Blob 41 of 52, id: 11, sources: 1, size: 22x21, npix 280, brick X: 51,73, Y: 135,156, one pixel: 60 135 Blob 27 finished, total: Wall: 1.38 s, CPU: 1.38 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 99 MB, VmData: 145 MB, maxrss: 0.101624 MB Blob 42 of 52, id: 46, sources: 1, size: 22x21, npix 271, brick X: 425,447, Y: 438,459, one pixel: 434 438 Blob 43 of 52, id: 44, sources: 1, size: 21x21, npix 270, brick X: 271,292, Y: 433,454, one pixel: 280 433 Blob 44 of 52, id: 25, sources: 1, size: 21x21, npix 250, brick X: 457,478, Y: 251,272, one pixel: 466 251 Blob 32 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 954 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 180 MB, maxrss: 0.146736 MB Blob 45 of 52, id: 38, sources: 1, size: 21x20, npix 230, brick X: 317,338, Y: 386,406, one pixel: 327 386 Blob 38 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 940 MB, VmSize: 727 MB, VmRSS: 147 MB, VmData: 182 MB, maxrss: 0.150112 MB Blob 46 of 52, id: 29, sources: 1, size: 20x19, npix 227, brick X: 65,85, Y: 303,322, one pixel: 73 303 Blob 39 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 956 MB, VmSize: 730 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151948 MB Blob 47 of 52, id: 42, sources: 1, size: 20x19, npix 227, brick X: 95,115, Y: 407,426, one pixel: 103 407 Blob 35 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 957 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 187 MB, maxrss: 0.15242 MB Blob 48 of 52, id: 45, sources: 1, size: 19x20, npix 209, brick X: 399,418, Y: 437,457, one pixel: 407 437 Blob 30 finished, total: Wall: 1.21 s, CPU: 1.21 s, VmPeak: 922 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148008 MB Blob 49 of 52, id: 22, sources: 1, size: 19x19, npix 190, brick X: 463,482, Y: 224,243, one pixel: 472 224 Blob 33 finished, total: Wall: 0.87 s, CPU: 0.87 s, VmPeak: 940 MB, VmSize: 727 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149256 MB Blob 50 of 52, id: 16, sources: 1, size: 18x18, npix 171, brick X: 462,480, Y: 181,199, one pixel: 470 181 Blob 47 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 957 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 187 MB, maxrss: 0.15242 MB Blob 51 of 52, id: 47, sources: 1, size: 17x17, npix 145, brick X: 460,477, Y: 439,456, one pixel: 468 439 Blob 42 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 940 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149584 MB Blob 52 of 52, id: 51, sources: 1, size: 17x16, npix 144, brick X: 421,438, Y: 471,487, one pixel: 429 471 Blob 41 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 954 MB, VmSize: 712 MB, VmRSS: 127 MB, VmData: 167 MB, maxrss: 0.143712 MB Blob 49 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 940 MB, VmSize: 727 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149256 MB Blob 34 finished, total: Wall: 0.89 s, CPU: 0.88 s, VmPeak: 939 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14968 MB Blob 50 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 957 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 187 MB, maxrss: 0.15242 MB Blob 44 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 954 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 180 MB, maxrss: 0.147424 MB Blob 37 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 959 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149252 MB Blob 52 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 954 MB, VmSize: 712 MB, VmRSS: 127 MB, VmData: 167 MB, maxrss: 0.143712 MB Blob 45 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 940 MB, VmSize: 727 MB, VmRSS: 147 MB, VmData: 182 MB, maxrss: 0.150112 MB Blob 51 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 940 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149584 MB Blob 48 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 922 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148008 MB Blob 43 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 99 MB, VmData: 145 MB, maxrss: 0.101624 MB Blob 40 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 954 MB, VmSize: 731 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152228 MB Blob 4 finished, total: Wall: 4.47 s, CPU: 4.47 s, VmPeak: 699 MB, VmSize: 699 MB, VmRSS: 123 MB, VmData: 170 MB, maxrss: 0.126328 MB Blob 46 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 956 MB, VmSize: 730 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151948 MB Measuring 5 iterative sources Blob 3 finished, total: Wall: 8.42 s, CPU: 8.42 s, VmPeak: 960 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 180 MB, maxrss: 0.148328 MB Measuring 6 iterative sources Blob 2 finished, total: Wall: 14.26 s, CPU: 14.26 s, VmPeak: 955 MB, VmSize: 726 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149712 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.5434, ee1=-0.710042, ee2=0.44134 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.792562, ee1=-0.103908, ee2=0.15231 Measuring 7 iterative sources Blob 1 finished, total: Wall: 29.90 s, CPU: 29.90 s, VmPeak: 956 MB, VmSize: 756 MB, VmRSS: 184 MB, VmData: 211 MB, maxrss: 0.199428 MB Old catalog: 112 New catalog: 118 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/metrics/cus/blobs-custom-326608m10411.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/metrics/cus/all-models-custom-326608m10411.fits Stage fitblobs : Wall: 30.47 s, CPU: 0.87 s, VmPeak: 1044 MB, VmSize: 1041 MB, VmRSS: 238 MB, VmData: 300 MB, maxrss: 0.27928 MB Stage fitblobs finished: 2020-08-10T15:01:08.757052 Resources for stage fitblobs : 106.157 s worker CPU, 106.469 s worker Wall, Wall: 30.470 s, Cores in use: 3.51, Total efficiency (on 16 cores): 22.0 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-10T15:01:08.786967 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/tmp-legacysurvey-custom-326608m10411-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/tmp-legacysurvey-custom-326608m10411-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/tmp-legacysurvey-custom-326608m10411-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/tmp-legacysurvey-custom-326608m10411-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-resid.jpg Stage coadds : Wall: 3.11 s, CPU: 1.34 s, VmPeak: 1067 MB, VmSize: 1067 MB, VmRSS: 269 MB, VmData: 326 MB, maxrss: 0.27928 MB Stage coadds finished: 2020-08-10T15:01:11.901059 Resources for stage coadds : 10.635 s worker CPU, 12.244 s worker Wall, Wall: 3.116 s, Cores in use: 3.85, Total efficiency (on 16 cores): 24.0 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-10T15:01:12.016707 Cut to 1 unWISE tiles Reading WISE tile 3261m107 band 1 Reading WISE tile 3261m107 band 2 Reading WISE tile 3261m107 band 3 Reading WISE tile 3261m107 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.42 s, CPU: 1.35 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 154 MB, VmData: 190 MB, maxrss: 0.19912 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.26 s, CPU: 0.68 s, VmPeak: 1006 MB, VmSize: 1006 MB, VmRSS: 146 MB, VmData: 186 MB, maxrss: 0.209228 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.18 s, CPU: 0.41 s, VmPeak: 1008 MB, VmSize: 1008 MB, VmRSS: 148 MB, VmData: 187 MB, maxrss: 0.209028 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/326/3261m107/unwise-3261m107-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.19 s, CPU: 0.42 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 150 MB, VmData: 190 MB, maxrss: 0.212732 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/tmp-legacysurvey-custom-326608m10411-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/tmp-legacysurvey-custom-326608m10411-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.67 s, CPU: 0.69 s, VmPeak: 1067 MB, VmSize: 1067 MB, VmRSS: 270 MB, VmData: 326 MB, maxrss: 0.27928 MB Stage wise_forced finished: 2020-08-10T15:01:14.689759 Resources for stage wise_forced : 5.977 s worker CPU, 5.422 s worker Wall, Wall: 2.675 s, Cores in use: 2.49, Total efficiency (on 16 cores): 15.6 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-10T15:01:14.767260 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/coadd/cus/custom-326608m10411/legacysurvey-custom-326608m10411-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/tractor-i/cus/tractor-custom-326608m10411.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/tractor/cus/tractor-custom-326608m10411.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/tractor/cus/brick-custom-326608m10411.sha256sum Stage writecat : Wall: 1.14 s, CPU: 0.99 s, VmPeak: 1199 MB, VmSize: 1071 MB, VmRSS: 272 MB, VmData: 326 MB, maxrss: 0.409244 MB Stage writecat finished: 2020-08-10T15:01:15.905515 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.140 s, Cores in use: 0.87, Total efficiency (on 16 cores): 5.4 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC163383_GROUP/PGC163383_GROUP-largegalaxy-writecat.p All done: 137.089 s worker CPU, 243.758 s worker Wall, Wall: 58.476 s, Cores in use: 2.56, Total efficiency (on 16 cores): 16.0 % Finished galaxy PGC163383_GROUP in 1.027 minutes.