Started working on galaxy DR8-0294p332-258 at Fri Jun 5 18:40:18 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.428673488651363 33.135800999047625 --width 351 --height 351 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-05T18:40:18.896520 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '29.428673488651363', '33.135800999047625', '--width', '351', '--height', '351', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.428673488651363 33.135800999047625 --width 351 --height 351 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 29.428673488651363 33.135800999047625 Starting process 18735 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 18736 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 18737 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 18738 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-05T18:40:24.552449 Keeping 15 CCDs: c4d_181103_041850_ooi_g_ls9.fits.fz c4d_181103_041850_ooi_g_ls9-S8 g exptime 184.0 propid 2014B-0404 seeing 1.61 MJD 58425.180 object DECaLS_4955_g c4d_181002_060032_ooi_z_ls9.fits.fz c4d_181002_060032_ooi_z_ls9-S8 z exptime 96.0 propid 2014B-0404 seeing 1.14 MJD 58393.250 object DECaLS_4955_z c4d_181110_030606_ooi_r_ls9.fits.fz c4d_181110_030606_ooi_r_ls9-S8 r exptime 78.0 propid 2014B-0404 seeing 1.71 MJD 58432.129 object DECaLS_4955_r c4d_181002_060244_ooi_z_ls9.fits.fz c4d_181002_060244_ooi_z_ls9-S12 z exptime 106.0 propid 2014B-0404 seeing 1.12 MJD 58393.252 object DECaLS_20806_z c4d_181110_030041_ooi_r_ls9.fits.fz c4d_181110_030041_ooi_r_ls9-S12 r exptime 67.0 propid 2014B-0404 seeing 1.85 MJD 58432.125 object DECaLS_20806_r c4d_181104_041106_ooi_g_ls9.fits.fz c4d_181104_041106_ooi_g_ls9-S12 g exptime 193.0 propid 2014B-0404 seeing 1.52 MJD 58426.174 object DECaLS_20806_g c4d_181105_043024_ooi_z_ls9.fits.fz c4d_181105_043024_ooi_z_ls9-S12 z exptime 106.0 propid 2014B-0404 seeing 0.91 MJD 58427.188 object DECaLS_36678_z c4d_181110_030217_ooi_g_ls9.fits.fz c4d_181110_030217_ooi_g_ls9-S12 g exptime 200.0 propid 2014B-0404 seeing 2.05 MJD 58432.127 object DECaLS_36678_g c4d_181104_041447_ooi_r_ls9.fits.fz c4d_181104_041447_ooi_r_ls9-S12 r exptime 90.0 propid 2014B-0404 seeing 1.25 MJD 58426.177 object DECaLS_36678_r c4d_181105_043024_ooi_z_ls9.fits.fz c4d_181105_043024_ooi_z_ls9-S11 z exptime 106.0 propid 2014B-0404 seeing 0.91 MJD 58427.188 object DECaLS_36678_z c4d_181110_030217_ooi_g_ls9.fits.fz c4d_181110_030217_ooi_g_ls9-S11 g exptime 200.0 propid 2014B-0404 seeing 1.58 MJD 58432.127 object DECaLS_36678_g c4d_181104_041447_ooi_r_ls9.fits.fz c4d_181104_041447_ooi_r_ls9-S11 r exptime 90.0 propid 2014B-0404 seeing 1.31 MJD 58426.177 object DECaLS_36678_r c4d_170722_104419_ooi_z_ls9.fits.fz c4d_170722_104419_ooi_z_ls9-S19 z exptime 205.0 propid 2014B-0404 seeing 1.18 MJD 57956.444 object DECaLS_4934_z c4d_181103_034341_ooi_r_ls9.fits.fz c4d_181103_034341_ooi_r_ls9-S19 r exptime 67.0 propid 2014B-0404 seeing 1.39 MJD 58425.155 object DECaLS_4934_r c4d_181103_034515_ooi_g_ls9.fits.fz c4d_181103_034515_ooi_g_ls9-S19 g exptime 164.0 propid 2014B-0404 seeing 1.67 MJD 58425.156 object DECaLS_4934_g The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T041850_oi[S8,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953829b-r-20181110T030606_oi[S8,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T060032_oi[S8,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T060244_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953829b-r-20181110T030041_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181104T041106_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181105T043024_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T041447_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181105T043024_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T041447_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9519cdc-z-20170722T104002_oi[S19,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538e4d-g-20181110T030217_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537a95-r-20181103T034341_oi[S19,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T034515_oi[S19,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538e4d-g-20181110T030217_oi[S11,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 204.70 s, CPU: 7.13 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 182 MB, VmData: 215 MB, maxrss: 0.454684 MB Stage tims finished: 2020-06-05T18:43:49.250682 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T060244_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538e4d-g-20181110T030217_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953829b-r-20181110T030606_oi[S8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953829b-r-20181110T030041_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T041447_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T041447_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537a95-r-20181103T034341_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T041850_oi[S8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181105T043024_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538e4d-g-20181110T030217_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T060032_oi[S8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181104T041106_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181105T043024_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9519cdc-z-20170722T104002_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T034515_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 4.927 s worker CPU, 743.625 s worker Wall, Wall: 204.699 s, Cores in use: 0.06, Total efficiency (on 4 cores): 1.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-05T18:43:49.285656 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02762.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02634.fits Matched 13 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/metrics/cus/reference-custom-029428p33135.fits Stage refs : Wall: 6.13 s, CPU: 5.55 s, VmPeak: 1030 MB, VmSize: 1023 MB, VmRSS: 210 MB, VmData: 242 MB, maxrss: 0.454684 MB Stage refs finished: 2020-06-05T18:43:55.416439 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.132 s, Cores in use: 0.91, Total efficiency (on 4 cores): 22.6 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-05T18:43:55.417895 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/metrics/cus/outlier-mask-custom-029428p33135.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/metrics/cus/outliers-pre-custom-029428p33135.jpg Image c4d_181104_041106_ooi_g_ls9-S12 g : masking 448 positive outlier pixels and 0 negative outlier pixels Image c4d_181103_034515_ooi_g_ls9-S19 g : masking 658 positive outlier pixels and 0 negative outlier pixels Image c4d_181104_041447_ooi_r_ls9-S12 r : masking 0 positive outlier pixels and 74 negative outlier pixels Image c4d_181103_034341_ooi_r_ls9-S19 r : masking 504 positive outlier pixels and 0 negative outlier pixels Image c4d_181105_043024_ooi_z_ls9-S12 z : masking 59 positive outlier pixels and 0 negative outlier pixels Image c4d_181002_060032_ooi_z_ls9-S8 z : masking 328 positive outlier pixels and 0 negative outlier pixels Image c4d_170722_104419_ooi_z_ls9-S19 z : masking 408 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/metrics/cus/outlier-mask-custom-029428p33135.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/metrics/cus/outliers-post-custom-029428p33135.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/metrics/cus/outliers-masked-pos-custom-029428p33135.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/metrics/cus/outliers-masked-neg-custom-029428p33135.jpg Stage outliers : Wall: 4.46 s, CPU: 4.02 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 229 MB, VmData: 258 MB, maxrss: 0.454684 MB Stage outliers finished: 2020-06-05T18:43:59.875402 Resources for stage outliers : 1.722 s worker CPU, 1.768 s worker Wall, Wall: 4.459 s, Cores in use: 1.29, Total efficiency (on 4 cores): 32.2 % Stage outliers finished Running stage halos Running stage halos at 2020-06-05T18:43:59.877113 Stage halos : Wall: 9.70 s, CPU: 4.16 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 229 MB, VmData: 258 MB, maxrss: 0.454684 MB Stage halos finished: 2020-06-05T18:44:09.575758 Resources for stage halos : 0.711 s worker CPU, 13.363 s worker Wall, Wall: 9.700 s, Cores in use: 0.50, Total efficiency (on 4 cores): 12.5 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-05T18:44:09.577536 PSF sigmas in coadd pixels: ['2.61', '2.47', '3.32', '2.57', '2.71'] Using average PSF sigma 2.7358308937792164 Gaussian PSF norm 0.10311119463389005 vs pixelized 0.089058705 average tim pixel scale / coadd scale: 1.001443317558133 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.77', '3.00', '2.03', '2.12', '2.26'] Using average PSF sigma 2.4364693285713876 Gaussian PSF norm 0.11578015305420779 vs pixelized 0.10314973 average tim pixel scale / coadd scale: 1.001469511005544 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.85', '1.81', '1.47', '1.48', '1.91'] Using average PSF sigma 1.7032561072820993 Gaussian PSF norm 0.16562088964061858 vs pixelized 0.14203782 average tim pixel scale / coadd scale: 1.0014565942368208 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.31 s, CPU: 0.30 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 232 MB, VmData: 260 MB, maxrss: 0.454684 MB Stage fit_on_coadds finished: 2020-06-05T18:44:09.889813 Resources for stage fit_on_coadds : 0.354 s worker CPU, 0.372 s worker Wall, Wall: 0.313 s, Cores in use: 2.10, Total efficiency (on 4 cores): 52.5 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-05T18:44:09.892761 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 24 potential peaks Of 24 potential peaks: 3 in veto map, 3 cut by saddle test, 0 cut by aper test, 18 kept SED z : 18 new peaks Found 19 potential peaks Of 19 potential peaks: 14 in veto map, 1 cut by saddle test, 0 cut by aper test, 4 kept SED r : 4 new peaks Found 23 potential peaks Of 23 potential peaks: 17 in veto map, 2 cut by saddle test, 0 cut by aper test, 4 kept SED g : 4 new peaks Found 35 potential peaks Of 35 potential peaks: 24 in veto map, 3 cut by saddle test, 0 cut by aper test, 8 kept SED Flat : 8 new peaks Found 36 potential peaks Of 36 potential peaks: 30 in veto map, 6 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 34 new sources Median coadd sky for g : -8.78332e-05 Median coadd sky for r : -0.00016495882 Median coadd sky for z : -2.6806407e-05 Stage srcs : Wall: 2.66 s, CPU: 2.60 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 233 MB, VmData: 260 MB, maxrss: 0.454684 MB Stage srcs finished: 2020-06-05T18:44:12.557180 Resources for stage srcs : 0.181 s worker CPU, 0.186 s worker Wall, Wall: 2.665 s, Cores in use: 1.04, Total efficiency (on 4 cores): 26.1 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-05T18:44:12.570738 Blob 1 of 29, id: 12, sources: 3, size: 85x91, npix 4680, brick X: 126,211, Y: 125,216, one pixel: 182 125 Blob 2 of 29, id: 3, sources: 2, size: 64x50, npix 1976, brick X: 54,118, Y: 13,63, one pixel: 79 13 Blob 3 of 29, id: 17, sources: 3, size: 45x49, npix 1240, brick X: 306,351, Y: 192,241, one pixel: 343 192 Blob 4 of 29, id: 13, sources: 2, size: 35x56, npix 1159, brick X: 104,139, Y: 130,186, one pixel: 120 130 Blob 5 of 29, id: 16, sources: 1, size: 39x37, npix 1004, brick X: 240,279, Y: 181,218, one pixel: 259 181 Measuring 1 iterative sources Measuring 1 iterative sources Blob 3 finished, total: Wall: 2.36 s, CPU: 2.36 s, VmPeak: 969 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14988 MB Blob 4 finished, total: Wall: 2.36 s, CPU: 2.36 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149032 MB Blob 6 of 29, id: 18, sources: 1, size: 34x35, npix 720, brick X: 41,75, Y: 199,234, one pixel: 58 199 Blob 7 of 29, id: 26, sources: 1, size: 29x30, npix 698, brick X: 322,351, Y: 321,351, one pixel: 344 321 Blob 2 finished, total: Wall: 2.43 s, CPU: 2.43 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150484 MB Blob 8 of 29, id: 10, sources: 1, size: 31x31, npix 643, brick X: 204,235, Y: 81,112, one pixel: 216 81 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.62537, ee1=0.0466097, ee2=0.315364 Blob 1 finished, total: Wall: 2.86 s, CPU: 2.86 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150916 MB Blob 9 of 29, id: 24, sources: 1, size: 29x29, npix 528, brick X: 193,222, Y: 298,327, one pixel: 206 298 Blob 8 finished, total: Wall: 0.61 s, CPU: 0.61 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150916 MB Blob 10 of 29, id: 8, sources: 1, size: 28x29, npix 506, brick X: 103,131, Y: 73,102, one pixel: 115 73 Measuring 1 iterative sources Measuring 2 iterative sources Blob 9 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150916 MB Blob 11 of 29, id: 5, sources: 1, size: 26x28, npix 489, brick X: 325,351, Y: 46,74, one pixel: 343 46 Blob 5 finished, total: Wall: 2.11 s, CPU: 2.11 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149032 MB Blob 12 of 29, id: 1, sources: 1, size: 26x28, npix 463, brick X: 138,164, Y: 7,35, one pixel: 149 7 Blob 7 finished, total: Wall: 2.37 s, CPU: 2.37 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150752 MB Blob 13 of 29, id: 22, sources: 1, size: 25x27, npix 438, brick X: 221,246, Y: 257,284, one pixel: 232 257 Measuring 1 iterative sources Measuring 1 iterative sources Blob 6 finished, total: Wall: 3.19 s, CPU: 3.19 s, VmPeak: 969 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14988 MB Blob 12 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150752 MB Blob 14 of 29, id: 23, sources: 1, size: 25x25, npix 389, brick X: 180,205, Y: 272,297, one pixel: 192 272 Blob 15 of 29, id: 9, sources: 1, size: 24x25, npix 388, brick X: 278,302, Y: 77,102, one pixel: 288 77 Blob 11 finished, total: Wall: 1.12 s, CPU: 1.12 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149032 MB Blob 16 of 29, id: 4, sources: 1, size: 24x25, npix 386, brick X: 114,138, Y: 33,58, one pixel: 127 33 Blob 14 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150752 MB Blob 17 of 29, id: 19, sources: 1, size: 24x24, npix 363, brick X: 220,244, Y: 209,233, one pixel: 229 209 Blob 15 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149032 MB Blob 18 of 29, id: 28, sources: 1, size: 27x18, npix 332, brick X: 28,55, Y: 333,351, one pixel: 40 333 Blob 13 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 969 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14988 MB Blob 19 of 29, id: 2, sources: 1, size: 22x22, npix 271, brick X: 207,229, Y: 10,32, one pixel: 216 10 Blob 10 finished, total: Wall: 2.11 s, CPU: 2.11 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150916 MB Blob 20 of 29, id: 27, sources: 1, size: 20x21, npix 248, brick X: 119,139, Y: 329,350, one pixel: 127 329 Blob 16 finished, total: Wall: 0.74 s, CPU: 0.73 s, VmPeak: 958 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.151024 MB Blob 21 of 29, id: 21, sources: 1, size: 21x21, npix 241, brick X: 163,184, Y: 242,263, one pixel: 172 242 Blob 20 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 958 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.151024 MB Blob 22 of 29, id: 20, sources: 1, size: 20x21, npix 239, brick X: 37,57, Y: 235,256, one pixel: 46 235 Blob 17 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149032 MB Blob 23 of 29, id: 7, sources: 1, size: 20x20, npix 228, brick X: 305,325, Y: 62,82, one pixel: 314 62 Blob 21 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 958 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.151024 MB Blob 24 of 29, id: 15, sources: 1, size: 20x18, npix 216, brick X: 222,242, Y: 173,191, one pixel: 230 173 Blob 18 finished, total: Wall: 0.88 s, CPU: 0.88 s, VmPeak: 969 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14988 MB Blob 19 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150916 MB Blob 25 of 29, id: 11, sources: 1, size: 20x19, npix 209, brick X: 259,279, Y: 86,105, one pixel: 267 86 Blob 26 of 29, id: 25, sources: 1, size: 19x19, npix 208, brick X: 140,159, Y: 318,337, one pixel: 148 318 Blob 24 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 969 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14988 MB Blob 27 of 29, id: 0, sources: 1, size: 21x15, npix 195, brick X: 161,182, Y: 0,15, one pixel: 166 0 Blob 22 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149032 MB Blob 28 of 29, id: 6, sources: 1, size: 18x18, npix 180, brick X: 157,175, Y: 52,70, one pixel: 165 52 Blob 23 finished, total: Wall: 0.19 s, CPU: 0.19 s, VmPeak: 958 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.151024 MB Blob 29 of 29, id: 14, sources: 2, size: 13x18, npix 150, brick X: 338,351, Y: 146,164, one pixel: 346 146 Blob 25 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150916 MB Blob 26 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 969 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14988 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (29.41262, 33.13436), pm (-1.6, -1.7), parallax -0.159 with NanoMaggies: g=18.7, r=17.9, z=17.9 Reset brightness to NanoMaggies: g=18.5, r=18, z=17.9 Blob 29 finished, total: Wall: 0.10 s, CPU: 0.10 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150916 MB Blob 27 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149032 MB Blob 28 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 958 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.151024 MB Old catalog: 42 New catalog: 39 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/metrics/cus/blobs-custom-029428p33135.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/metrics/cus/all-models-custom-029428p33135.fits Stage fitblobs : Wall: 10.68 s, CPU: 2.99 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 233 MB, VmData: 260 MB, maxrss: 0.454684 MB Stage fitblobs finished: 2020-06-05T18:44:23.254876 Resources for stage fitblobs : 30.204 s worker CPU, 30.327 s worker Wall, Wall: 10.685 s, Cores in use: 3.11, Total efficiency (on 4 cores): 77.7 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-05T18:44:23.256252 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/tmp-legacysurvey-custom-029428p33135-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/tmp-legacysurvey-custom-029428p33135-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/tmp-legacysurvey-custom-029428p33135-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/tmp-legacysurvey-custom-029428p33135-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-resid.jpg Stage coadds : Wall: 10.50 s, CPU: 9.72 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 233 MB, VmData: 261 MB, maxrss: 0.454684 MB Stage coadds finished: 2020-06-05T18:44:33.752966 Resources for stage coadds : 2.426 s worker CPU, 2.560 s worker Wall, Wall: 10.498 s, Cores in use: 1.16, Total efficiency (on 4 cores): 28.9 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-05T18:44:33.754378 Cut to 1 unWISE tiles Reading WISE tile 0287p333 band 2 Reading WISE tile 0287p333 band 1 Reading WISE tile 0287p333 band 3 Reading WISE tile 0287p333 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 963 MB, VmSize: 796 MB, VmRSS: 147 MB, VmData: 175 MB, maxrss: 0.191496 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 958 MB, VmSize: 793 MB, VmRSS: 143 MB, VmData: 171 MB, maxrss: 0.206744 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 969 MB, VmSize: 796 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.209924 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 962 MB, VmSize: 796 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209428 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/tmp-legacysurvey-custom-029428p33135-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/tmp-legacysurvey-custom-029428p33135-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 9.54 s, CPU: 5.95 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 234 MB, VmData: 261 MB, maxrss: 0.454684 MB Stage wise_forced finished: 2020-06-05T18:44:43.290246 Resources for stage wise_forced : 3.251 s worker CPU, 7.878 s worker Wall, Wall: 9.537 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.1 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-05T18:44:43.291829 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/tractor-i/cus/tractor-custom-029428p33135.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/tractor/cus/tractor-custom-029428p33135.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/tractor/cus/brick-custom-029428p33135.sha256sum Stage writecat : Wall: 9.40 s, CPU: 9.15 s, VmPeak: 1165 MB, VmSize: 1037 MB, VmRSS: 236 MB, VmData: 261 MB, maxrss: 0.454684 MB Stage writecat finished: 2020-06-05T18:44:52.687917 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.397 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.3 % Stage writecat finished All done: 43.777 s worker CPU, 800.081 s worker Wall, Wall: 268.140 s, Cores in use: 0.36, Total efficiency (on 4 cores): 8.9 % Finished galaxy DR8-0294p332-258 in 4.580 minutes. Started working on galaxy DR8-0294p332-258 at Fri Aug 7 09:49:21 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.428673488651363 33.135800999047625 --width 351 --height 351 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T09:49:22.445601 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '29.428673488651363', '33.135800999047625', '--width', '351', '--height', '351', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.428673488651363 33.135800999047625 --width 351 --height 351 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 29.428673488651363 33.135800999047625 Starting process 3593 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 3594 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 3595 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 3596 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 3597 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059412 MB Starting process 3598 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05942 MB Starting process 3599 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05942 MB Starting process 3600 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 3601 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 3602 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 3603 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 3604 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 3605 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 3606 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 3607 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 3608 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T09:49:22.921246 Keeping 15 CCDs: c4d_181103_041850_ooi_g_ls9-S8 g expnum 790269 exptime 184.0 propid 2014B-0404 seeing 1.61 MJD 58425.180 object DECaLS_4955_g decam/CP/V4.8.2a/CP20181102/c4d_181103_041850_ooi_g_ls9.fits.fz c4d_181002_060032_ooi_z_ls9-S8 z expnum 779932 exptime 96.0 propid 2014B-0404 seeing 1.14 MJD 58393.250 object DECaLS_4955_z decam/CP/V4.8.2a/CP20181001/c4d_181002_060032_ooi_z_ls9.fits.fz c4d_181110_030606_ooi_r_ls9-S8 r expnum 792795 exptime 78.0 propid 2014B-0404 seeing 1.71 MJD 58432.129 object DECaLS_4955_r decam/CP/V4.8.2a/CP20181109/c4d_181110_030606_ooi_r_ls9.fits.fz c4d_181002_060244_ooi_z_ls9-S12 z expnum 779933 exptime 106.0 propid 2014B-0404 seeing 1.12 MJD 58393.252 object DECaLS_20806_z decam/CP/V4.8.2a/CP20181001/c4d_181002_060244_ooi_z_ls9.fits.fz c4d_181110_030041_ooi_r_ls9-S12 r expnum 792793 exptime 67.0 propid 2014B-0404 seeing 1.85 MJD 58432.125 object DECaLS_20806_r decam/CP/V4.8.2a/CP20181109/c4d_181110_030041_ooi_r_ls9.fits.fz c4d_181104_041106_ooi_g_ls9-S12 g expnum 790572 exptime 193.0 propid 2014B-0404 seeing 1.52 MJD 58426.174 object DECaLS_20806_g decam/CP/V4.8.2a/CP20181103/c4d_181104_041106_ooi_g_ls9.fits.fz c4d_181105_043024_ooi_z_ls9-S12 z expnum 790926 exptime 106.0 propid 2014B-0404 seeing 0.91 MJD 58427.188 object DECaLS_36678_z decam/CP/V4.8.2a/CP20181104/c4d_181105_043024_ooi_z_ls9.fits.fz c4d_181110_030217_ooi_g_ls9-S12 g expnum 792794 exptime 200.0 propid 2014B-0404 seeing 2.05 MJD 58432.127 object DECaLS_36678_g decam/CP/V4.8.2a/CP20181109/c4d_181110_030217_ooi_g_ls9.fits.fz c4d_181104_041447_ooi_r_ls9-S12 r expnum 790573 exptime 90.0 propid 2014B-0404 seeing 1.25 MJD 58426.177 object DECaLS_36678_r decam/CP/V4.8.2a/CP20181103/c4d_181104_041447_ooi_r_ls9.fits.fz c4d_181105_043024_ooi_z_ls9-S11 z expnum 790926 exptime 106.0 propid 2014B-0404 seeing 0.91 MJD 58427.188 object DECaLS_36678_z decam/CP/V4.8.2a/CP20181104/c4d_181105_043024_ooi_z_ls9.fits.fz c4d_181110_030217_ooi_g_ls9-S11 g expnum 792794 exptime 200.0 propid 2014B-0404 seeing 1.58 MJD 58432.127 object DECaLS_36678_g decam/CP/V4.8.2a/CP20181109/c4d_181110_030217_ooi_g_ls9.fits.fz c4d_181104_041447_ooi_r_ls9-S11 r expnum 790573 exptime 90.0 propid 2014B-0404 seeing 1.31 MJD 58426.177 object DECaLS_36678_r decam/CP/V4.8.2a/CP20181103/c4d_181104_041447_ooi_r_ls9.fits.fz c4d_170722_104419_ooi_z_ls9-S19 z expnum 661059 exptime 205.0 propid 2014B-0404 seeing 1.18 MJD 57956.444 object DECaLS_4934_z decam/CP/V4.8.2/CP20170721/c4d_170722_104419_ooi_z_ls9.fits.fz c4d_181103_034341_ooi_r_ls9-S19 r expnum 790256 exptime 67.0 propid 2014B-0404 seeing 1.39 MJD 58425.155 object DECaLS_4934_r decam/CP/V4.8.2a/CP20181102/c4d_181103_034341_ooi_r_ls9.fits.fz c4d_181103_034515_ooi_g_ls9-S19 g expnum 790257 exptime 164.0 propid 2014B-0404 seeing 1.67 MJD 58425.156 object DECaLS_4934_g decam/CP/V4.8.2a/CP20181102/c4d_181103_034515_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538e4d-g-20181110T030217_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538e4d-g-20181110T030217_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181105T043024_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9519cdc-z-20170722T104002_oi[S19,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181105T043024_oi[S11,noinherit][2046,4094][real]: DECaLS_ Masking 0 additional saturated pixels in DECam expnum 661059 S19 CCD, decam/CP/V4.8.2/CP20170721/c4d_170722_104419_ooi_z_ls9.fits.fz slice (slice(2762, 3117, None), slice(1364, 1718, None)) The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953829b-r-20181110T030606_oi[S8,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T060032_oi[S8,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953829b-r-20181110T030041_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T034515_oi[S19,noinherit][2046,4094][real]: DECaLS_ Masking 0 additional saturated pixels in DECam expnum 790257 S19 CCD, decam/CP/V4.8.2a/CP20181102/c4d_181103_034515_ooi_g_ls9.fits.fz slice (slice(2744, 3099, None), slice(1383, 1737, None)) The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T041447_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T041447_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181104T041106_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537a95-r-20181103T034341_oi[S19,noinherit][2046,4094][real]: DECaLS_ Masking 0 additional saturated pixels in DECam expnum 790256 S19 CCD, decam/CP/V4.8.2a/CP20181102/c4d_181103_034341_ooi_r_ls9.fits.fz slice (slice(2746, 3100, None), slice(1373, 1727, None)) The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T041850_oi[S8,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T060244_oi[S12,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 95.27 s, CPU: 0.96 s, VmPeak: 1006 MB, VmSize: 1006 MB, VmRSS: 184 MB, VmData: 217 MB, maxrss: 0.18812 MB Stage tims finished: 2020-08-07T09:50:58.194802 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538e4d-g-20181110T030217_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538e4d-g-20181110T030217_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9519cdc-z-20170722T104002_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T041447_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T034515_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T041850_oi[S8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181105T043024_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181105T043024_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537a95-r-20181103T034341_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T060244_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T060032_oi[S8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953829b-r-20181110T030041_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 9.070 s worker CPU, 1294.943 s worker Wall, Wall: 95.275 s, Cores in use: 0.11, Total efficiency (on 16 cores): 0.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T041447_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181104T041106_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953829b-r-20181110T030606_oi[S8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Running stage refs at 2020-08-07T09:50:58.290640 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02762.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02634.fits Matched 13 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/metrics/cus/reference-custom-029428p33135.fits Stage refs : Wall: 16.51 s, CPU: 2.78 s, VmPeak: 1039 MB, VmSize: 1034 MB, VmRSS: 213 MB, VmData: 246 MB, maxrss: 0.217892 MB Stage refs finished: 2020-08-07T09:51:14.796162 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 16.507 s, Cores in use: 0.17, Total efficiency (on 16 cores): 1.1 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T09:51:14.840015 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/metrics/cus/outlier-mask-custom-029428p33135.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/metrics/cus/outliers-pre-custom-029428p33135.jpg Image c4d_181104_041106_ooi_g_ls9-S12 g : masking 448 positive outlier pixels and 0 negative outlier pixels Image c4d_181103_034515_ooi_g_ls9-S19 g : masking 658 positive outlier pixels and 0 negative outlier pixels Image c4d_181104_041447_ooi_r_ls9-S12 r : masking 0 positive outlier pixels and 74 negative outlier pixels Image c4d_181103_034341_ooi_r_ls9-S19 r : masking 504 positive outlier pixels and 0 negative outlier pixels Image c4d_181105_043024_ooi_z_ls9-S12 z : masking 59 positive outlier pixels and 0 negative outlier pixels Image c4d_181002_060032_ooi_z_ls9-S8 z : masking 328 positive outlier pixels and 0 negative outlier pixels Image c4d_170722_104419_ooi_z_ls9-S19 z : masking 408 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/metrics/cus/outlier-mask-custom-029428p33135.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/metrics/cus/outliers-post-custom-029428p33135.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/metrics/cus/outliers-masked-pos-custom-029428p33135.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/metrics/cus/outliers-masked-neg-custom-029428p33135.jpg Stage outliers : Wall: 1.18 s, CPU: 0.89 s, VmPeak: 1044 MB, VmSize: 1044 MB, VmRSS: 237 MB, VmData: 267 MB, maxrss: 0.242828 MB Stage outliers finished: 2020-08-07T09:51:16.016031 Resources for stage outliers : 1.424 s worker CPU, 1.458 s worker Wall, Wall: 1.178 s, Cores in use: 1.97, Total efficiency (on 16 cores): 12.3 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T09:51:16.334021 Stage halos : Wall: 0.48 s, CPU: 0.32 s, VmPeak: 1044 MB, VmSize: 1044 MB, VmRSS: 238 MB, VmData: 268 MB, maxrss: 0.243236 MB Stage halos finished: 2020-08-07T09:51:16.812022 Resources for stage halos : 1.081 s worker CPU, 1.890 s worker Wall, Wall: 0.480 s, Cores in use: 2.91, Total efficiency (on 16 cores): 18.2 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-07T09:51:20.459217 PSF sigmas in coadd pixels: ['2.61', '2.47', '3.32', '2.57', '2.71'] Using average PSF sigma 2.7358308937792164 Gaussian PSF norm 0.10311119463389005 vs pixelized 0.089058705 average tim pixel scale / coadd scale: 1.001443317558133 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.77', '3.00', '2.03', '2.12', '2.26'] Using average PSF sigma 2.4364693285713876 Gaussian PSF norm 0.11578015305420779 vs pixelized 0.10314973 average tim pixel scale / coadd scale: 1.001469511005544 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.85', '1.81', '1.47', '1.48', '1.91'] Using average PSF sigma 1.7032561072820993 Gaussian PSF norm 0.16562088964061858 vs pixelized 0.14203784 average tim pixel scale / coadd scale: 1.0014565942368208 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-copsf-z.fits.fz Stage fit_on_coadds : Wall: 5.15 s, CPU: 0.28 s, VmPeak: 1044 MB, VmSize: 1044 MB, VmRSS: 240 MB, VmData: 269 MB, maxrss: 0.246004 MB Stage fit_on_coadds finished: 2020-08-07T09:51:25.612126 Resources for stage fit_on_coadds : 0.318 s worker CPU, 0.318 s worker Wall, Wall: 5.155 s, Cores in use: 0.12, Total efficiency (on 16 cores): 0.7 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T09:51:31.720232 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 24 potential peaks Of 24 potential peaks: 3 in veto map, 3 cut by saddle test, 0 cut by aper test, 18 kept SED z : 18 new peaks Found 19 potential peaks Of 19 potential peaks: 14 in veto map, 1 cut by saddle test, 0 cut by aper test, 4 kept SED r : 4 new peaks Found 23 potential peaks Of 23 potential peaks: 17 in veto map, 2 cut by saddle test, 0 cut by aper test, 4 kept SED g : 4 new peaks Found 35 potential peaks Of 35 potential peaks: 24 in veto map, 3 cut by saddle test, 0 cut by aper test, 8 kept SED Flat : 8 new peaks Found 36 potential peaks Of 36 potential peaks: 30 in veto map, 6 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 34 new sources Median coadd sky for g : -8.78332e-05 Median coadd sky for r : -0.00016495882 Median coadd sky for z : -2.6806407e-05 Stage srcs : Wall: 0.60 s, CPU: 0.53 s, VmPeak: 1044 MB, VmSize: 1044 MB, VmRSS: 241 MB, VmData: 269 MB, maxrss: 0.246396 MB Stage srcs finished: 2020-08-07T09:51:32.317339 Resources for stage srcs : 0.156 s worker CPU, 0.156 s worker Wall, Wall: 0.599 s, Cores in use: 1.15, Total efficiency (on 16 cores): 7.2 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T09:51:32.469139 Blob 1 of 29, id: 12, sources: 3, size: 85x91, npix 4680, brick X: 126,211, Y: 125,216, one pixel: 182 125 Blob 2 of 29, id: 3, sources: 2, size: 64x50, npix 1976, brick X: 54,118, Y: 13,63, one pixel: 79 13 Blob 3 of 29, id: 17, sources: 3, size: 45x49, npix 1240, brick X: 306,351, Y: 192,241, one pixel: 343 192 Blob 4 of 29, id: 13, sources: 2, size: 35x56, npix 1159, brick X: 104,139, Y: 130,186, one pixel: 120 130 Blob 5 of 29, id: 16, sources: 1, size: 39x37, npix 1004, brick X: 240,279, Y: 181,218, one pixel: 259 181 Blob 6 of 29, id: 18, sources: 1, size: 34x35, npix 720, brick X: 41,75, Y: 199,234, one pixel: 58 199 Blob 7 of 29, id: 26, sources: 1, size: 29x30, npix 698, brick X: 322,351, Y: 321,351, one pixel: 344 321 Blob 8 of 29, id: 10, sources: 1, size: 31x31, npix 643, brick X: 204,235, Y: 81,112, one pixel: 216 81 Blob 9 of 29, id: 24, sources: 1, size: 29x29, npix 528, brick X: 193,222, Y: 298,327, one pixel: 206 298 Blob 10 of 29, id: 8, sources: 1, size: 28x29, npix 506, brick X: 103,131, Y: 73,102, one pixel: 115 73 Blob 11 of 29, id: 5, sources: 1, size: 26x28, npix 489, brick X: 325,351, Y: 46,74, one pixel: 343 46 Blob 12 of 29, id: 1, sources: 1, size: 26x28, npix 463, brick X: 138,164, Y: 7,35, one pixel: 149 7 Blob 13 of 29, id: 22, sources: 1, size: 25x27, npix 438, brick X: 221,246, Y: 257,284, one pixel: 232 257 Blob 14 of 29, id: 23, sources: 1, size: 25x25, npix 389, brick X: 180,205, Y: 272,297, one pixel: 192 272 Blob 15 of 29, id: 9, sources: 1, size: 24x25, npix 388, brick X: 278,302, Y: 77,102, one pixel: 288 77 Blob 16 of 29, id: 4, sources: 1, size: 24x25, npix 386, brick X: 114,138, Y: 33,58, one pixel: 127 33 Blob 17 of 29, id: 19, sources: 1, size: 24x24, npix 363, brick X: 220,244, Y: 209,233, one pixel: 229 209 Blob 14 finished, total: Wall: 0.45 s, CPU: 0.41 s, VmPeak: 940 MB, VmSize: 723 MB, VmRSS: 142 MB, VmData: 178 MB, maxrss: 0.144976 MB Blob 18 of 29, id: 28, sources: 1, size: 27x18, npix 332, brick X: 28,55, Y: 333,351, one pixel: 40 333 Blob 8 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 945 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146704 MB Blob 19 of 29, id: 2, sources: 1, size: 22x22, npix 271, brick X: 207,229, Y: 10,32, one pixel: 216 10 Blob 15 finished, total: Wall: 0.80 s, CPU: 0.79 s, VmPeak: 960 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147608 MB Blob 20 of 29, id: 27, sources: 1, size: 20x21, npix 248, brick X: 119,139, Y: 329,350, one pixel: 127 329 Blob 16 finished, total: Wall: 0.79 s, CPU: 0.76 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147164 MB Blob 21 of 29, id: 21, sources: 1, size: 21x21, npix 241, brick X: 163,184, Y: 242,263, one pixel: 172 242 Blob 13 finished, total: Wall: 0.89 s, CPU: 0.89 s, VmPeak: 963 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.14608 MB Blob 22 of 29, id: 20, sources: 1, size: 20x21, npix 239, brick X: 37,57, Y: 235,256, one pixel: 46 235 Blob 12 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147412 MB Blob 9 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 945 MB, VmSize: 727 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148436 MB Blob 23 of 29, id: 7, sources: 1, size: 20x20, npix 228, brick X: 305,325, Y: 62,82, one pixel: 314 62 Blob 24 of 29, id: 15, sources: 1, size: 20x18, npix 216, brick X: 222,242, Y: 173,191, one pixel: 230 173 Measuring 1 iterative sources Blob 20 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147164 MB Blob 25 of 29, id: 11, sources: 1, size: 20x19, npix 209, brick X: 259,279, Y: 86,105, one pixel: 267 86 Blob 23 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 945 MB, VmSize: 727 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148436 MB Blob 26 of 29, id: 25, sources: 1, size: 19x19, npix 208, brick X: 140,159, Y: 318,337, one pixel: 148 318 Blob 24 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147164 MB Blob 27 of 29, id: 0, sources: 1, size: 21x15, npix 195, brick X: 161,182, Y: 0,15, one pixel: 166 0 Blob 21 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 963 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.14778 MB Blob 28 of 29, id: 6, sources: 1, size: 18x18, npix 180, brick X: 157,175, Y: 52,70, one pixel: 165 52 Blob 22 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147412 MB Blob 29 of 29, id: 14, sources: 2, size: 13x18, npix 150, brick X: 338,351, Y: 146,164, one pixel: 346 146 Blob 17 finished, total: Wall: 0.89 s, CPU: 0.89 s, VmPeak: 940 MB, VmSize: 723 MB, VmRSS: 142 MB, VmData: 178 MB, maxrss: 0.144976 MB Blob 11 finished, total: Wall: 1.46 s, CPU: 1.46 s, VmPeak: 940 MB, VmSize: 723 MB, VmRSS: 142 MB, VmData: 178 MB, maxrss: 0.145196 MB Exception in one_blob: brick custom-029428p33135, iblob 12 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (29.41262, 33.13436), pm (-1.6, -1.7), parallax -0.159 with NanoMaggies: g=18.7, r=17.9, z=17.9 Reset brightness to NanoMaggies: g=18.5, r=18, z=17.9 Blob 29 finished, total: Wall: 0.12 s, CPU: 0.11 s, VmPeak: 941 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147692 MB Blob 19 finished, total: Wall: 0.68 s, CPU: 0.67 s, VmPeak: 960 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147608 MB Measuring 1 iterative sources Blob 26 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147164 MB Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1637, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 376, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1989, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker result = (True, func(*args, **kwds)) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__ R = self.func(*args, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1637, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 376, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1989, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3771, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3739, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3295, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3284, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1131, in stage_fitblobs r = Riter.next(timeout) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next raise value AttributeError: 'NoneType' object has no attribute 'getBrightness' Something went wrong; please check the logfile. ERROR: galaxy DR8-0294p332-258; please check the logfile. Finished galaxy DR8-0294p332-258 in 2.219 minutes. Started working on galaxy DR8-0294p332-258 at Fri Aug 7 12:11:32 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.428673488651363 33.135800999047625 --width 351 --height 351 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T12:11:33.198443 legacypipe git version: DR9.5.11-watershed-4-gcc619972 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '29.428673488651363', '33.135800999047625', '--width', '351', '--height', '351', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.428673488651363 33.135800999047625 --width 351 --height 351 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 29.428673488651363 33.135800999047625 Starting process 13760 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 13761 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 13762 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 13763 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 13764 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 13765 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 13766 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 13767 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 13768 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 13769 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 13770 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 13771 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 13772 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 13773 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 13774 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 13775 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 13776 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 13777 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 13778 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 13779 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 13780 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 13781 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 13782 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 13783 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 13784 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 13785 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 13786 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 13787 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 13788 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 13789 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 13790 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 13791 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-srcs.p and forcing stage srcs Runstage fit_on_coadds Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-fit_on_coadds.p and forcing stage fit_on_coadds Runstage halos Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-halos.p and forcing stage halos Runstage outliers Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-outliers.p and forcing stage outliers Runstage refs Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-refs.p and forcing stage refs Runstage tims Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-tims.p and forcing stage tims Running stage tims Running stage tims at 2020-08-07T12:11:33.651338 Keeping 15 CCDs: c4d_181103_041850_ooi_g_ls9-S8 g expnum 790269 exptime 184.0 propid 2014B-0404 seeing 1.61 MJD 58425.180 object DECaLS_4955_g decam/CP/V4.8.2a/CP20181102/c4d_181103_041850_ooi_g_ls9.fits.fz c4d_181002_060032_ooi_z_ls9-S8 z expnum 779932 exptime 96.0 propid 2014B-0404 seeing 1.14 MJD 58393.250 object DECaLS_4955_z decam/CP/V4.8.2a/CP20181001/c4d_181002_060032_ooi_z_ls9.fits.fz c4d_181110_030606_ooi_r_ls9-S8 r expnum 792795 exptime 78.0 propid 2014B-0404 seeing 1.71 MJD 58432.129 object DECaLS_4955_r decam/CP/V4.8.2a/CP20181109/c4d_181110_030606_ooi_r_ls9.fits.fz c4d_181002_060244_ooi_z_ls9-S12 z expnum 779933 exptime 106.0 propid 2014B-0404 seeing 1.12 MJD 58393.252 object DECaLS_20806_z decam/CP/V4.8.2a/CP20181001/c4d_181002_060244_ooi_z_ls9.fits.fz c4d_181110_030041_ooi_r_ls9-S12 r expnum 792793 exptime 67.0 propid 2014B-0404 seeing 1.85 MJD 58432.125 object DECaLS_20806_r decam/CP/V4.8.2a/CP20181109/c4d_181110_030041_ooi_r_ls9.fits.fz c4d_181104_041106_ooi_g_ls9-S12 g expnum 790572 exptime 193.0 propid 2014B-0404 seeing 1.52 MJD 58426.174 object DECaLS_20806_g decam/CP/V4.8.2a/CP20181103/c4d_181104_041106_ooi_g_ls9.fits.fz c4d_181105_043024_ooi_z_ls9-S12 z expnum 790926 exptime 106.0 propid 2014B-0404 seeing 0.91 MJD 58427.188 object DECaLS_36678_z decam/CP/V4.8.2a/CP20181104/c4d_181105_043024_ooi_z_ls9.fits.fz c4d_181110_030217_ooi_g_ls9-S12 g expnum 792794 exptime 200.0 propid 2014B-0404 seeing 2.05 MJD 58432.127 object DECaLS_36678_g decam/CP/V4.8.2a/CP20181109/c4d_181110_030217_ooi_g_ls9.fits.fz c4d_181104_041447_ooi_r_ls9-S12 r expnum 790573 exptime 90.0 propid 2014B-0404 seeing 1.25 MJD 58426.177 object DECaLS_36678_r decam/CP/V4.8.2a/CP20181103/c4d_181104_041447_ooi_r_ls9.fits.fz c4d_181105_043024_ooi_z_ls9-S11 z expnum 790926 exptime 106.0 propid 2014B-0404 seeing 0.91 MJD 58427.188 object DECaLS_36678_z decam/CP/V4.8.2a/CP20181104/c4d_181105_043024_ooi_z_ls9.fits.fz c4d_181110_030217_ooi_g_ls9-S11 g expnum 792794 exptime 200.0 propid 2014B-0404 seeing 1.58 MJD 58432.127 object DECaLS_36678_g decam/CP/V4.8.2a/CP20181109/c4d_181110_030217_ooi_g_ls9.fits.fz c4d_181104_041447_ooi_r_ls9-S11 r expnum 790573 exptime 90.0 propid 2014B-0404 seeing 1.31 MJD 58426.177 object DECaLS_36678_r decam/CP/V4.8.2a/CP20181103/c4d_181104_041447_ooi_r_ls9.fits.fz c4d_170722_104419_ooi_z_ls9-S19 z expnum 661059 exptime 205.0 propid 2014B-0404 seeing 1.18 MJD 57956.444 object DECaLS_4934_z decam/CP/V4.8.2/CP20170721/c4d_170722_104419_ooi_z_ls9.fits.fz c4d_181103_034341_ooi_r_ls9-S19 r expnum 790256 exptime 67.0 propid 2014B-0404 seeing 1.39 MJD 58425.155 object DECaLS_4934_r decam/CP/V4.8.2a/CP20181102/c4d_181103_034341_ooi_r_ls9.fits.fz c4d_181103_034515_ooi_g_ls9-S19 g expnum 790257 exptime 164.0 propid 2014B-0404 seeing 1.67 MJD 58425.156 object DECaLS_4934_g decam/CP/V4.8.2a/CP20181102/c4d_181103_034515_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T034515_oi[S19,noinherit][2046,4094][real]: DECaLS_ Masking 0 additional saturated pixels in DECam expnum 790257 S19 CCD, decam/CP/V4.8.2a/CP20181102/c4d_181103_034515_ooi_g_ls9.fits.fz slice (slice(2744, 3099, None), slice(1383, 1737, None)) The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953829b-r-20181110T030041_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181105T043024_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181105T043024_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9519cdc-z-20170722T104002_oi[S19,noinherit][2046,4094][real]: DECaLS_ Masking 0 additional saturated pixels in DECam expnum 661059 S19 CCD, decam/CP/V4.8.2/CP20170721/c4d_170722_104419_ooi_z_ls9.fits.fz slice (slice(2762, 3117, None), slice(1364, 1718, None)) The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T060244_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538e4d-g-20181110T030217_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538e4d-g-20181110T030217_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537a95-r-20181103T034341_oi[S19,noinherit][2046,4094][real]: DECaLS_ Masking 0 additional saturated pixels in DECam expnum 790256 S19 CCD, decam/CP/V4.8.2a/CP20181102/c4d_181103_034341_ooi_r_ls9.fits.fz slice (slice(2746, 3100, None), slice(1373, 1727, None)) The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T060032_oi[S8,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T041447_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T041447_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181104T041106_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T041850_oi[S8,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953829b-r-20181110T030606_oi[S8,noinherit][2046,4094][real]: DECaLS_4 Stage tims : Wall: 5.76 s, CPU: 0.86 s, VmPeak: 1006 MB, VmSize: 1006 MB, VmRSS: 182 MB, VmData: 216 MB, maxrss: 0.186804 MB Stage tims finished: 2020-08-07T12:11:39.406591 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T034515_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181105T043024_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181105T043024_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9519cdc-z-20170722T104002_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537a95-r-20181103T034341_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T041850_oi[S8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T060244_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953829b-r-20181110T030606_oi[S8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538e4d-g-20181110T030217_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T041447_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T041447_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 8.343 s worker CPU, 67.262 s worker Wall, Wall: 5.758 s, Cores in use: 1.60, Total efficiency (on 32 cores): 5.0 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181104T041106_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-08-07T12:11:39.441802 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02762.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02634.fits Matched 13 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/metrics/cus/reference-custom-029428p33135.fits Stage refs : Wall: 2.72 s, CPU: 2.51 s, VmPeak: 1039 MB, VmSize: 1034 MB, VmRSS: 212 MB, VmData: 245 MB, maxrss: 0.216852 MB Stage refs finished: 2020-08-07T12:11:42.163656 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953829b-r-20181110T030041_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538e4d-g-20181110T030217_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T060032_oi[S8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 2.724 s, Cores in use: 0.92, Total efficiency (on 32 cores): 2.9 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T12:11:42.198124 Stage outliers : Wall: 0.30 s, CPU: 0.28 s, VmPeak: 1039 MB, VmSize: 1035 MB, VmRSS: 213 MB, VmData: 245 MB, maxrss: 0.21822 MB Stage outliers finished: 2020-08-07T12:11:42.495764 Resources for stage outliers : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.300 s, Cores in use: 0.94, Total efficiency (on 32 cores): 2.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T12:11:42.548596 Stage halos : Wall: 0.41 s, CPU: 0.25 s, VmPeak: 1039 MB, VmSize: 1035 MB, VmRSS: 222 MB, VmData: 255 MB, maxrss: 0.227616 MB Stage halos finished: 2020-08-07T12:11:42.957569 Resources for stage halos : 1.135 s worker CPU, 1.668 s worker Wall, Wall: 0.412 s, Cores in use: 3.37, Total efficiency (on 32 cores): 10.5 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-07T12:11:43.009708 PSF sigmas in coadd pixels: ['2.61', '2.47', '3.32', '2.57', '2.71'] Using average PSF sigma 2.7358308937792164 Gaussian PSF norm 0.10311119463389005 vs pixelized 0.089058705 average tim pixel scale / coadd scale: 1.001443317558133 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.77', '3.00', '2.03', '2.12', '2.26'] Using average PSF sigma 2.4364693285713876 Gaussian PSF norm 0.11578015305420779 vs pixelized 0.10314973 average tim pixel scale / coadd scale: 1.001469511005544 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.85', '1.81', '1.47', '1.48', '1.91'] Using average PSF sigma 1.7032561072820993 Gaussian PSF norm 0.16562088964061858 vs pixelized 0.14203784 average tim pixel scale / coadd scale: 1.0014565942368208 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.30 s, CPU: 0.26 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 234 MB, VmData: 264 MB, maxrss: 0.239824 MB Stage fit_on_coadds finished: 2020-08-07T12:11:43.305010 Resources for stage fit_on_coadds : 0.340 s worker CPU, 0.576 s worker Wall, Wall: 0.298 s, Cores in use: 2.04, Total efficiency (on 32 cores): 6.4 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T12:11:43.318598 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 24 potential peaks Of 24 potential peaks: 3 in veto map, 3 cut by saddle test, 0 cut by aper test, 18 kept SED z : 18 new peaks Found 19 potential peaks Of 19 potential peaks: 14 in veto map, 1 cut by saddle test, 0 cut by aper test, 4 kept SED r : 4 new peaks Found 23 potential peaks Of 23 potential peaks: 17 in veto map, 2 cut by saddle test, 0 cut by aper test, 4 kept SED g : 4 new peaks Found 35 potential peaks Of 35 potential peaks: 24 in veto map, 3 cut by saddle test, 0 cut by aper test, 8 kept SED Flat : 8 new peaks Found 36 potential peaks Of 36 potential peaks: 30 in veto map, 6 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 34 new sources Median coadd sky for g : -8.783321e-05 Median coadd sky for r : -0.00016495882 Median coadd sky for z : -2.6806407e-05 Stage srcs : Wall: 0.60 s, CPU: 0.53 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 235 MB, VmData: 264 MB, maxrss: 0.240552 MB Stage srcs finished: 2020-08-07T12:11:43.914289 Resources for stage srcs : 0.165 s worker CPU, 0.165 s worker Wall, Wall: 0.598 s, Cores in use: 1.16, Total efficiency (on 32 cores): 3.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T12:11:43.931800 Blob 1 of 29, id: 12, sources: 3, size: 85x91, npix 4680, brick X: 126,211, Y: 125,216, one pixel: 182 125 Blob 2 of 29, id: 3, sources: 2, size: 64x50, npix 1976, brick X: 54,118, Y: 13,63, one pixel: 79 13 Blob 3 of 29, id: 17, sources: 3, size: 45x49, npix 1240, brick X: 306,351, Y: 192,241, one pixel: 343 192 Blob 4 of 29, id: 13, sources: 2, size: 35x56, npix 1159, brick X: 104,139, Y: 130,186, one pixel: 120 130 Blob 5 of 29, id: 16, sources: 1, size: 39x37, npix 1004, brick X: 240,279, Y: 181,218, one pixel: 259 181 Blob 6 of 29, id: 18, sources: 1, size: 34x35, npix 720, brick X: 41,75, Y: 199,234, one pixel: 58 199 Blob 7 of 29, id: 26, sources: 1, size: 29x30, npix 698, brick X: 322,351, Y: 321,351, one pixel: 344 321 Blob 8 of 29, id: 10, sources: 1, size: 31x31, npix 643, brick X: 204,235, Y: 81,112, one pixel: 216 81 Blob 9 of 29, id: 24, sources: 1, size: 29x29, npix 528, brick X: 193,222, Y: 298,327, one pixel: 206 298 Blob 10 of 29, id: 8, sources: 1, size: 28x29, npix 506, brick X: 103,131, Y: 73,102, one pixel: 115 73 Blob 11 of 29, id: 5, sources: 1, size: 26x28, npix 489, brick X: 325,351, Y: 46,74, one pixel: 343 46 Blob 12 of 29, id: 1, sources: 1, size: 26x28, npix 463, brick X: 138,164, Y: 7,35, one pixel: 149 7 Blob 13 of 29, id: 22, sources: 1, size: 25x27, npix 438, brick X: 221,246, Y: 257,284, one pixel: 232 257 Blob 14 of 29, id: 23, sources: 1, size: 25x25, npix 389, brick X: 180,205, Y: 272,297, one pixel: 192 272 Blob 15 of 29, id: 9, sources: 1, size: 24x25, npix 388, brick X: 278,302, Y: 77,102, one pixel: 288 77 Blob 16 of 29, id: 4, sources: 1, size: 24x25, npix 386, brick X: 114,138, Y: 33,58, one pixel: 127 33 Blob 17 of 29, id: 19, sources: 1, size: 24x24, npix 363, brick X: 220,244, Y: 209,233, one pixel: 229 209 Blob 18 of 29, id: 28, sources: 1, size: 27x18, npix 332, brick X: 28,55, Y: 333,351, one pixel: 40 333 Blob 19 of 29, id: 2, sources: 1, size: 22x22, npix 271, brick X: 207,229, Y: 10,32, one pixel: 216 10 Blob 20 of 29, id: 27, sources: 1, size: 20x21, npix 248, brick X: 119,139, Y: 329,350, one pixel: 127 329 Blob 21 of 29, id: 21, sources: 1, size: 21x21, npix 241, brick X: 163,184, Y: 242,263, one pixel: 172 242 Blob 22 of 29, id: 20, sources: 1, size: 20x21, npix 239, brick X: 37,57, Y: 235,256, one pixel: 46 235 Blob 23 of 29, id: 7, sources: 1, size: 20x20, npix 228, brick X: 305,325, Y: 62,82, one pixel: 314 62 Blob 24 of 29, id: 15, sources: 1, size: 20x18, npix 216, brick X: 222,242, Y: 173,191, one pixel: 230 173 Blob 25 of 29, id: 11, sources: 1, size: 20x19, npix 209, brick X: 259,279, Y: 86,105, one pixel: 267 86 Blob 26 of 29, id: 25, sources: 1, size: 19x19, npix 208, brick X: 140,159, Y: 318,337, one pixel: 148 318 Blob 27 of 29, id: 0, sources: 1, size: 21x15, npix 195, brick X: 161,182, Y: 0,15, one pixel: 166 0 Blob 28 of 29, id: 6, sources: 1, size: 18x18, npix 180, brick X: 157,175, Y: 52,70, one pixel: 165 52 Blob 29 of 29, id: 14, sources: 2, size: 13x18, npix 150, brick X: 338,351, Y: 146,164, one pixel: 346 146 Blob 24 finished, total: Wall: 0.09 s, CPU: 0.08 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144556 MB Blob 21 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.14452 MB Blob 23 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144612 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (29.41262, 33.13436), pm (-1.6, -1.7), parallax -0.159 with NanoMaggies: g=19.4, r=18.6, z=18.3 Reset brightness to NanoMaggies: g=18.5, r=18, z=17.9 Blob 20 finished, total: Wall: 0.30 s, CPU: 0.29 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.143956 MB Blob 29 finished, total: Wall: 0.28 s, CPU: 0.27 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 89 MB, VmData: 141 MB, maxrss: 0.091136 MB Blob 22 finished, total: Wall: 0.37 s, CPU: 0.36 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092204 MB Blob 26 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 960 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144384 MB Blob 14 finished, total: Wall: 0.43 s, CPU: 0.43 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 113 MB, VmData: 165 MB, maxrss: 0.115812 MB Blob 28 finished, total: Wall: 0.43 s, CPU: 0.42 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 111 MB, VmData: 164 MB, maxrss: 0.113416 MB Blob 25 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 940 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.144908 MB Blob 27 finished, total: Wall: 0.45 s, CPU: 0.45 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 140 MB, VmData: 180 MB, maxrss: 0.142952 MB Blob 15 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093612 MB Measuring 1 iterative sources Blob 13 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.091412 MB Blob 19 finished, total: Wall: 0.63 s, CPU: 0.63 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 93 MB, VmData: 141 MB, maxrss: 0.09552 MB Blob 16 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 940 MB, VmSize: 722 MB, VmRSS: 138 MB, VmData: 177 MB, maxrss: 0.141148 MB Blob 8 finished, total: Wall: 0.73 s, CPU: 0.72 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 114 MB, VmData: 165 MB, maxrss: 0.116856 MB Blob 12 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 941 MB, VmSize: 726 MB, VmRSS: 139 MB, VmData: 181 MB, maxrss: 0.142628 MB Blob 17 finished, total: Wall: 0.72 s, CPU: 0.72 s, VmPeak: 963 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143108 MB Blob 18 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092032 MB Blob 9 finished, total: Wall: 0.87 s, CPU: 0.87 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 111 MB, VmData: 165 MB, maxrss: 0.113412 MB Blob 11 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 940 MB, VmSize: 722 MB, VmRSS: 138 MB, VmData: 177 MB, maxrss: 0.141092 MB Exception in one_blob: brick custom-029428p33135, iblob 12 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker result = (True, func(*args, **kwds)) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__ R = self.func(*args, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3775, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3743, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3299, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3288, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1135, in stage_fitblobs r = Riter.next(timeout) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next raise value AttributeError: 'NoneType' object has no attribute 'getBrightness' Something went wrong; please check the logfile. ERROR: galaxy DR8-0294p332-258; please check the logfile. Finished galaxy DR8-0294p332-258 in 0.218 minutes. Started working on galaxy DR8-0294p332-258 at Fri Aug 7 12:34:53 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.428673488651363 33.135800999047625 --width 351 --height 351 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T12:34:54.364675 legacypipe git version: DR9.5.11-watershed-4-gcc619972 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '29.428673488651363', '33.135800999047625', '--width', '351', '--height', '351', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.428673488651363 33.135800999047625 --width 351 --height 351 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 29.428673488651363 33.135800999047625 Starting process 16785 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 16786 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 16787 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16788 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16789 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 16790 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 16791 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 16792 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 16793 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 16794 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 16795 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 16796 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 16797 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 16798 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 16799 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 16800 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16801 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 16802 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 16803 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 16804 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 16805 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 16806 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 16808 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 16809 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 16807 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 16810 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 16811 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 16812 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 16813 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 16814 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 16815 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 16816 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T12:34:54.794577 Keeping 15 CCDs: c4d_181103_041850_ooi_g_ls9-S8 g expnum 790269 exptime 184.0 propid 2014B-0404 seeing 1.61 MJD 58425.180 object DECaLS_4955_g decam/CP/V4.8.2a/CP20181102/c4d_181103_041850_ooi_g_ls9.fits.fz c4d_181002_060032_ooi_z_ls9-S8 z expnum 779932 exptime 96.0 propid 2014B-0404 seeing 1.14 MJD 58393.250 object DECaLS_4955_z decam/CP/V4.8.2a/CP20181001/c4d_181002_060032_ooi_z_ls9.fits.fz c4d_181110_030606_ooi_r_ls9-S8 r expnum 792795 exptime 78.0 propid 2014B-0404 seeing 1.71 MJD 58432.129 object DECaLS_4955_r decam/CP/V4.8.2a/CP20181109/c4d_181110_030606_ooi_r_ls9.fits.fz c4d_181002_060244_ooi_z_ls9-S12 z expnum 779933 exptime 106.0 propid 2014B-0404 seeing 1.12 MJD 58393.252 object DECaLS_20806_z decam/CP/V4.8.2a/CP20181001/c4d_181002_060244_ooi_z_ls9.fits.fz c4d_181110_030041_ooi_r_ls9-S12 r expnum 792793 exptime 67.0 propid 2014B-0404 seeing 1.85 MJD 58432.125 object DECaLS_20806_r decam/CP/V4.8.2a/CP20181109/c4d_181110_030041_ooi_r_ls9.fits.fz c4d_181104_041106_ooi_g_ls9-S12 g expnum 790572 exptime 193.0 propid 2014B-0404 seeing 1.52 MJD 58426.174 object DECaLS_20806_g decam/CP/V4.8.2a/CP20181103/c4d_181104_041106_ooi_g_ls9.fits.fz c4d_181105_043024_ooi_z_ls9-S12 z expnum 790926 exptime 106.0 propid 2014B-0404 seeing 0.91 MJD 58427.188 object DECaLS_36678_z decam/CP/V4.8.2a/CP20181104/c4d_181105_043024_ooi_z_ls9.fits.fz c4d_181110_030217_ooi_g_ls9-S12 g expnum 792794 exptime 200.0 propid 2014B-0404 seeing 2.05 MJD 58432.127 object DECaLS_36678_g decam/CP/V4.8.2a/CP20181109/c4d_181110_030217_ooi_g_ls9.fits.fz c4d_181104_041447_ooi_r_ls9-S12 r expnum 790573 exptime 90.0 propid 2014B-0404 seeing 1.25 MJD 58426.177 object DECaLS_36678_r decam/CP/V4.8.2a/CP20181103/c4d_181104_041447_ooi_r_ls9.fits.fz c4d_181105_043024_ooi_z_ls9-S11 z expnum 790926 exptime 106.0 propid 2014B-0404 seeing 0.91 MJD 58427.188 object DECaLS_36678_z decam/CP/V4.8.2a/CP20181104/c4d_181105_043024_ooi_z_ls9.fits.fz c4d_181110_030217_ooi_g_ls9-S11 g expnum 792794 exptime 200.0 propid 2014B-0404 seeing 1.58 MJD 58432.127 object DECaLS_36678_g decam/CP/V4.8.2a/CP20181109/c4d_181110_030217_ooi_g_ls9.fits.fz c4d_181104_041447_ooi_r_ls9-S11 r expnum 790573 exptime 90.0 propid 2014B-0404 seeing 1.31 MJD 58426.177 object DECaLS_36678_r decam/CP/V4.8.2a/CP20181103/c4d_181104_041447_ooi_r_ls9.fits.fz c4d_170722_104419_ooi_z_ls9-S19 z expnum 661059 exptime 205.0 propid 2014B-0404 seeing 1.18 MJD 57956.444 object DECaLS_4934_z decam/CP/V4.8.2/CP20170721/c4d_170722_104419_ooi_z_ls9.fits.fz c4d_181103_034341_ooi_r_ls9-S19 r expnum 790256 exptime 67.0 propid 2014B-0404 seeing 1.39 MJD 58425.155 object DECaLS_4934_r decam/CP/V4.8.2a/CP20181102/c4d_181103_034341_ooi_r_ls9.fits.fz c4d_181103_034515_ooi_g_ls9-S19 g expnum 790257 exptime 164.0 propid 2014B-0404 seeing 1.67 MJD 58425.156 object DECaLS_4934_g decam/CP/V4.8.2a/CP20181102/c4d_181103_034515_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953829b-r-20181110T030606_oi[S8,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T041447_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T041850_oi[S8,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T034515_oi[S19,noinherit][2046,4094][real]: DECaLS_ Masking 0 additional saturated pixels in DECam expnum 790257 S19 CCD, decam/CP/V4.8.2a/CP20181102/c4d_181103_034515_ooi_g_ls9.fits.fz slice (slice(2744, 3099, None), slice(1383, 1737, None)) The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538e4d-g-20181110T030217_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181105T043024_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538e4d-g-20181110T030217_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181105T043024_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T041447_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T060032_oi[S8,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9519cdc-z-20170722T104002_oi[S19,noinherit][2046,4094][real]: DECaLS_ Masking 0 additional saturated pixels in DECam expnum 661059 S19 CCD, decam/CP/V4.8.2/CP20170721/c4d_170722_104419_ooi_z_ls9.fits.fz slice (slice(2762, 3117, None), slice(1364, 1718, None)) The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537a95-r-20181103T034341_oi[S19,noinherit][2046,4094][real]: DECaLS_ Masking 0 additional saturated pixels in DECam expnum 790256 S19 CCD, decam/CP/V4.8.2a/CP20181102/c4d_181103_034341_ooi_r_ls9.fits.fz slice (slice(2746, 3100, None), slice(1373, 1727, None)) The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181104T041106_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953829b-r-20181110T030041_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T060244_oi[S12,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 7.01 s, CPU: 0.78 s, VmPeak: 1006 MB, VmSize: 1006 MB, VmRSS: 184 MB, VmData: 218 MB, maxrss: 0.18834 MB Stage tims finished: 2020-08-07T12:35:01.801681 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T034515_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538e4d-g-20181110T030217_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538e4d-g-20181110T030217_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T041447_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T041447_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953829b-r-20181110T030606_oi[S8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181104T041106_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953829b-r-20181110T030041_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T060244_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 8.204 s worker CPU, 73.415 s worker Wall, Wall: 7.010 s, Cores in use: 1.28, Total efficiency (on 32 cores): 4.0 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T041850_oi[S8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181105T043024_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9519cdc-z-20170722T104002_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-08-07T12:35:01.834876 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02762.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02634.fits Matched 13 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/metrics/cus/reference-custom-029428p33135.fits Stage refs : Wall: 2.83 s, CPU: 2.57 s, VmPeak: 1039 MB, VmSize: 1034 MB, VmRSS: 213 MB, VmData: 246 MB, maxrss: 0.218388 MB Stage refs finished: 2020-08-07T12:35:04.662520 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181105T043024_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 2.830 s, Cores in use: 0.91, Total efficiency (on 32 cores): 2.8 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-refs.p Running stage outliers Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537a95-r-20181103T034341_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T060032_oi[S8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Running stage outliers at 2020-08-07T12:35:05.215363 Stage outliers : Wall: 0.36 s, CPU: 0.34 s, VmPeak: 1039 MB, VmSize: 1035 MB, VmRSS: 214 MB, VmData: 247 MB, maxrss: 0.219548 MB Stage outliers finished: 2020-08-07T12:35:05.575688 Resources for stage outliers : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.362 s, Cores in use: 0.94, Total efficiency (on 32 cores): 2.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T12:35:06.094057 Stage halos : Wall: 0.43 s, CPU: 0.23 s, VmPeak: 1039 MB, VmSize: 1035 MB, VmRSS: 222 MB, VmData: 255 MB, maxrss: 0.22762 MB Stage halos finished: 2020-08-07T12:35:06.528096 Resources for stage halos : 1.109 s worker CPU, 2.170 s worker Wall, Wall: 0.436 s, Cores in use: 3.07, Total efficiency (on 32 cores): 9.6 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-07T12:35:07.424649 PSF sigmas in coadd pixels: ['2.61', '2.47', '3.32', '2.57', '2.71'] Using average PSF sigma 2.7358308937792164 Gaussian PSF norm 0.10311119463389005 vs pixelized 0.089058705 average tim pixel scale / coadd scale: 1.001443317558133 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.77', '3.00', '2.03', '2.12', '2.26'] Using average PSF sigma 2.4364693285713876 Gaussian PSF norm 0.11578015305420779 vs pixelized 0.10314973 average tim pixel scale / coadd scale: 1.001469511005544 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.85', '1.81', '1.47', '1.48', '1.91'] Using average PSF sigma 1.7032561072820993 Gaussian PSF norm 0.16562088964061858 vs pixelized 0.14203784 average tim pixel scale / coadd scale: 1.0014565942368208 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-copsf-z.fits.fz Stage fit_on_coadds : Wall: 2.11 s, CPU: 0.27 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 237 MB, VmData: 267 MB, maxrss: 0.24246 MB Stage fit_on_coadds finished: 2020-08-07T12:35:09.535315 Resources for stage fit_on_coadds : 0.311 s worker CPU, 0.381 s worker Wall, Wall: 2.113 s, Cores in use: 0.27, Total efficiency (on 32 cores): 0.9 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T12:35:09.552827 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 24 potential peaks Of 24 potential peaks: 3 in veto map, 3 cut by saddle test, 0 cut by aper test, 18 kept SED z : 18 new peaks Found 19 potential peaks Of 19 potential peaks: 14 in veto map, 1 cut by saddle test, 0 cut by aper test, 4 kept SED r : 4 new peaks Found 23 potential peaks Of 23 potential peaks: 17 in veto map, 2 cut by saddle test, 0 cut by aper test, 4 kept SED g : 4 new peaks Found 35 potential peaks Of 35 potential peaks: 24 in veto map, 3 cut by saddle test, 0 cut by aper test, 8 kept SED Flat : 8 new peaks Found 36 potential peaks Of 36 potential peaks: 30 in veto map, 6 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 34 new sources Median coadd sky for g : -8.78332e-05 Median coadd sky for r : -0.00016495882 Median coadd sky for z : -2.6806407e-05 Stage srcs : Wall: 0.61 s, CPU: 0.55 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 238 MB, VmData: 267 MB, maxrss: 0.243308 MB Stage srcs finished: 2020-08-07T12:35:10.159957 Resources for stage srcs : 0.146 s worker CPU, 0.156 s worker Wall, Wall: 0.609 s, Cores in use: 1.15, Total efficiency (on 32 cores): 3.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T12:35:10.187062 Blob 1 of 29, id: 12, sources: 3, size: 85x91, npix 4680, brick X: 126,211, Y: 125,216, one pixel: 182 125 Blob 2 of 29, id: 3, sources: 2, size: 64x50, npix 1976, brick X: 54,118, Y: 13,63, one pixel: 79 13 Blob 3 of 29, id: 17, sources: 3, size: 45x49, npix 1240, brick X: 306,351, Y: 192,241, one pixel: 343 192 Blob 4 of 29, id: 13, sources: 2, size: 35x56, npix 1159, brick X: 104,139, Y: 130,186, one pixel: 120 130 Blob 5 of 29, id: 16, sources: 1, size: 39x37, npix 1004, brick X: 240,279, Y: 181,218, one pixel: 259 181 Blob 6 of 29, id: 18, sources: 1, size: 34x35, npix 720, brick X: 41,75, Y: 199,234, one pixel: 58 199 Blob 7 of 29, id: 26, sources: 1, size: 29x30, npix 698, brick X: 322,351, Y: 321,351, one pixel: 344 321 Blob 8 of 29, id: 10, sources: 1, size: 31x31, npix 643, brick X: 204,235, Y: 81,112, one pixel: 216 81 Blob 9 of 29, id: 24, sources: 1, size: 29x29, npix 528, brick X: 193,222, Y: 298,327, one pixel: 206 298 Blob 10 of 29, id: 8, sources: 1, size: 28x29, npix 506, brick X: 103,131, Y: 73,102, one pixel: 115 73 Blob 11 of 29, id: 5, sources: 1, size: 26x28, npix 489, brick X: 325,351, Y: 46,74, one pixel: 343 46 Blob 12 of 29, id: 1, sources: 1, size: 26x28, npix 463, brick X: 138,164, Y: 7,35, one pixel: 149 7 Blob 13 of 29, id: 22, sources: 1, size: 25x27, npix 438, brick X: 221,246, Y: 257,284, one pixel: 232 257 Blob 14 of 29, id: 23, sources: 1, size: 25x25, npix 389, brick X: 180,205, Y: 272,297, one pixel: 192 272 Blob 15 of 29, id: 9, sources: 1, size: 24x25, npix 388, brick X: 278,302, Y: 77,102, one pixel: 288 77 Blob 16 of 29, id: 4, sources: 1, size: 24x25, npix 386, brick X: 114,138, Y: 33,58, one pixel: 127 33 Blob 17 of 29, id: 19, sources: 1, size: 24x24, npix 363, brick X: 220,244, Y: 209,233, one pixel: 229 209 Blob 18 of 29, id: 28, sources: 1, size: 27x18, npix 332, brick X: 28,55, Y: 333,351, one pixel: 40 333 Blob 19 of 29, id: 2, sources: 1, size: 22x22, npix 271, brick X: 207,229, Y: 10,32, one pixel: 216 10 Blob 20 of 29, id: 27, sources: 1, size: 20x21, npix 248, brick X: 119,139, Y: 329,350, one pixel: 127 329 Blob 21 of 29, id: 21, sources: 1, size: 21x21, npix 241, brick X: 163,184, Y: 242,263, one pixel: 172 242 Blob 22 of 29, id: 20, sources: 1, size: 20x21, npix 239, brick X: 37,57, Y: 235,256, one pixel: 46 235 Blob 23 of 29, id: 7, sources: 1, size: 20x20, npix 228, brick X: 305,325, Y: 62,82, one pixel: 314 62 Blob 24 of 29, id: 15, sources: 1, size: 20x18, npix 216, brick X: 222,242, Y: 173,191, one pixel: 230 173 Blob 25 of 29, id: 11, sources: 1, size: 20x19, npix 209, brick X: 259,279, Y: 86,105, one pixel: 267 86 Blob 26 of 29, id: 25, sources: 1, size: 19x19, npix 208, brick X: 140,159, Y: 318,337, one pixel: 148 318 Blob 27 of 29, id: 0, sources: 1, size: 21x15, npix 195, brick X: 161,182, Y: 0,15, one pixel: 166 0 Blob 28 of 29, id: 6, sources: 1, size: 18x18, npix 180, brick X: 157,175, Y: 52,70, one pixel: 165 52 Blob 29 of 29, id: 14, sources: 2, size: 13x18, npix 150, brick X: 338,351, Y: 146,164, one pixel: 346 146 Blob 24 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 963 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.144896 MB Blob 20 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.09116 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (29.41262, 33.13436), pm (-1.6, -1.7), parallax -0.159 with NanoMaggies: g=19.4, r=18.6, z=18.3 Reset brightness to NanoMaggies: g=18.5, r=18, z=17.9 Blob 23 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144288 MB Blob 21 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144308 MB Blob 29 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 106 MB, VmData: 164 MB, maxrss: 0.108444 MB Blob 14 finished, total: Wall: 0.37 s, CPU: 0.36 s, VmPeak: 940 MB, VmSize: 722 MB, VmRSS: 138 MB, VmData: 177 MB, maxrss: 0.1409 MB Blob 22 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 110 MB, VmData: 164 MB, maxrss: 0.112304 MB Blob 26 finished, total: Wall: 0.40 s, CPU: 0.39 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 180 MB, maxrss: 0.146816 MB Blob 25 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 940 MB, VmSize: 723 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144072 MB Blob 28 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 960 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144556 MB Blob 27 finished, total: Wall: 0.45 s, CPU: 0.45 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.091672 MB Blob 19 finished, total: Wall: 0.61 s, CPU: 0.61 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 109 MB, VmData: 164 MB, maxrss: 0.11172 MB Blob 16 finished, total: Wall: 0.70 s, CPU: 0.69 s, VmPeak: 945 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.14298 MB Blob 15 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.091372 MB Blob 17 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 940 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.142872 MB Blob 13 finished, total: Wall: 0.73 s, CPU: 0.72 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 114 MB, VmData: 165 MB, maxrss: 0.117068 MB Measuring 1 iterative sources Blob 12 finished, total: Wall: 0.85 s, CPU: 0.84 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.1151 MB Blob 8 finished, total: Wall: 0.86 s, CPU: 0.86 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 109 MB, VmData: 164 MB, maxrss: 0.11194 MB Blob 9 finished, total: Wall: 0.87 s, CPU: 0.87 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 108 MB, VmData: 164 MB, maxrss: 0.110552 MB Blob 18 finished, total: Wall: 1.00 s, CPU: 1.00 s, VmPeak: 941 MB, VmSize: 726 MB, VmRSS: 139 MB, VmData: 181 MB, maxrss: 0.142832 MB Measuring 1 iterative sources Blob 11 finished, total: Wall: 1.16 s, CPU: 1.16 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.14496 MB Exception in one_blob: brick custom-029428p33135, iblob 12 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker result = (True, func(*args, **kwds)) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__ R = self.func(*args, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3775, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3743, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3299, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3288, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1135, in stage_fitblobs r = Riter.next(timeout) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next raise value AttributeError: 'NoneType' object has no attribute 'getBrightness' Something went wrong; please check the logfile. ERROR: galaxy DR8-0294p332-258; please check the logfile. Finished galaxy DR8-0294p332-258 in 0.308 minutes. Started working on galaxy DR8-0294p332-258 at Fri Aug 7 13:37:17 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.428673488651363 33.135800999047625 --width 351 --height 351 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T13:37:18.066934 legacypipe git version: DR9.5.11-watershed-5-g77ea3463 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '29.428673488651363', '33.135800999047625', '--width', '351', '--height', '351', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.428673488651363 33.135800999047625 --width 351 --height 351 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 29.428673488651363 33.135800999047625 Starting process 20723 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 20724 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 20725 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 20726 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 20727 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059476 MB Starting process 20728 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059424 MB Starting process 20729 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059424 MB Starting process 20730 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 20731 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 20732 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 20733 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 20734 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 20735 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 20736 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 20737 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 20738 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 20739 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 20740 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 20741 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 20742 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 20743 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 20744 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 20745 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 20746 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 20747 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 20748 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 20749 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 20750 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 20751 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 20752 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 20753 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 20754 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T13:37:18.584039 Keeping 15 CCDs: c4d_181103_041850_ooi_g_ls9-S8 g expnum 790269 exptime 184.0 propid 2014B-0404 seeing 1.61 MJD 58425.180 object DECaLS_4955_g decam/CP/V4.8.2a/CP20181102/c4d_181103_041850_ooi_g_ls9.fits.fz c4d_181002_060032_ooi_z_ls9-S8 z expnum 779932 exptime 96.0 propid 2014B-0404 seeing 1.14 MJD 58393.250 object DECaLS_4955_z decam/CP/V4.8.2a/CP20181001/c4d_181002_060032_ooi_z_ls9.fits.fz c4d_181110_030606_ooi_r_ls9-S8 r expnum 792795 exptime 78.0 propid 2014B-0404 seeing 1.71 MJD 58432.129 object DECaLS_4955_r decam/CP/V4.8.2a/CP20181109/c4d_181110_030606_ooi_r_ls9.fits.fz c4d_181002_060244_ooi_z_ls9-S12 z expnum 779933 exptime 106.0 propid 2014B-0404 seeing 1.12 MJD 58393.252 object DECaLS_20806_z decam/CP/V4.8.2a/CP20181001/c4d_181002_060244_ooi_z_ls9.fits.fz c4d_181110_030041_ooi_r_ls9-S12 r expnum 792793 exptime 67.0 propid 2014B-0404 seeing 1.85 MJD 58432.125 object DECaLS_20806_r decam/CP/V4.8.2a/CP20181109/c4d_181110_030041_ooi_r_ls9.fits.fz c4d_181104_041106_ooi_g_ls9-S12 g expnum 790572 exptime 193.0 propid 2014B-0404 seeing 1.52 MJD 58426.174 object DECaLS_20806_g decam/CP/V4.8.2a/CP20181103/c4d_181104_041106_ooi_g_ls9.fits.fz c4d_181105_043024_ooi_z_ls9-S12 z expnum 790926 exptime 106.0 propid 2014B-0404 seeing 0.91 MJD 58427.188 object DECaLS_36678_z decam/CP/V4.8.2a/CP20181104/c4d_181105_043024_ooi_z_ls9.fits.fz c4d_181110_030217_ooi_g_ls9-S12 g expnum 792794 exptime 200.0 propid 2014B-0404 seeing 2.05 MJD 58432.127 object DECaLS_36678_g decam/CP/V4.8.2a/CP20181109/c4d_181110_030217_ooi_g_ls9.fits.fz c4d_181104_041447_ooi_r_ls9-S12 r expnum 790573 exptime 90.0 propid 2014B-0404 seeing 1.25 MJD 58426.177 object DECaLS_36678_r decam/CP/V4.8.2a/CP20181103/c4d_181104_041447_ooi_r_ls9.fits.fz c4d_181105_043024_ooi_z_ls9-S11 z expnum 790926 exptime 106.0 propid 2014B-0404 seeing 0.91 MJD 58427.188 object DECaLS_36678_z decam/CP/V4.8.2a/CP20181104/c4d_181105_043024_ooi_z_ls9.fits.fz c4d_181110_030217_ooi_g_ls9-S11 g expnum 792794 exptime 200.0 propid 2014B-0404 seeing 1.58 MJD 58432.127 object DECaLS_36678_g decam/CP/V4.8.2a/CP20181109/c4d_181110_030217_ooi_g_ls9.fits.fz c4d_181104_041447_ooi_r_ls9-S11 r expnum 790573 exptime 90.0 propid 2014B-0404 seeing 1.31 MJD 58426.177 object DECaLS_36678_r decam/CP/V4.8.2a/CP20181103/c4d_181104_041447_ooi_r_ls9.fits.fz c4d_170722_104419_ooi_z_ls9-S19 z expnum 661059 exptime 205.0 propid 2014B-0404 seeing 1.18 MJD 57956.444 object DECaLS_4934_z decam/CP/V4.8.2/CP20170721/c4d_170722_104419_ooi_z_ls9.fits.fz c4d_181103_034341_ooi_r_ls9-S19 r expnum 790256 exptime 67.0 propid 2014B-0404 seeing 1.39 MJD 58425.155 object DECaLS_4934_r decam/CP/V4.8.2a/CP20181102/c4d_181103_034341_ooi_r_ls9.fits.fz c4d_181103_034515_ooi_g_ls9-S19 g expnum 790257 exptime 164.0 propid 2014B-0404 seeing 1.67 MJD 58425.156 object DECaLS_4934_g decam/CP/V4.8.2a/CP20181102/c4d_181103_034515_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538e4d-g-20181110T030217_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538e4d-g-20181110T030217_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953829b-r-20181110T030606_oi[S8,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181105T043024_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181105T043024_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T041850_oi[S8,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T034515_oi[S19,noinherit][2046,4094][real]: DECaLS_ Masking 0 additional saturated pixels in DECam expnum 790257 S19 CCD, decam/CP/V4.8.2a/CP20181102/c4d_181103_034515_ooi_g_ls9.fits.fz slice (slice(2744, 3099, None), slice(1383, 1737, None)) The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T041447_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T041447_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9519cdc-z-20170722T104002_oi[S19,noinherit][2046,4094][real]: DECaLS_ Masking 0 additional saturated pixels in DECam expnum 661059 S19 CCD, decam/CP/V4.8.2/CP20170721/c4d_170722_104419_ooi_z_ls9.fits.fz slice (slice(2762, 3117, None), slice(1364, 1718, None)) The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T060032_oi[S8,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537a95-r-20181103T034341_oi[S19,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181104T041106_oi[S12,noinherit][2046,4094][real]: DECaLS_ Masking 0 additional saturated pixels in DECam expnum 790256 S19 CCD, decam/CP/V4.8.2a/CP20181102/c4d_181103_034341_ooi_r_ls9.fits.fz slice (slice(2746, 3100, None), slice(1373, 1727, None)) The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953829b-r-20181110T030041_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T060244_oi[S12,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 16.79 s, CPU: 0.81 s, VmPeak: 1006 MB, VmSize: 1006 MB, VmRSS: 183 MB, VmData: 216 MB, maxrss: 0.187024 MB Stage tims finished: 2020-08-07T13:37:35.378632 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T041850_oi[S8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T041447_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T060032_oi[S8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9519cdc-z-20170722T104002_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953829b-r-20181110T030606_oi[S8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T060244_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953829b-r-20181110T030041_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181105T043024_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 8.063 s worker CPU, 90.336 s worker Wall, Wall: 16.797 s, Cores in use: 0.53, Total efficiency (on 32 cores): 1.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538e4d-g-20181110T030217_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T034515_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T041447_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181104T041106_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537a95-r-20181103T034341_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181105T043024_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-08-07T13:37:35.413284 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02762.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02634.fits Matched 13 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/metrics/cus/reference-custom-029428p33135.fits Stage refs : Wall: 2.77 s, CPU: 2.50 s, VmPeak: 1039 MB, VmSize: 1034 MB, VmRSS: 212 MB, VmData: 245 MB, maxrss: 0.217072 MB Stage refs finished: 2020-08-07T13:37:38.185416 Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 2.775 s, Cores in use: 0.90, Total efficiency (on 32 cores): 2.8 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T13:37:38.221464 Stage outliers : Wall: 0.37 s, CPU: 0.35 s, VmPeak: 1039 MB, VmSize: 1035 MB, VmRSS: 213 MB, VmData: 245 MB, maxrss: 0.218436 MB Stage outliers finished: 2020-08-07T13:37:38.596122 Resources for stage outliers : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.377 s, Cores in use: 0.94, Total efficiency (on 32 cores): 2.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-outliers.p Running stage halos Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538e4d-g-20181110T030217_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage halos at 2020-08-07T13:37:38.659949 Stage halos : Wall: 0.60 s, CPU: 0.29 s, VmPeak: 1039 MB, VmSize: 1035 MB, VmRSS: 222 MB, VmData: 255 MB, maxrss: 0.227632 MB Stage halos finished: 2020-08-07T13:37:39.264748 Resources for stage halos : 1.090 s worker CPU, 1.981 s worker Wall, Wall: 0.607 s, Cores in use: 2.28, Total efficiency (on 32 cores): 7.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-07T13:37:39.303785 PSF sigmas in coadd pixels: ['2.61', '2.47', '3.32', '2.57', '2.71'] Using average PSF sigma 2.7358308937792164 Gaussian PSF norm 0.10311119463389005 vs pixelized 0.089058705 average tim pixel scale / coadd scale: 1.001443317558133 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.77', '3.00', '2.03', '2.12', '2.26'] Using average PSF sigma 2.4364693285713876 Gaussian PSF norm 0.11578015305420779 vs pixelized 0.10314973 average tim pixel scale / coadd scale: 1.001469511005544 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.85', '1.81', '1.47', '1.48', '1.91'] Using average PSF sigma 1.7032561072820993 Gaussian PSF norm 0.16562088964061858 vs pixelized 0.14203784 average tim pixel scale / coadd scale: 1.0014565942368208 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-copsf-z.fits.fz Stage fit_on_coadds : Wall: 1.80 s, CPU: 0.26 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 235 MB, VmData: 265 MB, maxrss: 0.24062 MB Stage fit_on_coadds finished: 2020-08-07T13:37:41.100507 Resources for stage fit_on_coadds : 0.351 s worker CPU, 0.561 s worker Wall, Wall: 1.799 s, Cores in use: 0.34, Total efficiency (on 32 cores): 1.1 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T13:37:41.115508 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 24 potential peaks Of 24 potential peaks: 3 in veto map, 3 cut by saddle test, 0 cut by aper test, 18 kept SED z : 18 new peaks Found 19 potential peaks Of 19 potential peaks: 14 in veto map, 1 cut by saddle test, 0 cut by aper test, 4 kept SED r : 4 new peaks Found 23 potential peaks Of 23 potential peaks: 17 in veto map, 2 cut by saddle test, 0 cut by aper test, 4 kept SED g : 4 new peaks Found 35 potential peaks Of 35 potential peaks: 24 in veto map, 3 cut by saddle test, 0 cut by aper test, 8 kept SED Flat : 8 new peaks Found 36 potential peaks Of 36 potential peaks: 30 in veto map, 6 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 34 new sources Median coadd sky for g : -8.783319e-05 Median coadd sky for r : -0.0001649588 Median coadd sky for z : -2.6806407e-05 Stage srcs : Wall: 0.63 s, CPU: 0.50 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 236 MB, VmData: 265 MB, maxrss: 0.241516 MB Stage srcs finished: 2020-08-07T13:37:41.747530 Resources for stage srcs : 0.132 s worker CPU, 0.132 s worker Wall, Wall: 0.634 s, Cores in use: 1.00, Total efficiency (on 32 cores): 3.1 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T13:37:41.763031 Blob 1 of 29, id: 12, sources: 3, size: 85x91, npix 4680, brick X: 126,211, Y: 125,216, one pixel: 182 125 Blob 2 of 29, id: 3, sources: 2, size: 64x50, npix 1976, brick X: 54,118, Y: 13,63, one pixel: 79 13 Blob 3 of 29, id: 17, sources: 3, size: 45x49, npix 1240, brick X: 306,351, Y: 192,241, one pixel: 343 192 Blob 4 of 29, id: 13, sources: 2, size: 35x56, npix 1159, brick X: 104,139, Y: 130,186, one pixel: 120 130 Blob 5 of 29, id: 16, sources: 1, size: 39x37, npix 1004, brick X: 240,279, Y: 181,218, one pixel: 259 181 Blob 6 of 29, id: 18, sources: 1, size: 34x35, npix 720, brick X: 41,75, Y: 199,234, one pixel: 58 199 Blob 7 of 29, id: 26, sources: 1, size: 29x30, npix 698, brick X: 322,351, Y: 321,351, one pixel: 344 321 Blob 8 of 29, id: 10, sources: 1, size: 31x31, npix 643, brick X: 204,235, Y: 81,112, one pixel: 216 81 Blob 9 of 29, id: 24, sources: 1, size: 29x29, npix 528, brick X: 193,222, Y: 298,327, one pixel: 206 298 Blob 10 of 29, id: 8, sources: 1, size: 28x29, npix 506, brick X: 103,131, Y: 73,102, one pixel: 115 73 Blob 11 of 29, id: 5, sources: 1, size: 26x28, npix 489, brick X: 325,351, Y: 46,74, one pixel: 343 46 Blob 12 of 29, id: 1, sources: 1, size: 26x28, npix 463, brick X: 138,164, Y: 7,35, one pixel: 149 7 Blob 13 of 29, id: 22, sources: 1, size: 25x27, npix 438, brick X: 221,246, Y: 257,284, one pixel: 232 257 Blob 14 of 29, id: 23, sources: 1, size: 25x25, npix 389, brick X: 180,205, Y: 272,297, one pixel: 192 272 Blob 15 of 29, id: 9, sources: 1, size: 24x25, npix 388, brick X: 278,302, Y: 77,102, one pixel: 288 77 Blob 16 of 29, id: 4, sources: 1, size: 24x25, npix 386, brick X: 114,138, Y: 33,58, one pixel: 127 33 Blob 17 of 29, id: 19, sources: 1, size: 24x24, npix 363, brick X: 220,244, Y: 209,233, one pixel: 229 209 Blob 18 of 29, id: 28, sources: 1, size: 27x18, npix 332, brick X: 28,55, Y: 333,351, one pixel: 40 333 Blob 19 of 29, id: 2, sources: 1, size: 22x22, npix 271, brick X: 207,229, Y: 10,32, one pixel: 216 10 Blob 20 of 29, id: 27, sources: 1, size: 20x21, npix 248, brick X: 119,139, Y: 329,350, one pixel: 127 329 Blob 21 of 29, id: 21, sources: 1, size: 21x21, npix 241, brick X: 163,184, Y: 242,263, one pixel: 172 242 Blob 22 of 29, id: 20, sources: 1, size: 20x21, npix 239, brick X: 37,57, Y: 235,256, one pixel: 46 235 Blob 23 of 29, id: 7, sources: 1, size: 20x20, npix 228, brick X: 305,325, Y: 62,82, one pixel: 314 62 Blob 24 of 29, id: 15, sources: 1, size: 20x18, npix 216, brick X: 222,242, Y: 173,191, one pixel: 230 173 Blob 25 of 29, id: 11, sources: 1, size: 20x19, npix 209, brick X: 259,279, Y: 86,105, one pixel: 267 86 Blob 26 of 29, id: 25, sources: 1, size: 19x19, npix 208, brick X: 140,159, Y: 318,337, one pixel: 148 318 Blob 27 of 29, id: 0, sources: 1, size: 21x15, npix 195, brick X: 161,182, Y: 0,15, one pixel: 166 0 Blob 28 of 29, id: 6, sources: 1, size: 18x18, npix 180, brick X: 157,175, Y: 52,70, one pixel: 165 52 Blob 29 of 29, id: 14, sources: 2, size: 13x18, npix 150, brick X: 338,351, Y: 146,164, one pixel: 346 146 Blob 24 finished, total: Wall: 0.11 s, CPU: 0.08 s, VmPeak: 963 MB, VmSize: 726 MB, VmRSS: 139 MB, VmData: 181 MB, maxrss: 0.142468 MB Blob 20 finished, total: Wall: 0.20 s, CPU: 0.20 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 113 MB, VmData: 165 MB, maxrss: 0.115804 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (29.41262, 33.13436), pm (-1.6, -1.7), parallax -0.159 with NanoMaggies: g=19.4, r=18.6, z=18.3 Reset brightness to NanoMaggies: g=18.5, r=18, z=17.9 Blob 23 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 180 MB, maxrss: 0.14646 MB Blob 21 finished, total: Wall: 0.25 s, CPU: 0.23 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 89 MB, VmData: 137 MB, maxrss: 0.091112 MB Blob 29 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 89 MB, VmData: 139 MB, maxrss: 0.090988 MB Blob 22 finished, total: Wall: 0.38 s, CPU: 0.35 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093672 MB Blob 28 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145676 MB Blob 26 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.093896 MB Blob 27 finished, total: Wall: 0.39 s, CPU: 0.37 s, VmPeak: 944 MB, VmSize: 722 MB, VmRSS: 135 MB, VmData: 177 MB, maxrss: 0.13868 MB Blob 14 finished, total: Wall: 0.48 s, CPU: 0.43 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 108 MB, VmData: 164 MB, maxrss: 0.110376 MB Blob 25 finished, total: Wall: 0.53 s, CPU: 0.48 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 114 MB, VmData: 165 MB, maxrss: 0.11686 MB Blob 8 finished, total: Wall: 0.61 s, CPU: 0.58 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.114936 MB Measuring 1 iterative sources Blob 16 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144664 MB Blob 13 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092424 MB Blob 15 finished, total: Wall: 0.70 s, CPU: 0.66 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 180 MB, maxrss: 0.146996 MB Blob 19 finished, total: Wall: 0.74 s, CPU: 0.72 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 111 MB, VmData: 164 MB, maxrss: 0.113256 MB Blob 12 finished, total: Wall: 0.82 s, CPU: 0.81 s, VmPeak: 960 MB, VmSize: 725 MB, VmRSS: 140 MB, VmData: 180 MB, maxrss: 0.142956 MB Blob 17 finished, total: Wall: 0.88 s, CPU: 0.85 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.091928 MB Blob 9 finished, total: Wall: 0.91 s, CPU: 0.87 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 110 MB, VmData: 164 MB, maxrss: 0.112436 MB Blob 18 finished, total: Wall: 0.93 s, CPU: 0.88 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.0914 MB Blob 11 finished, total: Wall: 0.99 s, CPU: 0.98 s, VmPeak: 960 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144572 MB Measuring 1 iterative sources Blob 10 finished, total: Wall: 1.43 s, CPU: 1.42 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 114 MB, VmData: 165 MB, maxrss: 0.116344 MB Measuring 1 iterative sources Measuring 2 iterative sources Measuring 1 iterative sources Measuring 1 iterative sources Blob 7 finished, total: Wall: 1.95 s, CPU: 1.94 s, VmPeak: 945 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144112 MB Blob 5 finished, total: Wall: 2.05 s, CPU: 2.01 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 113 MB, VmData: 165 MB, maxrss: 0.116092 MB Blob 6 finished, total: Wall: 2.06 s, CPU: 2.06 s, VmPeak: 940 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147768 MB Blob 4 finished, total: Wall: 2.09 s, CPU: 2.08 s, VmPeak: 940 MB, VmSize: 722 MB, VmRSS: 138 MB, VmData: 177 MB, maxrss: 0.14092 MB Blob 3 finished, total: Wall: 2.14 s, CPU: 2.10 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.11448 MB Blob 2 finished, total: Wall: 2.39 s, CPU: 2.38 s, VmPeak: 940 MB, VmSize: 727 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148604 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.79148, ee1=0.036512, ee2=0.311621 Blob 1 finished, total: Wall: 2.66 s, CPU: 2.61 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14572 MB Old catalog: 42 New catalog: 38 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/metrics/cus/blobs-custom-029428p33135.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/metrics/cus/all-models-custom-029428p33135.fits Stage fitblobs : Wall: 2.96 s, CPU: 0.36 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 236 MB, VmData: 265 MB, maxrss: 0.241872 MB Stage fitblobs finished: 2020-08-07T13:37:44.727104 Resources for stage fitblobs : 28.107 s worker CPU, 28.797 s worker Wall, Wall: 2.967 s, Cores in use: 9.60, Total efficiency (on 32 cores): 30.0 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T13:37:44.753778 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/tmp-legacysurvey-custom-029428p33135-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/tmp-legacysurvey-custom-029428p33135-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/tmp-legacysurvey-custom-029428p33135-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/tmp-legacysurvey-custom-029428p33135-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-resid.jpg Stage coadds : Wall: 2.13 s, CPU: 0.67 s, VmPeak: 1044 MB, VmSize: 1044 MB, VmRSS: 239 MB, VmData: 267 MB, maxrss: 0.244468 MB Stage coadds finished: 2020-08-07T13:37:46.880917 Resources for stage coadds : 28.282 s worker CPU, 31.789 s worker Wall, Wall: 2.129 s, Cores in use: 13.60, Total efficiency (on 32 cores): 42.5 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T13:37:46.913250 Cut to 1 unWISE tiles Reading WISE tile 0287p333 band 2 Reading WISE tile 0287p333 band 1 Reading WISE tile 0287p333 band 3 Reading WISE tile 0287p333 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 956 MB, VmSize: 805 MB, VmRSS: 148 MB, VmData: 176 MB, maxrss: 0.189368 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 944 MB, VmSize: 800 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.204764 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 941 MB, VmSize: 795 MB, VmRSS: 138 MB, VmData: 170 MB, maxrss: 0.199972 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 963 MB, VmSize: 809 MB, VmRSS: 150 MB, VmData: 180 MB, maxrss: 0.20688 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/tmp-legacysurvey-custom-029428p33135-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/tmp-legacysurvey-custom-029428p33135-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 1.89 s, CPU: 0.51 s, VmPeak: 1044 MB, VmSize: 1040 MB, VmRSS: 235 MB, VmData: 263 MB, maxrss: 0.245 MB Stage wise_forced finished: 2020-08-07T13:37:48.799978 Resources for stage wise_forced : 3.188 s worker CPU, 4.264 s worker Wall, Wall: 1.889 s, Cores in use: 1.96, Total efficiency (on 32 cores): 6.1 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T13:37:48.830071 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/coadd/cus/custom-029428p33135/legacysurvey-custom-029428p33135-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/tractor-i/cus/tractor-custom-029428p33135.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/tractor/cus/tractor-custom-029428p33135.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/tractor/cus/brick-custom-029428p33135.sha256sum Stage writecat : Wall: 0.65 s, CPU: 0.50 s, VmPeak: 1172 MB, VmSize: 1044 MB, VmRSS: 237 MB, VmData: 263 MB, maxrss: 0.373944 MB Stage writecat finished: 2020-08-07T13:37:49.479440 Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.652 s, Cores in use: 0.78, Total efficiency (on 32 cores): 2.4 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0294p332-258/DR8-0294p332-258-largegalaxy-writecat.p All done: 69.219 s worker CPU, 157.867 s worker Wall, Wall: 30.936 s, Cores in use: 2.46, Total efficiency (on 32 cores): 7.7 % Finished galaxy DR8-0294p332-258 in 0.566 minutes.