Started working on galaxy PGC3284995 at Thu Jun 25 03:29:47 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.8049535 1.1682798 --width 245 --height 245 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-25T03:29:53.603353 legacypipe git version: DR9.5.2-150-g3ed0fdf5 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '167.8049535', '1.1682798', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.8049535 1.1682798 --width 245 --height 245 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 167.8049535 1.1682798 Starting process 44538 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 130 MB, maxrss: 0.057768 MB Starting process 44541 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 130 MB, maxrss: 0.057768 MB Starting process 44544 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 130 MB, maxrss: 0.057748 MB Starting process 44546 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 130 MB, maxrss: 0.05776 MB Starting process 44549 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 130 MB, maxrss: 0.057772 MB Starting process 44552 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 130 MB, maxrss: 0.057772 MB Starting process 44562 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 130 MB, maxrss: 0.057772 MB Starting process 44564 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 130 MB, maxrss: 0.057764 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-25T03:29:57.085272 Keeping 10 CCDs: c4d_150417_013654_ooi_g_ls9.fits.fz c4d_150417_013654_ooi_g_ls9-N13 g exptime 52.0 propid 2014B-0404 seeing 1.08 MJD 57129.066 object DECaLS_3438_g c4d_190206_062158_ooi_g_ls9.fits.fz c4d_190206_062158_ooi_g_ls9-N13 g exptime 130.0 propid 2014B-0404 seeing 1.63 MJD 58520.265 object DECaLS_3438_g c4d_150417_013818_ooi_r_ls9.fits.fz c4d_150417_013818_ooi_r_ls9-N13 r exptime 54.0 propid 2014B-0404 seeing 1.02 MJD 57129.067 object DECaLS_3438_r c4d_150409_021138_ooi_z_ls9.fits.fz c4d_150409_021138_ooi_z_ls9-N13 z exptime 90.0 propid 2014B-0404 seeing 1.11 MJD 57121.090 object DECaLS_3438_z c4d_170306_045851_ooi_g_ls9.fits.fz c4d_170306_045851_ooi_g_ls9-N12 g exptime 175.0 propid 2014B-0404 seeing 1.18 MJD 57818.205 object DECaLS_19310_g c4d_170304_045330_ooi_r_ls9.fits.fz c4d_170304_045330_ooi_r_ls9-N12 r exptime 65.0 propid 2014B-0404 seeing 1.22 MJD 57816.203 object DECaLS_19310_r c4d_150328_031754_ooi_z_ls9.fits.fz c4d_150328_031754_ooi_z_ls9-N12 z exptime 103.0 propid 2014B-0404 seeing 1.27 MJD 57109.136 object DECaLS_19310_z c4d_180513_004425_ooi_g_ls9.fits.fz c4d_180513_004425_ooi_g_ls9-N4 g exptime 200.0 propid 2014B-0404 seeing 1.46 MJD 58251.031 object DECaLS_35182_g c4d_150329_020030_ooi_z_ls9.fits.fz c4d_150329_020030_ooi_z_ls9-N4 z exptime 143.0 propid 2014B-0404 seeing 1.14 MJD 57110.081 object DECaLS_35182_z c4d_180518_021934_ooi_r_ls9.fits.fz c4d_180518_021934_ooi_r_ls9-N4 r exptime 74.0 propid 2014B-0404 seeing 1.09 MJD 58256.097 object DECaLS_35182_r The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9575e24-z-20150409T020920_oi[N13,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9559b49-g-20150417T013512_oi[N13,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950f1c8-r-20170304T045136_oi[N12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f4fa-g-20180513T004425_oi[N4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539fed-g-20190206T062158_oi[N13,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95800b4-z-20150328T031522_oi[N12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9556947-r-20150417T013634_oi[N13,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_957ec43-z-20150329T015717_oi[N4,noinherit][2046,4094][real]: DECaLS_3 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560b38-r-20180518T021934_oi[N4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95102ba-g-20170306T045508_oi[N12,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 45.71 s, CPU: 3.69 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.178496 MB Stage tims finished: 2020-06-25T03:30:42.791771 Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950f1c8-r-20170304T045136_oi[N12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539fed-g-20190206T062158_oi[N13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f4fa-g-20180513T004425_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95800b4-z-20150328T031522_oi[N12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9556947-r-20150417T013634_oi[N13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9559b49-g-20150417T013512_oi[N13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_957ec43-z-20150329T015717_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] Resources for stage tims : 7.021 s worker CPU, 257.542 s worker Wall, Wall: 45.708 s, Cores in use: 0.23, Total efficiency (on 8 cores): 2.9 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95102ba-g-20170306T045508_oi[N12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9575e24-z-20150409T020920_oi[N13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560b38-r-20180518T021934_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] Running stage refs at 2020-06-25T03:30:42.965688 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06139.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06012.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05883.fits Matched 19 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/metrics/cus/reference-custom-167804p01168.fits Stage refs : Wall: 11.58 s, CPU: 8.95 s, VmPeak: 1026 MB, VmSize: 1011 MB, VmRSS: 191 MB, VmData: 223 MB, maxrss: 0.195668 MB Stage refs finished: 2020-06-25T03:30:54.547293 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 11.583 s, Cores in use: 0.77, Total efficiency (on 8 cores): 9.7 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-06-25T03:30:54.765451 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/metrics/cus/outlier-mask-custom-167804p01168.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/metrics/cus/outliers-pre-custom-167804p01168.jpg Image c4d_170306_045851_ooi_g_ls9-N12 g : masking 192 positive outlier pixels and 0 negative outlier pixels Image c4d_190206_062158_ooi_g_ls9-N13 g : masking 358 positive outlier pixels and 0 negative outlier pixels Image c4d_150409_021138_ooi_z_ls9-N13 z : masking 142 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/metrics/cus/outlier-mask-custom-167804p01168.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/metrics/cus/outliers-post-custom-167804p01168.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/metrics/cus/outliers-masked-pos-custom-167804p01168.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/metrics/cus/outliers-masked-neg-custom-167804p01168.jpg Stage outliers : Wall: 3.71 s, CPU: 3.37 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 203 MB, VmData: 234 MB, maxrss: 0.208204 MB Stage outliers finished: 2020-06-25T03:30:58.477639 Resources for stage outliers : 0.622 s worker CPU, 0.630 s worker Wall, Wall: 3.713 s, Cores in use: 1.08, Total efficiency (on 8 cores): 13.4 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-06-25T03:30:58.498118 Stage halos : Wall: 3.38 s, CPU: 2.79 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 204 MB, VmData: 234 MB, maxrss: 0.208588 MB Stage halos finished: 2020-06-25T03:31:01.878604 Resources for stage halos : 0.223 s worker CPU, 1.987 s worker Wall, Wall: 3.382 s, Cores in use: 0.89, Total efficiency (on 8 cores): 11.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-25T03:31:01.966569 PSF sigmas in coadd pixels: ['1.75', '2.64', '1.92', '2.37'] Using average PSF sigma 2.1707897054481395 Gaussian PSF norm 0.12995030843655225 vs pixelized 0.10335576 average tim pixel scale / coadd scale: 1.0010665718053702 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.65', '1.99', '1.78'] Using average PSF sigma 1.8046914250718196 Gaussian PSF norm 0.1563119256039308 vs pixelized 0.13536829 average tim pixel scale / coadd scale: 1.0010808015789636 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.80', '2.06', '1.85'] Using average PSF sigma 1.9028494971912504 Gaussian PSF norm 0.14824860935679432 vs pixelized 0.12741917 average tim pixel scale / coadd scale: 1.0010298143340033 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.15 s, CPU: 0.13 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 205 MB, VmData: 234 MB, maxrss: 0.210016 MB Stage fit_on_coadds finished: 2020-06-25T03:31:02.111604 Resources for stage fit_on_coadds : 0.150 s worker CPU, 0.150 s worker Wall, Wall: 0.146 s, Cores in use: 1.95, Total efficiency (on 8 cores): 24.3 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-06-25T03:31:02.120694 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 11 potential peaks Of 11 potential peaks: 3 in veto map, 0 cut by saddle test, 0 cut by aper test, 8 kept SED z : 8 new peaks Found 14 potential peaks Of 14 potential peaks: 11 in veto map, 0 cut by saddle test, 0 cut by aper test, 3 kept SED r : 3 new peaks Found 16 potential peaks Of 16 potential peaks: 14 in veto map, 0 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 25 potential peaks Of 25 potential peaks: 17 in veto map, 0 cut by saddle test, 0 cut by aper test, 8 kept SED Flat : 8 new peaks Found 23 potential peaks Of 23 potential peaks: 23 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 21 new sources Median coadd sky for g : -3.061327e-06 Median coadd sky for r : -6.198406e-05 Median coadd sky for z : 3.1161457e-05 Stage srcs : Wall: 2.16 s, CPU: 2.06 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 206 MB, VmData: 234 MB, maxrss: 0.21052 MB Stage srcs finished: 2020-06-25T03:31:04.282396 Resources for stage srcs : 0.072 s worker CPU, 0.093 s worker Wall, Wall: 2.163 s, Cores in use: 0.98, Total efficiency (on 8 cores): 12.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-25T03:31:04.292789 Blob 1 of 17, id: 6, sources: 5, size: 91x95, npix 4130, brick X: 81,172, Y: 69,164, one pixel: 124 69 Blob 2 of 17, id: 15, sources: 3, size: 54x46, npix 1692, brick X: 70,124, Y: 199,245, one pixel: 91 199 Blob 3 of 17, id: 1, sources: 2, size: 36x41, npix 971, brick X: 69,105, Y: 14,55, one pixel: 81 14 Blob 4 of 17, id: 13, sources: 1, size: 23x48, npix 825, brick X: 222,245, Y: 190,238, one pixel: 237 190 Blob 5 of 17, id: 14, sources: 1, size: 33x33, npix 706, brick X: 124,157, Y: 191,224, one pixel: 139 191 Blob 6 of 17, id: 7, sources: 1, size: 31x31, npix 626, brick X: 165,196, Y: 85,116, one pixel: 177 85 Blob 7 of 17, id: 9, sources: 1, size: 26x26, npix 419, brick X: 48,74, Y: 148,174, one pixel: 59 148 Blob 8 of 17, id: 3, sources: 1, size: 26x25, npix 389, brick X: 137,163, Y: 36,61, one pixel: 151 36 Blob 9 of 17, id: 5, sources: 1, size: 21x25, npix 304, brick X: 198,219, Y: 62,87, one pixel: 207 62 Blob 8 finished, total: Wall: 0.86 s, CPU: 0.78 s, VmPeak: 1000 MB, VmSize: 783 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.14572 MB Blob 10 of 17, id: 12, sources: 1, size: 23x22, npix 296, brick X: 41,64, Y: 171,193, one pixel: 51 171 Blob 9 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 1000 MB, VmSize: 783 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.14572 MB Blob 11 of 17, id: 4, sources: 1, size: 21x21, npix 278, brick X: 51,72, Y: 62,83, one pixel: 59 62 Blob 5 finished, total: Wall: 1.13 s, CPU: 1.05 s, VmPeak: 1016 MB, VmSize: 782 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143116 MB Blob 12 of 17, id: 8, sources: 1, size: 21x22, npix 271, brick X: 207,228, Y: 89,111, one pixel: 216 89 Blob 6 finished, total: Wall: 1.28 s, CPU: 0.84 s, VmPeak: 1001 MB, VmSize: 783 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144552 MB Blob 13 of 17, id: 2, sources: 1, size: 20x20, npix 237, brick X: 48,68, Y: 20,40, one pixel: 56 20 Blob 10 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 1000 MB, VmSize: 783 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.14572 MB Blob 14 of 17, id: 11, sources: 1, size: 19x20, npix 227, brick X: 21,40, Y: 162,182, one pixel: 29 162 Blob 13 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 1000 MB, VmSize: 783 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.14572 MB Blob 15 of 17, id: 10, sources: 1, size: 15x22, npix 214, brick X: 230,245, Y: 152,174, one pixel: 239 152 Blob 11 finished, total: Wall: 0.25 s, CPU: 0.24 s, VmPeak: 1016 MB, VmSize: 782 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143116 MB Blob 16 of 17, id: 16, sources: 1, size: 19x16, npix 190, brick X: 190,209, Y: 229,245, one pixel: 198 229 Blob 14 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 1000 MB, VmSize: 783 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.14572 MB Blob 17 of 17, id: 0, sources: 1, size: 17x17, npix 145, brick X: 180,197, Y: 9,26, one pixel: 188 9 Blob 7 finished, total: Wall: 1.61 s, CPU: 1.17 s, VmPeak: 997 MB, VmSize: 783 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145412 MB Blob 3 finished, total: Wall: 1.68 s, CPU: 1.60 s, VmPeak: 1026 MB, VmSize: 784 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145836 MB Blob 17 finished, total: Wall: 0.23 s, CPU: 0.21 s, VmPeak: 997 MB, VmSize: 783 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145412 MB Blob 4 finished, total: Wall: 1.99 s, CPU: 1.93 s, VmPeak: 1000 MB, VmSize: 783 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146028 MB Blob 15 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 1016 MB, VmSize: 782 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145116 MB Blob 16 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 1000 MB, VmSize: 783 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.14572 MB Blob 12 finished, total: Wall: 1.05 s, CPU: 0.93 s, VmPeak: 1001 MB, VmSize: 783 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144552 MB Blob 2 finished, total: Wall: 3.66 s, CPU: 2.80 s, VmPeak: 1001 MB, VmSize: 783 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.14602 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.33245, ee1=-0.65547, ee2=0.817517 Measuring 1 iterative sources Blob 1 finished, total: Wall: 4.48 s, CPU: 4.41 s, VmPeak: 1026 MB, VmSize: 784 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147508 MB Old catalog: 26 New catalog: 22 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/metrics/cus/blobs-custom-167804p01168.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/metrics/cus/all-models-custom-167804p01168.fits Stage fitblobs : Wall: 6.12 s, CPU: 1.63 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 203 MB, VmData: 232 MB, maxrss: 0.210536 MB Stage fitblobs finished: 2020-06-25T03:31:10.413654 Resources for stage fitblobs : 18.193 s worker CPU, 21.085 s worker Wall, Wall: 6.122 s, Cores in use: 3.24, Total efficiency (on 8 cores): 40.5 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-06-25T03:31:10.456495 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/tmp-legacysurvey-custom-167804p01168-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/tmp-legacysurvey-custom-167804p01168-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/tmp-legacysurvey-custom-167804p01168-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/tmp-legacysurvey-custom-167804p01168-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-resid.jpg Stage coadds : Wall: 4.69 s, CPU: 2.71 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 204 MB, VmData: 232 MB, maxrss: 0.210536 MB Stage coadds finished: 2020-06-25T03:31:15.151461 Resources for stage coadds : 3.286 s worker CPU, 14.267 s worker Wall, Wall: 4.696 s, Cores in use: 1.28, Total efficiency (on 8 cores): 16.0 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-06-25T03:31:15.165956 Cut to 1 unWISE tiles Reading WISE tile 1678p015 band 1 Reading WISE tile 1678p015 band 2 Reading WISE tile 1678p015 band 3 Reading WISE tile 1678p015 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.19 s, CPU: 0.10 s, VmPeak: 1026 MB, VmSize: 860 MB, VmRSS: 144 MB, VmData: 175 MB, maxrss: 0.208324 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.19 s, CPU: 0.11 s, VmPeak: 997 MB, VmSize: 863 MB, VmRSS: 146 MB, VmData: 178 MB, maxrss: 0.191228 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 1016 MB, VmSize: 860 MB, VmRSS: 145 MB, VmData: 175 MB, maxrss: 0.208992 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 1001 MB, VmSize: 860 MB, VmRSS: 144 MB, VmData: 175 MB, maxrss: 0.20702 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/tmp-legacysurvey-custom-167804p01168-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/tmp-legacysurvey-custom-167804p01168-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.53 s, CPU: 1.67 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 205 MB, VmData: 232 MB, maxrss: 0.210536 MB Stage wise_forced finished: 2020-06-25T03:31:18.700896 Resources for stage wise_forced : 3.449 s worker CPU, 5.198 s worker Wall, Wall: 3.536 s, Cores in use: 1.45, Total efficiency (on 8 cores): 18.1 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-06-25T03:31:18.713908 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/tractor-i/cus/tractor-custom-167804p01168.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/tractor/cus/tractor-custom-167804p01168.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/tractor/cus/brick-custom-167804p01168.sha256sum Stage writecat : Wall: 0.75 s, CPU: 0.59 s, VmPeak: 1151 MB, VmSize: 1023 MB, VmRSS: 207 MB, VmData: 232 MB, maxrss: 0.34264 MB Stage writecat finished: 2020-06-25T03:31:19.460754 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.748 s, Cores in use: 0.79, Total efficiency (on 8 cores): 9.9 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-writecat.p All done: 33.021 s worker CPU, 300.956 s worker Wall, Wall: 82.405 s, Cores in use: 0.74, Total efficiency (on 8 cores): 9.2 % Finished galaxy PGC3284995 in 1.531 minutes. Started working on galaxy PGC3284995 at Thu Jul 23 04:28:02 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.8049535 1.1682798 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-07-23T04:28:05.149427 legacypipe git version: DR9.5.5-21-g66b1aacb Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '167.8049535', '1.1682798', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.8049535 1.1682798 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 167.8049535 1.1682798 Starting process 30074 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 30075 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 30076 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058864 MB Starting process 30077 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059156 MB Starting process 30078 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05916 MB Starting process 30079 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059164 MB Starting process 30080 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 30081 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 30082 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 30083 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 30084 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 30085 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 30086 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 30087 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 30088 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 30089 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-07-23T04:28:06.916628 Keeping 10 CCDs: c4d_150417_013654_ooi_g_ls9.fits.fz c4d_150417_013654_ooi_g_ls9-N13 g exptime 52.0 propid 2014B-0404 seeing 1.08 MJD 57129.066 object DECaLS_3438_g c4d_190206_062158_ooi_g_ls9.fits.fz c4d_190206_062158_ooi_g_ls9-N13 g exptime 130.0 propid 2014B-0404 seeing 1.63 MJD 58520.265 object DECaLS_3438_g c4d_150417_013818_ooi_r_ls9.fits.fz c4d_150417_013818_ooi_r_ls9-N13 r exptime 54.0 propid 2014B-0404 seeing 1.02 MJD 57129.067 object DECaLS_3438_r c4d_150409_021138_ooi_z_ls9.fits.fz c4d_150409_021138_ooi_z_ls9-N13 z exptime 90.0 propid 2014B-0404 seeing 1.11 MJD 57121.090 object DECaLS_3438_z c4d_170306_045851_ooi_g_ls9.fits.fz c4d_170306_045851_ooi_g_ls9-N12 g exptime 175.0 propid 2014B-0404 seeing 1.18 MJD 57818.205 object DECaLS_19310_g c4d_170304_045330_ooi_r_ls9.fits.fz c4d_170304_045330_ooi_r_ls9-N12 r exptime 65.0 propid 2014B-0404 seeing 1.22 MJD 57816.203 object DECaLS_19310_r c4d_150328_031754_ooi_z_ls9.fits.fz c4d_150328_031754_ooi_z_ls9-N12 z exptime 103.0 propid 2014B-0404 seeing 1.27 MJD 57109.136 object DECaLS_19310_z c4d_180513_004425_ooi_g_ls9.fits.fz c4d_180513_004425_ooi_g_ls9-N4 g exptime 200.0 propid 2014B-0404 seeing 1.46 MJD 58251.031 object DECaLS_35182_g c4d_150329_020030_ooi_z_ls9.fits.fz c4d_150329_020030_ooi_z_ls9-N4 z exptime 143.0 propid 2014B-0404 seeing 1.14 MJD 57110.081 object DECaLS_35182_z c4d_180518_021934_ooi_r_ls9.fits.fz c4d_180518_021934_ooi_r_ls9-N4 r exptime 74.0 propid 2014B-0404 seeing 1.09 MJD 58256.097 object DECaLS_35182_r The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9556947-r-20150417T013634_oi[N13,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_957ec43-z-20150329T015717_oi[N4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950f1c8-r-20170304T045136_oi[N12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95102ba-g-20170306T045508_oi[N12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539fed-g-20190206T062158_oi[N13,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95800b4-z-20150328T031522_oi[N12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9575e24-z-20150409T020920_oi[N13,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560b38-r-20180518T021934_oi[N4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9559b49-g-20150417T013512_oi[N13,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f4fa-g-20180513T004425_oi[N4,noinherit][2046,4094][real]: DECaLS_3 Stage tims : Wall: 19.32 s, CPU: 1.52 s, VmPeak: 998 MB, VmSize: 998 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.178364 MB Stage tims finished: 2020-07-23T04:28:26.237291 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9556947-r-20150417T013634_oi[N13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950f1c8-r-20170304T045136_oi[N12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95102ba-g-20170306T045508_oi[N12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95800b4-z-20150328T031522_oi[N12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560b38-r-20180518T021934_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9559b49-g-20150417T013512_oi[N13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 5.645 s worker CPU, 91.196 s worker Wall, Wall: 19.323 s, Cores in use: 0.37, Total efficiency (on 16 cores): 2.3 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f4fa-g-20180513T004425_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_957ec43-z-20150329T015717_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] Running stage refs at 2020-07-23T04:28:26.266795 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06139.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06012.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05883.fits Matched 19 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/metrics/cus/reference-custom-167804p01168.fits Stage refs : Wall: 8.10 s, CPU: 2.78 s, VmPeak: 1029 MB, VmSize: 1014 MB, VmRSS: 191 MB, VmData: 224 MB, maxrss: 0.195076 MB Stage refs finished: 2020-07-23T04:28:34.367063 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539fed-g-20190206T062158_oi[N13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9575e24-z-20150409T020920_oi[N13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 8.102 s, Cores in use: 0.34, Total efficiency (on 16 cores): 2.1 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-07-23T04:28:34.390911 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/metrics/cus/outlier-mask-custom-167804p01168.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/metrics/cus/outliers-pre-custom-167804p01168.jpg Image c4d_190206_062158_ooi_g_ls9-N13 g : masking 358 positive outlier pixels and 0 negative outlier pixels Image c4d_170306_045851_ooi_g_ls9-N12 g : masking 192 positive outlier pixels and 0 negative outlier pixels Image c4d_150409_021138_ooi_z_ls9-N13 z : masking 142 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/metrics/cus/outlier-mask-custom-167804p01168.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/metrics/cus/outliers-post-custom-167804p01168.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/metrics/cus/outliers-masked-pos-custom-167804p01168.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/metrics/cus/outliers-masked-neg-custom-167804p01168.jpg Stage outliers : Wall: 3.25 s, CPU: 0.98 s, VmPeak: 1029 MB, VmSize: 1023 MB, VmRSS: 204 MB, VmData: 235 MB, maxrss: 0.209344 MB Stage outliers finished: 2020-07-23T04:28:37.642503 Resources for stage outliers : 0.648 s worker CPU, 0.713 s worker Wall, Wall: 3.254 s, Cores in use: 0.50, Total efficiency (on 16 cores): 3.1 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-07-23T04:28:37.781613 Stage halos : Wall: 0.93 s, CPU: 0.83 s, VmPeak: 1029 MB, VmSize: 1023 MB, VmRSS: 205 MB, VmData: 235 MB, maxrss: 0.209448 MB Stage halos finished: 2020-07-23T04:28:38.716092 Resources for stage halos : 0.314 s worker CPU, 0.776 s worker Wall, Wall: 0.936 s, Cores in use: 1.23, Total efficiency (on 16 cores): 7.7 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-07-23T04:28:38.743667 PSF sigmas in coadd pixels: ['1.75', '2.64', '1.92', '2.37'] Using average PSF sigma 2.1707897054481395 Gaussian PSF norm 0.12995030843655225 vs pixelized 0.10335576 average tim pixel scale / coadd scale: 1.0010665718053702 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.65', '1.99', '1.78'] Using average PSF sigma 1.8046914250718196 Gaussian PSF norm 0.1563119256039308 vs pixelized 0.13536829 average tim pixel scale / coadd scale: 1.0010808015789636 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.80', '2.06', '1.85'] Using average PSF sigma 1.9028494971912504 Gaussian PSF norm 0.14824860935679432 vs pixelized 0.12741917 average tim pixel scale / coadd scale: 1.0010298143340033 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.15 s, CPU: 0.13 s, VmPeak: 1029 MB, VmSize: 1023 MB, VmRSS: 206 MB, VmData: 235 MB, maxrss: 0.21106 MB Stage fit_on_coadds finished: 2020-07-23T04:28:38.889741 Resources for stage fit_on_coadds : 0.146 s worker CPU, 0.146 s worker Wall, Wall: 0.148 s, Cores in use: 1.91, Total efficiency (on 16 cores): 11.9 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-07-23T04:28:38.900290 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 11 potential peaks Of 11 potential peaks: 3 in veto map, 0 cut by saddle test, 0 cut by aper test, 8 kept SED z : 8 new peaks Found 14 potential peaks Of 14 potential peaks: 11 in veto map, 0 cut by saddle test, 0 cut by aper test, 3 kept SED r : 3 new peaks Found 16 potential peaks Of 16 potential peaks: 14 in veto map, 0 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 25 potential peaks Of 25 potential peaks: 17 in veto map, 0 cut by saddle test, 0 cut by aper test, 8 kept SED Flat : 8 new peaks Found 23 potential peaks Of 23 potential peaks: 23 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 21 new sources Median coadd sky for g : -3.061327e-06 Median coadd sky for r : -6.198406e-05 Median coadd sky for z : 3.116119e-05 Stage srcs : Wall: 0.47 s, CPU: 0.45 s, VmPeak: 1029 MB, VmSize: 1023 MB, VmRSS: 207 MB, VmData: 235 MB, maxrss: 0.21146 MB Stage srcs finished: 2020-07-23T04:28:39.374737 Resources for stage srcs : 0.065 s worker CPU, 0.065 s worker Wall, Wall: 0.476 s, Cores in use: 1.07, Total efficiency (on 16 cores): 6.7 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-07-23T04:28:39.386020 Blob 1 of 17, id: 6, sources: 5, size: 91x95, npix 4130, brick X: 81,172, Y: 69,164, one pixel: 124 69 Blob 2 of 17, id: 15, sources: 3, size: 54x46, npix 1692, brick X: 70,124, Y: 199,245, one pixel: 91 199 Blob 3 of 17, id: 1, sources: 2, size: 36x41, npix 971, brick X: 69,105, Y: 14,55, one pixel: 81 14 Blob 4 of 17, id: 13, sources: 1, size: 23x48, npix 825, brick X: 222,245, Y: 190,238, one pixel: 237 190 Blob 5 of 17, id: 14, sources: 1, size: 33x33, npix 706, brick X: 124,157, Y: 191,224, one pixel: 139 191 Blob 6 of 17, id: 7, sources: 1, size: 31x31, npix 626, brick X: 165,196, Y: 85,116, one pixel: 177 85 Blob 7 of 17, id: 9, sources: 1, size: 26x26, npix 419, brick X: 48,74, Y: 148,174, one pixel: 59 148 Blob 8 of 17, id: 3, sources: 1, size: 26x25, npix 389, brick X: 137,163, Y: 36,61, one pixel: 151 36 Blob 9 of 17, id: 5, sources: 1, size: 21x25, npix 304, brick X: 198,219, Y: 62,87, one pixel: 207 62 Blob 10 of 17, id: 12, sources: 1, size: 23x22, npix 296, brick X: 41,64, Y: 171,193, one pixel: 51 171 Blob 11 of 17, id: 4, sources: 1, size: 21x21, npix 278, brick X: 51,72, Y: 62,83, one pixel: 59 62 Blob 12 of 17, id: 8, sources: 1, size: 21x22, npix 271, brick X: 207,228, Y: 89,111, one pixel: 216 89 Blob 13 of 17, id: 2, sources: 1, size: 20x20, npix 237, brick X: 48,68, Y: 20,40, one pixel: 56 20 Blob 14 of 17, id: 11, sources: 1, size: 19x20, npix 227, brick X: 21,40, Y: 162,182, one pixel: 29 162 Blob 15 of 17, id: 10, sources: 1, size: 15x22, npix 214, brick X: 230,245, Y: 152,174, one pixel: 239 152 Blob 16 of 17, id: 16, sources: 1, size: 19x16, npix 190, brick X: 190,209, Y: 229,245, one pixel: 198 229 Blob 17 of 17, id: 0, sources: 1, size: 17x17, npix 145, brick X: 180,197, Y: 9,26, one pixel: 188 9 Blob 14 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 686 MB, VmSize: 686 MB, VmRSS: 104 MB, VmData: 164 MB, maxrss: 0.106864 MB Blob 13 finished, total: Wall: 0.08 s, CPU: 0.06 s, VmPeak: 936 MB, VmSize: 720 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143 MB Blob 9 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 688 MB, VmSize: 688 MB, VmRSS: 108 MB, VmData: 166 MB, maxrss: 0.110408 MB Blob 11 finished, total: Wall: 0.30 s, CPU: 0.28 s, VmPeak: 662 MB, VmSize: 662 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.094828 MB Blob 17 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 686 MB, VmSize: 686 MB, VmRSS: 107 MB, VmData: 164 MB, maxrss: 0.110012 MB Blob 10 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 931 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14516 MB Blob 16 finished, total: Wall: 0.61 s, CPU: 0.59 s, VmPeak: 937 MB, VmSize: 720 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143008 MB Blob 8 finished, total: Wall: 0.64 s, CPU: 0.63 s, VmPeak: 688 MB, VmSize: 688 MB, VmRSS: 112 MB, VmData: 166 MB, maxrss: 0.115184 MB Blob 6 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 662 MB, VmSize: 662 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.094312 MB Blob 15 finished, total: Wall: 0.80 s, CPU: 0.79 s, VmPeak: 937 MB, VmSize: 720 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.142976 MB Blob 12 finished, total: Wall: 0.85 s, CPU: 0.83 s, VmPeak: 937 MB, VmSize: 720 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143252 MB Blob 5 finished, total: Wall: 0.86 s, CPU: 0.85 s, VmPeak: 937 MB, VmSize: 720 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143828 MB Blob 7 finished, total: Wall: 1.12 s, CPU: 1.11 s, VmPeak: 933 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.1449 MB Blob 3 finished, total: Wall: 1.37 s, CPU: 1.36 s, VmPeak: 937 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14536 MB Blob 4 finished, total: Wall: 2.08 s, CPU: 2.08 s, VmPeak: 953 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146256 MB Blob 2 finished, total: Wall: 2.73 s, CPU: 2.72 s, VmPeak: 687 MB, VmSize: 687 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.114748 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.33245, ee1=-0.65547, ee2=0.817517 Measuring 1 iterative sources Blob 1 finished, total: Wall: 3.74 s, CPU: 3.73 s, VmPeak: 952 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147312 MB Old catalog: 27 New catalog: 22 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/metrics/cus/blobs-custom-167804p01168.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/metrics/cus/all-models-custom-167804p01168.fits Stage fitblobs : Wall: 4.26 s, CPU: 0.50 s, VmPeak: 1029 MB, VmSize: 1023 MB, VmRSS: 207 MB, VmData: 235 MB, maxrss: 0.211576 MB Stage fitblobs finished: 2020-07-23T04:28:43.648061 Resources for stage fitblobs : 16.757 s worker CPU, 17.349 s worker Wall, Wall: 4.264 s, Cores in use: 4.05, Total efficiency (on 16 cores): 25.3 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-07-23T04:28:43.660116 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/tmp-legacysurvey-custom-167804p01168-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/tmp-legacysurvey-custom-167804p01168-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/tmp-legacysurvey-custom-167804p01168-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/tmp-legacysurvey-custom-167804p01168-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-resid.jpg Stage coadds : Wall: 1.74 s, CPU: 0.53 s, VmPeak: 1029 MB, VmSize: 1023 MB, VmRSS: 207 MB, VmData: 235 MB, maxrss: 0.212228 MB Stage coadds finished: 2020-07-23T04:28:45.396572 Resources for stage coadds : 10.233 s worker CPU, 12.037 s worker Wall, Wall: 1.738 s, Cores in use: 6.20, Total efficiency (on 16 cores): 38.7 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-07-23T04:28:45.409597 Cut to 1 unWISE tiles Reading WISE tile 1678p015 band 2 Reading WISE tile 1678p015 band 3 Reading WISE tile 1678p015 band 1 Reading WISE tile 1678p015 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 931 MB, VmSize: 798 MB, VmRSS: 147 MB, VmData: 175 MB, maxrss: 0.194404 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 937 MB, VmSize: 797 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.20798 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 937 MB, VmSize: 797 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.207744 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678p015/unwise-1678p015-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 936 MB, VmSize: 797 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.208932 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/tmp-legacysurvey-custom-167804p01168-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/tmp-legacysurvey-custom-167804p01168-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.61 s, CPU: 0.81 s, VmPeak: 1029 MB, VmSize: 1023 MB, VmRSS: 208 MB, VmData: 235 MB, maxrss: 0.212932 MB Stage wise_forced finished: 2020-07-23T04:28:49.016156 Resources for stage wise_forced : 2.937 s worker CPU, 7.217 s worker Wall, Wall: 3.608 s, Cores in use: 1.04, Total efficiency (on 16 cores): 6.5 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-07-23T04:28:49.031855 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/coadd/cus/custom-167804p01168/legacysurvey-custom-167804p01168-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/tractor-i/cus/tractor-custom-167804p01168.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/tractor/cus/tractor-custom-167804p01168.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/tractor/cus/brick-custom-167804p01168.sha256sum Stage writecat : Wall: 0.76 s, CPU: 0.52 s, VmPeak: 1155 MB, VmSize: 1027 MB, VmRSS: 210 MB, VmData: 235 MB, maxrss: 0.345804 MB Stage writecat finished: 2020-07-23T04:28:49.792824 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.763 s, Cores in use: 0.69, Total efficiency (on 16 cores): 4.3 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC3284995/PGC3284995-largegalaxy-writecat.p All done: 36.748 s worker CPU, 129.503 s worker Wall, Wall: 42.900 s, Cores in use: 1.07, Total efficiency (on 16 cores): 6.7 % Finished galaxy PGC3284995 in 0.789 minutes.