Started working on galaxy PGC3091675 at Sun Jun 7 04:51:11 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 36.569166 7.5945833 --width 237 --height 237 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/PGC3091675-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/PGC3091675-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T04:51:12.962470 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '36.569166', '7.5945833', '--width', '237', '--height', '237', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/PGC3091675-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/PGC3091675-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 36.569166 7.5945833 --width 237 --height 237 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/PGC3091675-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/PGC3091675-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 36.569166 7.5945833 Starting process 49491 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 49492 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 49493 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 49494 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T04:51:17.470800 Keeping 15 CCDs: c4d_170920_083330_ooi_g_ls9.fits.fz c4d_170920_083330_ooi_g_ls9-N14 g exptime 200.0 propid 2014B-0404 seeing 1.44 MJD 58016.357 object DECaLS_26292_g c4d_171025_062307_ooi_r_ls9.fits.fz c4d_171025_062307_ooi_r_ls9-N14 r exptime 73.0 propid 2014B-0404 seeing 1.16 MJD 58051.266 object DECaLS_26292_r c4d_160724_095306_ooi_z_ls9.fits.fz c4d_160724_095306_ooi_z_ls9-N14 z exptime 202.0 propid 2016A-0190 seeing 1.15 MJD 57593.409 object DECaLS_26292_z c4d_181003_050948_ooi_g_ls9.fits.fz c4d_181003_050948_ooi_g_ls9-N18 g exptime 118.0 propid 2014B-0404 seeing 1.10 MJD 58394.215 object DECaLS_42181_g c4d_180904_090727_ooi_z_ls9.fits.fz c4d_180904_090727_ooi_z_ls9-N18 z exptime 92.0 propid 2014B-0404 seeing 1.20 MJD 58365.380 object DECaLS_42181_z c4d_181003_045940_ooi_r_ls9.fits.fz c4d_181003_045940_ooi_r_ls9-N18 r exptime 139.0 propid 2014B-0404 seeing 1.14 MJD 58394.208 object DECaLS_42181_r c4d_181114_041047_ooi_z_ls9.fits.fz c4d_181114_041047_ooi_z_ls9-N18 z exptime 175.0 propid 2014B-0404 seeing 1.82 MJD 58436.174 object DECaLS_42181_z c4d_181113_045102_ooi_g_ls9.fits.fz c4d_181113_045102_ooi_g_ls9-N18 g exptime 200.0 propid 2014B-0404 seeing 1.99 MJD 58435.202 object DECaLS_42181_g c4d_180811_082920_ooi_g_ls9.fits.fz c4d_180811_082920_ooi_g_ls9-N19 g exptime 113.0 propid 2014B-0404 seeing 1.52 MJD 58341.354 object DECaLS_26309_g c4d_180810_083122_ooi_r_ls9.fits.fz c4d_180810_083122_ooi_r_ls9-N19 r exptime 50.0 propid 2014B-0404 seeing 1.22 MJD 58340.355 object DECaLS_26309_r c4d_160724_093837_ooi_z_ls9.fits.fz c4d_160724_093837_ooi_z_ls9-N19 z exptime 102.0 propid 2016A-0190 seeing 1.01 MJD 57593.400 object DECaLS_26309_z c4d_181002_065619_ooi_z_ls9.fits.fz c4d_181002_065619_ooi_z_ls9-N19 z exptime 80.0 propid 2014B-0404 seeing 1.01 MJD 58393.289 object DECaLS_26309_z c4d_171111_042310_ooi_r_ls9.fits.fz c4d_171111_042310_ooi_r_ls9-N15 r exptime 80.0 propid 2014B-0404 seeing 1.06 MJD 58068.183 object DECaLS_10420_r c4d_160722_100559_ooi_z_ls9.fits.fz c4d_160722_100559_ooi_z_ls9-N15 z exptime 80.0 propid 2016A-0190 seeing 0.93 MJD 57591.419 object DECaLS_10420_z c4d_171112_041832_ooi_g_ls9.fits.fz c4d_171112_041832_ooi_g_ls9-N15 g exptime 146.0 propid 2014B-0404 seeing 1.16 MJD 58069.180 object DECaLS_10420_g The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95264c6-r-20171025T062307_oi[N14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9524a76-g-20170920T083330_oi[N14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b0ee-z-20160724T094854_oi[N14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536cb0-g-20181003T050948_oi[N18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533681-z-20181114T041047_oi[N18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953651d-r-20181003T045940_oi[N18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532e22-g-20180811T082920_oi[N19,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9531ac3-r-20180810T083122_oi[N19,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b0ee-z-20160724T093600_oi[N19,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180904T090727_oi[N18,noinherit][2046,4094][real]: DECaLS_4218 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538e4d-g-20181113T045102_oi[N18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b7a0-z-20160722T100351_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9526fce-r-20171111T042310_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952733c-g-20171112T041832_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953057e-z-20181002T065619_oi[N19,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 165.12 s, CPU: 7.03 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 178 MB, VmData: 211 MB, maxrss: 0.45468 MB Stage tims finished: 2020-06-07T04:54:02.593392 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95264c6-r-20171025T062307_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180904T090727_oi[N18,noinherit][2046,4094][real]: DECaLS_4218 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b7a0-z-20160722T100351_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b0ee-z-20160724T094854_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533681-z-20181114T041047_oi[N18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532e22-g-20180811T082920_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b0ee-z-20160724T093600_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9526fce-r-20171111T042310_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536cb0-g-20181003T050948_oi[N18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538e4d-g-20181113T045102_oi[N18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952733c-g-20171112T041832_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9524a76-g-20170920T083330_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953651d-r-20181003T045940_oi[N18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9531ac3-r-20180810T083122_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953057e-z-20181002T065619_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 5.443 s worker CPU, 595.004 s worker Wall, Wall: 165.124 s, Cores in use: 0.08, Total efficiency (on 4 cores): 1.9 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/PGC3091675-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/PGC3091675-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T04:54:03.154489 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05197.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05324.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05453.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05325.fits Matched 4 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/metrics/cus/reference-custom-036569p07594.fits Stage refs : Wall: 3.24 s, CPU: 2.11 s, VmPeak: 1027 MB, VmSize: 1007 MB, VmRSS: 190 MB, VmData: 223 MB, maxrss: 0.45468 MB Stage refs finished: 2020-06-07T04:54:06.393871 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.240 s, Cores in use: 0.65, Total efficiency (on 4 cores): 16.3 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T04:54:06.395313 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/metrics/cus/outlier-mask-custom-036569p07594.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/metrics/cus/outliers-pre-custom-036569p07594.jpg Image c4d_181003_050948_ooi_g_ls9-N18 g : masking 1789 positive outlier pixels and 0 negative outlier pixels Image c4d_171112_041832_ooi_g_ls9-N15 g : masking 139 positive outlier pixels and 0 negative outlier pixels Image c4d_171111_042310_ooi_r_ls9-N15 r : masking 397 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/metrics/cus/outlier-mask-custom-036569p07594.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/metrics/cus/outliers-post-custom-036569p07594.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/metrics/cus/outliers-masked-pos-custom-036569p07594.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/metrics/cus/outliers-masked-neg-custom-036569p07594.jpg Stage outliers : Wall: 1.68 s, CPU: 1.44 s, VmPeak: 1027 MB, VmSize: 1017 MB, VmRSS: 203 MB, VmData: 233 MB, maxrss: 0.45468 MB Stage outliers finished: 2020-06-07T04:54:08.077125 Resources for stage outliers : 0.990 s worker CPU, 1.035 s worker Wall, Wall: 1.683 s, Cores in use: 1.44, Total efficiency (on 4 cores): 36.1 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T04:54:08.078688 Stage halos : Wall: 1.40 s, CPU: 1.40 s, VmPeak: 1027 MB, VmSize: 1017 MB, VmRSS: 203 MB, VmData: 233 MB, maxrss: 0.45468 MB Stage halos finished: 2020-06-07T04:54:09.478391 Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.401 s, Cores in use: 1.00, Total efficiency (on 4 cores): 25.0 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T04:54:09.480022 PSF sigmas in coadd pixels: ['2.34', '1.79', '3.23', '2.47', '1.89'] Using average PSF sigma 2.343982420902955 Gaussian PSF norm 0.12034850997952827 vs pixelized 0.103043325 average tim pixel scale / coadd scale: 1.001155089661621 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.89', '1.85', '1.97', '1.72'] Using average PSF sigma 1.858696797934446 Gaussian PSF norm 0.15177020377253983 vs pixelized 0.13372442 average tim pixel scale / coadd scale: 1.0011764943070056 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.86', '1.95', '2.96', '1.64', '1.64', '1.51'] Using average PSF sigma 1.9278190606155867 Gaussian PSF norm 0.14632845869041272 vs pixelized 0.11884087 average tim pixel scale / coadd scale: 1.0011374540733642 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.23 s, CPU: 0.21 s, VmPeak: 1027 MB, VmSize: 1017 MB, VmRSS: 204 MB, VmData: 233 MB, maxrss: 0.45468 MB Stage fit_on_coadds finished: 2020-06-07T04:54:09.713841 Resources for stage fit_on_coadds : 0.234 s worker CPU, 0.242 s worker Wall, Wall: 0.235 s, Cores in use: 1.90, Total efficiency (on 4 cores): 47.6 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T04:54:09.716827 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 84 potential peaks Of 84 potential peaks: 66 in veto map, 6 cut by saddle test, 0 cut by aper test, 12 kept SED z : 12 new peaks Found 83 potential peaks Of 83 potential peaks: 77 in veto map, 6 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 62 potential peaks Of 62 potential peaks: 55 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 92 potential peaks Of 92 potential peaks: 86 in veto map, 6 cut by saddle test, 0 cut by aper test, 0 kept SED Flat : 0 new peaks Found 109 potential peaks Of 109 potential peaks: 99 in veto map, 8 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 17 new sources Median coadd sky for g : 0.0003515565 Median coadd sky for r : 0.00072244124 Median coadd sky for z : 0.0012379873 Stage srcs : Wall: 1.34 s, CPU: 1.30 s, VmPeak: 1027 MB, VmSize: 1017 MB, VmRSS: 205 MB, VmData: 233 MB, maxrss: 0.45468 MB Stage srcs finished: 2020-06-07T04:54:11.055260 Resources for stage srcs : 0.084 s worker CPU, 0.086 s worker Wall, Wall: 1.339 s, Cores in use: 1.03, Total efficiency (on 4 cores): 25.8 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/PGC3091675-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/PGC3091675-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T04:54:11.064980 Blob 1 of 4, id: 0, sources: 15, size: 237x237, npix 38541, brick X: 0,237, Y: 0,237, one pixel: 28 0 Blob 2 of 4, id: 2, sources: 1, size: 22x37, npix 598, brick X: 0,22, Y: 22,59, one pixel: 7 22 Blob 3 of 4, id: 1, sources: 1, size: 25x24, npix 388, brick X: 160,185, Y: 7,31, one pixel: 171 7 Blob 4 of 4, id: 3, sources: 1, size: 18x22, npix 256, brick X: 219,237, Y: 51,73, one pixel: 228 51 Blob 4 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.14512 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 0.83 s, CPU: 0.83 s, VmPeak: 964 MB, VmSize: 720 MB, VmRSS: 141 MB, VmData: 183 MB, maxrss: 0.144852 MB Blob 2 finished, total: Wall: 1.36 s, CPU: 1.36 s, VmPeak: 965 MB, VmSize: 720 MB, VmRSS: 141 MB, VmData: 183 MB, maxrss: 0.14474 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.25426, ee1=-0.153092, ee2=-0.0482744 Measuring 25 iterative sources Blob 1 finished, total: Wall: 27.50 s, CPU: 27.50 s, VmPeak: 962 MB, VmSize: 728 MB, VmRSS: 159 MB, VmData: 191 MB, maxrss: 0.162668 MB Old catalog: 18 New catalog: 39 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/metrics/cus/blobs-custom-036569p07594.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/metrics/cus/all-models-custom-036569p07594.fits Stage fitblobs : Wall: 28.71 s, CPU: 1.09 s, VmPeak: 1027 MB, VmSize: 1017 MB, VmRSS: 206 MB, VmData: 234 MB, maxrss: 0.45468 MB Stage fitblobs finished: 2020-06-07T04:54:39.771639 Resources for stage fitblobs : 30.299 s worker CPU, 30.312 s worker Wall, Wall: 28.708 s, Cores in use: 1.09, Total efficiency (on 4 cores): 27.3 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T04:54:39.773339 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/tmp-legacysurvey-custom-036569p07594-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/tmp-legacysurvey-custom-036569p07594-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/tmp-legacysurvey-custom-036569p07594-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/tmp-legacysurvey-custom-036569p07594-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-resid.jpg Stage coadds : Wall: 8.10 s, CPU: 7.10 s, VmPeak: 1027 MB, VmSize: 1017 MB, VmRSS: 207 MB, VmData: 234 MB, maxrss: 0.45468 MB Stage coadds finished: 2020-06-07T04:54:47.873028 Resources for stage coadds : 2.399 s worker CPU, 2.486 s worker Wall, Wall: 8.101 s, Cores in use: 1.17, Total efficiency (on 4 cores): 29.3 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T04:54:47.874325 Cut to 1 unWISE tiles Reading WISE tile 0366p075 band 1 Reading WISE tile 0366p075 band 2 Reading WISE tile 0366p075 band 4 Reading WISE tile 0366p075 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0366p075/unwise-0366p075-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/036/0366p075/unwise-0366p075-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/036/0366p075/unwise-0366p075-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/036/0366p075/unwise-0366p075-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/036/0366p075/unwise-0366p075-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 962 MB, VmSize: 802 MB, VmRSS: 156 MB, VmData: 180 MB, maxrss: 0.22068 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0366p075/unwise-0366p075-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0366p075/unwise-0366p075-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0366p075/unwise-0366p075-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0366p075/unwise-0366p075-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 962 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210208 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0366p075/unwise-0366p075-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0366p075/unwise-0366p075-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0366p075/unwise-0366p075-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0366p075/unwise-0366p075-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 964 MB, VmSize: 796 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210064 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0366p075/unwise-0366p075-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/036/0366p075/unwise-0366p075-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/036/0366p075/unwise-0366p075-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/036/0366p075/unwise-0366p075-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/036/0366p075/unwise-0366p075-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 965 MB, VmSize: 798 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.190716 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/tmp-legacysurvey-custom-036569p07594-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/tmp-legacysurvey-custom-036569p07594-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 13.89 s, CPU: 5.68 s, VmPeak: 1027 MB, VmSize: 1017 MB, VmRSS: 208 MB, VmData: 234 MB, maxrss: 0.45468 MB Stage wise_forced finished: 2020-06-07T04:55:01.762923 Resources for stage wise_forced : 2.877 s worker CPU, 22.495 s worker Wall, Wall: 13.890 s, Cores in use: 0.62, Total efficiency (on 4 cores): 15.4 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T04:55:01.764448 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/coadd/cus/custom-036569p07594/legacysurvey-custom-036569p07594-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/tractor-i/cus/tractor-custom-036569p07594.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/tractor/cus/tractor-custom-036569p07594.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC3091675/tractor/cus/brick-custom-036569p07594.sha256sum Stage writecat : Wall: 5.85 s, CPU: 2.29 s, VmPeak: 1149 MB, VmSize: 1021 MB, VmRSS: 210 MB, VmData: 234 MB, maxrss: 0.45468 MB Stage writecat finished: 2020-06-07T04:55:07.610692 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.847 s, Cores in use: 0.39, Total efficiency (on 4 cores): 9.8 % Stage writecat finished All done: 42.327 s worker CPU, 651.660 s worker Wall, Wall: 230.144 s, Cores in use: 0.31, Total efficiency (on 4 cores): 7.8 % Finished galaxy PGC3091675 in 3.938 minutes.