Started working on galaxy PGC1457708 at Sun Jun 7 15:50:27 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 128.171385 14.423288699999999 --width 239 --height 239 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/PGC1457708-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/PGC1457708-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T15:50:27.921890 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '128.171385', '14.423288699999999', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/PGC1457708-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/PGC1457708-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 128.171385 14.423288699999999 --width 239 --height 239 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/PGC1457708-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/PGC1457708-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 128.171385 14.423288699999999 Starting process 16658 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 16659 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 16660 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 16661 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T15:50:34.195156 Keeping 14 CCDs: c4d_181212_054059_ooi_g_ls9.fits.fz c4d_181212_054059_ooi_g_ls9-S29 g exptime 149.0 propid 2014B-0404 seeing 1.35 MJD 58464.237 object DECaLS_42401_g c4d_180224_012446_ooi_z_ls9.fits.fz c4d_180224_012446_ooi_z_ls9-S29 z exptime 85.0 propid 2014B-0404 seeing 1.03 MJD 58173.059 object DECaLS_42401_z c4d_181211_054251_ooi_r_ls9.fits.fz c4d_181211_054251_ooi_r_ls9-S29 r exptime 79.0 propid 2014B-0404 seeing 1.37 MJD 58463.238 object DECaLS_42401_r c4d_190306_004009_ooi_g_ls9.fits.fz c4d_190306_004009_ooi_g_ls9-S30 g exptime 75.0 propid 2014B-0404 seeing 1.62 MJD 58548.028 object DECaLS_26529_g c4d_180207_052915_ooi_z_ls9.fits.fz c4d_180207_052915_ooi_z_ls9-S30 z exptime 113.0 propid 2014B-0404 seeing 0.79 MJD 58156.229 object DECaLS_26529_z c4d_160111_060145_ooi_g_ls9.fits.fz c4d_160111_060145_ooi_g_ls9-S27 g exptime 92.0 propid 2014B-0404 seeing 1.08 MJD 57398.250 object DECaLS_10657_g c4d_160111_060310_ooi_r_ls9.fits.fz c4d_160111_060310_ooi_r_ls9-S27 r exptime 55.0 propid 2014B-0404 seeing 0.87 MJD 57398.251 object DECaLS_10657_r c4d_161221_075120_ooi_z_ls9.fits.fz c4d_161221_075120_ooi_z_ls9-S27 z exptime 80.0 propid 2014B-0404 seeing 0.82 MJD 57743.326 object DECaLS_10657_z c4d_160115_052828_ooi_r_ls9.fits.fz c4d_160115_052828_ooi_r_ls9-N25 r exptime 43.0 propid 2014B-0404 seeing 0.92 MJD 57402.227 object DECaLS_10672_r c4d_160115_052716_ooi_g_ls9.fits.fz c4d_160115_052716_ooi_g_ls9-N25 g exptime 79.0 propid 2014B-0404 seeing 1.06 MJD 57402.226 object DECaLS_10672_g c4d_160301_041607_ooi_z_ls9.fits.fz c4d_160301_041607_ooi_z_ls9-N25 z exptime 90.0 propid 2014B-0404 seeing 1.14 MJD 57448.176 object DECaLS_10672_z c4d_181213_051145_ooi_g_ls9.fits.fz c4d_181213_051145_ooi_g_ls9-N19 g exptime 125.0 propid 2014B-0404 seeing 1.40 MJD 58465.216 object DECaLS_42417_g c4d_181213_051423_ooi_r_ls9.fits.fz c4d_181213_051423_ooi_r_ls9-N19 r exptime 53.0 propid 2014B-0404 seeing 1.19 MJD 58465.218 object DECaLS_42417_r c4d_181212_081601_ooi_z_ls9.fits.fz c4d_181212_081601_ooi_z_ls9-N19 z exptime 164.0 propid 2014B-0404 seeing 1.06 MJD 58464.344 object DECaLS_42417_z The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953a368-g-20190306T004009_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539519-g-20181212T054059_oi[S29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95260c6-z-20180207T052915_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9575b52-g-20160111T055923_oi[S27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95280e6-z-20180224T012446_oi[S29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9542040-z-20161221T074909_oi[S27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_957a553-r-20160111T060124_oi[S27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9576b40-r-20160115T052654_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538963-r-20181211T054251_oi[S29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956fd6c-g-20160115T052506_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954eeb9-z-20160301T041349_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953988f-g-20181213T051145_oi[N19,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538cf2-r-20181213T051423_oi[N19,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533681-z-20181212T081601_oi[N19,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 98.74 s, CPU: 6.23 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 177 MB, VmData: 210 MB, maxrss: 0.454636 MB Stage tims finished: 2020-06-07T15:52:12.932813 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953a368-g-20190306T004009_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95260c6-z-20180207T052915_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_957a553-r-20160111T060124_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954eeb9-z-20160301T041349_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95280e6-z-20180224T012446_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9576b40-r-20160115T052654_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953988f-g-20181213T051145_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538963-r-20181211T054251_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538cf2-r-20181213T051423_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 4.880 s worker CPU, 342.873 s worker Wall, Wall: 98.739 s, Cores in use: 0.11, Total efficiency (on 4 cores): 2.8 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/PGC1457708-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/PGC1457708-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539519-g-20181212T054059_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9575b52-g-20160111T055923_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9542040-z-20161221T074909_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956fd6c-g-20160115T052506_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533681-z-20181212T081601_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-06-07T15:52:13.016716 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04589.fits Matched 2 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/metrics/cus/reference-custom-128171p14423.fits Stage refs : Wall: 8.65 s, CPU: 8.28 s, VmPeak: 1027 MB, VmSize: 1020 MB, VmRSS: 202 MB, VmData: 234 MB, maxrss: 0.454636 MB Stage refs finished: 2020-06-07T15:52:21.662670 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.647 s, Cores in use: 0.96, Total efficiency (on 4 cores): 23.9 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T15:52:21.664189 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/metrics/cus/outlier-mask-custom-128171p14423.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/metrics/cus/outliers-pre-custom-128171p14423.jpg Image c4d_181213_051145_ooi_g_ls9-N19 g : masking 93 positive outlier pixels and 0 negative outlier pixels Image c4d_181211_054251_ooi_r_ls9-S29 r : masking 439 positive outlier pixels and 0 negative outlier pixels Image c4d_160301_041607_ooi_z_ls9-N25 z : masking 165 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/metrics/cus/outlier-mask-custom-128171p14423.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/metrics/cus/outliers-post-custom-128171p14423.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/metrics/cus/outliers-masked-pos-custom-128171p14423.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/metrics/cus/outliers-masked-neg-custom-128171p14423.jpg Stage outliers : Wall: 7.14 s, CPU: 6.33 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 215 MB, VmData: 245 MB, maxrss: 0.454636 MB Stage outliers finished: 2020-06-07T15:52:28.807865 Resources for stage outliers : 1.063 s worker CPU, 1.070 s worker Wall, Wall: 7.145 s, Cores in use: 1.03, Total efficiency (on 4 cores): 25.9 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T15:52:28.809751 Stage halos : Wall: 7.47 s, CPU: 4.41 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 215 MB, VmData: 245 MB, maxrss: 0.454636 MB Stage halos finished: 2020-06-07T15:52:36.278818 Resources for stage halos : 0.151 s worker CPU, 10.767 s worker Wall, Wall: 7.470 s, Cores in use: 0.61, Total efficiency (on 4 cores): 15.3 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T15:52:36.280857 PSF sigmas in coadd pixels: ['2.19', '2.63', '1.76', '1.72', '2.27'] Using average PSF sigma 2.1120746826252432 Gaussian PSF norm 0.13356288681195833 vs pixelized 0.11823826 average tim pixel scale / coadd scale: 1.0012322903489907 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.23', '1.42', '1.50', '1.93'] Using average PSF sigma 1.7713969216067191 Gaussian PSF norm 0.15924990516411663 vs pixelized 0.13134742 average tim pixel scale / coadd scale: 1.0012727452287422 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.67', '1.28', '1.34', '1.85', '1.73'] Using average PSF sigma 1.5728698162624373 Gaussian PSF norm 0.17935037525496642 vs pixelized 0.14666732 average tim pixel scale / coadd scale: 1.0011208382300065 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.25 s, CPU: 0.22 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 218 MB, VmData: 247 MB, maxrss: 0.454636 MB Stage fit_on_coadds finished: 2020-06-07T15:52:36.526742 Resources for stage fit_on_coadds : 0.221 s worker CPU, 0.221 s worker Wall, Wall: 0.247 s, Cores in use: 1.78, Total efficiency (on 4 cores): 44.5 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T15:52:36.529930 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 117 potential peaks Of 117 potential peaks: 93 in veto map, 8 cut by saddle test, 0 cut by aper test, 16 kept SED z : 16 new peaks Found 112 potential peaks Of 112 potential peaks: 100 in veto map, 8 cut by saddle test, 0 cut by aper test, 4 kept SED r : 4 new peaks Found 85 potential peaks Of 85 potential peaks: 77 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 130 potential peaks Of 130 potential peaks: 118 in veto map, 9 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 168 potential peaks Of 168 potential peaks: 153 in veto map, 13 cut by saddle test, 2 cut by aper test, 0 kept SED Red : 0 new peaks Adding 25 new sources Median coadd sky for g : 0.00025964982 Median coadd sky for r : 0.0006277021 Median coadd sky for z : 0.0015852728 Stage srcs : Wall: 5.13 s, CPU: 5.08 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 218 MB, VmData: 247 MB, maxrss: 0.454636 MB Stage srcs finished: 2020-06-07T15:52:41.657756 Resources for stage srcs : 0.096 s worker CPU, 0.096 s worker Wall, Wall: 5.129 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.2 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/PGC1457708-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/PGC1457708-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T15:52:41.669159 Blob 1 of 8, id: 3, sources: 21, size: 239x214, npix 34384, brick X: 0,239, Y: 13,227, one pixel: 97 13 Blob 2 of 8, id: 1, sources: 1, size: 27x25, npix 429, brick X: 145,172, Y: 4,29, one pixel: 155 4 Blob 3 of 8, id: 5, sources: 1, size: 23x24, npix 339, brick X: 215,238, Y: 187,211, one pixel: 224 187 Blob 4 of 8, id: 0, sources: 1, size: 24x21, npix 302, brick X: 65,89, Y: 1,22, one pixel: 76 1 Blob 5 of 8, id: 6, sources: 1, size: 22x23, npix 296, brick X: 192,214, Y: 208,231, one pixel: 202 208 Blob 2 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 141 MB, VmData: 183 MB, maxrss: 0.144716 MB Blob 6 of 8, id: 2, sources: 1, size: 22x22, npix 279, brick X: 25,47, Y: 7,29, one pixel: 36 7 Blob 3 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 967 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.144972 MB Blob 7 of 8, id: 7, sources: 1, size: 24x15, npix 257, brick X: 161,185, Y: 224,239, one pixel: 171 224 Blob 5 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 141 MB, VmData: 183 MB, maxrss: 0.144716 MB Blob 8 of 8, id: 4, sources: 1, size: 14x23, npix 215, brick X: 0,14, Y: 36,59, one pixel: 3 36 Blob 4 finished, total: Wall: 1.23 s, CPU: 1.23 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 141 MB, VmData: 183 MB, maxrss: 0.14444 MB Blob 6 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 967 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.144972 MB Blob 7 finished, total: Wall: 1.08 s, CPU: 1.08 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 141 MB, VmData: 183 MB, maxrss: 0.144716 MB Blob 8 finished, total: Wall: 1.11 s, CPU: 1.11 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 141 MB, VmData: 183 MB, maxrss: 0.14444 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.1867, ee1=-0.105984, ee2=-0.069562 Measuring 12 iterative sources Blob 1 finished, total: Wall: 29.59 s, CPU: 29.59 s, VmPeak: 961 MB, VmSize: 725 MB, VmRSS: 155 MB, VmData: 188 MB, maxrss: 0.159084 MB Old catalog: 29 New catalog: 36 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/metrics/cus/blobs-custom-128171p14423.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/metrics/cus/all-models-custom-128171p14423.fits Stage fitblobs : Wall: 33.89 s, CPU: 4.26 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 220 MB, VmData: 247 MB, maxrss: 0.454636 MB Stage fitblobs finished: 2020-06-07T15:53:15.563998 Resources for stage fitblobs : 35.780 s worker CPU, 35.815 s worker Wall, Wall: 33.896 s, Cores in use: 1.18, Total efficiency (on 4 cores): 29.5 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T15:53:15.565884 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/tmp-legacysurvey-custom-128171p14423-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/tmp-legacysurvey-custom-128171p14423-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/tmp-legacysurvey-custom-128171p14423-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/tmp-legacysurvey-custom-128171p14423-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-resid.jpg Stage coadds : Wall: 2.91 s, CPU: 2.06 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 220 MB, VmData: 247 MB, maxrss: 0.454636 MB Stage coadds finished: 2020-06-07T15:53:18.479867 Resources for stage coadds : 2.612 s worker CPU, 2.723 s worker Wall, Wall: 2.915 s, Cores in use: 1.60, Total efficiency (on 4 cores): 40.1 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T15:53:18.481309 Cut to 1 unWISE tiles Reading WISE tile 1283p151 band 2 Reading WISE tile 1283p151 band 3 Reading WISE tile 1283p151 band 1 Reading WISE tile 1283p151 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1283p151/unwise-1283p151-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1283p151/unwise-1283p151-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1283p151/unwise-1283p151-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1283p151/unwise-1283p151-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1283p151/unwise-1283p151-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 961 MB, VmSize: 798 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.189372 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1283p151/unwise-1283p151-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1283p151/unwise-1283p151-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1283p151/unwise-1283p151-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1283p151/unwise-1283p151-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1283p151/unwise-1283p151-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 961 MB, VmSize: 799 MB, VmRSS: 154 MB, VmData: 178 MB, maxrss: 0.218348 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1283p151/unwise-1283p151-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1283p151/unwise-1283p151-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1283p151/unwise-1283p151-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1283p151/unwise-1283p151-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 956 MB, VmSize: 796 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209908 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1283p151/unwise-1283p151-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1283p151/unwise-1283p151-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1283p151/unwise-1283p151-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1283p151/unwise-1283p151-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 967 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210184 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/tmp-legacysurvey-custom-128171p14423-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/tmp-legacysurvey-custom-128171p14423-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 15.65 s, CPU: 5.51 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 221 MB, VmData: 247 MB, maxrss: 0.454636 MB Stage wise_forced finished: 2020-06-07T15:53:34.129148 Resources for stage wise_forced : 3.116 s worker CPU, 16.376 s worker Wall, Wall: 15.649 s, Cores in use: 0.55, Total efficiency (on 4 cores): 13.8 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T15:53:34.130925 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/coadd/cus/custom-128171p14423/legacysurvey-custom-128171p14423-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/tractor-i/cus/tractor-custom-128171p14423.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/tractor/cus/tractor-custom-128171p14423.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1457708/tractor/cus/brick-custom-128171p14423.sha256sum Stage writecat : Wall: 6.56 s, CPU: 6.28 s, VmPeak: 1162 MB, VmSize: 1034 MB, VmRSS: 223 MB, VmData: 247 MB, maxrss: 0.454636 MB Stage writecat finished: 2020-06-07T15:53:40.693246 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.563 s, Cores in use: 0.96, Total efficiency (on 4 cores): 23.9 % Stage writecat finished All done: 47.921 s worker CPU, 409.943 s worker Wall, Wall: 186.503 s, Cores in use: 0.52, Total efficiency (on 4 cores): 13.0 % Finished galaxy PGC1457708 in 3.229 minutes.