Started working on galaxy PGC1398579 at Thu Jun 4 12:41:57 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 243.380088 11.775312699999999 --width 243 --height 243 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/PGC1398579-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/PGC1398579-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-04T12:41:59.016261 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '243.380088', '11.775312699999999', '--width', '243', '--height', '243', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/PGC1398579-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/PGC1398579-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 243.380088 11.775312699999999 --width 243 --height 243 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/PGC1398579-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/PGC1398579-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 243.380088 11.775312699999999 Starting process 8234 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 8235 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 8236 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 8237 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 8238 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 8240 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Starting process 8241 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Starting process 8239 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-04T12:42:01.772449 Keeping 11 CCDs: c4d_140816_004520_ooi_g_ls9.fits.fz c4d_140816_004520_ooi_g_ls9-S18 g exptime 79.0 propid 2014B-0404 seeing 0.99 MJD 56885.030 object DECaLS_15150_g c4d_190306_085516_ooi_z_ls9.fits.fz c4d_190306_085516_ooi_z_ls9-S18 z exptime 94.0 propid 2014B-0404 seeing 0.96 MJD 58548.372 object DECaLS_15150_z c4d_180518_043940_ooi_r_ls9.fits.fz c4d_180518_043940_ooi_r_ls9-S18 r exptime 90.0 propid 2014B-0404 seeing 1.12 MJD 58256.194 object DECaLS_15150_r c4d_140817_004310_ooi_r_ls9.fits.fz c4d_140817_004310_ooi_r_ls9-S18 r exptime 67.0 propid 2014B-0404 seeing 1.89 MJD 56886.029 object DECaLS_15150_r c4d_140818_012040_ooi_z_ls9.fits.fz c4d_140818_012040_ooi_z_ls9-S16 z exptime 123.0 propid 2014B-0404 seeing 1.37 MJD 56887.054 object DECaLS_46894_z c4d_140817_012256_ooi_r_ls9.fits.fz c4d_140817_012256_ooi_r_ls9-S16 r exptime 68.0 propid 2014B-0404 seeing 1.73 MJD 56886.056 object DECaLS_46894_r c4d_140816_012954_ooi_g_ls9.fits.fz c4d_140816_012954_ooi_g_ls9-S16 g exptime 79.0 propid 2014B-0404 seeing 1.10 MJD 56885.061 object DECaLS_46894_g c4d_140816_000629_ooi_g_ls9.fits.fz c4d_140816_000629_ooi_g_ls9-S17 g exptime 78.0 propid 2014B-0404 seeing 1.00 MJD 56885.003 object DECaLS_31022_g c4d_140816_235930_ooi_r_ls9.fits.fz c4d_140816_235930_ooi_r_ls9-S17 r exptime 67.0 propid 2014B-0404 seeing 1.54 MJD 56885.998 object DECaLS_31022_r c4d_140818_001345_ooi_z_ls9.fits.fz c4d_140818_001345_ooi_z_ls9-S17 z exptime 118.0 propid 2014B-0404 seeing 0.98 MJD 56887.008 object DECaLS_31022_z c4d_180920_234437_ooi_z_ls9.fits.fz c4d_180920_234437_ooi_z_ls9-S18 z exptime 116.0 propid 2014B-0404 seeing 1.17 MJD 58381.989 object DECaLS_15150_z The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140817T012056_oi[S16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140817T004107_oi[S18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d605-z-20140818T011746_oi[S16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535707-z-20190306T085516_oi[S18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140816T235731_oi[S17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d605-z-20140818T001056_oi[S17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f80e-z-20180920T234437_oi[S18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560b38-r-20180518T043940_oi[S18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140816T012742_oi[S16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9549d4b-g-20140816T000419_oi[S17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9549d4b-g-20140816T004311_oi[S18,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 83.31 s, CPU: 3.37 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 175 MB, VmData: 209 MB, maxrss: 0.456848 MB Stage tims finished: 2020-06-04T12:43:25.080427 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535707-z-20190306T085516_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140817T012056_oi[S16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140816T235731_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140817T004107_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d605-z-20140818T001056_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d605-z-20140818T011746_oi[S16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f80e-z-20180920T234437_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560b38-r-20180518T043940_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 5.389 s worker CPU, 392.198 s worker Wall, Wall: 83.309 s, Cores in use: 0.11, Total efficiency (on 8 cores): 1.3 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/PGC1398579-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/PGC1398579-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9549d4b-g-20140816T000419_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140816T012742_oi[S16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9549d4b-g-20140816T004311_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-06-04T12:43:25.106120 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04886.fits Matched 5 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/metrics/cus/reference-custom-243380p11775.fits Stage refs : Wall: 7.77 s, CPU: 6.31 s, VmPeak: 1036 MB, VmSize: 1030 MB, VmRSS: 211 MB, VmData: 244 MB, maxrss: 0.456848 MB Stage refs finished: 2020-06-04T12:43:32.875954 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.771 s, Cores in use: 0.81, Total efficiency (on 8 cores): 10.2 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-04T12:43:32.877705 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/metrics/cus/outlier-mask-custom-243380p11775.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/metrics/cus/outliers-pre-custom-243380p11775.jpg Image c4d_140818_012040_ooi_z_ls9-S16 z : masking 324 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/metrics/cus/outlier-mask-custom-243380p11775.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/metrics/cus/outliers-post-custom-243380p11775.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/metrics/cus/outliers-masked-pos-custom-243380p11775.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/metrics/cus/outliers-masked-neg-custom-243380p11775.jpg Stage outliers : Wall: 3.71 s, CPU: 3.55 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 224 MB, VmData: 255 MB, maxrss: 0.456848 MB Stage outliers finished: 2020-06-04T12:43:36.586020 Resources for stage outliers : 0.794 s worker CPU, 0.794 s worker Wall, Wall: 3.710 s, Cores in use: 1.17, Total efficiency (on 8 cores): 14.6 % Stage outliers finished Running stage halos Running stage halos at 2020-06-04T12:43:36.588084 Stage halos : Wall: 2.88 s, CPU: 1.82 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 225 MB, VmData: 255 MB, maxrss: 0.456848 MB Stage halos finished: 2020-06-04T12:43:39.466970 Resources for stage halos : 0.137 s worker CPU, 4.885 s worker Wall, Wall: 2.880 s, Cores in use: 0.68, Total efficiency (on 8 cores): 8.5 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-04T12:43:39.469271 PSF sigmas in coadd pixels: ['1.61', '1.78', '1.62'] Using average PSF sigma 1.673011764306781 Gaussian PSF norm 0.16861494807884106 vs pixelized 0.13923459 average tim pixel scale / coadd scale: 1.0010980306022608 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.82', '3.07', '2.81', '2.50'] Using average PSF sigma 2.5510094008961186 Gaussian PSF norm 0.11058163551838888 vs pixelized 0.09950388 average tim pixel scale / coadd scale: 1.0011296810178825 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.56', '2.23', '1.59', '1.91'] Using average PSF sigma 1.820938402413074 Gaussian PSF norm 0.15491726211059714 vs pixelized 0.122763164 average tim pixel scale / coadd scale: 1.0011271816431295 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.18 s, CPU: 0.17 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 226 MB, VmData: 255 MB, maxrss: 0.456848 MB Stage fit_on_coadds finished: 2020-06-04T12:43:39.644678 Resources for stage fit_on_coadds : 0.162 s worker CPU, 0.162 s worker Wall, Wall: 0.177 s, Cores in use: 1.87, Total efficiency (on 8 cores): 23.4 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-04T12:43:39.647952 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 39 potential peaks Of 39 potential peaks: 20 in veto map, 5 cut by saddle test, 0 cut by aper test, 14 kept SED z : 14 new peaks Found 28 potential peaks Of 28 potential peaks: 22 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 56 potential peaks Of 56 potential peaks: 43 in veto map, 10 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 44 potential peaks Of 44 potential peaks: 36 in veto map, 8 cut by saddle test, 0 cut by aper test, 0 kept SED Flat : 0 new peaks Found 38 potential peaks Of 38 potential peaks: 32 in veto map, 6 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 19 new sources Median coadd sky for g : 3.2402753e-05 Median coadd sky for r : -3.72558e-05 Median coadd sky for z : 3.831542e-05 Stage srcs : Wall: 1.73 s, CPU: 1.71 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 226 MB, VmData: 255 MB, maxrss: 0.456848 MB Stage srcs finished: 2020-06-04T12:43:41.382197 Resources for stage srcs : 0.064 s worker CPU, 0.065 s worker Wall, Wall: 1.735 s, Cores in use: 1.02, Total efficiency (on 8 cores): 12.8 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/PGC1398579-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/PGC1398579-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-04T12:43:41.392267 Blob 1 of 10, id: 1, sources: 13, size: 200x164, npix 19892, brick X: 20,220, Y: 31,195, one pixel: 96 31 Blob 2 of 10, id: 0, sources: 2, size: 58x52, npix 2109, brick X: 185,243, Y: 0,52, one pixel: 209 0 Blob 3 of 10, id: 7, sources: 2, size: 35x50, npix 1105, brick X: 0,35, Y: 193,243, one pixel: 3 193 Blob 4 of 10, id: 2, sources: 1, size: 28x30, npix 588, brick X: 215,243, Y: 74,104, one pixel: 230 74 Blob 5 of 10, id: 5, sources: 1, size: 30x29, npix 562, brick X: 52,82, Y: 175,204, one pixel: 65 175 Blob 6 of 10, id: 9, sources: 1, size: 34x23, npix 560, brick X: 43,77, Y: 220,243, one pixel: 58 220 Blob 7 of 10, id: 4, sources: 1, size: 28x27, npix 496, brick X: 21,49, Y: 158,185, one pixel: 31 158 Blob 8 of 10, id: 8, sources: 1, size: 28x26, npix 455, brick X: 120,148, Y: 203,229, one pixel: 134 203 Blob 9 of 10, id: 6, sources: 1, size: 22x23, npix 306, brick X: 215,237, Y: 181,204, one pixel: 225 181 Blob 7 finished, total: Wall: 0.79 s, CPU: 0.78 s, VmPeak: 953 MB, VmSize: 719 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144324 MB Blob 10 of 10, id: 3, sources: 1, size: 20x20, npix 229, brick X: 191,211, Y: 113,133, one pixel: 200 113 Measuring 1 iterative sources Blob 8 finished, total: Wall: 1.00 s, CPU: 1.00 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144628 MB Blob 2 finished, total: Wall: 1.05 s, CPU: 1.05 s, VmPeak: 926 MB, VmSize: 714 MB, VmRSS: 138 MB, VmData: 177 MB, maxrss: 0.14102 MB Blob 5 finished, total: Wall: 1.05 s, CPU: 1.04 s, VmPeak: 936 MB, VmSize: 714 MB, VmRSS: 136 MB, VmData: 177 MB, maxrss: 0.139264 MB Blob 9 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 953 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146472 MB Blob 4 finished, total: Wall: 1.21 s, CPU: 1.21 s, VmPeak: 926 MB, VmSize: 714 MB, VmRSS: 137 MB, VmData: 177 MB, maxrss: 0.140776 MB Blob 10 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144628 MB Blob 6 finished, total: Wall: 1.55 s, CPU: 1.55 s, VmPeak: 957 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146812 MB Blob 3 finished, total: Wall: 2.04 s, CPU: 2.03 s, VmPeak: 932 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146024 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.62001, ee1=-0.130154, ee2=-0.194887 Measuring 16 iterative sources Blob 1 finished, total: Wall: 23.40 s, CPU: 23.40 s, VmPeak: 926 MB, VmSize: 717 MB, VmRSS: 147 MB, VmData: 180 MB, maxrss: 0.150884 MB Old catalog: 25 New catalog: 39 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/metrics/cus/blobs-custom-243380p11775.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/metrics/cus/all-models-custom-243380p11775.fits Stage fitblobs : Wall: 24.65 s, CPU: 1.24 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 227 MB, VmData: 255 MB, maxrss: 0.456848 MB Stage fitblobs finished: 2020-06-04T12:44:06.045730 Resources for stage fitblobs : 32.883 s worker CPU, 32.966 s worker Wall, Wall: 24.655 s, Cores in use: 1.38, Total efficiency (on 8 cores): 17.3 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-04T12:44:06.047887 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/tmp-legacysurvey-custom-243380p11775-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/tmp-legacysurvey-custom-243380p11775-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/tmp-legacysurvey-custom-243380p11775-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/tmp-legacysurvey-custom-243380p11775-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-resid.jpg Stage coadds : Wall: 2.46 s, CPU: 1.73 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 227 MB, VmData: 255 MB, maxrss: 0.456848 MB Stage coadds finished: 2020-06-04T12:44:08.512596 Resources for stage coadds : 4.286 s worker CPU, 4.663 s worker Wall, Wall: 2.466 s, Cores in use: 2.44, Total efficiency (on 8 cores): 30.5 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-04T12:44:08.514234 Cut to 2 unWISE tiles Reading WISE tile 2425p121 band 3 Reading WISE tile 2425p121 band 2 Reading WISE tile 2425p121 band 1 Reading WISE tile 2425p121 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/242/2425p121/unwise-2425p121-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/242/2425p121/unwise-2425p121-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/242/2425p121/unwise-2425p121-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/242/2425p121/unwise-2425p121-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/242/2425p121/unwise-2425p121-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2441p121 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/242/2425p121/unwise-2425p121-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/242/2425p121/unwise-2425p121-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/242/2425p121/unwise-2425p121-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/242/2425p121/unwise-2425p121-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/242/2425p121/unwise-2425p121-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2441p121 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/242/2425p121/unwise-2425p121-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/242/2425p121/unwise-2425p121-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/242/2425p121/unwise-2425p121-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/242/2425p121/unwise-2425p121-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2441p121 band 2 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/242/2425p121/unwise-2425p121-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/242/2425p121/unwise-2425p121-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/242/2425p121/unwise-2425p121-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/242/2425p121/unwise-2425p121-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2441p121 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/244/2441p121/unwise-2441p121-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/244/2441p121/unwise-2441p121-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/244/2441p121/unwise-2441p121-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/244/2441p121/unwise-2441p121-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/244/2441p121/unwise-2441p121-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 962 MB, VmSize: 800 MB, VmRSS: 150 MB, VmData: 179 MB, maxrss: 0.188604 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/244/2441p121/unwise-2441p121-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/244/2441p121/unwise-2441p121-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/244/2441p121/unwise-2441p121-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/244/2441p121/unwise-2441p121-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/244/2441p121/unwise-2441p121-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 926 MB, VmSize: 795 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.205768 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/244/2441p121/unwise-2441p121-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/244/2441p121/unwise-2441p121-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/244/2441p121/unwise-2441p121-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/244/2441p121/unwise-2441p121-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 932 MB, VmSize: 795 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.204116 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/244/2441p121/unwise-2441p121-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/244/2441p121/unwise-2441p121-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/244/2441p121/unwise-2441p121-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/244/2441p121/unwise-2441p121-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 926 MB, VmSize: 796 MB, VmRSS: 150 MB, VmData: 175 MB, maxrss: 0.214932 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/tmp-legacysurvey-custom-243380p11775-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/tmp-legacysurvey-custom-243380p11775-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 5.01 s, CPU: 1.59 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 228 MB, VmData: 255 MB, maxrss: 0.456848 MB Stage wise_forced finished: 2020-06-04T12:44:13.522076 Resources for stage wise_forced : 6.411 s worker CPU, 11.830 s worker Wall, Wall: 5.009 s, Cores in use: 1.60, Total efficiency (on 8 cores): 20.0 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-04T12:44:13.524127 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/coadd/cus/custom-243380p11775/legacysurvey-custom-243380p11775-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/tractor-i/cus/tractor-custom-243380p11775.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/tractor/cus/tractor-custom-243380p11775.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1398579/tractor/cus/brick-custom-243380p11775.sha256sum Stage writecat : Wall: 1.87 s, CPU: 1.49 s, VmPeak: 1172 MB, VmSize: 1044 MB, VmRSS: 230 MB, VmData: 255 MB, maxrss: 0.456848 MB Stage writecat finished: 2020-06-04T12:44:15.395650 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.873 s, Cores in use: 0.80, Total efficiency (on 8 cores): 9.9 % Stage writecat finished All done: 50.129 s worker CPU, 447.566 s worker Wall, Wall: 133.629 s, Cores in use: 0.55, Total efficiency (on 8 cores): 6.8 % Finished galaxy PGC1398579 in 2.303 minutes.