Started working on galaxy PGC1826741 at Sun Jun 7 05:34:24 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.8541915 28.115350399999997 --width 231 --height 231 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/PGC1826741-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/PGC1826741-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T05:34:24.732857 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '216.8541915', '28.115350399999997', '--width', '231', '--height', '231', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/PGC1826741-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/PGC1826741-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 216.8541915 28.115350399999997 --width 231 --height 231 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/PGC1826741-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/PGC1826741-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 216.8541915 28.115350399999997 Starting process 4595 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 4596 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 4597 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 4598 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T05:34:29.392941 Keeping 11 CCDs: c4d_180210_082016_ooi_z_ls9.fits.fz c4d_180210_082016_ooi_z_ls9-S2 z exptime 135.0 propid 2014B-0404 seeing 1.22 MJD 58159.347 object DECaLS_38585_z c4d_170305_095413_ooi_z_ls9.fits.fz c4d_170305_095413_ooi_z_ls9-S2 z exptime 250.0 propid 2014B-0404 seeing 1.21 MJD 57817.409 object DECaLS_38585_z c4d_180224_085402_ooi_r_ls9.fits.fz c4d_180224_085402_ooi_r_ls9-S2 r exptime 73.0 propid 2014B-0404 seeing 1.17 MJD 58173.371 object DECaLS_38585_r c4d_180224_085143_ooi_g_ls9.fits.fz c4d_180224_085143_ooi_g_ls9-S2 g exptime 110.0 propid 2014B-0404 seeing 1.41 MJD 58173.369 object DECaLS_38585_g c4d_180209_090554_ooi_z_ls9.fits.fz c4d_180209_090554_ooi_z_ls9-N4 z exptime 99.0 propid 2014B-0404 seeing 0.96 MJD 58158.379 object DECaLS_6841_z c4d_150411_054923_ooi_z_ls9.fits.fz c4d_150411_054923_ooi_z_ls9-N4 z exptime 87.0 propid 2014B-0404 seeing 1.17 MJD 57123.241 object DECaLS_6841_z c4d_170329_071441_ooi_r_ls9.fits.fz c4d_170329_071441_ooi_r_ls9-N4 r exptime 61.0 propid 2014B-0404 seeing 1.27 MJD 57841.301 object DECaLS_6841_r c4d_170329_071707_ooi_g_ls9.fits.fz c4d_170329_071707_ooi_g_ls9-N4 g exptime 118.0 propid 2014B-0404 seeing 1.44 MJD 57841.302 object DECaLS_6841_g c4d_170421_053701_ooi_r_ls9.fits.fz c4d_170421_053701_ooi_r_ls9-S3 r exptime 75.0 propid 2014B-0404 seeing 1.19 MJD 57864.233 object DECaLS_22713_r c4d_170422_051052_ooi_g_ls9.fits.fz c4d_170422_051052_ooi_g_ls9-S3 g exptime 113.0 propid 2014B-0404 seeing 1.19 MJD 57865.214 object DECaLS_22713_g c4d_150408_060200_ooi_z_ls9.fits.fz c4d_150408_060200_ooi_z_ls9-S3 z exptime 108.0 propid 2014B-0404 seeing 1.20 MJD 57120.250 object DECaLS_22713_z The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ccca-g-20180224T085143_oi[S2,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9527115-z-20180210T082016_oi[S2,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952c4aa-r-20180224T085402_oi[S2,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950dd28-z-20170305T094910_oi[S2,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9527115-z-20180209T090554_oi[N4,noinherit][2046,4094][real]: DECaLS_6 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951398e-r-20170329T071249_oi[N4,noinherit][2046,4094][real]: DECaLS_6 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956d285-z-20150411T054706_oi[N4,noinherit][2046,4094][real]: DECaLS_6 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9514cf9-g-20170329T071419_oi[N4,noinherit][2046,4094][real]: DECaLS_6 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9518570-g-20170422T050811_oi[S3,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95176d0-r-20170421T053455_oi[S3,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9577b3f-z-20150408T055923_oi[S3,noinherit][2046,4094][real]: DECaLS_2 Stage tims : Wall: 78.08 s, CPU: 5.68 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 174 MB, VmData: 207 MB, maxrss: 0.454684 MB Stage tims finished: 2020-06-07T05:35:47.477799 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950dd28-z-20170305T094910_oi[S2,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9514cf9-g-20170329T071419_oi[N4,noinherit][2046,4094][real]: DECaLS_6 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952c4aa-r-20180224T085402_oi[S2,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951398e-r-20170329T071249_oi[N4,noinherit][2046,4094][real]: DECaLS_6 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9518570-g-20170422T050811_oi[S3,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9527115-z-20180210T082016_oi[S2,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956d285-z-20150411T054706_oi[N4,noinherit][2046,4094][real]: DECaLS_6 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9577b3f-z-20150408T055923_oi[S3,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ccca-g-20180224T085143_oi[S2,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9527115-z-20180209T090554_oi[N4,noinherit][2046,4094][real]: DECaLS_6 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95176d0-r-20170421T053455_oi[S3,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] Resources for stage tims : 4.579 s worker CPU, 252.165 s worker Wall, Wall: 78.086 s, Cores in use: 0.13, Total efficiency (on 4 cores): 3.3 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/PGC1826741-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/PGC1826741-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T05:35:47.502075 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03341.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03213.fits Matched 7 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/metrics/cus/reference-custom-216854p28115.fits Stage refs : Wall: 3.26 s, CPU: 2.48 s, VmPeak: 1026 MB, VmSize: 1010 MB, VmRSS: 189 MB, VmData: 222 MB, maxrss: 0.454684 MB Stage refs finished: 2020-06-07T05:35:50.758958 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.258 s, Cores in use: 0.76, Total efficiency (on 4 cores): 19.1 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T05:35:50.760302 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/metrics/cus/outlier-mask-custom-216854p28115.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/metrics/cus/outliers-pre-custom-216854p28115.jpg Image c4d_170305_095413_ooi_z_ls9-S2 z : masking 0 positive outlier pixels and 192 negative outlier pixels Image c4d_150408_060200_ooi_z_ls9-S3 z : masking 614 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/metrics/cus/outlier-mask-custom-216854p28115.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/metrics/cus/outliers-post-custom-216854p28115.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/metrics/cus/outliers-masked-pos-custom-216854p28115.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/metrics/cus/outliers-masked-neg-custom-216854p28115.jpg Stage outliers : Wall: 2.13 s, CPU: 1.93 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 199 MB, VmData: 230 MB, maxrss: 0.454684 MB Stage outliers finished: 2020-06-07T05:35:52.893145 Resources for stage outliers : 0.665 s worker CPU, 0.667 s worker Wall, Wall: 2.134 s, Cores in use: 1.22, Total efficiency (on 4 cores): 30.4 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T05:35:52.894669 Stage halos : Wall: 3.16 s, CPU: 1.55 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 199 MB, VmData: 230 MB, maxrss: 0.454684 MB Stage halos finished: 2020-06-07T05:35:56.057816 Resources for stage halos : 0.213 s worker CPU, 5.344 s worker Wall, Wall: 3.164 s, Cores in use: 0.56, Total efficiency (on 4 cores): 14.0 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T05:35:56.059913 PSF sigmas in coadd pixels: ['2.29', '2.33', '1.93'] Using average PSF sigma 2.182672537167783 Gaussian PSF norm 0.1292428373795008 vs pixelized 0.12053742 average tim pixel scale / coadd scale: 1.0013263401546948 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.90', '2.05', '1.93'] Using average PSF sigma 1.9617051033713864 Gaussian PSF norm 0.1438008145511117 vs pixelized 0.12531428 average tim pixel scale / coadd scale: 1.001345502027801 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.98', '1.97', '1.56', '1.90', '1.94'] Using average PSF sigma 1.8724158369930908 Gaussian PSF norm 0.15065819579207024 vs pixelized 0.13055924 average tim pixel scale / coadd scale: 1.0013432425930242 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.18 s, CPU: 0.17 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 202 MB, VmData: 231 MB, maxrss: 0.454684 MB Stage fit_on_coadds finished: 2020-06-07T05:35:56.239659 Resources for stage fit_on_coadds : 0.156 s worker CPU, 0.158 s worker Wall, Wall: 0.181 s, Cores in use: 1.78, Total efficiency (on 4 cores): 44.5 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T05:35:56.242226 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 29 potential peaks Of 29 potential peaks: 15 in veto map, 3 cut by saddle test, 0 cut by aper test, 11 kept SED z : 11 new peaks Found 22 potential peaks Of 22 potential peaks: 17 in veto map, 4 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 22 potential peaks Of 22 potential peaks: 15 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 23 potential peaks Of 23 potential peaks: 17 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 31 potential peaks Of 31 potential peaks: 24 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 15 new sources Median coadd sky for g : 2.1942692e-06 Median coadd sky for r : 7.152297e-05 Median coadd sky for z : 0.00025447214 Stage srcs : Wall: 2.61 s, CPU: 2.57 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 202 MB, VmData: 231 MB, maxrss: 0.454684 MB Stage srcs finished: 2020-06-07T05:35:58.847765 Resources for stage srcs : 0.086 s worker CPU, 0.094 s worker Wall, Wall: 2.606 s, Cores in use: 1.02, Total efficiency (on 4 cores): 25.5 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/PGC1826741-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/PGC1826741-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T05:35:59.279857 Blob 1 of 12, id: 4, sources: 5, size: 122x131, npix 12445, brick X: 55,177, Y: 50,181, one pixel: 102 50 Blob 2 of 12, id: 10, sources: 2, size: 46x24, npix 703, brick X: 64,110, Y: 207,231, one pixel: 94 207 Blob 3 of 12, id: 8, sources: 1, size: 30x32, npix 626, brick X: 161,191, Y: 185,217, one pixel: 170 185 Blob 4 of 12, id: 1, sources: 1, size: 29x30, npix 543, brick X: 60,89, Y: 22,52, one pixel: 72 22 Blob 5 of 12, id: 3, sources: 1, size: 20x35, npix 505, brick X: 0,20, Y: 43,78, one pixel: 6 43 Measuring 1 iterative sources Blob 2 finished, total: Wall: 1.01 s, CPU: 0.94 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146336 MB Blob 6 of 12, id: 2, sources: 1, size: 26x25, npix 408, brick X: 192,218, Y: 34,59, one pixel: 201 34 Blob 4 finished, total: Wall: 1.17 s, CPU: 1.17 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14808 MB Blob 7 of 12, id: 7, sources: 1, size: 24x26, npix 388, brick X: 20,44, Y: 173,199, one pixel: 30 173 Blob 3 finished, total: Wall: 1.65 s, CPU: 1.59 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.145956 MB Blob 8 of 12, id: 0, sources: 1, size: 23x19, npix 287, brick X: 143,166, Y: 0,19, one pixel: 150 0 Blob 6 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14808 MB Blob 9 of 12, id: 5, sources: 1, size: 19x23, npix 282, brick X: 212,231, Y: 56,79, one pixel: 222 56 Blob 7 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.145956 MB Blob 10 of 12, id: 6, sources: 1, size: 22x21, npix 281, brick X: 177,199, Y: 152,173, one pixel: 185 152 Blob 5 finished, total: Wall: 1.36 s, CPU: 1.36 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146336 MB Blob 11 of 12, id: 9, sources: 1, size: 20x21, npix 248, brick X: 37,57, Y: 195,216, one pixel: 46 195 Blob 8 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14808 MB Blob 12 of 12, id: 11, sources: 1, size: 18x14, npix 160, brick X: 45,63, Y: 217,231, one pixel: 53 217 Blob 9 finished, total: Wall: 0.62 s, CPU: 0.61 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.145956 MB Blob 10 finished, total: Wall: 0.61 s, CPU: 0.61 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146336 MB Blob 11 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14808 MB Blob 12 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.145956 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.7956, ee1=-0.0880493, ee2=-0.0588426 Measuring 7 iterative sources Blob 1 finished, total: Wall: 10.99 s, CPU: 10.99 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150352 MB Old catalog: 19 New catalog: 25 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/metrics/cus/blobs-custom-216854p28115.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/metrics/cus/all-models-custom-216854p28115.fits Stage fitblobs : Wall: 15.69 s, CPU: 3.68 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 202 MB, VmData: 231 MB, maxrss: 0.454684 MB Stage fitblobs finished: 2020-06-07T05:36:14.970111 Resources for stage fitblobs : 20.149 s worker CPU, 20.315 s worker Wall, Wall: 15.692 s, Cores in use: 1.52, Total efficiency (on 4 cores): 38.0 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T05:36:14.971926 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/tmp-legacysurvey-custom-216854p28115-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/tmp-legacysurvey-custom-216854p28115-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/tmp-legacysurvey-custom-216854p28115-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/tmp-legacysurvey-custom-216854p28115-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-resid.jpg Stage coadds : Wall: 5.42 s, CPU: 4.72 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 203 MB, VmData: 231 MB, maxrss: 0.454684 MB Stage coadds finished: 2020-06-07T05:36:20.392006 Resources for stage coadds : 2.213 s worker CPU, 2.311 s worker Wall, Wall: 5.421 s, Cores in use: 1.28, Total efficiency (on 4 cores): 32.0 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T05:36:20.393329 Cut to 2 unWISE tiles Reading WISE tile 2160p287 band 1 Reading WISE tile 2160p287 band 2 Reading WISE tile 2160p287 band 3 Reading WISE tile 2160p287 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/216/2160p287/unwise-2160p287-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/216/2160p287/unwise-2160p287-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/216/2160p287/unwise-2160p287-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/216/2160p287/unwise-2160p287-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/216/2160p287/unwise-2160p287-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2177p287 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/216/2160p287/unwise-2160p287-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/216/2160p287/unwise-2160p287-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/216/2160p287/unwise-2160p287-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/216/2160p287/unwise-2160p287-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/216/2160p287/unwise-2160p287-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2177p287 band 4 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/216/2160p287/unwise-2160p287-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/216/2160p287/unwise-2160p287-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/216/2160p287/unwise-2160p287-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/216/2160p287/unwise-2160p287-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2177p287 band 1 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/216/2160p287/unwise-2160p287-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/216/2160p287/unwise-2160p287-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/216/2160p287/unwise-2160p287-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/216/2160p287/unwise-2160p287-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2177p287 band 2 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/217/2177p287/unwise-2177p287-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/217/2177p287/unwise-2177p287-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/217/2177p287/unwise-2177p287-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/217/2177p287/unwise-2177p287-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/217/2177p287/unwise-2177p287-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 962 MB, VmSize: 800 MB, VmRSS: 150 MB, VmData: 179 MB, maxrss: 0.189764 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/217/2177p287/unwise-2177p287-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/217/2177p287/unwise-2177p287-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/217/2177p287/unwise-2177p287-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/217/2177p287/unwise-2177p287-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/217/2177p287/unwise-2177p287-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 961 MB, VmSize: 792 MB, VmRSS: 142 MB, VmData: 170 MB, maxrss: 0.206312 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/217/2177p287/unwise-2177p287-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/217/2177p287/unwise-2177p287-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/217/2177p287/unwise-2177p287-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/217/2177p287/unwise-2177p287-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 962 MB, VmSize: 795 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.206092 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/217/2177p287/unwise-2177p287-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/217/2177p287/unwise-2177p287-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/217/2177p287/unwise-2177p287-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/217/2177p287/unwise-2177p287-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 956 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.21018 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/tmp-legacysurvey-custom-216854p28115-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/tmp-legacysurvey-custom-216854p28115-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 10.56 s, CPU: 2.42 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 204 MB, VmData: 231 MB, maxrss: 0.454684 MB Stage wise_forced finished: 2020-06-07T05:36:30.955330 Resources for stage wise_forced : 5.843 s worker CPU, 18.197 s worker Wall, Wall: 10.563 s, Cores in use: 0.78, Total efficiency (on 4 cores): 19.6 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T05:36:30.957079 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/coadd/cus/custom-216854p28115/legacysurvey-custom-216854p28115-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/tractor-i/cus/tractor-custom-216854p28115.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/tractor/cus/tractor-custom-216854p28115.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/216/PGC1826741/tractor/cus/brick-custom-216854p28115.sha256sum Stage writecat : Wall: 7.64 s, CPU: 7.42 s, VmPeak: 1151 MB, VmSize: 1023 MB, VmRSS: 206 MB, VmData: 231 MB, maxrss: 0.454684 MB Stage writecat finished: 2020-06-07T05:36:38.596158 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.640 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.3 % Stage writecat finished All done: 33.905 s worker CPU, 299.252 s worker Wall, Wall: 129.207 s, Cores in use: 0.52, Total efficiency (on 4 cores): 12.9 % Finished galaxy PGC1826741 in 2.248 minutes.