Started working on galaxy PGC1708768 at Fri Jun 5 17:13:49 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 233.17458299999998 24.499365 --width 273 --height 273 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-05T17:13:50.216717 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '233.17458299999998', '24.499365', '--width', '273', '--height', '273', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 233.17458299999998 24.499365 --width 273 --height 273 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 233.17458299999998 24.499365 Starting process 55320 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.0573 MB Starting process 55321 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 55322 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 55323 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-05T17:13:50.780888 Keeping 12 CCDs: c4d_150409_075217_ooi_z_ls9.fits.fz c4d_150409_075217_ooi_z_ls9-N26 z exptime 111.0 propid 2014B-0404 seeing 0.96 MJD 57121.326 object DECaLS_171_z c4d_190304_085515_ooi_z_ls9.fits.fz c4d_190304_085515_ooi_z_ls9-N20 z exptime 104.0 propid 2014B-0404 seeing 1.19 MJD 58546.372 object DECaLS_31915_z c4d_180517_050424_ooi_g_ls9.fits.fz c4d_180517_050424_ooi_g_ls9-N20 g exptime 131.0 propid 2014B-0404 seeing 1.24 MJD 58255.211 object DECaLS_31915_g c4d_180314_083901_ooi_z_ls9.fits.fz c4d_180314_083901_ooi_z_ls9-N20 z exptime 85.0 propid 2014B-0404 seeing 1.37 MJD 58191.360 object DECaLS_31915_z c4d_180515_045944_ooi_r_ls9.fits.fz c4d_180515_045944_ooi_r_ls9-N20 r exptime 148.0 propid 2014B-0404 seeing 1.33 MJD 58253.208 object DECaLS_31915_r c4d_170521_050830_ooi_r_ls9.fits.fz c4d_170521_050830_ooi_r_ls9-N21 r exptime 101.0 propid 2014B-0404 seeing 1.46 MJD 57894.212 object DECaLS_16043_r c4d_170331_084713_ooi_g_ls9.fits.fz c4d_170331_084713_ooi_g_ls9-N21 g exptime 151.0 propid 2014B-0404 seeing 1.53 MJD 57843.364 object DECaLS_16043_g c4d_150410_091047_ooi_z_ls9.fits.fz c4d_150410_091047_ooi_z_ls9-N21 z exptime 108.0 propid 2014B-0404 seeing 1.14 MJD 57122.381 object DECaLS_16043_z c4d_170328_090041_ooi_r_ls9.fits.fz c4d_170328_090041_ooi_r_ls9-N22 r exptime 69.0 propid 2014B-0404 seeing 1.14 MJD 57840.374 object DECaLS_171_r c4d_150409_073716_ooi_z_ls9.fits.fz c4d_150409_073716_ooi_z_ls9-N22 z exptime 80.0 propid 2014B-0404 seeing 1.18 MJD 57121.316 object DECaLS_171_z c4d_170328_084420_ooi_g_ls9.fits.fz c4d_170328_084420_ooi_g_ls9-N22 g exptime 167.0 propid 2014B-0404 seeing 1.32 MJD 57840.362 object DECaLS_171_g c4d_150409_075217_ooi_z_ls9.fits.fz c4d_150409_075217_ooi_z_ls9-N22 z exptime 111.0 propid 2014B-0404 seeing 0.94 MJD 57121.326 object DECaLS_171_z The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530903-g-20180517T050424_oi[N20,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534c2e-z-20190304T085515_oi[N20,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955fb7b-r-20180515T045944_oi[N20,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9516904-g-20170331T084352_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956d285-z-20150410T090806_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9512bde-r-20170328T085841_oi[N22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95718f0-z-20150409T073505_oi[N22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9528b21-z-20180314T083901_oi[N20,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951364f-g-20170328T084044_oi[N22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95718f0-z-20150409T074936_oi[N22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95197f6-r-20170521T050556_oi[N21,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 107.21 s, CPU: 1.15 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 175 MB, VmData: 209 MB, maxrss: 0.450552 MB Stage tims finished: 2020-06-05T17:15:37.987103 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9528b21-z-20180314T083901_oi[N20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534c2e-z-20190304T085515_oi[N20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9516904-g-20170331T084352_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9512bde-r-20170328T085841_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951364f-g-20170328T084044_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530903-g-20180517T050424_oi[N20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95197f6-r-20170521T050556_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955fb7b-r-20180515T045944_oi[N20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956d285-z-20150410T090806_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95718f0-z-20150409T073505_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95718f0-z-20150409T074936_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 4.665 s worker CPU, 361.986 s worker Wall, Wall: 107.208 s, Cores in use: 0.05, Total efficiency (on 4 cores): 1.4 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-05T17:15:38.111666 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03603.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03602.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03731.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03475.fits Matched 11 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/metrics/cus/reference-custom-233174p24499.fits Stage refs : Wall: 2.75 s, CPU: 2.04 s, VmPeak: 1026 MB, VmSize: 1015 MB, VmRSS: 196 MB, VmData: 229 MB, maxrss: 0.450552 MB Stage refs finished: 2020-06-05T17:15:40.858942 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.748 s, Cores in use: 0.74, Total efficiency (on 4 cores): 18.5 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-05T17:15:40.860593 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/metrics/cus/outlier-mask-custom-233174p24499.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/metrics/cus/outliers-pre-custom-233174p24499.jpg Image c4d_170331_084713_ooi_g_ls9-N21 g : masking 87 positive outlier pixels and 0 negative outlier pixels Image c4d_150409_075217_ooi_z_ls9-N22 z : masking 255 positive outlier pixels and 0 negative outlier pixels Image c4d_150409_073716_ooi_z_ls9-N22 z : masking 384 positive outlier pixels and 0 negative outlier pixels Image c4d_180314_083901_ooi_z_ls9-N20 z : masking 179 positive outlier pixels and 143 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/metrics/cus/outlier-mask-custom-233174p24499.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/metrics/cus/outliers-post-custom-233174p24499.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/metrics/cus/outliers-masked-pos-custom-233174p24499.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/metrics/cus/outliers-masked-neg-custom-233174p24499.jpg Stage outliers : Wall: 0.97 s, CPU: 0.71 s, VmPeak: 1026 MB, VmSize: 1025 MB, VmRSS: 211 MB, VmData: 241 MB, maxrss: 0.450552 MB Stage outliers finished: 2020-06-05T17:15:41.827373 Resources for stage outliers : 0.885 s worker CPU, 0.888 s worker Wall, Wall: 0.968 s, Cores in use: 1.65, Total efficiency (on 4 cores): 41.3 % Stage outliers finished Running stage halos Running stage halos at 2020-06-05T17:15:41.829133 Stage halos : Wall: 0.93 s, CPU: 0.24 s, VmPeak: 1026 MB, VmSize: 1025 MB, VmRSS: 211 MB, VmData: 241 MB, maxrss: 0.450552 MB Stage halos finished: 2020-06-05T17:15:42.761448 Resources for stage halos : 0.267 s worker CPU, 1.948 s worker Wall, Wall: 0.934 s, Cores in use: 0.54, Total efficiency (on 4 cores): 13.5 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-05T17:15:42.763526 PSF sigmas in coadd pixels: ['2.01', '2.48', '2.14'] Using average PSF sigma 2.212298858797924 Gaussian PSF norm 0.127512063142842 vs pixelized 0.11579682 average tim pixel scale / coadd scale: 1.001310577431253 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.17', '2.37', '1.86'] Using average PSF sigma 2.1318328786258895 Gaussian PSF norm 0.13232500286594104 vs pixelized 0.11219333 average tim pixel scale / coadd scale: 1.0013145764308575 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.94', '2.22', '1.86', '1.91', '1.53'] Using average PSF sigma 1.8917780908642996 Gaussian PSF norm 0.1491162167149304 vs pixelized 0.12371673 average tim pixel scale / coadd scale: 1.001289955923291 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.21 s, CPU: 0.18 s, VmPeak: 1026 MB, VmSize: 1025 MB, VmRSS: 213 MB, VmData: 241 MB, maxrss: 0.450552 MB Stage fit_on_coadds finished: 2020-06-05T17:15:42.978054 Resources for stage fit_on_coadds : 0.213 s worker CPU, 0.217 s worker Wall, Wall: 0.216 s, Cores in use: 1.81, Total efficiency (on 4 cores): 45.2 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-05T17:15:42.980928 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 15 potential peaks Of 15 potential peaks: 4 in veto map, 3 cut by saddle test, 0 cut by aper test, 8 kept SED z : 8 new peaks Found 12 potential peaks Of 12 potential peaks: 9 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 9 potential peaks Of 9 potential peaks: 9 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 16 potential peaks Of 16 potential peaks: 9 in veto map, 3 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 17 potential peaks Of 17 potential peaks: 15 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 13 new sources Median coadd sky for g : -1.5709596e-05 Median coadd sky for r : 5.451814e-05 Median coadd sky for z : 0.0005065884 Stage srcs : Wall: 0.51 s, CPU: 0.47 s, VmPeak: 1026 MB, VmSize: 1025 MB, VmRSS: 213 MB, VmData: 241 MB, maxrss: 0.450552 MB Stage srcs finished: 2020-06-05T17:15:43.495938 Resources for stage srcs : 0.120 s worker CPU, 0.132 s worker Wall, Wall: 0.516 s, Cores in use: 1.14, Total efficiency (on 4 cores): 28.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-05T17:15:43.506246 Blob 1 of 11, id: 6, sources: 4, size: 117x185, npix 9354, brick X: 96,213, Y: 88,273, one pixel: 169 88 Blob 2 of 11, id: 0, sources: 2, size: 50x42, npix 1291, brick X: 173,223, Y: 0,42, one pixel: 198 0 Blob 3 of 11, id: 10, sources: 1, size: 30x28, npix 542, brick X: 4,34, Y: 196,224, one pixel: 16 196 Blob 4 of 11, id: 9, sources: 1, size: 23x32, npix 532, brick X: 250,273, Y: 187,219, one pixel: 265 187 Blob 5 of 11, id: 3, sources: 1, size: 25x26, npix 402, brick X: 215,240, Y: 17,43, one pixel: 227 17 Blob 3 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.146948 MB Blob 6 of 11, id: 5, sources: 1, size: 24x22, npix 325, brick X: 236,260, Y: 86,108, one pixel: 245 86 Blob 4 finished, total: Wall: 1.23 s, CPU: 1.23 s, VmPeak: 951 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14832 MB Blob 7 of 11, id: 7, sources: 1, size: 20x21, npix 239, brick X: 236,256, Y: 127,148, one pixel: 245 127 Blob 5 finished, total: Wall: 0.99 s, CPU: 0.99 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.146948 MB Blob 8 of 11, id: 2, sources: 1, size: 20x20, npix 238, brick X: 59,79, Y: 10,30, one pixel: 67 10 Blob 7 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.146948 MB Blob 9 of 11, id: 4, sources: 1, size: 20x18, npix 216, brick X: 248,268, Y: 63,81, one pixel: 256 63 Measuring 1 iterative sources Blob 6 finished, total: Wall: 1.17 s, CPU: 1.17 s, VmPeak: 951 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14832 MB Blob 10 of 11, id: 1, sources: 1, size: 18x20, npix 198, brick X: 0,18, Y: 9,29, one pixel: 8 9 Blob 8 finished, total: Wall: 0.44 s, CPU: 0.44 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.146948 MB Blob 11 of 11, id: 8, sources: 1, size: 15x21, npix 194, brick X: 258,273, Y: 149,170, one pixel: 268 149 Blob 2 finished, total: Wall: 2.70 s, CPU: 2.70 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147284 MB Blob 9 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 951 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14832 MB Blob 11 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147284 MB Blob 10 finished, total: Wall: 0.89 s, CPU: 0.89 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.146948 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.7695, ee1=-0.753728, ee2=0.903042 Measuring 5 iterative sources Blob 1 finished, total: Wall: 14.39 s, CPU: 14.39 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.1512 MB Old catalog: 17 New catalog: 20 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/metrics/cus/blobs-custom-233174p24499.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/metrics/cus/all-models-custom-233174p24499.fits Stage fitblobs : Wall: 14.66 s, CPU: 0.27 s, VmPeak: 1026 MB, VmSize: 1025 MB, VmRSS: 214 MB, VmData: 241 MB, maxrss: 0.450552 MB Stage fitblobs finished: 2020-06-05T17:15:58.163988 Resources for stage fitblobs : 23.882 s worker CPU, 23.907 s worker Wall, Wall: 14.659 s, Cores in use: 1.65, Total efficiency (on 4 cores): 41.2 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-05T17:15:58.166013 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/tmp-legacysurvey-custom-233174p24499-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/tmp-legacysurvey-custom-233174p24499-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/tmp-legacysurvey-custom-233174p24499-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/tmp-legacysurvey-custom-233174p24499-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-resid.jpg Stage coadds : Wall: 1.32 s, CPU: 0.55 s, VmPeak: 1026 MB, VmSize: 1025 MB, VmRSS: 214 MB, VmData: 241 MB, maxrss: 0.450552 MB Stage coadds finished: 2020-06-05T17:15:59.488956 Resources for stage coadds : 2.472 s worker CPU, 2.586 s worker Wall, Wall: 1.324 s, Cores in use: 2.28, Total efficiency (on 4 cores): 57.0 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-05T17:15:59.490459 Cut to 1 unWISE tiles Reading WISE tile 2328p242 band 2 Reading WISE tile 2328p242 band 1 Reading WISE tile 2328p242 band 3 Reading WISE tile 2328p242 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 951 MB, VmSize: 798 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.191252 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 958 MB, VmSize: 792 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.20462 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 963 MB, VmSize: 796 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210668 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 962 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.21074 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/tmp-legacysurvey-custom-233174p24499-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/tmp-legacysurvey-custom-233174p24499-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.53 s, CPU: 0.52 s, VmPeak: 1026 MB, VmSize: 1025 MB, VmRSS: 215 MB, VmData: 241 MB, maxrss: 0.450552 MB Stage wise_forced finished: 2020-06-05T17:16:02.018221 Resources for stage wise_forced : 4.113 s worker CPU, 6.328 s worker Wall, Wall: 2.529 s, Cores in use: 1.83, Total efficiency (on 4 cores): 45.8 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-05T17:16:02.019982 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/tractor-i/cus/tractor-custom-233174p24499.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/tractor/cus/tractor-custom-233174p24499.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/tractor/cus/brick-custom-233174p24499.sha256sum Stage writecat : Wall: 1.10 s, CPU: 0.88 s, VmPeak: 1157 MB, VmSize: 1029 MB, VmRSS: 217 MB, VmData: 241 MB, maxrss: 0.450552 MB Stage writecat finished: 2020-06-05T17:16:03.119282 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.100 s, Cores in use: 0.80, Total efficiency (on 4 cores): 20.0 % Stage writecat finished All done: 36.618 s worker CPU, 397.993 s worker Wall, Wall: 132.343 s, Cores in use: 0.33, Total efficiency (on 4 cores): 8.2 % Finished galaxy PGC1708768 in 2.247 minutes. Started working on galaxy PGC1708768 at Thu Jul 23 05:02:11 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 233.17458299999998 24.499365 --width 273 --height 273 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-07-23T05:02:13.143914 legacypipe git version: DR9.5.5-21-g66b1aacb Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '233.17458299999998', '24.499365', '--width', '273', '--height', '273', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 233.17458299999998 24.499365 --width 273 --height 273 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 233.17458299999998 24.499365 Starting process 34578 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 34579 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 34580 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058864 MB Starting process 34581 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059156 MB Starting process 34582 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05916 MB Starting process 34583 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059164 MB Starting process 34584 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 34585 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 34586 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 34587 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 34589 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 34588 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB Starting process 34590 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 34591 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 34592 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 34593 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-07-23T05:02:14.589414 Keeping 12 CCDs: c4d_150409_075217_ooi_z_ls9.fits.fz c4d_150409_075217_ooi_z_ls9-N26 z exptime 111.0 propid 2014B-0404 seeing 0.96 MJD 57121.326 object DECaLS_171_z c4d_190304_085515_ooi_z_ls9.fits.fz c4d_190304_085515_ooi_z_ls9-N20 z exptime 104.0 propid 2014B-0404 seeing 1.19 MJD 58546.372 object DECaLS_31915_z c4d_180517_050424_ooi_g_ls9.fits.fz c4d_180517_050424_ooi_g_ls9-N20 g exptime 131.0 propid 2014B-0404 seeing 1.24 MJD 58255.211 object DECaLS_31915_g c4d_180314_083901_ooi_z_ls9.fits.fz c4d_180314_083901_ooi_z_ls9-N20 z exptime 85.0 propid 2014B-0404 seeing 1.37 MJD 58191.360 object DECaLS_31915_z c4d_180515_045944_ooi_r_ls9.fits.fz c4d_180515_045944_ooi_r_ls9-N20 r exptime 148.0 propid 2014B-0404 seeing 1.33 MJD 58253.208 object DECaLS_31915_r c4d_170521_050830_ooi_r_ls9.fits.fz c4d_170521_050830_ooi_r_ls9-N21 r exptime 101.0 propid 2014B-0404 seeing 1.46 MJD 57894.212 object DECaLS_16043_r c4d_170331_084713_ooi_g_ls9.fits.fz c4d_170331_084713_ooi_g_ls9-N21 g exptime 151.0 propid 2014B-0404 seeing 1.53 MJD 57843.364 object DECaLS_16043_g c4d_150410_091047_ooi_z_ls9.fits.fz c4d_150410_091047_ooi_z_ls9-N21 z exptime 108.0 propid 2014B-0404 seeing 1.14 MJD 57122.381 object DECaLS_16043_z c4d_170328_090041_ooi_r_ls9.fits.fz c4d_170328_090041_ooi_r_ls9-N22 r exptime 69.0 propid 2014B-0404 seeing 1.14 MJD 57840.374 object DECaLS_171_r c4d_150409_073716_ooi_z_ls9.fits.fz c4d_150409_073716_ooi_z_ls9-N22 z exptime 80.0 propid 2014B-0404 seeing 1.18 MJD 57121.316 object DECaLS_171_z c4d_170328_084420_ooi_g_ls9.fits.fz c4d_170328_084420_ooi_g_ls9-N22 g exptime 167.0 propid 2014B-0404 seeing 1.32 MJD 57840.362 object DECaLS_171_g c4d_150409_075217_ooi_z_ls9.fits.fz c4d_150409_075217_ooi_z_ls9-N22 z exptime 111.0 propid 2014B-0404 seeing 0.94 MJD 57121.326 object DECaLS_171_z The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95197f6-r-20170521T050556_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956d285-z-20150410T090806_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95718f0-z-20150409T073505_oi[N22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9528b21-z-20180314T083901_oi[N20,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530903-g-20180517T050424_oi[N20,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9516904-g-20170331T084352_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95718f0-z-20150409T074936_oi[N22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951364f-g-20170328T084044_oi[N22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9512bde-r-20170328T085841_oi[N22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534c2e-z-20190304T085515_oi[N20,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955fb7b-r-20180515T045944_oi[N20,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 14.56 s, CPU: 1.15 s, VmPeak: 998 MB, VmSize: 998 MB, VmRSS: 176 MB, VmData: 210 MB, maxrss: 0.180152 MB Stage tims finished: 2020-07-23T05:02:29.145067 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956d285-z-20150410T090806_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9528b21-z-20180314T083901_oi[N20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530903-g-20180517T050424_oi[N20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95718f0-z-20150409T074936_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9516904-g-20170331T084352_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951364f-g-20170328T084044_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9512bde-r-20170328T085841_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534c2e-z-20190304T085515_oi[N20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 7.247 s worker CPU, 119.302 s worker Wall, Wall: 14.558 s, Cores in use: 0.58, Total efficiency (on 16 cores): 3.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95197f6-r-20170521T050556_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955fb7b-r-20180515T045944_oi[N20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-07-23T05:02:29.171743 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03603.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03602.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03731.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03475.fits Matched 11 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/metrics/cus/reference-custom-233174p24499.fits Stage refs : Wall: 4.56 s, CPU: 2.30 s, VmPeak: 1029 MB, VmSize: 1020 MB, VmRSS: 198 MB, VmData: 231 MB, maxrss: 0.202608 MB Stage refs finished: 2020-07-23T05:02:33.735300 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95718f0-z-20150409T073505_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 4.565 s, Cores in use: 0.50, Total efficiency (on 16 cores): 3.2 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-07-23T05:02:33.767043 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/metrics/cus/outlier-mask-custom-233174p24499.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/metrics/cus/outliers-pre-custom-233174p24499.jpg Image c4d_170331_084713_ooi_g_ls9-N21 g : masking 87 positive outlier pixels and 0 negative outlier pixels Image c4d_150409_075217_ooi_z_ls9-N22 z : masking 255 positive outlier pixels and 0 negative outlier pixels Image c4d_150409_073716_ooi_z_ls9-N22 z : masking 384 positive outlier pixels and 0 negative outlier pixels Image c4d_180314_083901_ooi_z_ls9-N20 z : masking 179 positive outlier pixels and 143 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/metrics/cus/outlier-mask-custom-233174p24499.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/metrics/cus/outliers-post-custom-233174p24499.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/metrics/cus/outliers-masked-pos-custom-233174p24499.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/metrics/cus/outliers-masked-neg-custom-233174p24499.jpg Stage outliers : Wall: 1.26 s, CPU: 0.99 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 214 MB, VmData: 244 MB, maxrss: 0.218748 MB Stage outliers finished: 2020-07-23T05:02:35.027739 Resources for stage outliers : 0.771 s worker CPU, 0.818 s worker Wall, Wall: 1.262 s, Cores in use: 1.40, Total efficiency (on 16 cores): 8.7 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-07-23T05:02:35.053259 Stage halos : Wall: 0.36 s, CPU: 0.28 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 214 MB, VmData: 244 MB, maxrss: 0.219064 MB Stage halos finished: 2020-07-23T05:02:35.413856 Resources for stage halos : 0.369 s worker CPU, 0.744 s worker Wall, Wall: 0.362 s, Cores in use: 1.78, Total efficiency (on 16 cores): 11.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-07-23T05:02:35.443637 PSF sigmas in coadd pixels: ['2.01', '2.48', '2.14'] Using average PSF sigma 2.212298858797924 Gaussian PSF norm 0.127512063142842 vs pixelized 0.11579682 average tim pixel scale / coadd scale: 1.001310577431253 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.17', '2.37', '1.86'] Using average PSF sigma 2.1318328786258895 Gaussian PSF norm 0.13232500286594104 vs pixelized 0.11219333 average tim pixel scale / coadd scale: 1.0013145764308575 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.94', '2.22', '1.86', '1.91', '1.53'] Using average PSF sigma 1.8917780908642996 Gaussian PSF norm 0.1491162167149304 vs pixelized 0.12371673 average tim pixel scale / coadd scale: 1.001289955923291 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.18 s, CPU: 0.17 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 216 MB, VmData: 245 MB, maxrss: 0.22152 MB Stage fit_on_coadds finished: 2020-07-23T05:02:35.625052 Resources for stage fit_on_coadds : 0.163 s worker CPU, 0.163 s worker Wall, Wall: 0.183 s, Cores in use: 1.80, Total efficiency (on 16 cores): 11.2 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-07-23T05:02:35.637221 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 15 potential peaks Of 15 potential peaks: 4 in veto map, 3 cut by saddle test, 0 cut by aper test, 8 kept SED z : 8 new peaks Found 12 potential peaks Of 12 potential peaks: 9 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 9 potential peaks Of 9 potential peaks: 9 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 16 potential peaks Of 16 potential peaks: 9 in veto map, 3 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 17 potential peaks Of 17 potential peaks: 15 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 13 new sources Median coadd sky for g : -1.570955e-05 Median coadd sky for r : 5.451814e-05 Median coadd sky for z : 0.00050658826 Stage srcs : Wall: 0.70 s, CPU: 0.66 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 217 MB, VmData: 245 MB, maxrss: 0.221976 MB Stage srcs finished: 2020-07-23T05:02:36.341171 Resources for stage srcs : 0.079 s worker CPU, 0.079 s worker Wall, Wall: 0.705 s, Cores in use: 1.05, Total efficiency (on 16 cores): 6.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-07-23T05:02:36.354147 Blob 1 of 11, id: 6, sources: 4, size: 117x185, npix 9354, brick X: 96,213, Y: 88,273, one pixel: 169 88 Blob 2 of 11, id: 0, sources: 2, size: 50x42, npix 1291, brick X: 173,223, Y: 0,42, one pixel: 198 0 Blob 3 of 11, id: 10, sources: 1, size: 30x28, npix 542, brick X: 4,34, Y: 196,224, one pixel: 16 196 Blob 4 of 11, id: 9, sources: 1, size: 23x32, npix 532, brick X: 250,273, Y: 187,219, one pixel: 265 187 Blob 5 of 11, id: 3, sources: 1, size: 25x26, npix 402, brick X: 215,240, Y: 17,43, one pixel: 227 17 Blob 6 of 11, id: 5, sources: 1, size: 24x22, npix 325, brick X: 236,260, Y: 86,108, one pixel: 245 86 Blob 7 of 11, id: 7, sources: 1, size: 20x21, npix 239, brick X: 236,256, Y: 127,148, one pixel: 245 127 Blob 8 of 11, id: 2, sources: 1, size: 20x20, npix 238, brick X: 59,79, Y: 10,30, one pixel: 67 10 Blob 9 of 11, id: 4, sources: 1, size: 20x18, npix 216, brick X: 248,268, Y: 63,81, one pixel: 256 63 Blob 10 of 11, id: 1, sources: 1, size: 18x20, npix 198, brick X: 0,18, Y: 9,29, one pixel: 8 9 Blob 11 of 11, id: 8, sources: 1, size: 15x21, npix 194, brick X: 258,273, Y: 149,170, one pixel: 268 149 Blob 7 finished, total: Wall: 0.17 s, CPU: 0.16 s, VmPeak: 692 MB, VmSize: 692 MB, VmRSS: 116 MB, VmData: 169 MB, maxrss: 0.118496 MB Blob 9 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 664 MB, VmSize: 664 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097084 MB Blob 8 finished, total: Wall: 0.44 s, CPU: 0.43 s, VmPeak: 953 MB, VmSize: 719 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144192 MB Blob 11 finished, total: Wall: 0.65 s, CPU: 0.64 s, VmPeak: 685 MB, VmSize: 685 MB, VmRSS: 117 MB, VmData: 160 MB, maxrss: 0.119948 MB Blob 3 finished, total: Wall: 0.67 s, CPU: 0.66 s, VmPeak: 952 MB, VmSize: 720 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143128 MB Blob 6 finished, total: Wall: 0.82 s, CPU: 0.81 s, VmPeak: 953 MB, VmSize: 719 MB, VmRSS: 140 MB, VmData: 180 MB, maxrss: 0.143328 MB Blob 10 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 954 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145168 MB Blob 5 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 953 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14534 MB Blob 4 finished, total: Wall: 0.90 s, CPU: 0.90 s, VmPeak: 955 MB, VmSize: 725 MB, VmRSS: 147 MB, VmData: 186 MB, maxrss: 0.150336 MB Measuring 1 iterative sources Blob 2 finished, total: Wall: 1.74 s, CPU: 1.74 s, VmPeak: 954 MB, VmSize: 720 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143764 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.7695, ee1=-0.753729, ee2=0.903042 Measuring 5 iterative sources Blob 1 finished, total: Wall: 11.22 s, CPU: 11.21 s, VmPeak: 953 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148364 MB Old catalog: 17 New catalog: 20 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/metrics/cus/blobs-custom-233174p24499.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/metrics/cus/all-models-custom-233174p24499.fits Stage fitblobs : Wall: 11.64 s, CPU: 0.39 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 217 MB, VmData: 245 MB, maxrss: 0.222348 MB Stage fitblobs finished: 2020-07-23T05:02:47.994031 Resources for stage fitblobs : 18.700 s worker CPU, 18.858 s worker Wall, Wall: 11.642 s, Cores in use: 1.64, Total efficiency (on 16 cores): 10.2 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-07-23T05:02:48.008806 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/tmp-legacysurvey-custom-233174p24499-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/tmp-legacysurvey-custom-233174p24499-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/tmp-legacysurvey-custom-233174p24499-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/tmp-legacysurvey-custom-233174p24499-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-resid.jpg Stage coadds : Wall: 1.74 s, CPU: 0.51 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 218 MB, VmData: 245 MB, maxrss: 0.222928 MB Stage coadds finished: 2020-07-23T05:02:49.746975 Resources for stage coadds : 9.843 s worker CPU, 11.167 s worker Wall, Wall: 1.740 s, Cores in use: 5.95, Total efficiency (on 16 cores): 37.2 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-07-23T05:02:49.759981 Cut to 1 unWISE tiles Reading WISE tile 2328p242 band 2 Reading WISE tile 2328p242 band 1 Reading WISE tile 2328p242 band 3 Reading WISE tile 2328p242 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 954 MB, VmSize: 798 MB, VmRSS: 149 MB, VmData: 175 MB, maxrss: 0.19292 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 793 MB, VmSize: 790 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.202156 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 952 MB, VmSize: 792 MB, VmRSS: 141 MB, VmData: 174 MB, maxrss: 0.20312 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2328p242/unwise-2328p242-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 953 MB, VmSize: 797 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.21018 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/tmp-legacysurvey-custom-233174p24499-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/tmp-legacysurvey-custom-233174p24499-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 1.99 s, CPU: 0.58 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 218 MB, VmData: 245 MB, maxrss: 0.223632 MB Stage wise_forced finished: 2020-07-23T05:02:51.745965 Resources for stage wise_forced : 3.091 s worker CPU, 4.253 s worker Wall, Wall: 1.988 s, Cores in use: 1.85, Total efficiency (on 16 cores): 11.6 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-07-23T05:02:51.760886 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/coadd/cus/custom-233174p24499/legacysurvey-custom-233174p24499-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/tractor-i/cus/tractor-custom-233174p24499.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/tractor/cus/tractor-custom-233174p24499.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/tractor/cus/brick-custom-233174p24499.sha256sum Stage writecat : Wall: 0.66 s, CPU: 0.50 s, VmPeak: 1162 MB, VmSize: 1034 MB, VmRSS: 220 MB, VmData: 245 MB, maxrss: 0.356504 MB Stage writecat finished: 2020-07-23T05:02:52.424989 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.666 s, Cores in use: 0.75, Total efficiency (on 16 cores): 4.7 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1708768/PGC1708768-largegalaxy-writecat.p All done: 40.268 s worker CPU, 155.391 s worker Wall, Wall: 37.861 s, Cores in use: 1.27, Total efficiency (on 16 cores): 7.9 % Finished galaxy PGC1708768 in 0.701 minutes.