Started working on galaxy PGC1028396 at Sat Jun 6 16:16:30 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 134.0611365 -6.8105231 --width 335 --height 335 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/PGC1028396-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/PGC1028396-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-06T16:16:31.417188 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '134.0611365', '-6.8105231', '--width', '335', '--height', '335', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/PGC1028396-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/PGC1028396-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 134.0611365 -6.8105231 --width 335 --height 335 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/PGC1028396-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/PGC1028396-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 134.0611365 -6.8105231 Starting process 61511 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 61512 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 61513 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 61514 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-06T16:16:31.993000 Keeping 9 CCDs: c4d_180128_060034_ooi_z_ls9.fits.fz c4d_180128_060034_ooi_z_ls9-N17 z exptime 92.0 propid 2014B-0404 seeing 0.82 MJD 58146.250 object DECaLS_15635_z c4d_180211_060809_ooi_r_ls9.fits.fz c4d_180211_060809_ooi_r_ls9-N17 r exptime 42.0 propid 2014B-0404 seeing 0.94 MJD 58160.256 object DECaLS_15635_r c4d_180211_060921_ooi_g_ls9.fits.fz c4d_180211_060921_ooi_g_ls9-N17 g exptime 91.0 propid 2014B-0404 seeing 0.98 MJD 58160.257 object DECaLS_15635_g c4d_181017_080944_ooi_g_ls9.fits.fz c4d_181017_080944_ooi_g_ls9-N9 g exptime 200.0 propid 2014B-0404 seeing 1.96 MJD 58408.340 object DECaLS_47379_g c4d_180225_010200_ooi_z_ls9.fits.fz c4d_180225_010200_ooi_z_ls9-N9 z exptime 80.0 propid 2014B-0404 seeing 0.77 MJD 58174.043 object DECaLS_47379_z c4d_181013_082249_ooi_r_ls9.fits.fz c4d_181013_082249_ooi_r_ls9-N9 r exptime 110.0 propid 2014B-0404 seeing 1.87 MJD 58404.349 object DECaLS_47379_r c4d_180128_060252_ooi_z_ls9.fits.fz c4d_180128_060252_ooi_z_ls9-N10 z exptime 85.0 propid 2014B-0404 seeing 0.88 MJD 58146.252 object DECaLS_31507_z c4d_180221_060645_ooi_g_ls9.fits.fz c4d_180221_060645_ooi_g_ls9-N10 g exptime 118.0 propid 2014B-0404 seeing 1.10 MJD 58170.255 object DECaLS_31507_g c4d_180222_051932_ooi_r_ls9.fits.fz c4d_180222_051932_ooi_r_ls9-N10 r exptime 40.0 propid 2014B-0404 seeing 0.75 MJD 58171.222 object DECaLS_31507_r The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9529f0d-r-20180211T060809_oi[N17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952a2af-g-20180211T060921_oi[N17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537f22-g-20181017T080944_oi[N9,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9525b6d-z-20180128T060034_oi[N17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953732d-r-20181013T082249_oi[N9,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95285f9-z-20180225T010200_oi[N9,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952bd60-g-20180221T060645_oi[N10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9525b6d-z-20180128T060252_oi[N10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952bf3b-r-20180222T051932_oi[N10,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 162.32 s, CPU: 0.86 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 178 MB, VmData: 212 MB, maxrss: 0.4546 MB Stage tims finished: 2020-06-06T16:19:14.308429 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9529f0d-r-20180211T060809_oi[N17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95285f9-z-20180225T010200_oi[N9,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9525b6d-z-20180128T060034_oi[N17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952bd60-g-20180221T060645_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952a2af-g-20180211T060921_oi[N17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953732d-r-20181013T082249_oi[N9,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952bf3b-r-20180222T051932_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537f22-g-20181017T080944_oi[N9,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9525b6d-z-20180128T060252_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 3.854 s worker CPU, 479.039 s worker Wall, Wall: 162.317 s, Cores in use: 0.03, Total efficiency (on 4 cores): 0.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/PGC1028396-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/PGC1028396-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-06T16:19:14.332009 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06768.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06895.fits Matched 3 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/metrics/cus/reference-custom-134061m06810.fits Stage refs : Wall: 3.43 s, CPU: 2.89 s, VmPeak: 1037 MB, VmSize: 1031 MB, VmRSS: 216 MB, VmData: 248 MB, maxrss: 0.4546 MB Stage refs finished: 2020-06-06T16:19:17.766685 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.436 s, Cores in use: 0.84, Total efficiency (on 4 cores): 21.0 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-06T16:19:17.768013 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/metrics/cus/outlier-mask-custom-134061m06810.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/metrics/cus/outliers-pre-custom-134061m06810.jpg Image c4d_181017_080944_ooi_g_ls9-N9 g : masking 3133 positive outlier pixels and 0 negative outlier pixels Image c4d_180211_060921_ooi_g_ls9-N17 g : masking 572 positive outlier pixels and 0 negative outlier pixels Image c4d_181013_082249_ooi_r_ls9-N9 r : masking 911 positive outlier pixels and 0 negative outlier pixels Image c4d_180211_060809_ooi_r_ls9-N17 r : masking 370 positive outlier pixels and 0 negative outlier pixels Image c4d_180128_060034_ooi_z_ls9-N17 z : masking 168 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/metrics/cus/outlier-mask-custom-134061m06810.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/metrics/cus/outliers-post-custom-134061m06810.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/metrics/cus/outliers-masked-pos-custom-134061m06810.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/metrics/cus/outliers-masked-neg-custom-134061m06810.jpg Stage outliers : Wall: 5.83 s, CPU: 5.43 s, VmPeak: 1041 MB, VmSize: 1041 MB, VmRSS: 235 MB, VmData: 265 MB, maxrss: 0.4546 MB Stage outliers finished: 2020-06-06T16:19:23.597162 Resources for stage outliers : 1.372 s worker CPU, 1.436 s worker Wall, Wall: 5.830 s, Cores in use: 1.17, Total efficiency (on 4 cores): 29.2 % Stage outliers finished Running stage halos Running stage halos at 2020-06-06T16:19:23.598712 Stage halos : Wall: 12.18 s, CPU: 8.29 s, VmPeak: 1041 MB, VmSize: 1041 MB, VmRSS: 235 MB, VmData: 265 MB, maxrss: 0.4546 MB Stage halos finished: 2020-06-06T16:19:35.779143 Resources for stage halos : 0.846 s worker CPU, 11.075 s worker Wall, Wall: 12.182 s, Cores in use: 0.75, Total efficiency (on 4 cores): 18.8 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-06T16:19:35.781024 PSF sigmas in coadd pixels: ['1.59', '3.18', '1.78'] Using average PSF sigma 2.1852602082035433 Gaussian PSF norm 0.12908979475985718 vs pixelized 0.103644796 average tim pixel scale / coadd scale: 1.0012025377919314 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.53', '3.04', '1.22'] Using average PSF sigma 1.928507238510986 Gaussian PSF norm 0.14627624213206766 vs pixelized 0.11564008 average tim pixel scale / coadd scale: 1.0012095693662364 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.34', '1.25', '1.44'] Using average PSF sigma 1.3413642896607236 Gaussian PSF norm 0.21030438483287003 vs pixelized 0.17022903 average tim pixel scale / coadd scale: 1.0010473766072674 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.28 s, CPU: 0.22 s, VmPeak: 1041 MB, VmSize: 1041 MB, VmRSS: 238 MB, VmData: 266 MB, maxrss: 0.4546 MB Stage fit_on_coadds finished: 2020-06-06T16:19:36.060085 Resources for stage fit_on_coadds : 0.336 s worker CPU, 0.338 s worker Wall, Wall: 0.280 s, Cores in use: 2.00, Total efficiency (on 4 cores): 49.9 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-06T16:19:36.062419 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 246 potential peaks Of 246 potential peaks: 181 in veto map, 19 cut by saddle test, 0 cut by aper test, 46 kept SED z : 46 new peaks Found 167 potential peaks Of 167 potential peaks: 150 in veto map, 11 cut by saddle test, 0 cut by aper test, 6 kept SED r : 6 new peaks Found 136 potential peaks Of 136 potential peaks: 123 in veto map, 10 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 184 potential peaks Of 184 potential peaks: 169 in veto map, 12 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 282 potential peaks Of 282 potential peaks: 264 in veto map, 18 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 58 new sources Median coadd sky for g : 0.00018546973 Median coadd sky for r : 0.0005809393 Median coadd sky for z : 0.0011448077 Stage srcs : Wall: 2.33 s, CPU: 2.27 s, VmPeak: 1041 MB, VmSize: 1041 MB, VmRSS: 239 MB, VmData: 266 MB, maxrss: 0.4546 MB Stage srcs finished: 2020-06-06T16:19:38.395159 Resources for stage srcs : 0.161 s worker CPU, 0.161 s worker Wall, Wall: 2.334 s, Cores in use: 1.04, Total efficiency (on 4 cores): 26.0 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/PGC1028396-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/PGC1028396-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-06T16:19:38.410665 Blob 1 of 13, id: 2, sources: 57, size: 335x335, npix 68224, brick X: 0,335, Y: 0,335, one pixel: 296 0 Blob 2 of 13, id: 5, sources: 4, size: 42x62, npix 1519, brick X: 277,319, Y: 185,247, one pixel: 297 185 Blob 3 of 13, id: 4, sources: 1, size: 33x33, npix 628, brick X: 38,71, Y: 92,125, one pixel: 52 92 Blob 4 of 13, id: 9, sources: 1, size: 30x31, npix 592, brick X: 250,280, Y: 257,288, one pixel: 267 257 Blob 5 of 13, id: 1, sources: 1, size: 31x25, npix 535, brick X: 101,132, Y: 0,25, one pixel: 106 0 Blob 4 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14778 MB Blob 6 of 13, id: 8, sources: 1, size: 24x30, npix 488, brick X: 311,335, Y: 252,282, one pixel: 322 252 Measuring 1 iterative sources Blob 3 finished, total: Wall: 1.02 s, CPU: 1.02 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147576 MB Blob 7 of 13, id: 11, sources: 1, size: 32x20, npix 454, brick X: 281,313, Y: 315,335, one pixel: 296 315 Blob 6 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147576 MB Blob 8 of 13, id: 3, sources: 1, size: 26x27, npix 452, brick X: 3,29, Y: 23,50, one pixel: 17 23 Measuring 1 iterative sources Blob 5 finished, total: Wall: 1.72 s, CPU: 1.72 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149716 MB Blob 9 of 13, id: 10, sources: 1, size: 27x21, npix 387, brick X: 163,190, Y: 314,335, one pixel: 174 314 Blob 7 finished, total: Wall: 1.38 s, CPU: 1.38 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147576 MB Blob 10 of 13, id: 12, sources: 1, size: 25x17, npix 292, brick X: 130,155, Y: 318,335, one pixel: 139 318 Blob 2 finished, total: Wall: 3.50 s, CPU: 3.50 s, VmPeak: 957 MB, VmSize: 721 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151096 MB Blob 11 of 13, id: 0, sources: 1, size: 16x20, npix 250, brick X: 0,16, Y: 0,20, one pixel: 0 0 Blob 8 finished, total: Wall: 1.32 s, CPU: 1.32 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149716 MB Blob 12 of 13, id: 6, sources: 1, size: 16x22, npix 231, brick X: 319,335, Y: 230,252, one pixel: 329 230 Blob 9 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147576 MB Blob 13 of 13, id: 7, sources: 1, size: 19x20, npix 218, brick X: 298,317, Y: 244,264, one pixel: 306 244 Blob 10 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 957 MB, VmSize: 721 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151096 MB Blob 12 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147576 MB Blob 13 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 957 MB, VmSize: 721 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151096 MB Blob 11 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149716 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (134.04957, -6.82339), pm (-33.8, 25.0), parallax 3.178 with NanoMaggies: g=16.4, r=15.5, z=14 Reset brightness to NanoMaggies: g=15.3, r=14.3, z=13.8 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (134.05707, -6.79692), pm (-1.3, -6.4), parallax 0.226 with NanoMaggies: g=14.8, r=14.1, z=13.6 Reset brightness to NanoMaggies: g=15.2, r=14.5, z=14.2 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.99287, ee1=-0.0756396, ee2=0.3182 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (134.04631, -6.81948), pm (0.8, 2.1), parallax 0.462 with NanoMaggies: g=19.5, r=18.2, z=17.5 Reset brightness to NanoMaggies: g=19.5, r=18.2, z=17.5 Measuring 16 iterative sources Blob 1 finished, total: Wall: 69.66 s, CPU: 69.66 s, VmPeak: 961 MB, VmSize: 765 MB, VmRSS: 200 MB, VmData: 228 MB, maxrss: 0.208092 MB Old catalog: 80 New catalog: 86 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/metrics/cus/blobs-custom-134061m06810.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/metrics/cus/all-models-custom-134061m06810.fits Stage fitblobs : Wall: 70.24 s, CPU: 0.55 s, VmPeak: 1041 MB, VmSize: 1041 MB, VmRSS: 243 MB, VmData: 270 MB, maxrss: 0.4546 MB Stage fitblobs finished: 2020-06-06T16:20:48.655534 Resources for stage fitblobs : 83.282 s worker CPU, 83.304 s worker Wall, Wall: 70.247 s, Cores in use: 1.19, Total efficiency (on 4 cores): 29.8 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-06T16:20:48.658409 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/tmp-legacysurvey-custom-134061m06810-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/tmp-legacysurvey-custom-134061m06810-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/tmp-legacysurvey-custom-134061m06810-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/tmp-legacysurvey-custom-134061m06810-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-resid.jpg Stage coadds : Wall: 1.87 s, CPU: 0.57 s, VmPeak: 1041 MB, VmSize: 1041 MB, VmRSS: 243 MB, VmData: 270 MB, maxrss: 0.4546 MB Stage coadds finished: 2020-06-06T16:20:50.530952 Resources for stage coadds : 4.228 s worker CPU, 4.335 s worker Wall, Wall: 1.873 s, Cores in use: 2.56, Total efficiency (on 4 cores): 64.1 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-06T16:20:50.532442 Cut to 2 unWISE tiles Reading WISE tile 1336m061 band 2 Reading WISE tile 1336m061 band 1 Reading WISE tile 1336m061 band 3 Reading WISE tile 1336m061 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/133/1336m061/unwise-1336m061-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/133/1336m061/unwise-1336m061-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/133/1336m061/unwise-1336m061-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/133/1336m061/unwise-1336m061-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/133/1336m061/unwise-1336m061-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1342m076 band 4 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/133/1336m061/unwise-1336m061-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/133/1336m061/unwise-1336m061-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/133/1336m061/unwise-1336m061-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/133/1336m061/unwise-1336m061-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1342m076 band 1 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/134/1342m076/unwise-1342m076-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/134/1342m076/unwise-1342m076-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/134/1342m076/unwise-1342m076-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/134/1342m076/unwise-1342m076-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.33 s, CPU: 0.65 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 151 MB, VmData: 188 MB, maxrss: 0.21488 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/134/1342m076/unwise-1342m076-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/134/1342m076/unwise-1342m076-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/134/1342m076/unwise-1342m076-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/134/1342m076/unwise-1342m076-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/134/1342m076/unwise-1342m076-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.56 s, CPU: 1.24 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 155 MB, VmData: 193 MB, maxrss: 0.194612 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/133/1336m061/unwise-1336m061-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/133/1336m061/unwise-1336m061-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/133/1336m061/unwise-1336m061-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/133/1336m061/unwise-1336m061-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/133/1336m061/unwise-1336m061-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1342m076 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/133/1336m061/unwise-1336m061-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/133/1336m061/unwise-1336m061-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/133/1336m061/unwise-1336m061-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/133/1336m061/unwise-1336m061-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1342m076 band 2 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/134/1342m076/unwise-1342m076-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/134/1342m076/unwise-1342m076-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/134/1342m076/unwise-1342m076-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/134/1342m076/unwise-1342m076-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.32 s, CPU: 0.67 s, VmPeak: 1025 MB, VmSize: 1025 MB, VmRSS: 180 MB, VmData: 212 MB, maxrss: 0.238104 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/134/1342m076/unwise-1342m076-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/134/1342m076/unwise-1342m076-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/134/1342m076/unwise-1342m076-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/134/1342m076/unwise-1342m076-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/134/1342m076/unwise-1342m076-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.33 s, CPU: 0.85 s, VmPeak: 1062 MB, VmSize: 998 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.212216 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/tmp-legacysurvey-custom-134061m06810-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/tmp-legacysurvey-custom-134061m06810-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 10.62 s, CPU: 1.74 s, VmPeak: 1041 MB, VmSize: 1041 MB, VmRSS: 244 MB, VmData: 270 MB, maxrss: 0.4546 MB Stage wise_forced finished: 2020-06-06T16:21:01.155766 Resources for stage wise_forced : 9.869 s worker CPU, 25.754 s worker Wall, Wall: 10.625 s, Cores in use: 1.09, Total efficiency (on 4 cores): 27.3 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-06T16:21:01.157505 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/coadd/cus/custom-134061m06810/legacysurvey-custom-134061m06810-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/tractor-i/cus/tractor-custom-134061m06810.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/tractor/cus/tractor-custom-134061m06810.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC1028396/tractor/cus/brick-custom-134061m06810.sha256sum Stage writecat : Wall: 1.27 s, CPU: 1.12 s, VmPeak: 1173 MB, VmSize: 1045 MB, VmRSS: 246 MB, VmData: 270 MB, maxrss: 0.4546 MB Stage writecat finished: 2020-06-06T16:21:02.431836 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.275 s, Cores in use: 0.88, Total efficiency (on 4 cores): 22.0 % Stage writecat finished All done: 103.949 s worker CPU, 605.443 s worker Wall, Wall: 270.443 s, Cores in use: 0.47, Total efficiency (on 4 cores): 11.8 % Finished galaxy PGC1028396 in 4.550 minutes.