Started working on galaxy PGC1555879 at Sun Jun 7 07:05:13 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.9734715 18.306434600000003 --width 239 --height 239 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/PGC1555879-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/PGC1555879-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T07:05:14.963114 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '336.9734715', '18.306434600000003', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/PGC1555879-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/PGC1555879-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.9734715 18.306434600000003 --width 239 --height 239 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/PGC1555879-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/PGC1555879-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 336.9734715 18.306434600000003 Starting process 35598 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 35599 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 35600 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 35601 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T07:05:21.634410 Keeping 10 CCDs: c4d_170724_061359_ooi_g_ls9.fits.fz c4d_170724_061359_ooi_g_ls9-N3 g exptime 200.0 propid 2014B-0404 seeing 1.96 MJD 57958.257 object DECaLS_39522_g c4d_180918_020610_ooi_z_ls9.fits.fz c4d_180918_020610_ooi_z_ls9-N3 z exptime 124.0 propid 2014B-0404 seeing 1.56 MJD 58379.088 object DECaLS_39522_z c4d_180903_035217_ooi_r_ls9.fits.fz c4d_180903_035217_ooi_r_ls9-N4 r exptime 40.0 propid 2014B-0404 seeing 1.38 MJD 58364.161 object DECaLS_23650_r c4d_180903_034947_ooi_g_ls9.fits.fz c4d_180903_034947_ooi_g_ls9-N4 g exptime 116.0 propid 2014B-0404 seeing 1.53 MJD 58364.160 object DECaLS_23650_g c4d_170920_022945_ooi_r_ls9.fits.fz c4d_170920_022945_ooi_r_ls9-N4 r exptime 80.0 propid 2014B-0404 seeing 1.98 MJD 58016.104 object DECaLS_23650_r c4d_181017_004318_ooi_z_ls9.fits.fz c4d_181017_004318_ooi_z_ls9-N4 z exptime 160.0 propid 2014B-0404 seeing 1.34 MJD 58408.030 object DECaLS_23650_z c4d_140811_083505_ooi_z_ls9.fits.fz c4d_140811_083505_ooi_z_ls9-N4 z exptime 141.0 propid 2014B-0404 seeing 1.30 MJD 56880.355 object DECaLS_23650_z c4d_180811_044943_ooi_g_ls9.fits.fz c4d_180811_044943_ooi_g_ls9-N5 g exptime 79.0 propid 2014B-0404 seeing 1.23 MJD 58341.201 object DECaLS_7778_g c4d_180811_044835_ooi_r_ls9.fits.fz c4d_180811_044835_ooi_r_ls9-N5 r exptime 40.0 propid 2014B-0404 seeing 1.25 MJD 58341.200 object DECaLS_7778_r c4d_180916_024748_ooi_z_ls9.fits.fz c4d_180916_024748_ooi_z_ls9-N5 z exptime 102.0 propid 2014B-0404 seeing 1.37 MJD 58377.117 object DECaLS_7778_z The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f17b-z-20180918T020610_oi[N3,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180903T035217_oi[N4,noinherit][2046,4094][real]: DECaLS_23650 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951f216-g-20170724T060947_oi[N3,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180903T034947_oi[N4,noinherit][2046,4094][real]: DECaLS_23650 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9524507-r-20170920T022945_oi[N4,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9531bff-z-20181017T004318_oi[N4,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a245-z-20140811T083152_oi[N4,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95328e1-g-20180811T044943_oi[N5,noinherit][2046,4094][real]: DECaLS_7 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532014-r-20180811T044835_oi[N5,noinherit][2046,4094][real]: DECaLS_7 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952e572-z-20180916T024748_oi[N5,noinherit][2046,4094][real]: DECaLS_7 Stage tims : Wall: 70.06 s, CPU: 8.00 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 173 MB, VmData: 207 MB, maxrss: 0.45466 MB Stage tims finished: 2020-06-07T07:06:31.698507 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951f216-g-20170724T060947_oi[N3,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a245-z-20140811T083152_oi[N4,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180903T034947_oi[N4,noinherit][2046,4094][real]: DECaLS_23650 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95328e1-g-20180811T044943_oi[N5,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f17b-z-20180918T020610_oi[N3,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9524507-r-20170920T022945_oi[N4,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532014-r-20180811T044835_oi[N5,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180903T035217_oi[N4,noinherit][2046,4094][real]: DECaLS_23650 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9531bff-z-20181017T004318_oi[N4,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952e572-z-20180916T024748_oi[N5,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card] Resources for stage tims : 4.178 s worker CPU, 216.425 s worker Wall, Wall: 70.066 s, Cores in use: 0.17, Total efficiency (on 4 cores): 4.3 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/PGC1555879-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/PGC1555879-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T07:06:31.963494 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04280.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04151.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04407.fits Matched 6 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/metrics/cus/reference-custom-336973p18306.fits Stage refs : Wall: 5.98 s, CPU: 4.77 s, VmPeak: 1030 MB, VmSize: 1024 MB, VmRSS: 203 MB, VmData: 236 MB, maxrss: 0.45466 MB Stage refs finished: 2020-06-07T07:06:37.940402 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.978 s, Cores in use: 0.80, Total efficiency (on 4 cores): 20.0 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T07:06:37.941901 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/metrics/cus/outlier-mask-custom-336973p18306.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/metrics/cus/outliers-pre-custom-336973p18306.jpg Image c4d_170920_022945_ooi_r_ls9-N4 r : masking 4253 positive outlier pixels and 0 negative outlier pixels Image c4d_180916_024748_ooi_z_ls9-N5 z : masking 209 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/metrics/cus/outlier-mask-custom-336973p18306.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/metrics/cus/outliers-post-custom-336973p18306.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/metrics/cus/outliers-masked-pos-custom-336973p18306.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/metrics/cus/outliers-masked-neg-custom-336973p18306.jpg Stage outliers : Wall: 5.51 s, CPU: 5.28 s, VmPeak: 1034 MB, VmSize: 1034 MB, VmRSS: 215 MB, VmData: 246 MB, maxrss: 0.45466 MB Stage outliers finished: 2020-06-07T07:06:43.455478 Resources for stage outliers : 0.761 s worker CPU, 0.777 s worker Wall, Wall: 5.515 s, Cores in use: 1.10, Total efficiency (on 4 cores): 27.4 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T07:06:43.457364 Stage halos : Wall: 5.02 s, CPU: 3.20 s, VmPeak: 1034 MB, VmSize: 1034 MB, VmRSS: 215 MB, VmData: 246 MB, maxrss: 0.45466 MB Stage halos finished: 2020-06-07T07:06:48.475927 Resources for stage halos : 0.348 s worker CPU, 6.045 s worker Wall, Wall: 5.020 s, Cores in use: 0.71, Total efficiency (on 4 cores): 17.7 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T07:06:48.477884 PSF sigmas in coadd pixels: ['3.19', '2.49', '1.99'] Using average PSF sigma 2.5560902413800455 Gaussian PSF norm 0.1103618280791111 vs pixelized 0.09142676 average tim pixel scale / coadd scale: 1.0012346297637595 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.23', '3.22', '2.03'] Using average PSF sigma 2.496047995253151 Gaussian PSF norm 0.11301657352356637 vs pixelized 0.09819711 average tim pixel scale / coadd scale: 1.0012160344155974 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.53', '2.18', '2.11', '2.22'] Using average PSF sigma 2.2602938059620916 Gaussian PSF norm 0.12480447941315524 vs pixelized 0.10444408 average tim pixel scale / coadd scale: 1.0011959894300786 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.19 s, CPU: 0.16 s, VmPeak: 1034 MB, VmSize: 1034 MB, VmRSS: 217 MB, VmData: 246 MB, maxrss: 0.45466 MB Stage fit_on_coadds finished: 2020-06-07T07:06:48.663856 Resources for stage fit_on_coadds : 0.196 s worker CPU, 0.207 s worker Wall, Wall: 0.187 s, Cores in use: 1.89, Total efficiency (on 4 cores): 47.4 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T07:06:48.666686 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 26 potential peaks Of 26 potential peaks: 9 in veto map, 4 cut by saddle test, 0 cut by aper test, 13 kept SED z : 13 new peaks Found 20 potential peaks Of 20 potential peaks: 16 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 18 potential peaks Of 18 potential peaks: 14 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 35 potential peaks Of 35 potential peaks: 29 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 36 potential peaks Of 36 potential peaks: 32 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 19 new sources Median coadd sky for g : 7.264537e-05 Median coadd sky for r : 0.00023115992 Median coadd sky for z : 0.00036371595 Stage srcs : Wall: 4.54 s, CPU: 4.51 s, VmPeak: 1034 MB, VmSize: 1034 MB, VmRSS: 217 MB, VmData: 246 MB, maxrss: 0.45466 MB Stage srcs finished: 2020-06-07T07:06:53.206196 Resources for stage srcs : 0.094 s worker CPU, 0.094 s worker Wall, Wall: 4.540 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/PGC1555879-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/PGC1555879-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T07:06:53.216684 Blob 1 of 12, id: 3, sources: 7, size: 157x145, npix 14307, brick X: 43,200, Y: 39,184, one pixel: 164 39 Blob 2 of 12, id: 8, sources: 1, size: 49x34, npix 1058, brick X: 74,123, Y: 178,212, one pixel: 90 178 Blob 3 of 12, id: 7, sources: 2, size: 46x40, npix 1044, brick X: 153,199, Y: 158,198, one pixel: 166 158 Blob 4 of 12, id: 0, sources: 2, size: 49x38, npix 1020, brick X: 11,60, Y: 0,38, one pixel: 39 0 Blob 5 of 12, id: 9, sources: 1, size: 30x29, npix 569, brick X: 3,33, Y: 186,215, one pixel: 18 186 Blob 3 finished, total: Wall: 1.43 s, CPU: 1.43 s, VmPeak: 958 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146656 MB Blob 6 of 12, id: 4, sources: 1, size: 29x29, npix 550, brick X: 61,90, Y: 46,75, one pixel: 75 46 Blob 4 finished, total: Wall: 1.55 s, CPU: 1.55 s, VmPeak: 960 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146636 MB Blob 7 of 12, id: 6, sources: 1, size: 33x27, npix 513, brick X: 28,61, Y: 156,183, one pixel: 39 156 Measuring 1 iterative sources Blob 2 finished, total: Wall: 1.90 s, CPU: 1.90 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149212 MB Blob 8 of 12, id: 10, sources: 1, size: 25x25, npix 374, brick X: 197,222, Y: 202,227, one pixel: 209 202 Blob 6 finished, total: Wall: 0.98 s, CPU: 0.98 s, VmPeak: 960 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146636 MB Blob 5 finished, total: Wall: 1.10 s, CPU: 1.10 s, VmPeak: 958 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146656 MB Blob 9 of 12, id: 2, sources: 1, size: 23x23, npix 328, brick X: 174,197, Y: 16,39, one pixel: 183 16 Blob 10 of 12, id: 1, sources: 2, size: 27x16, npix 302, brick X: 78,105, Y: 0,16, one pixel: 80 0 Blob 9 finished, total: Wall: 0.24 s, CPU: 0.23 s, VmPeak: 958 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146656 MB Blob 11 of 12, id: 5, sources: 1, size: 15x24, npix 254, brick X: 0,15, Y: 48,72, one pixel: 2 48 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (336.97561, 18.29759), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=22.5, r=21, z=19.6 Reset brightness to NanoMaggies: g=22.4, r=20.9, z=19.8 Blob 10 finished, total: Wall: 0.12 s, CPU: 0.12 s, VmPeak: 958 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146656 MB Blob 12 of 12, id: 11, sources: 1, size: 19x19, npix 181, brick X: 56,75, Y: 219,238, one pixel: 65 219 Blob 7 finished, total: Wall: 1.34 s, CPU: 1.34 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149212 MB Blob 8 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 960 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146636 MB Blob 12 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149212 MB Blob 11 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 958 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146656 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.803355, ee1=-0.112164, ee2=0.244301 Measuring 3 iterative sources Blob 1 finished, total: Wall: 7.77 s, CPU: 7.76 s, VmPeak: 955 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.15018 MB Old catalog: 25 New catalog: 21 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/metrics/cus/blobs-custom-336973p18306.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/metrics/cus/all-models-custom-336973p18306.fits Stage fitblobs : Wall: 12.12 s, CPU: 3.99 s, VmPeak: 1034 MB, VmSize: 1034 MB, VmRSS: 217 MB, VmData: 246 MB, maxrss: 0.45466 MB Stage fitblobs finished: 2020-06-07T07:07:05.340065 Resources for stage fitblobs : 18.309 s worker CPU, 18.342 s worker Wall, Wall: 12.125 s, Cores in use: 1.84, Total efficiency (on 4 cores): 46.0 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T07:07:05.341959 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/tmp-legacysurvey-custom-336973p18306-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/tmp-legacysurvey-custom-336973p18306-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/tmp-legacysurvey-custom-336973p18306-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/tmp-legacysurvey-custom-336973p18306-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-resid.jpg Stage coadds : Wall: 6.05 s, CPU: 5.25 s, VmPeak: 1034 MB, VmSize: 1034 MB, VmRSS: 218 MB, VmData: 246 MB, maxrss: 0.45466 MB Stage coadds finished: 2020-06-07T07:07:11.391982 Resources for stage coadds : 2.268 s worker CPU, 2.382 s worker Wall, Wall: 6.051 s, Cores in use: 1.24, Total efficiency (on 4 cores): 31.1 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T07:07:11.393331 Cut to 2 unWISE tiles Reading WISE tile 3362p181 band 1 Reading WISE tile 3362p181 band 2 Reading WISE tile 3362p181 band 3 Reading WISE tile 3362p181 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3362p181/unwise-3362p181-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/336/3362p181/unwise-3362p181-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/336/3362p181/unwise-3362p181-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/336/3362p181/unwise-3362p181-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/336/3362p181/unwise-3362p181-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3377p181 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3362p181/unwise-3362p181-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3362p181/unwise-3362p181-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3362p181/unwise-3362p181-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3362p181/unwise-3362p181-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3377p181 band 2 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3362p181/unwise-3362p181-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3362p181/unwise-3362p181-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3362p181/unwise-3362p181-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3362p181/unwise-3362p181-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3377p181 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3377p181/unwise-3377p181-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3377p181/unwise-3377p181-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3377p181/unwise-3377p181-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3377p181/unwise-3377p181-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3377p181/unwise-3377p181-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 955 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.21008 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3377p181/unwise-3377p181-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3377p181/unwise-3377p181-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3377p181/unwise-3377p181-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3377p181/unwise-3377p181-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 958 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.20634 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3362p181/unwise-3362p181-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/336/3362p181/unwise-3362p181-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/336/3362p181/unwise-3362p181-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/336/3362p181/unwise-3362p181-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/336/3362p181/unwise-3362p181-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3377p181 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3377p181/unwise-3377p181-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3377p181/unwise-3377p181-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3377p181/unwise-3377p181-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3377p181/unwise-3377p181-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3377p181/unwise-3377p181-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 960 MB, VmSize: 800 MB, VmRSS: 150 MB, VmData: 179 MB, maxrss: 0.190788 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3377p181/unwise-3377p181-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3377p181/unwise-3377p181-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3377p181/unwise-3377p181-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3377p181/unwise-3377p181-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 966 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210336 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/tmp-legacysurvey-custom-336973p18306-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/tmp-legacysurvey-custom-336973p18306-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 14.80 s, CPU: 7.07 s, VmPeak: 1034 MB, VmSize: 1034 MB, VmRSS: 218 MB, VmData: 246 MB, maxrss: 0.45466 MB Stage wise_forced finished: 2020-06-07T07:07:26.196277 Resources for stage wise_forced : 6.035 s worker CPU, 18.468 s worker Wall, Wall: 14.804 s, Cores in use: 0.89, Total efficiency (on 4 cores): 22.1 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T07:07:26.197925 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/coadd/cus/custom-336973p18306/legacysurvey-custom-336973p18306-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/tractor-i/cus/tractor-custom-336973p18306.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/tractor/cus/tractor-custom-336973p18306.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1555879/tractor/cus/brick-custom-336973p18306.sha256sum Stage writecat : Wall: 7.26 s, CPU: 7.12 s, VmPeak: 1166 MB, VmSize: 1038 MB, VmRSS: 220 MB, VmData: 246 MB, maxrss: 0.45466 MB Stage writecat finished: 2020-06-07T07:07:33.458755 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.262 s, Cores in use: 0.98, Total efficiency (on 4 cores): 24.5 % Stage writecat finished All done: 32.190 s worker CPU, 262.742 s worker Wall, Wall: 131.830 s, Cores in use: 0.62, Total efficiency (on 4 cores): 15.5 % Finished galaxy PGC1555879 in 2.331 minutes.