Started working on galaxy PGC105313 at Sun Jun 7 19:25:56 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 206.1992175 -3.6882065 --width 263 --height 263 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T19:25:57.475096 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '206.1992175', '-3.6882065', '--width', '263', '--height', '263', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 206.1992175 -3.6882065 --width 263 --height 263 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 206.1992175 -3.6882065 Starting process 12344 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 12347 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 12351 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 12355 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T19:25:58.082254 Keeping 13 CCDs: c4d_170718_022241_ooi_g_ls9.fits.fz c4d_170718_022241_ooi_g_ls9-N15 g exptime 175.0 propid 2014B-0404 seeing 1.43 MJD 57952.096 object DECaLS_33088_g c4d_170724_234451_ooi_r_ls9.fits.fz c4d_170724_234451_ooi_r_ls9-N15 r exptime 125.0 propid 2014B-0404 seeing 1.17 MJD 57958.987 object DECaLS_33088_r c4d_190307_063620_ooi_g_ls9.fits.fz c4d_190307_063620_ooi_g_ls9-N21 g exptime 56.0 propid 2014B-0404 seeing 1.10 MJD 58549.275 object DECaLS_17216_g c4d_190204_090548_ooi_z_ls9.fits.fz c4d_190204_090548_ooi_z_ls9-N21 z exptime 80.0 propid 2014B-0404 seeing 1.00 MJD 58518.379 object DECaLS_17216_z c4d_160409_051037_ooi_r_ls9.fits.fz c4d_160409_051037_ooi_r_ls9-N21 r exptime 85.0 propid 2014B-0404 seeing 1.38 MJD 57487.214 object DECaLS_17216_r c4d_160409_050846_ooi_g_ls9.fits.fz c4d_160409_050846_ooi_g_ls9-N21 g exptime 67.0 propid 2014B-0404 seeing 1.43 MJD 57487.213 object DECaLS_17216_g c4d_150109_081210_ooi_z_ls9.fits.fz c4d_150109_081210_ooi_z_ls9-N21 z exptime 122.0 propid 2014B-0404 seeing 1.24 MJD 57031.340 object DECaLS_17216_z c4d_150411_074824_ooi_z_ls9.fits.fz c4d_150411_074824_ooi_z_ls9-N22 z exptime 87.0 propid 2014B-0404 seeing 1.12 MJD 57123.324 object DECaLS_1344_z c4d_170301_081409_ooi_r_ls9.fits.fz c4d_170301_081409_ooi_r_ls9-N22 r exptime 47.0 propid 2014B-0404 seeing 0.89 MJD 57813.342 object DECaLS_1344_r c4d_170301_081614_ooi_g_ls9.fits.fz c4d_170301_081614_ooi_g_ls9-N22 g exptime 96.0 propid 2014B-0404 seeing 1.04 MJD 57813.343 object DECaLS_1344_g c4d_190307_063447_ooi_g_ls9.fits.fz c4d_190307_063447_ooi_g_ls9-N15 g exptime 56.0 propid 2014B-0404 seeing 1.11 MJD 58549.274 object DECaLS_33088_g c4d_190204_090357_ooi_z_ls9.fits.fz c4d_190204_090357_ooi_z_ls9-N15 z exptime 80.0 propid 2014B-0404 seeing 1.03 MJD 58518.378 object DECaLS_33088_z c4d_170723_232607_ooi_z_ls9.fits.fz c4d_170723_232607_ooi_z_ls9-N15 z exptime 250.0 propid 2014B-0404 seeing 1.82 MJD 57957.973 object DECaLS_33088_z The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953a6e9-g-20190307T063620_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951f6d6-r-20170724T234153_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534704-z-20190204T090548_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951add9-g-20170718T021852_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9569bf0-g-20160409T050645_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956e596-r-20160409T050821_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9563512-z-20150109T080917_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956b61f-z-20150411T074606_oi[N22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950c76c-r-20170301T081233_oi[N22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950d2a9-g-20170301T081348_oi[N22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534704-z-20190204T090357_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953a6e9-g-20190307T063447_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9519cdc-z-20170723T232105_oi[N15,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 21.36 s, CPU: 0.95 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 177 MB, VmData: 211 MB, maxrss: 0.566556 MB Stage tims finished: 2020-06-07T19:26:19.444541 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953a6e9-g-20190307T063620_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956e596-r-20160409T050821_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950d2a9-g-20170301T081348_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951add9-g-20170718T021852_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956b61f-z-20150411T074606_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534704-z-20190204T090357_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 6.251 s worker CPU, 69.987 s worker Wall, Wall: 21.364 s, Cores in use: 0.34, Total efficiency (on 4 cores): 8.4 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534704-z-20190204T090548_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9563512-z-20150109T080917_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953a6e9-g-20190307T063447_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951f6d6-r-20170724T234153_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9569bf0-g-20160409T050645_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950c76c-r-20170301T081233_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9519cdc-z-20170723T232105_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-06-07T19:26:19.493324 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06665.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06537.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06409.fits Matched 3 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/metrics/cus/reference-custom-206199m03688.fits Stage refs : Wall: 2.90 s, CPU: 2.11 s, VmPeak: 1027 MB, VmSize: 1014 MB, VmRSS: 196 MB, VmData: 229 MB, maxrss: 0.566556 MB Stage refs finished: 2020-06-07T19:26:22.394560 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.902 s, Cores in use: 0.73, Total efficiency (on 4 cores): 18.2 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T19:26:22.396099 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/metrics/cus/outlier-mask-custom-206199m03688.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/metrics/cus/outliers-pre-custom-206199m03688.jpg Image c4d_170718_022241_ooi_g_ls9-N15 g : masking 345 positive outlier pixels and 0 negative outlier pixels Image c4d_190307_063620_ooi_g_ls9-N21 g : masking 0 positive outlier pixels and 193 negative outlier pixels Image c4d_170723_232607_ooi_z_ls9-N15 z : masking 2972 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/metrics/cus/outlier-mask-custom-206199m03688.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/metrics/cus/outliers-post-custom-206199m03688.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/metrics/cus/outliers-masked-pos-custom-206199m03688.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/metrics/cus/outliers-masked-neg-custom-206199m03688.jpg Stage outliers : Wall: 1.09 s, CPU: 0.77 s, VmPeak: 1027 MB, VmSize: 1024 MB, VmRSS: 211 MB, VmData: 242 MB, maxrss: 0.566556 MB Stage outliers finished: 2020-06-07T19:26:23.487904 Resources for stage outliers : 1.286 s worker CPU, 1.309 s worker Wall, Wall: 1.093 s, Cores in use: 1.89, Total efficiency (on 4 cores): 47.1 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T19:26:23.489936 Stage halos : Wall: 0.60 s, CPU: 0.32 s, VmPeak: 1027 MB, VmSize: 1024 MB, VmRSS: 211 MB, VmData: 242 MB, maxrss: 0.566556 MB Stage halos finished: 2020-06-07T19:26:24.086664 Resources for stage halos : 0.389 s worker CPU, 1.009 s worker Wall, Wall: 0.598 s, Cores in use: 1.18, Total efficiency (on 4 cores): 29.6 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T19:26:24.088787 PSF sigmas in coadd pixels: ['2.32', '1.79', '2.32', '1.68', '1.81'] Using average PSF sigma 1.9825755906796652 Gaussian PSF norm 0.14228702960938333 vs pixelized 0.11075827 average tim pixel scale / coadd scale: 1.001146431827477 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.90', '2.25', '1.44'] Using average PSF sigma 1.8621592165691456 Gaussian PSF norm 0.15148800879315327 vs pixelized 0.12242866 average tim pixel scale / coadd scale: 1.001095397927521 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.63', '2.02', '1.82', '1.68', '2.96'] Using average PSF sigma 2.019687462441001 Gaussian PSF norm 0.1396724973639919 vs pixelized 0.110998996 average tim pixel scale / coadd scale: 1.0011074615763287 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-copsf-z.fits.fz Stage fit_on_coadds : Wall: 2.58 s, CPU: 0.24 s, VmPeak: 1027 MB, VmSize: 1024 MB, VmRSS: 213 MB, VmData: 242 MB, maxrss: 0.566556 MB Stage fit_on_coadds finished: 2020-06-07T19:26:26.671568 Resources for stage fit_on_coadds : 0.305 s worker CPU, 0.322 s worker Wall, Wall: 2.584 s, Cores in use: 0.21, Total efficiency (on 4 cores): 5.3 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T19:26:26.674829 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 100 potential peaks Of 100 potential peaks: 72 in veto map, 11 cut by saddle test, 0 cut by aper test, 17 kept SED z : 17 new peaks Found 97 potential peaks Of 97 potential peaks: 86 in veto map, 11 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 91 potential peaks Of 91 potential peaks: 77 in veto map, 8 cut by saddle test, 0 cut by aper test, 6 kept SED g : 6 new peaks Found 117 potential peaks Of 117 potential peaks: 103 in veto map, 11 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 132 potential peaks Of 132 potential peaks: 121 in veto map, 10 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 27 new sources Median coadd sky for g : 8.908499e-05 Median coadd sky for r : 0.0003349336 Median coadd sky for z : 0.0008131192 Stage srcs : Wall: 1.02 s, CPU: 0.97 s, VmPeak: 1027 MB, VmSize: 1024 MB, VmRSS: 213 MB, VmData: 242 MB, maxrss: 0.566556 MB Stage srcs finished: 2020-06-07T19:26:27.695368 Resources for stage srcs : 0.117 s worker CPU, 0.117 s worker Wall, Wall: 1.022 s, Cores in use: 1.06, Total efficiency (on 4 cores): 26.5 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T19:26:27.713120 Blob 1 of 11, id: 0, sources: 20, size: 257x222, npix 32770, brick X: 6,263, Y: 0,222, one pixel: 15 0 Blob 2 of 11, id: 7, sources: 1, size: 42x43, npix 1286, brick X: 165,207, Y: 218,261, one pixel: 183 218 Blob 3 of 11, id: 4, sources: 1, size: 35x42, npix 1154, brick X: 0,35, Y: 164,206, one pixel: 10 164 Blob 4 of 11, id: 8, sources: 1, size: 37x29, npix 798, brick X: 102,139, Y: 234,263, one pixel: 115 234 Blob 5 of 11, id: 1, sources: 3, size: 45x25, npix 773, brick X: 199,244, Y: 0,25, one pixel: 210 0 Blob 4 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 960 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147108 MB Blob 6 of 11, id: 9, sources: 1, size: 33x27, npix 539, brick X: 30,63, Y: 236,263, one pixel: 50 236 Measuring 1 iterative sources Blob 3 finished, total: Wall: 0.90 s, CPU: 0.90 s, VmPeak: 964 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146904 MB Blob 7 of 11, id: 2, sources: 1, size: 20x25, npix 340, brick X: 0,20, Y: 70,95, one pixel: 5 70 Blob 2 finished, total: Wall: 1.18 s, CPU: 1.18 s, VmPeak: 968 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146936 MB Blob 8 of 11, id: 3, sources: 1, size: 23x22, npix 310, brick X: 22,45, Y: 79,101, one pixel: 30 79 Blob 7 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 968 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146936 MB Blob 9 of 11, id: 10, sources: 1, size: 22x21, npix 290, brick X: 143,165, Y: 242,263, one pixel: 152 242 Measuring 1 iterative sources Blob 8 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 968 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146936 MB Blob 10 of 11, id: 5, sources: 1, size: 17x23, npix 249, brick X: 246,263, Y: 191,214, one pixel: 256 191 Blob 5 finished, total: Wall: 1.33 s, CPU: 1.32 s, VmPeak: 960 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147108 MB Blob 11 of 11, id: 6, sources: 1, size: 20x18, npix 207, brick X: 64,84, Y: 194,212, one pixel: 72 194 Blob 6 finished, total: Wall: 1.49 s, CPU: 1.49 s, VmPeak: 964 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148828 MB Blob 9 finished, total: Wall: 0.89 s, CPU: 0.89 s, VmPeak: 968 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146936 MB Blob 10 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 960 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147108 MB Blob 11 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 964 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148828 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.43411, ee1=0.109265, ee2=0.291065 Measuring 19 iterative sources Blob 1 finished, total: Wall: 28.79 s, CPU: 28.79 s, VmPeak: 961 MB, VmSize: 732 MB, VmRSS: 163 MB, VmData: 195 MB, maxrss: 0.166948 MB Old catalog: 36 New catalog: 38 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/metrics/cus/blobs-custom-206199m03688.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/metrics/cus/all-models-custom-206199m03688.fits Stage fitblobs : Wall: 29.33 s, CPU: 0.58 s, VmPeak: 1027 MB, VmSize: 1020 MB, VmRSS: 211 MB, VmData: 238 MB, maxrss: 0.566556 MB Stage fitblobs finished: 2020-06-07T19:26:57.043611 Resources for stage fitblobs : 37.579 s worker CPU, 37.635 s worker Wall, Wall: 29.332 s, Cores in use: 1.30, Total efficiency (on 4 cores): 32.5 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T19:26:57.045492 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/tmp-legacysurvey-custom-206199m03688-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/tmp-legacysurvey-custom-206199m03688-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/tmp-legacysurvey-custom-206199m03688-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/tmp-legacysurvey-custom-206199m03688-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-resid.jpg Stage coadds : Wall: 1.75 s, CPU: 0.69 s, VmPeak: 1027 MB, VmSize: 1020 MB, VmRSS: 211 MB, VmData: 238 MB, maxrss: 0.566556 MB Stage coadds finished: 2020-06-07T19:26:58.791696 Resources for stage coadds : 2.964 s worker CPU, 3.167 s worker Wall, Wall: 1.747 s, Cores in use: 2.09, Total efficiency (on 4 cores): 52.3 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T19:26:58.793362 Cut to 1 unWISE tiles Reading WISE tile 2057m031 band 1 Reading WISE tile 2057m031 band 3 Reading WISE tile 2057m031 band 2 Reading WISE tile 2057m031 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.12 s, CPU: 0.12 s, VmPeak: 961 MB, VmSize: 802 MB, VmRSS: 157 MB, VmData: 181 MB, maxrss: 0.202512 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 964 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210744 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 968 MB, VmSize: 792 MB, VmRSS: 142 MB, VmData: 170 MB, maxrss: 0.206856 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 960 MB, VmSize: 796 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210908 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/tmp-legacysurvey-custom-206199m03688-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/tmp-legacysurvey-custom-206199m03688-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.68 s, CPU: 0.51 s, VmPeak: 1027 MB, VmSize: 1020 MB, VmRSS: 212 MB, VmData: 238 MB, maxrss: 0.566556 MB Stage wise_forced finished: 2020-06-07T19:27:01.469220 Resources for stage wise_forced : 4.485 s worker CPU, 6.962 s worker Wall, Wall: 2.677 s, Cores in use: 1.87, Total efficiency (on 4 cores): 46.7 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T19:27:01.471101 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206199m03688/legacysurvey-custom-206199m03688-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/tractor-i/cus/tractor-custom-206199m03688.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/tractor/cus/tractor-custom-206199m03688.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/tractor/cus/brick-custom-206199m03688.sha256sum Stage writecat : Wall: 1.21 s, CPU: 0.69 s, VmPeak: 1152 MB, VmSize: 1024 MB, VmRSS: 214 MB, VmData: 238 MB, maxrss: 0.566556 MB Stage writecat finished: 2020-06-07T19:27:02.683037 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.213 s, Cores in use: 0.57, Total efficiency (on 4 cores): 14.3 % Stage writecat finished All done: 53.378 s worker CPU, 120.509 s worker Wall, Wall: 64.606 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.7 % Finished galaxy PGC105313 in 1.111 minutes. Started working on galaxy PGC105313 at Thu Jul 16 04:45:41 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 206.1972 -3.6908 --width 263 --height 263 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-07-16T04:45:42.370046 legacypipe git version: DR9.5.4-57-g2fd66136 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '206.1972', '-3.6908', '--width', '263', '--height', '263', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 206.1972 -3.6908 --width 263 --height 263 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 206.1972 -3.6908 Starting process 36282 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058852 MB Starting process 36283 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058852 MB Starting process 36284 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 36285 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05902 MB Starting process 36286 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059024 MB Starting process 36287 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059024 MB Starting process 36288 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB Starting process 36289 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB Starting process 36290 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB Starting process 36291 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB Starting process 36292 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB Starting process 36293 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB Starting process 36294 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 36295 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB Starting process 36296 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB Starting process 36297 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB Starting process 36298 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB Starting process 36299 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB Starting process 36300 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB Starting process 36301 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB Starting process 36302 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB Starting process 36303 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB Starting process 36304 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB Starting process 36305 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB Starting process 36306 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB Starting process 36307 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB Starting process 36308 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB Starting process 36309 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB Starting process 36310 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058912 MB Starting process 36311 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058912 MB Starting process 36312 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058912 MB Starting process 36313 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058916 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-07-16T04:45:42.771751 Keeping 13 CCDs: c4d_170718_022241_ooi_g_ls9.fits.fz c4d_170718_022241_ooi_g_ls9-N15 g exptime 175.0 propid 2014B-0404 seeing 1.43 MJD 57952.096 object DECaLS_33088_g c4d_170724_234451_ooi_r_ls9.fits.fz c4d_170724_234451_ooi_r_ls9-N15 r exptime 125.0 propid 2014B-0404 seeing 1.17 MJD 57958.987 object DECaLS_33088_r c4d_190307_063620_ooi_g_ls9.fits.fz c4d_190307_063620_ooi_g_ls9-N21 g exptime 56.0 propid 2014B-0404 seeing 1.10 MJD 58549.275 object DECaLS_17216_g c4d_190204_090548_ooi_z_ls9.fits.fz c4d_190204_090548_ooi_z_ls9-N21 z exptime 80.0 propid 2014B-0404 seeing 1.00 MJD 58518.379 object DECaLS_17216_z c4d_160409_051037_ooi_r_ls9.fits.fz c4d_160409_051037_ooi_r_ls9-N21 r exptime 85.0 propid 2014B-0404 seeing 1.38 MJD 57487.214 object DECaLS_17216_r c4d_160409_050846_ooi_g_ls9.fits.fz c4d_160409_050846_ooi_g_ls9-N21 g exptime 67.0 propid 2014B-0404 seeing 1.43 MJD 57487.213 object DECaLS_17216_g c4d_150109_081210_ooi_z_ls9.fits.fz c4d_150109_081210_ooi_z_ls9-N21 z exptime 122.0 propid 2014B-0404 seeing 1.24 MJD 57031.340 object DECaLS_17216_z c4d_150411_074824_ooi_z_ls9.fits.fz c4d_150411_074824_ooi_z_ls9-N22 z exptime 87.0 propid 2014B-0404 seeing 1.12 MJD 57123.324 object DECaLS_1344_z c4d_170301_081409_ooi_r_ls9.fits.fz c4d_170301_081409_ooi_r_ls9-N22 r exptime 47.0 propid 2014B-0404 seeing 0.89 MJD 57813.342 object DECaLS_1344_r c4d_170301_081614_ooi_g_ls9.fits.fz c4d_170301_081614_ooi_g_ls9-N22 g exptime 96.0 propid 2014B-0404 seeing 1.04 MJD 57813.343 object DECaLS_1344_g c4d_190307_063447_ooi_g_ls9.fits.fz c4d_190307_063447_ooi_g_ls9-N15 g exptime 56.0 propid 2014B-0404 seeing 1.11 MJD 58549.274 object DECaLS_33088_g c4d_190204_090357_ooi_z_ls9.fits.fz c4d_190204_090357_ooi_z_ls9-N15 z exptime 80.0 propid 2014B-0404 seeing 1.03 MJD 58518.378 object DECaLS_33088_z c4d_170723_232607_ooi_z_ls9.fits.fz c4d_170723_232607_ooi_z_ls9-N15 z exptime 250.0 propid 2014B-0404 seeing 1.82 MJD 57957.973 object DECaLS_33088_z The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950c76c-r-20170301T081233_oi[N22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9563512-z-20150109T080917_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951add9-g-20170718T021852_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9569bf0-g-20160409T050645_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534704-z-20190204T090357_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951f6d6-r-20170724T234153_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953a6e9-g-20190307T063620_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956e596-r-20160409T050821_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534704-z-20190204T090548_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956b61f-z-20150411T074606_oi[N22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9519cdc-z-20170723T232105_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953a6e9-g-20190307T063447_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950d2a9-g-20170301T081348_oi[N22,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 6.47 s, CPU: 0.79 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 178 MB, VmData: 212 MB, maxrss: 0.182436 MB Stage tims finished: 2020-07-16T04:45:49.243572 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9563512-z-20150109T080917_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9569bf0-g-20160409T050645_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534704-z-20190204T090357_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951f6d6-r-20170724T234153_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956e596-r-20160409T050821_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953a6e9-g-20190307T063620_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953a6e9-g-20190307T063447_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534704-z-20190204T090548_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950d2a9-g-20170301T081348_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 7.403 s worker CPU, 64.430 s worker Wall, Wall: 6.475 s, Cores in use: 1.27, Total efficiency (on 32 cores): 4.0 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950c76c-r-20170301T081233_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-07-16T04:45:49.333760 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06665.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06537.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06409.fits Matched 3 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/metrics/cus/reference-custom-206197m03690.fits Stage refs : Wall: 2.49 s, CPU: 1.82 s, VmPeak: 1030 MB, VmSize: 1018 MB, VmRSS: 198 MB, VmData: 231 MB, maxrss: 0.202764 MB Stage refs finished: 2020-07-16T04:45:51.827678 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951add9-g-20170718T021852_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956b61f-z-20150411T074606_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9519cdc-z-20170723T232105_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage refs : 0.001 s worker CPU, 0.002 s worker Wall, Wall: 2.497 s, Cores in use: 0.73, Total efficiency (on 32 cores): 2.3 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-07-16T04:45:51.908364 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/metrics/cus/outlier-mask-custom-206197m03690.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/metrics/cus/outliers-pre-custom-206197m03690.jpg Image c4d_170301_081614_ooi_g_ls9-N22 g : masking 160 positive outlier pixels and 0 negative outlier pixels Image c4d_170718_022241_ooi_g_ls9-N15 g : masking 608 positive outlier pixels and 0 negative outlier pixels Image c4d_170723_232607_ooi_z_ls9-N15 z : masking 1084 positive outlier pixels and 0 negative outlier pixels Image c4d_190204_090357_ooi_z_ls9-N15 z : masking 179 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/metrics/cus/outlier-mask-custom-206197m03690.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/metrics/cus/outliers-post-custom-206197m03690.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/metrics/cus/outliers-masked-pos-custom-206197m03690.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/metrics/cus/outliers-masked-neg-custom-206197m03690.jpg Stage outliers : Wall: 6.36 s, CPU: 0.63 s, VmPeak: 1030 MB, VmSize: 1028 MB, VmRSS: 214 MB, VmData: 245 MB, maxrss: 0.21882 MB Stage outliers finished: 2020-07-16T04:45:58.264271 Resources for stage outliers : 1.092 s worker CPU, 1.356 s worker Wall, Wall: 6.359 s, Cores in use: 0.27, Total efficiency (on 32 cores): 0.8 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-07-16T04:45:58.297907 Stage halos : Wall: 0.29 s, CPU: 0.22 s, VmPeak: 1030 MB, VmSize: 1028 MB, VmRSS: 214 MB, VmData: 245 MB, maxrss: 0.219088 MB Stage halos finished: 2020-07-16T04:45:58.587255 Resources for stage halos : 0.409 s worker CPU, 0.721 s worker Wall, Wall: 0.292 s, Cores in use: 2.17, Total efficiency (on 32 cores): 6.8 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-07-16T04:46:04.567949 PSF sigmas in coadd pixels: ['2.32', '1.79', '2.32', '1.68', '1.81'] Using average PSF sigma 1.9825755906796652 Gaussian PSF norm 0.14228702960938333 vs pixelized 0.110721424 average tim pixel scale / coadd scale: 1.001146431827477 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.90', '2.25', '1.44'] Using average PSF sigma 1.8621592165691456 Gaussian PSF norm 0.15148800879315327 vs pixelized 0.12241103 average tim pixel scale / coadd scale: 1.001095397927521 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.63', '2.02', '1.82', '1.68', '2.96'] Using average PSF sigma 2.019687462441001 Gaussian PSF norm 0.1396724973639919 vs pixelized 0.1110213 average tim pixel scale / coadd scale: 1.0011074615763287 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-copsf-z.fits.fz Stage fit_on_coadds : Wall: 2.42 s, CPU: 0.19 s, VmPeak: 1030 MB, VmSize: 1028 MB, VmRSS: 216 MB, VmData: 246 MB, maxrss: 0.221064 MB Stage fit_on_coadds finished: 2020-07-16T04:46:06.990655 Resources for stage fit_on_coadds : 0.210 s worker CPU, 0.210 s worker Wall, Wall: 2.426 s, Cores in use: 0.16, Total efficiency (on 32 cores): 0.5 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-07-16T04:46:08.525334 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 74 potential peaks Of 74 potential peaks: 52 in veto map, 8 cut by saddle test, 1 cut by aper test, 13 kept SED z : 13 new peaks Found 63 potential peaks Of 63 potential peaks: 57 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 67 potential peaks Of 67 potential peaks: 58 in veto map, 7 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 82 potential peaks Of 82 potential peaks: 70 in veto map, 10 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 89 potential peaks Of 89 potential peaks: 78 in veto map, 10 cut by saddle test, 1 cut by aper test, 0 kept SED Red : 0 new peaks Adding 18 new sources Median coadd sky for g : 0.00023896611 Median coadd sky for r : 0.00063048844 Median coadd sky for z : 0.0012499223 Stage srcs : Wall: 0.67 s, CPU: 0.64 s, VmPeak: 1030 MB, VmSize: 1028 MB, VmRSS: 217 MB, VmData: 246 MB, maxrss: 0.2217 MB Stage srcs finished: 2020-07-16T04:46:09.194058 Resources for stage srcs : 0.077 s worker CPU, 0.077 s worker Wall, Wall: 0.671 s, Cores in use: 1.06, Total efficiency (on 32 cores): 3.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-07-16T04:46:11.326733 Blob 1 of 9, id: 4, sources: 11, size: 227x204, npix 25789, brick X: 18,245, Y: 39,243, one pixel: 101 39 Blob 2 of 9, id: 5, sources: 1, size: 34x46, npix 1205, brick X: 229,263, Y: 107,153, one pixel: 248 107 Blob 3 of 9, id: 2, sources: 3, size: 45x40, npix 1090, brick X: 172,217, Y: 20,60, one pixel: 183 20 Blob 4 of 9, id: 3, sources: 1, size: 25x46, npix 867, brick X: 0,25, Y: 31,77, one pixel: 5 31 Blob 5 of 9, id: 7, sources: 1, size: 32x31, npix 729, brick X: 175,207, Y: 215,246, one pixel: 187 215 Blob 6 of 9, id: 1, sources: 1, size: 29x28, npix 502, brick X: 52,81, Y: 9,37, one pixel: 64 9 Blob 7 of 9, id: 6, sources: 1, size: 28x24, npix 420, brick X: 210,238, Y: 182,206, one pixel: 225 182 Blob 8 of 9, id: 0, sources: 1, size: 23x24, npix 339, brick X: 143,166, Y: 2,26, one pixel: 153 2 Blob 9 of 9, id: 8, sources: 1, size: 22x23, npix 295, brick X: 219,241, Y: 227,250, one pixel: 229 227 Blob 4 finished, total: Wall: 0.08 s, CPU: 0.07 s, VmPeak: 954 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145108 MB Blob 8 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 663 MB, VmSize: 663 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.096768 MB Blob 6 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 952 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145136 MB Blob 9 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 948 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145072 MB Blob 5 finished, total: Wall: 0.53 s, CPU: 0.52 s, VmPeak: 689 MB, VmSize: 689 MB, VmRSS: 113 MB, VmData: 166 MB, maxrss: 0.115352 MB Blob 7 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 935 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145256 MB Measuring 1 iterative sources Measuring 1 iterative sources Blob 3 finished, total: Wall: 1.18 s, CPU: 1.18 s, VmPeak: 688 MB, VmSize: 688 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.11496 MB Blob 2 finished, total: Wall: 1.45 s, CPU: 1.44 s, VmPeak: 953 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145184 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.64359, ee1=-0.0201599, ee2=-0.0314801 Measuring 11 iterative sources Blob 1 finished, total: Wall: 16.41 s, CPU: 16.41 s, VmPeak: 698 MB, VmSize: 689 MB, VmRSS: 128 MB, VmData: 167 MB, maxrss: 0.137404 MB Old catalog: 27 New catalog: 31 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/metrics/cus/blobs-custom-206197m03690.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/metrics/cus/all-models-custom-206197m03690.fits Stage fitblobs : Wall: 19.20 s, CPU: 0.91 s, VmPeak: 1030 MB, VmSize: 1028 MB, VmRSS: 217 MB, VmData: 246 MB, maxrss: 0.222312 MB Stage fitblobs finished: 2020-07-16T04:46:30.527599 Resources for stage fitblobs : 21.661 s worker CPU, 21.732 s worker Wall, Wall: 19.203 s, Cores in use: 1.18, Total efficiency (on 32 cores): 3.7 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-07-16T04:46:30.541819 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/tmp-legacysurvey-custom-206197m03690-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/tmp-legacysurvey-custom-206197m03690-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/tmp-legacysurvey-custom-206197m03690-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/tmp-legacysurvey-custom-206197m03690-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-resid.jpg Stage coadds : Wall: 1.91 s, CPU: 0.51 s, VmPeak: 1030 MB, VmSize: 1028 MB, VmRSS: 218 MB, VmData: 246 MB, maxrss: 0.222956 MB Stage coadds finished: 2020-07-16T04:46:32.448469 Resources for stage coadds : 24.166 s worker CPU, 24.900 s worker Wall, Wall: 1.909 s, Cores in use: 12.93, Total efficiency (on 32 cores): 40.4 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-07-16T04:46:32.479190 Cut to 1 unWISE tiles Reading WISE tile 2057m031 band 2 Reading WISE tile 2057m031 band 1 Reading WISE tile 2057m031 band 3 Reading WISE tile 2057m031 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 950 MB, VmSize: 793 MB, VmRSS: 144 MB, VmData: 176 MB, maxrss: 0.187868 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 958 MB, VmSize: 790 MB, VmRSS: 141 MB, VmData: 174 MB, maxrss: 0.20348 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 954 MB, VmSize: 790 MB, VmRSS: 140 MB, VmData: 174 MB, maxrss: 0.202772 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 956 MB, VmSize: 790 MB, VmRSS: 141 MB, VmData: 174 MB, maxrss: 0.203172 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/tmp-legacysurvey-custom-206197m03690-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/tmp-legacysurvey-custom-206197m03690-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 1.82 s, CPU: 0.40 s, VmPeak: 1030 MB, VmSize: 1028 MB, VmRSS: 218 MB, VmData: 246 MB, maxrss: 0.22366 MB Stage wise_forced finished: 2020-07-16T04:46:34.300768 Resources for stage wise_forced : 3.171 s worker CPU, 4.224 s worker Wall, Wall: 1.824 s, Cores in use: 1.96, Total efficiency (on 32 cores): 6.1 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-07-16T04:46:34.334896 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/tractor-i/cus/tractor-custom-206197m03690.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/tractor/cus/tractor-custom-206197m03690.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/tractor/cus/brick-custom-206197m03690.sha256sum Stage writecat : Wall: 0.74 s, CPU: 0.48 s, VmPeak: 1160 MB, VmSize: 1032 MB, VmRSS: 220 MB, VmData: 246 MB, maxrss: 0.356408 MB Stage writecat finished: 2020-07-16T04:46:35.073702 Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.741 s, Cores in use: 0.65, Total efficiency (on 32 cores): 2.0 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-writecat.p All done: 58.195 s worker CPU, 117.658 s worker Wall, Wall: 52.361 s, Cores in use: 1.24, Total efficiency (on 32 cores): 3.9 % Finished galaxy PGC105313 in 0.909 minutes. Started working on galaxy PGC105313 at Thu Jul 16 05:44:33 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 206.1972 -3.6908 --width 263 --height 263 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-07-16T05:44:34.262805 legacypipe git version: DR9.5.4-57-g2fd66136 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '206.1972', '-3.6908', '--width', '263', '--height', '263', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 206.1972 -3.6908 --width 263 --height 263 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 206.1972 -3.6908 Starting process 46695 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058848 MB Starting process 46696 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058848 MB Starting process 46697 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058852 MB Starting process 46698 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059016 MB Starting process 46699 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05902 MB Starting process 46700 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05902 MB Starting process 46701 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 46702 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 46703 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 46704 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 46705 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 46706 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB Starting process 46707 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB Starting process 46708 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB Starting process 46709 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 46710 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-07-16T05:44:36.707782 Keeping 13 CCDs: c4d_170718_022241_ooi_g_ls9.fits.fz c4d_170718_022241_ooi_g_ls9-N15 g exptime 175.0 propid 2014B-0404 seeing 1.43 MJD 57952.096 object DECaLS_33088_g c4d_170724_234451_ooi_r_ls9.fits.fz c4d_170724_234451_ooi_r_ls9-N15 r exptime 125.0 propid 2014B-0404 seeing 1.17 MJD 57958.987 object DECaLS_33088_r c4d_190307_063620_ooi_g_ls9.fits.fz c4d_190307_063620_ooi_g_ls9-N21 g exptime 56.0 propid 2014B-0404 seeing 1.10 MJD 58549.275 object DECaLS_17216_g c4d_190204_090548_ooi_z_ls9.fits.fz c4d_190204_090548_ooi_z_ls9-N21 z exptime 80.0 propid 2014B-0404 seeing 1.00 MJD 58518.379 object DECaLS_17216_z c4d_160409_051037_ooi_r_ls9.fits.fz c4d_160409_051037_ooi_r_ls9-N21 r exptime 85.0 propid 2014B-0404 seeing 1.38 MJD 57487.214 object DECaLS_17216_r c4d_160409_050846_ooi_g_ls9.fits.fz c4d_160409_050846_ooi_g_ls9-N21 g exptime 67.0 propid 2014B-0404 seeing 1.43 MJD 57487.213 object DECaLS_17216_g c4d_150109_081210_ooi_z_ls9.fits.fz c4d_150109_081210_ooi_z_ls9-N21 z exptime 122.0 propid 2014B-0404 seeing 1.24 MJD 57031.340 object DECaLS_17216_z c4d_150411_074824_ooi_z_ls9.fits.fz c4d_150411_074824_ooi_z_ls9-N22 z exptime 87.0 propid 2014B-0404 seeing 1.12 MJD 57123.324 object DECaLS_1344_z c4d_170301_081409_ooi_r_ls9.fits.fz c4d_170301_081409_ooi_r_ls9-N22 r exptime 47.0 propid 2014B-0404 seeing 0.89 MJD 57813.342 object DECaLS_1344_r c4d_170301_081614_ooi_g_ls9.fits.fz c4d_170301_081614_ooi_g_ls9-N22 g exptime 96.0 propid 2014B-0404 seeing 1.04 MJD 57813.343 object DECaLS_1344_g c4d_190307_063447_ooi_g_ls9.fits.fz c4d_190307_063447_ooi_g_ls9-N15 g exptime 56.0 propid 2014B-0404 seeing 1.11 MJD 58549.274 object DECaLS_33088_g c4d_190204_090357_ooi_z_ls9.fits.fz c4d_190204_090357_ooi_z_ls9-N15 z exptime 80.0 propid 2014B-0404 seeing 1.03 MJD 58518.378 object DECaLS_33088_z c4d_170723_232607_ooi_z_ls9.fits.fz c4d_170723_232607_ooi_z_ls9-N15 z exptime 250.0 propid 2014B-0404 seeing 1.82 MJD 57957.973 object DECaLS_33088_z The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950c76c-r-20170301T081233_oi[N22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953a6e9-g-20190307T063447_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951add9-g-20170718T021852_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953a6e9-g-20190307T063620_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951f6d6-r-20170724T234153_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9563512-z-20150109T080917_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9569bf0-g-20160409T050645_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534704-z-20190204T090357_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534704-z-20190204T090548_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956e596-r-20160409T050821_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9519cdc-z-20170723T232105_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956b61f-z-20150411T074606_oi[N22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950d2a9-g-20170301T081348_oi[N22,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 6.57 s, CPU: 0.86 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 178 MB, VmData: 212 MB, maxrss: 0.182324 MB Stage tims finished: 2020-07-16T05:44:43.276037 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953a6e9-g-20190307T063447_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951add9-g-20170718T021852_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953a6e9-g-20190307T063620_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951f6d6-r-20170724T234153_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9563512-z-20150109T080917_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9569bf0-g-20160409T050645_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534704-z-20190204T090357_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534704-z-20190204T090548_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956e596-r-20160409T050821_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9519cdc-z-20170723T232105_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956b61f-z-20150411T074606_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950d2a9-g-20170301T081348_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 8.631 s worker CPU, 61.701 s worker Wall, Wall: 6.570 s, Cores in use: 1.45, Total efficiency (on 16 cores): 9.0 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950c76c-r-20170301T081233_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-07-16T05:44:47.141583 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06665.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06537.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06409.fits Matched 3 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/metrics/cus/reference-custom-206197m03690.fits Stage refs : Wall: 4.49 s, CPU: 2.24 s, VmPeak: 1030 MB, VmSize: 1018 MB, VmRSS: 198 MB, VmData: 231 MB, maxrss: 0.2029 MB Stage refs finished: 2020-07-16T05:44:51.628361 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.488 s, Cores in use: 0.50, Total efficiency (on 16 cores): 3.1 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-07-16T05:44:51.842695 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/metrics/cus/outlier-mask-custom-206197m03690.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/metrics/cus/outliers-pre-custom-206197m03690.jpg Image c4d_170718_022241_ooi_g_ls9-N15 g : masking 608 positive outlier pixels and 0 negative outlier pixels Image c4d_170301_081614_ooi_g_ls9-N22 g : masking 160 positive outlier pixels and 0 negative outlier pixels Image c4d_170723_232607_ooi_z_ls9-N15 z : masking 1084 positive outlier pixels and 0 negative outlier pixels Image c4d_190204_090357_ooi_z_ls9-N15 z : masking 179 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/metrics/cus/outlier-mask-custom-206197m03690.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/metrics/cus/outliers-post-custom-206197m03690.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/metrics/cus/outliers-masked-pos-custom-206197m03690.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/metrics/cus/outliers-masked-neg-custom-206197m03690.jpg Stage outliers : Wall: 2.09 s, CPU: 0.86 s, VmPeak: 1030 MB, VmSize: 1027 MB, VmRSS: 214 MB, VmData: 246 MB, maxrss: 0.219548 MB Stage outliers finished: 2020-07-16T05:44:53.936140 Resources for stage outliers : 0.948 s worker CPU, 1.003 s worker Wall, Wall: 2.095 s, Cores in use: 0.86, Total efficiency (on 16 cores): 5.4 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-07-16T05:44:54.146452 Stage halos : Wall: 0.62 s, CPU: 0.54 s, VmPeak: 1030 MB, VmSize: 1027 MB, VmRSS: 215 MB, VmData: 246 MB, maxrss: 0.219752 MB Stage halos finished: 2020-07-16T05:44:54.765388 Resources for stage halos : 0.381 s worker CPU, 0.812 s worker Wall, Wall: 0.621 s, Cores in use: 1.49, Total efficiency (on 16 cores): 9.3 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-07-16T05:44:54.833940 PSF sigmas in coadd pixels: ['2.32', '1.79', '2.32', '1.68', '1.81'] Using average PSF sigma 1.9825755906796652 Gaussian PSF norm 0.14228702960938333 vs pixelized 0.11072143 average tim pixel scale / coadd scale: 1.001146431827477 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.90', '2.25', '1.44'] Using average PSF sigma 1.8621592165691456 Gaussian PSF norm 0.15148800879315327 vs pixelized 0.12241103 average tim pixel scale / coadd scale: 1.001095397927521 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.63', '2.02', '1.82', '1.68', '2.96'] Using average PSF sigma 2.019687462441001 Gaussian PSF norm 0.1396724973639919 vs pixelized 0.1110213 average tim pixel scale / coadd scale: 1.0011074615763287 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.28 s, CPU: 0.19 s, VmPeak: 1030 MB, VmSize: 1027 MB, VmRSS: 216 MB, VmData: 246 MB, maxrss: 0.221352 MB Stage fit_on_coadds finished: 2020-07-16T05:44:55.111078 Resources for stage fit_on_coadds : 0.211 s worker CPU, 0.211 s worker Wall, Wall: 0.279 s, Cores in use: 1.45, Total efficiency (on 16 cores): 9.0 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-07-16T05:44:55.123251 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 74 potential peaks Of 74 potential peaks: 52 in veto map, 8 cut by saddle test, 1 cut by aper test, 13 kept SED z : 13 new peaks Found 63 potential peaks Of 63 potential peaks: 57 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 67 potential peaks Of 67 potential peaks: 58 in veto map, 7 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 82 potential peaks Of 82 potential peaks: 70 in veto map, 10 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 89 potential peaks Of 89 potential peaks: 78 in veto map, 10 cut by saddle test, 1 cut by aper test, 0 kept SED Red : 0 new peaks Adding 18 new sources Median coadd sky for g : 0.00023896617 Median coadd sky for r : 0.00063048844 Median coadd sky for z : 0.0012499223 Stage srcs : Wall: 0.68 s, CPU: 0.64 s, VmPeak: 1030 MB, VmSize: 1027 MB, VmRSS: 217 MB, VmData: 246 MB, maxrss: 0.221872 MB Stage srcs finished: 2020-07-16T05:44:55.804276 Resources for stage srcs : 0.090 s worker CPU, 0.090 s worker Wall, Wall: 0.682 s, Cores in use: 1.07, Total efficiency (on 16 cores): 6.7 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-07-16T05:44:55.815514 Blob 1 of 9, id: 4, sources: 11, size: 227x204, npix 25789, brick X: 18,245, Y: 39,243, one pixel: 101 39 Blob 2 of 9, id: 5, sources: 1, size: 34x46, npix 1205, brick X: 229,263, Y: 107,153, one pixel: 248 107 Blob 3 of 9, id: 2, sources: 3, size: 45x40, npix 1090, brick X: 172,217, Y: 20,60, one pixel: 183 20 Blob 4 of 9, id: 3, sources: 1, size: 25x46, npix 867, brick X: 0,25, Y: 31,77, one pixel: 5 31 Blob 5 of 9, id: 7, sources: 1, size: 32x31, npix 729, brick X: 175,207, Y: 215,246, one pixel: 187 215 Blob 6 of 9, id: 1, sources: 1, size: 29x28, npix 502, brick X: 52,81, Y: 9,37, one pixel: 64 9 Blob 7 of 9, id: 6, sources: 1, size: 28x24, npix 420, brick X: 210,238, Y: 182,206, one pixel: 225 182 Blob 8 of 9, id: 0, sources: 1, size: 23x24, npix 339, brick X: 143,166, Y: 2,26, one pixel: 153 2 Blob 9 of 9, id: 8, sources: 1, size: 22x23, npix 295, brick X: 219,241, Y: 227,250, one pixel: 229 227 Blob 4 finished, total: Wall: 0.12 s, CPU: 0.11 s, VmPeak: 935 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145196 MB Blob 8 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 955 MB, VmSize: 719 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144748 MB Blob 9 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 950 MB, VmSize: 720 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.143932 MB Blob 6 finished, total: Wall: 0.54 s, CPU: 0.54 s, VmPeak: 952 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145496 MB Blob 5 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 948 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145116 MB Blob 7 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 953 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14538 MB Measuring 1 iterative sources Measuring 1 iterative sources Blob 3 finished, total: Wall: 1.23 s, CPU: 1.23 s, VmPeak: 953 MB, VmSize: 719 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144768 MB Blob 2 finished, total: Wall: 1.52 s, CPU: 1.52 s, VmPeak: 664 MB, VmSize: 664 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.09774 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.643589, ee1=-0.0201599, ee2=-0.0314799 Measuring 11 iterative sources Blob 1 finished, total: Wall: 16.61 s, CPU: 16.61 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 139 MB, VmData: 175 MB, maxrss: 0.14278 MB Old catalog: 27 New catalog: 31 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/metrics/cus/blobs-custom-206197m03690.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/metrics/cus/all-models-custom-206197m03690.fits Stage fitblobs : Wall: 19.91 s, CPU: 0.29 s, VmPeak: 1030 MB, VmSize: 1027 MB, VmRSS: 217 MB, VmData: 246 MB, maxrss: 0.222472 MB Stage fitblobs finished: 2020-07-16T05:45:15.729498 Resources for stage fitblobs : 22.100 s worker CPU, 22.129 s worker Wall, Wall: 19.916 s, Cores in use: 1.12, Total efficiency (on 16 cores): 7.0 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-07-16T05:45:15.743696 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/tmp-legacysurvey-custom-206197m03690-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/tmp-legacysurvey-custom-206197m03690-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/tmp-legacysurvey-custom-206197m03690-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/tmp-legacysurvey-custom-206197m03690-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-resid.jpg Stage coadds : Wall: 6.05 s, CPU: 0.87 s, VmPeak: 1030 MB, VmSize: 1027 MB, VmRSS: 218 MB, VmData: 246 MB, maxrss: 0.223124 MB Stage coadds finished: 2020-07-16T05:45:21.792269 Resources for stage coadds : 9.154 s worker CPU, 10.793 s worker Wall, Wall: 6.050 s, Cores in use: 1.66, Total efficiency (on 16 cores): 10.4 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-07-16T05:45:21.808325 Cut to 1 unWISE tiles Reading WISE tile 2057m031 band 2 Reading WISE tile 2057m031 band 1 Reading WISE tile 2057m031 band 3 Reading WISE tile 2057m031 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 952 MB, VmSize: 795 MB, VmRSS: 144 MB, VmData: 176 MB, maxrss: 0.188104 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 953 MB, VmSize: 797 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.207812 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 952 MB, VmSize: 797 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.208332 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/205/2057m031/unwise-2057m031-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 953 MB, VmSize: 797 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.208376 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/tmp-legacysurvey-custom-206197m03690-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/tmp-legacysurvey-custom-206197m03690-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.16 s, CPU: 0.64 s, VmPeak: 1030 MB, VmSize: 1027 MB, VmRSS: 219 MB, VmData: 246 MB, maxrss: 0.223832 MB Stage wise_forced finished: 2020-07-16T05:45:23.972497 Resources for stage wise_forced : 3.133 s worker CPU, 4.262 s worker Wall, Wall: 2.166 s, Cores in use: 1.74, Total efficiency (on 16 cores): 10.9 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-07-16T05:45:24.011102 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/coadd/cus/custom-206197m03690/legacysurvey-custom-206197m03690-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/tractor-i/cus/tractor-custom-206197m03690.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/tractor/cus/tractor-custom-206197m03690.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/tractor/cus/brick-custom-206197m03690.sha256sum Stage writecat : Wall: 1.25 s, CPU: 0.93 s, VmPeak: 1160 MB, VmSize: 1032 MB, VmRSS: 220 MB, VmData: 246 MB, maxrss: 0.356576 MB Stage writecat finished: 2020-07-16T05:45:25.260144 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.251 s, Cores in use: 0.75, Total efficiency (on 16 cores): 4.7 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/206/PGC105313/PGC105313-largegalaxy-writecat.p All done: 44.652 s worker CPU, 101.005 s worker Wall, Wall: 48.570 s, Cores in use: 1.09, Total efficiency (on 16 cores): 6.8 % Finished galaxy PGC105313 in 0.883 minutes.