Started working on galaxy PGC1409798 at Sat Jun 6 11:29:02 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.644569000000004 12.451246099999999 --width 333 --height 333 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/PGC1409798-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/PGC1409798-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-06T11:29:03.012038 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '29.644569000000004', '12.451246099999999', '--width', '333', '--height', '333', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/PGC1409798-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/PGC1409798-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.644569000000004 12.451246099999999 --width 333 --height 333 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/PGC1409798-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/PGC1409798-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 29.644569000000004 12.451246099999999 Starting process 40720 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 40721 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 40722 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Starting process 40723 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Starting process 40724 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB Starting process 40725 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057324 MB Starting process 40726 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057324 MB Starting process 40727 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-06T11:29:08.085522 Keeping 17 CCDs: c4d_181007_033006_ooi_g_ls9.fits.fz c4d_181007_033006_ooi_g_ls9-N1 g exptime 145.0 propid 2014B-0404 seeing 1.39 MJD 58398.146 object DECaLS_42216_g c4d_160723_092659_ooi_z_ls9.fits.fz c4d_160723_092659_ooi_z_ls9-N1 z exptime 220.0 propid 2016A-0190 seeing 1.21 MJD 57592.391 object DECaLS_42216_z c4d_151011_084057_ooi_r_ls9.fits.fz c4d_151011_084057_ooi_r_ls9-N1 r exptime 125.0 propid 2014B-0404 seeing 1.61 MJD 57306.360 object DECaLS_42216_r c4d_181007_033006_ooi_g_ls9.fits.fz c4d_181007_033006_ooi_g_ls9-N8 g exptime 145.0 propid 2014B-0404 seeing 1.38 MJD 58398.146 object DECaLS_42216_g c4d_160723_092659_ooi_z_ls9.fits.fz c4d_160723_092659_ooi_z_ls9-N8 z exptime 220.0 propid 2016A-0190 seeing 1.20 MJD 57592.391 object DECaLS_42216_z c4d_151011_084057_ooi_r_ls9.fits.fz c4d_151011_084057_ooi_r_ls9-N8 r exptime 125.0 propid 2014B-0404 seeing 1.58 MJD 57306.360 object DECaLS_42216_r c4d_160723_091100_ooi_z_ls9.fits.fz c4d_160723_091100_ooi_z_ls9-N7 z exptime 80.0 propid 2016A-0190 seeing 1.50 MJD 57592.381 object DECaLS_34053_z c4d_170920_072116_ooi_g_ls9.fits.fz c4d_170920_072116_ooi_g_ls9-N7 g exptime 200.0 propid 2014B-0404 seeing 1.75 MJD 58016.306 object DECaLS_34053_g c4d_181015_030958_ooi_z_ls9.fits.fz c4d_181015_030958_ooi_z_ls9-N7 z exptime 236.0 propid 2014B-0404 seeing 1.74 MJD 58406.132 object DECaLS_34053_z c4d_181111_044702_ooi_r_ls9.fits.fz c4d_181111_044702_ooi_r_ls9-N7 r exptime 128.0 propid 2014B-0404 seeing 1.19 MJD 58433.199 object DECaLS_34053_r c4d_151011_083816_ooi_r_ls9.fits.fz c4d_151011_083816_ooi_r_ls9-N7 r exptime 114.0 propid 2014B-0404 seeing 1.80 MJD 57306.358 object DECaLS_34053_r c4d_170916_093059_ooi_z_ls9.fits.fz c4d_170916_093059_ooi_z_ls9-N2 z exptime 213.0 propid 2014B-0404 seeing 1.24 MJD 58012.397 object DECaLS_26344_z c4d_171025_052258_ooi_g_ls9.fits.fz c4d_171025_052258_ooi_g_ls9-N2 g exptime 148.0 propid 2014B-0404 seeing 1.05 MJD 58051.224 object DECaLS_26344_g c4d_171025_052101_ooi_r_ls9.fits.fz c4d_171025_052101_ooi_r_ls9-N2 r exptime 88.0 propid 2014B-0404 seeing 0.99 MJD 58051.223 object DECaLS_26344_r c4d_151128_021316_ooi_z_ls9.fits.fz c4d_151128_021316_ooi_z_ls9-N3 z exptime 100.0 propid 2014B-0404 seeing 0.98 MJD 57354.091 object DECaLS_10472_z c4d_181007_033301_ooi_r_ls9.fits.fz c4d_181007_033301_ooi_r_ls9-N3 r exptime 54.0 propid 2014B-0404 seeing 1.24 MJD 58398.148 object DECaLS_10472_r c4d_171111_035351_ooi_g_ls9.fits.fz c4d_171111_035351_ooi_g_ls9-N3 g exptime 80.0 propid 2014B-0404 seeing 1.03 MJD 58068.162 object DECaLS_10472_g The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b7a0-z-20160723T092229_oi[N8,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b7a0-z-20160723T092229_oi[N1,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9559e7b-r-20151011T083801_oi[N1,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9559e7b-r-20151011T083801_oi[N8,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b7a0-z-20160723T090850_oi[N7,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9524a76-g-20170920T072116_oi[N7,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953739a-g-20181007T033006_oi[N1,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953739a-g-20181007T033006_oi[N8,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95316b1-z-20181015T030958_oi[N7,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953861c-r-20181111T044702_oi[N7,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952630f-g-20171025T052258_oi[N2,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9559e7b-r-20151011T083531_oi[N7,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e046-z-20170916T093059_oi[N2,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536bf1-r-20181007T033301_oi[N3,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95264c6-r-20171025T052101_oi[N2,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9555e2b-z-20151128T021045_oi[N3,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9526dbd-g-20171111T035351_oi[N3,noinherit][2046,4094][real]: DECaLS_1 Stage tims : Wall: 61.67 s, CPU: 5.98 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 184 MB, VmData: 218 MB, maxrss: 0.450432 MB Stage tims finished: 2020-06-06T11:30:09.758918 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b7a0-z-20160723T092229_oi[N1,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953861c-r-20181111T044702_oi[N7,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9559e7b-r-20151011T083801_oi[N1,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9559e7b-r-20151011T083531_oi[N7,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b7a0-z-20160723T090850_oi[N7,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952630f-g-20171025T052258_oi[N2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9559e7b-r-20151011T083801_oi[N8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e046-z-20170916T093059_oi[N2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953739a-g-20181007T033006_oi[N8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536bf1-r-20181007T033301_oi[N3,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9524a76-g-20170920T072116_oi[N7,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95264c6-r-20171025T052101_oi[N2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b7a0-z-20160723T092229_oi[N8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95316b1-z-20181015T030958_oi[N7,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9526dbd-g-20171111T035351_oi[N3,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953739a-g-20181007T033006_oi[N1,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9555e2b-z-20151128T021045_oi[N3,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] Resources for stage tims : 7.252 s worker CPU, 295.498 s worker Wall, Wall: 61.675 s, Cores in use: 0.21, Total efficiency (on 8 cores): 2.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/PGC1409798-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/PGC1409798-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-06T11:30:09.817047 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04810.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04683.fits Matched 4 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/metrics/cus/reference-custom-029644p12451.fits Stage refs : Wall: 12.08 s, CPU: 10.33 s, VmPeak: 1028 MB, VmSize: 1009 MB, VmRSS: 197 MB, VmData: 230 MB, maxrss: 0.450432 MB Stage refs finished: 2020-06-06T11:30:21.900843 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 12.085 s, Cores in use: 0.85, Total efficiency (on 8 cores): 10.7 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-06T11:30:21.902533 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/metrics/cus/outlier-mask-custom-029644p12451.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/metrics/cus/outliers-pre-custom-029644p12451.jpg Image c4d_171111_035351_ooi_g_ls9-N3 g : masking 715 positive outlier pixels and 0 negative outlier pixels Image c4d_170920_072116_ooi_g_ls9-N7 g : masking 86 positive outlier pixels and 0 negative outlier pixels Image c4d_171025_052258_ooi_g_ls9-N2 g : masking 160 positive outlier pixels and 0 negative outlier pixels Image c4d_151011_084057_ooi_r_ls9-N1 r : masking 0 positive outlier pixels and 150 negative outlier pixels Image c4d_171025_052101_ooi_r_ls9-N2 r : masking 0 positive outlier pixels and 158 negative outlier pixels Image c4d_151011_083816_ooi_r_ls9-N7 r : masking 165 positive outlier pixels and 0 negative outlier pixels Image c4d_160723_092659_ooi_z_ls9-N8 z : masking 84 positive outlier pixels and 94 negative outlier pixels Image c4d_181015_030958_ooi_z_ls9-N7 z : masking 0 positive outlier pixels and 93 negative outlier pixels Image c4d_160723_091100_ooi_z_ls9-N7 z : masking 609 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/metrics/cus/outlier-mask-custom-029644p12451.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/metrics/cus/outliers-post-custom-029644p12451.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/metrics/cus/outliers-masked-pos-custom-029644p12451.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/metrics/cus/outliers-masked-neg-custom-029644p12451.jpg Stage outliers : Wall: 8.55 s, CPU: 8.16 s, VmPeak: 1028 MB, VmSize: 1019 MB, VmRSS: 222 MB, VmData: 252 MB, maxrss: 0.450432 MB Stage outliers finished: 2020-06-06T11:30:30.450629 Resources for stage outliers : 2.067 s worker CPU, 2.072 s worker Wall, Wall: 8.549 s, Cores in use: 1.20, Total efficiency (on 8 cores): 15.0 % Stage outliers finished Running stage halos Running stage halos at 2020-06-06T11:30:30.452575 Stage halos : Wall: 7.57 s, CPU: 5.53 s, VmPeak: 1028 MB, VmSize: 1019 MB, VmRSS: 222 MB, VmData: 252 MB, maxrss: 0.450432 MB Stage halos finished: 2020-06-06T11:30:38.027348 Resources for stage halos : 0.162 s worker CPU, 12.976 s worker Wall, Wall: 7.576 s, Cores in use: 0.75, Total efficiency (on 8 cores): 9.4 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-06T11:30:38.029492 PSF sigmas in coadd pixels: ['2.25', '2.24', '2.85', '1.70', '1.68'] Using average PSF sigma 2.1455678269524356 Gaussian PSF norm 0.13147791844668252 vs pixelized 0.11246568 average tim pixel scale / coadd scale: 1.0011959794325795 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.62', '2.57', '1.93', '2.93', '1.61', '2.01'] Using average PSF sigma 2.2793290203096617 Gaussian PSF norm 0.1237622077639119 vs pixelized 0.11750284 average tim pixel scale / coadd scale: 1.0013535333520072 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.96', '1.95', '2.44', '2.83', '2.02', '1.59'] Using average PSF sigma 2.13064926105839 Gaussian PSF norm 0.13239851200743802 vs pixelized 0.10717744 average tim pixel scale / coadd scale: 1.0011930068428734 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.32 s, CPU: 0.31 s, VmPeak: 1028 MB, VmSize: 1019 MB, VmRSS: 224 MB, VmData: 252 MB, maxrss: 0.450432 MB Stage fit_on_coadds finished: 2020-06-06T11:30:38.345592 Resources for stage fit_on_coadds : 0.445 s worker CPU, 0.445 s worker Wall, Wall: 0.317 s, Cores in use: 2.38, Total efficiency (on 8 cores): 29.7 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-06T11:30:38.348881 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 84 potential peaks Of 84 potential peaks: 58 in veto map, 9 cut by saddle test, 0 cut by aper test, 17 kept SED z : 17 new peaks Found 75 potential peaks Of 75 potential peaks: 57 in veto map, 14 cut by saddle test, 0 cut by aper test, 4 kept SED r : 4 new peaks Found 77 potential peaks Of 77 potential peaks: 65 in veto map, 11 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 84 potential peaks Of 84 potential peaks: 66 in veto map, 14 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 86 potential peaks Of 86 potential peaks: 69 in veto map, 15 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 28 new sources Median coadd sky for g : 5.076218e-05 Median coadd sky for r : 8.034099e-05 Median coadd sky for z : 0.00016799137 Stage srcs : Wall: 4.43 s, CPU: 4.33 s, VmPeak: 1028 MB, VmSize: 1019 MB, VmRSS: 224 MB, VmData: 252 MB, maxrss: 0.450432 MB Stage srcs finished: 2020-06-06T11:30:42.774933 Resources for stage srcs : 0.146 s worker CPU, 0.146 s worker Wall, Wall: 4.427 s, Cores in use: 1.01, Total efficiency (on 8 cores): 12.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/PGC1409798-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/PGC1409798-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-06T11:30:42.788418 Blob 1 of 13, id: 0, sources: 16, size: 210x289, npix 37542, brick X: 78,288, Y: 0,289, one pixel: 162 0 Blob 2 of 13, id: 9, sources: 3, size: 63x34, npix 1158, brick X: 208,271, Y: 288,322, one pixel: 218 288 Blob 3 of 13, id: 11, sources: 1, size: 34x32, npix 775, brick X: 79,113, Y: 301,333, one pixel: 92 301 Blob 4 of 13, id: 1, sources: 1, size: 36x38, npix 675, brick X: 7,43, Y: 53,91, one pixel: 28 53 Blob 5 of 13, id: 10, sources: 2, size: 35x29, npix 555, brick X: 105,140, Y: 289,318, one pixel: 113 289 Blob 6 of 13, id: 4, sources: 1, size: 25x25, npix 391, brick X: 308,333, Y: 186,211, one pixel: 318 186 Blob 7 of 13, id: 8, sources: 1, size: 21x26, npix 381, brick X: 0,21, Y: 277,303, one pixel: 5 277 Blob 8 of 13, id: 12, sources: 1, size: 22x22, npix 292, brick X: 36,58, Y: 308,330, one pixel: 45 308 Blob 9 of 13, id: 6, sources: 1, size: 22x20, npix 276, brick X: 52,74, Y: 241,261, one pixel: 63 241 Blob 6 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 957 MB, VmSize: 719 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.14582 MB Blob 10 of 13, id: 2, sources: 1, size: 19x21, npix 237, brick X: 304,323, Y: 74,95, one pixel: 313 74 Blob 9 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 957 MB, VmSize: 719 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.14582 MB Blob 11 of 13, id: 5, sources: 1, size: 20x19, npix 218, brick X: 279,299, Y: 200,219, one pixel: 288 200 Measuring 1 iterative sources Blob 8 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 953 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.145996 MB Blob 12 of 13, id: 7, sources: 1, size: 19x20, npix 209, brick X: 305,324, Y: 267,287, one pixel: 314 267 Blob 7 finished, total: Wall: 0.79 s, CPU: 0.78 s, VmPeak: 958 MB, VmSize: 721 MB, VmRSS: 144 MB, VmData: 184 MB, maxrss: 0.1478 MB Blob 13 of 13, id: 3, sources: 1, size: 18x17, npix 162, brick X: 64,82, Y: 75,92, one pixel: 72 75 Blob 12 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 958 MB, VmSize: 721 MB, VmRSS: 144 MB, VmData: 184 MB, maxrss: 0.1478 MB Blob 5 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146836 MB Blob 13 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 958 MB, VmSize: 721 MB, VmRSS: 144 MB, VmData: 184 MB, maxrss: 0.1478 MB Blob 3 finished, total: Wall: 1.10 s, CPU: 1.10 s, VmPeak: 962 MB, VmSize: 725 MB, VmRSS: 148 MB, VmData: 188 MB, maxrss: 0.1516 MB Blob 4 finished, total: Wall: 1.17 s, CPU: 1.17 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146432 MB Blob 10 finished, total: Wall: 0.83 s, CPU: 0.83 s, VmPeak: 957 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.14778 MB Blob 11 finished, total: Wall: 0.44 s, CPU: 0.44 s, VmPeak: 953 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.145996 MB Blob 2 finished, total: Wall: 1.79 s, CPU: 1.79 s, VmPeak: 955 MB, VmSize: 719 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.1455 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.20591, ee1=-0.00618231, ee2=-0.035227 Measuring 15 iterative sources Blob 1 finished, total: Wall: 31.46 s, CPU: 31.46 s, VmPeak: 956 MB, VmSize: 757 MB, VmRSS: 191 MB, VmData: 220 MB, maxrss: 0.195744 MB Old catalog: 33 New catalog: 39 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/metrics/cus/blobs-custom-029644p12451.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/metrics/cus/all-models-custom-029644p12451.fits Stage fitblobs : Wall: 35.92 s, CPU: 4.44 s, VmPeak: 1028 MB, VmSize: 1019 MB, VmRSS: 225 MB, VmData: 252 MB, maxrss: 0.450432 MB Stage fitblobs finished: 2020-06-06T11:31:18.705590 Resources for stage fitblobs : 39.928 s worker CPU, 39.991 s worker Wall, Wall: 35.920 s, Cores in use: 1.24, Total efficiency (on 8 cores): 15.4 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-06T11:31:18.709182 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/tmp-legacysurvey-custom-029644p12451-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/tmp-legacysurvey-custom-029644p12451-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/tmp-legacysurvey-custom-029644p12451-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/tmp-legacysurvey-custom-029644p12451-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-resid.jpg Stage coadds : Wall: 6.12 s, CPU: 4.41 s, VmPeak: 1028 MB, VmSize: 1019 MB, VmRSS: 225 MB, VmData: 253 MB, maxrss: 0.450432 MB Stage coadds finished: 2020-06-06T11:31:24.832875 Resources for stage coadds : 4.381 s worker CPU, 4.702 s worker Wall, Wall: 6.125 s, Cores in use: 1.44, Total efficiency (on 8 cores): 17.9 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-06T11:31:24.834712 Cut to 1 unWISE tiles Reading WISE tile 0293p121 band 1 Reading WISE tile 0293p121 band 3 Reading WISE tile 0293p121 band 2 Reading WISE tile 0293p121 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0293p121/unwise-0293p121-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0293p121/unwise-0293p121-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0293p121/unwise-0293p121-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0293p121/unwise-0293p121-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0293p121/unwise-0293p121-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 957 MB, VmSize: 791 MB, VmRSS: 141 MB, VmData: 170 MB, maxrss: 0.203996 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0293p121/unwise-0293p121-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0293p121/unwise-0293p121-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0293p121/unwise-0293p121-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0293p121/unwise-0293p121-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0293p121/unwise-0293p121-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 953 MB, VmSize: 799 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.192268 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0293p121/unwise-0293p121-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0293p121/unwise-0293p121-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0293p121/unwise-0293p121-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0293p121/unwise-0293p121-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 956 MB, VmSize: 810 MB, VmRSS: 168 MB, VmData: 189 MB, maxrss: 0.226344 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0293p121/unwise-0293p121-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0293p121/unwise-0293p121-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0293p121/unwise-0293p121-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0293p121/unwise-0293p121-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 957 MB, VmSize: 792 MB, VmRSS: 146 MB, VmData: 171 MB, maxrss: 0.21002 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/tmp-legacysurvey-custom-029644p12451-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/tmp-legacysurvey-custom-029644p12451-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 6.68 s, CPU: 4.93 s, VmPeak: 1028 MB, VmSize: 1019 MB, VmRSS: 226 MB, VmData: 253 MB, maxrss: 0.450432 MB Stage wise_forced finished: 2020-06-06T11:31:31.519507 Resources for stage wise_forced : 3.513 s worker CPU, 5.405 s worker Wall, Wall: 6.686 s, Cores in use: 1.26, Total efficiency (on 8 cores): 15.8 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-06T11:31:31.521530 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/coadd/cus/custom-029644p12451/legacysurvey-custom-029644p12451-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/tractor-i/cus/tractor-custom-029644p12451.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/tractor/cus/tractor-custom-029644p12451.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1409798/tractor/cus/brick-custom-029644p12451.sha256sum Stage writecat : Wall: 4.25 s, CPU: 3.61 s, VmPeak: 1151 MB, VmSize: 1023 MB, VmRSS: 228 MB, VmData: 253 MB, maxrss: 0.450432 MB Stage writecat finished: 2020-06-06T11:31:35.776507 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.256 s, Cores in use: 0.85, Total efficiency (on 8 cores): 10.6 % Stage writecat finished All done: 57.895 s worker CPU, 361.240 s worker Wall, Wall: 147.696 s, Cores in use: 0.74, Total efficiency (on 8 cores): 9.3 % Finished galaxy PGC1409798 in 2.567 minutes.