Started working on galaxy PGC1059038 at Sun Jun 7 04:29:55 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 202.18836299999998 -4.3752561 --width 345 --height 345 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T04:29:57.569470 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '202.18836299999998', '-4.3752561', '--width', '345', '--height', '345', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 202.18836299999998 -4.3752561 --width 345 --height 345 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 202.18836299999998 -4.3752561 Starting process 21304 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 21305 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 21306 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 21307 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T04:29:58.157023 Keeping 9 CCDs: c4d_180518_012016_ooi_r_ls9.fits.fz c4d_180518_012016_ooi_r_ls9-S10 r exptime 61.0 propid 2014B-0404 seeing 1.05 MJD 58256.056 object DECaLS_44963_r c4d_160722_021057_ooi_z_ls9.fits.fz c4d_160722_021057_ooi_z_ls9-S10 z exptime 141.0 propid 2016A-0190 seeing 1.16 MJD 57591.089 object DECaLS_44963_z c4d_170717_230457_ooi_z_ls9.fits.fz c4d_170717_230457_ooi_z_ls9-S11 z exptime 120.0 propid 2014B-0404 seeing 1.24 MJD 57951.960 object DECaLS_29091_z c4d_170330_065826_ooi_r_ls9.fits.fz c4d_170330_065826_ooi_r_ls9-S11 r exptime 40.0 propid 2014B-0404 seeing 1.16 MJD 57842.290 object DECaLS_29091_r c4d_160813_231617_ooi_z_ls9.fits.fz c4d_160813_231617_ooi_z_ls9-S11 z exptime 80.0 propid 2014B-0404 seeing 1.19 MJD 57613.968 object DECaLS_29091_z c4d_160409_045845_ooi_g_ls9.fits.fz c4d_160409_045845_ooi_g_ls9-S11 g exptime 82.0 propid 2014B-0404 seeing 1.30 MJD 57487.206 object DECaLS_29091_g c4d_150330_045714_ooi_z_ls9.fits.fz c4d_150330_045714_ooi_z_ls9-S12 z exptime 67.0 propid 2014B-0404 seeing 0.95 MJD 57111.205 object DECaLS_13219_z c4d_170302_071448_ooi_r_ls9.fits.fz c4d_170302_071448_ooi_r_ls9-S12 r exptime 40.0 propid 2014B-0404 seeing 0.92 MJD 57814.301 object DECaLS_13219_r c4d_170302_071702_ooi_g_ls9.fits.fz c4d_170302_071702_ooi_g_ls9-S12 g exptime 106.0 propid 2014B-0404 seeing 1.05 MJD 57814.302 object DECaLS_13219_g The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c242-z-20160722T020746_oi[S10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951519f-r-20170330T065658_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560b38-r-20180518T012016_oi[S10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951822a-z-20170717T230204_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9569bf0-g-20160409T045633_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_957bb70-z-20150330T045519_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950e32f-g-20170302T071426_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T231405_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950d81b-r-20170302T071317_oi[S12,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 103.91 s, CPU: 0.97 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 177 MB, VmData: 211 MB, maxrss: 0.454952 MB Stage tims finished: 2020-06-07T04:31:42.062071 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560b38-r-20180518T012016_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_957bb70-z-20150330T045519_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c242-z-20160722T020746_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9569bf0-g-20160409T045633_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950e32f-g-20170302T071426_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951519f-r-20170330T065658_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T231405_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 3.658 s worker CPU, 383.198 s worker Wall, Wall: 103.906 s, Cores in use: 0.04, Total efficiency (on 4 cores): 1.1 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951822a-z-20170717T230204_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950d81b-r-20170302T071317_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-06-07T04:31:42.085974 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06664.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06536.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06792.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06663.fits Matched 4 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/metrics/cus/reference-custom-202188m04375.fits Stage refs : Wall: 4.98 s, CPU: 1.56 s, VmPeak: 1026 MB, VmSize: 1013 MB, VmRSS: 196 MB, VmData: 229 MB, maxrss: 0.454952 MB Stage refs finished: 2020-06-07T04:31:47.066258 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.981 s, Cores in use: 0.31, Total efficiency (on 4 cores): 7.8 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T04:31:47.067567 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/metrics/cus/outlier-mask-custom-202188m04375.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/metrics/cus/outliers-pre-custom-202188m04375.jpg Image c4d_170302_071702_ooi_g_ls9-S12 g : masking 527 positive outlier pixels and 0 negative outlier pixels Image c4d_170302_071448_ooi_r_ls9-S12 r : masking 0 positive outlier pixels and 75 negative outlier pixels Image c4d_150330_045714_ooi_z_ls9-S12 z : masking 480 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/metrics/cus/outlier-mask-custom-202188m04375.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/metrics/cus/outliers-post-custom-202188m04375.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/metrics/cus/outliers-masked-pos-custom-202188m04375.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/metrics/cus/outliers-masked-neg-custom-202188m04375.jpg Stage outliers : Wall: 1.03 s, CPU: 0.69 s, VmPeak: 1026 MB, VmSize: 1022 MB, VmRSS: 215 MB, VmData: 245 MB, maxrss: 0.454952 MB Stage outliers finished: 2020-06-07T04:31:48.102167 Resources for stage outliers : 1.201 s worker CPU, 1.249 s worker Wall, Wall: 1.036 s, Cores in use: 1.83, Total efficiency (on 4 cores): 45.8 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T04:31:48.103794 Stage halos : Wall: 1.21 s, CPU: 0.19 s, VmPeak: 1026 MB, VmSize: 1022 MB, VmRSS: 215 MB, VmData: 245 MB, maxrss: 0.454952 MB Stage halos finished: 2020-06-07T04:31:49.310936 Resources for stage halos : 0.254 s worker CPU, 3.680 s worker Wall, Wall: 1.208 s, Cores in use: 0.37, Total efficiency (on 4 cores): 9.3 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T04:31:49.312676 PSF sigmas in coadd pixels: ['2.11', '1.70'] Using average PSF sigma 1.9034740673222195 Gaussian PSF norm 0.14819996585019157 vs pixelized 0.12786502 average tim pixel scale / coadd scale: 1.0011059119639818 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.71', '1.89', '1.49'] Using average PSF sigma 1.6956028701859733 Gaussian PSF norm 0.16636843256990835 vs pixelized 0.1414559 average tim pixel scale / coadd scale: 1.0011051954765526 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.88', '2.01', '1.93', '1.55'] Using average PSF sigma 1.8441142137473465 Gaussian PSF norm 0.15297034731956502 vs pixelized 0.125558 average tim pixel scale / coadd scale: 1.0010663968491376 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.27 s, CPU: 0.22 s, VmPeak: 1026 MB, VmSize: 1022 MB, VmRSS: 218 MB, VmData: 246 MB, maxrss: 0.454952 MB Stage fit_on_coadds finished: 2020-06-07T04:31:49.582069 Resources for stage fit_on_coadds : 0.306 s worker CPU, 0.336 s worker Wall, Wall: 0.270 s, Cores in use: 1.96, Total efficiency (on 4 cores): 49.1 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T04:31:49.584422 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 24 potential peaks Of 24 potential peaks: 3 in veto map, 1 cut by saddle test, 0 cut by aper test, 20 kept SED z : 20 new peaks Found 26 potential peaks Of 26 potential peaks: 20 in veto map, 2 cut by saddle test, 0 cut by aper test, 4 kept SED r : 4 new peaks Found 19 potential peaks Of 19 potential peaks: 16 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 36 potential peaks Of 36 potential peaks: 27 in veto map, 5 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 37 potential peaks Of 37 potential peaks: 31 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 31 new sources Median coadd sky for g : 6.472194e-05 Median coadd sky for r : -5.5760163e-05 Median coadd sky for z : -4.778884e-05 Stage srcs : Wall: 0.65 s, CPU: 0.58 s, VmPeak: 1026 MB, VmSize: 1022 MB, VmRSS: 218 MB, VmData: 246 MB, maxrss: 0.454952 MB Stage srcs finished: 2020-06-07T04:31:50.238449 Resources for stage srcs : 0.177 s worker CPU, 0.177 s worker Wall, Wall: 0.655 s, Cores in use: 1.16, Total efficiency (on 4 cores): 29.0 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T04:31:51.348137 Blob 1 of 26, id: 8, sources: 4, size: 101x144, npix 7146, brick X: 154,255, Y: 96,240, one pixel: 184 96 Blob 2 of 26, id: 20, sources: 3, size: 54x48, npix 1571, brick X: 27,81, Y: 263,311, one pixel: 46 263 Blob 3 of 26, id: 19, sources: 3, size: 32x60, npix 1035, brick X: 300,332, Y: 244,304, one pixel: 318 244 Blob 4 of 26, id: 11, sources: 1, size: 38x37, npix 959, brick X: 52,90, Y: 102,139, one pixel: 67 102 Blob 5 of 26, id: 0, sources: 2, size: 39x36, npix 895, brick X: 179,218, Y: 0,36, one pixel: 190 0 Blob 4 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 960 MB, VmSize: 721 MB, VmRSS: 145 MB, VmData: 184 MB, maxrss: 0.148012 MB Blob 6 of 26, id: 23, sources: 1, size: 33x29, npix 682, brick X: 300,333, Y: 316,345, one pixel: 315 316 Measuring 1 iterative sources Measuring 1 iterative sources Blob 3 finished, total: Wall: 2.17 s, CPU: 2.17 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147148 MB Blob 7 of 26, id: 7, sources: 2, size: 30x32, npix 603, brick X: 315,345, Y: 82,114, one pixel: 326 82 Blob 5 finished, total: Wall: 1.67 s, CPU: 1.67 s, VmPeak: 960 MB, VmSize: 721 MB, VmRSS: 145 MB, VmData: 184 MB, maxrss: 0.148012 MB Blob 8 of 26, id: 15, sources: 1, size: 27x31, npix 581, brick X: 0,27, Y: 165,196, one pixel: 9 165 Blob 6 finished, total: Wall: 1.06 s, CPU: 1.06 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147148 MB Blob 9 of 26, id: 6, sources: 1, size: 28x29, npix 527, brick X: 78,106, Y: 63,92, one pixel: 91 63 Blob 2 finished, total: Wall: 3.52 s, CPU: 3.52 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14946 MB Blob 10 of 26, id: 9, sources: 1, size: 27x27, npix 470, brick X: 10,37, Y: 97,124, one pixel: 21 97 Blob 8 finished, total: Wall: 0.97 s, CPU: 0.97 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147148 MB Blob 11 of 26, id: 10, sources: 1, size: 29x25, npix 449, brick X: 261,290, Y: 101,126, one pixel: 276 101 Blob 9 finished, total: Wall: 0.72 s, CPU: 0.72 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14946 MB Blob 12 of 26, id: 2, sources: 1, size: 27x26, npix 443, brick X: 315,342, Y: 6,32, one pixel: 327 6 Blob 7 finished, total: Wall: 1.90 s, CPU: 1.90 s, VmPeak: 960 MB, VmSize: 721 MB, VmRSS: 145 MB, VmData: 184 MB, maxrss: 0.148012 MB Blob 13 of 26, id: 21, sources: 1, size: 25x26, npix 405, brick X: 103,128, Y: 278,304, one pixel: 115 278 Blob 10 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147148 MB Blob 14 of 26, id: 13, sources: 1, size: 26x25, npix 394, brick X: 138,164, Y: 151,176, one pixel: 149 151 Blob 11 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14946 MB Blob 15 of 26, id: 17, sources: 1, size: 24x24, npix 362, brick X: 84,108, Y: 207,231, one pixel: 93 207 Blob 12 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 960 MB, VmSize: 721 MB, VmRSS: 145 MB, VmData: 184 MB, maxrss: 0.148012 MB Blob 16 of 26, id: 22, sources: 1, size: 24x25, npix 353, brick X: 71,95, Y: 292,317, one pixel: 82 292 Blob 13 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147148 MB Blob 17 of 26, id: 4, sources: 1, size: 24x23, npix 346, brick X: 171,195, Y: 46,69, one pixel: 183 46 Blob 14 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14946 MB Blob 18 of 26, id: 14, sources: 1, size: 22x23, npix 325, brick X: 310,332, Y: 162,185, one pixel: 320 162 Blob 15 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 960 MB, VmSize: 721 MB, VmRSS: 145 MB, VmData: 184 MB, maxrss: 0.148012 MB Blob 19 of 26, id: 24, sources: 1, size: 23x25, npix 283, brick X: 156,179, Y: 320,345, one pixel: 164 320 Blob 18 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 960 MB, VmSize: 721 MB, VmRSS: 145 MB, VmData: 184 MB, maxrss: 0.148012 MB Blob 20 of 26, id: 1, sources: 1, size: 21x20, npix 258, brick X: 51,72, Y: 5,25, one pixel: 59 5 Measuring 1 iterative sources Blob 16 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147148 MB Blob 19 finished, total: Wall: 0.11 s, CPU: 0.11 s, VmPeak: 960 MB, VmSize: 721 MB, VmRSS: 145 MB, VmData: 184 MB, maxrss: 0.148012 MB Blob 21 of 26, id: 5, sources: 1, size: 19x20, npix 208, brick X: 248,267, Y: 59,79, one pixel: 257 59 Blob 22 of 26, id: 12, sources: 1, size: 19x19, npix 199, brick X: 299,318, Y: 106,125, one pixel: 308 106 Blob 21 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 960 MB, VmSize: 721 MB, VmRSS: 145 MB, VmData: 184 MB, maxrss: 0.148012 MB Blob 23 of 26, id: 3, sources: 1, size: 18x19, npix 198, brick X: 245,263, Y: 7,26, one pixel: 253 7 Blob 17 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14946 MB Blob 24 of 26, id: 16, sources: 1, size: 18x19, npix 189, brick X: 287,305, Y: 184,203, one pixel: 295 184 Blob 20 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147148 MB Blob 25 of 26, id: 25, sources: 1, size: 20x15, npix 189, brick X: 180,200, Y: 330,345, one pixel: 189 330 Blob 23 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14946 MB Blob 26 of 26, id: 18, sources: 1, size: 12x19, npix 134, brick X: 333,345, Y: 232,251, one pixel: 342 232 Blob 22 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 960 MB, VmSize: 721 MB, VmRSS: 145 MB, VmData: 184 MB, maxrss: 0.148012 MB Blob 24 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147148 MB Blob 25 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14946 MB Blob 26 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 960 MB, VmSize: 721 MB, VmRSS: 145 MB, VmData: 184 MB, maxrss: 0.148012 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.25767, ee1=1.33172, ee2=-0.56062 Measuring 6 iterative sources Blob 1 finished, total: Wall: 15.87 s, CPU: 15.87 s, VmPeak: 958 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.150836 MB Old catalog: 36 New catalog: 40 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/metrics/cus/blobs-custom-202188m04375.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/metrics/cus/all-models-custom-202188m04375.fits Stage fitblobs : Wall: 16.16 s, CPU: 0.41 s, VmPeak: 1026 MB, VmSize: 1022 MB, VmRSS: 219 MB, VmData: 246 MB, maxrss: 0.454952 MB Stage fitblobs finished: 2020-06-07T04:32:07.509099 Resources for stage fitblobs : 37.976 s worker CPU, 37.998 s worker Wall, Wall: 16.162 s, Cores in use: 2.37, Total efficiency (on 4 cores): 59.4 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T04:32:07.510818 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/tmp-legacysurvey-custom-202188m04375-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/tmp-legacysurvey-custom-202188m04375-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/tmp-legacysurvey-custom-202188m04375-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/tmp-legacysurvey-custom-202188m04375-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-resid.jpg Stage coadds : Wall: 2.03 s, CPU: 1.09 s, VmPeak: 1026 MB, VmSize: 1022 MB, VmRSS: 219 MB, VmData: 247 MB, maxrss: 0.454952 MB Stage coadds finished: 2020-06-07T04:32:09.543385 Resources for stage coadds : 2.771 s worker CPU, 3.191 s worker Wall, Wall: 2.033 s, Cores in use: 1.90, Total efficiency (on 4 cores): 47.5 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T04:32:09.544801 Cut to 1 unWISE tiles Reading WISE tile 2020m046 band 1 Reading WISE tile 2020m046 band 2 Reading WISE tile 2020m046 band 3 Reading WISE tile 2020m046 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 960 MB, VmSize: 793 MB, VmRSS: 149 MB, VmData: 172 MB, maxrss: 0.211656 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 956 MB, VmSize: 800 MB, VmRSS: 153 MB, VmData: 179 MB, maxrss: 0.194132 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 958 MB, VmSize: 793 MB, VmRSS: 144 MB, VmData: 172 MB, maxrss: 0.20832 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 962 MB, VmSize: 796 MB, VmRSS: 150 MB, VmData: 175 MB, maxrss: 0.214688 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/tmp-legacysurvey-custom-202188m04375-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/tmp-legacysurvey-custom-202188m04375-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 6.93 s, CPU: 1.87 s, VmPeak: 1026 MB, VmSize: 1022 MB, VmRSS: 220 MB, VmData: 247 MB, maxrss: 0.454952 MB Stage wise_forced finished: 2020-06-07T04:32:16.475271 Resources for stage wise_forced : 3.216 s worker CPU, 15.944 s worker Wall, Wall: 6.932 s, Cores in use: 0.73, Total efficiency (on 4 cores): 18.3 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T04:32:16.476946 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/tractor-i/cus/tractor-custom-202188m04375.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/tractor/cus/tractor-custom-202188m04375.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/tractor/cus/brick-custom-202188m04375.sha256sum Stage writecat : Wall: 1.79 s, CPU: 1.36 s, VmPeak: 1154 MB, VmSize: 1026 MB, VmRSS: 222 MB, VmData: 247 MB, maxrss: 0.454952 MB Stage writecat finished: 2020-06-07T04:32:18.269301 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.793 s, Cores in use: 0.76, Total efficiency (on 4 cores): 18.9 % Stage writecat finished All done: 49.559 s worker CPU, 445.774 s worker Wall, Wall: 140.117 s, Cores in use: 0.42, Total efficiency (on 4 cores): 10.4 % Finished galaxy PGC1059038 in 2.380 minutes. Started working on galaxy PGC1059038 at Thu Jul 23 06:01:44 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 202.18836299999998 -4.3752561 --width 345 --height 345 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-07-23T06:01:45.510980 legacypipe git version: DR9.5.5-21-g66b1aacb Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '202.18836299999998', '-4.3752561', '--width', '345', '--height', '345', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 202.18836299999998 -4.3752561 --width 345 --height 345 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 202.18836299999998 -4.3752561 Starting process 1212 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB Starting process 1213 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB Starting process 1214 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058868 MB Starting process 1215 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0591 MB Starting process 1216 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059104 MB Starting process 1217 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059104 MB Starting process 1218 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB Starting process 1219 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB Starting process 1220 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB Starting process 1221 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB Starting process 1222 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 1223 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB Starting process 1224 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB Starting process 1225 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB Starting process 1226 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB Starting process 1227 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-07-23T06:01:45.951331 Keeping 9 CCDs: c4d_180518_012016_ooi_r_ls9.fits.fz c4d_180518_012016_ooi_r_ls9-S10 r exptime 61.0 propid 2014B-0404 seeing 1.05 MJD 58256.056 object DECaLS_44963_r c4d_160722_021057_ooi_z_ls9.fits.fz c4d_160722_021057_ooi_z_ls9-S10 z exptime 141.0 propid 2016A-0190 seeing 1.16 MJD 57591.089 object DECaLS_44963_z c4d_170717_230457_ooi_z_ls9.fits.fz c4d_170717_230457_ooi_z_ls9-S11 z exptime 120.0 propid 2014B-0404 seeing 1.24 MJD 57951.960 object DECaLS_29091_z c4d_170330_065826_ooi_r_ls9.fits.fz c4d_170330_065826_ooi_r_ls9-S11 r exptime 40.0 propid 2014B-0404 seeing 1.16 MJD 57842.290 object DECaLS_29091_r c4d_160813_231617_ooi_z_ls9.fits.fz c4d_160813_231617_ooi_z_ls9-S11 z exptime 80.0 propid 2014B-0404 seeing 1.19 MJD 57613.968 object DECaLS_29091_z c4d_160409_045845_ooi_g_ls9.fits.fz c4d_160409_045845_ooi_g_ls9-S11 g exptime 82.0 propid 2014B-0404 seeing 1.30 MJD 57487.206 object DECaLS_29091_g c4d_150330_045714_ooi_z_ls9.fits.fz c4d_150330_045714_ooi_z_ls9-S12 z exptime 67.0 propid 2014B-0404 seeing 0.95 MJD 57111.205 object DECaLS_13219_z c4d_170302_071448_ooi_r_ls9.fits.fz c4d_170302_071448_ooi_r_ls9-S12 r exptime 40.0 propid 2014B-0404 seeing 0.92 MJD 57814.301 object DECaLS_13219_r c4d_170302_071702_ooi_g_ls9.fits.fz c4d_170302_071702_ooi_g_ls9-S12 g exptime 106.0 propid 2014B-0404 seeing 1.05 MJD 57814.302 object DECaLS_13219_g The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951519f-r-20170330T065658_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560b38-r-20180518T012016_oi[S10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T231405_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c242-z-20160722T020746_oi[S10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_957bb70-z-20150330T045519_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950e32f-g-20170302T071426_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9569bf0-g-20160409T045633_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950d81b-r-20170302T071317_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951822a-z-20170717T230204_oi[S11,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 10.35 s, CPU: 0.83 s, VmPeak: 998 MB, VmSize: 998 MB, VmRSS: 180 MB, VmData: 213 MB, maxrss: 0.183868 MB Stage tims finished: 2020-07-23T06:01:56.298644 Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560b38-r-20180518T012016_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T231405_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c242-z-20160722T020746_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950e32f-g-20170302T071426_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9569bf0-g-20160409T045633_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950d81b-r-20170302T071317_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951822a-z-20170717T230204_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 5.326 s worker CPU, 63.845 s worker Wall, Wall: 10.349 s, Cores in use: 0.59, Total efficiency (on 16 cores): 3.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951519f-r-20170330T065658_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-07-23T06:01:56.327855 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06664.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06536.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06792.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06663.fits Matched 3 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/metrics/cus/reference-custom-202188m04375.fits Stage refs : Wall: 3.21 s, CPU: 2.16 s, VmPeak: 1029 MB, VmSize: 1017 MB, VmRSS: 199 MB, VmData: 232 MB, maxrss: 0.204072 MB Stage refs finished: 2020-07-23T06:01:59.542327 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_957bb70-z-20150330T045519_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.216 s, Cores in use: 0.67, Total efficiency (on 16 cores): 4.2 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-07-23T06:01:59.663582 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/metrics/cus/outlier-mask-custom-202188m04375.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/metrics/cus/outliers-pre-custom-202188m04375.jpg Image c4d_170302_071702_ooi_g_ls9-S12 g : masking 527 positive outlier pixels and 0 negative outlier pixels Image c4d_170302_071448_ooi_r_ls9-S12 r : masking 0 positive outlier pixels and 75 negative outlier pixels Image c4d_150330_045714_ooi_z_ls9-S12 z : masking 480 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/metrics/cus/outlier-mask-custom-202188m04375.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/metrics/cus/outliers-post-custom-202188m04375.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/metrics/cus/outliers-masked-pos-custom-202188m04375.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/metrics/cus/outliers-masked-neg-custom-202188m04375.jpg Stage outliers : Wall: 2.09 s, CPU: 1.64 s, VmPeak: 1029 MB, VmSize: 1026 MB, VmRSS: 220 MB, VmData: 249 MB, maxrss: 0.225092 MB Stage outliers finished: 2020-07-23T06:02:01.752781 Resources for stage outliers : 1.144 s worker CPU, 1.274 s worker Wall, Wall: 2.091 s, Cores in use: 1.33, Total efficiency (on 16 cores): 8.3 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-07-23T06:02:01.880026 Stage halos : Wall: 0.86 s, CPU: 0.64 s, VmPeak: 1029 MB, VmSize: 1026 MB, VmRSS: 220 MB, VmData: 250 MB, maxrss: 0.22536 MB Stage halos finished: 2020-07-23T06:02:02.739655 Resources for stage halos : 0.351 s worker CPU, 1.142 s worker Wall, Wall: 0.862 s, Cores in use: 1.16, Total efficiency (on 16 cores): 7.2 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-07-23T06:02:02.775625 PSF sigmas in coadd pixels: ['2.11', '1.70'] Using average PSF sigma 1.9034740673222195 Gaussian PSF norm 0.14819996585019157 vs pixelized 0.12786502 average tim pixel scale / coadd scale: 1.0011059119639818 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.71', '1.89', '1.49'] Using average PSF sigma 1.6956028701859733 Gaussian PSF norm 0.16636843256990835 vs pixelized 0.1414559 average tim pixel scale / coadd scale: 1.0011051954765526 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.88', '2.01', '1.93', '1.55'] Using average PSF sigma 1.8441142137473465 Gaussian PSF norm 0.15297034731956502 vs pixelized 0.125558 average tim pixel scale / coadd scale: 1.0010663968491376 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.25 s, CPU: 0.21 s, VmPeak: 1029 MB, VmSize: 1026 MB, VmRSS: 222 MB, VmData: 250 MB, maxrss: 0.22696 MB Stage fit_on_coadds finished: 2020-07-23T06:02:03.024167 Resources for stage fit_on_coadds : 0.243 s worker CPU, 0.243 s worker Wall, Wall: 0.250 s, Cores in use: 1.83, Total efficiency (on 16 cores): 11.4 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-07-23T06:02:03.044596 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 24 potential peaks Of 24 potential peaks: 3 in veto map, 1 cut by saddle test, 0 cut by aper test, 20 kept SED z : 20 new peaks Found 26 potential peaks Of 26 potential peaks: 20 in veto map, 2 cut by saddle test, 0 cut by aper test, 4 kept SED r : 4 new peaks Found 19 potential peaks Of 19 potential peaks: 16 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 36 potential peaks Of 36 potential peaks: 27 in veto map, 5 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 37 potential peaks Of 37 potential peaks: 31 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 31 new sources Median coadd sky for g : 6.472194e-05 Median coadd sky for r : -5.5760163e-05 Median coadd sky for z : -4.7788802e-05 Stage srcs : Wall: 1.76 s, CPU: 1.66 s, VmPeak: 1029 MB, VmSize: 1026 MB, VmRSS: 222 MB, VmData: 250 MB, maxrss: 0.227484 MB Stage srcs finished: 2020-07-23T06:02:04.809224 Resources for stage srcs : 0.146 s worker CPU, 0.146 s worker Wall, Wall: 1.766 s, Cores in use: 1.02, Total efficiency (on 16 cores): 6.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-07-23T06:02:04.835650 Blob 1 of 26, id: 8, sources: 4, size: 101x144, npix 7146, brick X: 154,255, Y: 96,240, one pixel: 184 96 Blob 2 of 26, id: 20, sources: 3, size: 54x48, npix 1571, brick X: 27,81, Y: 263,311, one pixel: 46 263 Blob 3 of 26, id: 19, sources: 3, size: 32x60, npix 1035, brick X: 300,332, Y: 244,304, one pixel: 318 244 Blob 4 of 26, id: 11, sources: 1, size: 38x37, npix 959, brick X: 52,90, Y: 102,139, one pixel: 67 102 Blob 5 of 26, id: 0, sources: 2, size: 39x36, npix 895, brick X: 179,218, Y: 0,36, one pixel: 190 0 Blob 6 of 26, id: 23, sources: 1, size: 33x29, npix 682, brick X: 300,333, Y: 316,345, one pixel: 315 316 Blob 7 of 26, id: 7, sources: 2, size: 30x32, npix 603, brick X: 315,345, Y: 82,114, one pixel: 326 82 Blob 8 of 26, id: 15, sources: 1, size: 27x31, npix 581, brick X: 0,27, Y: 165,196, one pixel: 9 165 Blob 9 of 26, id: 6, sources: 1, size: 28x29, npix 527, brick X: 78,106, Y: 63,92, one pixel: 91 63 Blob 10 of 26, id: 9, sources: 1, size: 27x27, npix 470, brick X: 10,37, Y: 97,124, one pixel: 21 97 Blob 11 of 26, id: 10, sources: 1, size: 29x25, npix 449, brick X: 261,290, Y: 101,126, one pixel: 276 101 Blob 12 of 26, id: 2, sources: 1, size: 27x26, npix 443, brick X: 315,342, Y: 6,32, one pixel: 327 6 Blob 13 of 26, id: 21, sources: 1, size: 25x26, npix 405, brick X: 103,128, Y: 278,304, one pixel: 115 278 Blob 14 of 26, id: 13, sources: 1, size: 26x25, npix 394, brick X: 138,164, Y: 151,176, one pixel: 149 151 Blob 15 of 26, id: 17, sources: 1, size: 24x24, npix 362, brick X: 84,108, Y: 207,231, one pixel: 93 207 Blob 16 of 26, id: 22, sources: 1, size: 24x25, npix 353, brick X: 71,95, Y: 292,317, one pixel: 82 292 Blob 17 of 26, id: 4, sources: 1, size: 24x23, npix 346, brick X: 171,195, Y: 46,69, one pixel: 183 46 Blob 15 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 946 MB, VmSize: 721 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146324 MB Blob 4 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 689 MB, VmSize: 689 MB, VmRSS: 114 MB, VmData: 166 MB, maxrss: 0.116396 MB Blob 18 of 26, id: 14, sources: 1, size: 22x23, npix 325, brick X: 310,332, Y: 162,185, one pixel: 320 162 Blob 16 finished, total: Wall: 0.79 s, CPU: 0.77 s, VmPeak: 953 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14528 MB Blob 19 of 26, id: 24, sources: 1, size: 23x25, npix 283, brick X: 156,179, Y: 320,345, one pixel: 164 320 Blob 13 finished, total: Wall: 0.80 s, CPU: 0.79 s, VmPeak: 663 MB, VmSize: 663 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097304 MB Blob 20 of 26, id: 1, sources: 1, size: 21x20, npix 258, brick X: 51,72, Y: 5,25, one pixel: 59 5 Blob 21 of 26, id: 5, sources: 1, size: 19x20, npix 208, brick X: 248,267, Y: 59,79, one pixel: 257 59 Blob 10 finished, total: Wall: 0.85 s, CPU: 0.83 s, VmPeak: 952 MB, VmSize: 721 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146228 MB Blob 14 finished, total: Wall: 0.84 s, CPU: 0.83 s, VmPeak: 661 MB, VmSize: 661 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.094972 MB Blob 22 of 26, id: 12, sources: 1, size: 19x19, npix 199, brick X: 299,318, Y: 106,125, one pixel: 308 106 Blob 23 of 26, id: 3, sources: 1, size: 18x19, npix 198, brick X: 245,263, Y: 7,26, one pixel: 253 7 Measuring 1 iterative sources Blob 9 finished, total: Wall: 0.88 s, CPU: 0.88 s, VmPeak: 689 MB, VmSize: 689 MB, VmRSS: 114 MB, VmData: 166 MB, maxrss: 0.116644 MB Blob 24 of 26, id: 16, sources: 1, size: 18x19, npix 189, brick X: 287,305, Y: 184,203, one pixel: 295 184 Blob 19 finished, total: Wall: 0.13 s, CPU: 0.12 s, VmPeak: 953 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14528 MB Blob 25 of 26, id: 25, sources: 1, size: 20x15, npix 189, brick X: 180,200, Y: 330,345, one pixel: 189 330 Blob 11 finished, total: Wall: 0.96 s, CPU: 0.94 s, VmPeak: 951 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146908 MB Blob 26 of 26, id: 18, sources: 1, size: 12x19, npix 134, brick X: 333,345, Y: 232,251, one pixel: 342 232 Blob 12 finished, total: Wall: 1.02 s, CPU: 1.00 s, VmPeak: 949 MB, VmSize: 721 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146784 MB Blob 21 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 952 MB, VmSize: 721 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148112 MB Blob 20 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 663 MB, VmSize: 663 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097388 MB Blob 8 finished, total: Wall: 1.14 s, CPU: 1.14 s, VmPeak: 689 MB, VmSize: 689 MB, VmRSS: 113 MB, VmData: 166 MB, maxrss: 0.115576 MB Blob 18 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 689 MB, VmSize: 689 MB, VmRSS: 114 MB, VmData: 166 MB, maxrss: 0.116644 MB Blob 23 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 689 MB, VmSize: 689 MB, VmRSS: 114 MB, VmData: 166 MB, maxrss: 0.116816 MB Blob 6 finished, total: Wall: 1.25 s, CPU: 1.23 s, VmPeak: 953 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14492 MB Blob 22 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 661 MB, VmSize: 661 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095124 MB Measuring 1 iterative sources Blob 24 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 953 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14528 MB Blob 25 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 951 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146908 MB Blob 5 finished, total: Wall: 1.64 s, CPU: 1.63 s, VmPeak: 946 MB, VmSize: 721 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146376 MB Blob 17 finished, total: Wall: 0.88 s, CPU: 0.88 s, VmPeak: 946 MB, VmSize: 721 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146324 MB Blob 26 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 949 MB, VmSize: 721 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146784 MB Measuring 1 iterative sources Blob 7 finished, total: Wall: 1.82 s, CPU: 1.81 s, VmPeak: 942 MB, VmSize: 721 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146244 MB Blob 3 finished, total: Wall: 1.99 s, CPU: 1.99 s, VmPeak: 687 MB, VmSize: 687 MB, VmRSS: 111 MB, VmData: 164 MB, maxrss: 0.11358 MB Blob 2 finished, total: Wall: 2.74 s, CPU: 2.73 s, VmPeak: 690 MB, VmSize: 690 MB, VmRSS: 116 MB, VmData: 168 MB, maxrss: 0.118848 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.25767, ee1=1.33172, ee2=-0.560621 Measuring 6 iterative sources Blob 1 finished, total: Wall: 13.10 s, CPU: 13.07 s, VmPeak: 949 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150564 MB Old catalog: 36 New catalog: 40 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/metrics/cus/blobs-custom-202188m04375.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/metrics/cus/all-models-custom-202188m04375.fits Stage fitblobs : Wall: 14.52 s, CPU: 1.33 s, VmPeak: 1029 MB, VmSize: 1026 MB, VmRSS: 223 MB, VmData: 250 MB, maxrss: 0.227856 MB Stage fitblobs finished: 2020-07-23T06:02:19.355286 Resources for stage fitblobs : 36.071 s worker CPU, 37.473 s worker Wall, Wall: 14.522 s, Cores in use: 2.58, Total efficiency (on 16 cores): 16.1 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-07-23T06:02:19.374717 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/tmp-legacysurvey-custom-202188m04375-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/tmp-legacysurvey-custom-202188m04375-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/tmp-legacysurvey-custom-202188m04375-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/tmp-legacysurvey-custom-202188m04375-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-resid.jpg Stage coadds : Wall: 2.39 s, CPU: 0.91 s, VmPeak: 1029 MB, VmSize: 1026 MB, VmRSS: 223 MB, VmData: 250 MB, maxrss: 0.228444 MB Stage coadds finished: 2020-07-23T06:02:21.761640 Resources for stage coadds : 10.879 s worker CPU, 15.777 s worker Wall, Wall: 2.389 s, Cores in use: 4.93, Total efficiency (on 16 cores): 30.8 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-07-23T06:02:21.783415 Cut to 1 unWISE tiles Reading WISE tile 2020m046 band 1 Reading WISE tile 2020m046 band 2 Reading WISE tile 2020m046 band 4 Reading WISE tile 2020m046 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 953 MB, VmSize: 799 MB, VmRSS: 151 MB, VmData: 177 MB, maxrss: 0.197776 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 949 MB, VmSize: 798 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.210388 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 942 MB, VmSize: 798 MB, VmRSS: 146 MB, VmData: 176 MB, maxrss: 0.209724 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 946 MB, VmSize: 798 MB, VmRSS: 146 MB, VmData: 176 MB, maxrss: 0.209908 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/tmp-legacysurvey-custom-202188m04375-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/tmp-legacysurvey-custom-202188m04375-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.13 s, CPU: 0.62 s, VmPeak: 1029 MB, VmSize: 1026 MB, VmRSS: 224 MB, VmData: 250 MB, maxrss: 0.229148 MB Stage wise_forced finished: 2020-07-23T06:02:23.913976 Resources for stage wise_forced : 3.211 s worker CPU, 4.579 s worker Wall, Wall: 2.132 s, Cores in use: 1.80, Total efficiency (on 16 cores): 11.2 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-07-23T06:02:23.932718 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202188m04375/legacysurvey-custom-202188m04375-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/tractor-i/cus/tractor-custom-202188m04375.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/tractor/cus/tractor-custom-202188m04375.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/tractor/cus/brick-custom-202188m04375.sha256sum Stage writecat : Wall: 1.01 s, CPU: 0.53 s, VmPeak: 1159 MB, VmSize: 1031 MB, VmRSS: 225 MB, VmData: 250 MB, maxrss: 0.361892 MB Stage writecat finished: 2020-07-23T06:02:24.939340 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.008 s, Cores in use: 0.53, Total efficiency (on 16 cores): 3.3 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-writecat.p All done: 57.375 s worker CPU, 124.483 s worker Wall, Wall: 39.102 s, Cores in use: 1.74, Total efficiency (on 16 cores): 10.9 % Finished galaxy PGC1059038 in 0.680 minutes. Started working on galaxy PGC1059038 at Wed Aug 5 20:07:55 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 202.1868 -4.3753 --width 345 --height 345 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T20:07:56.413382 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '202.1868', '-4.3753', '--width', '345', '--height', '345', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 202.1868 -4.3753 --width 345 --height 345 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 202.1868 -4.3753 Starting process 50887 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB Starting process 50888 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 50889 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 50890 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 50891 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB Starting process 50892 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 50893 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 50894 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 50895 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 50896 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 50897 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 50898 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 50899 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 50900 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 50901 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 50902 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 50903 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 50904 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 50905 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 50906 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 50907 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 50908 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 50909 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 50910 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 50911 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 50912 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 50913 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 50914 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 50915 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 50916 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 50917 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 50918 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T20:07:57.329261 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 9 CCDs: c4d_180518_012016_ooi_r_ls9-S10 r expnum 747309 exptime 61.0 propid 2014B-0404 seeing 1.05 MJD 58256.056 object DECaLS_44963_r decam/CP/V4.8.2a/CP20180517/c4d_180518_012016_ooi_r_ls9.fits.fz c4d_160722_021057_ooi_z_ls9-S10 z expnum 553715 exptime 141.0 propid 2016A-0190 seeing 1.16 MJD 57591.089 object DECaLS_44963_z decam/CP/V4.8.2a/CP20160721/c4d_160722_021057_ooi_z_ls9.fits.fz c4d_170717_230457_ooi_z_ls9-S11 z expnum 659472 exptime 120.0 propid 2014B-0404 seeing 1.24 MJD 57951.960 object DECaLS_29091_z decam/CP/V4.8.2/CP20170717/c4d_170717_230457_ooi_z_ls9.fits.fz c4d_170330_065826_ooi_r_ls9-S11 r expnum 635306 exptime 40.0 propid 2014B-0404 seeing 1.16 MJD 57842.290 object DECaLS_29091_r decam/CP/V4.8.2/CP20170329/c4d_170330_065826_ooi_r_ls9.fits.fz c4d_160813_231617_ooi_z_ls9-S11 z expnum 563791 exptime 80.0 propid 2014B-0404 seeing 1.19 MJD 57613.968 object DECaLS_29091_z decam/CP/V4.8.2a/CP20160813/c4d_160813_231617_ooi_z_ls9.fits.fz c4d_160409_045845_ooi_g_ls9-S11 g expnum 535588 exptime 82.0 propid 2014B-0404 seeing 1.30 MJD 57487.206 object DECaLS_29091_g decam/CP/V4.8.2a/CP20160408/c4d_160409_045845_ooi_g_ls9.fits.fz c4d_150330_045714_ooi_z_ls9-S12 z expnum 426147 exptime 67.0 propid 2014B-0404 seeing 0.95 MJD 57111.205 object DECaLS_13219_z decam/CP/V4.8.2a/CP20150329/c4d_150330_045714_ooi_z_ls9.fits.fz c4d_170302_071448_ooi_r_ls9-S12 r expnum 625015 exptime 40.0 propid 2014B-0404 seeing 0.92 MJD 57814.301 object DECaLS_13219_r decam/CP/V4.8.2/CP20170301/c4d_170302_071448_ooi_r_ls9.fits.fz c4d_170302_071702_ooi_g_ls9-S12 g expnum 625016 exptime 106.0 propid 2014B-0404 seeing 1.05 MJD 57814.302 object DECaLS_13219_g decam/CP/V4.8.2/CP20170301/c4d_170302_071702_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_957bb70-z-20150330T045519_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560b38-r-20180518T012016_oi[S10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T231405_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950d81b-r-20170302T071317_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951519f-r-20170330T065658_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9569bf0-g-20160409T045633_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c242-z-20160722T020746_oi[S10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951822a-z-20170717T230204_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950e32f-g-20170302T071426_oi[S12,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 18.44 s, CPU: 1.34 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 181 MB, VmData: 214 MB, maxrss: 0.185564 MB Stage tims finished: 2020-08-05T20:08:15.764378 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_957bb70-z-20150330T045519_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951822a-z-20170717T230204_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T231405_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950d81b-r-20170302T071317_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9569bf0-g-20160409T045633_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c242-z-20160722T020746_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 5.211 s worker CPU, 127.696 s worker Wall, Wall: 18.439 s, Cores in use: 0.36, Total efficiency (on 32 cores): 1.1 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560b38-r-20180518T012016_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951519f-r-20170330T065658_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T20:08:15.803850 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06664.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06536.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06792.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06663.fits Matched 3 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/metrics/cus/reference-custom-202186m04375.fits Stage refs : Wall: 9.29 s, CPU: 2.00 s, VmPeak: 1042 MB, VmSize: 1030 MB, VmRSS: 201 MB, VmData: 232 MB, maxrss: 0.205552 MB Stage refs finished: 2020-08-05T20:08:25.098414 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950e32f-g-20170302T071426_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.297 s, Cores in use: 0.22, Total efficiency (on 32 cores): 0.7 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T20:08:25.129611 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/metrics/cus/outlier-mask-custom-202186m04375.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/metrics/cus/outliers-pre-custom-202186m04375.jpg Image c4d_170302_071702_ooi_g_ls9-S12 g : masking 618 positive outlier pixels and 0 negative outlier pixels Image c4d_150330_045714_ooi_z_ls9-S12 z : masking 224 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/metrics/cus/outlier-mask-custom-202186m04375.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/metrics/cus/outliers-post-custom-202186m04375.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/metrics/cus/outliers-masked-pos-custom-202186m04375.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/metrics/cus/outliers-masked-neg-custom-202186m04375.jpg Stage outliers : Wall: 2.03 s, CPU: 1.38 s, VmPeak: 1042 MB, VmSize: 1039 MB, VmRSS: 222 MB, VmData: 251 MB, maxrss: 0.227004 MB Stage outliers finished: 2020-08-05T20:08:27.155258 Resources for stage outliers : 1.151 s worker CPU, 1.468 s worker Wall, Wall: 2.028 s, Cores in use: 1.25, Total efficiency (on 32 cores): 3.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T20:08:27.364722 Stage halos : Wall: 0.45 s, CPU: 0.34 s, VmPeak: 1042 MB, VmSize: 1039 MB, VmRSS: 222 MB, VmData: 251 MB, maxrss: 0.22722 MB Stage halos finished: 2020-08-05T20:08:27.814028 Resources for stage halos : 0.419 s worker CPU, 0.739 s worker Wall, Wall: 0.451 s, Cores in use: 1.69, Total efficiency (on 32 cores): 5.3 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T20:08:28.059919 PSF sigmas in coadd pixels: ['2.11', '1.70'] Using average PSF sigma 1.9034740673222195 Gaussian PSF norm 0.14819996585019157 vs pixelized 0.12786254 average tim pixel scale / coadd scale: 1.0011059119639818 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.71', '1.89', '1.49'] Using average PSF sigma 1.6956028701859733 Gaussian PSF norm 0.16636843256990835 vs pixelized 0.14147145 average tim pixel scale / coadd scale: 1.0011051954765526 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.88', '2.01', '1.93', '1.55'] Using average PSF sigma 1.8441142137473465 Gaussian PSF norm 0.15297034731956502 vs pixelized 0.12556653 average tim pixel scale / coadd scale: 1.0010663968491376 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.22 s, CPU: 0.20 s, VmPeak: 1042 MB, VmSize: 1039 MB, VmRSS: 223 MB, VmData: 251 MB, maxrss: 0.228824 MB Stage fit_on_coadds finished: 2020-08-05T20:08:28.279436 Resources for stage fit_on_coadds : 0.205 s worker CPU, 0.205 s worker Wall, Wall: 0.222 s, Cores in use: 1.82, Total efficiency (on 32 cores): 5.7 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T20:08:28.293450 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 27 potential peaks Of 27 potential peaks: 4 in veto map, 2 cut by saddle test, 0 cut by aper test, 21 kept SED z : 21 new peaks Found 33 potential peaks Of 33 potential peaks: 22 in veto map, 6 cut by saddle test, 0 cut by aper test, 5 kept SED r : 5 new peaks Found 25 potential peaks Of 25 potential peaks: 18 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 41 potential peaks Of 41 potential peaks: 32 in veto map, 6 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 42 potential peaks Of 42 potential peaks: 34 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 33 new sources Median coadd sky for g : 7.454031e-05 Median coadd sky for r : -4.4916178e-05 Median coadd sky for z : 4.6040004e-05 Stage srcs : Wall: 1.06 s, CPU: 1.01 s, VmPeak: 1042 MB, VmSize: 1039 MB, VmRSS: 224 MB, VmData: 251 MB, maxrss: 0.22936 MB Stage srcs finished: 2020-08-05T20:08:29.355575 Resources for stage srcs : 0.132 s worker CPU, 0.132 s worker Wall, Wall: 1.065 s, Cores in use: 1.07, Total efficiency (on 32 cores): 3.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T20:08:29.371619 Blob 1 of 27, id: 9, sources: 3, size: 100x143, npix 7084, brick X: 133,233, Y: 97,240, one pixel: 162 97 Blob 2 of 27, id: 8, sources: 4, size: 52x50, npix 1675, brick X: 293,345, Y: 70,120, one pixel: 322 70 Blob 3 of 27, id: 21, sources: 3, size: 54x47, npix 1541, brick X: 6,60, Y: 264,311, one pixel: 24 264 Blob 4 of 27, id: 20, sources: 3, size: 33x61, npix 1053, brick X: 278,311, Y: 244,305, one pixel: 298 244 Blob 5 of 27, id: 12, sources: 1, size: 37x37, npix 946, brick X: 31,68, Y: 103,140, one pixel: 45 103 Blob 6 of 27, id: 0, sources: 2, size: 40x37, npix 890, brick X: 157,197, Y: 0,37, one pixel: 169 0 Blob 7 of 27, id: 24, sources: 1, size: 32x28, npix 669, brick X: 279,311, Y: 317,345, one pixel: 292 317 Blob 8 of 27, id: 16, sources: 1, size: 23x40, npix 659, brick X: 322,345, Y: 164,204, one pixel: 338 164 Blob 9 of 27, id: 7, sources: 1, size: 28x29, npix 528, brick X: 57,85, Y: 64,93, one pixel: 68 64 Blob 10 of 27, id: 19, sources: 1, size: 27x27, npix 459, brick X: 311,338, Y: 228,255, one pixel: 323 228 Blob 11 of 27, id: 3, sources: 1, size: 27x27, npix 453, brick X: 294,321, Y: 6,33, one pixel: 308 6 Blob 12 of 27, id: 11, sources: 1, size: 30x25, npix 453, brick X: 239,269, Y: 102,127, one pixel: 249 102 Blob 13 of 27, id: 22, sources: 1, size: 26x26, npix 408, brick X: 81,107, Y: 279,305, one pixel: 92 279 Blob 14 of 27, id: 14, sources: 1, size: 25x26, npix 405, brick X: 117,142, Y: 151,177, one pixel: 128 151 Blob 15 of 27, id: 18, sources: 1, size: 24x24, npix 359, brick X: 62,86, Y: 207,231, one pixel: 73 207 Blob 16 of 27, id: 23, sources: 1, size: 24x24, npix 354, brick X: 49,73, Y: 293,317, one pixel: 60 293 Blob 17 of 27, id: 5, sources: 1, size: 24x23, npix 339, brick X: 150,174, Y: 47,70, one pixel: 160 47 Blob 18 of 27, id: 15, sources: 1, size: 23x23, npix 317, brick X: 288,311, Y: 163,186, one pixel: 298 163 Blob 19 of 27, id: 25, sources: 1, size: 24x25, npix 291, brick X: 134,158, Y: 320,345, one pixel: 142 320 Blob 20 of 27, id: 2, sources: 1, size: 22x21, npix 261, brick X: 29,51, Y: 5,26, one pixel: 38 5 Blob 21 of 27, id: 10, sources: 1, size: 15x24, npix 260, brick X: 0,15, Y: 98,122, one pixel: 4 98 Blob 22 of 27, id: 1, sources: 1, size: 22x17, npix 254, brick X: 322,344, Y: 0,17, one pixel: 327 0 Blob 23 of 27, id: 6, sources: 1, size: 19x20, npix 227, brick X: 227,246, Y: 60,80, one pixel: 235 60 Blob 24 of 27, id: 13, sources: 1, size: 19x19, npix 199, brick X: 278,297, Y: 107,126, one pixel: 286 107 Blob 25 of 27, id: 17, sources: 1, size: 19x19, npix 198, brick X: 265,284, Y: 185,204, one pixel: 273 185 Blob 26 of 27, id: 4, sources: 1, size: 18x20, npix 197, brick X: 223,241, Y: 7,27, one pixel: 232 7 Blob 27 of 27, id: 26, sources: 1, size: 19x15, npix 165, brick X: 159,178, Y: 330,345, one pixel: 168 330 Measuring 1 iterative sources Blob 19 finished, total: Wall: 0.15 s, CPU: 0.15 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149824 MB Blob 26 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.095876 MB Blob 23 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.096856 MB Blob 27 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 94 MB, VmData: 141 MB, maxrss: 0.095856 MB Blob 18 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 99 MB, VmData: 145 MB, maxrss: 0.101248 MB Blob 20 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 113 MB, VmData: 166 MB, maxrss: 0.1162 MB Blob 24 finished, total: Wall: 0.44 s, CPU: 0.44 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.09784 MB Blob 22 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 95 MB, VmData: 140 MB, maxrss: 0.096884 MB Blob 16 finished, total: Wall: 0.54 s, CPU: 0.54 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 112 MB, VmData: 166 MB, maxrss: 0.11476 MB Blob 5 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.094428 MB Blob 14 finished, total: Wall: 0.63 s, CPU: 0.63 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 114 MB, VmData: 166 MB, maxrss: 0.116332 MB Blob 17 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.094312 MB Blob 13 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148604 MB Blob 10 finished, total: Wall: 0.69 s, CPU: 0.68 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 99 MB, VmData: 145 MB, maxrss: 0.101264 MB Blob 15 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097028 MB Blob 9 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 958 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148232 MB Blob 11 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095124 MB Blob 21 finished, total: Wall: 0.86 s, CPU: 0.86 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.11508 MB Blob 7 finished, total: Wall: 0.90 s, CPU: 0.89 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 99 MB, VmData: 145 MB, maxrss: 0.101304 MB Blob 12 finished, total: Wall: 0.92 s, CPU: 0.92 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 113 MB, VmData: 165 MB, maxrss: 0.115512 MB Blob 25 finished, total: Wall: 0.99 s, CPU: 0.99 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 99 MB, VmData: 144 MB, maxrss: 0.1012 MB Measuring 1 iterative sources Blob 6 finished, total: Wall: 1.42 s, CPU: 1.42 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 112 MB, VmData: 166 MB, maxrss: 0.11492 MB Measuring 1 iterative sources Blob 8 finished, total: Wall: 1.61 s, CPU: 1.60 s, VmPeak: 961 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 187 MB, maxrss: 0.155864 MB Blob 4 finished, total: Wall: 1.82 s, CPU: 1.82 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.0946 MB Blob 2 finished, total: Wall: 2.23 s, CPU: 2.23 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 114 MB, VmData: 166 MB, maxrss: 0.117 MB Blob 3 finished, total: Wall: 2.76 s, CPU: 2.75 s, VmPeak: 954 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149396 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.08684, ee1=1.27718, ee2=-0.537539 Measuring 3 iterative sources Blob 1 finished, total: Wall: 7.01 s, CPU: 7.01 s, VmPeak: 958 MB, VmSize: 733 MB, VmRSS: 150 MB, VmData: 181 MB, maxrss: 0.153104 MB Old catalog: 38 New catalog: 39 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/metrics/cus/blobs-custom-202186m04375.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/metrics/cus/all-models-custom-202186m04375.fits Stage fitblobs : Wall: 7.56 s, CPU: 0.54 s, VmPeak: 1042 MB, VmSize: 1039 MB, VmRSS: 224 MB, VmData: 251 MB, maxrss: 0.22978 MB Stage fitblobs finished: 2020-08-05T20:08:36.930168 Resources for stage fitblobs : 29.779 s worker CPU, 29.932 s worker Wall, Wall: 7.561 s, Cores in use: 4.01, Total efficiency (on 32 cores): 12.5 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T20:08:36.969594 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/tmp-legacysurvey-custom-202186m04375-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/tmp-legacysurvey-custom-202186m04375-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/tmp-legacysurvey-custom-202186m04375-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/tmp-legacysurvey-custom-202186m04375-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-resid.jpg Stage coadds : Wall: 5.07 s, CPU: 2.48 s, VmPeak: 1042 MB, VmSize: 1039 MB, VmRSS: 225 MB, VmData: 251 MB, maxrss: 0.230232 MB Stage coadds finished: 2020-08-05T20:08:42.038988 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 22.865 s worker CPU, 47.346 s worker Wall, Wall: 5.072 s, Cores in use: 5.00, Total efficiency (on 32 cores): 15.6 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T20:08:42.062463 Cut to 1 unWISE tiles Reading WISE tile 2020m046 band 1 Reading WISE tile 2020m046 band 3 Reading WISE tile 2020m046 band 2 Reading WISE tile 2020m046 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 961 MB, VmSize: 808 MB, VmRSS: 150 MB, VmData: 175 MB, maxrss: 0.192776 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 954 MB, VmSize: 868 MB, VmRSS: 209 MB, VmData: 235 MB, maxrss: 0.214344 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 810 MB, VmSize: 810 MB, VmRSS: 156 MB, VmData: 180 MB, maxrss: 0.21418 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/202/2020m046/unwise-2020m046-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 956 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.207084 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/tmp-legacysurvey-custom-202186m04375-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/tmp-legacysurvey-custom-202186m04375-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.35 s, CPU: 0.85 s, VmPeak: 1042 MB, VmSize: 1039 MB, VmRSS: 226 MB, VmData: 251 MB, maxrss: 0.23094 MB Stage wise_forced finished: 2020-08-05T20:08:44.410656 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.131 s worker CPU, 4.437 s worker Wall, Wall: 2.350 s, Cores in use: 1.69, Total efficiency (on 32 cores): 5.3 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T20:08:44.494540 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/coadd/cus/custom-202186m04375/legacysurvey-custom-202186m04375-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/tractor-i/cus/tractor-custom-202186m04375.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/tractor/cus/tractor-custom-202186m04375.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/tractor/cus/brick-custom-202186m04375.sha256sum Stage writecat : Wall: 0.92 s, CPU: 0.67 s, VmPeak: 1172 MB, VmSize: 1044 MB, VmRSS: 227 MB, VmData: 251 MB, maxrss: 0.363816 MB Stage writecat finished: 2020-08-05T20:08:45.412728 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.921 s, Cores in use: 0.73, Total efficiency (on 32 cores): 2.3 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/202/PGC1059038/PGC1059038-largegalaxy-writecat.p All done: 62.899 s worker CPU, 211.961 s worker Wall, Wall: 48.161 s, Cores in use: 1.53, Total efficiency (on 32 cores): 4.8 % Finished galaxy PGC1059038 in 0.847 minutes.