Started working on galaxy PGC3088951 at Sun Jun 7 06:17:22 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.592148 32.526561699999995 --width 263 --height 263 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/PGC3088951-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/PGC3088951-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T06:17:23.154627 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '343.592148', '32.526561699999995', '--width', '263', '--height', '263', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/PGC3088951-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/PGC3088951-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.592148 32.526561699999995 --width 263 --height 263 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/PGC3088951-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/PGC3088951-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 343.592148 32.526561699999995 Starting process 7657 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 7658 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 7659 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057368 MB Starting process 7660 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T06:17:26.584335 Keeping 12 CCDs: c4d_181104_011503_ooi_r_ls9.fits.fz c4d_181104_011503_ooi_r_ls9-S23 r exptime 133.0 propid 2014B-0404 seeing 1.58 MJD 58426.052 object DECaLS_24171_r c4d_181003_015203_ooi_r_ls9.fits.fz c4d_181003_015203_ooi_r_ls9-S28 r exptime 126.0 propid 2014B-0404 seeing 1.50 MJD 58394.078 object DECaLS_8299_r c4d_181111_013819_ooi_g_ls9.fits.fz c4d_181111_013819_ooi_g_ls9-S28 g exptime 200.0 propid 2014B-0404 seeing 1.96 MJD 58433.068 object DECaLS_8299_g c4d_181003_020336_ooi_g_ls9.fits.fz c4d_181003_020336_ooi_g_ls9-N25 g exptime 200.0 propid 2014B-0404 seeing 1.59 MJD 58394.086 object DECaLS_8283_g c4d_180917_031748_ooi_z_ls9.fits.fz c4d_180917_031748_ooi_z_ls9-N25 z exptime 115.0 propid 2014B-0404 seeing 1.02 MJD 58378.137 object DECaLS_8283_z c4d_181111_002723_ooi_z_ls9.fits.fz c4d_181111_002723_ooi_z_ls9-S23 z exptime 120.0 propid 2014B-0404 seeing 1.52 MJD 58433.019 object DECaLS_24171_z c4d_181002_015438_ooi_g_ls9.fits.fz c4d_181002_015438_ooi_g_ls9-S23 g exptime 200.0 propid 2014B-0404 seeing 1.47 MJD 58393.080 object DECaLS_24171_g c4d_181017_013846_ooi_z_ls9.fits.fz c4d_181017_013846_ooi_z_ls9-S22 z exptime 221.0 propid 2014B-0404 seeing 1.61 MJD 58408.069 object DECaLS_40043_z c4d_180919_022543_ooi_z_ls9.fits.fz c4d_180919_022543_ooi_z_ls9-S22 z exptime 250.0 propid 2014B-0404 seeing 1.73 MJD 58380.101 object DECaLS_40043_z c4d_181110_011957_ooi_g_ls9.fits.fz c4d_181110_011957_ooi_g_ls9-S22 g exptime 149.0 propid 2014B-0404 seeing 1.95 MJD 58432.056 object DECaLS_40043_g c4d_181105_005716_ooi_r_ls9.fits.fz c4d_181105_005716_ooi_r_ls9-S22 r exptime 74.0 propid 2014B-0404 seeing 1.24 MJD 58427.040 object DECaLS_40043_r c4d_181102_004412_ooi_z_ls9.fits.fz c4d_181102_004412_ooi_z_ls9-S28 z exptime 90.0 propid 2014B-0404 seeing 1.05 MJD 58424.031 object DECaLS_8299_z The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181003T015203_oi[S28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538e4d-g-20181111T013819_oi[S28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181003T020336_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T011503_oi[S23,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181002T015438_oi[S23,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533129-z-20181111T002723_oi[S23,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9531bff-z-20181017T013846_oi[S22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T031748_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181105T005716_oi[S22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95326b5-z-20181102T004412_oi[S28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f80e-z-20180919T022543_oi[S22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538ac0-g-20181110T011957_oi[S22,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 181.86 s, CPU: 4.08 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 177 MB, VmData: 211 MB, maxrss: 0.454656 MB Stage tims finished: 2020-06-07T06:20:28.439488 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T011503_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9531bff-z-20181017T013846_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181105T005716_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181003T015203_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T031748_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95326b5-z-20181102T004412_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181003T020336_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181002T015438_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f80e-z-20180919T022543_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 4.178 s worker CPU, 644.583 s worker Wall, Wall: 181.856 s, Cores in use: 0.05, Total efficiency (on 4 cores): 1.1 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/PGC3088951-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/PGC3088951-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538e4d-g-20181111T013819_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533129-z-20181111T002723_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538ac0-g-20181110T011957_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-06-07T06:20:28.464122 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03002.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02873.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02874.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02746.fits Matched 10 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/metrics/cus/reference-custom-343592p32526.fits Stage refs : Wall: 9.24 s, CPU: 8.61 s, VmPeak: 1056 MB, VmSize: 1050 MB, VmRSS: 233 MB, VmData: 265 MB, maxrss: 0.454656 MB Stage refs finished: 2020-06-07T06:20:37.701212 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.238 s, Cores in use: 0.93, Total efficiency (on 4 cores): 23.3 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T06:20:37.702580 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/metrics/cus/outlier-mask-custom-343592p32526.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/metrics/cus/outliers-pre-custom-343592p32526.jpg Image c4d_181111_013819_ooi_g_ls9-S28 g : masking 143 positive outlier pixels and 0 negative outlier pixels Image c4d_181003_020336_ooi_g_ls9-N25 g : masking 1075 positive outlier pixels and 0 negative outlier pixels Image c4d_181002_015438_ooi_g_ls9-S23 g : masking 377 positive outlier pixels and 0 negative outlier pixels Image c4d_181110_011957_ooi_g_ls9-S22 g : masking 213 positive outlier pixels and 52 negative outlier pixels Image c4d_181104_011503_ooi_r_ls9-S23 r : masking 2375 positive outlier pixels and 0 negative outlier pixels Image c4d_181017_013846_ooi_z_ls9-S22 z : masking 1103 positive outlier pixels and 0 negative outlier pixels Image c4d_180919_022543_ooi_z_ls9-S22 z : masking 693 positive outlier pixels and 0 negative outlier pixels Image c4d_181102_004412_ooi_z_ls9-S28 z : masking 163 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/metrics/cus/outlier-mask-custom-343592p32526.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/metrics/cus/outliers-post-custom-343592p32526.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/metrics/cus/outliers-masked-pos-custom-343592p32526.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/metrics/cus/outliers-masked-neg-custom-343592p32526.jpg Stage outliers : Wall: 5.98 s, CPU: 5.33 s, VmPeak: 1059 MB, VmSize: 1059 MB, VmRSS: 250 MB, VmData: 280 MB, maxrss: 0.454656 MB Stage outliers finished: 2020-06-07T06:20:43.685164 Resources for stage outliers : 1.311 s worker CPU, 1.329 s worker Wall, Wall: 5.984 s, Cores in use: 1.11, Total efficiency (on 4 cores): 27.7 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T06:20:43.686671 Stage halos : Wall: 11.74 s, CPU: 7.01 s, VmPeak: 1059 MB, VmSize: 1059 MB, VmRSS: 250 MB, VmData: 280 MB, maxrss: 0.454656 MB Stage halos finished: 2020-06-07T06:20:55.427981 Resources for stage halos : 0.191 s worker CPU, 13.483 s worker Wall, Wall: 11.743 s, Cores in use: 0.61, Total efficiency (on 4 cores): 15.3 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T06:20:55.429841 PSF sigmas in coadd pixels: ['3.19', '2.58', '2.39', '3.18'] Using average PSF sigma 2.831279656804111 Gaussian PSF norm 0.09963508588632351 vs pixelized 0.095011204 average tim pixel scale / coadd scale: 1.0014620978600266 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.56', '2.43', '2.01'] Using average PSF sigma 2.3319030605160593 Gaussian PSF norm 0.1209719205529279 vs pixelized 0.10200586 average tim pixel scale / coadd scale: 1.0014072199217008 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.66', '2.48', '2.62', '2.82', '1.71'] Using average PSF sigma 2.2557936164666765 Gaussian PSF norm 0.12505345777852342 vs pixelized 0.1056821 average tim pixel scale / coadd scale: 1.0013820328891903 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.26 s, CPU: 0.23 s, VmPeak: 1059 MB, VmSize: 1059 MB, VmRSS: 251 MB, VmData: 280 MB, maxrss: 0.454656 MB Stage fit_on_coadds finished: 2020-06-07T06:20:55.688581 Resources for stage fit_on_coadds : 0.270 s worker CPU, 0.274 s worker Wall, Wall: 0.260 s, Cores in use: 1.93, Total efficiency (on 4 cores): 48.3 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T06:20:55.691308 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 25 potential peaks Of 25 potential peaks: 7 in veto map, 3 cut by saddle test, 0 cut by aper test, 15 kept SED z : 15 new peaks Found 29 potential peaks Of 29 potential peaks: 24 in veto map, 4 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 24 potential peaks Of 24 potential peaks: 20 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 34 potential peaks Of 34 potential peaks: 25 in veto map, 5 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 40 potential peaks Of 40 potential peaks: 33 in veto map, 7 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 20 new sources Median coadd sky for g : 4.2049553e-05 Median coadd sky for r : 0.00014249068 Median coadd sky for z : 0.00043869743 Stage srcs : Wall: 4.09 s, CPU: 4.06 s, VmPeak: 1059 MB, VmSize: 1059 MB, VmRSS: 252 MB, VmData: 280 MB, maxrss: 0.454656 MB Stage srcs finished: 2020-06-07T06:20:59.786257 Resources for stage srcs : 0.099 s worker CPU, 0.101 s worker Wall, Wall: 4.096 s, Cores in use: 1.02, Total efficiency (on 4 cores): 25.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/PGC3088951-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/PGC3088951-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T06:20:59.798023 Blob 1 of 11, id: 0, sources: 14, size: 231x249, npix 24315, brick X: 19,250, Y: 0,249, one pixel: 173 0 Blob 2 of 11, id: 9, sources: 2, size: 58x31, npix 1261, brick X: 136,194, Y: 232,263, one pixel: 151 232 Blob 3 of 11, id: 5, sources: 1, size: 45x40, npix 1231, brick X: 208,253, Y: 140,180, one pixel: 229 140 Blob 4 of 11, id: 8, sources: 1, size: 34x40, npix 898, brick X: 172,206, Y: 194,234, one pixel: 188 194 Blob 5 of 11, id: 6, sources: 2, size: 32x44, npix 842, brick X: 0,32, Y: 144,188, one pixel: 17 144 Measuring 1 iterative sources Blob 3 finished, total: Wall: 2.24 s, CPU: 2.24 s, VmPeak: 968 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14848 MB Blob 6 of 11, id: 10, sources: 2, size: 40x18, npix 537, brick X: 203,243, Y: 245,263, one pixel: 232 245 Blob 2 finished, total: Wall: 2.37 s, CPU: 2.37 s, VmPeak: 963 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146224 MB Blob 7 of 11, id: 1, sources: 1, size: 27x27, npix 438, brick X: 113,140, Y: 1,28, one pixel: 126 1 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.58467, 32.53636), pm (4.8, -2.8), parallax 0.280 with NanoMaggies: g=20.7, r=19.7, z=18.8 Reset brightness to NanoMaggies: g=20.9, r=19.7, z=19.1 Measuring 1 iterative sources Blob 6 finished, total: Wall: 0.42 s, CPU: 0.42 s, VmPeak: 963 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148088 MB Blob 8 of 11, id: 3, sources: 1, size: 27x26, npix 435, brick X: 48,75, Y: 65,91, one pixel: 58 65 Measuring 1 iterative sources Blob 4 finished, total: Wall: 3.19 s, CPU: 3.19 s, VmPeak: 967 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149184 MB Blob 9 of 11, id: 2, sources: 1, size: 25x25, npix 405, brick X: 1,26, Y: 8,33, one pixel: 11 8 Blob 7 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 963 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148088 MB Blob 10 of 11, id: 7, sources: 1, size: 22x24, npix 336, brick X: 31,53, Y: 161,185, one pixel: 40 161 Blob 8 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 967 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149184 MB Blob 11 of 11, id: 4, sources: 1, size: 20x20, npix 228, brick X: 41,61, Y: 119,139, one pixel: 50 119 Blob 9 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 963 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148088 MB Blob 10 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 967 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149184 MB Blob 11 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 963 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148088 MB Blob 5 finished, total: Wall: 1.64 s, CPU: 1.64 s, VmPeak: 968 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149096 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.03668, ee1=0.0301562, ee2=0.458978 Measuring 10 iterative sources Blob 1 finished, total: Wall: 31.86 s, CPU: 31.86 s, VmPeak: 962 MB, VmSize: 722 MB, VmRSS: 153 MB, VmData: 185 MB, maxrss: 0.164212 MB Old catalog: 33 New catalog: 35 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/metrics/cus/blobs-custom-343592p32526.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/metrics/cus/all-models-custom-343592p32526.fits Stage fitblobs : Wall: 36.25 s, CPU: 4.38 s, VmPeak: 1059 MB, VmSize: 1029 MB, VmRSS: 223 MB, VmData: 249 MB, maxrss: 0.454656 MB Stage fitblobs finished: 2020-06-07T06:21:36.049611 Resources for stage fitblobs : 43.517 s worker CPU, 43.533 s worker Wall, Wall: 36.253 s, Cores in use: 1.32, Total efficiency (on 4 cores): 33.0 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T06:21:36.051660 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/tmp-legacysurvey-custom-343592p32526-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/tmp-legacysurvey-custom-343592p32526-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/tmp-legacysurvey-custom-343592p32526-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/tmp-legacysurvey-custom-343592p32526-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-resid.jpg Stage coadds : Wall: 3.78 s, CPU: 3.02 s, VmPeak: 1059 MB, VmSize: 1029 MB, VmRSS: 223 MB, VmData: 249 MB, maxrss: 0.454656 MB Stage coadds finished: 2020-06-07T06:21:39.833435 Resources for stage coadds : 2.482 s worker CPU, 2.565 s worker Wall, Wall: 3.783 s, Cores in use: 1.45, Total efficiency (on 4 cores): 36.4 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T06:21:39.834834 Cut to 2 unWISE tiles Reading WISE tile 3437p333 band 2 Reading WISE tile 3437p333 band 1 Reading WISE tile 3437p333 band 3 Reading WISE tile 3437p333 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3441p318 band 4 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3441p318 band 2 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3441p318 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 967 MB, VmSize: 800 MB, VmRSS: 151 MB, VmData: 179 MB, maxrss: 0.191208 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3441p318 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 968 MB, VmSize: 796 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.206712 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 962 MB, VmSize: 800 MB, VmRSS: 154 MB, VmData: 179 MB, maxrss: 0.218948 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 963 MB, VmSize: 796 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.204676 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/tmp-legacysurvey-custom-343592p32526-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/tmp-legacysurvey-custom-343592p32526-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 12.09 s, CPU: 2.76 s, VmPeak: 1059 MB, VmSize: 1029 MB, VmRSS: 224 MB, VmData: 249 MB, maxrss: 0.454656 MB Stage wise_forced finished: 2020-06-07T06:21:51.922136 Resources for stage wise_forced : 6.678 s worker CPU, 21.303 s worker Wall, Wall: 12.088 s, Cores in use: 0.78, Total efficiency (on 4 cores): 19.5 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T06:21:51.923837 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/coadd/cus/custom-343592p32526/legacysurvey-custom-343592p32526-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/tractor-i/cus/tractor-custom-343592p32526.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/tractor/cus/tractor-custom-343592p32526.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC3088951/tractor/cus/brick-custom-343592p32526.sha256sum Stage writecat : Wall: 4.34 s, CPU: 4.13 s, VmPeak: 1161 MB, VmSize: 1033 MB, VmRSS: 226 MB, VmData: 249 MB, maxrss: 0.454656 MB Stage writecat finished: 2020-06-07T06:21:56.262683 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.340 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.8 % Stage writecat finished All done: 58.728 s worker CPU, 727.172 s worker Wall, Wall: 269.682 s, Cores in use: 0.38, Total efficiency (on 4 cores): 9.5 % Finished galaxy PGC3088951 in 4.569 minutes.