Started working on galaxy PGC3098498 at Fri Jun  5 05:10:20 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 128.29021799999998 30.550913899999998 --width 265 --height 265 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/PGC3098498-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/PGC3098498-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-05T05:10:21.112124
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '128.29021799999998', '30.550913899999998', '--width', '265', '--height', '265', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/PGC3098498-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/PGC3098498-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 128.29021799999998 30.550913899999998 --width 265 --height 265 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/PGC3098498-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/PGC3098498-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 128.29021799999998 30.550913899999998
Starting process 34737 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 34738 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 34739 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 34740 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-05T05:10:32.835243
Keeping 16 CCDs:
   c4d_141228_065726_ooi_g_ls9.fits.fz c4d_141228_065726_ooi_g_ls9-S25 g exptime 87.0 propid 2014B-0404 seeing 1.63 MJD 57019.288 object DECaLS_10847_g
   c4d_141228_065140_ooi_r_ls9.fits.fz c4d_141228_065140_ooi_r_ls9-S25 r exptime 71.0 propid 2014B-0404 seeing 1.41 MJD 57019.284 object DECaLS_10847_r
   c4d_170302_024857_ooi_r_ls9.fits.fz c4d_170302_024857_ooi_r_ls9-S25 r exptime 78.0 propid 2014B-0404 seeing 1.03 MJD 57814.116 object DECaLS_26719_r
   c4d_190305_013821_ooi_g_ls9.fits.fz c4d_190305_013821_ooi_g_ls9-S25 g exptime 116.0 propid 2014B-0404 seeing 1.62 MJD 58547.068 object DECaLS_26719_g
   c4d_190303_030329_ooi_g_ls9.fits.fz c4d_190303_030329_ooi_g_ls9-S25 g exptime 127.0 propid 2014B-0404 seeing 1.43 MJD 58545.127 object DECaLS_26719_g
   c4d_160409_233458_ooi_z_ls9.fits.fz c4d_160409_233458_ooi_z_ls9-S25 z exptime 175.0 propid 2014B-0404 seeing 1.22 MJD 57487.980 object DECaLS_26719_z
   c4d_141228_065726_ooi_g_ls9.fits.fz c4d_141228_065726_ooi_g_ls9-S21 g exptime 87.0 propid 2014B-0404 seeing 1.55 MJD 57019.288 object DECaLS_10847_g
   c4d_141228_065140_ooi_r_ls9.fits.fz c4d_141228_065140_ooi_r_ls9-S21 r exptime 71.0 propid 2014B-0404 seeing 1.36 MJD 57019.284 object DECaLS_10847_r
   c4d_141231_052726_ooi_z_ls9.fits.fz c4d_141231_052726_ooi_z_ls9-S21 z exptime 125.0 propid 2014B-0404 seeing 1.00 MJD 57022.225 object DECaLS_10847_z
   c4d_180213_035946_ooi_r_ls9.fits.fz c4d_180213_035946_ooi_r_ls9-N24 r exptime 138.0 propid 2014B-0404 seeing 1.27 MJD 58162.167 object DECaLS_26712_r
   c4d_180212_042033_ooi_g_ls9.fits.fz c4d_180212_042033_ooi_g_ls9-N24 g exptime 167.0 propid 2014B-0404 seeing 1.47 MJD 58161.181 object DECaLS_26712_g
   c4d_170327_001946_ooi_z_ls9.fits.fz c4d_170327_001946_ooi_z_ls9-N24 z exptime 245.0 propid 2014B-0404 seeing 1.35 MJD 57839.010 object DECaLS_26712_z
   c4d_181214_073256_ooi_g_ls9.fits.fz c4d_181214_073256_ooi_g_ls9-N23 g exptime 200.0 propid 2014B-0404 seeing 1.58 MJD 58466.315 object DECaLS_42584_g
   c4d_181214_073109_ooi_r_ls9.fits.fz c4d_181214_073109_ooi_r_ls9-N23 r exptime 78.0 propid 2014B-0404 seeing 1.19 MJD 58466.313 object DECaLS_42584_r
   c4d_181215_081002_ooi_z_ls9.fits.fz c4d_181215_081002_ooi_z_ls9-N23 z exptime 91.0 propid 2014B-0404 seeing 0.90 MJD 58467.340 object DECaLS_42584_z
   c4d_190303_030009_ooi_g_ls9.fits.fz c4d_190303_030009_ooi_g_ls9-S25 g exptime 171.0 propid 2014B-0404 seeing 1.44 MJD 58545.125 object DECaLS_10847_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953a368-g-20190305T013821_oi[S25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950d81b-r-20170302T024651_oi[S25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95506eb-r-20141228T064940_oi[S25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9552e01-g-20141228T065503_oi[S25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953a046-g-20190303T030329_oi[S25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9552e01-g-20141228T065503_oi[S21,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d4d0-z-20160409T233114_oi[S25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95506eb-r-20141228T064940_oi[S21,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95613b5-z-20141231T052432_oi[S21,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952a2af-g-20180212T042033_oi[N24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952a3cf-r-20180213T035946_oi[N24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95117e6-z-20170327T001453_oi[N24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953988f-g-20181214T073256_oi[N23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539067-r-20181214T073109_oi[N23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9533681-z-20181215T081002_oi[N23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953a046-g-20190303T030009_oi[S25,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 121.49 s, CPU: 8.97 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 177 MB, VmData: 210 MB, maxrss: 0.454612 MB
Stage tims finished: 2020-06-05T05:12:34.324956
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953a368-g-20190305T013821_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953a046-g-20190303T030329_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95613b5-z-20141231T052432_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953988f-g-20181214T073256_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9552e01-g-20141228T065503_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9552e01-g-20141228T065503_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952a2af-g-20180212T042033_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539067-r-20181214T073109_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95506eb-r-20141228T064940_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d4d0-z-20160409T233114_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952a3cf-r-20180213T035946_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9533681-z-20181215T081002_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950d81b-r-20170302T024651_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95506eb-r-20141228T064940_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95117e6-z-20170327T001453_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953a046-g-20190303T030009_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 5.287 s worker CPU, 434.393 s worker Wall, Wall: 121.730 s, Cores in use: 0.12, Total efficiency (on 4 cores): 2.9 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/PGC3098498-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/PGC3098498-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-05T05:12:40.055798
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03053.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02926.fits
Matched 8 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/metrics/cus/reference-custom-128290p30550.fits
Stage refs : Wall: 9.28 s, CPU: 8.68 s, VmPeak: 1027 MB, VmSize: 1015 MB, VmRSS: 197 MB, VmData: 230 MB, maxrss: 0.454612 MB
Stage refs finished: 2020-06-05T05:12:49.332812
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.278 s, Cores in use: 0.94, Total efficiency (on 4 cores): 23.4 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-05T05:12:49.334261
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/metrics/cus/outlier-mask-custom-128290p30550.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/metrics/cus/outliers-pre-custom-128290p30550.jpg
Image c4d_180213_035946_ooi_r_ls9-N24 r : masking 83 positive outlier pixels and 0 negative outlier pixels
Image c4d_170327_001946_ooi_z_ls9-N24 z : masking 428 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/metrics/cus/outlier-mask-custom-128290p30550.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/metrics/cus/outliers-post-custom-128290p30550.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/metrics/cus/outliers-masked-pos-custom-128290p30550.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/metrics/cus/outliers-masked-neg-custom-128290p30550.jpg
Stage outliers : Wall: 4.76 s, CPU: 4.42 s, VmPeak: 1027 MB, VmSize: 1025 MB, VmRSS: 212 MB, VmData: 241 MB, maxrss: 0.454612 MB
Stage outliers finished: 2020-06-05T05:12:54.093524
Resources for stage outliers : 1.111 s worker CPU, 1.141 s worker Wall, Wall: 4.760 s, Cores in use: 1.16, Total efficiency (on 4 cores): 29.1 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-05T05:12:54.095325
Stage halos : Wall: 4.45 s, CPU: 2.58 s, VmPeak: 1027 MB, VmSize: 1025 MB, VmRSS: 212 MB, VmData: 241 MB, maxrss: 0.454612 MB
Stage halos finished: 2020-06-05T05:12:58.549340
Resources for stage halos : 0.256 s worker CPU, 6.592 s worker Wall, Wall: 4.455 s, Cores in use: 0.64, Total efficiency (on 4 cores): 15.9 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-05T05:12:58.551489
PSF sigmas in coadd pixels: ['2.63', '2.32', '2.52', '2.39', '2.57', '2.33']
Using average PSF sigma 2.4609785134729933
Gaussian PSF norm 0.11462708440139084 vs pixelized 0.10310318
average tim pixel scale / coadd scale: 1.0013621978511507
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.67', '2.21', '2.06', '1.94']
Using average PSF sigma 1.9701195071800752
Gaussian PSF norm 0.14318663956464942 vs pixelized 0.12520011
average tim pixel scale / coadd scale: 1.0013970141414594
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.99', '1.62', '2.18', '1.46']
Using average PSF sigma 1.8137739820696024
Gaussian PSF norm 0.15552918641604652 vs pixelized 0.12841499
average tim pixel scale / coadd scale: 1.0013356294975266
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.25 s, CPU: 0.23 s, VmPeak: 1027 MB, VmSize: 1025 MB, VmRSS: 213 MB, VmData: 241 MB, maxrss: 0.454612 MB
Stage fit_on_coadds finished: 2020-06-05T05:12:58.799434
Resources for stage fit_on_coadds : 0.267 s worker CPU, 0.280 s worker Wall, Wall: 0.249 s, Cores in use: 2.00, Total efficiency (on 4 cores): 50.1 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-05T05:12:58.802586
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 27 potential peaks
Of 27 potential peaks: 14 in veto map, 4 cut by saddle test, 0 cut by aper test, 9 kept
SED z : 9 new peaks
Found 32 potential peaks
Of 32 potential peaks: 20 in veto map, 7 cut by saddle test, 0 cut by aper test, 5 kept
SED r : 5 new peaks
Found 22 potential peaks
Of 22 potential peaks: 19 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 34 potential peaks
Of 34 potential peaks: 26 in veto map, 5 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 38 potential peaks
Of 38 potential peaks: 31 in veto map, 7 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 17 new sources
Median coadd sky for g : -5.3487805e-05
Median coadd sky for r : -3.1748525e-05
Median coadd sky for z : 1.838267e-05
Stage srcs : Wall: 8.78 s, CPU: 3.94 s, VmPeak: 1027 MB, VmSize: 1025 MB, VmRSS: 214 MB, VmData: 241 MB, maxrss: 0.454612 MB
Stage srcs finished: 2020-06-05T05:13:07.579975
Resources for stage srcs : 0.107 s worker CPU, 0.115 s worker Wall, Wall: 8.778 s, Cores in use: 0.46, Total efficiency (on 4 cores): 11.5 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/PGC3098498-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/PGC3098498-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-05T05:13:08.282860
Blob 1 of 13, id: 0, sources: 7, size: 160x200, npix 18721, brick X: 57,217, Y: 0,200, one pixel: 120 0
Blob 2 of 13, id: 5, sources: 2, size: 23x52, npix 800, brick X: 242,265, Y: 112,164, one pixel: 258 112
Blob 3 of 13, id: 1, sources: 1, size: 29x32, npix 602, brick X: 221,250, Y: 7,39, one pixel: 235 7
Blob 4 of 13, id: 11, sources: 1, size: 28x29, npix 529, brick X: 159,187, Y: 229,258, one pixel: 172 229
Blob 5 of 13, id: 2, sources: 1, size: 28x25, npix 463, brick X: 194,222, Y: 24,49, one pixel: 207 24
Blob 4 finished, total: Wall: 1.01 s, CPU: 1.01 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14678 MB
Blob 6 of 13, id: 6, sources: 1, size: 28x26, npix 449, brick X: 208,236, Y: 137,163, one pixel: 217 137
Blob 3 finished, total: Wall: 1.48 s, CPU: 1.48 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148204 MB
Blob 7 of 13, id: 7, sources: 1, size: 26x26, npix 408, brick X: 24,50, Y: 166,192, one pixel: 35 166
Measuring 1 iterative sources
Blob 6 finished, total: Wall: 0.43 s, CPU: 0.43 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148204 MB
Blob 8 of 13, id: 8, sources: 1, size: 23x25, npix 381, brick X: 71,94, Y: 187,212, one pixel: 80 187
Blob 2 finished, total: Wall: 2.48 s, CPU: 2.48 s, VmPeak: 965 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148264 MB
Blob 9 of 13, id: 4, sources: 1, size: 22x23, npix 293, brick X: 234,256, Y: 79,102, one pixel: 245 79
Blob 5 finished, total: Wall: 1.68 s, CPU: 1.68 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148976 MB
Blob 10 of 13, id: 10, sources: 1, size: 19x20, npix 236, brick X: 20,39, Y: 224,244, one pixel: 28 224
Blob 7 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148204 MB
Blob 11 of 13, id: 12, sources: 1, size: 20x19, npix 218, brick X: 184,204, Y: 246,265, one pixel: 193 246
Blob 10 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148204 MB
Blob 12 of 13, id: 3, sources: 1, size: 19x19, npix 190, brick X: 214,233, Y: 76,95, one pixel: 223 76
Blob 9 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148976 MB
Blob 13 of 13, id: 9, sources: 1, size: 18x18, npix 171, brick X: 7,25, Y: 197,215, one pixel: 15 197
Blob 12 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148976 MB
Blob 8 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 965 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148264 MB
Blob 11 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148204 MB
Blob 13 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148976 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.71731, ee1=-0.0871085, ee2=0.0239584
Measuring 2 iterative sources
Blob 1 finished, total: Wall: 11.67 s, CPU: 11.66 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149132 MB
Old catalog: 20
New catalog: 19
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/metrics/cus/blobs-custom-128290p30550.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/metrics/cus/all-models-custom-128290p30550.fits
Stage fitblobs : Wall: 16.01 s, CPU: 3.51 s, VmPeak: 1027 MB, VmSize: 1025 MB, VmRSS: 214 MB, VmData: 241 MB, maxrss: 0.454612 MB
Stage fitblobs finished: 2020-06-05T05:13:24.293101
Resources for stage fitblobs : 21.882 s worker CPU, 21.932 s worker Wall, Wall: 16.012 s, Cores in use: 1.59, Total efficiency (on 4 cores): 39.6 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-05T05:13:24.295051
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/tmp-legacysurvey-custom-128290p30550-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/tmp-legacysurvey-custom-128290p30550-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/tmp-legacysurvey-custom-128290p30550-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/tmp-legacysurvey-custom-128290p30550-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-resid.jpg
Stage coadds : Wall: 6.61 s, CPU: 5.69 s, VmPeak: 1027 MB, VmSize: 1025 MB, VmRSS: 214 MB, VmData: 241 MB, maxrss: 0.454612 MB
Stage coadds finished: 2020-06-05T05:13:30.906297
Resources for stage coadds : 2.769 s worker CPU, 2.957 s worker Wall, Wall: 6.612 s, Cores in use: 1.28, Total efficiency (on 4 cores): 32.0 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-05T05:13:30.908007
Cut to 1 unWISE tiles
Reading WISE tile 1286p302 band 1
Reading WISE tile 1286p302 band 2
Reading WISE tile 1286p302 band 4
Reading WISE tile 1286p302 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1286p302/unwise-1286p302-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1286p302/unwise-1286p302-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1286p302/unwise-1286p302-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1286p302/unwise-1286p302-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1286p302/unwise-1286p302-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 963 MB, VmSize: 798 MB, VmRSS: 151 MB, VmData: 177 MB, maxrss: 0.194476 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1286p302/unwise-1286p302-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1286p302/unwise-1286p302-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1286p302/unwise-1286p302-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1286p302/unwise-1286p302-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1286p302/unwise-1286p302-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 965 MB, VmSize: 795 MB, VmRSS: 148 MB, VmData: 173 MB, maxrss: 0.212768 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1286p302/unwise-1286p302-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1286p302/unwise-1286p302-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1286p302/unwise-1286p302-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1286p302/unwise-1286p302-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 962 MB, VmSize: 796 MB, VmRSS: 149 MB, VmData: 174 MB, maxrss: 0.213828 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1286p302/unwise-1286p302-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1286p302/unwise-1286p302-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1286p302/unwise-1286p302-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1286p302/unwise-1286p302-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 961 MB, VmSize: 795 MB, VmRSS: 145 MB, VmData: 173 MB, maxrss: 0.209544 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/tmp-legacysurvey-custom-128290p30550-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/tmp-legacysurvey-custom-128290p30550-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 7.14 s, CPU: 4.97 s, VmPeak: 1027 MB, VmSize: 1025 MB, VmRSS: 215 MB, VmData: 241 MB, maxrss: 0.454612 MB
Stage wise_forced finished: 2020-06-05T05:13:38.049351
Resources for stage wise_forced : 4.110 s worker CPU, 7.131 s worker Wall, Wall: 7.143 s, Cores in use: 1.27, Total efficiency (on 4 cores): 31.8 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-05T05:13:38.051284
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/coadd/cus/custom-128290p30550/legacysurvey-custom-128290p30550-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/tractor-i/cus/tractor-custom-128290p30550.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/tractor/cus/tractor-custom-128290p30550.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3098498/tractor/cus/brick-custom-128290p30550.sha256sum
Stage writecat : Wall: 11.62 s, CPU: 6.54 s, VmPeak: 1157 MB, VmSize: 1029 MB, VmRSS: 217 MB, VmData: 242 MB, maxrss: 0.454612 MB
Stage writecat finished: 2020-06-05T05:13:49.676060
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 11.626 s, Cores in use: 0.56, Total efficiency (on 4 cores): 14.1 %
Stage writecat finished
All done: 35.788 s worker CPU, 474.543 s worker Wall, Wall: 197.175 s, Cores in use: 0.43, Total efficiency (on 4 cores): 10.8 %
Finished galaxy PGC3098498 in 3.604 minutes.