Started working on galaxy PGC1027683 at Sun Jun  7 10:13:43 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 163.084938 -6.866375 --width 257 --height 257 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/PGC1027683-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/PGC1027683-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T10:13:44.306817
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '163.084938', '-6.866375', '--width', '257', '--height', '257', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/PGC1027683-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/PGC1027683-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 163.084938 -6.866375 --width 257 --height 257 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/PGC1027683-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/PGC1027683-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 163.084938 -6.866375
Starting process 59103 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 59104 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 59105 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 59106 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T10:13:50.328517
Keeping 12 CCDs:
   c4d_170327_005523_ooi_r_ls9.fits.fz c4d_170327_005523_ooi_r_ls9-N31 r exptime 64.0 propid 2014B-0404 seeing 1.05 MJD 57839.037 object DECaLS_23011_r
   c4d_170304_010835_ooi_z_ls9.fits.fz c4d_170304_010835_ooi_z_ls9-N31 z exptime 203.0 propid 2014B-0404 seeing 1.47 MJD 57816.045 object DECaLS_23011_z
   c4d_170328_023211_ooi_g_ls9.fits.fz c4d_170328_023211_ooi_g_ls9-N31 g exptime 86.0 propid 2014B-0404 seeing 1.40 MJD 57840.104 object DECaLS_23011_g
   c4d_170328_023411_ooi_g_ls9.fits.fz c4d_170328_023411_ooi_g_ls9-S20 g exptime 88.0 propid 2014B-0404 seeing 1.30 MJD 57840.105 object DECaLS_22998_g
   c4d_170327_023452_ooi_r_ls9.fits.fz c4d_170327_023452_ooi_r_ls9-S20 r exptime 46.0 propid 2014B-0404 seeing 0.97 MJD 57839.106 object DECaLS_22998_r
   c4d_180207_071043_ooi_z_ls9.fits.fz c4d_180207_071043_ooi_z_ls9-S20 z exptime 106.0 propid 2014B-0404 seeing 0.67 MJD 58156.299 object DECaLS_22998_z
   c4d_170301_043826_ooi_g_ls9.fits.fz c4d_170301_043826_ooi_g_ls9-S21 g exptime 128.0 propid 2014B-0404 seeing 1.17 MJD 57813.191 object DECaLS_7126_g
   c4d_170302_042328_ooi_r_ls9.fits.fz c4d_170302_042328_ooi_r_ls9-S21 r exptime 40.0 propid 2014B-0404 seeing 0.82 MJD 57814.182 object DECaLS_7126_r
   c4d_151227_061651_ooi_z_ls9.fits.fz c4d_151227_061651_ooi_z_ls9-S21 z exptime 89.0 propid 2014B-0404 seeing 1.05 MJD 57383.260 object DECaLS_7126_z
   c4d_181215_064155_ooi_r_ls9.fits.fz c4d_181215_064155_ooi_r_ls9-N26 r exptime 47.0 propid 2014B-0404 seeing 1.04 MJD 58467.279 object DECaLS_38883_r
   c4d_181215_064312_ooi_g_ls9.fits.fz c4d_181215_064312_ooi_g_ls9-N26 g exptime 95.0 propid 2014B-0404 seeing 1.14 MJD 58467.280 object DECaLS_38883_g
   c4d_170306_010031_ooi_z_ls9.fits.fz c4d_170306_010031_ooi_z_ls9-N26 z exptime 162.0 propid 2014B-0404 seeing 1.03 MJD 57818.040 object DECaLS_38883_z
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95127dc-g-20170328T023153_oi[S20,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95127dc-g-20170328T022958_oi[N31,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950bfa6-z-20170304T010422_oi[N31,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951060a-r-20170327T005328_oi[N31,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9511334-r-20170327T023317_oi[S20,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952660d-z-20180207T071043_oi[S20,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950c43f-g-20170301T043527_oi[S21,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950d81b-r-20170302T042159_oi[S21,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95527d4-z-20151227T061432_oi[S21,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539067-r-20181215T064155_oi[N26,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953988f-g-20181215T064312_oi[N26,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950dd28-z-20170306T005702_oi[N26,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 71.84 s, CPU: 6.76 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 176 MB, VmData: 209 MB, maxrss: 0.454628 MB
Stage tims finished: 2020-06-07T10:15:02.173165
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95127dc-g-20170328T022958_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9511334-r-20170327T023317_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95527d4-z-20151227T061432_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950bfa6-z-20170304T010422_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952660d-z-20180207T071043_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539067-r-20181215T064155_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95127dc-g-20170328T023153_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950d81b-r-20170302T042159_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950dd28-z-20170306T005702_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951060a-r-20170327T005328_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950c43f-g-20170301T043527_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953988f-g-20181215T064312_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 4.649 s worker CPU, 225.625 s worker Wall, Wall: 71.846 s, Cores in use: 0.16, Total efficiency (on 4 cores): 4.0 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/PGC1027683-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/PGC1027683-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T10:15:02.196778
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06905.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06906.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06778.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07034.fits
Matched 5 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/metrics/cus/reference-custom-163084m06866.fits
Stage refs : Wall: 8.47 s, CPU: 8.16 s, VmPeak: 1026 MB, VmSize: 1012 MB, VmRSS: 193 MB, VmData: 225 MB, maxrss: 0.454628 MB
Stage refs finished: 2020-06-07T10:15:10.667061
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.471 s, Cores in use: 0.96, Total efficiency (on 4 cores): 24.1 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T10:15:10.668480
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/metrics/cus/outlier-mask-custom-163084m06866.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/metrics/cus/outliers-pre-custom-163084m06866.jpg
Image c4d_170302_042328_ooi_r_ls9-S21 r : masking 648 positive outlier pixels and 0 negative outlier pixels
Image c4d_151227_061651_ooi_z_ls9-S21 z : masking 156 positive outlier pixels and 0 negative outlier pixels
Image c4d_170306_010031_ooi_z_ls9-N26 z : masking 750 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/metrics/cus/outlier-mask-custom-163084m06866.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/metrics/cus/outliers-post-custom-163084m06866.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/metrics/cus/outliers-masked-pos-custom-163084m06866.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/metrics/cus/outliers-masked-neg-custom-163084m06866.jpg
Stage outliers : Wall: 7.64 s, CPU: 7.36 s, VmPeak: 1026 MB, VmSize: 1022 MB, VmRSS: 206 MB, VmData: 237 MB, maxrss: 0.454628 MB
Stage outliers finished: 2020-06-07T10:15:18.307793
Resources for stage outliers : 0.907 s worker CPU, 0.913 s worker Wall, Wall: 7.640 s, Cores in use: 1.08, Total efficiency (on 4 cores): 27.0 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T10:15:18.309282
Stage halos : Wall: 15.06 s, CPU: 9.55 s, VmPeak: 1026 MB, VmSize: 1022 MB, VmRSS: 207 MB, VmData: 237 MB, maxrss: 0.454628 MB
Stage halos finished: 2020-06-07T10:15:33.367147
Resources for stage halos : 0.335 s worker CPU, 21.779 s worker Wall, Wall: 15.059 s, Cores in use: 0.66, Total efficiency (on 4 cores): 16.4 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-07T10:15:33.368761
PSF sigmas in coadd pixels: ['2.27', '2.12', '1.91', '1.86']
Using average PSF sigma 2.0395433465506545
Gaussian PSF norm 0.13831272193894115 vs pixelized 0.11726684
average tim pixel scale / coadd scale: 1.0011202833688113
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.71', '1.58', '1.33', '1.69']
Using average PSF sigma 1.5778503180721317
Gaussian PSF norm 0.17878425383121935 vs pixelized 0.15466996
average tim pixel scale / coadd scale: 1.001156649271467
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.39', '1.08', '1.71', '1.67']
Using average PSF sigma 1.7130824641807998
Gaussian PSF norm 0.16467087701395425 vs pixelized 0.13225858
average tim pixel scale / coadd scale: 1.0011859419435718
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.19 s, CPU: 0.18 s, VmPeak: 1026 MB, VmSize: 1022 MB, VmRSS: 208 MB, VmData: 237 MB, maxrss: 0.454628 MB
Stage fit_on_coadds finished: 2020-06-07T10:15:33.559373
Resources for stage fit_on_coadds : 0.212 s worker CPU, 0.213 s worker Wall, Wall: 0.192 s, Cores in use: 2.05, Total efficiency (on 4 cores): 51.3 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T10:15:33.561931
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 61 potential peaks
Of 61 potential peaks: 48 in veto map, 4 cut by saddle test, 0 cut by aper test, 9 kept
SED z : 9 new peaks
Found 78 potential peaks
Of 78 potential peaks: 71 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 52 potential peaks
Of 52 potential peaks: 44 in veto map, 4 cut by saddle test, 0 cut by aper test, 4 kept
SED g : 4 new peaks
Found 61 potential peaks
Of 61 potential peaks: 52 in veto map, 8 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 83 potential peaks
Of 83 potential peaks: 70 in veto map, 8 cut by saddle test, 1 cut by aper test, 4 kept
SED Red : 4 new peaks
Adding 20 new sources
Median coadd sky for g : 0.00017274696
Median coadd sky for r : 0.00036227042
Median coadd sky for z : 0.001124506
Stage srcs : Wall: 10.56 s, CPU: 10.51 s, VmPeak: 1026 MB, VmSize: 1022 MB, VmRSS: 209 MB, VmData: 237 MB, maxrss: 0.454628 MB
Stage srcs finished: 2020-06-07T10:15:44.121031
Resources for stage srcs : 0.101 s worker CPU, 0.101 s worker Wall, Wall: 10.560 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.1 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/PGC1027683-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/PGC1027683-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T10:15:44.132010
Blob 1 of 9, id: 0, sources: 14, size: 195x255, npix 25269, brick X: 37,232, Y: 0,255, one pixel: 65 0
Blob 2 of 9, id: 4, sources: 2, size: 32x38, npix 797, brick X: 7,39, Y: 147,185, one pixel: 23 147
Blob 3 of 9, id: 1, sources: 1, size: 36x31, npix 697, brick X: 2,38, Y: 55,86, one pixel: 22 55
Blob 4 of 9, id: 8, sources: 1, size: 25x23, npix 384, brick X: 156,181, Y: 234,257, one pixel: 166 234
Blob 5 of 9, id: 6, sources: 1, size: 25x25, npix 367, brick X: 25,50, Y: 223,248, one pixel: 36 223
Blob 4 finished, total: Wall: 0.87 s, CPU: 0.87 s, VmPeak: 967 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147112 MB
Blob 6 of 9, id: 7, sources: 1, size: 21x21, npix 249, brick X: 54,75, Y: 234,255, one pixel: 64 234
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 1.46 s, CPU: 1.46 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147952 MB
Blob 5 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 967 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147112 MB
Blob 7 of 9, id: 3, sources: 1, size: 18x18, npix 180, brick X: 3,21, Y: 111,129, one pixel: 11 111
Blob 8 of 9, id: 2, sources: 1, size: 15x18, npix 156, brick X: 242,257, Y: 93,111, one pixel: 250 93
Blob 9 of 9, id: 5, sources: 1, size: 17x17, npix 145, brick X: 31,48, Y: 181,198, one pixel: 39 181
Blob 7 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147952 MB
Blob 6 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 967 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147112 MB
Blob 9 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 967 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147112 MB
Blob 8 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147952 MB
Blob 2 finished, total: Wall: 2.25 s, CPU: 2.25 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148716 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.16514, ee1=-0.176823, ee2=-0.144881
Measuring 5 iterative sources
Blob 1 finished, total: Wall: 12.59 s, CPU: 12.59 s, VmPeak: 962 MB, VmSize: 726 MB, VmRSS: 158 MB, VmData: 189 MB, maxrss: 0.161564 MB
Old catalog: 26
New catalog: 22
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/metrics/cus/blobs-custom-163084m06866.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/metrics/cus/all-models-custom-163084m06866.fits
Stage fitblobs : Wall: 20.84 s, CPU: 8.21 s, VmPeak: 1026 MB, VmSize: 1022 MB, VmRSS: 210 MB, VmData: 237 MB, maxrss: 0.454628 MB
Stage fitblobs finished: 2020-06-07T10:16:04.976256
Resources for stage fitblobs : 18.998 s worker CPU, 19.061 s worker Wall, Wall: 20.845 s, Cores in use: 1.31, Total efficiency (on 4 cores): 32.6 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T10:16:04.977777
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/tmp-legacysurvey-custom-163084m06866-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/tmp-legacysurvey-custom-163084m06866-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/tmp-legacysurvey-custom-163084m06866-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/tmp-legacysurvey-custom-163084m06866-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-resid.jpg
Stage coadds : Wall: 12.33 s, CPU: 11.66 s, VmPeak: 1026 MB, VmSize: 1022 MB, VmRSS: 210 MB, VmData: 237 MB, maxrss: 0.454628 MB
Stage coadds finished: 2020-06-07T10:16:17.308030
Resources for stage coadds : 2.023 s worker CPU, 2.140 s worker Wall, Wall: 12.331 s, Cores in use: 1.11, Total efficiency (on 4 cores): 27.7 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T10:16:17.309242
Cut to 1 unWISE tiles
Reading WISE tile 1632m076 band 1
Reading WISE tile 1632m076 band 2
Reading WISE tile 1632m076 band 4
Reading WISE tile 1632m076 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1632m076/unwise-1632m076-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/163/1632m076/unwise-1632m076-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/163/1632m076/unwise-1632m076-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/163/1632m076/unwise-1632m076-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/163/1632m076/unwise-1632m076-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 967 MB, VmSize: 798 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.191288 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1632m076/unwise-1632m076-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1632m076/unwise-1632m076-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1632m076/unwise-1632m076-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1632m076/unwise-1632m076-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 962 MB, VmSize: 798 MB, VmRSS: 152 MB, VmData: 177 MB, maxrss: 0.216744 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1632m076/unwise-1632m076-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1632m076/unwise-1632m076-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1632m076/unwise-1632m076-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1632m076/unwise-1632m076-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 961 MB, VmSize: 795 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209904 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1632m076/unwise-1632m076-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/163/1632m076/unwise-1632m076-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/163/1632m076/unwise-1632m076-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/163/1632m076/unwise-1632m076-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/163/1632m076/unwise-1632m076-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 961 MB, VmSize: 791 MB, VmRSS: 141 MB, VmData: 170 MB, maxrss: 0.204708 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/tmp-legacysurvey-custom-163084m06866-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/tmp-legacysurvey-custom-163084m06866-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 19.48 s, CPU: 11.10 s, VmPeak: 1026 MB, VmSize: 1022 MB, VmRSS: 211 MB, VmData: 237 MB, maxrss: 0.454628 MB
Stage wise_forced finished: 2020-06-07T10:16:36.787727
Resources for stage wise_forced : 3.072 s worker CPU, 12.332 s worker Wall, Wall: 19.479 s, Cores in use: 0.73, Total efficiency (on 4 cores): 18.2 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T10:16:36.789180
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/coadd/cus/custom-163084m06866/legacysurvey-custom-163084m06866-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/tractor-i/cus/tractor-custom-163084m06866.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/tractor/cus/tractor-custom-163084m06866.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1027683/tractor/cus/brick-custom-163084m06866.sha256sum
Stage writecat : Wall: 8.88 s, CPU: 8.40 s, VmPeak: 1154 MB, VmSize: 1026 MB, VmRSS: 213 MB, VmData: 237 MB, maxrss: 0.454628 MB
Stage writecat finished: 2020-06-07T10:16:45.668607
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.880 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.6 %
Stage writecat finished
All done: 30.298 s worker CPU, 282.166 s worker Wall, Wall: 175.345 s, Cores in use: 0.64, Total efficiency (on 4 cores): 16.0 %
Finished galaxy PGC1027683 in 3.047 minutes.