Started working on galaxy PGC1420035 at Sun Jun  7 10:11:05 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 163.40738850000002 12.9747246 --width 251 --height 251 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/PGC1420035-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/PGC1420035-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T10:11:06.484275
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '163.40738850000002', '12.9747246', '--width', '251', '--height', '251', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/PGC1420035-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/PGC1420035-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 163.40738850000002 12.9747246 --width 251 --height 251 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/PGC1420035-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/PGC1420035-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 163.40738850000002 12.9747246
Starting process 10662 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.0574 MB
Starting process 10663 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057372 MB
Starting process 10664 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05738 MB
Starting process 10665 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T10:11:10.859099
Keeping 9 CCDs:
   c4d_170305_023023_ooi_z_ls9.fits.fz c4d_170305_023023_ooi_z_ls9-N10 z exptime 98.0 propid 2014B-0404 seeing 1.17 MJD 57817.103 object DECaLS_19222_z
   c4d_180215_054348_ooi_r_ls9.fits.fz c4d_180215_054348_ooi_r_ls9-N10 r exptime 67.0 propid 2014B-0404 seeing 1.00 MJD 58164.239 object DECaLS_19222_r
   c4d_170422_010248_ooi_g_ls9.fits.fz c4d_170422_010248_ooi_g_ls9-N10 g exptime 113.0 propid 2014B-0404 seeing 1.14 MJD 57865.042 object DECaLS_19222_g
   c4d_170317_033301_ooi_z_ls9.fits.fz c4d_170317_033301_ooi_z_ls9-N9 z exptime 80.0 propid 2014B-0404 seeing 0.85 MJD 57829.146 object DECaLS_35094_z
   c4d_180319_032829_ooi_g_ls9.fits.fz c4d_180319_032829_ooi_g_ls9-N9 g exptime 111.0 propid 2014B-0404 seeing 0.97 MJD 58196.145 object DECaLS_35094_g
   c4d_180317_043756_ooi_r_ls9.fits.fz c4d_180317_043756_ooi_r_ls9-N9 r exptime 52.0 propid 2014B-0404 seeing 1.19 MJD 58194.193 object DECaLS_35094_r
   c4d_160229_060823_ooi_z_ls9.fits.fz c4d_160229_060823_ooi_z_ls9-N17 z exptime 80.0 propid 2014B-0404 seeing 0.99 MJD 57447.254 object DECaLS_3350_z
   c4d_160114_081544_ooi_r_ls9.fits.fz c4d_160114_081544_ooi_r_ls9-N17 r exptime 40.0 propid 2014B-0404 seeing 0.94 MJD 57401.343 object DECaLS_3350_r
   c4d_160114_081721_ooi_g_ls9.fits.fz c4d_160114_081721_ooi_g_ls9-N17 g exptime 66.0 propid 2014B-0404 seeing 1.05 MJD 57401.344 object DECaLS_3350_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9517d11-g-20170422T010007_oi[N10,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950ccb8-z-20170305T022754_oi[N10,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950fef3-z-20170317T033051_oi[N9,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952a9b3-r-20180215T054348_oi[N10,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952da1d-r-20180317T043756_oi[N9,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f27f-z-20160229T060614_oi[N17,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9576b40-r-20160114T081416_oi[N17,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95710b9-g-20160114T081525_oi[N17,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952ee93-g-20180319T032829_oi[N9,noinherit][2046,4094][real]: DECaLS_3
Stage tims : Wall: 76.17 s, CPU: 5.77 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 173 MB, VmData: 207 MB, maxrss: 0.45466 MB
Stage tims finished: 2020-06-07T10:12:27.031882
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950fef3-z-20170317T033051_oi[N9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954f27f-z-20160229T060614_oi[N17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952a9b3-r-20180215T054348_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9576b40-r-20160114T081416_oi[N17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950ccb8-z-20170305T022754_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952da1d-r-20180317T043756_oi[N9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95710b9-g-20160114T081525_oi[N17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 4.215 s worker CPU, 213.030 s worker Wall, Wall: 76.174 s, Cores in use: 0.13, Total efficiency (on 4 cores): 3.3 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/PGC1420035-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/PGC1420035-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9517d11-g-20170422T010007_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952ee93-g-20180319T032829_oi[N9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
Running stage refs at 2020-06-07T10:12:27.051991
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04858.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04730.fits
Matched 20 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/metrics/cus/reference-custom-163407p12974.fits
Stage refs : Wall: 4.76 s, CPU: 4.48 s, VmPeak: 1026 MB, VmSize: 1007 MB, VmRSS: 186 MB, VmData: 219 MB, maxrss: 0.45466 MB
Stage refs finished: 2020-06-07T10:12:31.814445
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.763 s, Cores in use: 0.94, Total efficiency (on 4 cores): 23.5 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T10:12:31.816071
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/metrics/cus/outlier-mask-custom-163407p12974.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/metrics/cus/outliers-pre-custom-163407p12974.jpg
Image c4d_180319_032829_ooi_g_ls9-N9 g : masking 525 positive outlier pixels and 0 negative outlier pixels
Image c4d_170422_010248_ooi_g_ls9-N10 g : masking 774 positive outlier pixels and 0 negative outlier pixels
Image c4d_180215_054348_ooi_r_ls9-N10 r : masking 409 positive outlier pixels and 0 negative outlier pixels
Image c4d_160114_081544_ooi_r_ls9-N17 r : masking 0 positive outlier pixels and 137 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/metrics/cus/outlier-mask-custom-163407p12974.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/metrics/cus/outliers-post-custom-163407p12974.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/metrics/cus/outliers-masked-pos-custom-163407p12974.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/metrics/cus/outliers-masked-neg-custom-163407p12974.jpg
Stage outliers : Wall: 5.05 s, CPU: 4.81 s, VmPeak: 1026 MB, VmSize: 1016 MB, VmRSS: 197 MB, VmData: 228 MB, maxrss: 0.45466 MB
Stage outliers finished: 2020-06-07T10:12:36.861850
Resources for stage outliers : 0.836 s worker CPU, 0.847 s worker Wall, Wall: 5.047 s, Cores in use: 1.12, Total efficiency (on 4 cores): 28.0 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T10:12:36.863746
Stage halos : Wall: 9.73 s, CPU: 7.40 s, VmPeak: 1026 MB, VmSize: 1016 MB, VmRSS: 197 MB, VmData: 228 MB, maxrss: 0.45466 MB
Stage halos finished: 2020-06-07T10:12:46.596557
Resources for stage halos : 0.130 s worker CPU, 7.727 s worker Wall, Wall: 9.734 s, Cores in use: 0.77, Total efficiency (on 4 cores): 19.3 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-07T10:12:46.598450
PSF sigmas in coadd pixels: ['1.86', '1.58', '1.70']
Using average PSF sigma 1.711596159523978
Gaussian PSF norm 0.16481387283103816 vs pixelized 0.14329208
average tim pixel scale / coadd scale: 1.0011234242497509
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.62', '1.93', '1.52']
Using average PSF sigma 1.6887286926139253
Gaussian PSF norm 0.16704565570993724 vs pixelized 0.14354803
average tim pixel scale / coadd scale: 1.0011800767441514
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.90', '1.38', '1.61']
Using average PSF sigma 1.6314432867514344
Gaussian PSF norm 0.1729111848782629 vs pixelized 0.148293
average tim pixel scale / coadd scale: 1.0011233909247543
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.19 s, CPU: 0.16 s, VmPeak: 1026 MB, VmSize: 1016 MB, VmRSS: 200 MB, VmData: 230 MB, maxrss: 0.45466 MB
Stage fit_on_coadds finished: 2020-06-07T10:12:46.784688
Resources for stage fit_on_coadds : 0.169 s worker CPU, 0.169 s worker Wall, Wall: 0.187 s, Cores in use: 1.75, Total efficiency (on 4 cores): 43.7 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T10:12:46.787280
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 31 potential peaks
Of 31 potential peaks: 8 in veto map, 6 cut by saddle test, 0 cut by aper test, 17 kept
SED z : 17 new peaks
Found 32 potential peaks
Of 32 potential peaks: 25 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept
SED r : 3 new peaks
Found 33 potential peaks
Of 33 potential peaks: 26 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 36 potential peaks
Of 36 potential peaks: 29 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 43 potential peaks
Of 43 potential peaks: 36 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 24 new sources
Median coadd sky for g : -1.6884766e-05
Median coadd sky for r : 0.00016359672
Median coadd sky for z : 0.0003145425
Stage srcs : Wall: 7.12 s, CPU: 7.07 s, VmPeak: 1026 MB, VmSize: 1016 MB, VmRSS: 201 MB, VmData: 230 MB, maxrss: 0.45466 MB
Stage srcs finished: 2020-06-07T10:12:53.905480
Resources for stage srcs : 0.097 s worker CPU, 0.097 s worker Wall, Wall: 7.119 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.2 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/PGC1420035-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/PGC1420035-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T10:12:54.241913
Blob 1 of 18, id: 6, sources: 4, size: 144x91, npix 7921, brick X: 56,200, Y: 81,172, one pixel: 134 81
Blob 2 of 18, id: 9, sources: 2, size: 37x69, npix 1831, brick X: 214,251, Y: 138,207, one pixel: 226 138
Blob 3 of 18, id: 1, sources: 1, size: 37x54, npix 1493, brick X: 0,37, Y: 2,56, one pixel: 9 2
Blob 4 of 18, id: 13, sources: 3, size: 45x47, npix 1311, brick X: 76,121, Y: 174,221, one pixel: 100 174
Blob 5 of 18, id: 5, sources: 1, size: 36x38, npix 940, brick X: 9,45, Y: 52,90, one pixel: 23 52
Measuring 1 iterative sources
Measuring 3 iterative sources
Blob 3 finished, total: Wall: 2.81 s, CPU: 2.81 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.1454 MB
Blob 6 of 18, id: 17, sources: 1, size: 34x31, npix 734, brick X: 95,129, Y: 220,251, one pixel: 114 220
Blob 4 finished, total: Wall: 3.28 s, CPU: 3.27 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148016 MB
Blob 7 of 18, id: 16, sources: 2, size: 36x31, npix 704, brick X: 4,40, Y: 220,251, one pixel: 14 220
Blob 5 finished, total: Wall: 1.44 s, CPU: 1.44 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147556 MB
Blob 8 of 18, id: 2, sources: 1, size: 33x30, npix 669, brick X: 113,146, Y: 9,39, one pixel: 128 9
Blob 2 finished, total: Wall: 4.59 s, CPU: 4.59 s, VmPeak: 952 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147892 MB
Blob 9 of 18, id: 7, sources: 1, size: 26x33, npix 558, brick X: 26,52, Y: 110,143, one pixel: 36 110
Blob 8 finished, total: Wall: 0.83 s, CPU: 0.83 s, VmPeak: 952 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147892 MB
Blob 10 of 18, id: 12, sources: 1, size: 28x24, npix 454, brick X: 148,176, Y: 164,188, one pixel: 159 164
Measuring 2 iterative sources
Measuring 1 iterative sources
Blob 7 finished, total: Wall: 2.01 s, CPU: 2.01 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147556 MB
Blob 11 of 18, id: 0, sources: 1, size: 28x25, npix 440, brick X: 137,165, Y: 0,25, one pixel: 144 0
Blob 6 finished, total: Wall: 3.09 s, CPU: 3.09 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148016 MB
Blob 12 of 18, id: 15, sources: 1, size: 26x27, npix 428, brick X: 130,156, Y: 208,235, one pixel: 139 208
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.119142, ee1=-0.185461, ee2=0.0552786
Measuring 2 iterative sources
Blob 9 finished, total: Wall: 1.48 s, CPU: 1.48 s, VmPeak: 952 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147892 MB
Blob 13 of 18, id: 14, sources: 1, size: 23x24, npix 359, brick X: 30,53, Y: 207,231, one pixel: 40 207
Blob 10 finished, total: Wall: 1.63 s, CPU: 1.63 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147556 MB
Blob 14 of 18, id: 4, sources: 1, size: 24x23, npix 327, brick X: 193,217, Y: 46,69, one pixel: 203 46
Blob 11 finished, total: Wall: 1.77 s, CPU: 1.77 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148016 MB
Blob 15 of 18, id: 3, sources: 2, size: 23x29, npix 319, brick X: 55,78, Y: 39,68, one pixel: 68 39
Blob 13 finished, total: Wall: 0.90 s, CPU: 0.90 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147556 MB
Blob 14 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148016 MB
Blob 16 of 18, id: 11, sources: 1, size: 24x22, npix 301, brick X: 1,25, Y: 155,177, one pixel: 13 155
Blob 17 of 18, id: 10, sources: 1, size: 22x23, npix 296, brick X: 32,54, Y: 151,174, one pixel: 42 151
Blob 1 finished, total: Wall: 8.88 s, CPU: 8.88 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149248 MB
Blob 18 of 18, id: 8, sources: 1, size: 22x22, npix 293, brick X: 15,37, Y: 135,157, one pixel: 25 135
Blob 15 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147556 MB
Blob 17 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149248 MB
Blob 16 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148016 MB
Blob 12 finished, total: Wall: 2.62 s, CPU: 2.62 s, VmPeak: 952 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148568 MB
Blob 18 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147556 MB
Old catalog: 27
New catalog: 33
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/metrics/cus/blobs-custom-163407p12974.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/metrics/cus/all-models-custom-163407p12974.fits
Stage fitblobs : Wall: 15.64 s, CPU: 5.90 s, VmPeak: 1026 MB, VmSize: 1016 MB, VmRSS: 201 MB, VmData: 230 MB, maxrss: 0.45466 MB
Stage fitblobs finished: 2020-06-07T10:13:09.880631
Resources for stage fitblobs : 38.016 s worker CPU, 38.046 s worker Wall, Wall: 15.640 s, Cores in use: 2.81, Total efficiency (on 4 cores): 70.2 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T10:13:09.882077
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/tmp-legacysurvey-custom-163407p12974-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/tmp-legacysurvey-custom-163407p12974-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/tmp-legacysurvey-custom-163407p12974-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/tmp-legacysurvey-custom-163407p12974-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-resid.jpg
Stage coadds : Wall: 6.49 s, CPU: 5.72 s, VmPeak: 1026 MB, VmSize: 1016 MB, VmRSS: 202 MB, VmData: 230 MB, maxrss: 0.45466 MB
Stage coadds finished: 2020-06-07T10:13:16.368740
Resources for stage coadds : 2.515 s worker CPU, 2.604 s worker Wall, Wall: 6.488 s, Cores in use: 1.27, Total efficiency (on 4 cores): 31.7 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T10:13:16.370392
Cut to 1 unWISE tiles
Reading WISE tile 1629p136 band 1
Reading WISE tile 1629p136 band 2
Reading WISE tile 1629p136 band 3
Reading WISE tile 1629p136 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/162/1629p136/unwise-1629p136-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/162/1629p136/unwise-1629p136-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/162/1629p136/unwise-1629p136-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/162/1629p136/unwise-1629p136-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/162/1629p136/unwise-1629p136-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 956 MB, VmSize: 796 MB, VmRSS: 147 MB, VmData: 175 MB, maxrss: 0.19126 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/162/1629p136/unwise-1629p136-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/162/1629p136/unwise-1629p136-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/162/1629p136/unwise-1629p136-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/162/1629p136/unwise-1629p136-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/162/1629p136/unwise-1629p136-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 952 MB, VmSize: 792 MB, VmRSS: 142 MB, VmData: 170 MB, maxrss: 0.205784 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/162/1629p136/unwise-1629p136-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/162/1629p136/unwise-1629p136-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/162/1629p136/unwise-1629p136-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/162/1629p136/unwise-1629p136-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 957 MB, VmSize: 796 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.21046 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/162/1629p136/unwise-1629p136-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/162/1629p136/unwise-1629p136-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/162/1629p136/unwise-1629p136-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/162/1629p136/unwise-1629p136-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 956 MB, VmSize: 791 MB, VmRSS: 142 MB, VmData: 170 MB, maxrss: 0.206532 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/tmp-legacysurvey-custom-163407p12974-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/tmp-legacysurvey-custom-163407p12974-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 9.22 s, CPU: 6.14 s, VmPeak: 1026 MB, VmSize: 1016 MB, VmRSS: 202 MB, VmData: 230 MB, maxrss: 0.45466 MB
Stage wise_forced finished: 2020-06-07T10:13:25.593618
Resources for stage wise_forced : 4.476 s worker CPU, 6.685 s worker Wall, Wall: 9.224 s, Cores in use: 1.15, Total efficiency (on 4 cores): 28.8 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T10:13:25.595348
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/coadd/cus/custom-163407p12974/legacysurvey-custom-163407p12974-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/tractor-i/cus/tractor-custom-163407p12974.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/tractor/cus/tractor-custom-163407p12974.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC1420035/tractor/cus/brick-custom-163407p12974.sha256sum
Stage writecat : Wall: 6.06 s, CPU: 5.79 s, VmPeak: 1148 MB, VmSize: 1020 MB, VmRSS: 204 MB, VmData: 230 MB, maxrss: 0.45466 MB
Stage writecat finished: 2020-06-07T10:13:31.656593
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.062 s, Cores in use: 0.96, Total efficiency (on 4 cores): 23.9 %
Stage writecat finished
All done: 50.456 s worker CPU, 269.208 s worker Wall, Wall: 140.802 s, Cores in use: 0.74, Total efficiency (on 4 cores): 18.4 %
Finished galaxy PGC1420035 in 2.439 minutes.