Started working on galaxy PGC3122707 at Sat Jun  6 22:10:28 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 195.690408 2.949204 --width 319 --height 319 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/PGC3122707-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/PGC3122707-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-06T22:10:32.126266
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '195.690408', '2.949204', '--width', '319', '--height', '319', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/PGC3122707-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/PGC3122707-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 195.690408 2.949204 --width 319 --height 319 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/PGC3122707-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/PGC3122707-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 195.690408 2.949204
Starting process 4142 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 4143 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 4144 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 4145 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-06T22:10:36.360747
Keeping 11 CCDs:
   c4d_180516_011328_ooi_g_ls9.fits.fz c4d_180516_011328_ooi_g_ls9-S2 g exptime 131.0 propid 2014B-0404 seeing 1.08 MJD 58254.051 object DECaLS_41521_g
   c4d_190204_080737_ooi_r_ls9.fits.fz c4d_190204_080737_ooi_r_ls9-S2 r exptime 40.0 propid 2014B-0404 seeing 1.22 MJD 58518.339 object DECaLS_41521_r
   c4d_180210_075200_ooi_z_ls9.fits.fz c4d_180210_075200_ooi_z_ls9-S2 z exptime 80.0 propid 2014B-0404 seeing 0.91 MJD 58159.328 object DECaLS_41521_z
   c4d_180209_081356_ooi_z_ls9.fits.fz c4d_180209_081356_ooi_z_ls9-S2 z exptime 80.0 propid 2014B-0404 seeing 0.74 MJD 58158.343 object DECaLS_41521_z
   c4d_160301_070901_ooi_z_ls9.fits.fz c4d_160301_070901_ooi_z_ls9-S3 z exptime 80.0 propid 2014B-0404 seeing 1.16 MJD 57448.296 object DECaLS_25649_z
   c4d_170304_065012_ooi_g_ls9.fits.fz c4d_170304_065012_ooi_g_ls9-S3 g exptime 157.0 propid 2014B-0404 seeing 1.48 MJD 57816.282 object DECaLS_25649_g
   c4d_170330_055456_ooi_r_ls9.fits.fz c4d_170330_055456_ooi_r_ls9-S3 r exptime 45.0 propid 2014B-0404 seeing 1.05 MJD 57842.245 object DECaLS_25649_r
   c4d_170305_064618_ooi_g_ls9.fits.fz c4d_170305_064618_ooi_g_ls9-N4 g exptime 94.0 propid 2014B-0404 seeing 1.00 MJD 57817.281 object DECaLS_9777_g
   c4d_170306_063745_ooi_r_ls9.fits.fz c4d_170306_063745_ooi_r_ls9-N4 r exptime 43.0 propid 2014B-0404 seeing 1.09 MJD 57818.275 object DECaLS_9777_r
   c4d_150330_042913_ooi_z_ls9.fits.fz c4d_150330_042913_ooi_z_ls9-N4 z exptime 66.0 propid 2014B-0404 seeing 1.00 MJD 57111.186 object DECaLS_9777_z
   c4d_170305_064618_ooi_g_ls9.fits.fz c4d_170305_064618_ooi_g_ls9-S4 g exptime 94.0 propid 2014B-0404 seeing 1.02 MJD 57817.281 object DECaLS_9777_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9527115-z-20180209T081356_oi[S2,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952fbad-g-20180516T011328_oi[S2,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95393ca-r-20190204T080737_oi[S2,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9527115-z-20180210T075200_oi[S2,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954e8b8-z-20160301T070653_oi[S3,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950f8db-g-20170304T064644_oi[S3,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951519f-r-20170330T055321_oi[S3,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951060a-r-20170306T063613_oi[N4,noinherit][2046,4094][real]: DECaLS_9
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957bb70-z-20150330T042716_oi[N4,noinherit][2046,4094][real]: DECaLS_9
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950f8db-g-20170305T064355_oi[N4,noinherit][2046,4094][real]: DECaLS_9
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950f8db-g-20170305T064355_oi[S4,noinherit][2046,4094][real]: DECaLS_9
Stage tims : Wall: 165.85 s, CPU: 4.62 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 176 MB, VmData: 209 MB, maxrss: 0.45468 MB
Stage tims finished: 2020-06-06T22:13:22.210046
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9527115-z-20180209T081356_oi[S2,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954e8b8-z-20160301T070653_oi[S3,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951060a-r-20170306T063613_oi[N4,noinherit][2046,4094][real]: DECaLS_9 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952fbad-g-20180516T011328_oi[S2,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950f8db-g-20170304T064644_oi[S3,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957bb70-z-20150330T042716_oi[N4,noinherit][2046,4094][real]: DECaLS_9 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9527115-z-20180210T075200_oi[S2,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950f8db-g-20170305T064355_oi[N4,noinherit][2046,4094][real]: DECaLS_9 [astropy.io.fits.card]
Resources for stage tims : 4.181 s worker CPU, 519.758 s worker Wall, Wall: 165.850 s, Cores in use: 0.05, Total efficiency (on 4 cores): 1.3 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/PGC3122707-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/PGC3122707-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95393ca-r-20190204T080737_oi[S2,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951519f-r-20170330T055321_oi[S3,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950f8db-g-20170305T064355_oi[S4,noinherit][2046,4094][real]: DECaLS_9 [astropy.io.fits.card]
Running stage refs at 2020-06-06T22:13:22.232991
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05765.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05893.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05766.fits
Matched 18 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/metrics/cus/reference-custom-195690p02949.fits
Stage refs : Wall: 5.35 s, CPU: 4.86 s, VmPeak: 1026 MB, VmSize: 1011 MB, VmRSS: 192 MB, VmData: 225 MB, maxrss: 0.45468 MB
Stage refs finished: 2020-06-06T22:13:27.584446
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.352 s, Cores in use: 0.91, Total efficiency (on 4 cores): 22.7 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-06T22:13:27.585947
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/metrics/cus/outlier-mask-custom-195690p02949.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/metrics/cus/outliers-pre-custom-195690p02949.jpg
Image c4d_170304_065012_ooi_g_ls9-S3 g : masking 745 positive outlier pixels and 0 negative outlier pixels
Image c4d_190204_080737_ooi_r_ls9-S2 r : masking 159 positive outlier pixels and 0 negative outlier pixels
Image c4d_150330_042913_ooi_z_ls9-N4 z : masking 56 positive outlier pixels and 0 negative outlier pixels
Image c4d_180209_081356_ooi_z_ls9-S2 z : masking 4607 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/metrics/cus/outlier-mask-custom-195690p02949.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/metrics/cus/outliers-post-custom-195690p02949.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/metrics/cus/outliers-masked-pos-custom-195690p02949.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/metrics/cus/outliers-masked-neg-custom-195690p02949.jpg
Stage outliers : Wall: 4.41 s, CPU: 4.10 s, VmPeak: 1026 MB, VmSize: 1020 MB, VmRSS: 210 MB, VmData: 239 MB, maxrss: 0.45468 MB
Stage outliers finished: 2020-06-06T22:13:31.996136
Resources for stage outliers : 1.074 s worker CPU, 1.102 s worker Wall, Wall: 4.411 s, Cores in use: 1.17, Total efficiency (on 4 cores): 29.3 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-06T22:13:31.997693
Stage halos : Wall: 7.08 s, CPU: 4.09 s, VmPeak: 1026 MB, VmSize: 1020 MB, VmRSS: 210 MB, VmData: 239 MB, maxrss: 0.45468 MB
Stage halos finished: 2020-06-06T22:13:39.077529
Resources for stage halos : 0.214 s worker CPU, 9.828 s worker Wall, Wall: 7.081 s, Cores in use: 0.61, Total efficiency (on 4 cores): 15.2 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-06T22:13:39.079382
PSF sigmas in coadd pixels: ['1.75', '2.41', '1.62']
Using average PSF sigma 1.9250484205199692
Gaussian PSF norm 0.14653906300065034 vs pixelized 0.11947776
average tim pixel scale / coadd scale: 1.0011047955765922
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.99', '1.70', '1.77']
Using average PSF sigma 1.8191939020491772
Gaussian PSF norm 0.15506581868822275 vs pixelized 0.13175866
average tim pixel scale / coadd scale: 1.0011587154212627
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.47', '1.20', '1.88', '1.63']
Using average PSF sigma 1.545996994590606
Gaussian PSF norm 0.18246787850229904 vs pixelized 0.15226226
average tim pixel scale / coadd scale: 1.0011050371828183
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.23 s, CPU: 0.20 s, VmPeak: 1026 MB, VmSize: 1020 MB, VmRSS: 211 MB, VmData: 239 MB, maxrss: 0.45468 MB
Stage fit_on_coadds finished: 2020-06-06T22:13:39.305685
Resources for stage fit_on_coadds : 0.227 s worker CPU, 0.243 s worker Wall, Wall: 0.227 s, Cores in use: 1.90, Total efficiency (on 4 cores): 47.5 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-06T22:13:39.308109
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 36 potential peaks
Of 36 potential peaks: 11 in veto map, 3 cut by saddle test, 0 cut by aper test, 22 kept
SED z : 22 new peaks
Found 30 potential peaks
Of 30 potential peaks: 26 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 30 potential peaks
Of 30 potential peaks: 23 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 49 potential peaks
Of 49 potential peaks: 38 in veto map, 3 cut by saddle test, 0 cut by aper test, 8 kept
SED Flat : 8 new peaks
Found 52 potential peaks
Of 52 potential peaks: 48 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 34 new sources
Median coadd sky for g : 0.0001224038
Median coadd sky for r : 0.00019381943
Median coadd sky for z : 0.00040884246
Stage srcs : Wall: 9.97 s, CPU: 9.92 s, VmPeak: 1026 MB, VmSize: 1020 MB, VmRSS: 212 MB, VmData: 239 MB, maxrss: 0.45468 MB
Stage srcs finished: 2020-06-06T22:13:49.282728
Resources for stage srcs : 0.144 s worker CPU, 0.144 s worker Wall, Wall: 9.975 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.2 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/PGC3122707-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/PGC3122707-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-06T22:13:49.296209
Blob 1 of 25, id: 8, sources: 4, size: 141x136, npix 9543, brick X: 91,232, Y: 97,233, one pixel: 178 97
Blob 2 of 25, id: 13, sources: 5, size: 62x68, npix 1803, brick X: 257,319, Y: 178,246, one pixel: 289 178
Blob 3 of 25, id: 3, sources: 3, size: 40x48, npix 1033, brick X: 3,43, Y: 48,96, one pixel: 11 48
Blob 4 of 25, id: 18, sources: 2, size: 44x32, npix 978, brick X: 116,160, Y: 246,278, one pixel: 129 246
Blob 5 of 25, id: 6, sources: 1, size: 34x34, npix 775, brick X: 225,259, Y: 80,114, one pixel: 243 80
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 2.82 s, CPU: 2.74 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149808 MB
Blob 6 of 25, id: 9, sources: 1, size: 36x35, npix 774, brick X: 228,264, Y: 129,164, one pixel: 246 129
Blob 4 finished, total: Wall: 2.95 s, CPU: 2.89 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14784 MB
Blob 7 of 25, id: 7, sources: 1, size: 33x33, npix 744, brick X: 91,124, Y: 97,130, one pixel: 105 97
Blob 5 finished, total: Wall: 0.92 s, CPU: 0.92 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149808 MB
Blob 8 of 25, id: 10, sources: 2, size: 38x32, npix 621, brick X: 49,87, Y: 157,189, one pixel: 58 157
Blob 2 finished, total: Wall: 4.17 s, CPU: 4.17 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149784 MB
Blob 9 of 25, id: 21, sources: 1, size: 31x29, npix 575, brick X: 269,300, Y: 255,284, one pixel: 280 255
Blob 7 finished, total: Wall: 1.39 s, CPU: 1.39 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149808 MB
Blob 10 of 25, id: 0, sources: 2, size: 29x29, npix 565, brick X: 290,319, Y: 0,29, one pixel: 301 0
Blob 8 finished, total: Wall: 1.11 s, CPU: 1.11 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149784 MB
Blob 11 of 25, id: 11, sources: 2, size: 41x26, npix 537, brick X: 5,46, Y: 161,187, one pixel: 13 161
Blob 6 finished, total: Wall: 2.77 s, CPU: 2.77 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149908 MB
Blob 12 of 25, id: 2, sources: 1, size: 27x28, npix 488, brick X: 40,67, Y: 25,53, one pixel: 52 25
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.763393, ee1=-0.684571, ee2=0.0760964
Measuring 6 iterative sources
Blob 11 finished, total: Wall: 1.36 s, CPU: 1.36 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149908 MB
Blob 13 of 25, id: 20, sources: 1, size: 27x28, npix 471, brick X: 187,214, Y: 254,282, one pixel: 198 254
Blob 10 finished, total: Wall: 2.04 s, CPU: 2.03 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149784 MB
Blob 14 of 25, id: 17, sources: 1, size: 26x27, npix 448, brick X: 178,204, Y: 229,256, one pixel: 189 229
Measuring 1 iterative sources
Blob 12 finished, total: Wall: 1.00 s, CPU: 1.00 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149908 MB
Blob 9 finished, total: Wall: 2.98 s, CPU: 2.98 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149808 MB
Blob 15 of 25, id: 1, sources: 1, size: 23x25, npix 361, brick X: 260,283, Y: 2,27, one pixel: 269 2
Blob 13 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149784 MB
Blob 16 of 25, id: 14, sources: 1, size: 24x24, npix 354, brick X: 247,271, Y: 211,235, one pixel: 257 211
Blob 17 of 25, id: 22, sources: 1, size: 23x24, npix 351, brick X: 124,147, Y: 279,303, one pixel: 134 279
Blob 14 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149908 MB
Blob 18 of 25, id: 24, sources: 1, size: 22x24, npix 341, brick X: 0,22, Y: 289,313, one pixel: 8 289
Blob 16 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149784 MB
Blob 19 of 25, id: 19, sources: 1, size: 23x24, npix 340, brick X: 26,49, Y: 248,272, one pixel: 36 248
Blob 15 finished, total: Wall: 1.04 s, CPU: 1.03 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149808 MB
Blob 20 of 25, id: 15, sources: 1, size: 23x23, npix 305, brick X: 102,125, Y: 225,248, one pixel: 112 225
Blob 18 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149784 MB
Blob 21 of 25, id: 12, sources: 1, size: 21x20, npix 239, brick X: 222,243, Y: 175,195, one pixel: 232 175
Blob 17 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149908 MB
Blob 22 of 25, id: 23, sources: 1, size: 21x19, npix 228, brick X: 161,182, Y: 286,305, one pixel: 170 286
Blob 21 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149908 MB
Blob 23 of 25, id: 4, sources: 1, size: 19x20, npix 218, brick X: 122,141, Y: 51,71, one pixel: 131 51
Blob 19 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149808 MB
Blob 24 of 25, id: 5, sources: 1, size: 19x18, npix 189, brick X: 215,234, Y: 68,86, one pixel: 223 68
Blob 22 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149908 MB
Blob 25 of 25, id: 16, sources: 1, size: 18x18, npix 171, brick X: 34,52, Y: 228,246, one pixel: 42 228
Blob 24 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149908 MB
Blob 25 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149908 MB
Blob 20 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149784 MB
Blob 23 finished, total: Wall: 0.61 s, CPU: 0.61 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149808 MB
Blob 1 finished, total: Wall: 11.33 s, CPU: 11.33 s, VmPeak: 957 MB, VmSize: 721 MB, VmRSS: 149 MB, VmData: 184 MB, maxrss: 0.152488 MB
Old catalog: 41
New catalog: 42
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/metrics/cus/blobs-custom-195690p02949.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/metrics/cus/all-models-custom-195690p02949.fits
Stage fitblobs : Wall: 22.17 s, CPU: 10.91 s, VmPeak: 1026 MB, VmSize: 1020 MB, VmRSS: 212 MB, VmData: 239 MB, maxrss: 0.45468 MB
Stage fitblobs finished: 2020-06-06T22:14:11.464297
Resources for stage fitblobs : 42.451 s worker CPU, 42.623 s worker Wall, Wall: 22.169 s, Cores in use: 2.41, Total efficiency (on 4 cores): 60.2 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-06T22:14:11.465957
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/tmp-legacysurvey-custom-195690p02949-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/tmp-legacysurvey-custom-195690p02949-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/tmp-legacysurvey-custom-195690p02949-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/tmp-legacysurvey-custom-195690p02949-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-resid.jpg
Stage coadds : Wall: 6.00 s, CPU: 4.85 s, VmPeak: 1026 MB, VmSize: 1020 MB, VmRSS: 213 MB, VmData: 240 MB, maxrss: 0.45468 MB
Stage coadds finished: 2020-06-06T22:14:17.461703
Resources for stage coadds : 2.622 s worker CPU, 2.710 s worker Wall, Wall: 5.997 s, Cores in use: 1.25, Total efficiency (on 4 cores): 31.2 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-06T22:14:17.463140
Cut to 1 unWISE tiles
Reading WISE tile 1951p030 band 1
Reading WISE tile 1951p030 band 2
Reading WISE tile 1951p030 band 3
Reading WISE tile 1951p030 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1951p030/unwise-1951p030-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1951p030/unwise-1951p030-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1951p030/unwise-1951p030-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1951p030/unwise-1951p030-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1951p030/unwise-1951p030-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 961 MB, VmSize: 796 MB, VmRSS: 146 MB, VmData: 175 MB, maxrss: 0.210444 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1951p030/unwise-1951p030-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1951p030/unwise-1951p030-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1951p030/unwise-1951p030-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1951p030/unwise-1951p030-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1951p030/unwise-1951p030-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 962 MB, VmSize: 798 MB, VmRSS: 149 MB, VmData: 177 MB, maxrss: 0.18992 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1951p030/unwise-1951p030-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1951p030/unwise-1951p030-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1951p030/unwise-1951p030-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1951p030/unwise-1951p030-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 961 MB, VmSize: 796 MB, VmRSS: 146 MB, VmData: 175 MB, maxrss: 0.210056 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1951p030/unwise-1951p030-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1951p030/unwise-1951p030-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1951p030/unwise-1951p030-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1951p030/unwise-1951p030-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 957 MB, VmSize: 793 MB, VmRSS: 144 MB, VmData: 172 MB, maxrss: 0.208176 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/tmp-legacysurvey-custom-195690p02949-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/tmp-legacysurvey-custom-195690p02949-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 17.51 s, CPU: 8.18 s, VmPeak: 1026 MB, VmSize: 1020 MB, VmRSS: 214 MB, VmData: 240 MB, maxrss: 0.45468 MB
Stage wise_forced finished: 2020-06-06T22:14:34.971731
Resources for stage wise_forced : 3.115 s worker CPU, 13.769 s worker Wall, Wall: 17.510 s, Cores in use: 0.65, Total efficiency (on 4 cores): 16.1 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-06T22:14:34.973459
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/coadd/cus/custom-195690p02949/legacysurvey-custom-195690p02949-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/tractor-i/cus/tractor-custom-195690p02949.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/tractor/cus/tractor-custom-195690p02949.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC3122707/tractor/cus/brick-custom-195690p02949.sha256sum
Stage writecat : Wall: 6.34 s, CPU: 6.17 s, VmPeak: 1152 MB, VmSize: 1024 MB, VmRSS: 216 MB, VmData: 240 MB, maxrss: 0.45468 MB
Stage writecat finished: 2020-06-06T22:14:41.311864
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.339 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.3 %
Stage writecat finished
All done: 54.030 s worker CPU, 590.178 s worker Wall, Wall: 244.956 s, Cores in use: 0.46, Total efficiency (on 4 cores): 11.4 %
Finished galaxy PGC3122707 in 4.220 minutes.