Started working on galaxy PGC1412995 at Fri Jun  5 17:13:37 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 212.267691 12.623415800000002 --width 245 --height 245 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/PGC1412995-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/PGC1412995-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-05T17:13:38.943970
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '212.267691', '12.623415800000002', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/PGC1412995-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/PGC1412995-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 212.267691 12.623415800000002 --width 245 --height 245 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/PGC1412995-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/PGC1412995-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 212.267691 12.623415800000002
Starting process 55445 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 55446 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 55447 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 55448 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-05T17:13:39.365243
Keeping 13 CCDs:
   c4d_170421_060158_ooi_g_ls9.fits.fz c4d_170421_060158_ooi_g_ls9-S1 g exptime 175.0 propid 2014B-0404 seeing 1.25 MJD 57864.249 object DECaLS_1194_g
   c4d_170306_081624_ooi_r_ls9.fits.fz c4d_170306_081624_ooi_r_ls9-S1 r exptime 48.0 propid 2014B-0404 seeing 1.03 MJD 57818.344 object DECaLS_1194_r
   c4d_150409_053153_ooi_z_ls9.fits.fz c4d_150409_053153_ooi_z_ls9-S1 z exptime 80.0 propid 2014B-0404 seeing 1.34 MJD 57121.229 object DECaLS_1194_z
   c4d_170520_040009_ooi_r_ls9.fits.fz c4d_170520_040009_ooi_r_ls9-S11 r exptime 102.0 propid 2014B-0404 seeing 1.72 MJD 57893.165 object DECaLS_32956_r
   c4d_180513_025935_ooi_g_ls9.fits.fz c4d_180513_025935_ooi_g_ls9-S11 g exptime 200.0 propid 2014B-0404 seeing 1.44 MJD 58251.125 object DECaLS_32956_g
   c4d_150329_062915_ooi_r_ls9.fits.fz c4d_150329_062915_ooi_r_ls9-S5 r exptime 59.0 propid 2014B-0404 seeing 1.04 MJD 57110.269 object DECaLS_17084_r
   c4d_150412_053915_ooi_z_ls9.fits.fz c4d_150412_053915_ooi_z_ls9-S5 z exptime 80.0 propid 2014B-0404 seeing 1.00 MJD 57124.234 object DECaLS_17084_z
   c4d_150329_062747_ooi_g_ls9.fits.fz c4d_150329_062747_ooi_g_ls9-S5 g exptime 64.0 propid 2014B-0404 seeing 1.18 MJD 57110.268 object DECaLS_17084_g
   c4d_150409_052627_ooi_z_ls9.fits.fz c4d_150409_052627_ooi_z_ls9-S6 z exptime 80.0 propid 2014B-0404 seeing 1.05 MJD 57121.225 object DECaLS_1212_z
   c4d_170306_075821_ooi_r_ls9.fits.fz c4d_170306_075821_ooi_r_ls9-S6 r exptime 44.0 propid 2014B-0404 seeing 0.94 MJD 57818.331 object DECaLS_1212_r
   c4d_170306_080043_ooi_g_ls9.fits.fz c4d_170306_080043_ooi_g_ls9-S6 g exptime 113.0 propid 2014B-0404 seeing 1.06 MJD 57818.332 object DECaLS_1212_g
   c4d_160812_004428_ooi_z_ls9.fits.fz c4d_160812_004428_ooi_z_ls9-S11 z exptime 197.0 propid 2014B-0404 seeing 1.24 MJD 57612.028 object DECaLS_32956_z
   c4d_170401_064913_ooi_g_ls9.fits.fz c4d_170401_064913_ooi_g_ls9-S11 g exptime 175.0 propid 2014B-0404 seeing 2.01 MJD 57844.282 object DECaLS_32956_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9517d11-g-20170421T055813_oi[S1,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9572de6-z-20150409T052945_oi[S1,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951060a-r-20170306T081446_oi[S1,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95188f8-r-20170520T035735_oi[S11,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f4fa-g-20180513T025935_oi[S11,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9553d6a-r-20150329T062725_oi[S5,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956a2ca-z-20150412T053705_oi[S5,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95579f3-g-20150329T062554_oi[S5,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9572de6-z-20150409T052417_oi[S6,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951060a-r-20170306T075646_oi[S6,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95102ba-g-20170306T075800_oi[S6,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95173ea-g-20170401T064527_oi[S11,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a387-z-20160812T004020_oi[S11,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 96.52 s, CPU: 0.95 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.450836 MB
Stage tims finished: 2020-06-05T17:15:15.885420
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9572de6-z-20150409T052945_oi[S1,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9553d6a-r-20150329T062725_oi[S5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951060a-r-20170306T075646_oi[S6,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951060a-r-20170306T081446_oi[S1,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956a2ca-z-20150412T053705_oi[S5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95102ba-g-20170306T075800_oi[S6,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9517d11-g-20170421T055813_oi[S1,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f4fa-g-20180513T025935_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9572de6-z-20150409T052417_oi[S6,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95173ea-g-20170401T064527_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95188f8-r-20170520T035735_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95579f3-g-20150329T062554_oi[S5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a387-z-20160812T004020_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 5.124 s worker CPU, 264.220 s worker Wall, Wall: 96.522 s, Cores in use: 0.06, Total efficiency (on 4 cores): 1.6 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/PGC1412995-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/PGC1412995-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-05T17:15:16.288623
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04748.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04875.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04747.fits
Matched 14 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/metrics/cus/reference-custom-212267p12623.fits
Stage refs : Wall: 5.01 s, CPU: 4.70 s, VmPeak: 1027 MB, VmSize: 1010 MB, VmRSS: 189 MB, VmData: 222 MB, maxrss: 0.450836 MB
Stage refs finished: 2020-06-05T17:15:21.301308
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.014 s, Cores in use: 0.94, Total efficiency (on 4 cores): 23.4 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-05T17:15:21.302615
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/metrics/cus/outlier-mask-custom-212267p12623.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/metrics/cus/outliers-pre-custom-212267p12623.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/metrics/cus/outlier-mask-custom-212267p12623.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/metrics/cus/outliers-post-custom-212267p12623.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/metrics/cus/outliers-masked-pos-custom-212267p12623.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/metrics/cus/outliers-masked-neg-custom-212267p12623.jpg
Stage outliers : Wall: 3.98 s, CPU: 3.85 s, VmPeak: 1027 MB, VmSize: 1020 MB, VmRSS: 200 MB, VmData: 231 MB, maxrss: 0.450836 MB
Stage outliers finished: 2020-06-05T17:15:25.279275
Resources for stage outliers : 0.555 s worker CPU, 0.555 s worker Wall, Wall: 3.978 s, Cores in use: 1.11, Total efficiency (on 4 cores): 27.7 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-05T17:15:25.280871
Stage halos : Wall: 5.57 s, CPU: 3.43 s, VmPeak: 1027 MB, VmSize: 1020 MB, VmRSS: 200 MB, VmData: 231 MB, maxrss: 0.450836 MB
Stage halos finished: 2020-06-05T17:15:30.855064
Resources for stage halos : 0.177 s worker CPU, 7.998 s worker Wall, Wall: 5.575 s, Cores in use: 0.65, Total efficiency (on 4 cores): 16.2 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-05T17:15:30.856909
PSF sigmas in coadd pixels: ['2.03', '2.34', '1.91', '1.72', '3.26']
Using average PSF sigma 2.2511119736507497
Gaussian PSF norm 0.12531353174599744 vs pixelized 0.102089494
average tim pixel scale / coadd scale: 1.0011535900367694
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.67', '2.80', '1.69', '1.52']
Using average PSF sigma 1.921287125714413
Gaussian PSF norm 0.1468259418378103 vs pixelized 0.11689177
average tim pixel scale / coadd scale: 1.0011855420436113
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.18', '1.63', '1.70', '2.01']
Using average PSF sigma 1.8795332739254045
Gaussian PSF norm 0.15008768170659906 vs pixelized 0.12626933
average tim pixel scale / coadd scale: 1.0011636225270277
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.44 s, CPU: 0.15 s, VmPeak: 1027 MB, VmSize: 1020 MB, VmRSS: 203 MB, VmData: 232 MB, maxrss: 0.450836 MB
Stage fit_on_coadds finished: 2020-06-05T17:15:31.298230
Resources for stage fit_on_coadds : 0.131 s worker CPU, 0.133 s worker Wall, Wall: 0.442 s, Cores in use: 0.63, Total efficiency (on 4 cores): 15.8 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-05T17:15:31.300791
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 10 potential peaks
Of 10 potential peaks: 1 in veto map, 1 cut by saddle test, 0 cut by aper test, 8 kept
SED z : 8 new peaks
Found 8 potential peaks
Of 8 potential peaks: 5 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 5 potential peaks
Of 5 potential peaks: 5 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 10 potential peaks
Of 10 potential peaks: 8 in veto map, 0 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 15 potential peaks
Of 15 potential peaks: 12 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 13 new sources
Median coadd sky for g : 1.1210824e-05
Median coadd sky for r : 0.00010661619
Median coadd sky for z : 0.00036128436
Stage srcs : Wall: 1.94 s, CPU: 1.90 s, VmPeak: 1027 MB, VmSize: 1020 MB, VmRSS: 204 MB, VmData: 232 MB, maxrss: 0.450836 MB
Stage srcs finished: 2020-06-05T17:15:33.239168
Resources for stage srcs : 0.088 s worker CPU, 0.095 s worker Wall, Wall: 1.939 s, Cores in use: 1.03, Total efficiency (on 4 cores): 25.6 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/PGC1412995-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/PGC1412995-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-05T17:15:33.248906
Blob 1 of 10, id: 0, sources: 4, size: 78x139, npix 6315, brick X: 84,162, Y: 26,165, one pixel: 116 26
Blob 2 of 10, id: 1, sources: 2, size: 40x66, npix 1553, brick X: 205,245, Y: 44,110, one pixel: 218 44
Blob 3 of 10, id: 6, sources: 1, size: 33x38, npix 850, brick X: 13,46, Y: 136,174, one pixel: 29 136
Blob 4 of 10, id: 7, sources: 1, size: 22x31, npix 420, brick X: 172,194, Y: 138,169, one pixel: 181 138
Blob 5 of 10, id: 2, sources: 1, size: 23x25, npix 351, brick X: 81,104, Y: 60,85, one pixel: 90 60
Measuring 1 iterative sources
Blob 4 finished, total: Wall: 0.42 s, CPU: 0.42 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146308 MB
Blob 6 of 10, id: 5, sources: 1, size: 22x21, npix 271, brick X: 198,220, Y: 134,155, one pixel: 207 134
Blob 5 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146308 MB
Blob 7 of 10, id: 9, sources: 1, size: 20x21, npix 258, brick X: 131,151, Y: 214,235, one pixel: 139 214
Blob 6 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146308 MB
Blob 8 of 10, id: 8, sources: 1, size: 20x20, npix 237, brick X: 207,227, Y: 204,224, one pixel: 215 204
Blob 3 finished, total: Wall: 1.63 s, CPU: 1.62 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14816 MB
Blob 9 of 10, id: 3, sources: 1, size: 19x18, npix 198, brick X: 172,191, Y: 95,113, one pixel: 180 95
Blob 8 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14816 MB
Blob 10 of 10, id: 4, sources: 1, size: 17x17, npix 145, brick X: 208,225, Y: 101,118, one pixel: 216 101
Blob 9 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14816 MB
Blob 7 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146308 MB
Blob 10 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14816 MB
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 3.07 s, CPU: 3.07 s, VmPeak: 960 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14804 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.440778, ee1=0.061852, ee2=0.00219588
Blob 1 finished, total: Wall: 6.18 s, CPU: 6.18 s, VmPeak: 964 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148148 MB
Old catalog: 15
New catalog: 14
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/metrics/cus/blobs-custom-212267p12623.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/metrics/cus/all-models-custom-212267p12623.fits
Stage fitblobs : Wall: 7.15 s, CPU: 0.97 s, VmPeak: 1027 MB, VmSize: 1020 MB, VmRSS: 204 MB, VmData: 232 MB, maxrss: 0.450836 MB
Stage fitblobs finished: 2020-06-05T17:15:40.403423
Resources for stage fitblobs : 13.607 s worker CPU, 13.629 s worker Wall, Wall: 7.155 s, Cores in use: 2.04, Total efficiency (on 4 cores): 50.9 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-05T17:15:40.404976
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/tmp-legacysurvey-custom-212267p12623-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/tmp-legacysurvey-custom-212267p12623-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/tmp-legacysurvey-custom-212267p12623-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/tmp-legacysurvey-custom-212267p12623-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-resid.jpg
Stage coadds : Wall: 4.93 s, CPU: 4.32 s, VmPeak: 1027 MB, VmSize: 1020 MB, VmRSS: 204 MB, VmData: 232 MB, maxrss: 0.450836 MB
Stage coadds finished: 2020-06-05T17:15:45.330376
Resources for stage coadds : 1.876 s worker CPU, 1.974 s worker Wall, Wall: 4.926 s, Cores in use: 1.26, Total efficiency (on 4 cores): 31.5 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-05T17:15:45.331780
Cut to 1 unWISE tiles
Reading WISE tile 2116p121 band 2
Reading WISE tile 2116p121 band 1
Reading WISE tile 2116p121 band 4
Reading WISE tile 2116p121 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/211/2116p121/unwise-2116p121-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/211/2116p121/unwise-2116p121-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/211/2116p121/unwise-2116p121-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/211/2116p121/unwise-2116p121-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/211/2116p121/unwise-2116p121-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 964 MB, VmSize: 795 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209508 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/211/2116p121/unwise-2116p121-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/211/2116p121/unwise-2116p121-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/211/2116p121/unwise-2116p121-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/211/2116p121/unwise-2116p121-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/211/2116p121/unwise-2116p121-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 960 MB, VmSize: 797 MB, VmRSS: 148 MB, VmData: 176 MB, maxrss: 0.189208 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/211/2116p121/unwise-2116p121-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/211/2116p121/unwise-2116p121-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/211/2116p121/unwise-2116p121-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/211/2116p121/unwise-2116p121-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 961 MB, VmSize: 791 MB, VmRSS: 141 MB, VmData: 170 MB, maxrss: 0.205992 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/211/2116p121/unwise-2116p121-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/211/2116p121/unwise-2116p121-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/211/2116p121/unwise-2116p121-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/211/2116p121/unwise-2116p121-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 962 MB, VmSize: 795 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.210008 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/tmp-legacysurvey-custom-212267p12623-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/tmp-legacysurvey-custom-212267p12623-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 7.08 s, CPU: 2.79 s, VmPeak: 1027 MB, VmSize: 1020 MB, VmRSS: 205 MB, VmData: 232 MB, maxrss: 0.450836 MB
Stage wise_forced finished: 2020-06-05T17:15:52.408318
Resources for stage wise_forced : 3.107 s worker CPU, 7.899 s worker Wall, Wall: 7.078 s, Cores in use: 0.83, Total efficiency (on 4 cores): 20.8 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-05T17:15:52.409813
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/coadd/cus/custom-212267p12623/legacysurvey-custom-212267p12623-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/tractor-i/cus/tractor-custom-212267p12623.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/tractor/cus/tractor-custom-212267p12623.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/PGC1412995/tractor/cus/brick-custom-212267p12623.sha256sum
Stage writecat : Wall: 0.54 s, CPU: 0.38 s, VmPeak: 1152 MB, VmSize: 1024 MB, VmRSS: 207 MB, VmData: 232 MB, maxrss: 0.450836 MB
Stage writecat finished: 2020-06-05T17:15:52.949680
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.541 s, Cores in use: 0.70, Total efficiency (on 4 cores): 17.5 %
Stage writecat finished
All done: 24.666 s worker CPU, 296.505 s worker Wall, Wall: 133.589 s, Cores in use: 0.36, Total efficiency (on 4 cores): 9.0 %
Finished galaxy PGC1412995 in 2.257 minutes.