Started working on galaxy SDSSJ141105.69+204531.2 at Fri Jun  5 09:06:42 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 212.77373550000002 20.758624100000002 --width 239 --height 239 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/SDSSJ141105.69+204531.2-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/SDSSJ141105.69+204531.2-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-05T09:06:43.495144
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '212.77373550000002', '20.758624100000002', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/SDSSJ141105.69+204531.2-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/SDSSJ141105.69+204531.2-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 212.77373550000002 20.758624100000002 --width 239 --height 239 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/SDSSJ141105.69+204531.2-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/SDSSJ141105.69+204531.2-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 212.77373550000002 20.758624100000002
Starting process 39169 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 39170 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 39171 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 39172 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-05T09:06:43.846240
Keeping 9 CCDs:
   c4d_160302_081125_ooi_z_ls9.fits.fz c4d_160302_081125_ooi_z_ls9-S14 z exptime 80.0 propid 2014B-0404 seeing 1.14 MJD 57449.340 object DECaLS_15994_z
   c4d_170330_062906_ooi_r_ls9.fits.fz c4d_170330_062906_ooi_r_ls9-S14 r exptime 47.0 propid 2014B-0404 seeing 1.07 MJD 57842.269 object DECaLS_15994_r
   c4d_170520_033949_ooi_g_ls9.fits.fz c4d_170520_033949_ooi_g_ls9-S14 g exptime 175.0 propid 2014B-0404 seeing 1.85 MJD 57893.150 object DECaLS_15994_g
   c4d_170303_093434_ooi_z_ls9.fits.fz c4d_170303_093434_ooi_z_ls9-S24 z exptime 98.0 propid 2014B-0404 seeing 1.00 MJD 57815.397 object DECaLS_38480_z
   c4d_180317_075116_ooi_r_ls9.fits.fz c4d_180317_075116_ooi_r_ls9-S24 r exptime 66.0 propid 2014B-0404 seeing 1.16 MJD 58194.327 object DECaLS_38480_r
   c4d_180317_074842_ooi_g_ls9.fits.fz c4d_180317_074842_ooi_g_ls9-S24 g exptime 126.0 propid 2014B-0404 seeing 1.26 MJD 58194.325 object DECaLS_38480_g
   c4d_150411_051115_ooi_z_ls9.fits.fz c4d_150411_051115_ooi_z_ls9-S15 z exptime 116.0 propid 2014B-0404 seeing 1.01 MJD 57123.214 object DECaLS_122_z
   c4d_150417_052100_ooi_r_ls9.fits.fz c4d_150417_052100_ooi_r_ls9-S15 r exptime 71.0 propid 2014B-0404 seeing 1.20 MJD 57129.222 object DECaLS_122_r
   c4d_150417_052301_ooi_g_ls9.fits.fz c4d_150417_052301_ooi_g_ls9-S15 g exptime 93.0 propid 2014B-0404 seeing 1.38 MJD 57129.223 object DECaLS_122_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951519f-r-20170330T062730_oi[S14,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95193ab-g-20170520T033601_oi[S14,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950bfa6-z-20170303T093205_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954db65-z-20160302T080914_oi[S14,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956d285-z-20150411T050831_oi[S15,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952df04-r-20180317T075116_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95571b1-r-20150417T051900_oi[S15,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e23a-g-20180317T074842_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9559b49-g-20150417T052039_oi[S15,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 38.04 s, CPU: 0.90 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 173 MB, VmData: 207 MB, maxrss: 0.44874 MB
Stage tims finished: 2020-06-05T09:07:21.885470
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951519f-r-20170330T062730_oi[S14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952df04-r-20180317T075116_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954db65-z-20160302T080914_oi[S14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95571b1-r-20150417T051900_oi[S15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950bfa6-z-20170303T093205_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956d285-z-20150411T050831_oi[S15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9559b49-g-20150417T052039_oi[S15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95193ab-g-20170520T033601_oi[S14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e23a-g-20180317T074842_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 3.928 s worker CPU, 118.113 s worker Wall, Wall: 38.040 s, Cores in use: 0.13, Total efficiency (on 4 cores): 3.2 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/SDSSJ141105.69+204531.2-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/SDSSJ141105.69+204531.2-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-05T09:07:21.906528
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03979.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04107.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03980.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03851.fits
Matched 11 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/metrics/cus/reference-custom-212773p20758.fits
Stage refs : Wall: 2.13 s, CPU: 1.34 s, VmPeak: 1026 MB, VmSize: 1008 MB, VmRSS: 187 MB, VmData: 220 MB, maxrss: 0.44874 MB
Stage refs finished: 2020-06-05T09:07:24.036556
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.131 s, Cores in use: 0.63, Total efficiency (on 4 cores): 15.7 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-05T09:07:24.037930
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/metrics/cus/outlier-mask-custom-212773p20758.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/metrics/cus/outliers-pre-custom-212773p20758.jpg
Image c4d_170520_033949_ooi_g_ls9-S14 g : masking 219 positive outlier pixels and 0 negative outlier pixels
Image c4d_150417_052301_ooi_g_ls9-S15 g : masking 333 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/metrics/cus/outlier-mask-custom-212773p20758.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/metrics/cus/outliers-post-custom-212773p20758.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/metrics/cus/outliers-masked-pos-custom-212773p20758.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/metrics/cus/outliers-masked-neg-custom-212773p20758.jpg
Stage outliers : Wall: 0.71 s, CPU: 0.52 s, VmPeak: 1026 MB, VmSize: 1017 MB, VmRSS: 199 MB, VmData: 229 MB, maxrss: 0.44874 MB
Stage outliers finished: 2020-06-05T09:07:24.750752
Resources for stage outliers : 0.645 s worker CPU, 0.647 s worker Wall, Wall: 0.714 s, Cores in use: 1.64, Total efficiency (on 4 cores): 40.9 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-05T09:07:24.752340
Stage halos : Wall: 0.54 s, CPU: 0.23 s, VmPeak: 1026 MB, VmSize: 1017 MB, VmRSS: 199 MB, VmData: 229 MB, maxrss: 0.44874 MB
Stage halos finished: 2020-06-05T09:07:25.290768
Resources for stage halos : 0.188 s worker CPU, 0.988 s worker Wall, Wall: 0.539 s, Cores in use: 0.78, Total efficiency (on 4 cores): 19.4 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-05T09:07:25.292591
PSF sigmas in coadd pixels: ['3.01', '2.04', '2.23']
Using average PSF sigma 2.4277116354371038
Gaussian PSF norm 0.11619781676545274 vs pixelized 0.09871146
average tim pixel scale / coadd scale: 1.001219933440212
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.73', '1.89', '1.96']
Using average PSF sigma 1.860743746077415
Gaussian PSF norm 0.15160324594321747 vs pixelized 0.13498881
average tim pixel scale / coadd scale: 1.0012437941378536
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.85', '1.63', '1.63']
Using average PSF sigma 1.703130441993762
Gaussian PSF norm 0.1656331099593553 vs pixelized 0.14000781
average tim pixel scale / coadd scale: 1.0011975723674222
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.52 s, CPU: 0.15 s, VmPeak: 1026 MB, VmSize: 1017 MB, VmRSS: 200 MB, VmData: 229 MB, maxrss: 0.44874 MB
Stage fit_on_coadds finished: 2020-06-05T09:07:25.808585
Resources for stage fit_on_coadds : 0.143 s worker CPU, 0.143 s worker Wall, Wall: 0.517 s, Cores in use: 0.57, Total efficiency (on 4 cores): 14.1 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-05T09:07:25.811382
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 20 potential peaks
Of 20 potential peaks: 10 in veto map, 2 cut by saddle test, 0 cut by aper test, 8 kept
SED z : 8 new peaks
Found 14 potential peaks
Of 14 potential peaks: 11 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 11 potential peaks
Of 11 potential peaks: 6 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 23 potential peaks
Of 23 potential peaks: 13 in veto map, 2 cut by saddle test, 2 cut by aper test, 6 kept
SED Flat : 6 new peaks
Found 23 potential peaks
Of 23 potential peaks: 19 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 17 new sources
Median coadd sky for g : 0.00011578882
Median coadd sky for r : 0.00011455272
Median coadd sky for z : 0.00075633975
Stage srcs : Wall: 0.47 s, CPU: 0.44 s, VmPeak: 1026 MB, VmSize: 1017 MB, VmRSS: 201 MB, VmData: 229 MB, maxrss: 0.44874 MB
Stage srcs finished: 2020-06-05T09:07:26.284574
Resources for stage srcs : 0.091 s worker CPU, 0.099 s worker Wall, Wall: 0.474 s, Cores in use: 1.11, Total efficiency (on 4 cores): 27.8 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/SDSSJ141105.69+204531.2-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/SDSSJ141105.69+204531.2-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-05T09:07:26.525270
Blob 1 of 16, id: 7, sources: 2, size: 113x113, npix 7899, brick X: 72,185, Y: 56,169, one pixel: 111 56
Blob 2 of 16, id: 0, sources: 3, size: 54x38, npix 1246, brick X: 41,95, Y: 0,38, one pixel: 42 0
Blob 3 of 16, id: 12, sources: 1, size: 34x33, npix 724, brick X: 201,235, Y: 188,221, one pixel: 212 188
Blob 4 of 16, id: 15, sources: 1, size: 27x26, npix 431, brick X: 117,144, Y: 208,234, one pixel: 128 208
Blob 5 of 16, id: 3, sources: 1, size: 26x26, npix 428, brick X: 191,217, Y: 19,45, one pixel: 201 19
Blob 4 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 956 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.14602 MB
Blob 6 of 16, id: 11, sources: 1, size: 26x25, npix 391, brick X: 82,108, Y: 175,200, one pixel: 95 175
Blob 5 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 956 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.147988 MB
Blob 7 of 16, id: 8, sources: 1, size: 24x27, npix 331, brick X: 36,60, Y: 118,145, one pixel: 44 118
Blob 3 finished, total: Wall: 1.81 s, CPU: 1.81 s, VmPeak: 956 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14844 MB
Blob 8 of 16, id: 14, sources: 1, size: 23x22, npix 322, brick X: 62,85, Y: 200,222, one pixel: 71 200
Blob 6 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 956 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.147988 MB
Blob 9 of 16, id: 13, sources: 1, size: 22x23, npix 304, brick X: 22,44, Y: 198,221, one pixel: 33 198
Blob 7 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 956 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14844 MB
Blob 10 of 16, id: 10, sources: 1, size: 16x28, npix 301, brick X: 0,16, Y: 135,163, one pixel: 6 135
Blob 8 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 956 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.147988 MB
Blob 11 of 16, id: 2, sources: 1, size: 17x21, npix 236, brick X: 222,239, Y: 9,30, one pixel: 231 9
Measuring 1 iterative sources
Blob 10 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 956 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.147988 MB
Blob 12 of 16, id: 1, sources: 1, size: 22x19, npix 235, brick X: 142,164, Y: 0,19, one pixel: 150 0
Blob 9 finished, total: Wall: 0.99 s, CPU: 0.99 s, VmPeak: 956 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14844 MB
Blob 13 of 16, id: 4, sources: 1, size: 19x19, npix 217, brick X: 124,143, Y: 24,43, one pixel: 132 24
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.59054, ee1=0.153829, ee2=0.144647
Blob 1 finished, total: Wall: 2.99 s, CPU: 2.99 s, VmPeak: 957 MB, VmSize: 719 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149236 MB
Blob 14 of 16, id: 6, sources: 1, size: 19x18, npix 198, brick X: 85,104, Y: 47,65, one pixel: 93 47
Blob 11 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 956 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.147988 MB
Blob 15 of 16, id: 5, sources: 1, size: 14x21, npix 197, brick X: 0,14, Y: 35,56, one pixel: 3 35
Blob 12 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 956 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14844 MB
Blob 16 of 16, id: 9, sources: 1, size: 18x19, npix 189, brick X: 160,178, Y: 130,149, one pixel: 168 130
Blob 13 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 957 MB, VmSize: 719 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149236 MB
Measuring 1 iterative sources
Blob 16 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 957 MB, VmSize: 719 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149236 MB
Blob 14 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 956 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.147988 MB
Blob 15 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 956 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14844 MB
Blob 2 finished, total: Wall: 3.82 s, CPU: 3.82 s, VmPeak: 953 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148532 MB
Old catalog: 21
New catalog: 16
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/metrics/cus/blobs-custom-212773p20758.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/metrics/cus/all-models-custom-212773p20758.fits
Stage fitblobs : Wall: 11.13 s, CPU: 0.91 s, VmPeak: 1026 MB, VmSize: 1017 MB, VmRSS: 201 MB, VmData: 229 MB, maxrss: 0.44874 MB
Stage fitblobs finished: 2020-06-05T09:07:37.653948
Resources for stage fitblobs : 14.234 s worker CPU, 14.254 s worker Wall, Wall: 11.130 s, Cores in use: 1.36, Total efficiency (on 4 cores): 34.0 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-05T09:07:37.655653
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/tmp-legacysurvey-custom-212773p20758-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/tmp-legacysurvey-custom-212773p20758-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/tmp-legacysurvey-custom-212773p20758-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/tmp-legacysurvey-custom-212773p20758-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-resid.jpg
Stage coadds : Wall: 1.21 s, CPU: 0.50 s, VmPeak: 1026 MB, VmSize: 1017 MB, VmRSS: 201 MB, VmData: 229 MB, maxrss: 0.44874 MB
Stage coadds finished: 2020-06-05T09:07:38.866148
Resources for stage coadds : 2.130 s worker CPU, 2.254 s worker Wall, Wall: 1.211 s, Cores in use: 2.18, Total efficiency (on 4 cores): 54.4 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-05T09:07:38.867467
Cut to 1 unWISE tiles
Reading WISE tile 2130p212 band 2
Reading WISE tile 2130p212 band 3
Reading WISE tile 2130p212 band 1
Reading WISE tile 2130p212 band 4
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2130p212/unwise-2130p212-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2130p212/unwise-2130p212-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2130p212/unwise-2130p212-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2130p212/unwise-2130p212-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.04 s, VmPeak: 956 MB, VmSize: 791 MB, VmRSS: 141 MB, VmData: 170 MB, maxrss: 0.205004 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2130p212/unwise-2130p212-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2130p212/unwise-2130p212-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2130p212/unwise-2130p212-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2130p212/unwise-2130p212-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2130p212/unwise-2130p212-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.67 s, CPU: 0.05 s, VmPeak: 953 MB, VmSize: 796 MB, VmRSS: 147 MB, VmData: 175 MB, maxrss: 0.190952 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2130p212/unwise-2130p212-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2130p212/unwise-2130p212-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2130p212/unwise-2130p212-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2130p212/unwise-2130p212-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2130p212/unwise-2130p212-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.47 s, CPU: 0.04 s, VmPeak: 956 MB, VmSize: 791 MB, VmRSS: 142 MB, VmData: 170 MB, maxrss: 0.206328 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2130p212/unwise-2130p212-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2130p212/unwise-2130p212-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2130p212/unwise-2130p212-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2130p212/unwise-2130p212-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 957 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210276 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/tmp-legacysurvey-custom-212773p20758-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/tmp-legacysurvey-custom-212773p20758-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.47 s, CPU: 0.49 s, VmPeak: 1026 MB, VmSize: 1017 MB, VmRSS: 202 MB, VmData: 229 MB, maxrss: 0.44874 MB
Stage wise_forced finished: 2020-06-05T09:07:41.334161
Resources for stage wise_forced : 4.371 s worker CPU, 7.423 s worker Wall, Wall: 2.468 s, Cores in use: 1.97, Total efficiency (on 4 cores): 49.3 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-05T09:07:41.335945
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/coadd/cus/custom-212773p20758/legacysurvey-custom-212773p20758-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/tractor-i/cus/tractor-custom-212773p20758.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/tractor/cus/tractor-custom-212773p20758.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/SDSSJ141105.69+204531.2/tractor/cus/brick-custom-212773p20758.sha256sum
Stage writecat : Wall: 3.18 s, CPU: 0.94 s, VmPeak: 1150 MB, VmSize: 1022 MB, VmRSS: 204 MB, VmData: 229 MB, maxrss: 0.44874 MB
Stage writecat finished: 2020-06-05T09:07:44.515753
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.181 s, Cores in use: 0.30, Total efficiency (on 4 cores): 7.4 %
Stage writecat finished
All done: 25.731 s worker CPU, 143.923 s worker Wall, Wall: 60.675 s, Cores in use: 0.53, Total efficiency (on 4 cores): 13.3 %
Finished galaxy SDSSJ141105.69+204531.2 in 1.083 minutes.