Started working on galaxy 2MASXJ16121680+2516036 at Sun Jun  7 12:50:59 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 243.07001549999998 25.2678537 --width 257 --height 257 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/2MASXJ16121680+2516036-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/2MASXJ16121680+2516036-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T12:51:00.437934
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '243.07001549999998', '25.2678537', '--width', '257', '--height', '257', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/2MASXJ16121680+2516036-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/2MASXJ16121680+2516036-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 243.07001549999998 25.2678537 --width 257 --height 257 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/2MASXJ16121680+2516036-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/2MASXJ16121680+2516036-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 243.07001549999998 25.2678537
Starting process 64185 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 64186 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 64187 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB
Starting process 64188 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T12:51:04.837304
Keeping 11 CCDs:
   c4d_180515_052937_ooi_g_ls9.fits.fz c4d_180515_052937_ooi_g_ls9-S27 g exptime 200.0 propid 2014B-0404 seeing 1.77 MJD 58253.229 object DECaLS_31834_g
   c4d_160609_054115_ooi_g_ls9.fits.fz c4d_160609_054115_ooi_g_ls9-S27 g exptime 216.0 propid 2014B-0404 seeing 1.98 MJD 57548.234 object DECaLS_15962_g
   c4d_180809_004055_ooi_r_ls9.fits.fz c4d_180809_004055_ooi_r_ls9-S27 r exptime 85.0 propid 2014B-0404 seeing 1.53 MJD 58339.028 object DECaLS_15962_r
   c4d_150410_074302_ooi_z_ls9.fits.fz c4d_150410_074302_ooi_z_ls9-S27 z exptime 117.0 propid 2014B-0404 seeing 0.98 MJD 57122.320 object DECaLS_15962_z
   c4d_140815_232859_ooi_z_ls9.fits.fz c4d_140815_232859_ooi_z_ls9-S24 z exptime 126.0 propid 2014B-0404 seeing 0.96 MJD 56884.976 object DECaLS_90_z
   c4d_180517_043537_ooi_r_ls9.fits.fz c4d_180517_043537_ooi_r_ls9-S24 r exptime 70.0 propid 2014B-0404 seeing 1.15 MJD 58255.191 object DECaLS_90_r
   c4d_180516_052333_ooi_g_ls9.fits.fz c4d_180516_052333_ooi_g_ls9-S24 g exptime 142.0 propid 2014B-0404 seeing 1.25 MJD 58254.225 object DECaLS_90_g
   c4d_180517_051655_ooi_r_ls9.fits.fz c4d_180517_051655_ooi_r_ls9-N14 r exptime 61.0 propid 2014B-0404 seeing 1.10 MJD 58255.220 object DECaLS_89_r
   c4d_180516_052057_ooi_g_ls9.fits.fz c4d_180516_052057_ooi_g_ls9-N14 g exptime 126.0 propid 2014B-0404 seeing 1.26 MJD 58254.223 object DECaLS_89_g
   c4d_140815_233920_ooi_z_ls9.fits.fz c4d_140815_233920_ooi_z_ls9-N14 z exptime 124.0 propid 2014B-0404 seeing 0.92 MJD 56884.984 object DECaLS_89_z
   c4d_180212_085947_ooi_z_ls9.fits.fz c4d_180212_085947_ooi_z_ls9-S27 z exptime 172.0 propid 2014B-0404 seeing 1.29 MJD 58161.375 object DECaLS_31834_z
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95648f6-g-20160609T053651_oi[S27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956e9f3-z-20150410T074014_oi[S27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952fbad-g-20180515T052937_oi[S27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9560631-r-20180517T043537_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530281-g-20180516T052333_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d16a-z-20140815T232604_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530fec-r-20180809T004055_oi[S27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9560631-r-20180517T051655_oi[N14,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530281-g-20180516T052057_oi[N14,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d16a-z-20140815T233622_oi[N14,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952764d-z-20180212T085947_oi[S27,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 64.43 s, CPU: 3.83 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 176 MB, VmData: 209 MB, maxrss: 0.454616 MB
Stage tims finished: 2020-06-07T12:52:09.270343
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956e9f3-z-20150410T074014_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9560631-r-20180517T043537_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9560631-r-20180517T051655_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95648f6-g-20160609T053651_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d16a-z-20140815T232604_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d16a-z-20140815T233622_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530fec-r-20180809T004055_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952764d-z-20180212T085947_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952fbad-g-20180515T052937_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530281-g-20180516T052333_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530281-g-20180516T052057_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 4.123 s worker CPU, 222.807 s worker Wall, Wall: 64.434 s, Cores in use: 0.12, Total efficiency (on 4 cores): 3.1 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/2MASXJ16121680+2516036-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/2MASXJ16121680+2516036-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T12:52:09.571967
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03478.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03606.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03479.fits
Matched 9 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/metrics/cus/reference-custom-243070p25267.fits
Stage refs : Wall: 10.22 s, CPU: 8.34 s, VmPeak: 1027 MB, VmSize: 1021 MB, VmRSS: 202 MB, VmData: 235 MB, maxrss: 0.454616 MB
Stage refs finished: 2020-06-07T12:52:19.788768
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 10.218 s, Cores in use: 0.82, Total efficiency (on 4 cores): 20.4 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T12:52:19.790207
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/metrics/cus/outlier-mask-custom-243070p25267.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/metrics/cus/outliers-pre-custom-243070p25267.jpg
Image c4d_160609_054115_ooi_g_ls9-S27 g : masking 0 positive outlier pixels and 162 negative outlier pixels
Image c4d_180516_052333_ooi_g_ls9-S24 g : masking 129 positive outlier pixels and 0 negative outlier pixels
Image c4d_180516_052057_ooi_g_ls9-N14 g : masking 146 positive outlier pixels and 0 negative outlier pixels
Image c4d_180809_004055_ooi_r_ls9-S27 r : masking 1422 positive outlier pixels and 0 negative outlier pixels
Image c4d_180517_051655_ooi_r_ls9-N14 r : masking 495 positive outlier pixels and 0 negative outlier pixels
Image c4d_150410_074302_ooi_z_ls9-S27 z : masking 137 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/metrics/cus/outlier-mask-custom-243070p25267.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/metrics/cus/outliers-post-custom-243070p25267.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/metrics/cus/outliers-masked-pos-custom-243070p25267.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/metrics/cus/outliers-masked-neg-custom-243070p25267.jpg
Stage outliers : Wall: 11.97 s, CPU: 6.33 s, VmPeak: 1031 MB, VmSize: 1031 MB, VmRSS: 214 MB, VmData: 245 MB, maxrss: 0.454616 MB
Stage outliers finished: 2020-06-07T12:52:31.758014
Resources for stage outliers : 1.150 s worker CPU, 1.161 s worker Wall, Wall: 11.969 s, Cores in use: 0.62, Total efficiency (on 4 cores): 15.6 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T12:52:31.759727
Stage halos : Wall: 9.14 s, CPU: 6.62 s, VmPeak: 1031 MB, VmSize: 1031 MB, VmRSS: 214 MB, VmData: 245 MB, maxrss: 0.454616 MB
Stage halos finished: 2020-06-07T12:52:40.897566
Resources for stage halos : 0.241 s worker CPU, 9.257 s worker Wall, Wall: 9.139 s, Cores in use: 0.75, Total efficiency (on 4 cores): 18.8 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-07T12:52:40.899427
PSF sigmas in coadd pixels: ['2.87', '3.22', '2.02', '2.05']
Using average PSF sigma 2.5431105269034098
Gaussian PSF norm 0.11092510089106027 vs pixelized 0.09928316
average tim pixel scale / coadd scale: 1.0012881413772203
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.49', '1.87', '1.79']
Using average PSF sigma 2.0500857185514665
Gaussian PSF norm 0.13760146184189725 vs pixelized 0.117855564
average tim pixel scale / coadd scale: 1.0012608565361671
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.60', '1.56', '1.49', '2.09']
Using average PSF sigma 1.6834205870170282
Gaussian PSF norm 0.1675723784949915 vs pixelized 0.13579385
average tim pixel scale / coadd scale: 1.0012742698473414
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 1.50 s, CPU: 0.19 s, VmPeak: 1031 MB, VmSize: 1031 MB, VmRSS: 217 MB, VmData: 246 MB, maxrss: 0.454616 MB
Stage fit_on_coadds finished: 2020-06-07T12:52:42.394694
Resources for stage fit_on_coadds : 0.245 s worker CPU, 0.264 s worker Wall, Wall: 1.496 s, Cores in use: 0.29, Total efficiency (on 4 cores): 7.3 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T12:52:42.397527
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 55 potential peaks
Of 55 potential peaks: 21 in veto map, 8 cut by saddle test, 0 cut by aper test, 26 kept
SED z : 26 new peaks
Found 39 potential peaks
Of 39 potential peaks: 33 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 34 potential peaks
Of 34 potential peaks: 28 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 44 potential peaks
Of 44 potential peaks: 36 in veto map, 7 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 54 potential peaks
Of 54 potential peaks: 43 in veto map, 10 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 30 new sources
Median coadd sky for g : 0.00014495749
Median coadd sky for r : 9.576077e-05
Median coadd sky for z : 0.00026114238
Stage srcs : Wall: 5.60 s, CPU: 5.56 s, VmPeak: 1031 MB, VmSize: 1031 MB, VmRSS: 217 MB, VmData: 246 MB, maxrss: 0.454616 MB
Stage srcs finished: 2020-06-07T12:52:47.999050
Resources for stage srcs : 0.117 s worker CPU, 0.125 s worker Wall, Wall: 5.602 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/2MASXJ16121680+2516036-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/2MASXJ16121680+2516036-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T12:52:48.329742
Blob 1 of 13, id: 0, sources: 20, size: 234x191, npix 24923, brick X: 23,257, Y: 0,191, one pixel: 75 0
Blob 2 of 13, id: 5, sources: 2, size: 26x56, npix 1094, brick X: 231,257, Y: 128,184, one pixel: 251 128
Blob 3 of 13, id: 10, sources: 1, size: 27x34, npix 668, brick X: 160,187, Y: 223,257, one pixel: 172 223
Blob 4 of 13, id: 11, sources: 1, size: 32x31, npix 667, brick X: 207,239, Y: 226,257, one pixel: 222 226
Blob 5 of 13, id: 2, sources: 1, size: 32x26, npix 543, brick X: 200,232, Y: 14,40, one pixel: 220 14
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (243.05956, 25.27000), pm (-3.3, -0.2), parallax 0.079 with NanoMaggies: g=17.3, r=16.4, z=16
Reset brightness to NanoMaggies: g=17.2, r=16.3, z=16
Blob 2 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146776 MB
Blob 6 of 13, id: 4, sources: 1, size: 28x30, npix 534, brick X: 26,54, Y: 119,149, one pixel: 39 119
Blob 4 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146856 MB
Blob 7 of 13, id: 7, sources: 1, size: 26x26, npix 418, brick X: 15,41, Y: 149,175, one pixel: 28 149
Measuring 1 iterative sources
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 1.62 s, CPU: 1.62 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.1482 MB
Blob 8 of 13, id: 12, sources: 1, size: 32x18, npix 395, brick X: 109,141, Y: 239,257, one pixel: 119 239
Blob 5 finished, total: Wall: 1.50 s, CPU: 1.50 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146776 MB
Blob 9 of 13, id: 1, sources: 1, size: 24x26, npix 390, brick X: 147,171, Y: 2,28, one pixel: 158 2
Measuring 1 iterative sources
Blob 6 finished, total: Wall: 1.29 s, CPU: 1.29 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146856 MB
Blob 10 of 13, id: 6, sources: 1, size: 23x24, npix 349, brick X: 203,226, Y: 141,165, one pixel: 212 141
Measuring 1 iterative sources
Blob 7 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.1482 MB
Blob 11 of 13, id: 9, sources: 1, size: 24x24, npix 343, brick X: 111,135, Y: 204,228, one pixel: 123 204
Blob 8 finished, total: Wall: 1.03 s, CPU: 1.03 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146776 MB
Blob 12 of 13, id: 8, sources: 1, size: 24x23, npix 317, brick X: 35,59, Y: 183,206, one pixel: 46 183
Blob 10 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.1482 MB
Blob 9 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146856 MB
Blob 13 of 13, id: 3, sources: 1, size: 15x19, npix 183, brick X: 0,15, Y: 118,137, one pixel: 5 118
Blob 12 finished, total: Wall: 0.39 s, CPU: 0.38 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.1482 MB
Blob 13 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146856 MB
Blob 11 finished, total: Wall: 1.22 s, CPU: 1.22 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148808 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.679684, ee1=0.243197, ee2=-0.1613
Measuring 9 iterative sources
Blob 1 finished, total: Wall: 26.66 s, CPU: 26.65 s, VmPeak: 961 MB, VmSize: 722 MB, VmRSS: 153 MB, VmData: 185 MB, maxrss: 0.156924 MB
Old catalog: 35
New catalog: 40
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/metrics/cus/blobs-custom-243070p25267.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/metrics/cus/all-models-custom-243070p25267.fits
Stage fitblobs : Wall: 34.09 s, CPU: 4.22 s, VmPeak: 1031 MB, VmSize: 1031 MB, VmRSS: 218 MB, VmData: 246 MB, maxrss: 0.454616 MB
Stage fitblobs finished: 2020-06-07T12:53:22.420228
Resources for stage fitblobs : 37.660 s worker CPU, 37.682 s worker Wall, Wall: 34.092 s, Cores in use: 1.23, Total efficiency (on 4 cores): 30.7 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T12:53:22.422034
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/tmp-legacysurvey-custom-243070p25267-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/tmp-legacysurvey-custom-243070p25267-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/tmp-legacysurvey-custom-243070p25267-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/tmp-legacysurvey-custom-243070p25267-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-resid.jpg
Stage coadds : Wall: 17.69 s, CPU: 11.01 s, VmPeak: 1031 MB, VmSize: 1031 MB, VmRSS: 218 MB, VmData: 246 MB, maxrss: 0.454616 MB
Stage coadds finished: 2020-06-07T12:53:40.116273
Resources for stage coadds : 2.647 s worker CPU, 2.802 s worker Wall, Wall: 17.695 s, Cores in use: 0.77, Total efficiency (on 4 cores): 19.3 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T12:53:40.117610
Cut to 1 unWISE tiles
Reading WISE tile 2433p257 band 4
Reading WISE tile 2433p257 band 2
Reading WISE tile 2433p257 band 3
Reading WISE tile 2433p257 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p257/unwise-2433p257-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p257/unwise-2433p257-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p257/unwise-2433p257-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p257/unwise-2433p257-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p257/unwise-2433p257-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 961 MB, VmSize: 792 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.2067 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p257/unwise-2433p257-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p257/unwise-2433p257-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p257/unwise-2433p257-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p257/unwise-2433p257-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 961 MB, VmSize: 798 MB, VmRSS: 153 MB, VmData: 177 MB, maxrss: 0.217352 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p257/unwise-2433p257-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p257/unwise-2433p257-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p257/unwise-2433p257-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p257/unwise-2433p257-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p257/unwise-2433p257-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 962 MB, VmSize: 798 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.19126 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p257/unwise-2433p257-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p257/unwise-2433p257-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p257/unwise-2433p257-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p257/unwise-2433p257-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 961 MB, VmSize: 795 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.20872 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/tmp-legacysurvey-custom-243070p25267-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/tmp-legacysurvey-custom-243070p25267-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 23.42 s, CPU: 10.51 s, VmPeak: 1031 MB, VmSize: 1031 MB, VmRSS: 219 MB, VmData: 246 MB, maxrss: 0.454616 MB
Stage wise_forced finished: 2020-06-07T12:54:03.533271
Resources for stage wise_forced : 3.202 s worker CPU, 16.924 s worker Wall, Wall: 23.417 s, Cores in use: 0.59, Total efficiency (on 4 cores): 14.6 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T12:54:03.535041
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/coadd/cus/custom-243070p25267/legacysurvey-custom-243070p25267-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/tractor-i/cus/tractor-custom-243070p25267.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/tractor/cus/tractor-custom-243070p25267.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/2MASXJ16121680+2516036/tractor/cus/brick-custom-243070p25267.sha256sum
Stage writecat : Wall: 23.56 s, CPU: 10.29 s, VmPeak: 1163 MB, VmSize: 1035 MB, VmRSS: 221 MB, VmData: 246 MB, maxrss: 0.454616 MB
Stage writecat finished: 2020-06-07T12:54:27.099956
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 23.566 s, Cores in use: 0.44, Total efficiency (on 4 cores): 10.9 %
Stage writecat finished
All done: 49.386 s worker CPU, 291.023 s worker Wall, Wall: 202.271 s, Cores in use: 0.58, Total efficiency (on 4 cores): 14.4 %
Finished galaxy 2MASXJ16121680+2516036 in 3.490 minutes.