Started working on galaxy SDSSJ110628.91+111435.1 at Sun Jun  7 04:00:52 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 166.62051 11.2431314 --width 263 --height 263 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/SDSSJ110628.91+111435.1-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/SDSSJ110628.91+111435.1-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T04:00:53.131325
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '166.62051', '11.2431314', '--width', '263', '--height', '263', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/SDSSJ110628.91+111435.1-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/SDSSJ110628.91+111435.1-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 166.62051 11.2431314 --width 263 --height 263 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/SDSSJ110628.91+111435.1-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/SDSSJ110628.91+111435.1-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 166.62051 11.2431314
Starting process 58110 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 58111 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 58112 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 58113 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T04:00:58.431948
Keeping 10 CCDs:
   c4d_160110_082602_ooi_z_ls9.fits.fz c4d_160110_082602_ooi_z_ls9-N19 z exptime 87.0 propid 2014B-0404 seeing 0.97 MJD 57397.350 object DECaLS_3373_z
   c4d_190206_062812_ooi_g_ls9.fits.fz c4d_190206_062812_ooi_g_ls9-N19 g exptime 151.0 propid 2014B-0404 seeing 1.80 MJD 58520.270 object DECaLS_3373_g
   c4d_160117_080538_ooi_g_ls9.fits.fz c4d_160117_080538_ooi_g_ls9-N19 g exptime 64.0 propid 2014B-0404 seeing 1.25 MJD 57404.336 object DECaLS_3373_g
   c4d_160117_080646_ooi_r_ls9.fits.fz c4d_160117_080646_ooi_r_ls9-N19 r exptime 40.0 propid 2014B-0404 seeing 1.17 MJD 57404.337 object DECaLS_3373_r
   c4d_180128_072957_ooi_g_ls9.fits.fz c4d_180128_072957_ooi_g_ls9-N18 g exptime 122.0 propid 2014B-0404 seeing 1.12 MJD 58146.312 object DECaLS_19245_g
   c4d_170110_060538_ooi_z_ls9.fits.fz c4d_170110_060538_ooi_z_ls9-N18 z exptime 86.0 propid 2014B-0404 seeing 1.23 MJD 57763.252 object DECaLS_19245_z
   c4d_170422_003409_ooi_r_ls9.fits.fz c4d_170422_003409_ooi_r_ls9-N18 r exptime 73.0 propid 2014B-0404 seeing 1.01 MJD 57865.022 object DECaLS_19245_r
   c4d_160302_051441_ooi_z_ls9.fits.fz c4d_160302_051441_ooi_z_ls9-N17 z exptime 250.0 propid 2014B-0404 seeing 1.17 MJD 57449.215 object DECaLS_35117_z
   c4d_180319_040527_ooi_g_ls9.fits.fz c4d_180319_040527_ooi_g_ls9-N17 g exptime 124.0 propid 2014B-0404 seeing 1.07 MJD 58196.170 object DECaLS_35117_g
   c4d_180318_042819_ooi_r_ls9.fits.fz c4d_180318_042819_ooi_r_ls9-N17 r exptime 58.0 propid 2014B-0404 seeing 1.06 MJD 58195.186 object DECaLS_35117_r
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9553d83-z-20160110T082344_oi[N19,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539fed-g-20190206T062812_oi[N19,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95297f5-g-20180128T072957_oi[N18,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_965de6e-z-20170110T060324_oi[N18,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9517f92-r-20170422T003206_oi[N18,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954dee2-z-20160302T050942_oi[N17,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9571eaa-r-20160117T080517_oi[N19,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952df04-r-20180318T042819_oi[N17,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952ee93-g-20180319T040527_oi[N17,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956e86d-g-20160117T080344_oi[N19,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 82.22 s, CPU: 6.80 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.454652 MB
Stage tims finished: 2020-06-07T04:02:20.648445
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9571eaa-r-20160117T080517_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539fed-g-20190206T062812_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_965de6e-z-20170110T060324_oi[N18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954dee2-z-20160302T050942_oi[N17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952df04-r-20180318T042819_oi[N17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956e86d-g-20160117T080344_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9553d83-z-20160110T082344_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95297f5-g-20180128T072957_oi[N18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9517f92-r-20170422T003206_oi[N18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952ee93-g-20180319T040527_oi[N17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 4.136 s worker CPU, 272.679 s worker Wall, Wall: 82.218 s, Cores in use: 0.13, Total efficiency (on 4 cores): 3.3 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/SDSSJ110628.91+111435.1-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/SDSSJ110628.91+111435.1-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T04:02:20.672127
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04987.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04859.fits
Matched 9 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/metrics/cus/reference-custom-166620p11243.fits
Stage refs : Wall: 8.33 s, CPU: 7.81 s, VmPeak: 1026 MB, VmSize: 1007 MB, VmRSS: 187 MB, VmData: 219 MB, maxrss: 0.454652 MB
Stage refs finished: 2020-06-07T04:02:29.001161
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.330 s, Cores in use: 0.94, Total efficiency (on 4 cores): 23.4 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T04:02:29.002788
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/metrics/cus/outlier-mask-custom-166620p11243.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/metrics/cus/outliers-pre-custom-166620p11243.jpg
Image c4d_190206_062812_ooi_g_ls9-N19 g : masking 736 positive outlier pixels and 0 negative outlier pixels
Image c4d_170422_003409_ooi_r_ls9-N18 r : masking 238 positive outlier pixels and 0 negative outlier pixels
Image c4d_160110_082602_ooi_z_ls9-N19 z : masking 106 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/metrics/cus/outlier-mask-custom-166620p11243.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/metrics/cus/outliers-post-custom-166620p11243.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/metrics/cus/outliers-masked-pos-custom-166620p11243.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/metrics/cus/outliers-masked-neg-custom-166620p11243.jpg
Stage outliers : Wall: 7.33 s, CPU: 7.06 s, VmPeak: 1026 MB, VmSize: 1016 MB, VmRSS: 200 MB, VmData: 231 MB, maxrss: 0.454652 MB
Stage outliers finished: 2020-06-07T04:02:36.336614
Resources for stage outliers : 0.931 s worker CPU, 0.952 s worker Wall, Wall: 7.335 s, Cores in use: 1.09, Total efficiency (on 4 cores): 27.2 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T04:02:36.338525
Stage halos : Wall: 7.51 s, CPU: 7.51 s, VmPeak: 1026 MB, VmSize: 1016 MB, VmRSS: 200 MB, VmData: 231 MB, maxrss: 0.454652 MB
Stage halos finished: 2020-06-07T04:02:43.851123
Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.514 s, Cores in use: 1.00, Total efficiency (on 4 cores): 25.0 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-07T04:02:43.852984
PSF sigmas in coadd pixels: ['2.92', '2.03', '1.81', '1.73']
Using average PSF sigma 2.1230946863504245
Gaussian PSF norm 0.1328696235676591 vs pixelized 0.107031144
average tim pixel scale / coadd scale: 1.0011728952073613
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.90', '1.65', '1.73']
Using average PSF sigma 1.7581601692647917
Gaussian PSF norm 0.16044885824699437 vs pixelized 0.14200035
average tim pixel scale / coadd scale: 1.0011606482710718
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.57', '1.99', '1.90']
Using average PSF sigma 1.8193604317083114
Gaussian PSF norm 0.15505162520710739 vs pixelized 0.13231212
average tim pixel scale / coadd scale: 1.0011791436442437
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.20 s, CPU: 0.18 s, VmPeak: 1026 MB, VmSize: 1016 MB, VmRSS: 201 MB, VmData: 231 MB, maxrss: 0.454652 MB
Stage fit_on_coadds finished: 2020-06-07T04:02:44.052624
Resources for stage fit_on_coadds : 0.174 s worker CPU, 0.176 s worker Wall, Wall: 0.201 s, Cores in use: 1.77, Total efficiency (on 4 cores): 44.3 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T04:02:44.055284
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 25 potential peaks
Of 25 potential peaks: 3 in veto map, 3 cut by saddle test, 0 cut by aper test, 19 kept
SED z : 19 new peaks
Found 20 potential peaks
Of 20 potential peaks: 16 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 20 potential peaks
Of 20 potential peaks: 17 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 28 potential peaks
Of 28 potential peaks: 21 in veto map, 3 cut by saddle test, 0 cut by aper test, 4 kept
SED Flat : 4 new peaks
Found 32 potential peaks
Of 32 potential peaks: 27 in veto map, 2 cut by saddle test, 0 cut by aper test, 3 kept
SED Red : 3 new peaks
Adding 29 new sources
Median coadd sky for g : -3.209421e-05
Median coadd sky for r : -2.2988686e-05
Median coadd sky for z : 0.0001490659
Stage srcs : Wall: 8.85 s, CPU: 8.81 s, VmPeak: 1026 MB, VmSize: 1016 MB, VmRSS: 202 MB, VmData: 231 MB, maxrss: 0.454652 MB
Stage srcs finished: 2020-06-07T04:02:52.901673
Resources for stage srcs : 0.120 s worker CPU, 0.127 s worker Wall, Wall: 8.847 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.2 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/SDSSJ110628.91+111435.1-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/SDSSJ110628.91+111435.1-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T04:02:52.915226
Blob 1 of 23, id: 9, sources: 1, size: 76x98, npix 4216, brick X: 92,168, Y: 77,175, one pixel: 103 77
Blob 2 of 23, id: 8, sources: 4, size: 69x64, npix 2160, brick X: 194,263, Y: 65,129, one pixel: 254 65
Blob 3 of 23, id: 21, sources: 2, size: 57x42, npix 1458, brick X: 150,207, Y: 218,260, one pixel: 168 218
Blob 4 of 23, id: 14, sources: 1, size: 39x42, npix 1235, brick X: 224,263, Y: 170,212, one pixel: 238 170
Blob 5 of 23, id: 20, sources: 3, size: 43x41, npix 1028, brick X: 5,48, Y: 216,257, one pixel: 32 216
Blob 4 finished, total: Wall: 1.80 s, CPU: 1.80 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146148 MB
Blob 6 of 23, id: 3, sources: 2, size: 34x42, npix 801, brick X: 6,40, Y: 31,73, one pixel: 23 31
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.873673, ee1=0.314397, ee2=-0.719494
Blob 1 finished, total: Wall: 1.92 s, CPU: 1.92 s, VmPeak: 942 MB, VmSize: 714 MB, VmRSS: 140 MB, VmData: 177 MB, maxrss: 0.142924 MB
Blob 7 of 23, id: 11, sources: 2, size: 24x40, npix 616, brick X: 62,86, Y: 135,175, one pixel: 73 135
Blob 3 finished, total: Wall: 2.17 s, CPU: 2.17 s, VmPeak: 943 MB, VmSize: 714 MB, VmRSS: 139 MB, VmData: 177 MB, maxrss: 0.142428 MB
Blob 8 of 23, id: 16, sources: 1, size: 34x25, npix 544, brick X: 115,149, Y: 187,212, one pixel: 136 187
Blob 5 finished, total: Wall: 1.59 s, CPU: 1.59 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146148 MB
Blob 9 of 23, id: 19, sources: 1, size: 27x30, npix 493, brick X: 79,106, Y: 206,236, one pixel: 92 206
Blob 7 finished, total: Wall: 1.32 s, CPU: 1.32 s, VmPeak: 943 MB, VmSize: 714 MB, VmRSS: 140 MB, VmData: 177 MB, maxrss: 0.143 MB
Blob 10 of 23, id: 22, sources: 1, size: 28x28, npix 486, brick X: 49,77, Y: 221,249, one pixel: 61 221
Blob 6 finished, total: Wall: 1.63 s, CPU: 1.63 s, VmPeak: 942 MB, VmSize: 714 MB, VmRSS: 140 MB, VmData: 177 MB, maxrss: 0.142924 MB
Blob 11 of 23, id: 17, sources: 1, size: 27x26, npix 464, brick X: 171,198, Y: 191,217, one pixel: 182 191
Measuring 1 iterative sources
Blob 9 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 943 MB, VmSize: 714 MB, VmRSS: 140 MB, VmData: 177 MB, maxrss: 0.143 MB
Blob 12 of 23, id: 1, sources: 1, size: 27x27, npix 460, brick X: 147,174, Y: 3,30, one pixel: 157 3
Blob 2 finished, total: Wall: 4.39 s, CPU: 4.39 s, VmPeak: 964 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149196 MB
Blob 13 of 23, id: 6, sources: 1, size: 24x24, npix 352, brick X: 65,89, Y: 55,79, one pixel: 76 55
Blob 8 finished, total: Wall: 0.99 s, CPU: 0.99 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.1483 MB
Blob 14 of 23, id: 7, sources: 1, size: 23x24, npix 349, brick X: 174,197, Y: 62,86, one pixel: 183 62
Blob 10 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 942 MB, VmSize: 714 MB, VmRSS: 140 MB, VmData: 177 MB, maxrss: 0.143732 MB
Blob 15 of 23, id: 0, sources: 1, size: 26x15, npix 286, brick X: 82,108, Y: 0,15, one pixel: 83 0
Blob 13 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.1483 MB
Blob 16 of 23, id: 2, sources: 1, size: 21x22, npix 280, brick X: 242,263, Y: 29,51, one pixel: 252 29
Blob 11 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 943 MB, VmSize: 714 MB, VmRSS: 140 MB, VmData: 177 MB, maxrss: 0.143 MB
Blob 17 of 23, id: 5, sources: 1, size: 20x21, npix 239, brick X: 143,163, Y: 49,70, one pixel: 152 49
Blob 14 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 942 MB, VmSize: 714 MB, VmRSS: 140 MB, VmData: 177 MB, maxrss: 0.143732 MB
Blob 18 of 23, id: 13, sources: 1, size: 19x21, npix 237, brick X: 175,194, Y: 156,177, one pixel: 183 156
Blob 16 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 943 MB, VmSize: 714 MB, VmRSS: 140 MB, VmData: 177 MB, maxrss: 0.143 MB
Blob 19 of 23, id: 10, sources: 1, size: 19x19, npix 208, brick X: 19,38, Y: 83,102, one pixel: 28 83
Blob 17 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 942 MB, VmSize: 714 MB, VmRSS: 140 MB, VmData: 177 MB, maxrss: 0.143732 MB
Blob 20 of 23, id: 18, sources: 1, size: 19x19, npix 208, brick X: 74,93, Y: 193,212, one pixel: 82 193
Blob 18 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 943 MB, VmSize: 714 MB, VmRSS: 140 MB, VmData: 177 MB, maxrss: 0.143 MB
Blob 21 of 23, id: 4, sources: 1, size: 19x19, npix 199, brick X: 116,135, Y: 39,58, one pixel: 125 39
Blob 20 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 943 MB, VmSize: 714 MB, VmRSS: 140 MB, VmData: 177 MB, maxrss: 0.143 MB
Blob 22 of 23, id: 12, sources: 1, size: 18x18, npix 180, brick X: 83,101, Y: 149,167, one pixel: 91 149
Blob 21 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 943 MB, VmSize: 714 MB, VmRSS: 140 MB, VmData: 177 MB, maxrss: 0.143 MB
Blob 23 of 23, id: 15, sources: 1, size: 19x18, npix 180, brick X: 152,171, Y: 177,195, one pixel: 160 177
Blob 15 finished, total: Wall: 1.08 s, CPU: 1.08 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.1483 MB
Blob 23 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.1483 MB
Blob 19 finished, total: Wall: 0.61 s, CPU: 0.61 s, VmPeak: 942 MB, VmSize: 714 MB, VmRSS: 140 MB, VmData: 177 MB, maxrss: 0.143732 MB
Blob 22 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 943 MB, VmSize: 714 MB, VmRSS: 140 MB, VmData: 177 MB, maxrss: 0.143 MB
Blob 12 finished, total: Wall: 1.69 s, CPU: 1.69 s, VmPeak: 964 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149196 MB
Old catalog: 33
New catalog: 25
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/metrics/cus/blobs-custom-166620p11243.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/metrics/cus/all-models-custom-166620p11243.fits
Stage fitblobs : Wall: 14.25 s, CPU: 7.88 s, VmPeak: 1026 MB, VmSize: 1016 MB, VmRSS: 202 MB, VmData: 231 MB, maxrss: 0.454652 MB
Stage fitblobs finished: 2020-06-07T04:03:07.164422
Resources for stage fitblobs : 23.953 s worker CPU, 23.973 s worker Wall, Wall: 14.250 s, Cores in use: 2.23, Total efficiency (on 4 cores): 55.8 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T04:03:07.166230
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/tmp-legacysurvey-custom-166620p11243-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/tmp-legacysurvey-custom-166620p11243-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/tmp-legacysurvey-custom-166620p11243-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/tmp-legacysurvey-custom-166620p11243-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-resid.jpg
Stage coadds : Wall: 8.37 s, CPU: 7.58 s, VmPeak: 1026 MB, VmSize: 1016 MB, VmRSS: 202 MB, VmData: 231 MB, maxrss: 0.454652 MB
Stage coadds finished: 2020-06-07T04:03:15.532962
Resources for stage coadds : 2.479 s worker CPU, 2.571 s worker Wall, Wall: 8.368 s, Cores in use: 1.20, Total efficiency (on 4 cores): 30.1 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T04:03:15.534646
Cut to 1 unWISE tiles
Reading WISE tile 1661p106 band 1
Reading WISE tile 1661p106 band 2
Reading WISE tile 1661p106 band 4
Reading WISE tile 1661p106 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1661p106/unwise-1661p106-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1661p106/unwise-1661p106-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1661p106/unwise-1661p106-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1661p106/unwise-1661p106-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1661p106/unwise-1661p106-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 943 MB, VmSize: 792 MB, VmRSS: 142 MB, VmData: 170 MB, maxrss: 0.206024 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1661p106/unwise-1661p106-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1661p106/unwise-1661p106-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1661p106/unwise-1661p106-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1661p106/unwise-1661p106-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1661p106/unwise-1661p106-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 942 MB, VmSize: 798 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.190844 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1661p106/unwise-1661p106-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1661p106/unwise-1661p106-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1661p106/unwise-1661p106-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1661p106/unwise-1661p106-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 962 MB, VmSize: 792 MB, VmRSS: 141 MB, VmData: 170 MB, maxrss: 0.205688 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1661p106/unwise-1661p106-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1661p106/unwise-1661p106-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1661p106/unwise-1661p106-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1661p106/unwise-1661p106-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 964 MB, VmSize: 792 MB, VmRSS: 141 MB, VmData: 170 MB, maxrss: 0.205204 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/tmp-legacysurvey-custom-166620p11243-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/tmp-legacysurvey-custom-166620p11243-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 8.71 s, CPU: 6.49 s, VmPeak: 1026 MB, VmSize: 1016 MB, VmRSS: 203 MB, VmData: 231 MB, maxrss: 0.454652 MB
Stage wise_forced finished: 2020-06-07T04:03:24.244512
Resources for stage wise_forced : 4.755 s worker CPU, 7.175 s worker Wall, Wall: 8.711 s, Cores in use: 1.29, Total efficiency (on 4 cores): 32.3 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T04:03:24.246181
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/coadd/cus/custom-166620p11243/legacysurvey-custom-166620p11243-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/tractor-i/cus/tractor-custom-166620p11243.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/tractor/cus/tractor-custom-166620p11243.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/SDSSJ110628.91+111435.1/tractor/cus/brick-custom-166620p11243.sha256sum
Stage writecat : Wall: 7.79 s, CPU: 7.48 s, VmPeak: 1148 MB, VmSize: 1020 MB, VmRSS: 205 MB, VmData: 231 MB, maxrss: 0.454652 MB
Stage writecat finished: 2020-06-07T04:03:32.034604
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.789 s, Cores in use: 0.96, Total efficiency (on 4 cores): 24.0 %
Stage writecat finished
All done: 36.549 s worker CPU, 307.656 s worker Wall, Wall: 153.608 s, Cores in use: 0.68, Total efficiency (on 4 cores): 17.0 %
Finished galaxy SDSSJ110628.91+111435.1 in 2.664 minutes.