Started working on galaxy PGC1104799 at Thu Jun  4 12:34:39 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 233.52939299999997 -1.983422 --width 341 --height 341 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/PGC1104799-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/PGC1104799-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-04T12:34:41.494393
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '233.52939299999997', '-1.983422', '--width', '341', '--height', '341', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/PGC1104799-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/PGC1104799-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 233.52939299999997 -1.983422 --width 341 --height 341 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/PGC1104799-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/PGC1104799-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 233.52939299999997 -1.983422
Starting process 25870 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.0573 MB
Starting process 25871 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 25872 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 25873 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 25874 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 25875 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 25876 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 25877 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-04T12:34:46.751974
Keeping 7 CCDs:
   c4d_160607_025240_ooi_r_ls9.fits.fz c4d_160607_025240_ooi_r_ls9-N12 r exptime 79.0 propid 2014B-0404 seeing 1.36 MJD 57546.118 object DECaLS_16976_r
   c4d_160607_025052_ooi_g_ls9.fits.fz c4d_160607_025052_ooi_g_ls9-N12 g exptime 118.0 propid 2014B-0404 seeing 1.47 MJD 57546.117 object DECaLS_16976_g
   c4d_150412_070846_ooi_z_ls9.fits.fz c4d_150412_070846_ooi_z_ls9-N12 z exptime 80.0 propid 2014B-0404 seeing 0.85 MJD 57124.296 object DECaLS_16976_z
   c4d_140811_000434_ooi_z_ls9.fits.fz c4d_140811_000434_ooi_z_ls9-N19 z exptime 145.0 propid 2014B-0404 seeing 1.43 MJD 56880.001 object DECaLS_1104_z
   c4d_150330_075733_ooi_g_ls9.fits.fz c4d_150330_075733_ooi_g_ls9-N19 g exptime 125.0 propid 2014B-0404 seeing 1.10 MJD 57111.330 object DECaLS_1104_g
   c4d_150330_075939_ooi_r_ls9.fits.fz c4d_150330_075939_ooi_r_ls9-N19 r exptime 96.0 propid 2014B-0404 seeing 0.96 MJD 57111.331 object DECaLS_1104_r
   c4d_140811_001235_ooi_z_ls9.fits.fz c4d_140811_001235_ooi_z_ls9-N14 z exptime 140.0 propid 2014B-0404 seeing 1.37 MJD 56880.007 object DECaLS_1098_z
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956a851-r-20160607T025028_oi[N12,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95499d2-z-20140811T000119_oi[N19,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9566081-g-20160607T024803_oi[N12,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95555f8-r-20150330T075712_oi[N19,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9568fa4-z-20150412T070635_oi[N12,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95579f3-g-20150330T075439_oi[N19,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95499d2-z-20140811T000922_oi[N14,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 94.56 s, CPU: 6.52 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.455148 MB
Stage tims finished: 2020-06-04T12:36:21.311224
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95555f8-r-20150330T075712_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956a851-r-20160607T025028_oi[N12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9568fa4-z-20150412T070635_oi[N12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95499d2-z-20140811T000119_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9566081-g-20160607T024803_oi[N12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95579f3-g-20150330T075439_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95499d2-z-20140811T000922_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 4.255 s worker CPU, 250.026 s worker Wall, Wall: 94.561 s, Cores in use: 0.11, Total efficiency (on 8 cores): 1.4 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/PGC1104799-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/PGC1104799-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-04T12:36:22.007274
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06291.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06418.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06419.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06547.fits
Matched 3 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/metrics/cus/reference-custom-233529m01983.fits
Stage refs : Wall: 8.32 s, CPU: 6.71 s, VmPeak: 1032 MB, VmSize: 1026 MB, VmRSS: 206 MB, VmData: 239 MB, maxrss: 0.455148 MB
Stage refs finished: 2020-06-04T12:36:30.324045
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.318 s, Cores in use: 0.81, Total efficiency (on 8 cores): 10.1 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-04T12:36:30.325892
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/metrics/cus/outlier-mask-custom-233529m01983.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/metrics/cus/outliers-pre-custom-233529m01983.jpg
Image c4d_160607_025052_ooi_g_ls9-N12 g : masking 674 positive outlier pixels and 0 negative outlier pixels
Image c4d_160607_025240_ooi_r_ls9-N12 r : masking 2297 positive outlier pixels and 0 negative outlier pixels
Image c4d_150330_075939_ooi_r_ls9-N19 r : masking 265 positive outlier pixels and 0 negative outlier pixels
Image c4d_140811_000434_ooi_z_ls9-N19 z : masking 660 positive outlier pixels and 0 negative outlier pixels
Image c4d_150412_070846_ooi_z_ls9-N12 z : masking 253 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/metrics/cus/outlier-mask-custom-233529m01983.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/metrics/cus/outliers-post-custom-233529m01983.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/metrics/cus/outliers-masked-pos-custom-233529m01983.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/metrics/cus/outliers-masked-neg-custom-233529m01983.jpg
Stage outliers : Wall: 3.96 s, CPU: 3.56 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 226 MB, VmData: 255 MB, maxrss: 0.455148 MB
Stage outliers finished: 2020-06-04T12:36:34.285798
Resources for stage outliers : 0.996 s worker CPU, 1.042 s worker Wall, Wall: 3.961 s, Cores in use: 1.15, Total efficiency (on 8 cores): 14.4 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-04T12:36:34.287829
Stage halos : Wall: 3.60 s, CPU: 2.98 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 226 MB, VmData: 255 MB, maxrss: 0.455148 MB
Stage halos finished: 2020-06-04T12:36:37.891567
Resources for stage halos : 0.362 s worker CPU, 4.107 s worker Wall, Wall: 3.605 s, Cores in use: 0.93, Total efficiency (on 8 cores): 11.6 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-04T12:36:37.894319
PSF sigmas in coadd pixels: ['2.39', '1.78']
Using average PSF sigma 2.0855691234059597
Gaussian PSF norm 0.13526034146170465 vs pixelized 0.113371916
average tim pixel scale / coadd scale: 1.0011132601257555
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.21', '1.55']
Using average PSF sigma 1.880131627160697
Gaussian PSF norm 0.150039916194531 vs pixelized 0.1270449
average tim pixel scale / coadd scale: 1.0011213081124601
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.39', '2.32', '2.23']
Using average PSF sigma 1.9775280442470775
Gaussian PSF norm 0.14265021049614635 vs pixelized 0.11913746
average tim pixel scale / coadd scale: 1.001003654211589
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.20 s, CPU: 0.17 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 227 MB, VmData: 255 MB, maxrss: 0.455148 MB
Stage fit_on_coadds finished: 2020-06-04T12:36:38.093208
Resources for stage fit_on_coadds : 0.263 s worker CPU, 0.263 s worker Wall, Wall: 0.200 s, Cores in use: 2.19, Total efficiency (on 8 cores): 27.3 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-04T12:36:38.095988
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 32 potential peaks
Of 32 potential peaks: 11 in veto map, 3 cut by saddle test, 0 cut by aper test, 18 kept
SED z : 18 new peaks
Found 57 potential peaks
Of 57 potential peaks: 39 in veto map, 5 cut by saddle test, 0 cut by aper test, 13 kept
SED r : 13 new peaks
Found 38 potential peaks
Of 38 potential peaks: 31 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 57 potential peaks
Of 57 potential peaks: 48 in veto map, 5 cut by saddle test, 0 cut by aper test, 4 kept
SED Flat : 4 new peaks
Found 60 potential peaks
Of 60 potential peaks: 54 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 38 new sources
Median coadd sky for g : 5.3510473e-07
Median coadd sky for r : 4.7759688e-05
Median coadd sky for z : 5.6724843e-05
Stage srcs : Wall: 2.32 s, CPU: 2.25 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 228 MB, VmData: 255 MB, maxrss: 0.455148 MB
Stage srcs finished: 2020-06-04T12:36:40.412198
Resources for stage srcs : 0.171 s worker CPU, 0.171 s worker Wall, Wall: 2.317 s, Cores in use: 1.04, Total efficiency (on 8 cores): 13.1 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/PGC1104799-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/PGC1104799-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-04T12:36:40.427827
Blob 1 of 28, id: 23, sources: 7, size: 183x90, npix 10419, brick X: 114,297, Y: 251,341, one pixel: 211 251
Blob 2 of 28, id: 14, sources: 6, size: 164x122, npix 9966, brick X: 75,239, Y: 118,240, one pixel: 107 118
Blob 3 of 28, id: 18, sources: 1, size: 53x61, npix 2225, brick X: 11,64, Y: 208,269, one pixel: 31 208
Blob 4 of 28, id: 21, sources: 2, size: 53x47, npix 1729, brick X: 288,341, Y: 241,288, one pixel: 326 241
Blob 5 of 28, id: 12, sources: 3, size: 38x63, npix 1552, brick X: 303,341, Y: 111,174, one pixel: 332 111
Blob 6 of 28, id: 5, sources: 2, size: 39x51, npix 1083, brick X: 156,195, Y: 26,77, one pixel: 182 26
Blob 7 of 28, id: 9, sources: 2, size: 33x50, npix 971, brick X: 26,59, Y: 87,137, one pixel: 42 87
Blob 8 of 28, id: 6, sources: 1, size: 33x30, npix 674, brick X: 27,60, Y: 41,71, one pixel: 40 41
Blob 9 of 28, id: 3, sources: 2, size: 28x35, npix 636, brick X: 58,86, Y: 19,54, one pixel: 73 19
Blob 3 finished, total: Wall: 0.13 s, CPU: 0.13 s, VmPeak: 938 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148228 MB
Blob 10 of 28, id: 24, sources: 1, size: 30x31, npix 633, brick X: 63,93, Y: 265,296, one pixel: 76 265
Blob 8 finished, total: Wall: 0.88 s, CPU: 0.83 s, VmPeak: 937 MB, VmSize: 716 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.142976 MB
Blob 11 of 28, id: 1, sources: 1, size: 31x29, npix 605, brick X: 101,132, Y: 12,41, one pixel: 112 12
Blob 9 finished, total: Wall: 1.25 s, CPU: 1.25 s, VmPeak: 938 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148228 MB
Blob 12 of 28, id: 19, sources: 1, size: 30x30, npix 581, brick X: 263,293, Y: 215,245, one pixel: 279 215
Blob 6 finished, total: Wall: 1.43 s, CPU: 1.43 s, VmPeak: 937 MB, VmSize: 721 MB, VmRSS: 145 MB, VmData: 184 MB, maxrss: 0.148056 MB
Blob 13 of 28, id: 7, sources: 1, size: 23x28, npix 442, brick X: 318,341, Y: 66,94, one pixel: 331 66
Blob 5 finished, total: Wall: 1.59 s, CPU: 1.58 s, VmPeak: 943 MB, VmSize: 716 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144356 MB
Blob 14 of 28, id: 15, sources: 1, size: 25x23, npix 390, brick X: 214,239, Y: 127,150, one pixel: 224 127
Blob 4 finished, total: Wall: 1.68 s, CPU: 1.68 s, VmPeak: 941 MB, VmSize: 716 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145124 MB
Blob 15 of 28, id: 2, sources: 1, size: 21x26, npix 362, brick X: 227,248, Y: 14,40, one pixel: 235 14
Blob 7 finished, total: Wall: 1.79 s, CPU: 1.74 s, VmPeak: 948 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148564 MB
Blob 16 of 28, id: 27, sources: 1, size: 24x24, npix 352, brick X: 14,38, Y: 295,319, one pixel: 25 295
Blob 10 finished, total: Wall: 1.02 s, CPU: 1.02 s, VmPeak: 937 MB, VmSize: 716 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.142976 MB
Blob 17 of 28, id: 0, sources: 1, size: 23x21, npix 318, brick X: 140,163, Y: 0,21, one pixel: 147 0
Blob 16 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 937 MB, VmSize: 716 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.142976 MB
Blob 18 of 28, id: 20, sources: 1, size: 22x24, npix 304, brick X: 184,206, Y: 231,255, one pixel: 193 231
Blob 14 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 941 MB, VmSize: 716 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145704 MB
Blob 19 of 28, id: 22, sources: 1, size: 21x24, npix 292, brick X: 264,285, Y: 246,270, one pixel: 274 246
Blob 13 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 943 MB, VmSize: 716 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144356 MB
Blob 20 of 28, id: 13, sources: 1, size: 23x21, npix 282, brick X: 249,272, Y: 116,137, one pixel: 259 116
Blob 11 finished, total: Wall: 1.20 s, CPU: 1.20 s, VmPeak: 938 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148228 MB
Blob 21 of 28, id: 4, sources: 1, size: 22x21, npix 270, brick X: 18,40, Y: 22,43, one pixel: 28 22
Blob 15 finished, total: Wall: 1.10 s, CPU: 1.10 s, VmPeak: 948 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148564 MB
Blob 22 of 28, id: 17, sources: 1, size: 18x22, npix 264, brick X: 323,341, Y: 202,224, one pixel: 332 202
Blob 19 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 943 MB, VmSize: 716 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144356 MB
Blob 23 of 28, id: 26, sources: 1, size: 21x21, npix 261, brick X: 294,315, Y: 290,311, one pixel: 303 290
Blob 20 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 938 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148228 MB
Blob 24 of 28, id: 10, sources: 1, size: 20x19, npix 209, brick X: 86,106, Y: 99,118, one pixel: 95 99
Blob 17 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 937 MB, VmSize: 716 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.142976 MB
Blob 25 of 28, id: 16, sources: 1, size: 19x19, npix 199, brick X: 243,262, Y: 138,157, one pixel: 251 138
Blob 18 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 941 MB, VmSize: 716 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145704 MB
Blob 26 of 28, id: 11, sources: 1, size: 19x18, npix 189, brick X: 228,247, Y: 106,124, one pixel: 237 106
Blob 22 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 943 MB, VmSize: 716 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144356 MB
Blob 27 of 28, id: 25, sources: 1, size: 18x18, npix 180, brick X: 264,282, Y: 287,305, one pixel: 272 287
Blob 12 finished, total: Wall: 1.92 s, CPU: 1.92 s, VmPeak: 937 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.150064 MB
Blob 28 of 28, id: 8, sources: 1, size: 17x18, npix 162, brick X: 300,317, Y: 77,95, one pixel: 308 77
Blob 24 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 937 MB, VmSize: 716 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.142976 MB
Blob 27 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 937 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.150064 MB
Blob 25 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 941 MB, VmSize: 716 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145704 MB
Blob 21 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 948 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148564 MB
Blob 23 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 938 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148228 MB
Blob 26 finished, total: Wall: 0.49 s, CPU: 0.49 s, VmPeak: 943 MB, VmSize: 716 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144356 MB
Blob 28 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 937 MB, VmSize: 716 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.142976 MB
Measuring 9 iterative sources
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.956155, ee1=-0.324091, ee2=-0.393361
Blob 2 finished, total: Wall: 7.37 s, CPU: 7.37 s, VmPeak: 688 MB, VmSize: 688 MB, VmRSS: 127 MB, VmData: 167 MB, maxrss: 0.130308 MB
Blob 1 finished, total: Wall: 10.90 s, CPU: 10.89 s, VmPeak: 938 MB, VmSize: 716 MB, VmRSS: 143 MB, VmData: 179 MB, maxrss: 0.1461 MB
Old catalog: 50
New catalog: 50
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/metrics/cus/blobs-custom-233529m01983.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/metrics/cus/all-models-custom-233529m01983.fits
Stage fitblobs : Wall: 15.34 s, CPU: 3.30 s, VmPeak: 1036 MB, VmSize: 1029 MB, VmRSS: 221 MB, VmData: 248 MB, maxrss: 0.455148 MB
Stage fitblobs finished: 2020-06-04T12:36:55.764896
Resources for stage fitblobs : 40.632 s worker CPU, 40.804 s worker Wall, Wall: 15.339 s, Cores in use: 2.86, Total efficiency (on 8 cores): 35.8 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-04T12:36:55.767488
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/tmp-legacysurvey-custom-233529m01983-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/tmp-legacysurvey-custom-233529m01983-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/tmp-legacysurvey-custom-233529m01983-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/tmp-legacysurvey-custom-233529m01983-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-resid.jpg
Stage coadds : Wall: 7.90 s, CPU: 3.18 s, VmPeak: 1036 MB, VmSize: 1029 MB, VmRSS: 222 MB, VmData: 249 MB, maxrss: 0.455148 MB
Stage coadds finished: 2020-06-04T12:37:03.670104
Resources for stage coadds : 5.589 s worker CPU, 5.823 s worker Wall, Wall: 7.904 s, Cores in use: 1.11, Total efficiency (on 8 cores): 13.9 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-04T12:37:03.672166
Cut to 1 unWISE tiles
Reading WISE tile 2329m016 band 1
Reading WISE tile 2329m016 band 2
Reading WISE tile 2329m016 band 3
Reading WISE tile 2329m016 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2329m016/unwise-2329m016-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/232/2329m016/unwise-2329m016-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/232/2329m016/unwise-2329m016-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/232/2329m016/unwise-2329m016-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/232/2329m016/unwise-2329m016-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 937 MB, VmSize: 796 MB, VmRSS: 146 MB, VmData: 175 MB, maxrss: 0.193008 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2329m016/unwise-2329m016-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/232/2329m016/unwise-2329m016-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/232/2329m016/unwise-2329m016-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/232/2329m016/unwise-2329m016-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/232/2329m016/unwise-2329m016-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 948 MB, VmSize: 795 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208368 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2329m016/unwise-2329m016-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2329m016/unwise-2329m016-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2329m016/unwise-2329m016-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2329m016/unwise-2329m016-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 941 MB, VmSize: 793 MB, VmRSS: 145 MB, VmData: 172 MB, maxrss: 0.207132 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2329m016/unwise-2329m016-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2329m016/unwise-2329m016-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2329m016/unwise-2329m016-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/232/2329m016/unwise-2329m016-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 943 MB, VmSize: 793 MB, VmRSS: 146 MB, VmData: 172 MB, maxrss: 0.207848 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/tmp-legacysurvey-custom-233529m01983-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/tmp-legacysurvey-custom-233529m01983-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 4.48 s, CPU: 2.96 s, VmPeak: 1036 MB, VmSize: 1029 MB, VmRSS: 222 MB, VmData: 249 MB, maxrss: 0.455148 MB
Stage wise_forced finished: 2020-06-04T12:37:08.147487
Resources for stage wise_forced : 3.555 s worker CPU, 4.924 s worker Wall, Wall: 4.477 s, Cores in use: 1.46, Total efficiency (on 8 cores): 18.2 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-04T12:37:08.149652
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/coadd/cus/custom-233529m01983/legacysurvey-custom-233529m01983-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/tractor-i/cus/tractor-custom-233529m01983.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/tractor/cus/tractor-custom-233529m01983.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC1104799/tractor/cus/brick-custom-233529m01983.sha256sum
Stage writecat : Wall: 1.61 s, CPU: 1.43 s, VmPeak: 1161 MB, VmSize: 1033 MB, VmRSS: 224 MB, VmData: 249 MB, maxrss: 0.455148 MB
Stage writecat finished: 2020-06-04T12:37:09.760419
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.612 s, Cores in use: 0.89, Total efficiency (on 8 cores): 11.1 %
Stage writecat finished
All done: 55.826 s worker CPU, 307.163 s worker Wall, Wall: 143.015 s, Cores in use: 0.62, Total efficiency (on 8 cores): 7.8 %
Finished galaxy PGC1104799 in 2.515 minutes.