Started working on galaxy PGC1953331 at Sat Jun  6 09:08:10 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 106.2411255 31.565444399999997 --width 295 --height 295 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/PGC1953331-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/PGC1953331-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-06T09:08:12.764859
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '106.2411255', '31.565444399999997', '--width', '295', '--height', '295', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/PGC1953331-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/PGC1953331-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 106.2411255 31.565444399999997 --width 295 --height 295 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/PGC1953331-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/PGC1953331-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 106.2411255 31.565444399999997
Starting process 21748 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 21749 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 21750 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 21751 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 21752 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB
Starting process 21753 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB
Starting process 21754 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB
Starting process 21755 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-06T09:08:16.474296
Keeping 10 CCDs:
   c4d_171112_082824_ooi_z_ls9.fits.fz c4d_171112_082824_ooi_z_ls9-S3 z exptime 136.0 propid 2014B-0404 seeing 1.04 MJD 58069.353 object DECaLS_8093_z
   c4d_181211_065218_ooi_g_ls9.fits.fz c4d_181211_065218_ooi_g_ls9-S3 g exptime 200.0 propid 2014B-0404 seeing 1.69 MJD 58463.286 object DECaLS_8093_g
   c4d_181209_052703_ooi_r_ls9.fits.fz c4d_181209_052703_ooi_r_ls9-S3 r exptime 85.0 propid 2014B-0404 seeing 1.16 MJD 58461.227 object DECaLS_8093_r
   c4d_181230_052934_ooi_z_ls9.fits.fz c4d_181230_052934_ooi_z_ls9-S2 z exptime 248.0 propid 2014B-0404 seeing 1.42 MJD 58482.229 object DECaLS_23965_z
   c4d_181211_052329_ooi_r_ls9.fits.fz c4d_181211_052329_ooi_r_ls9-S2 r exptime 119.0 propid 2014B-0404 seeing 1.47 MJD 58463.225 object DECaLS_23965_r
   c4d_150109_053245_ooi_z_ls9.fits.fz c4d_150109_053245_ooi_z_ls9-S2 z exptime 138.0 propid 2014B-0404 seeing 1.05 MJD 57031.229 object DECaLS_23965_z
   c4d_181211_064828_ooi_g_ls9.fits.fz c4d_181211_064828_ooi_g_ls9-S2 g exptime 200.0 propid 2014B-0404 seeing 1.69 MJD 58463.284 object DECaLS_23965_g
   c4d_171112_083109_ooi_z_ls9.fits.fz c4d_171112_083109_ooi_z_ls9-S1 z exptime 145.0 propid 2014B-0404 seeing 1.10 MJD 58069.355 object DECaLS_39837_z
   c4d_181214_052351_ooi_g_ls9.fits.fz c4d_181214_052351_ooi_g_ls9-S1 g exptime 200.0 propid 2014B-0404 seeing 1.86 MJD 58466.225 object DECaLS_39837_g
   c4d_181214_052155_ooi_r_ls9.fits.fz c4d_181214_052155_ooi_r_ls9-S1 r exptime 88.0 propid 2014B-0404 seeing 1.45 MJD 58466.224 object DECaLS_39837_r
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952303b-z-20171112T083109_oi[S1,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95629d9-z-20150109T052938_oi[S2,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952303b-z-20171112T082824_oi[S3,noinherit][2046,4094][real]: DECaLS_8
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9538963-r-20181209T052703_oi[S3,noinherit][2046,4094][real]: DECaLS_8
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9533bf7-z-20181230T052934_oi[S2,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539519-g-20181211T065218_oi[S3,noinherit][2046,4094][real]: DECaLS_8
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539519-g-20181211T064828_oi[S2,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953988f-g-20181214T052351_oi[S1,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539067-r-20181214T052155_oi[S1,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9538963-r-20181211T052329_oi[S2,noinherit][2046,4094][real]: DECaLS_2
Stage tims : Wall: 64.93 s, CPU: 4.29 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 177 MB, VmData: 211 MB, maxrss: 0.4508 MB
Stage tims finished: 2020-06-06T09:09:21.408992
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952303b-z-20171112T082824_oi[S3,noinherit][2046,4094][real]: DECaLS_8 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9538963-r-20181209T052703_oi[S3,noinherit][2046,4094][real]: DECaLS_8 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9533bf7-z-20181230T052934_oi[S2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539519-g-20181211T065218_oi[S3,noinherit][2046,4094][real]: DECaLS_8 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539519-g-20181211T064828_oi[S2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952303b-z-20171112T083109_oi[S1,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953988f-g-20181214T052351_oi[S1,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
Resources for stage tims : 5.113 s worker CPU, 279.596 s worker Wall, Wall: 64.936 s, Cores in use: 0.14, Total efficiency (on 8 cores): 1.8 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/PGC1953331-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/PGC1953331-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9538963-r-20181211T052329_oi[S2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95629d9-z-20150109T052938_oi[S2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539067-r-20181214T052155_oi[S1,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
Running stage refs at 2020-06-06T09:09:21.615719
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02789.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03045.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02918.fits
Matched 3 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/metrics/cus/reference-custom-106241p31565.fits
Stage refs : Wall: 8.40 s, CPU: 7.73 s, VmPeak: 1065 MB, VmSize: 1058 MB, VmRSS: 242 MB, VmData: 274 MB, maxrss: 0.4508 MB
Stage refs finished: 2020-06-06T09:09:30.016836
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.402 s, Cores in use: 0.92, Total efficiency (on 8 cores): 11.5 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-06T09:09:30.018523
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/metrics/cus/outlier-mask-custom-106241p31565.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/metrics/cus/outliers-pre-custom-106241p31565.jpg
Image c4d_181211_065218_ooi_g_ls9-S3 g : masking 325 positive outlier pixels and 0 negative outlier pixels
Image c4d_181214_052155_ooi_r_ls9-S1 r : masking 56 positive outlier pixels and 0 negative outlier pixels
Image c4d_181230_052934_ooi_z_ls9-S2 z : masking 593 positive outlier pixels and 0 negative outlier pixels
Image c4d_171112_083109_ooi_z_ls9-S1 z : masking 404 positive outlier pixels and 0 negative outlier pixels
Image c4d_150109_053245_ooi_z_ls9-S2 z : masking 342 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/metrics/cus/outlier-mask-custom-106241p31565.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/metrics/cus/outliers-post-custom-106241p31565.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/metrics/cus/outliers-masked-pos-custom-106241p31565.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/metrics/cus/outliers-masked-neg-custom-106241p31565.jpg
Stage outliers : Wall: 6.01 s, CPU: 5.73 s, VmPeak: 1068 MB, VmSize: 1068 MB, VmRSS: 259 MB, VmData: 288 MB, maxrss: 0.4508 MB
Stage outliers finished: 2020-06-06T09:09:36.031509
Resources for stage outliers : 1.134 s worker CPU, 1.142 s worker Wall, Wall: 6.014 s, Cores in use: 1.14, Total efficiency (on 8 cores): 14.3 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-06T09:09:36.033425
Stage halos : Wall: 6.24 s, CPU: 4.91 s, VmPeak: 1068 MB, VmSize: 1068 MB, VmRSS: 259 MB, VmData: 288 MB, maxrss: 0.4508 MB
Stage halos finished: 2020-06-06T09:09:42.274906
Resources for stage halos : 0.472 s worker CPU, 8.065 s worker Wall, Wall: 6.243 s, Cores in use: 0.86, Total efficiency (on 8 cores): 10.8 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-06T09:09:42.277119
PSF sigmas in coadd pixels: ['2.74', '2.74', '3.02']
Using average PSF sigma 2.8353256958201816
Gaussian PSF norm 0.0994929055909663 vs pixelized 0.089496866
average tim pixel scale / coadd scale: 1.0014618395913022
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.88', '2.38', '2.35']
Using average PSF sigma 2.2018516333053566
Gaussian PSF norm 0.1281170754227457 vs pixelized 0.11056756
average tim pixel scale / coadd scale: 1.0015303224595333
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.70', '2.31', '1.70', '1.79']
Using average PSF sigma 1.8727324976915904
Gaussian PSF norm 0.15063272096874497 vs pixelized 0.11577861
average tim pixel scale / coadd scale: 1.0013972390851873
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.90 s, CPU: 0.20 s, VmPeak: 1068 MB, VmSize: 1068 MB, VmRSS: 261 MB, VmData: 288 MB, maxrss: 0.4508 MB
Stage fit_on_coadds finished: 2020-06-06T09:09:43.174944
Resources for stage fit_on_coadds : 0.283 s worker CPU, 0.283 s worker Wall, Wall: 0.899 s, Cores in use: 0.54, Total efficiency (on 8 cores): 6.7 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-06T09:09:43.177750
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 41 potential peaks
Of 41 potential peaks: 7 in veto map, 8 cut by saddle test, 0 cut by aper test, 26 kept
SED z : 26 new peaks
Found 36 potential peaks
Of 36 potential peaks: 29 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 28 potential peaks
Of 28 potential peaks: 22 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 42 potential peaks
Of 42 potential peaks: 33 in veto map, 4 cut by saddle test, 0 cut by aper test, 5 kept
SED Flat : 5 new peaks
Found 45 potential peaks
Of 45 potential peaks: 40 in veto map, 4 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 35 new sources
Median coadd sky for g : 4.8288544e-05
Median coadd sky for r : 0.00012447522
Median coadd sky for z : 0.00029604815
Stage srcs : Wall: 3.74 s, CPU: 3.70 s, VmPeak: 1068 MB, VmSize: 1068 MB, VmRSS: 261 MB, VmData: 288 MB, maxrss: 0.4508 MB
Stage srcs finished: 2020-06-06T09:09:46.922346
Resources for stage srcs : 0.117 s worker CPU, 0.117 s worker Wall, Wall: 3.746 s, Cores in use: 1.02, Total efficiency (on 8 cores): 12.7 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/PGC1953331-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/PGC1953331-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-06T09:09:46.935401
Blob 1 of 21, id: 8, sources: 7, size: 147x173, npix 12671, brick X: 76,223, Y: 66,239, one pixel: 134 66
Blob 2 of 21, id: 10, sources: 2, size: 68x82, npix 3456, brick X: 11,79, Y: 105,187, one pixel: 41 105
Blob 3 of 21, id: 17, sources: 4, size: 68x65, npix 2689, brick X: 15,83, Y: 230,295, one pixel: 44 230
Blob 4 of 21, id: 6, sources: 6, size: 62x73, npix 2431, brick X: 233,295, Y: 53,126, one pixel: 282 53
Blob 5 of 21, id: 11, sources: 3, size: 30x55, npix 1087, brick X: 265,295, Y: 134,189, one pixel: 278 134
Blob 6 of 21, id: 13, sources: 2, size: 37x52, npix 1078, brick X: 230,267, Y: 164,216, one pixel: 248 164
Blob 7 of 21, id: 3, sources: 2, size: 36x45, npix 1025, brick X: 259,295, Y: 3,48, one pixel: 276 3
Blob 8 of 21, id: 20, sources: 2, size: 45x30, npix 1018, brick X: 250,295, Y: 265,295, one pixel: 284 265
Blob 9 of 21, id: 16, sources: 1, size: 43x31, npix 893, brick X: 102,145, Y: 208,239, one pixel: 126 208
Blob 7 finished, total: Wall: 1.67 s, CPU: 1.67 s, VmPeak: 939 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148744 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (106.22823, 31.56716), pm (-0.0, -4.0), parallax 0.292 with NanoMaggies: g=19.6, r=18.9, z=18.9
Reset brightness to NanoMaggies: g=19.5, r=18.8, z=18.5
Blob 5 finished, total: Wall: 1.68 s, CPU: 1.67 s, VmPeak: 933 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14802 MB
Blob 10 of 21, id: 12, sources: 2, size: 28x43, npix 751, brick X: 75,103, Y: 153,196, one pixel: 90 153
Blob 11 of 21, id: 2, sources: 1, size: 33x27, npix 622, brick X: 182,215, Y: 0,27, one pixel: 189 0
Blob 2 finished, total: Wall: 1.72 s, CPU: 1.72 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149156 MB
Blob 12 of 21, id: 7, sources: 1, size: 30x30, npix 556, brick X: 161,191, Y: 57,87, one pixel: 175 57
Blob 6 finished, total: Wall: 1.88 s, CPU: 1.88 s, VmPeak: 933 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14894 MB
Blob 13 of 21, id: 4, sources: 1, size: 29x30, npix 546, brick X: 45,74, Y: 7,37, one pixel: 60 7
Measuring 1 iterative sources
Blob 8 finished, total: Wall: 2.44 s, CPU: 2.44 s, VmPeak: 933 MB, VmSize: 715 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144312 MB
Blob 14 of 21, id: 15, sources: 1, size: 24x31, npix 546, brick X: 0,24, Y: 206,237, one pixel: 7 206
Blob 11 finished, total: Wall: 0.91 s, CPU: 0.91 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149156 MB
Blob 15 of 21, id: 0, sources: 1, size: 34x21, npix 537, brick X: 100,134, Y: 0,21, one pixel: 104 0
Blob 10 finished, total: Wall: 1.06 s, CPU: 1.06 s, VmPeak: 933 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14802 MB
Blob 16 of 21, id: 18, sources: 1, size: 26x27, npix 451, brick X: 78,104, Y: 238,265, one pixel: 90 238
Blob 12 finished, total: Wall: 1.12 s, CPU: 1.12 s, VmPeak: 933 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.14894 MB
Blob 17 of 21, id: 1, sources: 1, size: 27x21, npix 390, brick X: 135,162, Y: 0,21, one pixel: 142 0
Blob 13 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 933 MB, VmSize: 715 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144348 MB
Blob 18 of 21, id: 19, sources: 1, size: 24x24, npix 349, brick X: 124,148, Y: 247,271, one pixel: 137 247
Blob 9 finished, total: Wall: 1.79 s, CPU: 1.79 s, VmPeak: 939 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148924 MB
Blob 19 of 21, id: 14, sources: 1, size: 22x22, npix 303, brick X: 220,242, Y: 200,222, one pixel: 230 200
Blob 16 finished, total: Wall: 0.71 s, CPU: 0.70 s, VmPeak: 933 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.14894 MB
Blob 20 of 21, id: 9, sources: 1, size: 21x21, npix 250, brick X: 50,71, Y: 68,89, one pixel: 59 68
Blob 18 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 939 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148924 MB
Blob 21 of 21, id: 5, sources: 1, size: 19x20, npix 200, brick X: 96,115, Y: 21,41, one pixel: 105 21
Blob 14 finished, total: Wall: 1.10 s, CPU: 1.10 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149156 MB
Blob 15 finished, total: Wall: 1.03 s, CPU: 1.03 s, VmPeak: 933 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14802 MB
Blob 17 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 933 MB, VmSize: 715 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144348 MB
Blob 20 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 939 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148924 MB
Blob 21 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149156 MB
Blob 19 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 933 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.14894 MB
Measuring 4 iterative sources
Blob 3 finished, total: Wall: 6.84 s, CPU: 6.84 s, VmPeak: 933 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149196 MB
Blob 4 finished, total: Wall: 7.05 s, CPU: 7.04 s, VmPeak: 939 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148732 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.63, ee1=0.345936, ee2=-0.22565
Blob 1 finished, total: Wall: 7.90 s, CPU: 7.90 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150864 MB
Old catalog: 48
New catalog: 46
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/metrics/cus/blobs-custom-106241p31565.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/metrics/cus/all-models-custom-106241p31565.fits
Stage fitblobs : Wall: 10.92 s, CPU: 3.05 s, VmPeak: 1068 MB, VmSize: 1068 MB, VmRSS: 262 MB, VmData: 288 MB, maxrss: 0.4508 MB
Stage fitblobs finished: 2020-06-06T09:09:57.856093
Resources for stage fitblobs : 42.356 s worker CPU, 42.444 s worker Wall, Wall: 10.922 s, Cores in use: 4.16, Total efficiency (on 8 cores): 52.0 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-06T09:09:57.858252
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/tmp-legacysurvey-custom-106241p31565-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/tmp-legacysurvey-custom-106241p31565-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/tmp-legacysurvey-custom-106241p31565-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/tmp-legacysurvey-custom-106241p31565-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-resid.jpg
Stage coadds : Wall: 4.24 s, CPU: 3.52 s, VmPeak: 1068 MB, VmSize: 1068 MB, VmRSS: 262 MB, VmData: 289 MB, maxrss: 0.4508 MB
Stage coadds finished: 2020-06-06T09:10:02.103020
Resources for stage coadds : 4.076 s worker CPU, 4.362 s worker Wall, Wall: 4.246 s, Cores in use: 1.79, Total efficiency (on 8 cores): 22.4 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-06T09:10:02.104751
Cut to 1 unWISE tiles
Reading WISE tile 1058p318 band 1
Reading WISE tile 1058p318 band 3
Reading WISE tile 1058p318 band 2
Reading WISE tile 1058p318 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1058p318/unwise-1058p318-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/105/1058p318/unwise-1058p318-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/105/1058p318/unwise-1058p318-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/105/1058p318/unwise-1058p318-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/105/1058p318/unwise-1058p318-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 933 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.189144 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1058p318/unwise-1058p318-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1058p318/unwise-1058p318-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1058p318/unwise-1058p318-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1058p318/unwise-1058p318-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 933 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 171 MB, maxrss: 0.206988 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1058p318/unwise-1058p318-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/105/1058p318/unwise-1058p318-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/105/1058p318/unwise-1058p318-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/105/1058p318/unwise-1058p318-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/105/1058p318/unwise-1058p318-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 958 MB, VmSize: 796 MB, VmRSS: 149 MB, VmData: 174 MB, maxrss: 0.210748 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1058p318/unwise-1058p318-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1058p318/unwise-1058p318-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1058p318/unwise-1058p318-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1058p318/unwise-1058p318-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 933 MB, VmSize: 796 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209352 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/tmp-legacysurvey-custom-106241p31565-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/tmp-legacysurvey-custom-106241p31565-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 4.42 s, CPU: 1.71 s, VmPeak: 1068 MB, VmSize: 1068 MB, VmRSS: 263 MB, VmData: 289 MB, maxrss: 0.4508 MB
Stage wise_forced finished: 2020-06-06T09:10:06.523162
Resources for stage wise_forced : 3.065 s worker CPU, 8.414 s worker Wall, Wall: 4.420 s, Cores in use: 1.08, Total efficiency (on 8 cores): 13.5 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-06T09:10:06.525144
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/coadd/cus/custom-106241p31565/legacysurvey-custom-106241p31565-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/tractor-i/cus/tractor-custom-106241p31565.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/tractor/cus/tractor-custom-106241p31565.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC1953331/tractor/cus/brick-custom-106241p31565.sha256sum
Stage writecat : Wall: 2.81 s, CPU: 2.01 s, VmPeak: 1200 MB, VmSize: 1072 MB, VmRSS: 265 MB, VmData: 289 MB, maxrss: 0.4508 MB
Stage writecat finished: 2020-06-06T09:10:09.339416
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.816 s, Cores in use: 0.71, Total efficiency (on 8 cores): 8.9 %
Stage writecat finished
All done: 56.619 s worker CPU, 344.427 s worker Wall, Wall: 112.870 s, Cores in use: 0.83, Total efficiency (on 8 cores): 10.4 %
Finished galaxy PGC1953331 in 1.995 minutes.