Started working on galaxy PGC1065754_GROUP at Fri Jun  5 16:21:00 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 195.74458136340567 -3.8755090806670234 --width 321 --height 321 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-05T16:21:03.802413
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '195.74458136340567', '-3.8755090806670234', '--width', '321', '--height', '321', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 195.74458136340567 -3.8755090806670234 --width 321 --height 321 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 195.74458136340567 -3.8755090806670234
Starting process 33633 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 33634 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 33635 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 33636 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-05T16:21:04.676692
Keeping 15 CCDs:
   c4d_180225_072400_ooi_g_ls9.fits.fz c4d_180225_072400_ooi_g_ls9-S23 g exptime 59.0 propid 2014B-0404 seeing 0.95 MJD 58174.308 object DECaLS_44967_g
   c4d_180225_044327_ooi_z_ls9.fits.fz c4d_180225_044327_ooi_z_ls9-S23 z exptime 80.0 propid 2014B-0404 seeing 0.80 MJD 58174.197 object DECaLS_44967_z
   c4d_160302_063656_ooi_z_ls9.fits.fz c4d_160302_063656_ooi_z_ls9-N29 z exptime 80.0 propid 2014B-0404 seeing 1.04 MJD 57449.274 object DECaLS_29096_z
   c4d_170330_055801_ooi_g_ls9.fits.fz c4d_170330_055801_ooi_g_ls9-N29 g exptime 144.0 propid 2014B-0404 seeing 1.15 MJD 57842.246 object DECaLS_29096_g
   c4d_160409_045032_ooi_r_ls9.fits.fz c4d_160409_045032_ooi_r_ls9-N29 r exptime 116.0 propid 2014B-0404 seeing 1.49 MJD 57487.200 object DECaLS_29096_r
   c4d_170304_063219_ooi_g_ls9.fits.fz c4d_170304_063219_ooi_g_ls9-S24 g exptime 146.0 propid 2014B-0404 seeing 1.47 MJD 57816.270 object DECaLS_29095_g
   c4d_160410_041415_ooi_r_ls9.fits.fz c4d_160410_041415_ooi_r_ls9-S24 r exptime 75.0 propid 2014B-0404 seeing 1.21 MJD 57488.175 object DECaLS_29095_r
   c4d_160721_004738_ooi_z_ls9.fits.fz c4d_160721_004738_ooi_z_ls9-S24 z exptime 160.0 propid 2016A-0190 seeing 1.18 MJD 57590.031 object DECaLS_29095_z
   c4d_160811_235025_ooi_z_ls9.fits.fz c4d_160811_235025_ooi_z_ls9-S28 z exptime 119.0 propid 2014B-0404 seeing 1.53 MJD 57611.991 object DECaLS_44967_z
   c4d_180225_044327_ooi_z_ls9.fits.fz c4d_180225_044327_ooi_z_ls9-S28 z exptime 80.0 propid 2014B-0404 seeing 0.84 MJD 58174.197 object DECaLS_44967_z
   c4d_180225_072400_ooi_g_ls9.fits.fz c4d_180225_072400_ooi_g_ls9-S28 g exptime 59.0 propid 2014B-0404 seeing 0.97 MJD 58174.308 object DECaLS_44967_g
   c4d_180225_072528_ooi_r_ls9.fits.fz c4d_180225_072528_ooi_r_ls9-S28 r exptime 42.0 propid 2014B-0404 seeing 0.88 MJD 58174.309 object DECaLS_44967_r
   c4d_160811_235353_ooi_z_ls9.fits.fz c4d_160811_235353_ooi_z_ls9-N25 z exptime 179.0 propid 2014B-0404 seeing 1.53 MJD 57611.993 object DECaLS_44968_z
   c4d_170401_052916_ooi_g_ls9.fits.fz c4d_170401_052916_ooi_g_ls9-N25 g exptime 175.0 propid 2014B-0404 seeing 1.65 MJD 57844.226 object DECaLS_44968_g
   c4d_190207_080726_ooi_z_ls9.fits.fz c4d_190207_080726_ooi_z_ls9-N25 z exptime 80.0 propid 2014B-0404 seeing 1.00 MJD 58521.338 object DECaLS_44968_z
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952ccca-g-20180225T072400_oi[S23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954dee2-z-20160302T063446_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95159e5-g-20170330T055447_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9528b21-z-20180225T044327_oi[S23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956e596-r-20160409T044745_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950f8db-g-20170304T062900_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956cfb1-r-20160410T041210_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954c7e7-z-20160721T004408_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a387-z-20160811T234736_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9528b21-z-20180225T044327_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952ccca-g-20180225T072400_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952c998-r-20180225T072528_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a387-z-20160811T235003_oi[N25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95173ea-g-20170401T052529_oi[N25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9534c2e-z-20190207T080726_oi[N25,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 83.41 s, CPU: 0.98 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 180 MB, VmData: 214 MB, maxrss: 0.450544 MB
Stage tims finished: 2020-06-05T16:22:28.087434
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9528b21-z-20180225T044327_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954c7e7-z-20160721T004408_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952c998-r-20180225T072528_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952ccca-g-20180225T072400_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956e596-r-20160409T044745_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a387-z-20160811T234736_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a387-z-20160811T235003_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95159e5-g-20170330T055447_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956cfb1-r-20160410T041210_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952ccca-g-20180225T072400_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9534c2e-z-20190207T080726_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954dee2-z-20160302T063446_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950f8db-g-20170304T062900_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9528b21-z-20180225T044327_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95173ea-g-20170401T052529_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 5.928 s worker CPU, 300.361 s worker Wall, Wall: 83.412 s, Cores in use: 0.08, Total efficiency (on 4 cores): 2.1 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-05T16:22:28.119225
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06405.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06533.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06661.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06534.fits
Matched 12 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/metrics/cus/reference-custom-195744m03875.fits
Stage refs : Wall: 4.64 s, CPU: 4.22 s, VmPeak: 1027 MB, VmSize: 1014 MB, VmRSS: 199 MB, VmData: 232 MB, maxrss: 0.450544 MB
Stage refs finished: 2020-06-05T16:22:32.761281
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.643 s, Cores in use: 0.91, Total efficiency (on 4 cores): 22.7 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-05T16:22:32.762758
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/metrics/cus/outlier-mask-custom-195744m03875.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/metrics/cus/outliers-pre-custom-195744m03875.jpg
Image c4d_170330_055801_ooi_g_ls9-N29 g : masking 519 positive outlier pixels and 0 negative outlier pixels
Image c4d_170304_063219_ooi_g_ls9-S24 g : masking 699 positive outlier pixels and 0 negative outlier pixels
Image c4d_190207_080726_ooi_z_ls9-N25 z : masking 380 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/metrics/cus/outlier-mask-custom-195744m03875.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/metrics/cus/outliers-post-custom-195744m03875.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/metrics/cus/outliers-masked-pos-custom-195744m03875.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/metrics/cus/outliers-masked-neg-custom-195744m03875.jpg
Stage outliers : Wall: 3.02 s, CPU: 2.65 s, VmPeak: 1027 MB, VmSize: 1024 MB, VmRSS: 217 MB, VmData: 246 MB, maxrss: 0.450544 MB
Stage outliers finished: 2020-06-05T16:22:35.786367
Resources for stage outliers : 1.370 s worker CPU, 1.389 s worker Wall, Wall: 3.025 s, Cores in use: 1.33, Total efficiency (on 4 cores): 33.2 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-05T16:22:35.788233
Stage halos : Wall: 2.54 s, CPU: 1.60 s, VmPeak: 1027 MB, VmSize: 1024 MB, VmRSS: 217 MB, VmData: 246 MB, maxrss: 0.450544 MB
Stage halos finished: 2020-06-05T16:22:38.330688
Resources for stage halos : 0.498 s worker CPU, 3.449 s worker Wall, Wall: 2.544 s, Cores in use: 0.82, Total efficiency (on 4 cores): 20.6 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-05T16:22:38.332628
PSF sigmas in coadd pixels: ['1.87', '2.38', '1.57', '2.69']
Using average PSF sigma 2.1282735804195227
Gaussian PSF norm 0.1325463015512658 vs pixelized 0.11113541
average tim pixel scale / coadd scale: 1.0011037125141993
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.42', '1.96', '1.43']
Using average PSF sigma 1.9383914572004217
Gaussian PSF norm 0.14553035235787812 vs pixelized 0.11519259
average tim pixel scale / coadd scale: 1.0011109273759862
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.30', '1.70', '1.92', '2.48', '1.36', '2.48', '1.63']
Using average PSF sigma 1.8387063420372851
Gaussian PSF norm 0.1534202527747402 vs pixelized 0.1345208
average tim pixel scale / coadd scale: 1.0011213580999552
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.30 s, CPU: 0.26 s, VmPeak: 1027 MB, VmSize: 1024 MB, VmRSS: 219 MB, VmData: 247 MB, maxrss: 0.450544 MB
Stage fit_on_coadds finished: 2020-06-05T16:22:38.634654
Resources for stage fit_on_coadds : 0.306 s worker CPU, 0.313 s worker Wall, Wall: 0.303 s, Cores in use: 1.88, Total efficiency (on 4 cores): 47.1 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-05T16:22:38.637945
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 244 potential peaks
Of 244 potential peaks: 201 in veto map, 15 cut by saddle test, 0 cut by aper test, 28 kept
SED z : 28 new peaks
Found 229 potential peaks
Of 229 potential peaks: 213 in veto map, 14 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 170 potential peaks
Of 170 potential peaks: 160 in veto map, 10 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 199 potential peaks
Of 199 potential peaks: 183 in veto map, 14 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 241 potential peaks
Of 241 potential peaks: 226 in veto map, 14 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 33 new sources
Median coadd sky for g : 0.00018913206
Median coadd sky for r : 0.00067357195
Median coadd sky for z : 0.001560063
Stage srcs : Wall: 1.37 s, CPU: 1.30 s, VmPeak: 1027 MB, VmSize: 1024 MB, VmRSS: 220 MB, VmData: 247 MB, maxrss: 0.450544 MB
Stage srcs finished: 2020-06-05T16:22:40.003073
Resources for stage srcs : 0.159 s worker CPU, 0.174 s worker Wall, Wall: 1.366 s, Cores in use: 1.07, Total efficiency (on 4 cores): 26.8 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-05T16:22:40.017817
Blob 1 of 7, id: 1, sources: 30, size: 321x312, npix 70424, brick X: 0,321, Y: 9,321, one pixel: 137 9
Blob 2 of 7, id: 4, sources: 1, size: 24x24, npix 362, brick X: 6,30, Y: 76,100, one pixel: 17 76
Blob 3 of 7, id: 5, sources: 1, size: 23x23, npix 327, brick X: 263,286, Y: 296,319, one pixel: 272 296
Blob 4 of 7, id: 6, sources: 1, size: 18x25, npix 319, brick X: 303,321, Y: 296,321, one pixel: 313 296
Blob 5 of 7, id: 0, sources: 1, size: 23x14, npix 208, brick X: 226,249, Y: 0,14, one pixel: 228 0
Blob 3 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 963 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146776 MB
Blob 2 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 965 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147592 MB
Blob 6 of 7, id: 3, sources: 1, size: 18x19, npix 198, brick X: 63,81, Y: 28,47, one pixel: 71 28
Blob 7 of 7, id: 2, sources: 1, size: 18x18, npix 171, brick X: 284,302, Y: 21,39, one pixel: 292 21
Blob 6 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 965 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147592 MB
Blob 4 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 965 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147928 MB
Blob 7 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 965 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147592 MB
Blob 5 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 963 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146776 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.33807, ee1=-0.076715, ee2=0.0380403
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.97894, ee1=0.428169, ee2=-0.201928
Measuring 32 iterative sources
Blob 1 finished, total: Wall: 58.48 s, CPU: 58.48 s, VmPeak: 960 MB, VmSize: 775 MB, VmRSS: 210 MB, VmData: 238 MB, maxrss: 0.214564 MB
Old catalog: 42
New catalog: 59
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/metrics/cus/blobs-custom-195744m03875.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/metrics/cus/all-models-custom-195744m03875.fits
Stage fitblobs : Wall: 59.14 s, CPU: 0.59 s, VmPeak: 1027 MB, VmSize: 1020 MB, VmRSS: 219 MB, VmData: 246 MB, maxrss: 0.450544 MB
Stage fitblobs finished: 2020-06-05T16:23:39.157045
Resources for stage fitblobs : 60.447 s worker CPU, 60.475 s worker Wall, Wall: 59.140 s, Cores in use: 1.03, Total efficiency (on 4 cores): 25.8 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-05T16:23:39.158757
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/tmp-legacysurvey-custom-195744m03875-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/tmp-legacysurvey-custom-195744m03875-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/tmp-legacysurvey-custom-195744m03875-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/tmp-legacysurvey-custom-195744m03875-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-resid.jpg
Stage coadds : Wall: 1.86 s, CPU: 0.65 s, VmPeak: 1027 MB, VmSize: 1020 MB, VmRSS: 220 MB, VmData: 246 MB, maxrss: 0.450544 MB
Stage coadds finished: 2020-06-05T16:23:41.014723
Resources for stage coadds : 3.727 s worker CPU, 3.849 s worker Wall, Wall: 1.857 s, Cores in use: 2.36, Total efficiency (on 4 cores): 59.0 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-05T16:23:41.016165
Cut to 1 unWISE tiles
Reading WISE tile 1959m046 band 1
Reading WISE tile 1959m046 band 2
Reading WISE tile 1959m046 band 3
Reading WISE tile 1959m046 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.12 s, CPU: 0.12 s, VmPeak: 965 MB, VmSize: 798 MB, VmRSS: 154 MB, VmData: 177 MB, maxrss: 0.199204 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 960 MB, VmSize: 825 MB, VmRSS: 185 MB, VmData: 203 MB, maxrss: 0.240304 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 963 MB, VmSize: 795 MB, VmRSS: 151 MB, VmData: 174 MB, maxrss: 0.213576 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 965 MB, VmSize: 796 MB, VmRSS: 146 MB, VmData: 175 MB, maxrss: 0.209036 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/tmp-legacysurvey-custom-195744m03875-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/tmp-legacysurvey-custom-195744m03875-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 6.19 s, CPU: 0.97 s, VmPeak: 1027 MB, VmSize: 1020 MB, VmRSS: 220 MB, VmData: 246 MB, maxrss: 0.450544 MB
Stage wise_forced finished: 2020-06-05T16:23:47.203295
Resources for stage wise_forced : 3.239 s worker CPU, 10.530 s worker Wall, Wall: 6.188 s, Cores in use: 0.68, Total efficiency (on 4 cores): 17.0 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-05T16:23:47.205185
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/tractor-i/cus/tractor-custom-195744m03875.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/tractor/cus/tractor-custom-195744m03875.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/tractor/cus/brick-custom-195744m03875.sha256sum
Stage writecat : Wall: 3.62 s, CPU: 3.00 s, VmPeak: 1152 MB, VmSize: 1024 MB, VmRSS: 222 MB, VmData: 246 MB, maxrss: 0.450544 MB
Stage writecat finished: 2020-06-05T16:23:50.828927
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.625 s, Cores in use: 0.83, Total efficiency (on 4 cores): 20.7 %
Stage writecat finished
All done: 75.674 s worker CPU, 380.541 s worker Wall, Wall: 166.157 s, Cores in use: 0.55, Total efficiency (on 4 cores): 13.8 %
Finished galaxy PGC1065754_GROUP in 2.849 minutes.
Started working on galaxy PGC1065754_GROUP at Mon Aug 10 10:44:16 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 195.74460475506237 -3.875360285579317 --width 319 --height 319 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-10T10:44:17.031440
legacypipe git version: DR9.5.11-watershed-6-g6a2880fc
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '195.74460475506237', '-3.875360285579317', '--width', '319', '--height', '319', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 195.74460475506237 -3.875360285579317 --width 319 --height 319 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 195.74460475506237 -3.875360285579317
Starting process 13749 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 13751 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 13754 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 13756 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 13760 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB
Starting process 13763 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 13765 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 13771 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-10T10:44:17.736077
Keeping 14 CCDs:
  c4d_180225_044327_ooi_z_ls9-S23 z expnum 725181 exptime 80.0 propid 2014B-0404 seeing 0.80 MJD 58174.197 object DECaLS_44967_z 
    decam/CP/V4.8.2a/CP20180224/c4d_180225_044327_ooi_z_ls9.fits.fz
  c4d_160302_063656_ooi_z_ls9-N29 z expnum 522162 exptime 80.0 propid 2014B-0404 seeing 1.04 MJD 57449.274 object DECaLS_29096_z 
    decam/CP/V4.8.2a/CP20160301/c4d_160302_063656_ooi_z_ls9.fits.fz
  c4d_170330_055801_ooi_g_ls9-N29 g expnum 635271 exptime 144.0 propid 2014B-0404 seeing 1.15 MJD 57842.246 object DECaLS_29096_g 
    decam/CP/V4.8.2/CP20170329/c4d_170330_055801_ooi_g_ls9.fits.fz
  c4d_160409_045032_ooi_r_ls9-N29 r expnum 535584 exptime 116.0 propid 2014B-0404 seeing 1.49 MJD 57487.200 object DECaLS_29096_r 
    decam/CP/V4.8.2a/CP20160408/c4d_160409_045032_ooi_r_ls9.fits.fz
  c4d_170304_063219_ooi_g_ls9-S24 g expnum 625760 exptime 146.0 propid 2014B-0404 seeing 1.47 MJD 57816.270 object DECaLS_29095_g 
    decam/CP/V4.8.2/CP20170303/c4d_170304_063219_ooi_g_ls9.fits.fz
  c4d_160410_041415_ooi_r_ls9-S24 r expnum 535991 exptime 75.0 propid 2014B-0404 seeing 1.21 MJD 57488.175 object DECaLS_29095_r 
    decam/CP/V4.8.2a/CP20160409/c4d_160410_041415_ooi_r_ls9.fits.fz
  c4d_160721_004738_ooi_z_ls9-S24 z expnum 553424 exptime 160.0 propid 2016A-0190 seeing 1.18 MJD 57590.031 object DECaLS_29095_z 
    decam/CP/V4.8.2a/CP20160720/c4d_160721_004738_ooi_z_ls9.fits.fz
  c4d_160811_235025_ooi_z_ls9-S28 z expnum 563033 exptime 119.0 propid 2014B-0404 seeing 1.53 MJD 57611.991 object DECaLS_44967_z 
    decam/CP/V4.8.2a/CP20160811/c4d_160811_235025_ooi_z_ls9.fits.fz
  c4d_180225_044327_ooi_z_ls9-S28 z expnum 725181 exptime 80.0 propid 2014B-0404 seeing 0.84 MJD 58174.197 object DECaLS_44967_z 
    decam/CP/V4.8.2a/CP20180224/c4d_180225_044327_ooi_z_ls9.fits.fz
  c4d_180225_072400_ooi_g_ls9-S28 g expnum 725248 exptime 59.0 propid 2014B-0404 seeing 0.97 MJD 58174.308 object DECaLS_44967_g 
    decam/CP/V4.8.2a/CP20180224/c4d_180225_072400_ooi_g_ls9.fits.fz
  c4d_180225_072528_ooi_r_ls9-S28 r expnum 725249 exptime 42.0 propid 2014B-0404 seeing 0.88 MJD 58174.309 object DECaLS_44967_r 
    decam/CP/V4.8.2a/CP20180224/c4d_180225_072528_ooi_r_ls9.fits.fz
  c4d_160811_235353_ooi_z_ls9-N25 z expnum 563034 exptime 179.0 propid 2014B-0404 seeing 1.53 MJD 57611.993 object DECaLS_44968_z 
    decam/CP/V4.8.2a/CP20160811/c4d_160811_235353_ooi_z_ls9.fits.fz
  c4d_170401_052916_ooi_g_ls9-N25 g expnum 635995 exptime 175.0 propid 2014B-0404 seeing 1.65 MJD 57844.226 object DECaLS_44968_g 
    decam/CP/V4.8.2/CP20170331/c4d_170401_052916_ooi_g_ls9.fits.fz
  c4d_190207_080726_ooi_z_ls9-N25 z expnum 820578 exptime 80.0 propid 2014B-0404 seeing 1.00 MJD 58521.338 object DECaLS_44968_z 
    decam/CP/V4.8.2a/CP20190206/c4d_190207_080726_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956cfb1-r-20160410T041210_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950f8db-g-20170304T062900_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954dee2-z-20160302T063446_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956e596-r-20160409T044745_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95159e5-g-20170330T055447_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9528b21-z-20180225T044327_oi[S23,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9528b21-z-20180225T044327_oi[S28,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952ccca-g-20180225T072400_oi[S28,noinherit][2046,4094][real]: DECaLS_
Clipping 1 pixels with anomalously large oow values: max 0.0652565 vs median 0.0501839
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a387-z-20160811T234736_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952c998-r-20180225T072528_oi[S28,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95173ea-g-20170401T052529_oi[N25,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a387-z-20160811T235003_oi[N25,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9534c2e-z-20190207T080726_oi[N25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954c7e7-z-20160721T004408_oi[S24,noinherit][2046,4094][real]: DECaLS_
Clipping 1 pixels with anomalously large oow values: max 0.00159158 vs median 0.0008325
Stage tims : Wall: 90.65 s, CPU: 0.94 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 181 MB, VmData: 215 MB, maxrss: 0.185204 MB
Stage tims finished: 2020-08-10T10:45:48.385950
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954dee2-z-20160302T063446_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952ccca-g-20180225T072400_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950f8db-g-20170304T062900_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9534c2e-z-20190207T080726_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9528b21-z-20180225T044327_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952c998-r-20180225T072528_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95159e5-g-20170330T055447_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95173ea-g-20170401T052529_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a387-z-20160811T234736_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956e596-r-20160409T044745_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a387-z-20160811T235003_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956cfb1-r-20160410T041210_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9528b21-z-20180225T044327_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 6.553 s worker CPU, 678.815 s worker Wall, Wall: 90.651 s, Cores in use: 0.08, Total efficiency (on 8 cores): 1.0 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-tims.p
Running stage refs
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954c7e7-z-20160721T004408_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Running stage refs at 2020-08-10T10:45:48.579559
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06405.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06533.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06661.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06534.fits
Matched 12 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/metrics/cus/reference-custom-195744m03875.fits
Stage refs : Wall: 13.14 s, CPU: 2.10 s, VmPeak: 1036 MB, VmSize: 1024 MB, VmRSS: 201 MB, VmData: 234 MB, maxrss: 0.205428 MB
Stage refs finished: 2020-08-10T10:46:01.717431
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 13.139 s, Cores in use: 0.16, Total efficiency (on 8 cores): 2.0 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-10T10:46:01.746733
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/metrics/cus/outlier-mask-custom-195744m03875.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/metrics/cus/outliers-pre-custom-195744m03875.jpg
Image c4d_180225_072400_ooi_g_ls9-S28 g : masking 0 positive outlier pixels and 62 negative outlier pixels
Image c4d_170330_055801_ooi_g_ls9-N29 g : masking 514 positive outlier pixels and 0 negative outlier pixels
Image c4d_170304_063219_ooi_g_ls9-S24 g : masking 693 positive outlier pixels and 0 negative outlier pixels
Image c4d_180225_072528_ooi_r_ls9-S28 r : masking 76 positive outlier pixels and 0 negative outlier pixels
Image c4d_160410_041415_ooi_r_ls9-S24 r : masking 0 positive outlier pixels and 76 negative outlier pixels
Image c4d_190207_080726_ooi_z_ls9-N25 z : masking 377 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/metrics/cus/outlier-mask-custom-195744m03875.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/metrics/cus/outliers-post-custom-195744m03875.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/metrics/cus/outliers-masked-pos-custom-195744m03875.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/metrics/cus/outliers-masked-neg-custom-195744m03875.jpg
Stage outliers : Wall: 1.15 s, CPU: 0.87 s, VmPeak: 1036 MB, VmSize: 1034 MB, VmRSS: 219 MB, VmData: 250 MB, maxrss: 0.22466 MB
Stage outliers finished: 2020-08-10T10:46:02.898754
Resources for stage outliers : 1.147 s worker CPU, 1.153 s worker Wall, Wall: 1.153 s, Cores in use: 1.75, Total efficiency (on 8 cores): 21.9 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-10T10:46:03.108829
Stage halos : Wall: 3.62 s, CPU: 0.56 s, VmPeak: 1036 MB, VmSize: 1034 MB, VmRSS: 220 MB, VmData: 250 MB, maxrss: 0.224784 MB
Stage halos finished: 2020-08-10T10:46:06.727501
Resources for stage halos : 0.537 s worker CPU, 6.893 s worker Wall, Wall: 3.620 s, Cores in use: 0.30, Total efficiency (on 8 cores): 3.8 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-10T10:46:06.784756
PSF sigmas in coadd pixels: ['1.87', '2.38', '1.57', '2.69']
Using average PSF sigma 2.1282735804195227
Gaussian PSF norm 0.1325463015512658 vs pixelized 0.11113614
average tim pixel scale / coadd scale: 1.0011037125141993
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.42', '1.96', '1.43']
Using average PSF sigma 1.9383914572004217
Gaussian PSF norm 0.14553035235787812 vs pixelized 0.11519264
average tim pixel scale / coadd scale: 1.0011109273759862
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.70', '1.92', '2.48', '1.36', '2.48', '1.63']
Using average PSF sigma 1.9280345718517917
Gaussian PSF norm 0.14631210243441778 vs pixelized 0.12818822
average tim pixel scale / coadd scale: 1.0011122103883594
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.25 s, CPU: 0.23 s, VmPeak: 1036 MB, VmSize: 1034 MB, VmRSS: 223 MB, VmData: 253 MB, maxrss: 0.228756 MB
Stage fit_on_coadds finished: 2020-08-10T10:46:07.037858
Resources for stage fit_on_coadds : 0.291 s worker CPU, 0.291 s worker Wall, Wall: 0.254 s, Cores in use: 2.06, Total efficiency (on 8 cores): 25.7 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-10T10:46:07.049687
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 218 potential peaks
Of 218 potential peaks: 178 in veto map, 14 cut by saddle test, 0 cut by aper test, 26 kept
SED z : 26 new peaks
Found 225 potential peaks
Of 225 potential peaks: 208 in veto map, 15 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 169 potential peaks
Of 169 potential peaks: 159 in veto map, 10 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 199 potential peaks
Of 199 potential peaks: 184 in veto map, 13 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 234 potential peaks
Of 234 potential peaks: 219 in veto map, 14 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 31 new sources
Median coadd sky for g : 0.00018884712
Median coadd sky for r : 0.000647243
Median coadd sky for z : 0.0015184096
Stage srcs : Wall: 0.99 s, CPU: 0.94 s, VmPeak: 1036 MB, VmSize: 1034 MB, VmRSS: 224 MB, VmData: 253 MB, maxrss: 0.229316 MB
Stage srcs finished: 2020-08-10T10:46:08.035049
Resources for stage srcs : 0.130 s worker CPU, 0.130 s worker Wall, Wall: 0.986 s, Cores in use: 1.09, Total efficiency (on 8 cores): 13.6 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-10T10:46:08.057969
Blob 1 of 6, id: 0, sources: 29, size: 319x314, npix 71365, brick X: 0,319, Y: 5,319, one pixel: 137 5
Blob 2 of 6, id: 3, sources: 1, size: 25x24, npix 373, brick X: 5,30, Y: 73,97, one pixel: 16 73
Blob 3 of 6, id: 4, sources: 1, size: 23x24, npix 347, brick X: 262,285, Y: 292,316, one pixel: 272 292
Blob 4 of 6, id: 5, sources: 1, size: 17x24, npix 281, brick X: 302,319, Y: 294,318, one pixel: 312 294
Blob 5 of 6, id: 2, sources: 1, size: 18x19, npix 189, brick X: 62,80, Y: 25,44, one pixel: 71 25
Blob 6 of 6, id: 1, sources: 1, size: 18x17, npix 162, brick X: 283,301, Y: 18,35, one pixel: 291 18
Blob 5 finished, total: Wall: 0.04 s, CPU: 0.04 s, VmPeak: 957 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145568 MB
Blob 6 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 966 MB, VmSize: 728 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.1486 MB
Blob 3 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 970 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146176 MB
Blob 4 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 970 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146264 MB
Blob 2 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 941 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.14754 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.09354, ee1=-0.0180727, ee2=0.0132897
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.68616, ee1=0.306189, ee2=-0.161409
Measuring 23 iterative sources
Blob 1 finished, total: Wall: 51.27 s, CPU: 51.26 s, VmPeak: 943 MB, VmSize: 761 MB, VmRSS: 189 MB, VmData: 217 MB, maxrss: 0.211104 MB
Old catalog: 40
New catalog: 47
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/metrics/cus/blobs-custom-195744m03875.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/metrics/cus/all-models-custom-195744m03875.fits
Stage fitblobs : Wall: 51.80 s, CPU: 0.43 s, VmPeak: 1036 MB, VmSize: 1034 MB, VmRSS: 226 MB, VmData: 255 MB, maxrss: 0.231652 MB
Stage fitblobs finished: 2020-08-10T10:46:59.857477
Resources for stage fitblobs : 52.522 s worker CPU, 52.577 s worker Wall, Wall: 51.801 s, Cores in use: 1.02, Total efficiency (on 8 cores): 12.8 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-10T10:46:59.959727
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/tmp-legacysurvey-custom-195744m03875-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/tmp-legacysurvey-custom-195744m03875-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/tmp-legacysurvey-custom-195744m03875-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/tmp-legacysurvey-custom-195744m03875-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-resid.jpg
Stage coadds : Wall: 2.21 s, CPU: 1.13 s, VmPeak: 1036 MB, VmSize: 1034 MB, VmRSS: 227 MB, VmData: 255 MB, maxrss: 0.232168 MB
Stage coadds finished: 2020-08-10T10:47:02.174042
Resources for stage coadds : 4.994 s worker CPU, 5.784 s worker Wall, Wall: 2.215 s, Cores in use: 2.76, Total efficiency (on 8 cores): 34.5 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-10T10:47:02.239572
Cut to 1 unWISE tiles
Reading WISE tile 1959m046 band 1
Reading WISE tile 1959m046 band 2
Reading WISE tile 1959m046 band 3
Reading WISE tile 1959m046 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.12 s, CPU: 0.12 s, VmPeak: 957 MB, VmSize: 801 MB, VmRSS: 145 MB, VmData: 172 MB, maxrss: 0.206348 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 941 MB, VmSize: 800 MB, VmRSS: 145 MB, VmData: 171 MB, maxrss: 0.205948 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 966 MB, VmSize: 802 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.207188 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1959m046/unwise-1959m046-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 970 MB, VmSize: 806 MB, VmRSS: 149 MB, VmData: 177 MB, maxrss: 0.18982 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/tmp-legacysurvey-custom-195744m03875-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/tmp-legacysurvey-custom-195744m03875-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.63 s, CPU: 1.15 s, VmPeak: 1036 MB, VmSize: 1034 MB, VmRSS: 227 MB, VmData: 255 MB, maxrss: 0.232872 MB
Stage wise_forced finished: 2020-08-10T10:47:04.872100
Resources for stage wise_forced : 3.333 s worker CPU, 4.813 s worker Wall, Wall: 2.634 s, Cores in use: 1.70, Total efficiency (on 8 cores): 21.3 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-10T10:47:04.968385
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/coadd/cus/custom-195744m03875/legacysurvey-custom-195744m03875-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/tractor-i/cus/tractor-custom-195744m03875.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/tractor/cus/tractor-custom-195744m03875.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/tractor/cus/brick-custom-195744m03875.sha256sum
Stage writecat : Wall: 2.73 s, CPU: 0.89 s, VmPeak: 1166 MB, VmSize: 1038 MB, VmRSS: 229 MB, VmData: 255 MB, maxrss: 0.365872 MB
Stage writecat finished: 2020-08-10T10:47:07.694512
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.728 s, Cores in use: 0.33, Total efficiency (on 8 cores): 4.1 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC1065754_GROUP/PGC1065754_GROUP-largegalaxy-writecat.p
All done: 69.510 s worker CPU, 750.459 s worker Wall, Wall: 170.095 s, Cores in use: 0.46, Total efficiency (on 8 cores): 5.8 %
Finished galaxy PGC1065754_GROUP in 2.869 minutes.