Started working on galaxy PGC1233503 at Sat Jun  6 17:40:58 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 318.54926700000004 2.6491856 --width 315 --height 315 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/PGC1233503-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/PGC1233503-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-06T17:40:59.209287
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '318.54926700000004', '2.6491856', '--width', '315', '--height', '315', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/PGC1233503-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/PGC1233503-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 318.54926700000004 2.6491856 --width 315 --height 315 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/PGC1233503-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/PGC1233503-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 318.54926700000004 2.6491856
Starting process 60411 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.0573 MB
Starting process 60412 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 60413 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 60414 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-06T17:41:05.953439
Keeping 15 CCDs:
   c4d_160907_040201_ooi_g_ls9.fits.fz c4d_160907_040201_ooi_g_ls9-S25 g exptime 90.0 propid 2012B-0001 seeing 1.47 MJD 57638.166 object DES survey hex -411+16 tiling 5
   c4d_160907_040002_ooi_r_ls9.fits.fz c4d_160907_040002_ooi_r_ls9-S25 r exptime 90.0 propid 2012B-0001 seeing 1.27 MJD 57638.165 object DES survey hex -411+16 tiling 5
   c4d_140818_043409_ooi_r_ls9.fits.fz c4d_140818_043409_ooi_r_ls9-N20 r exptime 69.0 propid 2014B-0404 seeing 1.34 MJD 56887.189 object DECaLS_27636_r
   c4d_180518_102615_ooi_z_ls9.fits.fz c4d_180518_102615_ooi_z_ls9-N20 z exptime 250.0 propid 2014B-0404 seeing 1.04 MJD 58256.435 object DECaLS_27636_z
   c4d_140818_033744_ooi_g_ls9.fits.fz c4d_140818_033744_ooi_g_ls9-N20 g exptime 82.0 propid 2014B-0404 seeing 1.58 MJD 56887.150 object DECaLS_27636_g
   c4d_170721_040245_ooi_g_ls9.fits.fz c4d_170721_040245_ooi_g_ls9-N28 g exptime 199.0 propid 2014B-0404 seeing 1.24 MJD 57955.166 object DECaLS_43491_g
   c4d_140815_024900_ooi_r_ls9.fits.fz c4d_140815_024900_ooi_r_ls9-N28 r exptime 85.0 propid 2014B-0404 seeing 1.09 MJD 56884.116 object DECaLS_43491_r
   c4d_140814_025216_ooi_z_ls9.fits.fz c4d_140814_025216_ooi_z_ls9-N28 z exptime 250.0 propid 2014B-0404 seeing 1.05 MJD 56883.116 object DECaLS_43491_z
   c4d_160908_015542_ooi_z_ls9.fits.fz c4d_160908_015542_ooi_z_ls9-S25 z exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 57639.079 object DES survey hex -411+16 tiling 5
   c4d_170720_041203_ooi_g_ls9.fits.fz c4d_170720_041203_ooi_g_ls9-S29 g exptime 200.0 propid 2014B-0404 seeing 1.50 MJD 57954.172 object DECaLS_43490_g
   c4d_140814_030616_ooi_z_ls9.fits.fz c4d_140814_030616_ooi_z_ls9-S29 z exptime 250.0 propid 2014B-0404 seeing 1.07 MJD 56883.126 object DECaLS_43490_z
   c4d_140815_024317_ooi_r_ls9.fits.fz c4d_140815_024317_ooi_r_ls9-S29 r exptime 85.0 propid 2014B-0404 seeing 1.24 MJD 56884.112 object DECaLS_43490_r
   c4d_160812_030531_ooi_z_ls9.fits.fz c4d_160812_030531_ooi_z_ls9-N21 z exptime 87.0 propid 2014B-0404 seeing 1.07 MJD 57612.127 object DECaLS_11764_z
   c4d_140817_042500_ooi_r_ls9.fits.fz c4d_140817_042500_ooi_r_ls9-N21 r exptime 73.0 propid 2014B-0404 seeing 1.24 MJD 56886.183 object DECaLS_11764_r
   c4d_140816_033458_ooi_g_ls9.fits.fz c4d_140816_033458_ooi_g_ls9-N21 g exptime 88.0 propid 2014B-0404 seeing 0.98 MJD 56885.148 object DECaLS_11764_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955eab7-z-20180518T102615_oi[N20,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_94fb337-g-20160907T035941_oi[S25,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9548bbb-r-20140818T043207_oi[N20,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_94fc0f0-r-20160907T035741_oi[S25,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a39a-g-20140818T033529_oi[N20,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ccd4-g-20170721T035832_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954793b-r-20140815T024642_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954c6e6-z-20140814T024716_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_94fc4b7-z-20160908T015322_oi[S25,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954c6e6-z-20140814T030116_oi[S29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ccd4-g-20170720T040751_oi[S29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954793b-r-20140815T024101_oi[S29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a387-z-20160812T030313_oi[N21,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9548bbb-r-20140817T042253_oi[N21,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a39a-g-20140816T033239_oi[N21,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 206.91 s, CPU: 9.85 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 183 MB, VmData: 217 MB, maxrss: 0.4562 MB
Stage tims finished: 2020-06-06T17:44:32.867716
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_94fc0f0-r-20160907T035741_oi[S25,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954c6e6-z-20140814T024716_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954793b-r-20140815T024101_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955eab7-z-20180518T102615_oi[N20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a39a-g-20140818T033529_oi[N20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_94fc4b7-z-20160908T015322_oi[S25,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a387-z-20160812T030313_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_94fb337-g-20160907T035941_oi[S25,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ccd4-g-20170721T035832_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ccd4-g-20170720T040751_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9548bbb-r-20140817T042253_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 5.367 s worker CPU, 500.522 s worker Wall, Wall: 206.916 s, Cores in use: 0.07, Total efficiency (on 4 cores): 1.8 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/PGC1233503-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/PGC1233503-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9548bbb-r-20140818T043207_oi[N20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954793b-r-20140815T024642_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954c6e6-z-20140814T030116_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a39a-g-20140816T033239_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Running stage refs at 2020-06-06T17:44:32.904174
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05937.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05809.fits
Matched 21 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/metrics/cus/reference-custom-318549p02649.fits
Stage refs : Wall: 13.67 s, CPU: 12.45 s, VmPeak: 1053 MB, VmSize: 1047 MB, VmRSS: 236 MB, VmData: 267 MB, maxrss: 0.4562 MB
Stage refs finished: 2020-06-06T17:44:46.572483
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 13.669 s, Cores in use: 0.91, Total efficiency (on 4 cores): 22.8 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-06T17:44:46.573840
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/metrics/cus/outlier-mask-custom-318549p02649.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/metrics/cus/outliers-pre-custom-318549p02649.jpg
Image c4d_140818_033744_ooi_g_ls9-N20 g : masking 2642 positive outlier pixels and 0 negative outlier pixels
Image c4d_170721_040245_ooi_g_ls9-N28 g : masking 290 positive outlier pixels and 0 negative outlier pixels
Image c4d_160907_040201_ooi_g_ls9-S25 g : masking 0 positive outlier pixels and 54 negative outlier pixels
Image c4d_140818_043409_ooi_r_ls9-N20 r : masking 247 positive outlier pixels and 0 negative outlier pixels
Image c4d_160907_040002_ooi_r_ls9-S25 r : masking 254 positive outlier pixels and 0 negative outlier pixels
Image c4d_180518_102615_ooi_z_ls9-N20 z : masking 172 positive outlier pixels and 0 negative outlier pixels
Image c4d_140814_030616_ooi_z_ls9-S29 z : masking 674 positive outlier pixels and 0 negative outlier pixels
Image c4d_140814_025216_ooi_z_ls9-N28 z : masking 1017 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/metrics/cus/outlier-mask-custom-318549p02649.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/metrics/cus/outliers-post-custom-318549p02649.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/metrics/cus/outliers-masked-pos-custom-318549p02649.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/metrics/cus/outliers-masked-neg-custom-318549p02649.jpg
Stage outliers : Wall: 3.48 s, CPU: 3.02 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 257 MB, VmData: 285 MB, maxrss: 0.4562 MB
Stage outliers finished: 2020-06-06T17:44:50.054353
Resources for stage outliers : 2.203 s worker CPU, 2.246 s worker Wall, Wall: 3.482 s, Cores in use: 1.50, Total efficiency (on 4 cores): 37.5 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-06T17:44:50.056194
Stage halos : Wall: 14.32 s, CPU: 8.25 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 257 MB, VmData: 285 MB, maxrss: 0.4562 MB
Stage halos finished: 2020-06-06T17:45:04.372980
Resources for stage halos : 0.592 s worker CPU, 22.862 s worker Wall, Wall: 14.318 s, Cores in use: 0.62, Total efficiency (on 4 cores): 15.4 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-06T17:45:04.374730
PSF sigmas in coadd pixels: ['2.39', '2.56', '2.02', '2.43', '1.59']
Using average PSF sigma 2.1983027497259524
Gaussian PSF norm 0.1283239043434964 vs pixelized 0.10697079
average tim pixel scale / coadd scale: 1.001127196639378
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.07', '2.17', '1.77', '2.02', '2.01']
Using average PSF sigma 2.008792599933283
Gaussian PSF norm 0.14043002337983881 vs pixelized 0.11554299
average tim pixel scale / coadd scale: 1.0011248172346132
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.69', '1.71', '1.65', '1.73', '1.73']
Using average PSF sigma 1.7013288620707587
Gaussian PSF norm 0.16580850302541084 vs pixelized 0.12942035
average tim pixel scale / coadd scale: 1.0010822878738168
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.40 s, CPU: 0.32 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 262 MB, VmData: 289 MB, maxrss: 0.4562 MB
Stage fit_on_coadds finished: 2020-06-06T17:45:04.770097
Resources for stage fit_on_coadds : 0.487 s worker CPU, 0.531 s worker Wall, Wall: 0.396 s, Cores in use: 2.05, Total efficiency (on 4 cores): 51.2 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-06T17:45:04.773180
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 101 potential peaks
Of 101 potential peaks: 59 in veto map, 12 cut by saddle test, 0 cut by aper test, 30 kept
SED z : 30 new peaks
Found 120 potential peaks
Of 120 potential peaks: 98 in veto map, 15 cut by saddle test, 0 cut by aper test, 7 kept
SED r : 7 new peaks
Found 63 potential peaks
Of 63 potential peaks: 55 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 114 potential peaks
Of 114 potential peaks: 94 in veto map, 14 cut by saddle test, 0 cut by aper test, 6 kept
SED Flat : 6 new peaks
Found 139 potential peaks
Of 139 potential peaks: 121 in veto map, 16 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 47 new sources
Median coadd sky for g : 4.5411947e-05
Median coadd sky for r : 0.00029718122
Median coadd sky for z : 0.00043605387
Stage srcs : Wall: 10.40 s, CPU: 10.34 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 262 MB, VmData: 289 MB, maxrss: 0.4562 MB
Stage srcs finished: 2020-06-06T17:45:15.173630
Resources for stage srcs : 0.167 s worker CPU, 0.167 s worker Wall, Wall: 10.401 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/PGC1233503-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/PGC1233503-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-06T17:45:15.189207
Blob 1 of 16, id: 2, sources: 31, size: 273x315, npix 44755, brick X: 0,273, Y: 0,315, one pixel: 156 0
Blob 2 of 16, id: 12, sources: 3, size: 68x48, npix 2047, brick X: 0,68, Y: 267,315, one pixel: 57 267
Blob 3 of 16, id: 11, sources: 5, size: 43x76, npix 1838, brick X: 208,251, Y: 239,315, one pixel: 237 239
Blob 4 of 16, id: 4, sources: 3, size: 34x66, npix 1683, brick X: 0,34, Y: 10,76, one pixel: 4 10
Blob 5 of 16, id: 5, sources: 2, size: 31x42, npix 844, brick X: 191,222, Y: 20,62, one pixel: 201 20
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 2.57 s, CPU: 2.22 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.147976 MB
Blob 6 of 16, id: 7, sources: 2, size: 39x30, npix 663, brick X: 228,267, Y: 60,90, one pixel: 240 60
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (318.56093, 2.64113), pm (-6.6, -24.1), parallax 1.392 with NanoMaggies: g=17.3, r=16.1, z=15.5
Reset brightness to NanoMaggies: g=17.3, r=16.1, z=15.6
Measuring 2 iterative sources
Blob 5 finished, total: Wall: 1.62 s, CPU: 1.62 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.147976 MB
Blob 7 of 16, id: 3, sources: 1, size: 29x24, npix 511, brick X: 252,281, Y: 0,24, one pixel: 258 0
Blob 3 finished, total: Wall: 5.65 s, CPU: 4.85 s, VmPeak: 965 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14722 MB
Blob 8 of 16, id: 10, sources: 1, size: 26x29, npix 507, brick X: 289,315, Y: 219,248, one pixel: 303 219
Blob 4 finished, total: Wall: 5.93 s, CPU: 5.17 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.1497 MB
Blob 9 of 16, id: 1, sources: 1, size: 26x26, npix 422, brick X: 74,100, Y: 0,26, one pixel: 86 0
Blob 6 finished, total: Wall: 2.13 s, CPU: 2.13 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.147976 MB
Blob 10 of 16, id: 6, sources: 1, size: 25x24, npix 388, brick X: 49,74, Y: 27,51, one pixel: 59 27
Blob 7 finished, total: Wall: 0.95 s, CPU: 0.95 s, VmPeak: 965 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14722 MB
Blob 11 of 16, id: 13, sources: 1, size: 23x22, npix 294, brick X: 270,293, Y: 279,301, one pixel: 281 279
Blob 8 finished, total: Wall: 0.72 s, CPU: 0.72 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.1497 MB
Blob 12 of 16, id: 14, sources: 1, size: 21x22, npix 280, brick X: 134,155, Y: 289,311, one pixel: 142 289
Blob 10 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 965 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14722 MB
Blob 13 of 16, id: 15, sources: 1, size: 22x17, npix 247, brick X: 280,302, Y: 298,315, one pixel: 289 298
Blob 9 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.147976 MB
Blob 14 of 16, id: 8, sources: 1, size: 19x20, npix 218, brick X: 8,27, Y: 95,115, one pixel: 16 95
Blob 13 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.147976 MB
Blob 15 of 16, id: 9, sources: 1, size: 18x18, npix 171, brick X: 282,300, Y: 146,164, one pixel: 291 146
Blob 11 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.1497 MB
Blob 16 of 16, id: 0, sources: 1, size: 18x15, npix 156, brick X: 37,55, Y: 0,15, one pixel: 43 0
Blob 14 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.147976 MB
Blob 12 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 965 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14722 MB
Blob 15 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.1497 MB
Blob 16 finished, total: Wall: 0.32 s, CPU: 0.31 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.147976 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.96681, ee1=0.104, ee2=-0.068774
Measuring 9 iterative sources
Blob 1 finished, total: Wall: 40.85 s, CPU: 40.84 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 151 MB, VmData: 182 MB, maxrss: 0.18216 MB
Old catalog: 61
New catalog: 61
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/metrics/cus/blobs-custom-318549p02649.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/metrics/cus/all-models-custom-318549p02649.fits
Stage fitblobs : Wall: 48.28 s, CPU: 7.45 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 265 MB, VmData: 291 MB, maxrss: 0.4562 MB
Stage fitblobs finished: 2020-06-06T17:46:03.465154
Resources for stage fitblobs : 61.904 s worker CPU, 63.857 s worker Wall, Wall: 48.277 s, Cores in use: 1.44, Total efficiency (on 4 cores): 35.9 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-06T17:46:03.467352
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/tmp-legacysurvey-custom-318549p02649-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/tmp-legacysurvey-custom-318549p02649-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/tmp-legacysurvey-custom-318549p02649-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/tmp-legacysurvey-custom-318549p02649-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-resid.jpg
Stage coadds : Wall: 8.08 s, CPU: 7.12 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 265 MB, VmData: 291 MB, maxrss: 0.4562 MB
Stage coadds finished: 2020-06-06T17:46:11.546138
Resources for stage coadds : 3.072 s worker CPU, 3.180 s worker Wall, Wall: 8.080 s, Cores in use: 1.26, Total efficiency (on 4 cores): 31.6 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-06T17:46:11.547693
Cut to 1 unWISE tiles
Reading WISE tile 3191p030 band 1
Reading WISE tile 3191p030 band 2
Reading WISE tile 3191p030 band 3
Reading WISE tile 3191p030 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3191p030/unwise-3191p030-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3191p030/unwise-3191p030-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3191p030/unwise-3191p030-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3191p030/unwise-3191p030-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3191p030/unwise-3191p030-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.15 s, CPU: 0.33 s, VmPeak: 1002 MB, VmSize: 1002 MB, VmRSS: 151 MB, VmData: 189 MB, maxrss: 0.191768 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3191p030/unwise-3191p030-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3191p030/unwise-3191p030-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3191p030/unwise-3191p030-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3191p030/unwise-3191p030-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.23 s, VmPeak: 1006 MB, VmSize: 1006 MB, VmRSS: 157 MB, VmData: 193 MB, maxrss: 0.221492 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3191p030/unwise-3191p030-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3191p030/unwise-3191p030-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3191p030/unwise-3191p030-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3191p030/unwise-3191p030-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.12 s, CPU: 0.30 s, VmPeak: 1000 MB, VmSize: 1000 MB, VmRSS: 148 MB, VmData: 187 MB, maxrss: 0.2108 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3191p030/unwise-3191p030-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3191p030/unwise-3191p030-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3191p030/unwise-3191p030-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3191p030/unwise-3191p030-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3191p030/unwise-3191p030-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.17 s, VmPeak: 1000 MB, VmSize: 1000 MB, VmRSS: 149 MB, VmData: 188 MB, maxrss: 0.211636 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/tmp-legacysurvey-custom-318549p02649-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/tmp-legacysurvey-custom-318549p02649-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 19.62 s, CPU: 10.58 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 266 MB, VmData: 291 MB, maxrss: 0.4562 MB
Stage wise_forced finished: 2020-06-06T17:46:31.170969
Resources for stage wise_forced : 4.033 s worker CPU, 15.279 s worker Wall, Wall: 19.624 s, Cores in use: 0.74, Total efficiency (on 4 cores): 18.6 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-06T17:46:31.172640
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/coadd/cus/custom-318549p02649/legacysurvey-custom-318549p02649-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/tractor-i/cus/tractor-custom-318549p02649.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/tractor/cus/tractor-custom-318549p02649.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC1233503/tractor/cus/brick-custom-318549p02649.sha256sum
Stage writecat : Wall: 7.55 s, CPU: 7.36 s, VmPeak: 1189 MB, VmSize: 1061 MB, VmRSS: 268 MB, VmData: 291 MB, maxrss: 0.4562 MB
Stage writecat finished: 2020-06-06T17:46:38.723394
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.552 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.4 %
Stage writecat finished
All done: 77.827 s worker CPU, 608.644 s worker Wall, Wall: 332.775 s, Cores in use: 0.46, Total efficiency (on 4 cores): 11.6 %
Finished galaxy PGC1233503 in 5.687 minutes.