Started working on galaxy PGC066951 at Thu Jun  4 10:04:04 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.3203695 11.6204257 --width 333 --height 333 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/PGC066951-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/PGC066951-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-04T10:04:05.347088
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '323.3203695', '11.6204257', '--width', '333', '--height', '333', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/PGC066951-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/PGC066951-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.3203695 11.6204257 --width 333 --height 333 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/PGC066951-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/PGC066951-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 323.3203695 11.6204257
Starting process 14300 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 14301 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 14302 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 14303 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 14304 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB
Starting process 14305 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057324 MB
Starting process 14306 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057324 MB
Starting process 14307 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-04T10:04:08.325171
Keeping 10 CCDs:
   c4d_140817_040414_ooi_g_ls9.fits.fz c4d_140817_040414_ooi_g_ls9-S19 g exptime 105.0 propid 2014B-0404 seeing 1.50 MJD 56886.168 object DECaLS_11830_g
   c4d_140816_034535_ooi_r_ls9.fits.fz c4d_140816_034535_ooi_r_ls9-S19 r exptime 77.0 propid 2014B-0404 seeing 0.97 MJD 56885.155 object DECaLS_11830_r
   c4d_140816_042843_ooi_z_ls9.fits.fz c4d_140816_042843_ooi_z_ls9-S19 z exptime 125.0 propid 2014B-0404 seeing 1.00 MJD 56885.185 object DECaLS_11830_z
   c4d_140818_030151_ooi_r_ls9.fits.fz c4d_140818_030151_ooi_r_ls9-S18 r exptime 76.0 propid 2014B-0404 seeing 1.28 MJD 56887.125 object DECaLS_27702_r
   c4d_180514_101944_ooi_z_ls9.fits.fz c4d_180514_101944_ooi_z_ls9-S18 z exptime 250.0 propid 2014B-0404 seeing 1.48 MJD 58252.430 object DECaLS_27702_z
   c4d_140818_040537_ooi_g_ls9.fits.fz c4d_140818_040537_ooi_g_ls9-S18 g exptime 89.0 propid 2014B-0404 seeing 1.63 MJD 56887.169 object DECaLS_27702_g
   c4d_160724_054431_ooi_z_ls9.fits.fz c4d_160724_054431_ooi_z_ls9-S18 z exptime 100.0 propid 2016A-0190 seeing 1.81 MJD 57593.238 object DECaLS_27702_z
   c4d_140814_040503_ooi_z_ls9.fits.fz c4d_140814_040503_ooi_z_ls9-S17 z exptime 250.0 propid 2014B-0404 seeing 1.04 MJD 56883.167 object DECaLS_43574_z
   c4d_140815_031411_ooi_r_ls9.fits.fz c4d_140815_031411_ooi_r_ls9-S17 r exptime 85.0 propid 2014B-0404 seeing 1.26 MJD 56884.133 object DECaLS_43574_r
   c4d_170724_045824_ooi_g_ls9.fits.fz c4d_170724_045824_ooi_g_ls9-S17 g exptime 200.0 propid 2014B-0404 seeing 1.97 MJD 57958.204 object DECaLS_43574_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9548395-r-20140816T034326_oi[S19,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a39a-g-20140817T040136_oi[S19,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954c6e6-z-20140814T040003_oi[S17,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b419-z-20160724T054200_oi[S18,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9548bbb-r-20140818T025944_oi[S18,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a39a-g-20140818T040315_oi[S18,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d16a-z-20140816T042546_oi[S19,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9548395-r-20140815T031155_oi[S17,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951f216-g-20170724T045408_oi[S17,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955e646-z-20180514T101944_oi[S18,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 80.63 s, CPU: 4.03 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 178 MB, VmData: 212 MB, maxrss: 0.448388 MB
Stage tims finished: 2020-06-04T10:05:28.958235
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954c6e6-z-20140814T040003_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b419-z-20160724T054200_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9548bbb-r-20140818T025944_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a39a-g-20140818T040315_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d16a-z-20140816T042546_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a39a-g-20140817T040136_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951f216-g-20170724T045408_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 5.471 s worker CPU, 202.883 s worker Wall, Wall: 80.635 s, Cores in use: 0.12, Total efficiency (on 8 cores): 1.5 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/PGC066951-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/PGC066951-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955e646-z-20180514T101944_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9548395-r-20140816T034326_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9548395-r-20140815T031155_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Running stage refs at 2020-06-04T10:05:28.982576
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04915.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04914.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05043.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04787.fits
Matched 11 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/metrics/cus/reference-custom-323320p11620.fits
Stage refs : Wall: 6.93 s, CPU: 6.13 s, VmPeak: 1062 MB, VmSize: 1056 MB, VmRSS: 241 MB, VmData: 272 MB, maxrss: 0.448388 MB
Stage refs finished: 2020-06-04T10:05:35.917148
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.936 s, Cores in use: 0.88, Total efficiency (on 8 cores): 11.0 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-04T10:05:35.918987
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/metrics/cus/outlier-mask-custom-323320p11620.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/metrics/cus/outliers-pre-custom-323320p11620.jpg
Image c4d_170724_045824_ooi_g_ls9-S17 g : masking 273 positive outlier pixels and 0 negative outlier pixels
Image c4d_140816_034535_ooi_r_ls9-S19 r : masking 133 positive outlier pixels and 0 negative outlier pixels
Image c4d_140815_031411_ooi_r_ls9-S17 r : masking 231 positive outlier pixels and 0 negative outlier pixels
Image c4d_180514_101944_ooi_z_ls9-S18 z : masking 447 positive outlier pixels and 0 negative outlier pixels
Image c4d_160724_054431_ooi_z_ls9-S18 z : masking 161 positive outlier pixels and 0 negative outlier pixels
Image c4d_140814_040503_ooi_z_ls9-S17 z : masking 1460 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/metrics/cus/outlier-mask-custom-323320p11620.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/metrics/cus/outliers-post-custom-323320p11620.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/metrics/cus/outliers-masked-pos-custom-323320p11620.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/metrics/cus/outliers-masked-neg-custom-323320p11620.jpg
Stage outliers : Wall: 3.79 s, CPU: 3.47 s, VmPeak: 1065 MB, VmSize: 1065 MB, VmRSS: 262 MB, VmData: 290 MB, maxrss: 0.448388 MB
Stage outliers finished: 2020-06-04T10:05:39.706173
Resources for stage outliers : 1.164 s worker CPU, 1.164 s worker Wall, Wall: 3.788 s, Cores in use: 1.22, Total efficiency (on 8 cores): 15.3 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-04T10:05:39.708120
Stage halos : Wall: 3.98 s, CPU: 3.08 s, VmPeak: 1065 MB, VmSize: 1065 MB, VmRSS: 262 MB, VmData: 290 MB, maxrss: 0.448388 MB
Stage halos finished: 2020-06-04T10:05:43.688186
Resources for stage halos : 0.451 s worker CPU, 5.162 s worker Wall, Wall: 3.982 s, Cores in use: 0.89, Total efficiency (on 8 cores): 11.1 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-04T10:05:43.690650
PSF sigmas in coadd pixels: ['2.44', '2.65', '3.20']
Using average PSF sigma 2.764528912961078
Gaussian PSF norm 0.10204081804003537 vs pixelized 0.08219699
average tim pixel scale / coadd scale: 1.0011758444695698
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.57', '2.08', '2.04']
Using average PSF sigma 1.9000324680933531
Gaussian PSF norm 0.14846840594095478 vs pixelized 0.12634969
average tim pixel scale / coadd scale: 1.0012058369666053
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.62', '2.41', '2.94', '1.69']
Using average PSF sigma 2.1652763842594567
Gaussian PSF norm 0.13028119358090956 vs pixelized 0.100132555
average tim pixel scale / coadd scale: 1.001126256874471
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.23 s, CPU: 0.23 s, VmPeak: 1065 MB, VmSize: 1065 MB, VmRSS: 264 MB, VmData: 290 MB, maxrss: 0.448388 MB
Stage fit_on_coadds finished: 2020-06-04T10:05:43.922470
Resources for stage fit_on_coadds : 0.285 s worker CPU, 0.287 s worker Wall, Wall: 0.233 s, Cores in use: 2.21, Total efficiency (on 8 cores): 27.7 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-04T10:05:43.925371
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 119 potential peaks
Of 119 potential peaks: 77 in veto map, 11 cut by saddle test, 0 cut by aper test, 31 kept
SED z : 31 new peaks
Found 121 potential peaks
Of 121 potential peaks: 108 in veto map, 9 cut by saddle test, 0 cut by aper test, 4 kept
SED r : 4 new peaks
Found 52 potential peaks
Of 52 potential peaks: 46 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 117 potential peaks
Of 117 potential peaks: 102 in veto map, 10 cut by saddle test, 0 cut by aper test, 5 kept
SED Flat : 5 new peaks
Found 141 potential peaks
Of 141 potential peaks: 128 in veto map, 13 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 42 new sources
Median coadd sky for g : 0.00016926194
Median coadd sky for r : 0.00043337143
Median coadd sky for z : 0.00092990237
Stage srcs : Wall: 2.63 s, CPU: 2.59 s, VmPeak: 1065 MB, VmSize: 1065 MB, VmRSS: 264 MB, VmData: 290 MB, maxrss: 0.448388 MB
Stage srcs finished: 2020-06-04T10:05:46.559999
Resources for stage srcs : 0.115 s worker CPU, 0.115 s worker Wall, Wall: 2.636 s, Cores in use: 1.03, Total efficiency (on 8 cores): 12.8 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/PGC066951-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/PGC066951-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-04T10:05:46.616816
Blob 1 of 15, id: 3, sources: 25, size: 269x278, npix 46798, brick X: 19,288, Y: 24,302, one pixel: 143 24
Blob 2 of 15, id: 12, sources: 5, size: 58x46, npix 1794, brick X: 275,333, Y: 287,333, one pixel: 305 287
Blob 3 of 15, id: 1, sources: 4, size: 49x53, npix 1729, brick X: 255,304, Y: 0,53, one pixel: 262 0
Blob 4 of 15, id: 0, sources: 2, size: 61x28, npix 1215, brick X: 55,116, Y: 0,28, one pixel: 63 0
Blob 5 of 15, id: 5, sources: 2, size: 37x48, npix 1022, brick X: 0,37, Y: 64,112, one pixel: 17 64
Blob 6 of 15, id: 8, sources: 1, size: 26x43, npix 840, brick X: 0,26, Y: 154,197, one pixel: 7 154
Blob 7 of 15, id: 6, sources: 1, size: 33x35, npix 805, brick X: 275,308, Y: 69,104, one pixel: 285 69
Blob 8 of 15, id: 7, sources: 1, size: 35x29, npix 604, brick X: 0,35, Y: 120,149, one pixel: 6 120
Blob 9 of 15, id: 4, sources: 2, size: 26x31, npix 570, brick X: 0,26, Y: 25,56, one pixel: 7 25
Blob 5 finished, total: Wall: 1.02 s, CPU: 1.01 s, VmPeak: 937 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146452 MB
Blob 10 of 15, id: 13, sources: 1, size: 28x28, npix 510, brick X: 204,232, Y: 305,333, one pixel: 219 305
Blob 4 finished, total: Wall: 1.20 s, CPU: 1.20 s, VmPeak: 948 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148308 MB
Blob 7 finished, total: Wall: 1.20 s, CPU: 1.20 s, VmPeak: 936 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148244 MB
Blob 11 of 15, id: 10, sources: 1, size: 21x23, npix 291, brick X: 53,74, Y: 244,267, one pixel: 62 244
Blob 12 of 15, id: 9, sources: 1, size: 18x21, npix 233, brick X: 0,18, Y: 226,247, one pixel: 7 226
Blob 6 finished, total: Wall: 1.29 s, CPU: 1.29 s, VmPeak: 941 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148884 MB
Blob 13 of 15, id: 2, sources: 1, size: 18x20, npix 205, brick X: 315,333, Y: 14,34, one pixel: 324 14
Blob 12 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 941 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148884 MB
Blob 14 of 15, id: 14, sources: 1, size: 17x17, npix 145, brick X: 42,59, Y: 310,327, one pixel: 50 310
Blob 13 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 941 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148884 MB
Blob 15 of 15, id: 11, sources: 1, size: 16x17, npix 144, brick X: 317,333, Y: 282,299, one pixel: 325 282
Blob 14 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 941 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148884 MB
Blob 8 finished, total: Wall: 1.61 s, CPU: 1.61 s, VmPeak: 954 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14826 MB
Blob 11 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 936 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148244 MB
Blob 10 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 948 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148308 MB
Blob 9 finished, total: Wall: 1.44 s, CPU: 1.44 s, VmPeak: 937 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148188 MB
Blob 15 finished, total: Wall: 1.12 s, CPU: 1.12 s, VmPeak: 941 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148884 MB
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 3.62 s, CPU: 3.62 s, VmPeak: 960 MB, VmSize: 715 MB, VmRSS: 142 MB, VmData: 178 MB, maxrss: 0.145012 MB
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 4.42 s, CPU: 4.42 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.14648 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.966707, ee1=-0.0270322, ee2=0.0197919
Measuring 7 iterative sources
Blob 1 finished, total: Wall: 37.40 s, CPU: 37.40 s, VmPeak: 964 MB, VmSize: 728 MB, VmRSS: 160 MB, VmData: 191 MB, maxrss: 0.180824 MB
Old catalog: 53
New catalog: 53
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/metrics/cus/blobs-custom-323320p11620.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/metrics/cus/all-models-custom-323320p11620.fits
Stage fitblobs : Wall: 40.06 s, CPU: 2.63 s, VmPeak: 1065 MB, VmSize: 1065 MB, VmRSS: 265 MB, VmData: 291 MB, maxrss: 0.448388 MB
Stage fitblobs finished: 2020-06-04T10:06:26.672739
Resources for stage fitblobs : 56.014 s worker CPU, 56.122 s worker Wall, Wall: 40.058 s, Cores in use: 1.46, Total efficiency (on 8 cores): 18.3 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-04T10:06:26.675362
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/tmp-legacysurvey-custom-323320p11620-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/tmp-legacysurvey-custom-323320p11620-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/tmp-legacysurvey-custom-323320p11620-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/tmp-legacysurvey-custom-323320p11620-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-resid.jpg
Stage coadds : Wall: 4.41 s, CPU: 3.50 s, VmPeak: 1065 MB, VmSize: 1065 MB, VmRSS: 265 MB, VmData: 291 MB, maxrss: 0.448388 MB
Stage coadds finished: 2020-06-04T10:06:31.082328
Resources for stage coadds : 4.599 s worker CPU, 5.138 s worker Wall, Wall: 4.408 s, Cores in use: 1.84, Total efficiency (on 8 cores): 23.0 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-04T10:06:31.084208
Cut to 1 unWISE tiles
Reading WISE tile 3229p121 band 2
Reading WISE tile 3229p121 band 3
Reading WISE tile 3229p121 band 4
Reading WISE tile 3229p121 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3229p121/unwise-3229p121-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/322/3229p121/unwise-3229p121-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/322/3229p121/unwise-3229p121-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/322/3229p121/unwise-3229p121-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/322/3229p121/unwise-3229p121-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.13 s, CPU: 0.13 s, VmPeak: 957 MB, VmSize: 798 MB, VmRSS: 150 MB, VmData: 177 MB, maxrss: 0.18896 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3229p121/unwise-3229p121-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/322/3229p121/unwise-3229p121-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/322/3229p121/unwise-3229p121-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/322/3229p121/unwise-3229p121-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/322/3229p121/unwise-3229p121-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 941 MB, VmSize: 796 MB, VmRSS: 148 MB, VmData: 175 MB, maxrss: 0.209296 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3229p121/unwise-3229p121-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3229p121/unwise-3229p121-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3229p121/unwise-3229p121-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3229p121/unwise-3229p121-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 960 MB, VmSize: 792 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.20604 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3229p121/unwise-3229p121-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3229p121/unwise-3229p121-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3229p121/unwise-3229p121-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3229p121/unwise-3229p121-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 954 MB, VmSize: 795 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.21052 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/tmp-legacysurvey-custom-323320p11620-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/tmp-legacysurvey-custom-323320p11620-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 4.48 s, CPU: 2.35 s, VmPeak: 1065 MB, VmSize: 1065 MB, VmRSS: 266 MB, VmData: 291 MB, maxrss: 0.448388 MB
Stage wise_forced finished: 2020-06-04T10:06:35.565149
Resources for stage wise_forced : 3.466 s worker CPU, 5.991 s worker Wall, Wall: 4.482 s, Cores in use: 1.30, Total efficiency (on 8 cores): 16.2 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-04T10:06:35.567354
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/coadd/cus/custom-323320p11620/legacysurvey-custom-323320p11620-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/tractor-i/cus/tractor-custom-323320p11620.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/tractor/cus/tractor-custom-323320p11620.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC066951/tractor/cus/brick-custom-323320p11620.sha256sum
Stage writecat : Wall: 2.60 s, CPU: 2.38 s, VmPeak: 1197 MB, VmSize: 1069 MB, VmRSS: 268 MB, VmData: 291 MB, maxrss: 0.448388 MB
Stage writecat finished: 2020-06-04T10:06:38.167529
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.601 s, Cores in use: 0.92, Total efficiency (on 8 cores): 11.4 %
Stage writecat finished
All done: 71.567 s worker CPU, 276.866 s worker Wall, Wall: 149.847 s, Cores in use: 0.68, Total efficiency (on 8 cores): 8.5 %
Finished galaxy PGC066951 in 2.569 minutes.