Started working on galaxy PGC2329644 at Sun Jun  7 19:00:23 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 233.5347975 48.951076799999996 --width 233 --height 233 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/PGC2329644-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/PGC2329644-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T19:00:25.262542
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '233.5347975', '48.951076799999996', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/PGC2329644-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/PGC2329644-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 233.5347975 48.951076799999996 --width 233 --height 233 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/PGC2329644-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/PGC2329644-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 233.5347975 48.951076799999996
Starting process 56554 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 56555 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 56556 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 56557 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T19:00:25.691288
Keeping 9 CCDs:
   k4m_160520_072755_ooi_zd_ls9.fits.fz k4m_160520_072755_ooi_zd_ls9-CCD3 z exptime 80.104 propid 2016A-0453 seeing 0.96 MJD 57528.311 object MzLS_645386_z
   k4m_160517_072110_ooi_zd_ls9.fits.fz k4m_160517_072110_ooi_zd_ls9-CCD1 z exptime 156.103 propid 2016A-0453 seeing 1.32 MJD 57525.306 object MzLS_646210_z
   k4m_170505_085946_ooi_zd_ls9.fits.fz k4m_170505_085946_ooi_zd_ls9-CCD2 z exptime 91.103 propid 2016A-0453 seeing 1.04 MJD 57878.375 object MzLS_644560_z
   ksb_170330_105906_ooi_g_ls9.fits.fz ksb_170330_105906_ooi_g_ls9-CCD1 g exptime 80.092 propid BASS seeing 1.58 MJD 57842.458 object 25773
   ksb_170421_103231_ooi_r_ls9.fits.fz ksb_170421_103231_ooi_r_ls9-CCD1 r exptime 116.161 propid BASS seeing 1.67 MJD 57864.439 object 25773
   ksb_160314_113608_ooi_g_ls9.fits.fz ksb_160314_113608_ooi_g_ls9-CCD4 g exptime 50.0 propid 2015A-0801 seeing 1.19 MJD 57461.483 object 25771
   ksb_160511_084713_ooi_r_ls9.fits.fz ksb_160511_084713_ooi_r_ls9-CCD4 r exptime 50.1 propid BASS seeing 1.08 MJD 57519.366 object 25771
   ksb_160611_073848_ooi_r_ls9.fits.fz ksb_160611_073848_ooi_r_ls9-CCD4 r exptime 65.5 propid BASS seeing 1.17 MJD 57550.319 object 25772
   ksb_160603_050143_ooi_g_ls9.fits.fz ksb_160603_050143_ooi_g_ls9-CCD4 g exptime 79.8 propid BASS seeing 1.60 MJD 57542.210 object 25772
Faked up EXPNUM 78420224
Faked up EXPNUM 78420224
Faked up EXPNUM 78420224
90prime get_fwhm: self.fwhm = 3.49
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2420 2557 and amp range 2016 4031 and image y 2587 2724 and amp range 2048 4095
Range in image: x 0 138 , y 0 138 (with image size 138 x 138)
dzp 0.020521455 -> scaling image by 1.0190807119283773
mosaic get_fwhm: self.fwhm = 3.71
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3572 3807 and amp range 2006 4053 and image y 2403 2640 and amp range 2040 4078
Range in image: x 0 236 , y 0 238 (with image size 236 x 238)
dzp -0.0026360443 -> scaling image by 0.99757505842151
mosaic get_fwhm: self.fwhm = 5.07
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 826 1064 and amp range 0 2005 and image y 3492 3727 and amp range 2040 4078
Range in image: x 0 239 , y 0 236 (with image size 239 x 236)
dzp -0.005990375 -> scaling image by 0.994497853444703
mosaic get_fwhm: self.fwhm = 3.99
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1985 2223 and amp range 0 2047 and image y 1042 1281 and amp range 0 2039
Range in image: x 0 63 , y 0 240 (with image size 239 x 240)
dzp -0.0096683735 -> scaling image by 0.9911346301237048
Found overlap: image x 1985 2223 and amp range 2048 4095 and image y 1042 1281 and amp range 0 2039
Range in image: x 63 239 , y 0 240 (with image size 239 x 240)
dzp 0.0044767857 -> scaling image by 1.004131784351374
Faked up EXPNUM 78640217
Faked up EXPNUM 78640217
Faked up EXPNUM 78640217
90prime get_fwhm: self.fwhm = 3.69
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2426 2562 and amp range 2016 4031 and image y 2574 2710 and amp range 2048 4095
Range in image: x 0 137 , y 0 137 (with image size 137 x 137)
dzp 0.02308583 -> scaling image by 1.021490500713915
Faked up EXPNUM 75190179
Faked up EXPNUM 75190179
Faked up EXPNUM 75190179
90prime get_fwhm: self.fwhm = 2.39
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 265 401 and amp range 0 2015 and image y 99 234 and amp range 0 2047
Range in image: x 0 137 , y 0 136 (with image size 137 x 136)
dzp 0.009781551 -> scaling image by 1.0090498455107675
Faked up EXPNUM 74610231
Faked up EXPNUM 74610231
Faked up EXPNUM 74610231
90prime get_fwhm: self.fwhm = 2.63
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 255 391 and amp range 0 2015 and image y 93 229 and amp range 0 2047
Range in image: x 0 137 , y 0 137 (with image size 137 x 137)
dzp 0.009539392 -> scaling image by 1.0088248156909383
Faked up EXPNUM 75500089
Faked up EXPNUM 75500089
Faked up EXPNUM 75500089
90prime get_fwhm: self.fwhm = 2.59
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2260 2397 and amp range 2016 4031 and image y 2090 2226 and amp range 2048 4095
Range in image: x 0 138 , y 0 137 (with image size 138 x 137)
dzp -0.0036899033 -> scaling image by 0.9966072419211972
Faked up EXPNUM 75420039
Faked up EXPNUM 75420039
Faked up EXPNUM 75420039
90prime get_fwhm: self.fwhm = 3.53
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2259 2395 and amp range 2016 4031 and image y 2100 2235 and amp range 2048 4095
Range in image: x 0 137 , y 0 136 (with image size 137 x 136)
dzp 0.0013913503 -> scaling image by 1.001282302423891
Stage tims : Wall: 7.08 s, CPU: 0.87 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 170 MB, VmData: 204 MB, maxrss: 0.567852 MB
Stage tims finished: 2020-06-07T19:00:32.771774
Resources for stage tims : 3.618 s worker CPU, 15.615 s worker Wall, Wall: 7.082 s, Cores in use: 0.63, Total efficiency (on 4 cores): 15.8 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/PGC2329644-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/PGC2329644-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T19:00:32.791435
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01584.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01473.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01474.fits
Matched 6 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/metrics/cus/reference-custom-233534p48951.fits
Stage refs : Wall: 2.49 s, CPU: 1.62 s, VmPeak: 972 MB, VmSize: 958 MB, VmRSS: 187 MB, VmData: 220 MB, maxrss: 0.567852 MB
Stage refs finished: 2020-06-07T19:00:35.284278
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.494 s, Cores in use: 0.65, Total efficiency (on 4 cores): 16.2 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T19:00:35.285799
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/metrics/cus/outlier-mask-custom-233534p48951.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/metrics/cus/outliers-pre-custom-233534p48951.jpg
Image k4m_160520_072755_ooi_zd_ls9-CCD3 z : masking 308 positive outlier pixels and 0 negative outlier pixels
Image k4m_170505_085946_ooi_zd_ls9-CCD2 z : masking 368 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/metrics/cus/outlier-mask-custom-233534p48951.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/metrics/cus/outliers-post-custom-233534p48951.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/metrics/cus/outliers-masked-pos-custom-233534p48951.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/metrics/cus/outliers-masked-neg-custom-233534p48951.jpg
Stage outliers : Wall: 0.94 s, CPU: 0.70 s, VmPeak: 972 MB, VmSize: 967 MB, VmRSS: 198 MB, VmData: 229 MB, maxrss: 0.567852 MB
Stage outliers finished: 2020-06-07T19:00:36.226893
Resources for stage outliers : 0.728 s worker CPU, 0.745 s worker Wall, Wall: 0.942 s, Cores in use: 1.51, Total efficiency (on 4 cores): 37.8 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T19:00:36.228889
Stage halos : Wall: 0.29 s, CPU: 0.28 s, VmPeak: 972 MB, VmSize: 967 MB, VmRSS: 198 MB, VmData: 229 MB, maxrss: 0.567852 MB
Stage halos finished: 2020-06-07T19:00:36.521717
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.294 s, Cores in use: 0.96, Total efficiency (on 4 cores): 24.0 %
Stage halos finished
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-06-07T19:00:36.523607
PSF sigmas in coadd pixels: ['2.57', '1.94', '2.60']
Using average PSF sigma 2.3677260150622295
Gaussian PSF norm 0.11914165320621527 vs pixelized 0.10556128
average tim pixel scale / coadd scale: 1.7298655211214573
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.71', '1.76', '1.91']
Using average PSF sigma 2.1269582454137304
Gaussian PSF norm 0.13262826968143224 vs pixelized 0.10403064
average tim pixel scale / coadd scale: 1.7296192493957985
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.56', '2.14', '1.68']
Using average PSF sigma 1.7948079706891809
Gaussian PSF norm 0.15717268720706526 vs pixelized 0.13205898
average tim pixel scale / coadd scale: 0.9908610914890718
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.19 s, CPU: 0.16 s, VmPeak: 972 MB, VmSize: 967 MB, VmRSS: 201 MB, VmData: 231 MB, maxrss: 0.567852 MB
Stage fit_on_coadds finished: 2020-06-07T19:00:36.718272
Resources for stage fit_on_coadds : 0.167 s worker CPU, 0.172 s worker Wall, Wall: 0.196 s, Cores in use: 1.69, Total efficiency (on 4 cores): 42.2 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T19:00:36.721017
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 7 potential peaks
Of 7 potential peaks: 1 in veto map, 0 cut by saddle test, 0 cut by aper test, 6 kept
SED z : 6 new peaks
Found 8 potential peaks
Of 8 potential peaks: 5 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 5 potential peaks
Of 5 potential peaks: 4 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 14 potential peaks
Of 14 potential peaks: 10 in veto map, 1 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 14 potential peaks
Of 14 potential peaks: 11 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 13 new sources
Median coadd sky for g : 4.7518515e-05
Median coadd sky for r : 0.0001221521
Median coadd sky for z : 0.0001611028
Stage srcs : Wall: 0.53 s, CPU: 0.47 s, VmPeak: 972 MB, VmSize: 967 MB, VmRSS: 202 MB, VmData: 231 MB, maxrss: 0.567852 MB
Stage srcs finished: 2020-06-07T19:00:37.247821
Resources for stage srcs : 0.101 s worker CPU, 0.107 s worker Wall, Wall: 0.528 s, Cores in use: 1.08, Total efficiency (on 4 cores): 27.1 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/PGC2329644-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/PGC2329644-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T19:00:37.263270
Blob 1 of 12, id: 3, sources: 3, size: 68x108, npix 4840, brick X: 82,150, Y: 55,163, one pixel: 114 55
Blob 2 of 12, id: 5, sources: 1, size: 32x30, npix 609, brick X: 26,58, Y: 109,139, one pixel: 37 109
Blob 3 of 12, id: 4, sources: 1, size: 29x28, npix 553, brick X: 0,29, Y: 98,126, one pixel: 10 98
Blob 4 of 12, id: 2, sources: 1, size: 29x26, npix 510, brick X: 153,182, Y: 42,68, one pixel: 164 42
Blob 5 of 12, id: 1, sources: 1, size: 23x23, npix 317, brick X: 50,73, Y: 24,47, one pixel: 61 24
Blob 6 of 12, id: 7, sources: 1, size: 23x22, npix 313, brick X: 137,160, Y: 160,182, one pixel: 146 160
Blob 2 finished, total: Wall: 1.20 s, CPU: 1.20 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141716 MB
Blob 7 of 12, id: 6, sources: 1, size: 22x23, npix 304, brick X: 111,133, Y: 158,181, one pixel: 122 158
Blob 4 finished, total: Wall: 1.25 s, CPU: 1.25 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.141984 MB
Blob 8 of 12, id: 0, sources: 1, size: 19x23, npix 278, brick X: 0,19, Y: 24,47, one pixel: 7 24
Blob 5 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141716 MB
Blob 6 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.14254 MB
Blob 9 of 12, id: 9, sources: 1, size: 20x20, npix 247, brick X: 79,99, Y: 188,208, one pixel: 87 188
Blob 10 of 12, id: 10, sources: 1, size: 19x19, npix 217, brick X: 67,86, Y: 206,225, one pixel: 75 206
Blob 8 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.14254 MB
Blob 11 of 12, id: 11, sources: 1, size: 19x17, npix 193, brick X: 100,119, Y: 216,233, one pixel: 108 216
Blob 3 finished, total: Wall: 1.95 s, CPU: 1.94 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14182 MB
Blob 12 of 12, id: 8, sources: 1, size: 18x18, npix 180, brick X: 70,88, Y: 164,182, one pixel: 78 164
Blob 9 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.14254 MB
Blob 7 finished, total: Wall: 0.54 s, CPU: 0.53 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141716 MB
Blob 11 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.14254 MB
Blob 12 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141716 MB
Blob 10 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142416 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.22292, ee1=0.116772, ee2=0.205611
Blob 1 finished, total: Wall: 2.28 s, CPU: 2.27 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142228 MB
Old catalog: 17
New catalog: 12
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/metrics/cus/blobs-custom-233534p48951.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/metrics/cus/all-models-custom-233534p48951.fits
Stage fitblobs : Wall: 2.69 s, CPU: 0.39 s, VmPeak: 972 MB, VmSize: 967 MB, VmRSS: 202 MB, VmData: 231 MB, maxrss: 0.567852 MB
Stage fitblobs finished: 2020-06-07T19:00:39.954468
Resources for stage fitblobs : 8.743 s worker CPU, 8.775 s worker Wall, Wall: 2.692 s, Cores in use: 3.39, Total efficiency (on 4 cores): 84.8 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T19:00:39.956364
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/tmp-legacysurvey-custom-233534p48951-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/tmp-legacysurvey-custom-233534p48951-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/tmp-legacysurvey-custom-233534p48951-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/tmp-legacysurvey-custom-233534p48951-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-resid.jpg
Stage coadds : Wall: 1.40 s, CPU: 0.78 s, VmPeak: 972 MB, VmSize: 967 MB, VmRSS: 203 MB, VmData: 231 MB, maxrss: 0.567852 MB
Stage coadds finished: 2020-06-07T19:00:41.353588
Resources for stage coadds : 1.693 s worker CPU, 1.757 s worker Wall, Wall: 1.398 s, Cores in use: 1.77, Total efficiency (on 4 cores): 44.2 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T19:00:41.355283
Cut to 1 unWISE tiles
Reading WISE tile 2339p484 band 1
Reading WISE tile 2339p484 band 2
Reading WISE tile 2339p484 band 3
Reading WISE tile 2339p484 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p484/unwise-2339p484-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2339p484/unwise-2339p484-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2339p484/unwise-2339p484-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2339p484/unwise-2339p484-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2339p484/unwise-2339p484-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 804 MB, VmSize: 793 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.188232 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p484/unwise-2339p484-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2339p484/unwise-2339p484-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2339p484/unwise-2339p484-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2339p484/unwise-2339p484-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2339p484/unwise-2339p484-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 803 MB, VmSize: 788 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.203908 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p484/unwise-2339p484-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p484/unwise-2339p484-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p484/unwise-2339p484-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p484/unwise-2339p484-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 804 MB, VmSize: 788 MB, VmRSS: 139 MB, VmData: 169 MB, maxrss: 0.203508 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p484/unwise-2339p484-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p484/unwise-2339p484-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p484/unwise-2339p484-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p484/unwise-2339p484-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 803 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 173 MB, maxrss: 0.207524 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/tmp-legacysurvey-custom-233534p48951-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/tmp-legacysurvey-custom-233534p48951-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.44 s, CPU: 0.47 s, VmPeak: 972 MB, VmSize: 967 MB, VmRSS: 203 MB, VmData: 231 MB, maxrss: 0.567852 MB
Stage wise_forced finished: 2020-06-07T19:00:43.799196
Resources for stage wise_forced : 4.896 s worker CPU, 6.469 s worker Wall, Wall: 2.445 s, Cores in use: 2.19, Total efficiency (on 4 cores): 54.8 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T19:00:43.801019
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/coadd/cus/custom-233534p48951/legacysurvey-custom-233534p48951-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/tractor-i/cus/tractor-custom-233534p48951.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/tractor/cus/tractor-custom-233534p48951.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2329644/tractor/cus/brick-custom-233534p48951.sha256sum
Stage writecat : Wall: 0.80 s, CPU: 0.45 s, VmPeak: 1099 MB, VmSize: 971 MB, VmRSS: 205 MB, VmData: 231 MB, maxrss: 0.567852 MB
Stage writecat finished: 2020-06-07T19:00:44.604242
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.804 s, Cores in use: 0.56, Total efficiency (on 4 cores): 14.0 %
Stage writecat finished
All done: 19.948 s worker CPU, 33.643 s worker Wall, Wall: 18.919 s, Cores in use: 1.38, Total efficiency (on 4 cores): 34.6 %
Finished galaxy PGC2329644 in 0.357 minutes.