Started working on galaxy PGC2165335 at Sun Jun  7 19:47:08 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 157.35491549999998 40.406343799999995 --width 265 --height 265 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/PGC2165335-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/PGC2165335-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T19:47:10.520044
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '157.35491549999998', '40.406343799999995', '--width', '265', '--height', '265', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/PGC2165335-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/PGC2165335-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 157.35491549999998 40.406343799999995 --width 265 --height 265 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/PGC2165335-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/PGC2165335-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 157.35491549999998 40.406343799999995
Starting process 58569 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 58570 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 58571 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 58572 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T19:47:10.949819
Keeping 9 CCDs:
   k4m_160217_082133_ooi_zd_ls9.fits.fz k4m_160217_082133_ooi_zd_ls9-CCD2 z exptime 80.105 propid 2016A-0453 seeing 0.71 MJD 57435.348 object MzLS_605072_z
   k4m_160429_044723_ooi_zd_ls9.fits.fz k4m_160429_044723_ooi_zd_ls9-CCD1 z exptime 84.102 propid 2016A-0453 seeing 1.44 MJD 57507.200 object MzLS_606984_z
   k4m_160302_080620_ooi_zd_ls9.fits.fz k4m_160302_080620_ooi_zd_ls9-CCD4 z exptime 80.104 propid 2016A-0453 seeing 0.97 MJD 57449.338 object MzLS_606029_z
   ksb_160217_081517_ooi_r_ls9.fits.fz ksb_160217_081517_ooi_r_ls9-CCD1 r exptime 115.6 propid 2015A-0801 seeing 1.23 MJD 57435.344 object 14011
   ksb_170523_040257_ooi_g_ls9.fits.fz ksb_170523_040257_ooi_g_ls9-CCD1 g exptime 123.648 propid 2015A-0801 seeing 1.44 MJD 57896.169 object 14011
   ksb_170304_074705_ooi_r_ls9.fits.fz ksb_170304_074705_ooi_r_ls9-CCD2 r exptime 72.822 propid BASS seeing 1.48 MJD 57816.324 object 15323
   ksb_170302_092735_ooi_g_ls9.fits.fz ksb_170302_092735_ooi_g_ls9-CCD2 g exptime 119.719 propid BASS seeing 1.71 MJD 57814.394 object 15323
   ksb_160211_084139_ooi_g_ls9.fits.fz ksb_160211_084139_ooi_g_ls9-CCD3 g exptime 112.6 propid 2015A-0801 seeing 1.45 MJD 57429.362 object 14012
   ksb_160216_081427_ooi_r_ls9.fits.fz ksb_160216_081427_ooi_r_ls9-CCD3 r exptime 149.4 propid 2015A-0801 seeing 1.86 MJD 57434.343 object 14012
mosaic get_fwhm: self.fwhm = 5.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1606 1875 and amp range 0 2005 and image y 1913 2183 and amp range 0 2039
Range in image: x 0 270 , y 0 127 (with image size 270 x 271)
dzp -0.011066288 -> scaling image by 0.989859339076806
Found overlap: image x 1606 1875 and amp range 0 2005 and image y 1913 2183 and amp range 2040 4078
Range in image: x 0 270 , y 127 271 (with image size 270 x 271)
dzp -0.005990375 -> scaling image by 0.994497853444703
Faked up EXPNUM 74350121
Faked up EXPNUM 74350121
Faked up EXPNUM 74350121
90prime get_fwhm: self.fwhm = 2.71
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 778 933 and amp range 0 2015 and image y 3509 3663 and amp range 2048 4095
Range in image: x 0 156 , y 0 155 (with image size 156 x 155)
dzp -0.00015519658 -> scaling image by 0.9998570688798908
mosaic get_fwhm: self.fwhm = 2.73
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2757 3032 and amp range 2048 4095 and image y 680 954 and amp range 0 2039
Range in image: x 0 276 , y 0 275 (with image size 276 x 275)
dzp 0.0072022504 -> scaling image by 1.0066555682883527
mosaic get_fwhm: self.fwhm = 3.75
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 99 316 and amp range 0 2047 and image y 2750 3020 and amp range 2022 4060
Range in image: x 0 218 , y 0 271 (with image size 218 x 271)
dzp 0.0033053984 -> scaling image by 1.0030490232713904
Faked up EXPNUM 78160120
Faked up EXPNUM 78160120
Faked up EXPNUM 78160120
90prime get_fwhm: self.fwhm = 3.27
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2560 2715 and amp range 2016 4031 and image y 2642 2796 and amp range 2048 4095
Range in image: x 0 156 , y 0 155 (with image size 156 x 155)
dzp 0.021366077 -> scaling image by 1.0198737893800265
Faked up EXPNUM 78960045
Faked up EXPNUM 78960045
Faked up EXPNUM 78960045
90prime get_fwhm: self.fwhm = 3.19
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 791 946 and amp range 0 2015 and image y 3510 3664 and amp range 2048 4095
Range in image: x 0 156 , y 0 155 (with image size 156 x 155)
dzp -0.034377232 -> scaling image by 0.9688334104074875
Faked up EXPNUM 74290185
Faked up EXPNUM 74290185
Faked up EXPNUM 74290185
90prime get_fwhm: self.fwhm = 3.21
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2808 2962 and amp range 2016 4031 and image y 1050 1204 and amp range 0 2047
Range in image: x 0 155 , y 0 155 (with image size 155 x 155)
dzp -0.0022715968 -> scaling image by 0.9979099691834846
Faked up EXPNUM 78140222
Faked up EXPNUM 78140222
Faked up EXPNUM 78140222
90prime get_fwhm: self.fwhm = 3.77
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2567 2721 and amp range 2016 4031 and image y 2646 2800 and amp range 2048 4095
Range in image: x 0 155 , y 0 155 (with image size 155 x 155)
dzp 0.010008041 -> scaling image by 1.0092603604948323
Faked up EXPNUM 74340125
Faked up EXPNUM 74340125
Faked up EXPNUM 74340125
90prime get_fwhm: self.fwhm = 4.11
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2800 2953 and amp range 2016 4031 and image y 1033 1186 and amp range 0 2047
Range in image: x 0 154 , y 0 154 (with image size 154 x 154)
dzp 0.004245165 -> scaling image by 1.0039175950705865
Stage tims : Wall: 5.58 s, CPU: 0.88 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 171 MB, VmData: 204 MB, maxrss: 0.567824 MB
Stage tims finished: 2020-06-07T19:47:16.527093
Resources for stage tims : 3.238 s worker CPU, 15.040 s worker Wall, Wall: 5.578 s, Cores in use: 0.74, Total efficiency (on 4 cores): 18.5 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/PGC2165335-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/PGC2165335-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T19:47:16.549808
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02168.fits
Matched 26 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/metrics/cus/reference-custom-157354p40406.fits
Stage refs : Wall: 1.68 s, CPU: 1.37 s, VmPeak: 972 MB, VmSize: 953 MB, VmRSS: 184 MB, VmData: 216 MB, maxrss: 0.567824 MB
Stage refs finished: 2020-06-07T19:47:18.231004
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.682 s, Cores in use: 0.81, Total efficiency (on 4 cores): 20.4 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T19:47:18.232577
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/metrics/cus/outlier-mask-custom-157354p40406.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/metrics/cus/outliers-pre-custom-157354p40406.jpg
Image k4m_160429_044723_ooi_zd_ls9-CCD1 z : masking 0 positive outlier pixels and 154 negative outlier pixels
Image k4m_160217_082133_ooi_zd_ls9-CCD2 z : masking 134 positive outlier pixels and 0 negative outlier pixels
Image k4m_160302_080620_ooi_zd_ls9-CCD4 z : masking 878 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/metrics/cus/outlier-mask-custom-157354p40406.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/metrics/cus/outliers-post-custom-157354p40406.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/metrics/cus/outliers-masked-pos-custom-157354p40406.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/metrics/cus/outliers-masked-neg-custom-157354p40406.jpg
Stage outliers : Wall: 0.88 s, CPU: 0.64 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 197 MB, VmData: 228 MB, maxrss: 0.567824 MB
Stage outliers finished: 2020-06-07T19:47:19.114311
Resources for stage outliers : 0.840 s worker CPU, 0.888 s worker Wall, Wall: 0.883 s, Cores in use: 1.68, Total efficiency (on 4 cores): 41.9 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T19:47:19.116004
Stage halos : Wall: 0.21 s, CPU: 0.20 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 198 MB, VmData: 228 MB, maxrss: 0.567824 MB
Stage halos finished: 2020-06-07T19:47:19.326327
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.211 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.2 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-07T19:47:19.328063
PSF sigmas in coadd pixels: ['2.35', '2.78', '2.36']
Using average PSF sigma 2.4948220583830563
Gaussian PSF norm 0.11307210902115777 vs pixelized 0.09547694
average tim pixel scale / coadd scale: 1.7293943723180252
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.99', '2.41', '3.02']
Using average PSF sigma 2.475005126735929
Gaussian PSF norm 0.11397745755214199 vs pixelized 0.09599732
average tim pixel scale / coadd scale: 1.7292867325786643
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.15', '2.34', '1.58']
Using average PSF sigma 1.6908701441948486
Gaussian PSF norm 0.16683409588984424 vs pixelized 0.16615087
average tim pixel scale / coadd scale: 0.9909144114838017
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.20 s, CPU: 0.18 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 199 MB, VmData: 228 MB, maxrss: 0.567824 MB
Stage fit_on_coadds finished: 2020-06-07T19:47:19.530609
Resources for stage fit_on_coadds : 0.202 s worker CPU, 0.225 s worker Wall, Wall: 0.204 s, Cores in use: 1.90, Total efficiency (on 4 cores): 47.5 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T19:47:19.533132
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 49 potential peaks
Of 49 potential peaks: 18 in veto map, 6 cut by saddle test, 0 cut by aper test, 25 kept
SED z : 25 new peaks
Found 43 potential peaks
Of 43 potential peaks: 39 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept
SED r : 0 new peaks
Found 36 potential peaks
Of 36 potential peaks: 31 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 51 potential peaks
Of 51 potential peaks: 41 in veto map, 7 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 73 potential peaks
Of 73 potential peaks: 57 in veto map, 13 cut by saddle test, 0 cut by aper test, 3 kept
SED Red : 3 new peaks
Adding 31 new sources
Median coadd sky for g : 0.0002525856
Median coadd sky for r : 0.0008280596
Median coadd sky for z : -0.0002379964
Stage srcs : Wall: 0.57 s, CPU: 0.52 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 200 MB, VmData: 228 MB, maxrss: 0.567824 MB
Stage srcs finished: 2020-06-07T19:47:20.107584
Resources for stage srcs : 0.115 s worker CPU, 0.115 s worker Wall, Wall: 0.575 s, Cores in use: 1.11, Total efficiency (on 4 cores): 27.8 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/PGC2165335-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/PGC2165335-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T19:47:20.122987
Blob 1 of 12, id: 6, sources: 16, size: 172x200, npix 21003, brick X: 48,220, Y: 65,265, one pixel: 191 65
Blob 2 of 12, id: 5, sources: 3, size: 56x100, npix 3540, brick X: 0,56, Y: 37,137, one pixel: 26 37
Blob 3 of 12, id: 1, sources: 2, size: 63x34, npix 1492, brick X: 144,207, Y: 0,34, one pixel: 162 0
Blob 4 of 12, id: 2, sources: 3, size: 48x43, npix 1196, brick X: 217,265, Y: 0,43, one pixel: 225 0
Blob 5 of 12, id: 4, sources: 1, size: 43x39, npix 938, brick X: 123,166, Y: 33,72, one pixel: 132 33
Measuring 5 iterative sources
Measuring 1 iterative sources
Measuring 2 iterative sources
Blob 3 finished, total: Wall: 3.35 s, CPU: 3.32 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.143948 MB
Blob 6 of 12, id: 7, sources: 2, size: 39x39, npix 872, brick X: 225,264, Y: 83,122, one pixel: 247 83
Blob 4 finished, total: Wall: 3.60 s, CPU: 3.60 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.143912 MB
Blob 7 of 12, id: 0, sources: 1, size: 31x22, npix 464, brick X: 100,131, Y: 0,22, one pixel: 106 0
Blob 5 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.143948 MB
Blob 8 of 12, id: 8, sources: 1, size: 26x28, npix 460, brick X: 23,49, Y: 188,216, one pixel: 32 188
Blob 7 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.143948 MB
Blob 9 of 12, id: 9, sources: 1, size: 25x24, npix 378, brick X: 65,90, Y: 201,225, one pixel: 75 201
Blob 6 finished, total: Wall: 1.29 s, CPU: 1.29 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.143912 MB
Blob 10 of 12, id: 11, sources: 1, size: 25x20, npix 345, brick X: 1,26, Y: 245,265, one pixel: 12 245
Blob 11 of 12, id: 3, sources: 1, size: 18x18, npix 180, brick X: 81,99, Y: 3,21, one pixel: 89 3
Measuring 1 iterative sources
Blob 8 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.143948 MB
Blob 12 of 12, id: 10, sources: 1, size: 18x18, npix 171, brick X: 203,221, Y: 202,220, one pixel: 211 202
Blob 9 finished, total: Wall: 0.54 s, CPU: 0.54 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.143912 MB
Blob 11 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.143912 MB
Blob 12 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.143912 MB
Blob 10 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.143948 MB
Blob 2 finished, total: Wall: 6.03 s, CPU: 6.03 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.143984 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.367467, ee1=-0.0244954, ee2=0.0883993
Measuring 8 iterative sources
Blob 1 finished, total: Wall: 22.89 s, CPU: 22.88 s, VmPeak: 804 MB, VmSize: 716 MB, VmRSS: 149 MB, VmData: 181 MB, maxrss: 0.152508 MB
Old catalog: 37
New catalog: 43
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/metrics/cus/blobs-custom-157354p40406.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/metrics/cus/all-models-custom-157354p40406.fits
Stage fitblobs : Wall: 23.61 s, CPU: 0.69 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 200 MB, VmData: 228 MB, maxrss: 0.567824 MB
Stage fitblobs finished: 2020-06-07T19:47:43.732932
Resources for stage fitblobs : 40.399 s worker CPU, 40.621 s worker Wall, Wall: 23.611 s, Cores in use: 1.74, Total efficiency (on 4 cores): 43.5 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T19:47:43.735059
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/tmp-legacysurvey-custom-157354p40406-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/tmp-legacysurvey-custom-157354p40406-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/tmp-legacysurvey-custom-157354p40406-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/tmp-legacysurvey-custom-157354p40406-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-resid.jpg
Stage coadds : Wall: 1.52 s, CPU: 0.69 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 200 MB, VmData: 228 MB, maxrss: 0.567824 MB
Stage coadds finished: 2020-06-07T19:47:45.255687
Resources for stage coadds : 2.485 s worker CPU, 2.605 s worker Wall, Wall: 1.522 s, Cores in use: 2.09, Total efficiency (on 4 cores): 52.2 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T19:47:45.257424
Cut to 1 unWISE tiles
Reading WISE tile 1582p408 band 1
Reading WISE tile 1582p408 band 2
Reading WISE tile 1582p408 band 3
Reading WISE tile 1582p408 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/158/1582p408/unwise-1582p408-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/158/1582p408/unwise-1582p408-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/158/1582p408/unwise-1582p408-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/158/1582p408/unwise-1582p408-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/158/1582p408/unwise-1582p408-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.14 s, CPU: 0.14 s, VmPeak: 805 MB, VmSize: 795 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.187188 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/158/1582p408/unwise-1582p408-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/158/1582p408/unwise-1582p408-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/158/1582p408/unwise-1582p408-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/158/1582p408/unwise-1582p408-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/158/1582p408/unwise-1582p408-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 805 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.208828 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/158/1582p408/unwise-1582p408-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/158/1582p408/unwise-1582p408-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/158/1582p408/unwise-1582p408-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/158/1582p408/unwise-1582p408-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 805 MB, VmSize: 792 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209264 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/158/1582p408/unwise-1582p408-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/158/1582p408/unwise-1582p408-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/158/1582p408/unwise-1582p408-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/158/1582p408/unwise-1582p408-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 804 MB, VmSize: 795 MB, VmRSS: 152 MB, VmData: 177 MB, maxrss: 0.216828 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/tmp-legacysurvey-custom-157354p40406-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/tmp-legacysurvey-custom-157354p40406-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.46 s, CPU: 0.50 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 201 MB, VmData: 228 MB, maxrss: 0.567824 MB
Stage wise_forced finished: 2020-06-07T19:47:47.718681
Resources for stage wise_forced : 5.225 s worker CPU, 6.436 s worker Wall, Wall: 2.463 s, Cores in use: 2.33, Total efficiency (on 4 cores): 58.2 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T19:47:47.720711
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/coadd/cus/custom-157354p40406/legacysurvey-custom-157354p40406-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/tractor-i/cus/tractor-custom-157354p40406.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/tractor/cus/tractor-custom-157354p40406.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2165335/tractor/cus/brick-custom-157354p40406.sha256sum
Stage writecat : Wall: 0.78 s, CPU: 0.59 s, VmPeak: 1095 MB, VmSize: 967 MB, VmRSS: 203 MB, VmData: 228 MB, maxrss: 0.567824 MB
Stage writecat finished: 2020-06-07T19:47:48.503845
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.784 s, Cores in use: 0.75, Total efficiency (on 4 cores): 18.8 %
Stage writecat finished
All done: 52.506 s worker CPU, 65.933 s worker Wall, Wall: 37.558 s, Cores in use: 1.57, Total efficiency (on 4 cores): 39.2 %
Finished galaxy PGC2165335 in 0.673 minutes.