Started working on galaxy PGC2035777 at Sun Jun  7 10:28:43 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 134.082837 33.61816470000001 --width 245 --height 245 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/PGC2035777-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/PGC2035777-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T10:28:45.481569
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '134.082837', '33.61816470000001', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/PGC2035777-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/PGC2035777-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 134.082837 33.61816470000001 --width 245 --height 245 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/PGC2035777-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/PGC2035777-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 134.082837 33.61816470000001
Starting process 17528 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 17529 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057372 MB
Starting process 17530 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05738 MB
Starting process 17531 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T10:28:49.765979
Keeping 11 CCDs:
   k4m_170126_084443_ooi_zd_ls9.fits.fz k4m_170126_084443_ooi_zd_ls9-CCD3 z exptime 80.104 propid 2016A-0453 seeing 0.93 MJD 57779.364 object MzLS_571970_z
   k4m_170107_094806_ooi_zd_ls9.fits.fz k4m_170107_094806_ooi_zd_ls9-CCD4 z exptime 80.103 propid 2014A-0453 seeing 1.00 MJD 57760.408 object MzLS_569880_z
   k4m_170126_084640_ooi_zd_ls9.fits.fz k4m_170126_084640_ooi_zd_ls9-CCD1 z exptime 80.105 propid 2016A-0453 seeing 1.16 MJD 57779.366 object MzLS_571971_z
   k4m_170119_083338_ooi_zd_ls9.fits.fz k4m_170119_083338_ooi_zd_ls9-CCD4 z exptime 157.102 propid 2016A-0453 seeing 0.97 MJD 57772.357 object MzLS_570926_z
   ksb_160213_065531_ooi_r_ls9.fits.fz ksb_160213_065531_ooi_r_ls9-CCD2 r exptime 62.9 propid 2015A-0801 seeing 1.21 MJD 57431.289 object 05763
   ksb_170222_063026_ooi_g_ls9.fits.fz ksb_170222_063026_ooi_g_ls9-CCD2 g exptime 93.367 propid BASS seeing 1.24 MJD 57806.271 object 05763
   ksb_180320_080439_ooi_g_ls9.fits.fz ksb_180320_080439_ooi_g_ls9-CCD3 g exptime 160.297 propid BASS seeing 1.64 MJD 58197.337 object 04382
   ksb_180223_085715_ooi_r_ls9.fits.fz ksb_180223_085715_ooi_r_ls9-CCD3 r exptime 98.389 propid BASS seeing 1.54 MJD 58172.373 object 04382
   ksb_180113_113949_ooi_g_ls9.fits.fz ksb_180113_113949_ooi_g_ls9-CCD4 g exptime 163.31 propid BASS seeing 1.93 MJD 58131.486 object 05761
   ksb_160209_065812_ooi_r_ls9.fits.fz ksb_160209_065812_ooi_r_ls9-CCD4 r exptime 89.7 propid 2015A-0801 seeing 1.47 MJD 57427.290 object 05761
   ksb_160212_064827_ooi_r_ls9.fits.fz ksb_160212_064827_ooi_r_ls9-CCD4 r exptime 70.6 propid 2015A-0801 seeing 1.16 MJD 57430.284 object 05761
mosaic get_fwhm: self.fwhm = 3.75
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 792 1040 and amp range 0 2047 and image y 1963 2211 and amp range 0 2021
Range in image: x 0 249 , y 0 59 (with image size 249 x 249)
dzp -0.018417627 -> scaling image by 0.9831798050134541
Found overlap: image x 792 1040 and amp range 0 2047 and image y 1963 2211 and amp range 2022 4060
Range in image: x 0 249 , y 59 249 (with image size 249 x 249)
dzp -0.017482605 -> scaling image by 0.9840268712629925
mosaic get_fwhm: self.fwhm = 4.45
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2358 2607 and amp range 2006 4053 and image y 7 51 and amp range 0 2039
Range in image: x 0 250 , y 0 45 (with image size 250 x 45)
dzp 0.000620604 -> scaling image by 1.0005717608254892
Faked up EXPNUM 74310114
Faked up EXPNUM 74310114
Faked up EXPNUM 74310114
90prime get_fwhm: self.fwhm = 2.67
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 875 1018 and amp range 0 2015 and image y 2980 3123 and amp range 2048 4095
Range in image: x 0 144 , y 0 144 (with image size 144 x 144)
dzp 0.016961161 -> scaling image by 1.0157444649385616
Faked up EXPNUM 78060114
Faked up EXPNUM 78060114
Faked up EXPNUM 78060114
90prime get_fwhm: self.fwhm = 2.73
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 897 1039 and amp range 0 2015 and image y 3002 3145 and amp range 2048 4095
Range in image: x 0 143 , y 0 144 (with image size 143 x 144)
dzp 0.051889952 -> scaling image by 1.0489528829333021
mosaic get_fwhm: self.fwhm = 3.59
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2369 2618 and amp range 2006 4053 and image y 3497 3751 and amp range 2040 4078
Range in image: x 0 250 , y 0 255 (with image size 250 x 255)
dzp -0.0021409686 -> scaling image by 0.9980300379995196
Faked up EXPNUM 81720180
Faked up EXPNUM 81720180
Faked up EXPNUM 81720180
90prime get_fwhm: self.fwhm = 3.39
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1120 1263 and amp range 0 2015 and image y 3003 3146 and amp range 2048 4095
Range in image: x 0 144 , y 0 144 (with image size 144 x 144)
dzp -0.038361903 -> scaling image by 0.9652842912941227
mosaic get_fwhm: self.fwhm = 3.87
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3499 3751 and amp range 2048 4095 and image y 455 703 and amp range 0 2021
Range in image: x 0 253 , y 0 249 (with image size 253 x 249)
dzp -0.03444113 -> scaling image by 0.9687763957004109
Faked up EXPNUM 81310186
Faked up EXPNUM 81310186
Faked up EXPNUM 81310186
90prime get_fwhm: self.fwhm = 4.25
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2896 3039 and amp range 2016 4031 and image y 541 683 and amp range 0 2047
Range in image: x 0 144 , y 0 143 (with image size 144 x 143)
dzp 0.023266561 -> scaling image by 1.0216605511853067
Faked up EXPNUM 81970123
Faked up EXPNUM 81970123
Faked up EXPNUM 81970123
90prime get_fwhm: self.fwhm = 3.61
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1071 1214 and amp range 0 2015 and image y 2975 3118 and amp range 2048 4095
Range in image: x 0 144 , y 0 144 (with image size 144 x 144)
dzp -0.027600318 -> scaling image by 0.9748995562775561
Faked up EXPNUM 74300138
Faked up EXPNUM 74300138
Faked up EXPNUM 74300138
90prime get_fwhm: self.fwhm = 2.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2907 3051 and amp range 2016 4031 and image y 547 689 and amp range 0 2047
Range in image: x 0 145 , y 0 143 (with image size 145 x 143)
dzp 0.0047082007 -> scaling image by 1.0043458289369953
Faked up EXPNUM 74270106
Faked up EXPNUM 74270106
Faked up EXPNUM 74270106
90prime get_fwhm: self.fwhm = 3.25
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2896 3039 and amp range 2016 4031 and image y 517 659 and amp range 0 2047
Range in image: x 0 144 , y 0 143 (with image size 144 x 143)
dzp 0.0047082007 -> scaling image by 1.0043458289369953
Stage tims : Wall: 17.98 s, CPU: 6.44 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 171 MB, VmData: 205 MB, maxrss: 0.454672 MB
Stage tims finished: 2020-06-07T10:29:07.743285
Resources for stage tims : 3.613 s worker CPU, 35.985 s worker Wall, Wall: 17.979 s, Cores in use: 0.56, Total efficiency (on 4 cores): 14.0 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/PGC2035777-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/PGC2035777-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T10:29:07.838185
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02672.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02799.fits
Matched 3 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/metrics/cus/reference-custom-134082p33618.fits
Stage refs : Wall: 7.47 s, CPU: 6.06 s, VmPeak: 972 MB, VmSize: 958 MB, VmRSS: 188 MB, VmData: 221 MB, maxrss: 0.454672 MB
Stage refs finished: 2020-06-07T10:29:15.303479
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.466 s, Cores in use: 0.81, Total efficiency (on 4 cores): 20.3 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T10:29:15.304939
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/metrics/cus/outlier-mask-custom-134082p33618.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/metrics/cus/outliers-pre-custom-134082p33618.jpg
Image ksb_170222_063026_ooi_g_ls9-CCD2 g : masking 169 positive outlier pixels and 0 negative outlier pixels
Image k4m_170107_094806_ooi_zd_ls9-CCD4 z : masking 698 positive outlier pixels and 0 negative outlier pixels
Image k4m_170119_083338_ooi_zd_ls9-CCD4 z : masking 212 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/metrics/cus/outlier-mask-custom-134082p33618.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/metrics/cus/outliers-post-custom-134082p33618.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/metrics/cus/outliers-masked-pos-custom-134082p33618.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/metrics/cus/outliers-masked-neg-custom-134082p33618.jpg
Stage outliers : Wall: 5.88 s, CPU: 5.64 s, VmPeak: 972 MB, VmSize: 967 MB, VmRSS: 202 MB, VmData: 233 MB, maxrss: 0.454672 MB
Stage outliers finished: 2020-06-07T10:29:21.180939
Resources for stage outliers : 0.860 s worker CPU, 0.864 s worker Wall, Wall: 5.877 s, Cores in use: 1.11, Total efficiency (on 4 cores): 27.6 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T10:29:21.182709
Stage halos : Wall: 6.64 s, CPU: 6.63 s, VmPeak: 972 MB, VmSize: 967 MB, VmRSS: 202 MB, VmData: 233 MB, maxrss: 0.454672 MB
Stage halos finished: 2020-06-07T10:29:27.819308
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 6.638 s, Cores in use: 1.00, Total efficiency (on 4 cores): 25.0 %
Stage halos finished
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-06-07T10:29:27.821153
PSF sigmas in coadd pixels: ['2.01', '2.66', '3.13']
Using average PSF sigma 2.5998415476277423
Gaussian PSF norm 0.10850460945640286 vs pixelized 0.08891883
average tim pixel scale / coadd scale: 1.730660855492847
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.97', '2.50', '2.39', '1.88']
Using average PSF sigma 2.183023530661709
Gaussian PSF norm 0.12922205730341843 vs pixelized 0.11056522
average tim pixel scale / coadd scale: 1.7301851245023678
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.51', '1.63', '1.88', '1.58']
Using average PSF sigma 1.6508781819546836
Gaussian PSF norm 0.17087559509682929 vs pixelized 0.14017533
average tim pixel scale / coadd scale: 0.9909476531680161
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.19 s, CPU: 0.16 s, VmPeak: 972 MB, VmSize: 967 MB, VmRSS: 204 MB, VmData: 233 MB, maxrss: 0.454672 MB
Stage fit_on_coadds finished: 2020-06-07T10:29:28.012499
Resources for stage fit_on_coadds : 0.189 s worker CPU, 0.194 s worker Wall, Wall: 0.192 s, Cores in use: 1.82, Total efficiency (on 4 cores): 45.5 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T10:29:28.015315
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 23 potential peaks
Of 23 potential peaks: 6 in veto map, 5 cut by saddle test, 0 cut by aper test, 12 kept
SED z : 12 new peaks
Found 18 potential peaks
Of 18 potential peaks: 14 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 15 potential peaks
Of 15 potential peaks: 13 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 28 potential peaks
Of 28 potential peaks: 21 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 32 potential peaks
Of 32 potential peaks: 25 in veto map, 7 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 14 new sources
Median coadd sky for g : 5.5627337e-05
Median coadd sky for r : 9.339166e-05
Median coadd sky for z : 3.9261635e-05
Stage srcs : Wall: 5.29 s, CPU: 5.26 s, VmPeak: 972 MB, VmSize: 967 MB, VmRSS: 204 MB, VmData: 233 MB, maxrss: 0.454672 MB
Stage srcs finished: 2020-06-07T10:29:33.308371
Resources for stage srcs : 0.100 s worker CPU, 0.109 s worker Wall, Wall: 5.294 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/PGC2035777-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/PGC2035777-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T10:29:33.319292
Blob 1 of 13, id: 6, sources: 1, size: 123x127, npix 9569, brick X: 60,183, Y: 57,184, one pixel: 131 57
Blob 2 of 13, id: 11, sources: 3, size: 45x61, npix 1632, brick X: 38,83, Y: 172,233, one pixel: 48 172
Blob 3 of 13, id: 5, sources: 2, size: 64x37, npix 1466, brick X: 181,245, Y: 36,73, one pixel: 194 36
Blob 4 of 13, id: 4, sources: 1, size: 43x42, npix 1298, brick X: 29,72, Y: 32,74, one pixel: 46 32
Blob 5 of 13, id: 9, sources: 1, size: 38x35, npix 894, brick X: 21,59, Y: 122,157, one pixel: 33 122
Blob 4 finished, total: Wall: 1.28 s, CPU: 1.28 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141348 MB
Blob 6 of 13, id: 10, sources: 1, size: 33x33, npix 737, brick X: 176,209, Y: 158,191, one pixel: 190 158
Measuring 1 iterative sources
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 2.31 s, CPU: 2.14 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141456 MB
Blob 7 of 13, id: 12, sources: 1, size: 31x32, npix 665, brick X: 126,157, Y: 196,228, one pixel: 140 196
Blob 3 finished, total: Wall: 2.46 s, CPU: 2.34 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141536 MB
Blob 8 of 13, id: 3, sources: 2, size: 23x42, npix 574, brick X: 2,25, Y: 19,61, one pixel: 12 19
Measuring 2 iterative sources
Blob 5 finished, total: Wall: 2.05 s, CPU: 2.05 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 179 MB, maxrss: 0.142396 MB
Blob 9 of 13, id: 1, sources: 1, size: 25x27, npix 441, brick X: 99,124, Y: 4,31, one pixel: 112 4
Blob 6 finished, total: Wall: 1.02 s, CPU: 1.02 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141688 MB
Blob 10 of 13, id: 2, sources: 2, size: 29x24, npix 417, brick X: 134,163, Y: 4,28, one pixel: 152 4
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.648, ee1=0.0360089, ee2=0.25734
Measuring 1 iterative sources
Blob 9 finished, total: Wall: 0.48 s, CPU: 0.48 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141688 MB
Blob 11 of 13, id: 7, sources: 1, size: 26x26, npix 348, brick X: 171,197, Y: 65,91, one pixel: 180 65
Blob 8 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 179 MB, maxrss: 0.142396 MB
Blob 12 of 13, id: 0, sources: 1, size: 23x22, npix 314, brick X: 12,35, Y: 0,22, one pixel: 20 0
Blob 13 of 13, id: 8, sources: 1, size: 20x19, npix 218, brick X: 0,20, Y: 89,108, one pixel: 8 89
Blob 7 finished, total: Wall: 1.65 s, CPU: 1.65 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142084 MB
Measuring 1 iterative sources
Blob 10 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141688 MB
Blob 12 finished, total: Wall: 0.48 s, CPU: 0.48 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142084 MB
Blob 1 finished, total: Wall: 4.71 s, CPU: 4.64 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144064 MB
Blob 13 finished, total: Wall: 0.20 s, CPU: 0.20 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141688 MB
Blob 11 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 179 MB, maxrss: 0.142396 MB
Old catalog: 19
New catalog: 24
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/metrics/cus/blobs-custom-134082p33618.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/metrics/cus/all-models-custom-134082p33618.fits
Stage fitblobs : Wall: 11.13 s, CPU: 6.26 s, VmPeak: 972 MB, VmSize: 967 MB, VmRSS: 204 MB, VmData: 233 MB, maxrss: 0.454672 MB
Stage fitblobs finished: 2020-06-07T10:29:44.449344
Resources for stage fitblobs : 18.619 s worker CPU, 19.031 s worker Wall, Wall: 11.131 s, Cores in use: 2.24, Total efficiency (on 4 cores): 55.9 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T10:29:44.451160
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/tmp-legacysurvey-custom-134082p33618-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/tmp-legacysurvey-custom-134082p33618-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/tmp-legacysurvey-custom-134082p33618-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/tmp-legacysurvey-custom-134082p33618-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-resid.jpg
Stage coadds : Wall: 7.40 s, CPU: 6.81 s, VmPeak: 972 MB, VmSize: 967 MB, VmRSS: 204 MB, VmData: 233 MB, maxrss: 0.454672 MB
Stage coadds finished: 2020-06-07T10:29:51.849879
Resources for stage coadds : 1.802 s worker CPU, 1.855 s worker Wall, Wall: 7.400 s, Cores in use: 1.16, Total efficiency (on 4 cores): 29.1 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T10:29:51.851416
Cut to 2 unWISE tiles
Reading WISE tile 1331p333 band 1
Reading WISE tile 1331p333 band 2
Reading WISE tile 1331p333 band 3
Reading WISE tile 1331p333 band 4
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/133/1331p333/unwise-1331p333-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/133/1331p333/unwise-1331p333-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/133/1331p333/unwise-1331p333-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/133/1331p333/unwise-1331p333-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 1349p333 band 2
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/133/1331p333/unwise-1331p333-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/133/1331p333/unwise-1331p333-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/133/1331p333/unwise-1331p333-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/133/1331p333/unwise-1331p333-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 1349p333 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/133/1331p333/unwise-1331p333-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/133/1331p333/unwise-1331p333-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/133/1331p333/unwise-1331p333-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/133/1331p333/unwise-1331p333-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/133/1331p333/unwise-1331p333-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 1349p333 band 3
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/134/1349p333/unwise-1349p333-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/134/1349p333/unwise-1349p333-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/134/1349p333/unwise-1349p333-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/134/1349p333/unwise-1349p333-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.20486 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/134/1349p333/unwise-1349p333-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/134/1349p333/unwise-1349p333-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/134/1349p333/unwise-1349p333-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/134/1349p333/unwise-1349p333-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/134/1349p333/unwise-1349p333-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.20846 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/134/1349p333/unwise-1349p333-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/134/1349p333/unwise-1349p333-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/134/1349p333/unwise-1349p333-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/134/1349p333/unwise-1349p333-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 805 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 173 MB, maxrss: 0.206436 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/133/1331p333/unwise-1331p333-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/133/1331p333/unwise-1331p333-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/133/1331p333/unwise-1331p333-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/133/1331p333/unwise-1331p333-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/133/1331p333/unwise-1331p333-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 1349p333 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/134/1349p333/unwise-1349p333-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/134/1349p333/unwise-1349p333-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/134/1349p333/unwise-1349p333-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/134/1349p333/unwise-1349p333-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/134/1349p333/unwise-1349p333-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 804 MB, VmSize: 797 MB, VmRSS: 149 MB, VmData: 179 MB, maxrss: 0.188904 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/tmp-legacysurvey-custom-134082p33618-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/tmp-legacysurvey-custom-134082p33618-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 11.88 s, CPU: 5.33 s, VmPeak: 972 MB, VmSize: 967 MB, VmRSS: 205 MB, VmData: 233 MB, maxrss: 0.454672 MB
Stage wise_forced finished: 2020-06-07T10:30:03.732660
Resources for stage wise_forced : 6.789 s worker CPU, 18.573 s worker Wall, Wall: 11.883 s, Cores in use: 1.02, Total efficiency (on 4 cores): 25.5 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T10:30:03.734697
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/coadd/cus/custom-134082p33618/legacysurvey-custom-134082p33618-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/tractor-i/cus/tractor-custom-134082p33618.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/tractor/cus/tractor-custom-134082p33618.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/134/PGC2035777/tractor/cus/brick-custom-134082p33618.sha256sum
Stage writecat : Wall: 5.76 s, CPU: 5.56 s, VmPeak: 1100 MB, VmSize: 972 MB, VmRSS: 207 MB, VmData: 233 MB, maxrss: 0.454672 MB
Stage writecat finished: 2020-06-07T10:30:09.494599
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.761 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.1 %
Stage writecat finished
All done: 31.974 s worker CPU, 76.613 s worker Wall, Wall: 79.733 s, Cores in use: 1.08, Total efficiency (on 4 cores): 27.0 %
Finished galaxy PGC2035777 in 1.445 minutes.