Started working on galaxy PGC2619371_GROUP at Sun Jun  7 19:09:07 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 157.13030265784684 61.513013228824406 --width 305 --height 305 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/PGC2619371_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/PGC2619371_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T19:09:09.167911
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '157.13030265784684', '61.513013228824406', '--width', '305', '--height', '305', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/PGC2619371_GROUP-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/PGC2619371_GROUP-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 157.13030265784684 61.513013228824406 --width 305 --height 305 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/PGC2619371_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/PGC2619371_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 157.13030265784684 61.513013228824406
Starting process 44818 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 44820 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 44819 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 44821 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T19:09:09.885689
Keeping 11 CCDs:
   k4m_170408_091214_ooi_zd_ls9.fits.fz k4m_170408_091214_ooi_zd_ls9-CCD2 z exptime 82.104 propid 2016A-0453 seeing 0.95 MJD 57851.383 object MzLS_691173_z
   k4m_171118_103131_ooi_zd_ls9.fits.fz k4m_171118_103131_ooi_zd_ls9-CCD1 z exptime 156.104 propid 2016A-0453 seeing 1.65 MJD 58075.439 object MzLS_691773_z
   k4m_170502_035606_ooi_zd_ls9.fits.fz k4m_170502_035606_ooi_zd_ls9-CCD4 z exptime 89.105 propid 2016A-0453 seeing 0.97 MJD 57875.164 object MzLS_690568_z
   ksb_180319_084830_ooi_g_ls9.fits.fz ksb_180319_084830_ooi_g_ls9-CCD3 g exptime 165.282 propid BASS seeing 1.85 MJD 58196.367 object 38191
   ksb_180508_032928_ooi_r_ls9.fits.fz ksb_180508_032928_ooi_r_ls9-CCD3 r exptime 105.2 propid NOTBASS seeing 1.24 MJD 58246.145 object 38191
   ksb_180317_081937_ooi_g_ls9.fits.fz ksb_180317_081937_ooi_g_ls9-CCD4 g exptime 162.0 propid BASS seeing 1.63 MJD 58194.347 object 39143
   ksb_180225_110009_ooi_r_ls9.fits.fz ksb_180225_110009_ooi_r_ls9-CCD4 r exptime 78.721 propid BASS seeing 1.22 MJD 58174.458 object 39143
   ksb_180321_092500_ooi_g_ls9.fits.fz ksb_180321_092500_ooi_g_ls9-CCD3 g exptime 168.998 propid BASS seeing 1.36 MJD 58198.392 object 38192
   ksb_180507_035859_ooi_r_ls9.fits.fz ksb_180507_035859_ooi_r_ls9-CCD3 r exptime 250.0 propid NOTBASS seeing 1.88 MJD 58245.166 object 38192
   ksb_180319_084505_ooi_g_ls9.fits.fz ksb_180319_084505_ooi_g_ls9-CCD2 g exptime 167.817 propid BASS seeing 1.62 MJD 58196.365 object 39131
   ksb_180507_034404_ooi_r_ls9.fits.fz ksb_180507_034404_ooi_r_ls9-CCD2 r exptime 203.947 propid NOTBASS seeing 1.76 MJD 58245.156 object 39131
Faked up EXPNUM 81960146
Faked up EXPNUM 81960146
Faked up EXPNUM 81960146
90prime get_fwhm: self.fwhm = 4.09
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 139 and amp range 0 2015 and image y 320 497 and amp range 0 2047
Range in image: x 0 125 , y 0 178 (with image size 125 x 178)
dzp -0.03692675 -> scaling image by 0.9665610717922232
mosaic get_fwhm: self.fwhm = 3.65
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 7 259 and amp range 0 2047 and image y 869 1181 and amp range 0 2039
Range in image: x 0 253 , y 0 313 (with image size 253 x 313)
dzp -0.0096683735 -> scaling image by 0.9911346301237048
mosaic get_fwhm: self.fwhm = 6.35
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1523 1832 and amp range 0 2005 and image y 1883 2195 and amp range 0 2039
Range in image: x 0 310 , y 0 157 (with image size 310 x 313)
dzp 0.009508088 -> scaling image by 1.0087957299815176
Found overlap: image x 1523 1832 and amp range 0 2005 and image y 1883 2195 and amp range 2040 4078
Range in image: x 0 310 , y 157 313 (with image size 310 x 313)
dzp 0.014419514 -> scaling image by 1.0133694453441033
mosaic get_fwhm: self.fwhm = 3.73
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2666 2979 and amp range 2048 4095 and image y 2060 2371 and amp range 2022 4060
Range in image: x 0 314 , y 0 312 (with image size 314 x 312)
dzp -0.02499645 -> scaling image by 0.9772404160512723
Faked up EXPNUM 82460028
Faked up EXPNUM 82460028
Faked up EXPNUM 82460028
90prime get_fwhm: self.fwhm = 2.73
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 159 and amp range 0 2015 and image y 346 523 and amp range 0 2047
Range in image: x 0 145 , y 0 178 (with image size 145 x 178)
dzp -0.039144866 -> scaling image by 0.9645884414840357
Faked up EXPNUM 81740162
Faked up EXPNUM 81740162
Faked up EXPNUM 81740162
90prime get_fwhm: self.fwhm = 2.69
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1742 1920 and amp range 0 2015 and image y 3263 3442 and amp range 2048 4095
Range in image: x 0 179 , y 0 180 (with image size 179 x 180)
dzp 0.04491909 -> scaling image by 1.0422397564357018
Faked up EXPNUM 81980092
Faked up EXPNUM 81980092
Faked up EXPNUM 81980092
90prime get_fwhm: self.fwhm = 3.01
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1938 2116 and amp range 0 2015 and image y 2298 2476 and amp range 2048 4095
Range in image: x 0 78 , y 0 179 (with image size 179 x 179)
dzp -0.027600318 -> scaling image by 0.9748995562775561
Found overlap: image x 1938 2116 and amp range 2016 4031 and image y 2298 2476 and amp range 2048 4095
Range in image: x 78 179 , y 0 179 (with image size 179 x 179)
dzp -0.01723723 -> scaling image by 0.9842492857213068
Faked up EXPNUM 81940047
Faked up EXPNUM 81940047
Faked up EXPNUM 81940047
90prime get_fwhm: self.fwhm = 3.59
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1714 1892 and amp range 0 2015 and image y 3284 3464 and amp range 2048 4095
Range in image: x 0 179 , y 0 181 (with image size 179 x 181)
dzp 0.027550658 -> scaling image by 1.0256997821704772
Faked up EXPNUM 82450032
Faked up EXPNUM 82450032
Faked up EXPNUM 82450032
90prime get_fwhm: self.fwhm = 4.15
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1960 2138 and amp range 0 2015 and image y 2301 2478 and amp range 2048 4095
Range in image: x 0 56 , y 0 178 (with image size 179 x 178)
dzp -0.038361903 -> scaling image by 0.9652842912941227
Found overlap: image x 1960 2138 and amp range 2016 4031 and image y 2301 2478 and amp range 2048 4095
Range in image: x 56 179 , y 0 178 (with image size 179 x 178)
dzp -0.0072602304 -> scaling image by 0.9933353884052984
Faked up EXPNUM 81960145
Faked up EXPNUM 81960145
Faked up EXPNUM 81960145
90prime get_fwhm: self.fwhm = 3.57
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3667 3847 and amp range 2016 4031 and image y 1634 1815 and amp range 0 2047
Range in image: x 0 181 , y 0 182 (with image size 181 x 182)
dzp 0.009189803 -> scaling image by 1.0085000434534261
Faked up EXPNUM 82450029
Faked up EXPNUM 82450029
Faked up EXPNUM 82450029
90prime get_fwhm: self.fwhm = 3.89
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3689 3869 and amp range 2016 4031 and image y 1656 1838 and amp range 0 2047
Range in image: x 0 181 , y 0 183 (with image size 181 x 183)
dzp 0.014483032 -> scaling image by 1.0134287315188357
Stage tims : Wall: 6.83 s, CPU: 1.07 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 173 MB, VmData: 207 MB, maxrss: 0.567824 MB
Stage tims finished: 2020-06-07T19:09:16.714875
Resources for stage tims : 4.159 s worker CPU, 13.790 s worker Wall, Wall: 6.830 s, Cores in use: 0.77, Total efficiency (on 4 cores): 19.1 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/PGC2619371_GROUP-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/PGC2619371_GROUP-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T19:09:16.741375
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00794.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00643.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00716.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00717.fits
Matched 10 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/metrics/cus/reference-custom-157130p61513.fits
Stage refs : Wall: 2.37 s, CPU: 1.51 s, VmPeak: 972 MB, VmSize: 955 MB, VmRSS: 187 MB, VmData: 220 MB, maxrss: 0.567824 MB
Stage refs finished: 2020-06-07T19:09:19.109725
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.369 s, Cores in use: 0.64, Total efficiency (on 4 cores): 16.0 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T19:09:19.111269
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/metrics/cus/outlier-mask-custom-157130p61513.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/metrics/cus/outliers-pre-custom-157130p61513.jpg
Image ksb_180319_084830_ooi_g_ls9-CCD3 g : masking 3298 positive outlier pixels and 0 negative outlier pixels
Image ksb_180508_032928_ooi_r_ls9-CCD3 r : masking 3256 positive outlier pixels and 0 negative outlier pixels
Image k4m_170408_091214_ooi_zd_ls9-CCD2 z : masking 5926 positive outlier pixels and 0 negative outlier pixels
Image k4m_171118_103131_ooi_zd_ls9-CCD1 z : masking 0 positive outlier pixels and 372 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/metrics/cus/outlier-mask-custom-157130p61513.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/metrics/cus/outliers-post-custom-157130p61513.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/metrics/cus/outliers-masked-pos-custom-157130p61513.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/metrics/cus/outliers-masked-neg-custom-157130p61513.jpg
Stage outliers : Wall: 1.21 s, CPU: 0.82 s, VmPeak: 972 MB, VmSize: 965 MB, VmRSS: 206 MB, VmData: 236 MB, maxrss: 0.567824 MB
Stage outliers finished: 2020-06-07T19:09:20.321164
Resources for stage outliers : 1.435 s worker CPU, 1.489 s worker Wall, Wall: 1.211 s, Cores in use: 1.86, Total efficiency (on 4 cores): 46.5 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T19:09:20.323011
Stage halos : Wall: 0.29 s, CPU: 0.28 s, VmPeak: 972 MB, VmSize: 965 MB, VmRSS: 206 MB, VmData: 236 MB, maxrss: 0.567824 MB
Stage halos finished: 2020-06-07T19:09:20.617109
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.295 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.7 %
Stage halos finished
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-06-07T19:09:20.619083
PSF sigmas in coadd pixels: ['3.01', '2.64', '2.22', '2.63']
Using average PSF sigma 2.6260377567104447
Gaussian PSF norm 0.10742221472369441 vs pixelized 0.09272034
average tim pixel scale / coadd scale: 1.731026713969186
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.01', '1.98', '3.05', '2.86']
Using average PSF sigma 2.477598274072693
Gaussian PSF norm 0.11385816446754655 vs pixelized 0.09859213
average tim pixel scale / coadd scale: 1.730354632098114
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.54', '2.68', '1.57']
Using average PSF sigma 1.9299856143914742
Gaussian PSF norm 0.14616419400764438 vs pixelized 0.1327921
average tim pixel scale / coadd scale: 0.9909828277020395
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.32 s, CPU: 0.26 s, VmPeak: 972 MB, VmSize: 965 MB, VmRSS: 209 MB, VmData: 237 MB, maxrss: 0.567824 MB
Stage fit_on_coadds finished: 2020-06-07T19:09:20.935447
Resources for stage fit_on_coadds : 0.380 s worker CPU, 0.396 s worker Wall, Wall: 0.318 s, Cores in use: 2.03, Total efficiency (on 4 cores): 50.7 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T19:09:20.938401
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 49 potential peaks
Of 49 potential peaks: 4 in veto map, 1 cut by saddle test, 0 cut by aper test, 44 kept
SED z : 44 new peaks
Found 69 potential peaks
Of 69 potential peaks: 58 in veto map, 5 cut by saddle test, 1 cut by aper test, 5 kept
SED r : 5 new peaks
Found 61 potential peaks
Of 61 potential peaks: 52 in veto map, 4 cut by saddle test, 0 cut by aper test, 5 kept
SED g : 5 new peaks
Found 81 potential peaks
Of 81 potential peaks: 71 in veto map, 7 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 76 potential peaks
Of 76 potential peaks: 70 in veto map, 6 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 57 new sources
Median coadd sky for g : 0.00010231393
Median coadd sky for r : 0.0006167708
Median coadd sky for z : -0.00074166164
Stage srcs : Wall: 0.80 s, CPU: 0.73 s, VmPeak: 972 MB, VmSize: 965 MB, VmRSS: 209 MB, VmData: 237 MB, maxrss: 0.567824 MB
Stage srcs finished: 2020-06-07T19:09:21.733777
Resources for stage srcs : 0.157 s worker CPU, 0.172 s worker Wall, Wall: 0.796 s, Cores in use: 1.12, Total efficiency (on 4 cores): 28.0 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/PGC2619371_GROUP-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/PGC2619371_GROUP-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T19:09:21.753251
Blob 1 of 15, id: 1, sources: 41, size: 304x305, npix 38044, brick X: 0,304, Y: 0,305, one pixel: 158 0
Blob 2 of 15, id: 2, sources: 3, size: 63x62, npix 1806, brick X: 0,63, Y: 39,101, one pixel: 37 39
Blob 3 of 15, id: 4, sources: 2, size: 43x55, npix 1297, brick X: 236,279, Y: 67,122, one pixel: 247 67
Blob 4 of 15, id: 8, sources: 1, size: 26x49, npix 962, brick X: 279,305, Y: 104,153, one pixel: 297 104
Blob 5 of 15, id: 9, sources: 2, size: 44x41, npix 962, brick X: 47,91, Y: 236,277, one pixel: 57 236
Blob 3 finished, total: Wall: 1.76 s, CPU: 1.75 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14334 MB
Blob 6 of 15, id: 0, sources: 2, size: 39x29, npix 699, brick X: 30,69, Y: 0,29, one pixel: 39 0
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 2.48 s, CPU: 2.47 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.143976 MB
Blob 7 of 15, id: 14, sources: 1, size: 26x23, npix 423, brick X: 48,74, Y: 282,305, one pixel: 59 282
Blob 8 of 15, id: 12, sources: 1, size: 26x26, npix 403, brick X: 169,195, Y: 259,285, one pixel: 179 259
Blob 4 finished, total: Wall: 2.70 s, CPU: 2.70 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.143996 MB
Blob 5 finished, total: Wall: 1.29 s, CPU: 1.29 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.143996 MB
Blob 9 of 15, id: 7, sources: 1, size: 19x28, npix 378, brick X: 0,19, Y: 104,132, one pixel: 5 104
Blob 10 of 15, id: 3, sources: 1, size: 25x24, npix 377, brick X: 205,230, Y: 61,85, one pixel: 215 61
Blob 7 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.143996 MB
Blob 8 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.143996 MB
Blob 11 of 15, id: 11, sources: 1, size: 22x23, npix 315, brick X: 144,166, Y: 256,279, one pixel: 154 256
Blob 12 of 15, id: 10, sources: 1, size: 22x22, npix 293, brick X: 111,133, Y: 243,265, one pixel: 120 243
Blob 6 finished, total: Wall: 0.97 s, CPU: 0.97 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.14426 MB
Blob 13 of 15, id: 6, sources: 1, size: 22x20, npix 259, brick X: 41,63, Y: 88,108, one pixel: 50 88
Blob 11 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.14426 MB
Blob 14 of 15, id: 5, sources: 1, size: 20x20, npix 247, brick X: 89,109, Y: 71,91, one pixel: 98 71
Blob 10 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.14404 MB
Blob 15 of 15, id: 13, sources: 1, size: 18x18, npix 171, brick X: 115,133, Y: 274,292, one pixel: 123 274
Blob 9 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.143996 MB
Blob 13 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.14404 MB
Blob 12 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.14426 MB
Blob 15 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.14404 MB
Blob 14 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.143996 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.695381, ee1=0.0661638, ee2=-0.0887571
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.405208, ee1=0.039254, ee2=0.0232151
Measuring 10 iterative sources
Blob 1 finished, total: Wall: 40.89 s, CPU: 40.88 s, VmPeak: 804 MB, VmSize: 729 MB, VmRSS: 162 MB, VmData: 194 MB, maxrss: 0.175268 MB
Old catalog: 62
New catalog: 67
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/metrics/cus/blobs-custom-157130p61513.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/metrics/cus/all-models-custom-157130p61513.fits
Stage fitblobs : Wall: 41.46 s, CPU: 0.52 s, VmPeak: 972 MB, VmSize: 965 MB, VmRSS: 212 MB, VmData: 240 MB, maxrss: 0.567824 MB
Stage fitblobs finished: 2020-06-07T19:10:03.213470
Resources for stage fitblobs : 53.236 s worker CPU, 53.398 s worker Wall, Wall: 41.462 s, Cores in use: 1.30, Total efficiency (on 4 cores): 32.4 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T19:10:03.216281
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/tmp-legacysurvey-custom-157130p61513-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/tmp-legacysurvey-custom-157130p61513-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/tmp-legacysurvey-custom-157130p61513-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/tmp-legacysurvey-custom-157130p61513-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-resid.jpg
Stage coadds : Wall: 1.78 s, CPU: 0.73 s, VmPeak: 972 MB, VmSize: 965 MB, VmRSS: 212 MB, VmData: 240 MB, maxrss: 0.567824 MB
Stage coadds finished: 2020-06-07T19:10:04.997983
Resources for stage coadds : 3.091 s worker CPU, 3.150 s worker Wall, Wall: 1.783 s, Cores in use: 2.14, Total efficiency (on 4 cores): 53.5 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T19:10:04.999726
Cut to 1 unWISE tiles
Reading WISE tile 1578p620 band 2
Reading WISE tile 1578p620 band 1
Reading WISE tile 1578p620 band 3
Reading WISE tile 1578p620 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/157/1578p620/unwise-1578p620-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/157/1578p620/unwise-1578p620-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/157/1578p620/unwise-1578p620-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/157/1578p620/unwise-1578p620-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/157/1578p620/unwise-1578p620-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.21 s, CPU: 0.28 s, VmPeak: 1070 MB, VmSize: 1007 MB, VmRSS: 161 MB, VmData: 197 MB, maxrss: 0.223696 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/157/1578p620/unwise-1578p620-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/157/1578p620/unwise-1578p620-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/157/1578p620/unwise-1578p620-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/157/1578p620/unwise-1578p620-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/157/1578p620/unwise-1578p620-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.45 s, CPU: 0.67 s, VmPeak: 1063 MB, VmSize: 999 MB, VmRSS: 150 MB, VmData: 189 MB, maxrss: 0.19018 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/157/1578p620/unwise-1578p620-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/157/1578p620/unwise-1578p620-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/157/1578p620/unwise-1578p620-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/157/1578p620/unwise-1578p620-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.13 s, CPU: 0.26 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 147 MB, VmData: 187 MB, maxrss: 0.20972 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/157/1578p620/unwise-1578p620-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/157/1578p620/unwise-1578p620-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/157/1578p620/unwise-1578p620-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/157/1578p620/unwise-1578p620-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.19 s, CPU: 0.28 s, VmPeak: 1060 MB, VmSize: 996 MB, VmRSS: 147 MB, VmData: 186 MB, maxrss: 0.209068 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/tmp-legacysurvey-custom-157130p61513-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/tmp-legacysurvey-custom-157130p61513-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.06 s, CPU: 0.65 s, VmPeak: 972 MB, VmSize: 965 MB, VmRSS: 213 MB, VmData: 240 MB, maxrss: 0.567824 MB
Stage wise_forced finished: 2020-06-07T19:10:08.063662
Resources for stage wise_forced : 5.703 s worker CPU, 7.499 s worker Wall, Wall: 3.065 s, Cores in use: 2.07, Total efficiency (on 4 cores): 51.8 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T19:10:08.065850
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/coadd/cus/custom-157130p61513/legacysurvey-custom-157130p61513-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/tractor-i/cus/tractor-custom-157130p61513.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/tractor/cus/tractor-custom-157130p61513.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/PGC2619371_GROUP/tractor/cus/brick-custom-157130p61513.sha256sum
Stage writecat : Wall: 1.26 s, CPU: 0.96 s, VmPeak: 1097 MB, VmSize: 969 MB, VmRSS: 215 MB, VmData: 240 MB, maxrss: 0.567824 MB
Stage writecat finished: 2020-06-07T19:10:09.321473
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.257 s, Cores in use: 0.76, Total efficiency (on 4 cores): 19.1 %
Stage writecat finished
All done: 68.164 s worker CPU, 79.897 s worker Wall, Wall: 59.440 s, Cores in use: 1.27, Total efficiency (on 4 cores): 31.9 %
Finished galaxy PGC2619371_GROUP in 1.044 minutes.