Started working on galaxy DR8-2127p500-269 at Sun Jun  7 17:24:46 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 212.546443055917 49.894913965696 --width 327 --height 327 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/DR8-2127p500-269-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/DR8-2127p500-269-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T17:24:47.725383
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '212.546443055917', '49.894913965696', '--width', '327', '--height', '327', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/DR8-2127p500-269-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/DR8-2127p500-269-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 212.546443055917 49.894913965696 --width 327 --height 327 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/DR8-2127p500-269-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/DR8-2127p500-269-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 212.546443055917 49.894913965696
Starting process 46179 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057372 MB
Starting process 46180 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB
Starting process 46182 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05738 MB
Starting process 46181 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057404 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T17:24:48.511256
Keeping 9 CCDs:
   k4m_160607_051419_ooi_zd_ls9.fits.fz k4m_160607_051419_ooi_zd_ls9-CCD1 z exptime 80.105 propid 2016A-0453 seeing 1.14 MJD 57546.218 object MzLS_650256_z
   k4m_170505_071146_ooi_zd_ls9.fits.fz k4m_170505_071146_ooi_zd_ls9-CCD1 z exptime 103.106 propid 2016A-0453 seeing 1.32 MJD 57878.300 object MzLS_649448_z
   k4m_160420_074250_ooi_zd_ls9.fits.fz k4m_160420_074250_ooi_zd_ls9-CCD2 z exptime 110.104 propid 2016A-0453 seeing 0.92 MJD 57498.321 object MzLS_648638_z
   ksb_160510_071054_ooi_r_ls9.fits.fz ksb_160510_071054_ooi_r_ls9-CCD2 r exptime 53.0 propid BASS seeing 1.22 MJD 57518.299 object 26801
   ksb_160314_090954_ooi_g_ls9.fits.fz ksb_160314_090954_ooi_g_ls9-CCD2 g exptime 70.4 propid 2015A-0801 seeing 1.64 MJD 57461.382 object 26801
   ksb_170330_100216_ooi_g_ls9.fits.fz ksb_170330_100216_ooi_g_ls9-CCD1 g exptime 102.96 propid BASS seeing 1.57 MJD 57842.418 object 26803
   ksb_170420_090715_ooi_r_ls9.fits.fz ksb_170420_090715_ooi_r_ls9-CCD1 r exptime 74.754 propid BASS seeing 1.65 MJD 57863.380 object 26803
   ksb_160609_042523_ooi_r_ls9.fits.fz ksb_160609_042523_ooi_r_ls9-CCD4 r exptime 144.1 propid BASS seeing 1.72 MJD 57548.184 object 26802
   ksb_160503_064802_ooi_g_ls9.fits.fz ksb_160503_064802_ooi_g_ls9-CCD4 g exptime 112.7 propid BASS seeing 1.94 MJD 57511.283 object 26802
mosaic get_fwhm: self.fwhm = 5.07
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3040 3369 and amp range 2006 4053 and image y 980 1315 and amp range 0 2039
Range in image: x 0 330 , y 0 336 (with image size 330 x 336)
dzp 0.000620604 -> scaling image by 1.0005717608254892
Faked up EXPNUM 75180134
Faked up EXPNUM 75180134
Faked up EXPNUM 75180134
90prime get_fwhm: self.fwhm = 2.69
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 649 840 and amp range 0 2015 and image y 3409 3600 and amp range 2048 4095
Range in image: x 0 192 , y 0 192 (with image size 192 x 192)
dzp 0.016961161 -> scaling image by 1.0157444649385616
mosaic get_fwhm: self.fwhm = 4.41
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 322 660 and amp range 0 2005 and image y 2138 2472 and amp range 2040 4078
Range in image: x 0 339 , y 0 335 (with image size 339 x 335)
dzp -0.005990375 -> scaling image by 0.994497853444703
mosaic get_fwhm: self.fwhm = 3.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1468 1800 and amp range 0 2047 and image y 1665 1996 and amp range 0 2039
Range in image: x 0 333 , y 0 332 (with image size 333 x 332)
dzp -0.006320339 -> scaling image by 0.9941956631368829
Faked up EXPNUM 78420196
Faked up EXPNUM 78420196
Faked up EXPNUM 78420196
90prime get_fwhm: self.fwhm = 3.47
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2823 3015 and amp range 2016 4031 and image y 1415 1607 and amp range 0 2047
Range in image: x 0 193 , y 0 193 (with image size 193 x 193)
dzp -0.011406615 -> scaling image by 0.9895491130016149
Faked up EXPNUM 74610159
Faked up EXPNUM 74610159
Faked up EXPNUM 74610159
90prime get_fwhm: self.fwhm = 3.61
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 654 844 and amp range 0 2015 and image y 3409 3599 and amp range 2048 4095
Range in image: x 0 191 , y 0 191 (with image size 191 x 191)
dzp 0.01693853 -> scaling image by 1.015723292931903
Faked up EXPNUM 78630157
Faked up EXPNUM 78630157
Faked up EXPNUM 78630157
90prime get_fwhm: self.fwhm = 3.65
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2821 3012 and amp range 2016 4031 and image y 1411 1603 and amp range 0 2047
Range in image: x 0 192 , y 0 193 (with image size 192 x 193)
dzp -0.006547878 -> scaling image by 0.9939873303458991
Faked up EXPNUM 75480054
Faked up EXPNUM 75480054
Faked up EXPNUM 75480054
90prime get_fwhm: self.fwhm = 3.79
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2656 2847 and amp range 2016 4031 and image y 921 1111 and amp range 0 2047
Range in image: x 0 192 , y 0 191 (with image size 192 x 191)
dzp 0.0047082007 -> scaling image by 1.0043458289369953
Faked up EXPNUM 75110099
Faked up EXPNUM 75110099
Faked up EXPNUM 75110099
90prime get_fwhm: self.fwhm = 4.29
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2671 2862 and amp range 2016 4031 and image y 921 1111 and amp range 0 2047
Range in image: x 0 192 , y 0 191 (with image size 192 x 191)
dzp 0.010226944 -> scaling image by 1.0094638657706572
Stage tims : Wall: 5.65 s, CPU: 1.12 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 173 MB, VmData: 206 MB, maxrss: 0.56654 MB
Stage tims finished: 2020-06-07T17:24:54.158016
Resources for stage tims : 2.939 s worker CPU, 13.683 s worker Wall, Wall: 5.648 s, Cores in use: 0.72, Total efficiency (on 4 cores): 18.0 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/DR8-2127p500-269-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/DR8-2127p500-269-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T17:24:54.182102
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01361.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01578.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01467.fits
Matched 8 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/metrics/cus/reference-custom-212546p49894.fits
Stage refs : Wall: 2.00 s, CPU: 1.62 s, VmPeak: 972 MB, VmSize: 953 MB, VmRSS: 186 MB, VmData: 218 MB, maxrss: 0.56654 MB
Stage refs finished: 2020-06-07T17:24:56.186063
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.005 s, Cores in use: 0.81, Total efficiency (on 4 cores): 20.1 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T17:24:56.187493
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/metrics/cus/outlier-mask-custom-212546p49894.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/metrics/cus/outliers-pre-custom-212546p49894.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/metrics/cus/outlier-mask-custom-212546p49894.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/metrics/cus/outliers-post-custom-212546p49894.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/metrics/cus/outliers-masked-pos-custom-212546p49894.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/metrics/cus/outliers-masked-neg-custom-212546p49894.jpg
Stage outliers : Wall: 1.37 s, CPU: 0.90 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 206 MB, VmData: 236 MB, maxrss: 0.56654 MB
Stage outliers finished: 2020-06-07T17:24:57.553876
Resources for stage outliers : 1.132 s worker CPU, 1.171 s worker Wall, Wall: 1.367 s, Cores in use: 1.49, Total efficiency (on 4 cores): 37.2 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T17:24:57.555500
Stage halos : Wall: 0.49 s, CPU: 0.48 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 206 MB, VmData: 236 MB, maxrss: 0.56654 MB
Stage halos finished: 2020-06-07T17:24:58.043218
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.489 s, Cores in use: 0.98, Total efficiency (on 4 cores): 24.5 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-07T17:24:58.045156
PSF sigmas in coadd pixels: ['2.66', '2.55', '3.16']
Using average PSF sigma 2.7899291293120427
Gaussian PSF norm 0.10111181277333692 vs pixelized 0.0917741
average tim pixel scale / coadd scale: 1.7298843164195996
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.98', '2.69', '2.79']
Using average PSF sigma 2.484823793895055
Gaussian PSF norm 0.11352708086060459 vs pixelized 0.09018989
average tim pixel scale / coadd scale: 1.7293534492220701
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.86', '2.14', '1.50']
Using average PSF sigma 1.8313411886844395
Gaussian PSF norm 0.15403726706792606 vs pixelized 0.13125099
average tim pixel scale / coadd scale: 0.9908698226382088
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.35 s, CPU: 0.25 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 209 MB, VmData: 237 MB, maxrss: 0.56654 MB
Stage fit_on_coadds finished: 2020-06-07T17:24:58.397117
Resources for stage fit_on_coadds : 0.264 s worker CPU, 0.289 s worker Wall, Wall: 0.353 s, Cores in use: 1.45, Total efficiency (on 4 cores): 36.2 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T17:24:58.399587
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 17 potential peaks
Of 17 potential peaks: 3 in veto map, 1 cut by saddle test, 0 cut by aper test, 13 kept
SED z : 13 new peaks
Found 11 potential peaks
Of 11 potential peaks: 9 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 14 potential peaks
Of 14 potential peaks: 10 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 25 potential peaks
Of 25 potential peaks: 17 in veto map, 5 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 30 potential peaks
Of 30 potential peaks: 22 in veto map, 5 cut by saddle test, 0 cut by aper test, 3 kept
SED Red : 3 new peaks
Adding 21 new sources
Median coadd sky for g : -3.7929683e-05
Median coadd sky for r : -0.00011330272
Median coadd sky for z : 0.00014178397
Stage srcs : Wall: 0.91 s, CPU: 0.83 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 209 MB, VmData: 237 MB, maxrss: 0.56654 MB
Stage srcs finished: 2020-06-07T17:24:59.307399
Resources for stage srcs : 0.160 s worker CPU, 0.166 s worker Wall, Wall: 0.909 s, Cores in use: 1.09, Total efficiency (on 4 cores): 27.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/DR8-2127p500-269-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/DR8-2127p500-269-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T17:24:59.321035
Blob 1 of 17, id: 5, sources: 3, size: 100x88, npix 5750, brick X: 125,225, Y: 119,207, one pixel: 162 119
Blob 2 of 17, id: 2, sources: 3, size: 92x66, npix 3394, brick X: 233,325, Y: 57,123, one pixel: 243 57
Blob 3 of 17, id: 13, sources: 2, size: 35x32, npix 616, brick X: 175,210, Y: 231,263, one pixel: 198 231
Blob 4 of 17, id: 16, sources: 1, size: 29x30, npix 557, brick X: 116,145, Y: 296,326, one pixel: 129 296
Blob 5 of 17, id: 15, sources: 2, size: 18x45, npix 534, brick X: 0,18, Y: 257,302, one pixel: 6 257
Blob 3 finished, total: Wall: 0.45 s, CPU: 0.45 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14148 MB
Blob 6 of 17, id: 7, sources: 1, size: 29x27, npix 495, brick X: 76,105, Y: 121,148, one pixel: 87 121
Blob 4 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141624 MB
Blob 7 of 17, id: 3, sources: 1, size: 27x27, npix 482, brick X: 100,127, Y: 63,90, one pixel: 111 63
Blob 6 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.1435 MB
Blob 8 of 17, id: 11, sources: 1, size: 25x25, npix 411, brick X: 114,139, Y: 207,232, one pixel: 123 207
Blob 5 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143412 MB
Blob 9 of 17, id: 4, sources: 1, size: 26x24, npix 386, brick X: 184,210, Y: 107,131, one pixel: 196 107
Blob 8 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143412 MB
Blob 10 of 17, id: 6, sources: 1, size: 24x24, npix 352, brick X: 48,72, Y: 121,145, one pixel: 59 121
Measuring 2 iterative sources
Blob 7 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.1435 MB
Blob 11 of 17, id: 9, sources: 1, size: 23x23, npix 335, brick X: 7,30, Y: 130,153, one pixel: 16 130
Blob 12 of 17, id: 1, sources: 1, size: 22x21, npix 280, brick X: 179,201, Y: 23,44, one pixel: 189 23
Blob 10 finished, total: Wall: 0.18 s, CPU: 0.18 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.1435 MB
Blob 13 of 17, id: 8, sources: 1, size: 20x20, npix 238, brick X: 294,314, Y: 125,145, one pixel: 302 125
Blob 9 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143412 MB
Blob 14 of 17, id: 12, sources: 1, size: 19x20, npix 208, brick X: 279,298, Y: 219,239, one pixel: 288 219
Blob 12 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143412 MB
Blob 15 of 17, id: 14, sources: 1, size: 19x19, npix 208, brick X: 262,281, Y: 254,273, one pixel: 270 254
Blob 11 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.1435 MB
Blob 16 of 17, id: 10, sources: 1, size: 19x18, npix 189, brick X: 205,224, Y: 136,154, one pixel: 213 136
Blob 14 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.1435 MB
Blob 17 of 17, id: 0, sources: 1, size: 19x13, npix 162, brick X: 294,313, Y: 0,13, one pixel: 295 0
Blob 13 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143412 MB
Blob 16 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143412 MB
Blob 15 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.1435 MB
Blob 2 finished, total: Wall: 3.18 s, CPU: 3.16 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143748 MB
Blob 17 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143412 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.38597, ee1=0.0593669, ee2=-0.00151404
Blob 1 finished, total: Wall: 3.85 s, CPU: 3.85 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145104 MB
Old catalog: 27
New catalog: 22
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/metrics/cus/blobs-custom-212546p49894.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/metrics/cus/all-models-custom-212546p49894.fits
Stage fitblobs : Wall: 4.47 s, CPU: 0.64 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 210 MB, VmData: 237 MB, maxrss: 0.56654 MB
Stage fitblobs finished: 2020-06-07T17:25:03.789446
Resources for stage fitblobs : 13.528 s worker CPU, 13.601 s worker Wall, Wall: 4.469 s, Cores in use: 3.17, Total efficiency (on 4 cores): 79.3 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T17:25:03.791185
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/tmp-legacysurvey-custom-212546p49894-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/tmp-legacysurvey-custom-212546p49894-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/tmp-legacysurvey-custom-212546p49894-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/tmp-legacysurvey-custom-212546p49894-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-resid.jpg
Stage coadds : Wall: 2.17 s, CPU: 0.78 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 210 MB, VmData: 238 MB, maxrss: 0.56654 MB
Stage coadds finished: 2020-06-07T17:25:05.966100
Resources for stage coadds : 2.068 s worker CPU, 2.171 s worker Wall, Wall: 2.176 s, Cores in use: 1.31, Total efficiency (on 4 cores): 32.8 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T17:25:05.967846
Cut to 2 unWISE tiles
Reading WISE tile 2113p499 band 1
Reading WISE tile 2113p499 band 2
Reading WISE tile 2113p499 band 3
Reading WISE tile 2113p499 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/211/2113p499/unwise-2113p499-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/211/2113p499/unwise-2113p499-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/211/2113p499/unwise-2113p499-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/211/2113p499/unwise-2113p499-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/211/2113p499/unwise-2113p499-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2136p499 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/211/2113p499/unwise-2113p499-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/211/2113p499/unwise-2113p499-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/211/2113p499/unwise-2113p499-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/211/2113p499/unwise-2113p499-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/211/2113p499/unwise-2113p499-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2136p499 band 4
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/211/2113p499/unwise-2113p499-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/211/2113p499/unwise-2113p499-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/211/2113p499/unwise-2113p499-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/211/2113p499/unwise-2113p499-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2136p499 band 2
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/211/2113p499/unwise-2113p499-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/211/2113p499/unwise-2113p499-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/211/2113p499/unwise-2113p499-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/211/2113p499/unwise-2113p499-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2136p499 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2136p499/unwise-2136p499-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2136p499/unwise-2136p499-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2136p499/unwise-2136p499-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2136p499/unwise-2136p499-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2136p499/unwise-2136p499-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 805 MB, VmSize: 792 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.204676 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2136p499/unwise-2136p499-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2136p499/unwise-2136p499-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2136p499/unwise-2136p499-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2136p499/unwise-2136p499-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/213/2136p499/unwise-2136p499-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 805 MB, VmSize: 797 MB, VmRSS: 154 MB, VmData: 178 MB, maxrss: 0.191748 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2136p499/unwise-2136p499-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2136p499/unwise-2136p499-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2136p499/unwise-2136p499-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2136p499/unwise-2136p499-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 149 MB, VmData: 174 MB, maxrss: 0.207792 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2136p499/unwise-2136p499-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2136p499/unwise-2136p499-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2136p499/unwise-2136p499-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/213/2136p499/unwise-2136p499-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.05 s, VmPeak: 803 MB, VmSize: 792 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.21158 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/tmp-legacysurvey-custom-212546p49894-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/tmp-legacysurvey-custom-212546p49894-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.72 s, CPU: 0.43 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 211 MB, VmData: 238 MB, maxrss: 0.56654 MB
Stage wise_forced finished: 2020-06-07T17:25:09.683881
Resources for stage wise_forced : 8.058 s worker CPU, 10.679 s worker Wall, Wall: 3.717 s, Cores in use: 2.28, Total efficiency (on 4 cores): 57.1 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T17:25:09.685614
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/coadd/cus/custom-212546p49894/legacysurvey-custom-212546p49894-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/tractor-i/cus/tractor-custom-212546p49894.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/tractor/cus/tractor-custom-212546p49894.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/212/DR8-2127p500-269/tractor/cus/brick-custom-212546p49894.sha256sum
Stage writecat : Wall: 1.06 s, CPU: 0.61 s, VmPeak: 1095 MB, VmSize: 967 MB, VmRSS: 213 MB, VmData: 238 MB, maxrss: 0.56654 MB
Stage writecat finished: 2020-06-07T17:25:10.743120
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.059 s, Cores in use: 0.58, Total efficiency (on 4 cores): 14.5 %
Stage writecat finished
All done: 28.152 s worker CPU, 41.763 s worker Wall, Wall: 22.237 s, Cores in use: 1.61, Total efficiency (on 4 cores): 40.3 %
Finished galaxy DR8-2127p500-269 in 0.418 minutes.