Started working on galaxy PGC2192504 at Sun Jun 7 18:30:24 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 128.705949 42.10693 --width 237 --height 237 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/PGC2192504-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/PGC2192504-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T18:30:25.267927 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '128.705949', '42.10693', '--width', '237', '--height', '237', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/PGC2192504-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/PGC2192504-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 128.705949 42.10693 --width 237 --height 237 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/PGC2192504-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/PGC2192504-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 128.705949 42.10693 Starting process 35089 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 35090 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 35093 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 35096 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T18:30:25.696488 Keeping 10 CCDs: k4m_160229_060953_ooi_zd_ls9.fits.fz k4m_160229_060953_ooi_zd_ls9-CCD3 z exptime 80.103 propid 2016A-0453 seeing 0.92 MJD 57447.257 object MzLS_614486_z k4m_160216_062349_ooi_zd_ls9.fits.fz k4m_160216_062349_ooi_zd_ls9-CCD1 z exptime 80.103 propid 2016A-0453 seeing 0.83 MJD 57434.267 object MzLS_614487_z k4m_151214_105333_ooi_zd_ls9.fits.fz k4m_151214_105333_ooi_zd_ls9-CCD4 z exptime 96.104 propid 2015B-2001 seeing 1.21 MJD 57370.454 object MzLS_613553_z k4m_170202_082016_ooi_zd_ls9.fits.fz k4m_170202_082016_ooi_zd_ls9-CCD3 z exptime 80.105 propid 2016A-0453 seeing 1.02 MJD 57786.347 object MzLS_615416_z ksb_170319_045420_ooi_r_ls9.fits.fz ksb_170319_045420_ooi_r_ls9-CCD1 r exptime 58.247 propid BASS seeing 1.13 MJD 57831.204 object 16401 ksb_180113_081707_ooi_g_ls9.fits.fz ksb_180113_081707_ooi_g_ls9-CCD1 g exptime 112.456 propid BASS seeing 1.54 MJD 58131.345 object 16401 ksb_170202_084226_ooi_r_ls9.fits.fz ksb_170202_084226_ooi_r_ls9-CCD2 r exptime 102.634 propid BASS seeing 1.30 MJD 57786.363 object 16402 ksb_160310_043407_ooi_g_ls9.fits.fz ksb_160310_043407_ooi_g_ls9-CCD2 g exptime 110.6 propid 2015A-0801 seeing 1.29 MJD 57457.190 object 16402 ksb_180114_100535_ooi_g_ls9.fits.fz ksb_180114_100535_ooi_g_ls9-CCD3 g exptime 94.351 propid BASS seeing 1.24 MJD 58132.421 object 16413 ksb_170205_075943_ooi_r_ls9.fits.fz ksb_170205_075943_ooi_r_ls9-CCD3 r exptime 245.7 propid BASS seeing 1.20 MJD 57789.333 object 16413 mosaic get_fwhm: self.fwhm = 3.21 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3543 3783 and amp range 2006 4053 and image y 35 281 and amp range 0 2039 Range in image: x 0 241 , y 0 247 (with image size 241 x 247) dzp 0.001388291 -> scaling image by 1.0012794811153327 mosaic get_fwhm: self.fwhm = 3.53 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3532 3772 and amp range 2006 4053 and image y 3738 3983 and amp range 2040 4078 Range in image: x 0 241 , y 0 246 (with image size 241 x 246) dzp -0.0026360443 -> scaling image by 0.99757505842151 mosaic get_fwhm: self.fwhm = 4.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1949 2190 and amp range 0 2047 and image y 1385 1625 and amp range 0 2021 Range in image: x 0 99 , y 0 241 (with image size 242 x 241) dzp 0.005139143 -> scaling image by 1.0047445456970268 Found overlap: image x 1949 2190 and amp range 2048 4095 and image y 1385 1625 and amp range 0 2021 Range in image: x 99 242 , y 0 241 (with image size 242 x 241) dzp -0.0006399284 -> scaling image by 0.9994107778325068 mosaic get_fwhm: self.fwhm = 3.91 Found 4 relevant rows in amp-corrections file. Found overlap: image x 803 1049 and amp range 0 2005 and image y 3348 3595 and amp range 2040 4078 Range in image: x 0 247 , y 0 248 (with image size 247 x 248) dzp 0.012956044 -> scaling image by 1.012004439021001 Faked up EXPNUM 78310114 Faked up EXPNUM 78310114 Faked up EXPNUM 78310114 90prime get_fwhm: self.fwhm = 2.49 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3154 3293 and amp range 2016 4031 and image y 1245 1384 and amp range 0 2047 Range in image: x 0 140 , y 0 140 (with image size 140 x 140) dzp -0.006547878 -> scaling image by 0.9939873303458991 Faked up EXPNUM 81310094 Faked up EXPNUM 81310094 Faked up EXPNUM 81310094 90prime get_fwhm: self.fwhm = 3.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3160 3299 and amp range 2016 4031 and image y 1244 1383 and amp range 0 2047 Range in image: x 0 140 , y 0 140 (with image size 140 x 140) dzp -0.019046262 -> scaling image by 0.9826107140833663 Faked up EXPNUM 77860158 Faked up EXPNUM 77860158 Faked up EXPNUM 77860158 90prime get_fwhm: self.fwhm = 2.87 Found 4 relevant rows in amp-corrections file. Found overlap: image x 990 1128 and amp range 0 2015 and image y 3234 3372 and amp range 2048 4095 Range in image: x 0 139 , y 0 139 (with image size 139 x 139) dzp 0.05525464 -> scaling image by 1.0522086198429996 Faked up EXPNUM 74570059 Faked up EXPNUM 74570059 Faked up EXPNUM 74570059 90prime get_fwhm: self.fwhm = 2.85 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1001 1139 and amp range 0 2015 and image y 3223 3361 and amp range 2048 4095 Range in image: x 0 139 , y 0 139 (with image size 139 x 139) dzp 0.01693853 -> scaling image by 1.015723292931903 Faked up EXPNUM 77890122 Faked up EXPNUM 77890122 Faked up EXPNUM 77890122 90prime get_fwhm: self.fwhm = 2.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1193 1332 and amp range 0 2015 and image y 2777 2915 and amp range 2048 4095 Range in image: x 0 140 , y 0 139 (with image size 140 x 139) dzp -0.07725406 -> scaling image by 0.9313188157188347 Faked up EXPNUM 81320202 Faked up EXPNUM 81320202 Faked up EXPNUM 81320202 90prime get_fwhm: self.fwhm = 2.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1198 1337 and amp range 0 2015 and image y 2801 2939 and amp range 2048 4095 Range in image: x 0 140 , y 0 139 (with image size 140 x 139) dzp -0.027600318 -> scaling image by 0.9748995562775561 Stage tims : Wall: 6.38 s, CPU: 0.94 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 171 MB, VmData: 205 MB, maxrss: 0.56788 MB Stage tims finished: 2020-06-07T18:30:32.071511 Resources for stage tims : 3.372 s worker CPU, 18.178 s worker Wall, Wall: 6.376 s, Cores in use: 0.68, Total efficiency (on 4 cores): 16.9 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/PGC2192504-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/PGC2192504-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T18:30:32.253183 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01904.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02029.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02158.fits Matched 5 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/metrics/cus/reference-custom-128705p42106.fits Stage refs : Wall: 2.48 s, CPU: 1.79 s, VmPeak: 972 MB, VmSize: 959 MB, VmRSS: 189 MB, VmData: 222 MB, maxrss: 0.56788 MB Stage refs finished: 2020-06-07T18:30:34.732069 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.480 s, Cores in use: 0.72, Total efficiency (on 4 cores): 18.0 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T18:30:34.733552 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/metrics/cus/outlier-mask-custom-128705p42106.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/metrics/cus/outliers-pre-custom-128705p42106.jpg Image k4m_160216_062349_ooi_zd_ls9-CCD1 z : masking 900 positive outlier pixels and 0 negative outlier pixels Image k4m_170202_082016_ooi_zd_ls9-CCD3 z : masking 783 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/metrics/cus/outlier-mask-custom-128705p42106.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/metrics/cus/outliers-post-custom-128705p42106.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/metrics/cus/outliers-masked-pos-custom-128705p42106.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/metrics/cus/outliers-masked-neg-custom-128705p42106.jpg Stage outliers : Wall: 0.86 s, CPU: 0.62 s, VmPeak: 972 MB, VmSize: 969 MB, VmRSS: 202 MB, VmData: 233 MB, maxrss: 0.56788 MB Stage outliers finished: 2020-06-07T18:30:35.594092 Resources for stage outliers : 0.780 s worker CPU, 0.784 s worker Wall, Wall: 0.862 s, Cores in use: 1.63, Total efficiency (on 4 cores): 40.7 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T18:30:35.595837 Stage halos : Wall: 0.20 s, CPU: 0.19 s, VmPeak: 972 MB, VmSize: 969 MB, VmRSS: 202 MB, VmData: 233 MB, maxrss: 0.56788 MB Stage halos finished: 2020-06-07T18:30:35.793823 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.199 s, Cores in use: 0.96, Total efficiency (on 4 cores): 24.0 % Stage halos finished Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-06-07T18:30:35.795542 PSF sigmas in coadd pixels: ['2.50', '2.10', '2.01'] Using average PSF sigma 2.201497548847937 Gaussian PSF norm 0.12813768151661165 vs pixelized 0.10349724 average tim pixel scale / coadd scale: 1.7302794842305416 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.83', '2.11', '1.95'] Using average PSF sigma 1.964816022953034 Gaussian PSF norm 0.14357313279128384 vs pixelized 0.12197652 average tim pixel scale / coadd scale: 1.7293058611267735 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.49', '1.35', '1.97', '1.65'] Using average PSF sigma 1.6148969642053965 Gaussian PSF norm 0.17468284232776535 vs pixelized 0.14299527 average tim pixel scale / coadd scale: 0.9908553512583892 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.65 s, CPU: 0.17 s, VmPeak: 972 MB, VmSize: 969 MB, VmRSS: 204 MB, VmData: 234 MB, maxrss: 0.56788 MB Stage fit_on_coadds finished: 2020-06-07T18:30:36.441788 Resources for stage fit_on_coadds : 0.172 s worker CPU, 0.184 s worker Wall, Wall: 0.647 s, Cores in use: 0.52, Total efficiency (on 4 cores): 13.1 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T18:30:36.444472 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 21 potential peaks Of 21 potential peaks: 2 in veto map, 0 cut by saddle test, 0 cut by aper test, 19 kept SED z : 19 new peaks Found 18 potential peaks Of 18 potential peaks: 18 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 15 potential peaks Of 15 potential peaks: 14 in veto map, 0 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 24 potential peaks Of 24 potential peaks: 19 in veto map, 2 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 26 potential peaks Of 26 potential peaks: 23 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 24 new sources Median coadd sky for g : 0.00010678181 Median coadd sky for r : 6.976384e-05 Median coadd sky for z : 0.00014259835 Stage srcs : Wall: 0.58 s, CPU: 0.54 s, VmPeak: 972 MB, VmSize: 969 MB, VmRSS: 205 MB, VmData: 234 MB, maxrss: 0.56788 MB Stage srcs finished: 2020-06-07T18:30:37.024407 Resources for stage srcs : 0.094 s worker CPU, 0.094 s worker Wall, Wall: 0.581 s, Cores in use: 1.09, Total efficiency (on 4 cores): 27.2 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/PGC2192504-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/PGC2192504-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T18:30:37.035709 Blob 1 of 17, id: 6, sources: 3, size: 71x94, npix 4595, brick X: 89,160, Y: 70,164, one pixel: 127 70 Blob 2 of 17, id: 2, sources: 2, size: 55x40, npix 1391, brick X: 129,184, Y: 25,65, one pixel: 146 25 Blob 3 of 17, id: 13, sources: 2, size: 43x45, npix 1353, brick X: 194,237, Y: 169,214, one pixel: 207 169 Blob 4 of 17, id: 14, sources: 2, size: 57x48, npix 1351, brick X: 79,136, Y: 181,229, one pixel: 113 181 Blob 5 of 17, id: 7, sources: 2, size: 33x33, npix 640, brick X: 56,89, Y: 85,118, one pixel: 74 85 Blob 2 finished, total: Wall: 2.68 s, CPU: 2.68 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142408 MB Measuring 1 iterative sources Blob 6 of 17, id: 8, sources: 1, size: 32x30, npix 640, brick X: 169,201, Y: 85,115, one pixel: 183 85 Blob 3 finished, total: Wall: 2.70 s, CPU: 2.70 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142112 MB Blob 7 of 17, id: 9, sources: 2, size: 26x37, npix 538, brick X: 63,89, Y: 121,158, one pixel: 76 121 Blob 4 finished, total: Wall: 3.24 s, CPU: 3.24 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142628 MB Blob 8 of 17, id: 5, sources: 2, size: 39x26, npix 513, brick X: 184,223, Y: 53,79, one pixel: 193 53 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.32355, ee1=0.545728, ee2=0.398074 Blob 1 finished, total: Wall: 3.37 s, CPU: 3.37 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143132 MB Blob 9 of 17, id: 3, sources: 1, size: 26x26, npix 433, brick X: 98,124, Y: 41,67, one pixel: 108 41 Blob 6 finished, total: Wall: 0.72 s, CPU: 0.72 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142616 MB Blob 10 of 17, id: 16, sources: 1, size: 26x27, npix 431, brick X: 176,202, Y: 204,231, one pixel: 187 204 Blob 5 finished, total: Wall: 0.98 s, CPU: 0.98 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.14242 MB Blob 11 of 17, id: 4, sources: 1, size: 26x24, npix 400, brick X: 30,56, Y: 50,74, one pixel: 42 50 Blob 7 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142628 MB Blob 12 of 17, id: 15, sources: 1, size: 24x24, npix 365, brick X: 30,54, Y: 200,224, one pixel: 39 200 Blob 9 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142616 MB Blob 13 of 17, id: 11, sources: 1, size: 25x22, npix 325, brick X: 181,206, Y: 143,165, one pixel: 189 143 Blob 14 of 17, id: 12, sources: 1, size: 23x23, npix 316, brick X: 2,25, Y: 156,179, one pixel: 12 156 Blob 8 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143132 MB Blob 15 of 17, id: 0, sources: 1, size: 22x22, npix 291, brick X: 0,22, Y: 4,26, one pixel: 10 4 Blob 10 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.14242 MB Blob 16 of 17, id: 10, sources: 1, size: 21x22, npix 291, brick X: 215,236, Y: 133,155, one pixel: 224 133 Blob 11 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142876 MB Blob 17 of 17, id: 1, sources: 1, size: 18x20, npix 216, brick X: 178,196, Y: 14,34, one pixel: 186 14 Measuring 1 iterative sources Blob 13 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143132 MB Blob 12 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142616 MB Blob 14 finished, total: Wall: 0.49 s, CPU: 0.49 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.14242 MB Blob 15 finished, total: Wall: 0.47 s, CPU: 0.47 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142876 MB Blob 17 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142616 MB Blob 16 finished, total: Wall: 0.42 s, CPU: 0.42 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143132 MB Old catalog: 27 New catalog: 25 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/metrics/cus/blobs-custom-128705p42106.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/metrics/cus/all-models-custom-128705p42106.fits Stage fitblobs : Wall: 6.39 s, CPU: 0.50 s, VmPeak: 972 MB, VmSize: 965 MB, VmRSS: 201 MB, VmData: 230 MB, maxrss: 0.56788 MB Stage fitblobs finished: 2020-06-07T18:30:43.423914 Resources for stage fitblobs : 20.079 s worker CPU, 20.132 s worker Wall, Wall: 6.389 s, Cores in use: 3.22, Total efficiency (on 4 cores): 80.5 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T18:30:43.425654 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/tmp-legacysurvey-custom-128705p42106-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/tmp-legacysurvey-custom-128705p42106-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/tmp-legacysurvey-custom-128705p42106-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/tmp-legacysurvey-custom-128705p42106-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-resid.jpg Stage coadds : Wall: 1.30 s, CPU: 0.54 s, VmPeak: 972 MB, VmSize: 965 MB, VmRSS: 201 MB, VmData: 230 MB, maxrss: 0.56788 MB Stage coadds finished: 2020-06-07T18:30:44.721096 Resources for stage coadds : 2.067 s worker CPU, 2.139 s worker Wall, Wall: 1.296 s, Cores in use: 2.01, Total efficiency (on 4 cores): 50.3 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T18:30:44.722953 Cut to 1 unWISE tiles Reading WISE tile 1294p424 band 1 Reading WISE tile 1294p424 band 2 Reading WISE tile 1294p424 band 4 Reading WISE tile 1294p424 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/129/1294p424/unwise-1294p424-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/129/1294p424/unwise-1294p424-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/129/1294p424/unwise-1294p424-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/129/1294p424/unwise-1294p424-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/129/1294p424/unwise-1294p424-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 804 MB, VmSize: 794 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.18852 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/129/1294p424/unwise-1294p424-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/129/1294p424/unwise-1294p424-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/129/1294p424/unwise-1294p424-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/129/1294p424/unwise-1294p424-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/129/1294p424/unwise-1294p424-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 805 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.20864 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/129/1294p424/unwise-1294p424-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/129/1294p424/unwise-1294p424-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/129/1294p424/unwise-1294p424-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/129/1294p424/unwise-1294p424-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 803 MB, VmSize: 788 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.204968 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/129/1294p424/unwise-1294p424-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/129/1294p424/unwise-1294p424-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/129/1294p424/unwise-1294p424-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/129/1294p424/unwise-1294p424-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 805 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.207992 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/tmp-legacysurvey-custom-128705p42106-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/tmp-legacysurvey-custom-128705p42106-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.70 s, CPU: 0.59 s, VmPeak: 972 MB, VmSize: 965 MB, VmRSS: 202 MB, VmData: 230 MB, maxrss: 0.56788 MB Stage wise_forced finished: 2020-06-07T18:30:47.421467 Resources for stage wise_forced : 4.628 s worker CPU, 6.090 s worker Wall, Wall: 2.700 s, Cores in use: 1.93, Total efficiency (on 4 cores): 48.3 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T18:30:47.423482 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/coadd/cus/custom-128705p42106/legacysurvey-custom-128705p42106-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/tractor-i/cus/tractor-custom-128705p42106.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/tractor/cus/tractor-custom-128705p42106.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2192504/tractor/cus/brick-custom-128705p42106.sha256sum Stage writecat : Wall: 1.16 s, CPU: 0.57 s, VmPeak: 1097 MB, VmSize: 969 MB, VmRSS: 204 MB, VmData: 230 MB, maxrss: 0.56788 MB Stage writecat finished: 2020-06-07T18:30:48.581501 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.159 s, Cores in use: 0.49, Total efficiency (on 4 cores): 12.3 % Stage writecat finished All done: 31.194 s worker CPU, 47.603 s worker Wall, Wall: 22.890 s, Cores in use: 1.65, Total efficiency (on 4 cores): 41.1 % Finished galaxy PGC2192504 in 0.413 minutes.