Started working on galaxy PGC2223690 at Sun Jun 7 19:34:04 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 106.76279099999999 43.5599444 --width 281 --height 281 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/PGC2223690-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/PGC2223690-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T19:34:05.287949 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '106.76279099999999', '43.5599444', '--width', '281', '--height', '281', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/PGC2223690-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/PGC2223690-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 106.76279099999999 43.5599444 --width 281 --height 281 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/PGC2223690-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/PGC2223690-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 106.76279099999999 43.5599444 Starting process 28571 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057592 MB Starting process 28572 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057592 MB Starting process 28573 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057596 MB Starting process 28574 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.0576 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T19:34:05.766309 Keeping 10 CCDs: k4m_170214_034926_ooi_zd_ls9.fits.fz k4m_170214_034926_ooi_zd_ls9-CCD4 z exptime 80.104 propid 2016A-0453 seeing 1.14 MJD 57798.159 object MzLS_620907_z k4m_170225_043810_ooi_zd_ls9.fits.fz k4m_170225_043810_ooi_zd_ls9-CCD4 z exptime 80.105 propid 2016A-0453 seeing 1.24 MJD 57809.193 object MzLS_619995_z k4m_170222_044938_ooi_zd_ls9.fits.fz k4m_170222_044938_ooi_zd_ls9-CCD4 z exptime 80.101 propid 2016A-0453 seeing 0.84 MJD 57806.201 object MzLS_619995_z k4m_160209_051513_ooi_zd_ls9.fits.fz k4m_160209_051513_ooi_zd_ls9-CCD1 z exptime 80.103 propid 2016A-0453 seeing 1.07 MJD 57427.219 object MzLS_621817_z ksb_180115_043952_ooi_g_ls9.fits.fz ksb_180115_043952_ooi_g_ls9-CCD2 g exptime 166.9 propid BASS seeing 1.17 MJD 58133.194 object 18803 ksb_171127_101937_ooi_r_ls9.fits.fz ksb_171127_101937_ooi_r_ls9-CCD1 r exptime 236.04 propid BASS seeing 1.34 MJD 58084.430 object 17522 ksb_170128_065012_ooi_g_ls9.fits.fz ksb_170128_065012_ooi_g_ls9-CCD1 g exptime 250.0 propid BASS seeing 2.01 MJD 57781.285 object 17522 ksb_170129_062139_ooi_g_ls9.fits.fz ksb_170129_062139_ooi_g_ls9-CCD1 g exptime 250.0 propid BASS seeing 2.45 MJD 57782.265 object 17522 ksb_171127_095428_ooi_r_ls9.fits.fz ksb_171127_095428_ooi_r_ls9-CCD4 r exptime 201.029 propid BASS seeing 1.69 MJD 58084.413 object 18801 ksb_161106_110110_ooi_g_ls9.fits.fz ksb_161106_110110_ooi_g_ls9-CCD4 g exptime 149.0 propid BASS seeing 1.31 MJD 57698.459 object 18801 mosaic get_fwhm: self.fwhm = 4.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 401 683 and amp range 0 2047 and image y 481 763 and amp range 0 2021 Range in image: x 0 283 , y 0 283 (with image size 283 x 283) dzp -0.018417627 -> scaling image by 0.9831798050134541 mosaic get_fwhm: self.fwhm = 3.25 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3136 3426 and amp range 2048 4095 and image y 2071 2359 and amp range 2022 4060 Range in image: x 0 291 , y 0 289 (with image size 291 x 289) dzp -0.02499645 -> scaling image by 0.9772404160512723 mosaic get_fwhm: self.fwhm = 4.13 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1963 2246 and amp range 0 2005 and image y 2370 2656 and amp range 2040 4078 Range in image: x 0 43 , y 0 287 (with image size 284 x 287) dzp -0.005990375 -> scaling image by 0.994497853444703 Found overlap: image x 1963 2246 and amp range 2006 4053 and image y 2370 2656 and amp range 2040 4078 Range in image: x 43 284 , y 0 287 (with image size 284 x 287) dzp -0.006092005 -> scaling image by 0.9944047680378836 mosaic get_fwhm: self.fwhm = 4.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3133 3424 and amp range 2048 4095 and image y 2066 2354 and amp range 2022 4060 Range in image: x 0 292 , y 0 289 (with image size 292 x 289) dzp -0.02499645 -> scaling image by 0.9772404160512723 Faked up EXPNUM 77810085 Faked up EXPNUM 77810085 Faked up EXPNUM 77810085 90prime get_fwhm: self.fwhm = 4.43 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1512 1678 and amp range 0 2015 and image y 775 940 and amp range 0 2047 Range in image: x 0 167 , y 0 166 (with image size 167 x 166) dzp -0.023075538 -> scaling image by 0.9789709052881876 Faked up EXPNUM 80850166 Faked up EXPNUM 80850166 Faked up EXPNUM 80850166 90prime get_fwhm: self.fwhm = 2.95 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1508 1674 and amp range 0 2015 and image y 728 893 and amp range 0 2047 Range in image: x 0 167 , y 0 166 (with image size 167 x 166) dzp -0.04811793 -> scaling image by 0.9566494556405901 Faked up EXPNUM 77820086 Faked up EXPNUM 77820086 Faked up EXPNUM 77820086 90prime get_fwhm: self.fwhm = 5.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1522 1687 and amp range 0 2015 and image y 777 942 and amp range 0 2047 Range in image: x 0 166 , y 0 166 (with image size 166 x 166) dzp -0.023075538 -> scaling image by 0.9789709052881876 Faked up EXPNUM 81330068 Faked up EXPNUM 81330068 Faked up EXPNUM 81330068 Faked up EXPNUM 80850160 Faked up EXPNUM 80850160 Faked up EXPNUM 80850160 90prime get_fwhm: self.fwhm = 3.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3355 3519 and amp range 2016 4031 and image y 1604 1767 and amp range 0 2047 Range in image: x 0 165 , y 0 164 (with image size 165 x 164) dzp 0.043530058 -> scaling image by 1.0409072255640852 Faked up EXPNUM 76980174 Faked up EXPNUM 76980174 Faked up EXPNUM 76980174 90prime get_fwhm: self.fwhm = 2.89 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3355 3520 and amp range 2016 4031 and image y 1615 1778 and amp range 0 2047 Range in image: x 0 166 , y 0 164 (with image size 166 x 164) dzp 0.016679538 -> scaling image by 1.0154810312115594 Stage tims : Wall: 4.53 s, CPU: 0.96 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 172 MB, VmData: 206 MB, maxrss: 0.566548 MB Stage tims finished: 2020-06-07T19:34:10.296832 Resources for stage tims : 3.461 s worker CPU, 10.935 s worker Wall, Wall: 4.532 s, Cores in use: 0.98, Total efficiency (on 4 cores): 24.4 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/PGC2223690-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/PGC2223690-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T19:34:10.317188 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01896.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02022.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01775.fits Matched 11 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/metrics/cus/reference-custom-106762p43559.fits Stage refs : Wall: 5.42 s, CPU: 4.11 s, VmPeak: 989 MB, VmSize: 983 MB, VmRSS: 216 MB, VmData: 247 MB, maxrss: 0.566548 MB Stage refs finished: 2020-06-07T19:34:15.738289 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.422 s, Cores in use: 0.76, Total efficiency (on 4 cores): 19.0 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T19:34:15.739751 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/metrics/cus/outlier-mask-custom-106762p43559.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/metrics/cus/outliers-pre-custom-106762p43559.jpg Image ksb_170129_062139_ooi_g_ls9-CCD1 g : masking 296 positive outlier pixels and 0 negative outlier pixels Image k4m_160209_051513_ooi_zd_ls9-CCD1 z : masking 415 positive outlier pixels and 0 negative outlier pixels Image k4m_170225_043810_ooi_zd_ls9-CCD4 z : masking 0 positive outlier pixels and 432 negative outlier pixels Image k4m_170222_044938_ooi_zd_ls9-CCD4 z : masking 726 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/metrics/cus/outlier-mask-custom-106762p43559.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/metrics/cus/outliers-post-custom-106762p43559.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/metrics/cus/outliers-masked-pos-custom-106762p43559.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/metrics/cus/outliers-masked-neg-custom-106762p43559.jpg Stage outliers : Wall: 1.12 s, CPU: 0.83 s, VmPeak: 992 MB, VmSize: 992 MB, VmRSS: 233 MB, VmData: 262 MB, maxrss: 0.566548 MB Stage outliers finished: 2020-06-07T19:34:16.855163 Resources for stage outliers : 1.032 s worker CPU, 1.051 s worker Wall, Wall: 1.117 s, Cores in use: 1.66, Total efficiency (on 4 cores): 41.6 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T19:34:16.856903 Stage halos : Wall: 0.28 s, CPU: 0.27 s, VmPeak: 992 MB, VmSize: 992 MB, VmRSS: 233 MB, VmData: 262 MB, maxrss: 0.566548 MB Stage halos finished: 2020-06-07T19:34:17.132092 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.276 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.2 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T19:34:17.133886 PSF sigmas in coadd pixels: ['3.26', '3.98', '2.13'] Using average PSF sigma 3.1237277552428453 Gaussian PSF norm 0.09030709904229393 vs pixelized 0.07323851 average tim pixel scale / coadd scale: 1.7300556735526627 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.17', '2.75'] Using average PSF sigma 2.4592008151689 Gaussian PSF norm 0.11470994561885897 vs pixelized 0.11070484 average tim pixel scale / coadd scale: 1.7302074689126594 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.85', '2.01', '1.37', '1.74'] Using average PSF sigma 1.7434537943628654 Gaussian PSF norm 0.1618022758538135 vs pixelized 0.12980124 average tim pixel scale / coadd scale: 0.9908372807789252 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.24 s, CPU: 0.19 s, VmPeak: 992 MB, VmSize: 992 MB, VmRSS: 234 MB, VmData: 262 MB, maxrss: 0.566548 MB Stage fit_on_coadds finished: 2020-06-07T19:34:17.370525 Resources for stage fit_on_coadds : 0.212 s worker CPU, 0.220 s worker Wall, Wall: 0.238 s, Cores in use: 1.71, Total efficiency (on 4 cores): 42.8 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T19:34:17.373184 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 43 potential peaks Of 43 potential peaks: 8 in veto map, 2 cut by saddle test, 0 cut by aper test, 33 kept SED z : 33 new peaks Found 32 potential peaks Of 32 potential peaks: 28 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 23 potential peaks Of 23 potential peaks: 17 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 42 potential peaks Of 42 potential peaks: 37 in veto map, 2 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 49 potential peaks Of 49 potential peaks: 44 in veto map, 4 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 41 new sources Median coadd sky for g : -1.817721e-05 Median coadd sky for r : 6.970559e-05 Median coadd sky for z : -8.760077e-05 Stage srcs : Wall: 0.56 s, CPU: 0.50 s, VmPeak: 992 MB, VmSize: 992 MB, VmRSS: 235 MB, VmData: 262 MB, maxrss: 0.566548 MB Stage srcs finished: 2020-06-07T19:34:17.932800 Resources for stage srcs : 0.131 s worker CPU, 0.131 s worker Wall, Wall: 0.561 s, Cores in use: 1.14, Total efficiency (on 4 cores): 28.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/PGC2223690-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/PGC2223690-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T19:34:17.986415 Blob 1 of 24, id: 12, sources: 7, size: 171x158, npix 14678, brick X: 72,243, Y: 76,234, one pixel: 134 76 Blob 2 of 24, id: 19, sources: 7, size: 64x92, npix 3875, brick X: 210,274, Y: 189,281, one pixel: 229 189 Blob 3 of 24, id: 1, sources: 5, size: 103x39, npix 2236, brick X: 105,208, Y: 0,39, one pixel: 136 0 Blob 4 of 24, id: 14, sources: 5, size: 24x60, npix 1066, brick X: 257,281, Y: 90,150, one pixel: 273 90 Blob 5 of 24, id: 0, sources: 3, size: 38x48, npix 1051, brick X: 0,38, Y: 0,48, one pixel: 0 0 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (106.74072, 43.55935), pm (-6.2, -3.1), parallax 0.937 with NanoMaggies: g=16.8, r=16.1, z=15.8 Reset brightness to NanoMaggies: g=16.8, r=16.1, z=15.8 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (106.74739, 43.55889), pm (0.3, -4.0), parallax 0.268 with NanoMaggies: g=17, r=16, z=15.8 Reset brightness to NanoMaggies: g=16.5, r=16, z=15.8 Measuring 2 iterative sources Blob 4 finished, total: Wall: 2.98 s, CPU: 2.93 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142796 MB Blob 6 of 24, id: 13, sources: 1, size: 34x34, npix 837, brick X: 1,35, Y: 80,114, one pixel: 14 80 Blob 3 finished, total: Wall: 3.55 s, CPU: 3.50 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143028 MB Blob 7 of 24, id: 6, sources: 1, size: 35x30, npix 712, brick X: 98,133, Y: 49,79, one pixel: 113 49 Blob 6 finished, total: Wall: 0.58 s, CPU: 0.58 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143236 MB Blob 8 of 24, id: 22, sources: 2, size: 36x31, npix 598, brick X: 135,171, Y: 239,270, one pixel: 157 239 Measuring 1 iterative sources Blob 7 finished, total: Wall: 1.22 s, CPU: 1.22 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143236 MB Blob 9 of 24, id: 17, sources: 1, size: 31x31, npix 589, brick X: 238,269, Y: 168,199, one pixel: 249 168 Measuring 1 iterative sources Measuring 1 iterative sources Blob 8 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143236 MB Blob 10 of 24, id: 20, sources: 1, size: 31x26, npix 541, brick X: 189,220, Y: 217,243, one pixel: 199 217 Blob 2 finished, total: Wall: 6.27 s, CPU: 6.26 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.14342 MB Blob 11 of 24, id: 23, sources: 2, size: 35x28, npix 540, brick X: 0,35, Y: 252,280, one pixel: 23 252 Blob 5 finished, total: Wall: 3.38 s, CPU: 3.38 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.143964 MB Blob 12 of 24, id: 10, sources: 1, size: 28x30, npix 538, brick X: 232,260, Y: 54,84, one pixel: 244 54 Blob 11 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.143964 MB Blob 13 of 24, id: 21, sources: 1, size: 28x28, npix 530, brick X: 0,28, Y: 227,255, one pixel: 10 227 Blob 10 finished, total: Wall: 1.19 s, CPU: 1.19 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144088 MB Blob 14 of 24, id: 8, sources: 1, size: 29x27, npix 524, brick X: 57,86, Y: 53,80, one pixel: 71 53 Blob 9 finished, total: Wall: 1.84 s, CPU: 1.83 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143736 MB Blob 15 of 24, id: 3, sources: 1, size: 22x28, npix 429, brick X: 259,281, Y: 20,48, one pixel: 272 20 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.48431, ee1=-0.00189814, ee2=-0.07345 Blob 1 finished, total: Wall: 8.01 s, CPU: 8.01 s, VmPeak: 812 MB, VmSize: 713 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.14574 MB Blob 16 of 24, id: 5, sources: 1, size: 26x24, npix 388, brick X: 33,59, Y: 34,58, one pixel: 44 34 Blob 12 finished, total: Wall: 0.98 s, CPU: 0.98 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144012 MB Blob 17 of 24, id: 4, sources: 1, size: 32x22, npix 378, brick X: 133,165, Y: 24,46, one pixel: 156 24 Blob 16 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144012 MB Blob 18 of 24, id: 11, sources: 1, size: 24x24, npix 356, brick X: 83,107, Y: 66,90, one pixel: 93 66 Blob 13 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144088 MB Blob 19 of 24, id: 9, sources: 1, size: 24x24, npix 351, brick X: 207,231, Y: 53,77, one pixel: 217 53 Blob 15 finished, total: Wall: 0.61 s, CPU: 0.61 s, VmPeak: 812 MB, VmSize: 713 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.14574 MB Blob 20 of 24, id: 18, sources: 1, size: 24x23, npix 319, brick X: 35,59, Y: 182,205, one pixel: 45 182 Blob 21 of 24, id: 7, sources: 1, size: 20x24, npix 300, brick X: 139,159, Y: 51,75, one pixel: 148 51 Blob 18 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144088 MB Blob 22 of 24, id: 2, sources: 1, size: 22x21, npix 290, brick X: 89,111, Y: 18,39, one pixel: 98 18 Measuring 1 iterative sources Blob 19 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 812 MB, VmSize: 713 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.14574 MB Blob 23 of 24, id: 16, sources: 1, size: 20x21, npix 238, brick X: 250,270, Y: 140,161, one pixel: 258 140 Blob 20 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144088 MB Blob 24 of 24, id: 15, sources: 1, size: 21x19, npix 228, brick X: 43,64, Y: 117,136, one pixel: 51 117 Blob 17 finished, total: Wall: 1.02 s, CPU: 1.02 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144012 MB Blob 22 finished, total: Wall: 0.20 s, CPU: 0.20 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144088 MB Blob 21 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 812 MB, VmSize: 713 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.14574 MB Blob 23 finished, total: Wall: 0.17 s, CPU: 0.17 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144012 MB Blob 24 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144088 MB Blob 14 finished, total: Wall: 1.93 s, CPU: 1.93 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.14422 MB Old catalog: 54 New catalog: 50 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/metrics/cus/blobs-custom-106762p43559.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/metrics/cus/all-models-custom-106762p43559.fits Stage fitblobs : Wall: 10.32 s, CPU: 0.48 s, VmPeak: 992 MB, VmSize: 992 MB, VmRSS: 235 MB, VmData: 262 MB, maxrss: 0.566548 MB Stage fitblobs finished: 2020-06-07T19:34:28.302011 Resources for stage fitblobs : 38.477 s worker CPU, 38.647 s worker Wall, Wall: 10.317 s, Cores in use: 3.78, Total efficiency (on 4 cores): 94.4 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T19:34:28.303879 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/tmp-legacysurvey-custom-106762p43559-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/tmp-legacysurvey-custom-106762p43559-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/tmp-legacysurvey-custom-106762p43559-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/tmp-legacysurvey-custom-106762p43559-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-resid.jpg Stage coadds : Wall: 3.77 s, CPU: 0.62 s, VmPeak: 992 MB, VmSize: 992 MB, VmRSS: 235 MB, VmData: 262 MB, maxrss: 0.566548 MB Stage coadds finished: 2020-06-07T19:34:32.078501 Resources for stage coadds : 2.385 s worker CPU, 2.495 s worker Wall, Wall: 3.776 s, Cores in use: 0.80, Total efficiency (on 4 cores): 19.9 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T19:34:32.080116 Cut to 1 unWISE tiles Reading WISE tile 1061p439 band 1 Reading WISE tile 1061p439 band 3 Reading WISE tile 1061p439 band 2 Reading WISE tile 1061p439 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1061p439/unwise-1061p439-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1061p439/unwise-1061p439-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1061p439/unwise-1061p439-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1061p439/unwise-1061p439-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1061p439/unwise-1061p439-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.17 s, CPU: 0.17 s, VmPeak: 807 MB, VmSize: 794 MB, VmRSS: 146 MB, VmData: 175 MB, maxrss: 0.189944 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1061p439/unwise-1061p439-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1061p439/unwise-1061p439-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1061p439/unwise-1061p439-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1061p439/unwise-1061p439-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1061p439/unwise-1061p439-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.13 s, CPU: 0.13 s, VmPeak: 810 MB, VmSize: 792 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209316 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1061p439/unwise-1061p439-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1061p439/unwise-1061p439-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1061p439/unwise-1061p439-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1061p439/unwise-1061p439-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 812 MB, VmSize: 795 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.211664 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1061p439/unwise-1061p439-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1061p439/unwise-1061p439-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1061p439/unwise-1061p439-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1061p439/unwise-1061p439-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 807 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.207948 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/tmp-legacysurvey-custom-106762p43559-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/tmp-legacysurvey-custom-106762p43559-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.59 s, CPU: 0.70 s, VmPeak: 992 MB, VmSize: 992 MB, VmRSS: 236 MB, VmData: 262 MB, maxrss: 0.566548 MB Stage wise_forced finished: 2020-06-07T19:34:34.670645 Resources for stage wise_forced : 4.928 s worker CPU, 6.097 s worker Wall, Wall: 2.592 s, Cores in use: 2.17, Total efficiency (on 4 cores): 54.2 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T19:34:34.672586 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/coadd/cus/custom-106762p43559/legacysurvey-custom-106762p43559-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/tractor-i/cus/tractor-custom-106762p43559.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/tractor/cus/tractor-custom-106762p43559.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2223690/tractor/cus/brick-custom-106762p43559.sha256sum Stage writecat : Wall: 1.11 s, CPU: 0.95 s, VmPeak: 1124 MB, VmSize: 996 MB, VmRSS: 238 MB, VmData: 262 MB, maxrss: 0.566548 MB Stage writecat finished: 2020-06-07T19:34:35.784498 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.113 s, Cores in use: 0.85, Total efficiency (on 4 cores): 21.3 % Stage writecat finished All done: 50.628 s worker CPU, 59.579 s worker Wall, Wall: 30.024 s, Cores in use: 2.01, Total efficiency (on 4 cores): 50.2 % Finished galaxy PGC2223690 in 0.534 minutes.