Started working on galaxy PGC2612490 at Sun Jun 7 17:36:34 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 281.6835 61.132305599999995 --width 307 --height 307 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T17:36:35.479945 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '281.6835', '61.132305599999995', '--width', '307', '--height', '307', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 281.6835 61.132305599999995 --width 307 --height 307 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 281.6835 61.132305599999995 Starting process 14706 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.0573 MB Starting process 14711 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 14712 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 14713 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T17:36:36.337854 Keeping 9 CCDs: k4m_160606_093724_ooi_zd_ls9.fits.fz k4m_160606_093724_ooi_zd_ls9-CCD2 z exptime 83.105 propid 2016A-0453 seeing 1.09 MJD 57545.401 object MzLS_689455_z k4m_171110_033746_ooi_zd_ls9.fits.fz k4m_171110_033746_ooi_zd_ls9-CCD3 z exptime 119.103 propid 2016A-0453 seeing 0.87 MJD 58067.151 object MzLS_690673_z k4m_170926_054320_ooi_zd_ls9.fits.fz k4m_170926_054320_ooi_zd_ls9-CCD2 z exptime 250.105 propid 2016A-0453 seeing 1.68 MJD 58022.238 object MzLS_690066_z ksb_180519_095740_ooi_g_ls9.fits.fz ksb_180519_095740_ooi_g_ls9-CCD1 g exptime 102.928 propid NOTBASS seeing 1.36 MJD 58257.415 object 38791 ksb_170619_101812_ooi_r_ls9.fits.fz ksb_170619_101812_ooi_r_ls9-CCD1 r exptime 227.141 propid BASS seeing 1.83 MJD 57923.429 object 38791 ksb_160711_102120_ooi_g_ls9.fits.fz ksb_160711_102120_ooi_g_ls9-CCD4 g exptime 113.0 propid BASS seeing 1.61 MJD 57580.431 object 38792 ksb_180519_074738_ooi_r_ls9.fits.fz ksb_180519_074738_ooi_r_ls9-CCD4 r exptime 81.405 propid NOTBASS seeing 1.23 MJD 58257.325 object 38792 ksb_170621_105725_ooi_g_ls9.fits.fz ksb_170621_105725_ooi_g_ls9-CCD1 g exptime 205.752 propid BASS seeing 1.18 MJD 57925.457 object 38793 ksb_180520_102930_ooi_r_ls9.fits.fz ksb_180520_102930_ooi_r_ls9-CCD1 r exptime 87.759 propid NOTBASS seeing 1.18 MJD 58258.437 object 38793 mosaic get_fwhm: self.fwhm = 3.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1514 1826 and amp range 0 2005 and image y 807 1120 and amp range 0 2039 Range in image: x 0 313 , y 0 314 (with image size 313 x 314) dzp 0.0014252509 -> scaling image by 1.0013135665633692 Faked up EXPNUM 82570187 Faked up EXPNUM 82570187 Faked up EXPNUM 82570187 90prime get_fwhm: self.fwhm = 2.99 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2944 3125 and amp range 2016 4031 and image y 2613 2794 and amp range 2048 4095 Range in image: x 0 182 , y 0 182 (with image size 182 x 182) dzp 0.016257986 -> scaling image by 1.01508683329102 mosaic get_fwhm: self.fwhm = 4.21 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2793 3109 and amp range 2048 4095 and image y 1705 2019 and amp range 0 2039 Range in image: x 0 317 , y 0 315 (with image size 317 x 315) dzp 0.0072022504 -> scaling image by 1.0066555682883527 Faked up EXPNUM 79230146 Faked up EXPNUM 79230146 Faked up EXPNUM 79230146 90prime get_fwhm: self.fwhm = 4.05 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2953 3134 and amp range 2016 4031 and image y 2619 2799 and amp range 2048 4095 Range in image: x 0 182 , y 0 181 (with image size 182 x 181) dzp 0.02308583 -> scaling image by 1.021490500713915 Faked up EXPNUM 82570129 Faked up EXPNUM 82570129 Faked up EXPNUM 82570129 90prime get_fwhm: self.fwhm = 2.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 794 974 and amp range 0 2015 and image y 117 296 and amp range 0 2047 Range in image: x 0 181 , y 0 180 (with image size 181 x 180) dzp 0.014080205 -> scaling image by 1.0130528017623828 Faked up EXPNUM 75800140 Faked up EXPNUM 75800140 Faked up EXPNUM 75800140 90prime get_fwhm: self.fwhm = 3.55 Found 4 relevant rows in amp-corrections file. Found overlap: image x 810 989 and amp range 0 2015 and image y 53 232 and amp range 0 2047 Range in image: x 0 180 , y 0 180 (with image size 180 x 180) dzp 0.009539392 -> scaling image by 1.0088248156909383 mosaic get_fwhm: self.fwhm = 6.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 92 400 and amp range 0 2047 and image y 3117 3426 and amp range 2040 4078 Range in image: x 0 309 , y 0 310 (with image size 309 x 310) dzp 0.003927584 -> scaling image by 1.0036239891963392 Faked up EXPNUM 82580134 Faked up EXPNUM 82580134 Faked up EXPNUM 82580134 90prime get_fwhm: self.fwhm = 2.61 Found 4 relevant rows in amp-corrections file. Found overlap: image x 911 1096 and amp range 0 2015 and image y 643 825 and amp range 0 2047 Range in image: x 0 186 , y 0 183 (with image size 186 x 183) dzp -0.04811793 -> scaling image by 0.9566494556405901 Faked up EXPNUM 79250097 Faked up EXPNUM 79250097 Faked up EXPNUM 79250097 90prime get_fwhm: self.fwhm = 2.61 Found 4 relevant rows in amp-corrections file. Found overlap: image x 922 1106 and amp range 0 2015 and image y 637 819 and amp range 0 2047 Range in image: x 0 185 , y 0 183 (with image size 185 x 183) dzp -0.023075538 -> scaling image by 0.9789709052881876 Stage tims : Wall: 5.99 s, CPU: 1.04 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 172 MB, VmData: 206 MB, maxrss: 0.566564 MB Stage tims finished: 2020-06-07T17:36:42.332041 Resources for stage tims : 3.265 s worker CPU, 14.218 s worker Wall, Wall: 5.995 s, Cores in use: 0.72, Total efficiency (on 4 cores): 17.9 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T17:36:42.396302 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00822.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00743.fits Matched 4 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/metrics/cus/reference-custom-281683p61132.fits Stage refs : Wall: 5.21 s, CPU: 4.49 s, VmPeak: 995 MB, VmSize: 989 MB, VmRSS: 221 MB, VmData: 253 MB, maxrss: 0.566564 MB Stage refs finished: 2020-06-07T17:36:47.603025 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.208 s, Cores in use: 0.86, Total efficiency (on 4 cores): 21.6 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T17:36:47.604496 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/metrics/cus/outlier-mask-custom-281683p61132.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/metrics/cus/outliers-pre-custom-281683p61132.jpg Image ksb_160711_102120_ooi_g_ls9-CCD4 g : masking 333 positive outlier pixels and 0 negative outlier pixels Image ksb_170621_105725_ooi_g_ls9-CCD1 g : masking 75 positive outlier pixels and 0 negative outlier pixels Image ksb_180519_095740_ooi_g_ls9-CCD1 g : masking 75 positive outlier pixels and 0 negative outlier pixels Image k4m_171110_033746_ooi_zd_ls9-CCD3 z : masking 1089 positive outlier pixels and 0 negative outlier pixels Image k4m_170926_054320_ooi_zd_ls9-CCD2 z : masking 3500 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/metrics/cus/outlier-mask-custom-281683p61132.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/metrics/cus/outliers-post-custom-281683p61132.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/metrics/cus/outliers-masked-pos-custom-281683p61132.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/metrics/cus/outliers-masked-neg-custom-281683p61132.jpg Stage outliers : Wall: 1.13 s, CPU: 0.74 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 239 MB, VmData: 267 MB, maxrss: 0.566564 MB Stage outliers finished: 2020-06-07T17:36:48.739571 Resources for stage outliers : 1.277 s worker CPU, 1.278 s worker Wall, Wall: 1.136 s, Cores in use: 1.78, Total efficiency (on 4 cores): 44.4 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T17:36:48.741450 Stage halos : Wall: 0.59 s, CPU: 0.57 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 239 MB, VmData: 267 MB, maxrss: 0.566564 MB Stage halos finished: 2020-06-07T17:36:49.327749 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.587 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.2 % Stage halos finished Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-06-07T17:36:49.329549 PSF sigmas in coadd pixels: ['2.20', '2.61', '1.92'] Using average PSF sigma 2.2445553475443187 Gaussian PSF norm 0.1256795882010694 vs pixelized 0.099843435 average tim pixel scale / coadd scale: 1.7293238566249949 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.98', '2.00', '1.92'] Using average PSF sigma 2.29867697004563 Gaussian PSF norm 0.12272050203220962 vs pixelized 0.1039274 average tim pixel scale / coadd scale: 1.729736020184257 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.78', '1.42', '2.73'] Using average PSF sigma 1.974935527603123 Gaussian PSF norm 0.1428374687837238 vs pixelized 0.11586632 average tim pixel scale / coadd scale: 0.990981628002158 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.27 s, CPU: 0.22 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 241 MB, VmData: 269 MB, maxrss: 0.566564 MB Stage fit_on_coadds finished: 2020-06-07T17:36:49.601823 Resources for stage fit_on_coadds : 0.298 s worker CPU, 0.310 s worker Wall, Wall: 0.273 s, Cores in use: 1.91, Total efficiency (on 4 cores): 47.8 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T17:36:49.604484 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 34 potential peaks Of 34 potential peaks: 4 in veto map, 3 cut by saddle test, 0 cut by aper test, 27 kept SED z : 27 new peaks Found 30 potential peaks Of 30 potential peaks: 26 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 23 potential peaks Of 23 potential peaks: 20 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 38 potential peaks Of 38 potential peaks: 34 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 39 potential peaks Of 39 potential peaks: 36 in veto map, 0 cut by saddle test, 0 cut by aper test, 3 kept SED Red : 3 new peaks Adding 36 new sources Median coadd sky for g : -2.1120284e-05 Median coadd sky for r : -0.00014857829 Median coadd sky for z : -0.00016366945 Stage srcs : Wall: 0.74 s, CPU: 0.67 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 242 MB, VmData: 269 MB, maxrss: 0.566564 MB Stage srcs finished: 2020-06-07T17:36:50.344051 Resources for stage srcs : 0.165 s worker CPU, 0.165 s worker Wall, Wall: 0.741 s, Cores in use: 1.13, Total efficiency (on 4 cores): 28.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T17:36:50.361673 Blob 1 of 21, id: 6, sources: 9, size: 135x173, npix 13267, brick X: 80,215, Y: 65,238, one pixel: 161 65 Blob 2 of 21, id: 5, sources: 2, size: 77x56, npix 2661, brick X: 228,305, Y: 49,105, one pixel: 272 49 Blob 3 of 21, id: 13, sources: 1, size: 56x59, npix 2222, brick X: 250,306, Y: 212,271, one pixel: 276 212 Blob 4 of 21, id: 14, sources: 4, size: 68x48, npix 1833, brick X: 64,132, Y: 222,270, one pixel: 78 222 Blob 5 of 21, id: 4, sources: 3, size: 77x41, npix 1562, brick X: 165,242, Y: 26,67, one pixel: 179 26 Measuring 2 iterative sources Measuring 1 iterative sources Blob 3 finished, total: Wall: 1.24 s, CPU: 1.24 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142636 MB Blob 6 of 21, id: 1, sources: 3, size: 57x46, npix 1437, brick X: 42,99, Y: 13,59, one pixel: 81 13 Blob 2 finished, total: Wall: 2.68 s, CPU: 2.68 s, VmPeak: 795 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143156 MB Blob 7 of 21, id: 7, sources: 2, size: 31x53, npix 1103, brick X: 17,48, Y: 91,144, one pixel: 30 91 Blob 5 finished, total: Wall: 1.83 s, CPU: 1.83 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142636 MB Blob 8 of 21, id: 0, sources: 2, size: 36x44, npix 927, brick X: 114,150, Y: 0,44, one pixel: 131 0 Measuring 1 iterative sources Blob 4 finished, total: Wall: 3.73 s, CPU: 3.73 s, VmPeak: 808 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144328 MB Blob 9 of 21, id: 8, sources: 2, size: 42x32, npix 741, brick X: 34,76, Y: 135,167, one pixel: 46 135 Blob 6 finished, total: Wall: 2.15 s, CPU: 2.15 s, VmPeak: 795 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143156 MB Blob 10 of 21, id: 2, sources: 2, size: 37x25, npix 513, brick X: 240,277, Y: 19,44, one pixel: 251 19 Blob 7 finished, total: Wall: 1.95 s, CPU: 1.95 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143816 MB Blob 11 of 21, id: 16, sources: 1, size: 26x26, npix 454, brick X: 137,163, Y: 243,269, one pixel: 149 243 Blob 8 finished, total: Wall: 1.38 s, CPU: 1.38 s, VmPeak: 808 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144328 MB Blob 12 of 21, id: 15, sources: 1, size: 26x25, npix 414, brick X: 169,195, Y: 223,248, one pixel: 180 223 Blob 11 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 808 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144328 MB Blob 13 of 21, id: 9, sources: 1, size: 26x25, npix 394, brick X: 266,292, Y: 159,184, one pixel: 276 159 Blob 9 finished, total: Wall: 1.01 s, CPU: 1.01 s, VmPeak: 795 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.14382 MB Blob 14 of 21, id: 19, sources: 1, size: 26x21, npix 385, brick X: 24,50, Y: 286,307, one pixel: 35 286 Blob 15 of 21, id: 18, sources: 1, size: 26x23, npix 383, brick X: 279,305, Y: 284,307, one pixel: 290 284 Blob 10 finished, total: Wall: 0.95 s, CPU: 0.95 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143816 MB Blob 16 of 21, id: 12, sources: 1, size: 24x24, npix 361, brick X: 11,35, Y: 191,215, one pixel: 22 191 Blob 13 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 795 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.14382 MB Blob 12 finished, total: Wall: 0.48 s, CPU: 0.48 s, VmPeak: 808 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144328 MB Blob 17 of 21, id: 11, sources: 1, size: 23x23, npix 318, brick X: 216,239, Y: 188,211, one pixel: 227 188 Blob 18 of 21, id: 3, sources: 1, size: 20x23, npix 303, brick X: 287,307, Y: 25,48, one pixel: 297 25 Blob 14 finished, total: Wall: 0.58 s, CPU: 0.58 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143816 MB Blob 19 of 21, id: 10, sources: 1, size: 22x21, npix 280, brick X: 7,29, Y: 169,190, one pixel: 15 169 Blob 15 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 795 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.14382 MB Blob 20 of 21, id: 20, sources: 1, size: 20x14, npix 188, brick X: 77,97, Y: 293,307, one pixel: 85 293 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.83336, ee1=-0.0102626, ee2=0.00808474 Measuring 2 iterative sources Blob 17 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143816 MB Blob 21 of 21, id: 17, sources: 1, size: 15x18, npix 156, brick X: 292,307, Y: 269,287, one pixel: 300 269 Blob 16 finished, total: Wall: 0.54 s, CPU: 0.54 s, VmPeak: 808 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144328 MB Blob 18 finished, total: Wall: 0.19 s, CPU: 0.19 s, VmPeak: 795 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.14382 MB Blob 21 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 795 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.14382 MB Blob 19 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143816 MB Blob 20 finished, total: Wall: 0.48 s, CPU: 0.48 s, VmPeak: 808 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144328 MB Blob 1 finished, total: Wall: 7.71 s, CPU: 7.71 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144788 MB Old catalog: 49 New catalog: 44 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/metrics/cus/blobs-custom-281683p61132.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/metrics/cus/all-models-custom-281683p61132.fits Stage fitblobs : Wall: 8.33 s, CPU: 0.58 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 242 MB, VmData: 269 MB, maxrss: 0.566564 MB Stage fitblobs finished: 2020-06-07T17:36:58.688354 Resources for stage fitblobs : 29.521 s worker CPU, 30.117 s worker Wall, Wall: 8.328 s, Cores in use: 3.61, Total efficiency (on 4 cores): 90.4 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T17:36:58.690333 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/tmp-legacysurvey-custom-281683p61132-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/tmp-legacysurvey-custom-281683p61132-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/tmp-legacysurvey-custom-281683p61132-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/tmp-legacysurvey-custom-281683p61132-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-resid.jpg Stage coadds : Wall: 1.44 s, CPU: 0.65 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 242 MB, VmData: 269 MB, maxrss: 0.566564 MB Stage coadds finished: 2020-06-07T17:37:00.132745 Resources for stage coadds : 2.256 s worker CPU, 2.380 s worker Wall, Wall: 1.443 s, Cores in use: 2.01, Total efficiency (on 4 cores): 50.3 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T17:37:00.134429 Cut to 1 unWISE tiles Reading WISE tile 2820p605 band 3 Reading WISE tile 2820p605 band 1 Reading WISE tile 2820p605 band 2 Reading WISE tile 2820p605 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 795 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.207964 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.13 s, CPU: 0.13 s, VmPeak: 808 MB, VmSize: 794 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.188508 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 810 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.20834 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 809 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.208132 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/tmp-legacysurvey-custom-281683p61132-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/tmp-legacysurvey-custom-281683p61132-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.83 s, CPU: 0.59 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 243 MB, VmData: 269 MB, maxrss: 0.566564 MB Stage wise_forced finished: 2020-06-07T17:37:02.964596 Resources for stage wise_forced : 4.832 s worker CPU, 7.514 s worker Wall, Wall: 2.831 s, Cores in use: 1.92, Total efficiency (on 4 cores): 47.9 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T17:37:02.966678 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281683p61132/legacysurvey-custom-281683p61132-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/tractor-i/cus/tractor-custom-281683p61132.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/tractor/cus/tractor-custom-281683p61132.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/tractor/cus/brick-custom-281683p61132.sha256sum Stage writecat : Wall: 0.83 s, CPU: 0.59 s, VmPeak: 1132 MB, VmSize: 1004 MB, VmRSS: 246 MB, VmData: 271 MB, maxrss: 0.566564 MB Stage writecat finished: 2020-06-07T17:37:03.794842 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.829 s, Cores in use: 0.71, Total efficiency (on 4 cores): 17.8 % Stage writecat finished All done: 41.615 s worker CPU, 55.985 s worker Wall, Wall: 27.464 s, Cores in use: 1.89, Total efficiency (on 4 cores): 47.2 % Finished galaxy PGC2612490 in 0.507 minutes. Started working on galaxy PGC2612490 at Fri Aug 7 10:06:59 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 281.684073560481 61.13200787184958 --width 307 --height 307 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T10:07:00.676450 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '281.684073560481', '61.13200787184958', '--width', '307', '--height', '307', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 281.684073560481 61.13200787184958 --width 307 --height 307 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 281.684073560481 61.13200787184958 Starting process 60755 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 60756 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 60757 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 60758 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 60759 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 60760 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059556 MB Starting process 60761 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059556 MB Starting process 60762 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 60763 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 60764 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 60765 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 60766 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 60767 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 60768 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 60769 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 60770 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T10:07:01.162005 Keeping 9 CCDs: k4m_160606_093724_ooi_zd_ls9-CCD2 z expnum 93800 exptime 83.105 propid 2016A-0453 seeing 1.09 MJD 57545.401 object MzLS_689455_z mosaic/CP/V4.3/CP20160605/k4m_160606_093724_ooi_zd_ls9.fits.fz k4m_171110_033746_ooi_zd_ls9-CCD3 z expnum 145625 exptime 119.103 propid 2016A-0453 seeing 0.87 MJD 58067.151 object MzLS_690673_z mosaic/CP/V4.3/CP20171109/k4m_171110_033746_ooi_zd_ls9.fits.fz k4m_170926_054320_ooi_zd_ls9-CCD2 z expnum 140906 exptime 250.105 propid 2016A-0453 seeing 1.68 MJD 58022.238 object MzLS_690066_z mosaic/CP/V4.3/CP20170925/k4m_170926_054320_ooi_zd_ls9.fits.fz ksb_180519_095740_ooi_g_ls9-CCD1 g expnum 82570187 exptime 102.928 propid NOTBASS seeing 1.36 MJD 58257.415 object 38791 90prime/CP/V2.3/CP20180518/ksb_180519_095740_ooi_g_ls9.fits.fz ksb_170619_101812_ooi_r_ls9-CCD1 r expnum 79230146 exptime 227.141 propid BASS seeing 1.83 MJD 57923.429 object 38791 90prime/CP/V2.3/CP20170618/ksb_170619_101812_ooi_r_ls9.fits.fz ksb_160711_102120_ooi_g_ls9-CCD4 g expnum 75800140 exptime 113.0 propid BASS seeing 1.61 MJD 57580.431 object 38792 90prime/CP/V2.3/CP20160710/ksb_160711_102120_ooi_g_ls9.fits.fz ksb_180519_074738_ooi_r_ls9-CCD4 r expnum 82570129 exptime 81.405 propid NOTBASS seeing 1.23 MJD 58257.325 object 38792 90prime/CP/V2.3/CP20180518/ksb_180519_074738_ooi_r_ls9.fits.fz ksb_170621_105725_ooi_g_ls9-CCD1 g expnum 79250097 exptime 205.752 propid BASS seeing 1.18 MJD 57925.457 object 38793 90prime/CP/V2.3/CP20170620/ksb_170621_105725_ooi_g_ls9.fits.fz ksb_180520_102930_ooi_r_ls9-CCD1 r expnum 82580134 exptime 87.759 propid NOTBASS seeing 1.18 MJD 58258.437 object 38793 90prime/CP/V2.3/CP20180519/ksb_180520_102930_ooi_r_ls9.fits.fz Faked up EXPNUM 75800140 Faked up EXPNUM 75800140 Faked up EXPNUM 75800140 90prime get_fwhm: self.fwhm = 3.55 Found 4 relevant rows in amp-corrections file. Found overlap: image x 813 992 and amp range 0 2015 and image y 51 230 and amp range 0 2047 Range in image: x 0 180 , y 0 180 (with image size 180 x 180) dzp 0.009539392 -> scaling image by 1.0088248156909383 Faked up EXPNUM 79230146 Faked up EXPNUM 79230146 Faked up EXPNUM 79230146 90prime get_fwhm: self.fwhm = 4.05 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2956 3136 and amp range 2016 4031 and image y 2617 2797 and amp range 2048 4095 Range in image: x 0 181 , y 0 181 (with image size 181 x 181) dzp 0.02308583 -> scaling image by 1.021490500713915 Faked up EXPNUM 82580134 Faked up EXPNUM 82580134 Faked up EXPNUM 82580134 90prime get_fwhm: self.fwhm = 2.61 Found 4 relevant rows in amp-corrections file. Found overlap: image x 914 1098 and amp range 0 2015 and image y 640 823 and amp range 0 2047 Range in image: x 0 185 , y 0 184 (with image size 185 x 184) dzp -0.04811793 -> scaling image by 0.9566494556405901 Faked up EXPNUM 82570129 Faked up EXPNUM 82570129 Faked up EXPNUM 82570129 90prime get_fwhm: self.fwhm = 2.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 797 976 and amp range 0 2015 and image y 115 294 and amp range 0 2047 Range in image: x 0 180 , y 0 180 (with image size 180 x 180) dzp 0.014080205 -> scaling image by 1.0130528017623828 Faked up EXPNUM 82570187 Faked up EXPNUM 82570187 Faked up EXPNUM 82570187 90prime get_fwhm: self.fwhm = 2.99 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2947 3127 and amp range 2016 4031 and image y 2611 2792 and amp range 2048 4095 Range in image: x 0 181 , y 0 182 (with image size 181 x 182) dzp 0.016257986 -> scaling image by 1.01508683329102 mosaic get_fwhm: self.fwhm = 3.37 Found 4 relevant rows in amp-corrections file. mosaic get_fwhm: self.fwhm = 4.21 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1510 1822 and amp range 0 2005 and image y 811 1124 and amp range 0 2039 Found overlap: image x 2789 3105 and amp range 2048 4095 and image y 1709 2023 and amp range 0 2039 Range in image: x 0 313 , y 0 314 (with image size 313 x 314) Range in image: x 0 317 , y 0 315 (with image size 317 x 315) dzp 0.0014252509 -> scaling image by 1.0013135665633692 dzp 0.0072022504 -> scaling image by 1.0066555682883527 Faked up EXPNUM 79250097 Faked up EXPNUM 79250097 Faked up EXPNUM 79250097 90prime get_fwhm: self.fwhm = 2.61 Found 4 relevant rows in amp-corrections file. Found overlap: image x 924 1108 and amp range 0 2015 and image y 634 817 and amp range 0 2047 Range in image: x 0 185 , y 0 184 (with image size 185 x 184) dzp -0.023075538 -> scaling image by 0.9789709052881876 mosaic get_fwhm: self.fwhm = 6.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 87 396 and amp range 0 2047 and image y 3121 3430 and amp range 2040 4078 Range in image: x 0 310 , y 0 310 (with image size 310 x 310) dzp 0.003927584 -> scaling image by 1.0036239891963392 Stage tims : Wall: 12.52 s, CPU: 0.91 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.178148 MB Stage tims finished: 2020-08-07T10:07:13.677376 Resources for stage tims : 4.408 s worker CPU, 36.891 s worker Wall, Wall: 12.517 s, Cores in use: 0.43, Total efficiency (on 16 cores): 2.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T10:07:14.401086 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00822.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00743.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/metrics/cus/reference-custom-281684p61132.fits Stage refs : Wall: 26.25 s, CPU: 4.43 s, VmPeak: 1005 MB, VmSize: 999 MB, VmRSS: 224 MB, VmData: 256 MB, maxrss: 0.229804 MB Stage refs finished: 2020-08-07T10:07:40.649719 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 26.250 s, Cores in use: 0.17, Total efficiency (on 16 cores): 1.1 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T10:07:40.734223 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/metrics/cus/outlier-mask-custom-281684p61132.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/metrics/cus/outliers-pre-custom-281684p61132.jpg Image ksb_160711_102120_ooi_g_ls9-CCD4 g : masking 329 positive outlier pixels and 0 negative outlier pixels Image ksb_170621_105725_ooi_g_ls9-CCD1 g : masking 77 positive outlier pixels and 0 negative outlier pixels Image ksb_180519_095740_ooi_g_ls9-CCD1 g : masking 73 positive outlier pixels and 0 negative outlier pixels Image k4m_171110_033746_ooi_zd_ls9-CCD3 z : masking 1193 positive outlier pixels and 0 negative outlier pixels Image k4m_170926_054320_ooi_zd_ls9-CCD2 z : masking 3547 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/metrics/cus/outlier-mask-custom-281684p61132.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/metrics/cus/outliers-post-custom-281684p61132.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/metrics/cus/outliers-masked-pos-custom-281684p61132.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/metrics/cus/outliers-masked-neg-custom-281684p61132.jpg Stage outliers : Wall: 1.06 s, CPU: 0.65 s, VmPeak: 1008 MB, VmSize: 1008 MB, VmRSS: 244 MB, VmData: 273 MB, maxrss: 0.249776 MB Stage outliers finished: 2020-08-07T10:07:41.789276 Resources for stage outliers : 1.062 s worker CPU, 1.147 s worker Wall, Wall: 1.056 s, Cores in use: 1.62, Total efficiency (on 16 cores): 10.1 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T10:07:41.834887 Stage halos : Wall: 0.37 s, CPU: 0.32 s, VmPeak: 1008 MB, VmSize: 1008 MB, VmRSS: 244 MB, VmData: 273 MB, maxrss: 0.250136 MB Stage halos finished: 2020-08-07T10:07:42.203420 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.370 s, Cores in use: 0.88, Total efficiency (on 16 cores): 5.5 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T10:07:42.235742 PSF sigmas in coadd pixels: ['2.20', '2.61', '1.92'] Using average PSF sigma 2.2445553475443187 Gaussian PSF norm 0.1256795882010694 vs pixelized 0.099836856 average tim pixel scale / coadd scale: 1.7293238566249949 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.98', '2.00', '1.92'] Using average PSF sigma 2.29867697004563 Gaussian PSF norm 0.12272050203220962 vs pixelized 0.10392743 average tim pixel scale / coadd scale: 1.729736020184257 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.78', '1.42', '2.73'] Using average PSF sigma 1.974935527603123 Gaussian PSF norm 0.1428374687837238 vs pixelized 0.115866385 average tim pixel scale / coadd scale: 0.990981628002158 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.21 s, CPU: 0.19 s, VmPeak: 1008 MB, VmSize: 1008 MB, VmRSS: 246 MB, VmData: 273 MB, maxrss: 0.2516 MB Stage fit_on_coadds finished: 2020-08-07T10:07:42.446106 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.219 s worker CPU, 0.219 s worker Wall, Wall: 0.212 s, Cores in use: 1.94, Total efficiency (on 16 cores): 12.1 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-fit_on_coadds.p Running stage srcs Warning: Stellar halo subtraction is only implemented for DECam Running stage srcs at 2020-08-07T10:07:42.456637 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 35 potential peaks Of 35 potential peaks: 5 in veto map, 3 cut by saddle test, 0 cut by aper test, 27 kept SED z : 27 new peaks Found 30 potential peaks Of 30 potential peaks: 26 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 23 potential peaks Of 23 potential peaks: 20 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 40 potential peaks Of 40 potential peaks: 35 in veto map, 2 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 40 potential peaks Of 40 potential peaks: 38 in veto map, 0 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 36 new sources Median coadd sky for g : -2.6400337e-05 Median coadd sky for r : -0.0001449286 Median coadd sky for z : -0.00012718463 Stage srcs : Wall: 0.56 s, CPU: 0.49 s, VmPeak: 1008 MB, VmSize: 1008 MB, VmRSS: 246 MB, VmData: 273 MB, maxrss: 0.252092 MB Stage srcs finished: 2020-08-07T10:07:43.016134 Resources for stage srcs : 0.099 s worker CPU, 0.099 s worker Wall, Wall: 0.561 s, Cores in use: 1.06, Total efficiency (on 16 cores): 6.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T10:07:43.029061 Blob 1 of 22, id: 8, sources: 8, size: 134x173, npix 13264, brick X: 84,218, Y: 69,242, one pixel: 166 69 Blob 2 of 22, id: 7, sources: 2, size: 75x56, npix 2633, brick X: 232,307, Y: 53,109, one pixel: 276 53 Blob 3 of 22, id: 15, sources: 1, size: 54x59, npix 2171, brick X: 253,307, Y: 216,275, one pixel: 280 216 Blob 4 of 22, id: 16, sources: 4, size: 68x47, npix 1822, brick X: 68,136, Y: 227,274, one pixel: 79 227 Blob 5 of 22, id: 5, sources: 3, size: 77x41, npix 1564, brick X: 169,246, Y: 30,71, one pixel: 183 30 Blob 6 of 22, id: 3, sources: 3, size: 56x46, npix 1421, brick X: 46,102, Y: 17,63, one pixel: 85 17 Blob 7 of 22, id: 9, sources: 2, size: 31x53, npix 1085, brick X: 21,52, Y: 95,148, one pixel: 34 95 Blob 8 of 22, id: 1, sources: 2, size: 36x48, npix 987, brick X: 118,154, Y: 0,48, one pixel: 139 0 Blob 9 of 22, id: 10, sources: 2, size: 42x33, npix 721, brick X: 38,80, Y: 139,172, one pixel: 50 139 Blob 10 of 22, id: 4, sources: 2, size: 37x25, npix 514, brick X: 244,281, Y: 23,48, one pixel: 255 23 Blob 11 of 22, id: 18, sources: 1, size: 26x27, npix 455, brick X: 141,167, Y: 247,274, one pixel: 153 247 Blob 12 of 22, id: 17, sources: 1, size: 26x25, npix 416, brick X: 173,199, Y: 227,252, one pixel: 184 227 Blob 13 of 22, id: 11, sources: 1, size: 26x25, npix 393, brick X: 270,296, Y: 163,188, one pixel: 281 163 Blob 14 of 22, id: 14, sources: 1, size: 24x25, npix 365, brick X: 15,39, Y: 195,220, one pixel: 26 195 Blob 15 of 22, id: 13, sources: 1, size: 23x23, npix 328, brick X: 220,243, Y: 192,215, one pixel: 231 192 Blob 16 of 22, id: 20, sources: 1, size: 24x19, npix 317, brick X: 283,307, Y: 288,307, one pixel: 294 288 Blob 17 of 22, id: 12, sources: 1, size: 22x21, npix 289, brick X: 11,33, Y: 173,194, one pixel: 19 173 Blob 18 of 22, id: 21, sources: 1, size: 23x17, npix 277, brick X: 29,52, Y: 290,307, one pixel: 39 290 Measuring 1 iterative sources Blob 15 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14744 MB Blob 19 of 22, id: 0, sources: 1, size: 23x16, npix 247, brick X: 2,25, Y: 0,16, one pixel: 6 0 Blob 13 finished, total: Wall: 0.28 s, CPU: 0.26 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 97 MB, VmData: 144 MB, maxrss: 0.098968 MB Blob 20 of 22, id: 2, sources: 1, size: 24x14, npix 242, brick X: 222,246, Y: 0,14, one pixel: 224 0 Blob 14 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147692 MB Blob 21 of 22, id: 6, sources: 1, size: 16x22, npix 222, brick X: 291,307, Y: 30,52, one pixel: 300 30 Blob 12 finished, total: Wall: 0.57 s, CPU: 0.56 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095148 MB Blob 22 of 22, id: 19, sources: 1, size: 16x20, npix 209, brick X: 0,16, Y: 265,285, one pixel: 4 265 Blob 16 finished, total: Wall: 0.58 s, CPU: 0.57 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14766 MB Blob 11 finished, total: Wall: 0.73 s, CPU: 0.72 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.094984 MB Blob 17 finished, total: Wall: 0.54 s, CPU: 0.53 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14744 MB Blob 21 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14766 MB Blob 19 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147692 MB Blob 18 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 97 MB, VmData: 144 MB, maxrss: 0.09908 MB Blob 2 finished, total: Wall: 0.93 s, CPU: 0.92 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147552 MB Blob 10 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.1474 MB Blob 20 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095276 MB Blob 22 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095088 MB Blob 9 finished, total: Wall: 1.03 s, CPU: 1.03 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.094968 MB Blob 8 finished, total: Wall: 1.25 s, CPU: 1.25 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147244 MB Blob 7 finished, total: Wall: 1.35 s, CPU: 1.34 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 92 MB, VmData: 138 MB, maxrss: 0.094636 MB Blob 3 finished, total: Wall: 1.50 s, CPU: 1.49 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147672 MB Blob 5 finished, total: Wall: 1.54 s, CPU: 1.54 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095732 MB Blob 6 finished, total: Wall: 1.90 s, CPU: 1.89 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.14836 MB Measuring 1 iterative sources Blob 4 finished, total: Wall: 2.23 s, CPU: 2.20 s, VmPeak: 805 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.14862 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.70033, ee1=-0.00832215, ee2=0.00666289 Measuring 1 iterative sources Blob 1 finished, total: Wall: 4.43 s, CPU: 4.42 s, VmPeak: 692 MB, VmSize: 685 MB, VmRSS: 111 MB, VmData: 154 MB, maxrss: 0.119636 MB Old catalog: 49 New catalog: 42 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/metrics/cus/blobs-custom-281684p61132.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/metrics/cus/all-models-custom-281684p61132.fits Stage fitblobs : Wall: 4.86 s, CPU: 0.44 s, VmPeak: 1008 MB, VmSize: 1008 MB, VmRSS: 247 MB, VmData: 273 MB, maxrss: 0.252448 MB Stage fitblobs finished: 2020-08-07T10:07:47.890421 Resources for stage fitblobs : 22.518 s worker CPU, 22.734 s worker Wall, Wall: 4.863 s, Cores in use: 4.72, Total efficiency (on 16 cores): 29.5 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T10:07:48.056703 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/tmp-legacysurvey-custom-281684p61132-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/tmp-legacysurvey-custom-281684p61132-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/tmp-legacysurvey-custom-281684p61132-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/tmp-legacysurvey-custom-281684p61132-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-resid.jpg Stage coadds : Wall: 2.15 s, CPU: 0.96 s, VmPeak: 1008 MB, VmSize: 1008 MB, VmRSS: 247 MB, VmData: 273 MB, maxrss: 0.252768 MB Stage coadds finished: 2020-08-07T10:07:50.210413 Resources for stage coadds : 9.432 s worker CPU, 10.016 s worker Wall, Wall: 2.155 s, Cores in use: 4.82, Total efficiency (on 16 cores): 30.1 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T10:07:50.224001 Cut to 1 unWISE tiles Reading WISE tile 2820p605 band 2 Reading WISE tile 2820p605 band 1 Reading WISE tile 2820p605 band 4 Reading WISE tile 2820p605 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 811 MB, VmSize: 802 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.18876 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 812 MB, VmSize: 797 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.2044 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 811 MB, VmSize: 799 MB, VmRSS: 142 MB, VmData: 173 MB, maxrss: 0.20594 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2820p605/unwise-2820p605-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 814 MB, VmSize: 797 MB, VmRSS: 140 MB, VmData: 171 MB, maxrss: 0.204108 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/tmp-legacysurvey-custom-281684p61132-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/tmp-legacysurvey-custom-281684p61132-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 31.65 s, CPU: 0.68 s, VmPeak: 1008 MB, VmSize: 1008 MB, VmRSS: 247 MB, VmData: 273 MB, maxrss: 0.253292 MB Stage wise_forced finished: 2020-08-07T10:08:21.877143 Resources for stage wise_forced : 2.969 s worker CPU, 16.924 s worker Wall, Wall: 31.655 s, Cores in use: 0.12, Total efficiency (on 16 cores): 0.7 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T10:08:22.094120 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/coadd/cus/custom-281684p61132/legacysurvey-custom-281684p61132-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/tractor-i/cus/tractor-custom-281684p61132.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/tractor/cus/tractor-custom-281684p61132.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/tractor/cus/brick-custom-281684p61132.sha256sum Stage writecat : Wall: 1.08 s, CPU: 0.79 s, VmPeak: 1141 MB, VmSize: 1013 MB, VmRSS: 249 MB, VmData: 273 MB, maxrss: 0.38598 MB Stage writecat finished: 2020-08-07T10:08:23.173935 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.081 s, Cores in use: 0.73, Total efficiency (on 16 cores): 4.6 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2612490/PGC2612490-largegalaxy-writecat.p All done: 40.709 s worker CPU, 88.033 s worker Wall, Wall: 82.151 s, Cores in use: 0.62, Total efficiency (on 16 cores): 3.9 % Finished galaxy PGC2612490 in 1.406 minutes.