Started working on galaxy PGC2677374 at Sun Jun 7 19:40:04 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 267.53149950000005 65.4220278 --width 257 --height 257 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/PGC2677374-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/PGC2677374-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T19:40:05.644547 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '267.53149950000005', '65.4220278', '--width', '257', '--height', '257', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/PGC2677374-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/PGC2677374-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 267.53149950000005 65.4220278 --width 257 --height 257 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/PGC2677374-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/PGC2677374-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 267.53149950000005 65.4220278 Starting process 7710 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB Starting process 7711 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB Starting process 7712 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057464 MB Starting process 7713 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T19:40:06.040988 Keeping 9 CCDs: k4m_171001_045648_ooi_zd_ls9.fits.fz k4m_171001_045648_ooi_zd_ls9-CCD2 z exptime 99.105 propid 2016A-0453 seeing 0.84 MJD 58027.206 object MzLS_702022_z k4m_170614_102739_ooi_zd_ls9.fits.fz k4m_170614_102739_ooi_zd_ls9-CCD2 z exptime 91.104 propid 2016A-0453 seeing 0.95 MJD 57918.436 object MzLS_702549_z k4m_170604_105144_ooi_zd_ls9.fits.fz k4m_170604_105144_ooi_zd_ls9-CCD3 z exptime 97.104 propid 2016A-0453 seeing 0.92 MJD 57908.453 object MzLS_703072_z ksb_180418_105627_ooi_g_ls9.fits.fz ksb_180418_105627_ooi_g_ls9-CCD1 g exptime 120.3 propid BASS seeing 1.43 MJD 58226.456 object 42311 ksb_180423_112605_ooi_r_ls9.fits.fz ksb_180423_112605_ooi_r_ls9-CCD1 r exptime 82.439 propid BASS seeing 1.29 MJD 58231.476 object 42311 ksb_180712_064904_ooi_g_ls9.fits.fz ksb_180712_064904_ooi_g_ls9-CCD2 g exptime 184.184 propid NOTBASS seeing 1.07 MJD 58311.284 object 43153 ksb_180521_090907_ooi_r_ls9.fits.fz ksb_180521_090907_ooi_r_ls9-CCD2 r exptime 103.764 propid NOTBASS seeing 1.51 MJD 58259.381 object 43153 ksb_180424_112209_ooi_r_ls9.fits.fz ksb_180424_112209_ooi_r_ls9-CCD3 r exptime 91.627 propid BASS seeing 1.27 MJD 58232.474 object 42312 ksb_180517_084100_ooi_g_ls9.fits.fz ksb_180517_084100_ooi_g_ls9-CCD3 g exptime 180.45 propid NOTBASS seeing 1.75 MJD 58255.362 object 42312 Faked up EXPNUM 82260173 Faked up EXPNUM 82260173 Faked up EXPNUM 82260173 90prime get_fwhm: self.fwhm = 3.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 638 791 and amp range 0 2015 and image y 2889 3040 and amp range 2048 4095 Range in image: x 0 154 , y 0 152 (with image size 154 x 152) dzp -0.031697065 -> scaling image by 0.9712279547101786 mosaic get_fwhm: self.fwhm = 3.53 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1553 1814 and amp range 0 2005 and image y 880 1141 and amp range 0 2039 Range in image: x 0 262 , y 0 262 (with image size 262 x 262) dzp 0.0013971253 -> scaling image by 1.0012876282438632 mosaic get_fwhm: self.fwhm = 3.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 7 214 and amp range 0 2047 and image y 3386 3644 and amp range 2040 4078 Range in image: x 0 208 , y 0 259 (with image size 208 x 259) dzp 0.015739892 -> scaling image by 1.0146025667655956 mosaic get_fwhm: self.fwhm = 3.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2664 2928 and amp range 2048 4095 and image y 1524 1787 and amp range 0 2039 Range in image: x 0 265 , y 0 264 (with image size 265 x 264) dzp -0.012875672 -> scaling image by 0.9882111074411305 Faked up EXPNUM 83110045 Faked up EXPNUM 83110045 Faked up EXPNUM 83110045 90prime get_fwhm: self.fwhm = 2.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2427 2578 and amp range 2016 4031 and image y 2958 3109 and amp range 2048 4095 Range in image: x 0 152 , y 0 152 (with image size 152 x 152) dzp 0.013237011 -> scaling image by 1.012266359574015 Faked up EXPNUM 82310175 Faked up EXPNUM 82310175 Faked up EXPNUM 82310175 90prime get_fwhm: self.fwhm = 2.85 Found 4 relevant rows in amp-corrections file. Found overlap: image x 657 810 and amp range 0 2015 and image y 2892 3044 and amp range 2048 4095 Range in image: x 0 154 , y 0 153 (with image size 154 x 153) dzp -0.05213645 -> scaling image by 0.953115252660837 Faked up EXPNUM 82320161 Faked up EXPNUM 82320161 Faked up EXPNUM 82320161 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2673 2823 and amp range 2016 4031 and image y 357 507 and amp range 0 2047 Range in image: x 0 151 , y 0 151 (with image size 151 x 151) dzp 0.0057031885 -> scaling image by 1.00526665101287 Faked up EXPNUM 82590110 Faked up EXPNUM 82590110 Faked up EXPNUM 82590110 90prime get_fwhm: self.fwhm = 3.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2452 2604 and amp range 2016 4031 and image y 2999 3151 and amp range 2048 4095 Range in image: x 0 153 , y 0 153 (with image size 153 x 153) dzp 0.019008487 -> scaling image by 1.0176616178968958 Faked up EXPNUM 82550112 Faked up EXPNUM 82550112 Faked up EXPNUM 82550112 90prime get_fwhm: self.fwhm = 3.85 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2690 2839 and amp range 2016 4031 and image y 339 489 and amp range 0 2047 Range in image: x 0 150 , y 0 151 (with image size 150 x 151) dzp -0.0012233759 -> scaling image by 0.9988738637196966 Stage tims : Wall: 6.00 s, CPU: 0.91 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 171 MB, VmData: 204 MB, maxrss: 0.566512 MB Stage tims finished: 2020-06-07T19:40:12.045479 Resources for stage tims : 3.108 s worker CPU, 13.286 s worker Wall, Wall: 6.006 s, Cores in use: 0.67, Total efficiency (on 4 cores): 16.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/PGC2677374-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/PGC2677374-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T19:40:12.067552 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00594.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00527.fits Matched 15 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/metrics/cus/reference-custom-267531p65422.fits Stage refs : Wall: 3.24 s, CPU: 2.64 s, VmPeak: 976 MB, VmSize: 970 MB, VmRSS: 200 MB, VmData: 233 MB, maxrss: 0.566512 MB Stage refs finished: 2020-06-07T19:40:15.303815 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.237 s, Cores in use: 0.82, Total efficiency (on 4 cores): 20.4 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T19:40:15.305495 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/metrics/cus/outlier-mask-custom-267531p65422.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/metrics/cus/outliers-pre-custom-267531p65422.jpg Image ksb_180712_064904_ooi_g_ls9-CCD2 g : masking 34 positive outlier pixels and 0 negative outlier pixels Image ksb_180517_084100_ooi_g_ls9-CCD3 g : masking 615 positive outlier pixels and 0 negative outlier pixels Image ksb_180418_105627_ooi_g_ls9-CCD1 g : masking 480 positive outlier pixels and 0 negative outlier pixels Image k4m_170614_102739_ooi_zd_ls9-CCD2 z : masking 365 positive outlier pixels and 0 negative outlier pixels Image k4m_171001_045648_ooi_zd_ls9-CCD2 z : masking 516 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/metrics/cus/outlier-mask-custom-267531p65422.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/metrics/cus/outliers-post-custom-267531p65422.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/metrics/cus/outliers-masked-pos-custom-267531p65422.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/metrics/cus/outliers-masked-neg-custom-267531p65422.jpg Stage outliers : Wall: 0.88 s, CPU: 0.58 s, VmPeak: 980 MB, VmSize: 980 MB, VmRSS: 214 MB, VmData: 245 MB, maxrss: 0.566512 MB Stage outliers finished: 2020-06-07T19:40:16.188086 Resources for stage outliers : 0.962 s worker CPU, 0.965 s worker Wall, Wall: 0.884 s, Cores in use: 1.75, Total efficiency (on 4 cores): 43.7 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T19:40:16.189756 Stage halos : Wall: 0.19 s, CPU: 0.18 s, VmPeak: 980 MB, VmSize: 980 MB, VmRSS: 214 MB, VmData: 245 MB, maxrss: 0.566512 MB Stage halos finished: 2020-06-07T19:40:16.378461 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.190 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.8 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T19:40:16.380201 PSF sigmas in coadd pixels: ['2.32', '1.75', '2.83'] Using average PSF sigma 2.2998589250961716 Gaussian PSF norm 0.12265743289540335 vs pixelized 0.10231717 average tim pixel scale / coadd scale: 1.730448641913822 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.10', '2.45', '2.07'] Using average PSF sigma 2.2063636084812406 Gaussian PSF norm 0.1278550782334827 vs pixelized 0.10242575 average tim pixel scale / coadd scale: 1.7302233649360883 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.36', '1.55', '1.49'] Using average PSF sigma 1.4660444462246731 Gaussian PSF norm 0.1924189900929148 vs pixelized 0.15915053 average tim pixel scale / coadd scale: 0.9909522686800599 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.22 s, CPU: 0.17 s, VmPeak: 980 MB, VmSize: 980 MB, VmRSS: 216 MB, VmData: 246 MB, maxrss: 0.566512 MB Stage fit_on_coadds finished: 2020-06-07T19:40:16.598621 Resources for stage fit_on_coadds : 0.266 s worker CPU, 0.287 s worker Wall, Wall: 0.220 s, Cores in use: 2.01, Total efficiency (on 4 cores): 50.2 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T19:40:16.601213 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 34 potential peaks Of 34 potential peaks: 12 in veto map, 3 cut by saddle test, 0 cut by aper test, 19 kept SED z : 19 new peaks Found 34 potential peaks Of 34 potential peaks: 29 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 24 potential peaks Of 24 potential peaks: 20 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 41 potential peaks Of 41 potential peaks: 31 in veto map, 5 cut by saddle test, 0 cut by aper test, 5 kept SED Flat : 5 new peaks Found 52 potential peaks Of 52 potential peaks: 44 in veto map, 7 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 27 new sources Median coadd sky for g : 0.0001415303 Median coadd sky for r : 0.00023352663 Median coadd sky for z : -6.539056e-05 Stage srcs : Wall: 0.51 s, CPU: 0.46 s, VmPeak: 980 MB, VmSize: 980 MB, VmRSS: 217 MB, VmData: 246 MB, maxrss: 0.566512 MB Stage srcs finished: 2020-06-07T19:40:17.115856 Resources for stage srcs : 0.111 s worker CPU, 0.111 s worker Wall, Wall: 0.516 s, Cores in use: 1.11, Total efficiency (on 4 cores): 27.8 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/PGC2677374-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/PGC2677374-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T19:40:17.130833 Blob 1 of 14, id: 1, sources: 13, size: 147x182, npix 14307, brick X: 50,197, Y: 0,182, one pixel: 80 0 Blob 2 of 14, id: 2, sources: 6, size: 95x74, npix 3420, brick X: 156,251, Y: 0,74, one pixel: 183 0 Blob 3 of 14, id: 4, sources: 2, size: 41x40, npix 970, brick X: 216,257, Y: 70,110, one pixel: 225 70 Blob 4 of 14, id: 6, sources: 2, size: 29x54, npix 828, brick X: 85,114, Y: 180,234, one pixel: 101 180 Blob 5 of 14, id: 7, sources: 2, size: 39x39, npix 826, brick X: 114,153, Y: 180,219, one pixel: 122 180 Blob 3 finished, total: Wall: 0.96 s, CPU: 0.84 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.140856 MB Blob 6 of 14, id: 12, sources: 1, size: 30x19, npix 420, brick X: 4,34, Y: 238,257, one pixel: 15 238 Blob 7 of 14, id: 3, sources: 1, size: 24x25, npix 375, brick X: 35,59, Y: 32,57, one pixel: 47 32 Blob 4 finished, total: Wall: 1.30 s, CPU: 1.18 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.1426 MB Blob 6 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.1426 MB Blob 8 of 14, id: 9, sources: 1, size: 22x24, npix 356, brick X: 235,257, Y: 226,250, one pixel: 243 226 Blob 9 of 14, id: 5, sources: 1, size: 22x22, npix 301, brick X: 8,30, Y: 145,167, one pixel: 17 145 Blob 5 finished, total: Wall: 1.21 s, CPU: 1.21 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142788 MB Blob 10 of 14, id: 11, sources: 1, size: 21x21, npix 269, brick X: 194,215, Y: 233,254, one pixel: 202 233 Blob 7 finished, total: Wall: 0.48 s, CPU: 0.48 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.1426 MB Blob 11 of 14, id: 13, sources: 1, size: 24x17, npix 263, brick X: 90,114, Y: 240,257, one pixel: 100 240 Blob 9 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.1426 MB Blob 12 of 14, id: 8, sources: 1, size: 20x20, npix 228, brick X: 2,22, Y: 216,236, one pixel: 10 216 Blob 8 finished, total: Wall: 0.42 s, CPU: 0.42 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142788 MB Blob 13 of 14, id: 0, sources: 1, size: 20x17, npix 210, brick X: 4,24, Y: 0,17, one pixel: 10 0 Blob 10 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.1426 MB Blob 14 of 14, id: 10, sources: 1, size: 18x18, npix 180, brick X: 38,56, Y: 233,251, one pixel: 46 233 Blob 11 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142788 MB Blob 12 finished, total: Wall: 0.20 s, CPU: 0.20 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.1426 MB Blob 2 finished, total: Wall: 3.36 s, CPU: 3.36 s, VmPeak: 808 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143348 MB Blob 14 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.1426 MB Blob 13 finished, total: Wall: 0.17 s, CPU: 0.17 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142788 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.03293, ee1=-0.0438543, ee2=-0.046413 Measuring 5 iterative sources Blob 1 finished, total: Wall: 10.25 s, CPU: 10.12 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 143 MB, VmData: 179 MB, maxrss: 0.145924 MB Old catalog: 38 New catalog: 35 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/metrics/cus/blobs-custom-267531p65422.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/metrics/cus/all-models-custom-267531p65422.fits Stage fitblobs : Wall: 10.67 s, CPU: 0.40 s, VmPeak: 980 MB, VmSize: 980 MB, VmRSS: 217 MB, VmData: 246 MB, maxrss: 0.566512 MB Stage fitblobs finished: 2020-06-07T19:40:27.804644 Resources for stage fitblobs : 20.081 s worker CPU, 20.561 s worker Wall, Wall: 10.675 s, Cores in use: 1.92, Total efficiency (on 4 cores): 48.0 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T19:40:27.806593 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/tmp-legacysurvey-custom-267531p65422-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/tmp-legacysurvey-custom-267531p65422-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/tmp-legacysurvey-custom-267531p65422-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/tmp-legacysurvey-custom-267531p65422-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-resid.jpg Stage coadds : Wall: 1.33 s, CPU: 0.59 s, VmPeak: 980 MB, VmSize: 980 MB, VmRSS: 217 MB, VmData: 246 MB, maxrss: 0.566512 MB Stage coadds finished: 2020-06-07T19:40:29.136793 Resources for stage coadds : 2.143 s worker CPU, 2.288 s worker Wall, Wall: 1.331 s, Cores in use: 2.06, Total efficiency (on 4 cores): 51.4 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T19:40:29.138310 Cut to 2 unWISE tiles Reading WISE tile 2656p651 band 1 Reading WISE tile 2656p651 band 4 Reading WISE tile 2656p651 band 3 Reading WISE tile 2656p651 band 2 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/265/2656p651/unwise-2656p651-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/265/2656p651/unwise-2656p651-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/265/2656p651/unwise-2656p651-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/265/2656p651/unwise-2656p651-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/265/2656p651/unwise-2656p651-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2691p651 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/265/2656p651/unwise-2656p651-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/265/2656p651/unwise-2656p651-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/265/2656p651/unwise-2656p651-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/265/2656p651/unwise-2656p651-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/265/2656p651/unwise-2656p651-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2691p651 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/265/2656p651/unwise-2656p651-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/265/2656p651/unwise-2656p651-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/265/2656p651/unwise-2656p651-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/265/2656p651/unwise-2656p651-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2691p651 band 2 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/265/2656p651/unwise-2656p651-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/265/2656p651/unwise-2656p651-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/265/2656p651/unwise-2656p651-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/265/2656p651/unwise-2656p651-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2691p651 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2691p651/unwise-2691p651-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2691p651/unwise-2691p651-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2691p651/unwise-2691p651-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2691p651/unwise-2691p651-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2691p651/unwise-2691p651-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 806 MB, VmSize: 797 MB, VmRSS: 149 MB, VmData: 178 MB, maxrss: 0.189464 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2691p651/unwise-2691p651-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2691p651/unwise-2691p651-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2691p651/unwise-2691p651-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2691p651/unwise-2691p651-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2691p651/unwise-2691p651-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 808 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.208656 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2691p651/unwise-2691p651-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2691p651/unwise-2691p651-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2691p651/unwise-2691p651-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2691p651/unwise-2691p651-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 805 MB, VmSize: 792 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209192 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2691p651/unwise-2691p651-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2691p651/unwise-2691p651-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2691p651/unwise-2691p651-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2691p651/unwise-2691p651-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 806 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.208532 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/tmp-legacysurvey-custom-267531p65422-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/tmp-legacysurvey-custom-267531p65422-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 4.19 s, CPU: 0.56 s, VmPeak: 980 MB, VmSize: 980 MB, VmRSS: 218 MB, VmData: 246 MB, maxrss: 0.566512 MB Stage wise_forced finished: 2020-06-07T19:40:33.331488 Resources for stage wise_forced : 9.121 s worker CPU, 12.531 s worker Wall, Wall: 4.194 s, Cores in use: 2.31, Total efficiency (on 4 cores): 57.7 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T19:40:33.333314 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/coadd/cus/custom-267531p65422/legacysurvey-custom-267531p65422-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/tractor-i/cus/tractor-custom-267531p65422.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/tractor/cus/tractor-custom-267531p65422.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2677374/tractor/cus/brick-custom-267531p65422.sha256sum Stage writecat : Wall: 0.88 s, CPU: 0.58 s, VmPeak: 1112 MB, VmSize: 984 MB, VmRSS: 220 MB, VmData: 246 MB, maxrss: 0.566512 MB Stage writecat finished: 2020-06-07T19:40:34.209629 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.877 s, Cores in use: 0.66, Total efficiency (on 4 cores): 16.4 % Stage writecat finished All done: 35.795 s worker CPU, 50.031 s worker Wall, Wall: 28.173 s, Cores in use: 1.52, Total efficiency (on 4 cores): 38.1 % Finished galaxy PGC2677374 in 0.503 minutes.