Started working on galaxy PGC2592643 at Sun Jun 7 19:55:46 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 267.33899849999995 59.63596999999999 --width 269 --height 269 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/PGC2592643-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/PGC2592643-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T19:55:47.722196 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '267.33899849999995', '59.63596999999999', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/PGC2592643-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/PGC2592643-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 267.33899849999995 59.63596999999999 --width 269 --height 269 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/PGC2592643-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/PGC2592643-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 267.33899849999995 59.63596999999999 Starting process 61522 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB Starting process 61523 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057372 MB Starting process 61524 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05738 MB Starting process 61525 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T19:55:48.016511 Keeping 10 CCDs: k4m_170512_111541_ooi_zd_ls9.fits.fz k4m_170512_111541_ooi_zd_ls9-CCD4 z exptime 111.106 propid 2016A-0453 seeing 1.04 MJD 57885.469 object MzLS_685059_z k4m_160606_084109_ooi_zd_ls9.fits.fz k4m_160606_084109_ooi_zd_ls9-CCD3 z exptime 93.104 propid 2016A-0453 seeing 1.10 MJD 57545.362 object MzLS_685696_z k4m_170615_102820_ooi_zd_ls9.fits.fz k4m_170615_102820_ooi_zd_ls9-CCD2 z exptime 136.104 propid 2016A-0453 seeing 1.37 MJD 57919.436 object MzLS_684418_z k4m_170806_070020_ooi_zd_ls9.fits.fz k4m_170806_070020_ooi_zd_ls9-CCD3 z exptime 121.104 propid 2016A-0453 seeing 0.99 MJD 57971.292 object MzLS_686330_z ksb_170519_110043_ooi_r_ls9.fits.fz ksb_170519_110043_ooi_r_ls9-CCD2 r exptime 127.6 propid 2015A-0801 seeing 1.55 MJD 57892.459 object 37773 ksb_170521_111034_ooi_g_ls9.fits.fz ksb_170521_111034_ooi_g_ls9-CCD2 g exptime 250.0 propid 2015A-0801 seeing 1.61 MJD 57894.466 object 37773 ksb_180509_083855_ooi_g_ls9.fits.fz ksb_180509_083855_ooi_g_ls9-CCD2 g exptime 129.1 propid NOTBASS seeing 1.60 MJD 58247.360 object 37771 ksb_170618_082328_ooi_r_ls9.fits.fz ksb_170618_082328_ooi_r_ls9-CCD2 r exptime 127.6 propid BASS seeing 1.29 MJD 57922.350 object 37771 ksb_180223_115809_ooi_r_ls9.fits.fz ksb_180223_115809_ooi_r_ls9-CCD1 r exptime 164.896 propid BASS seeing 1.23 MJD 58172.499 object 36802 ksb_160710_073039_ooi_g_ls9.fits.fz ksb_160710_073039_ooi_g_ls9-CCD1 g exptime 174.0 propid BASS seeing 1.78 MJD 57579.313 object 36802 mosaic get_fwhm: self.fwhm = 5.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3750 4031 and amp range 2048 4095 and image y 1434 1712 and amp range 0 2039 Range in image: x 0 282 , y 0 279 (with image size 282 x 279) dzp 0.0044767857 -> scaling image by 1.004131784351374 mosaic get_fwhm: self.fwhm = 4.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2639 2911 and amp range 2006 4053 and image y 2423 2699 and amp range 2040 4078 Range in image: x 0 273 , y 0 277 (with image size 273 x 277) dzp -0.0026360443 -> scaling image by 0.99757505842151 mosaic get_fwhm: self.fwhm = 4.01 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1078 1354 and amp range 0 2047 and image y 3289 3566 and amp range 2022 4060 Range in image: x 0 277 , y 0 278 (with image size 277 x 278) dzp -0.017482605 -> scaling image by 0.9840268712629925 mosaic get_fwhm: self.fwhm = 3.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 0 175 and amp range 0 2005 and image y 1522 1798 and amp range 0 2039 Range in image: x 0 176 , y 0 277 (with image size 176 x 277) dzp 0.0014252509 -> scaling image by 1.0013135665633692 Faked up EXPNUM 78920230 Faked up EXPNUM 78920230 Faked up EXPNUM 78920230 90prime get_fwhm: self.fwhm = 3.43 Found 4 relevant rows in amp-corrections file. Found overlap: image x 698 856 and amp range 0 2015 and image y 826 986 and amp range 0 2047 Range in image: x 0 159 , y 0 161 (with image size 159 x 161) dzp 0.005335051 -> scaling image by 1.0049258559887364 Faked up EXPNUM 78940199 Faked up EXPNUM 78940199 Faked up EXPNUM 78940199 90prime get_fwhm: self.fwhm = 3.55 Found 4 relevant rows in amp-corrections file. Found overlap: image x 712 870 and amp range 0 2015 and image y 903 1063 and amp range 0 2047 Range in image: x 0 159 , y 0 161 (with image size 159 x 161) dzp 0.0003063402 -> scaling image by 1.0002821895558327 Faked up EXPNUM 82470140 Faked up EXPNUM 82470140 Faked up EXPNUM 82470140 90prime get_fwhm: self.fwhm = 3.53 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2709 2867 and amp range 2016 4031 and image y 2884 3043 and amp range 2048 4095 Range in image: x 0 159 , y 0 160 (with image size 159 x 160) dzp 0.013237011 -> scaling image by 1.012266359574015 Faked up EXPNUM 79220110 Faked up EXPNUM 79220110 Faked up EXPNUM 79220110 90prime get_fwhm: self.fwhm = 2.85 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2753 2911 and amp range 2016 4031 and image y 2890 3048 and amp range 2048 4095 Range in image: x 0 159 , y 0 159 (with image size 159 x 159) dzp 0.021366077 -> scaling image by 1.0198737893800265 Faked up EXPNUM 81720243 Faked up EXPNUM 81720243 Faked up EXPNUM 81720243 90prime get_fwhm: self.fwhm = 2.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 953 1111 and amp range 0 2015 and image y 3941 4080 and amp range 2048 4095 Range in image: x 0 159 , y 0 140 (with image size 159 x 140) dzp -0.05213645 -> scaling image by 0.953115252660837 Faked up EXPNUM 75790088 Faked up EXPNUM 75790088 Faked up EXPNUM 75790088 90prime get_fwhm: self.fwhm = 3.93 Found 4 relevant rows in amp-corrections file. Found overlap: image x 951 1109 and amp range 0 2015 and image y 3943 4080 and amp range 2048 4095 Range in image: x 0 159 , y 0 138 (with image size 159 x 138) dzp -0.0051191514 -> scaling image by 0.9952961850385206 Stage tims : Wall: 4.95 s, CPU: 0.85 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 172 MB, VmData: 205 MB, maxrss: 0.56658 MB Stage tims finished: 2020-06-07T19:55:52.963056 Resources for stage tims : 3.710 s worker CPU, 13.525 s worker Wall, Wall: 4.948 s, Cores in use: 0.92, Total efficiency (on 4 cores): 23.1 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/PGC2592643-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/PGC2592643-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T19:55:52.985634 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00819.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00902.fits Matched 5 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/metrics/cus/reference-custom-267338p59635.fits Stage refs : Wall: 4.15 s, CPU: 3.00 s, VmPeak: 979 MB, VmSize: 973 MB, VmRSS: 204 MB, VmData: 237 MB, maxrss: 0.56658 MB Stage refs finished: 2020-06-07T19:55:57.136669 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.152 s, Cores in use: 0.72, Total efficiency (on 4 cores): 18.1 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T19:55:57.138203 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/metrics/cus/outlier-mask-custom-267338p59635.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/metrics/cus/outliers-pre-custom-267338p59635.jpg Image ksb_160710_073039_ooi_g_ls9-CCD1 g : masking 424 positive outlier pixels and 0 negative outlier pixels Image ksb_170519_110043_ooi_r_ls9-CCD2 r : masking 81 positive outlier pixels and 0 negative outlier pixels Image k4m_170615_102820_ooi_zd_ls9-CCD2 z : masking 334 positive outlier pixels and 0 negative outlier pixels Image k4m_170806_070020_ooi_zd_ls9-CCD3 z : masking 0 positive outlier pixels and 1309 negative outlier pixels Image k4m_170512_111541_ooi_zd_ls9-CCD4 z : masking 880 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/metrics/cus/outlier-mask-custom-267338p59635.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/metrics/cus/outliers-post-custom-267338p59635.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/metrics/cus/outliers-masked-pos-custom-267338p59635.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/metrics/cus/outliers-masked-neg-custom-267338p59635.jpg Stage outliers : Wall: 0.88 s, CPU: 0.60 s, VmPeak: 982 MB, VmSize: 982 MB, VmRSS: 219 MB, VmData: 249 MB, maxrss: 0.56658 MB Stage outliers finished: 2020-06-07T19:55:58.018647 Resources for stage outliers : 1.017 s worker CPU, 1.025 s worker Wall, Wall: 0.882 s, Cores in use: 1.84, Total efficiency (on 4 cores): 45.9 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T19:55:58.020364 Stage halos : Wall: 0.13 s, CPU: 0.13 s, VmPeak: 982 MB, VmSize: 982 MB, VmRSS: 219 MB, VmData: 249 MB, maxrss: 0.56658 MB Stage halos finished: 2020-06-07T19:55:58.154059 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.135 s, Cores in use: 0.94, Total efficiency (on 4 cores): 23.5 % Stage halos finished Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-06-07T19:55:58.155732 PSF sigmas in coadd pixels: ['2.61', '2.60', '2.89'] Using average PSF sigma 2.7010296796534754 Gaussian PSF norm 0.10443972308000299 vs pixelized 0.081545025 average tim pixel scale / coadd scale: 1.729578926149784 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.53', '2.10', '2.00'] Using average PSF sigma 2.2060809054036628 Gaussian PSF norm 0.12787146250298614 vs pixelized 0.10856245 average tim pixel scale / coadd scale: 1.7300095517572214 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.69', '1.78', '2.22', '1.61'] Using average PSF sigma 1.8258047064250387 Gaussian PSF norm 0.1545043622580124 vs pixelized 0.119797684 average tim pixel scale / coadd scale: 0.9909050888159732 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.25 s, CPU: 0.21 s, VmPeak: 982 MB, VmSize: 982 MB, VmRSS: 221 MB, VmData: 249 MB, maxrss: 0.56658 MB Stage fit_on_coadds finished: 2020-06-07T19:55:58.410269 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.223 s worker CPU, 0.227 s worker Wall, Wall: 0.256 s, Cores in use: 1.68, Total efficiency (on 4 cores): 42.0 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T19:55:58.413193 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 34 potential peaks Of 34 potential peaks: 17 in veto map, 3 cut by saddle test, 0 cut by aper test, 14 kept SED z : 14 new peaks Found 40 potential peaks Of 40 potential peaks: 36 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 27 potential peaks Of 27 potential peaks: 24 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 43 potential peaks Of 43 potential peaks: 36 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 42 potential peaks Of 42 potential peaks: 36 in veto map, 6 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 18 new sources Median coadd sky for g : 0.00011801994 Median coadd sky for r : 0.00041235797 Median coadd sky for z : -0.00015845252 Stage srcs : Wall: 0.45 s, CPU: 0.40 s, VmPeak: 982 MB, VmSize: 982 MB, VmRSS: 221 MB, VmData: 249 MB, maxrss: 0.56658 MB Stage srcs finished: 2020-06-07T19:55:58.864304 Resources for stage srcs : 0.120 s worker CPU, 0.120 s worker Wall, Wall: 0.452 s, Cores in use: 1.15, Total efficiency (on 4 cores): 28.8 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/PGC2592643-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/PGC2592643-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T19:55:59.097484 Blob 1 of 12, id: 0, sources: 12, size: 204x247, npix 25458, brick X: 29,233, Y: 0,247, one pixel: 115 0 Blob 2 of 12, id: 10, sources: 1, size: 36x36, npix 941, brick X: 28,64, Y: 233,269, one pixel: 42 233 Blob 3 of 12, id: 5, sources: 1, size: 33x32, npix 672, brick X: 2,35, Y: 98,130, one pixel: 16 98 Blob 4 of 12, id: 9, sources: 1, size: 32x31, npix 644, brick X: 24,56, Y: 193,224, one pixel: 36 193 Blob 5 of 12, id: 4, sources: 1, size: 29x30, npix 577, brick X: 6,35, Y: 65,95, one pixel: 17 65 Blob 2 finished, total: Wall: 0.88 s, CPU: 0.88 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.1429 MB Blob 6 of 12, id: 6, sources: 1, size: 25x27, npix 460, brick X: 239,264, Y: 102,129, one pixel: 249 102 Blob 4 finished, total: Wall: 1.17 s, CPU: 1.16 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141108 MB Blob 7 of 12, id: 1, sources: 1, size: 25x24, npix 397, brick X: 202,227, Y: 0,24, one pixel: 213 0 Blob 3 finished, total: Wall: 1.28 s, CPU: 1.28 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142924 MB Blob 8 of 12, id: 8, sources: 1, size: 25x25, npix 378, brick X: 243,268, Y: 154,179, one pixel: 253 154 Blob 5 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.1429 MB Blob 9 of 12, id: 11, sources: 1, size: 26x17, npix 316, brick X: 149,175, Y: 252,269, one pixel: 159 252 Blob 10 of 12, id: 3, sources: 1, size: 24x21, npix 294, brick X: 42,66, Y: 62,83, one pixel: 52 62 Blob 6 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143104 MB Blob 11 of 12, id: 7, sources: 1, size: 19x21, npix 246, brick X: 5,24, Y: 146,167, one pixel: 14 146 Blob 7 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142924 MB Blob 12 of 12, id: 2, sources: 1, size: 20x20, npix 228, brick X: 244,264, Y: 45,65, one pixel: 253 45 Blob 10 finished, total: Wall: 0.07 s, CPU: 0.06 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142924 MB Blob 11 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142924 MB Blob 12 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142924 MB Blob 8 finished, total: Wall: 0.42 s, CPU: 0.42 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.1429 MB Blob 9 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14314 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.59443, ee1=-0.168108, ee2=0.3959 Measuring 8 iterative sources Blob 1 finished, total: Wall: 14.73 s, CPU: 14.73 s, VmPeak: 805 MB, VmSize: 710 MB, VmRSS: 143 MB, VmData: 175 MB, maxrss: 0.1681 MB Old catalog: 24 New catalog: 25 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/metrics/cus/blobs-custom-267338p59635.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/metrics/cus/all-models-custom-267338p59635.fits Stage fitblobs : Wall: 15.09 s, CPU: 0.34 s, VmPeak: 982 MB, VmSize: 966 MB, VmRSS: 205 MB, VmData: 233 MB, maxrss: 0.56658 MB Stage fitblobs finished: 2020-06-07T19:56:14.187650 Resources for stage fitblobs : 21.055 s worker CPU, 21.067 s worker Wall, Wall: 15.092 s, Cores in use: 1.42, Total efficiency (on 4 cores): 35.4 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T19:56:14.189675 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/tmp-legacysurvey-custom-267338p59635-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/tmp-legacysurvey-custom-267338p59635-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/tmp-legacysurvey-custom-267338p59635-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/tmp-legacysurvey-custom-267338p59635-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-resid.jpg Stage coadds : Wall: 1.23 s, CPU: 0.52 s, VmPeak: 982 MB, VmSize: 966 MB, VmRSS: 205 MB, VmData: 233 MB, maxrss: 0.56658 MB Stage coadds finished: 2020-06-07T19:56:15.420816 Resources for stage coadds : 2.156 s worker CPU, 2.204 s worker Wall, Wall: 1.232 s, Cores in use: 2.17, Total efficiency (on 4 cores): 54.2 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T19:56:15.422266 Cut to 1 unWISE tiles Reading WISE tile 2678p590 band 1 Reading WISE tile 2678p590 band 2 Reading WISE tile 2678p590 band 4 Reading WISE tile 2678p590 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2678p590/unwise-2678p590-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2678p590/unwise-2678p590-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2678p590/unwise-2678p590-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2678p590/unwise-2678p590-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2678p590/unwise-2678p590-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 805 MB, VmSize: 793 MB, VmRSS: 150 MB, VmData: 175 MB, maxrss: 0.21474 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2678p590/unwise-2678p590-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2678p590/unwise-2678p590-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2678p590/unwise-2678p590-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2678p590/unwise-2678p590-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2678p590/unwise-2678p590-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 810 MB, VmSize: 794 MB, VmRSS: 150 MB, VmData: 176 MB, maxrss: 0.191712 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2678p590/unwise-2678p590-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2678p590/unwise-2678p590-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2678p590/unwise-2678p590-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2678p590/unwise-2678p590-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 806 MB, VmSize: 792 MB, VmRSS: 147 MB, VmData: 173 MB, maxrss: 0.212156 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2678p590/unwise-2678p590-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2678p590/unwise-2678p590-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2678p590/unwise-2678p590-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2678p590/unwise-2678p590-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 805 MB, VmSize: 792 MB, VmRSS: 147 MB, VmData: 173 MB, maxrss: 0.212088 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/tmp-legacysurvey-custom-267338p59635-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/tmp-legacysurvey-custom-267338p59635-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.22 s, CPU: 0.41 s, VmPeak: 982 MB, VmSize: 966 MB, VmRSS: 206 MB, VmData: 233 MB, maxrss: 0.56658 MB Stage wise_forced finished: 2020-06-07T19:56:17.641562 Resources for stage wise_forced : 4.514 s worker CPU, 5.739 s worker Wall, Wall: 2.220 s, Cores in use: 2.22, Total efficiency (on 4 cores): 55.5 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T19:56:17.643022 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/coadd/cus/custom-267338p59635/legacysurvey-custom-267338p59635-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/tractor-i/cus/tractor-custom-267338p59635.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/tractor/cus/tractor-custom-267338p59635.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2592643/tractor/cus/brick-custom-267338p59635.sha256sum Stage writecat : Wall: 0.58 s, CPU: 0.40 s, VmPeak: 1098 MB, VmSize: 970 MB, VmRSS: 208 MB, VmData: 233 MB, maxrss: 0.56658 MB Stage writecat finished: 2020-06-07T19:56:18.221237 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.579 s, Cores in use: 0.68, Total efficiency (on 4 cores): 17.1 % Stage writecat finished All done: 32.797 s worker CPU, 43.910 s worker Wall, Wall: 30.210 s, Cores in use: 1.31, Total efficiency (on 4 cores): 32.8 % Finished galaxy PGC2592643 in 0.526 minutes.