Started working on galaxy PGC2338738 at Mon Jun 15 06:31:11 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.531865 49.2892 --width 245 --height 245 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/PGC2338738-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/PGC2338738-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-15T06:31:12.626152 legacypipe git version: DR9.5.2-29-gb5a6d7b1 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.531865', '49.2892', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/PGC2338738-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/PGC2338738-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.531865 49.2892 --width 245 --height 245 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/PGC2338738-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/PGC2338738-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 272.531865 49.2892 Starting process 25778 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB Starting process 25779 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB Starting process 25780 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057392 MB Starting process 25781 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057388 MB Starting process 25782 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057396 MB Starting process 25783 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.0574 MB Starting process 25784 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.0574 MB Starting process 25785 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.0574 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-15T06:31:13.264854 Keeping 10 CCDs: k4m_160516_100657_ooi_zd_ls9.fits.fz k4m_160516_100657_ooi_zd_ls9-CCD4 z exptime 80.103 propid 2016A-0453 seeing 1.12 MJD 57524.421 object MzLS_645431_z k4m_160523_092108_ooi_zd_ls9.fits.fz k4m_160523_092108_ooi_zd_ls9-CCD4 z exptime 92.103 propid 2016A-0453 seeing 0.91 MJD 57531.390 object MzLS_646254_z k4m_170809_083842_ooi_zd_ls9.fits.fz k4m_170809_083842_ooi_zd_ls9-CCD1 z exptime 131.105 propid 2016A-0453 seeing 0.86 MJD 57974.360 object MzLS_647074_z k4m_160518_095527_ooi_zd_ls9.fits.fz k4m_160518_095527_ooi_zd_ls9-CCD3 z exptime 80.104 propid 2016A-0453 seeing 0.85 MJD 57526.414 object MzLS_647891_z ksb_170619_055629_ooi_g_ls9.fits.fz ksb_170619_055629_ooi_g_ls9-CCD4 g exptime 165.533 propid BASS seeing 2.27 MJD 57923.248 object 27193 ksb_180518_104320_ooi_r_ls9.fits.fz ksb_180518_104320_ooi_r_ls9-CCD4 r exptime 80.377 propid NOTBASS seeing 1.21 MJD 58256.447 object 27193 ksb_160612_104353_ooi_r_ls9.fits.fz ksb_160612_104353_ooi_r_ls9-CCD1 r exptime 84.1 propid BASS seeing 1.45 MJD 57551.447 object 26022 ksb_160706_095707_ooi_g_ls9.fits.fz ksb_160706_095707_ooi_g_ls9-CCD1 g exptime 176.8 propid BASS seeing 2.08 MJD 57575.415 object 26022 ksb_160611_100218_ooi_r_ls9.fits.fz ksb_160611_100218_ooi_r_ls9-CCD1 r exptime 64.099 propid BASS seeing 1.17 MJD 57550.418 object 26021 ksb_170527_091109_ooi_g_ls9.fits.fz ksb_170527_091109_ooi_g_ls9-CCD1 g exptime 111.42 propid 2015A-0801 seeing 1.74 MJD 57900.383 object 26021 Faked up EXPNUM 82560206 Faked up EXPNUM 82560206 Faked up EXPNUM 82560206 90prime get_fwhm: self.fwhm = 2.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3566 3710 and amp range 2016 4031 and image y 3055 3199 and amp range 2048 4095 Range in image: x 0 145 , y 0 145 (with image size 145 x 145) dzp 0.044050463 -> scaling image by 1.0414062625929388 mosaic get_fwhm: self.fwhm = 4.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3975 4088 and amp range 2048 4095 and image y 297 545 and amp range 0 2021 Range in image: x 0 114 , y 0 249 (with image size 114 x 249) dzp -0.0006399284 -> scaling image by 0.9994107778325068 Faked up EXPNUM 75750118 Faked up EXPNUM 75750118 Faked up EXPNUM 75750118 90prime get_fwhm: self.fwhm = 4.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3718 3861 and amp range 2016 4031 and image y 3671 3814 and amp range 2048 4095 Range in image: x 0 144 , y 0 144 (with image size 144 x 144) dzp 0.009677861 -> scaling image by 1.0089534840651213 Faked up EXPNUM 79230081 Faked up EXPNUM 79230081 Faked up EXPNUM 79230081 90prime get_fwhm: self.fwhm = 5.01 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3562 3706 and amp range 2016 4031 and image y 3073 3217 and amp range 2048 4095 Range in image: x 0 145 , y 0 145 (with image size 145 x 145) dzp -0.0030897402 -> scaling image by 0.9971582894587289 Faked up EXPNUM 75510130 Faked up EXPNUM 75510130 Faked up EXPNUM 75510130 90prime get_fwhm: self.fwhm = 3.21 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3713 3856 and amp range 2016 4031 and image y 3659 3802 and amp range 2048 4095 Range in image: x 0 144 , y 0 144 (with image size 144 x 144) dzp 0.01301769 -> scaling image by 1.0120619004021345 mosaic get_fwhm: self.fwhm = 3.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 99 351 and amp range 0 2005 and image y 899 1149 and amp range 0 2039 Range in image: x 0 253 , y 0 251 (with image size 253 x 251) dzp -0.005856539 -> scaling image by 0.9946204500110131 mosaic get_fwhm: self.fwhm = 3.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1268 1519 and amp range 0 2047 and image y 3280 3531 and amp range 2022 4060 Range in image: x 0 252 , y 0 252 (with image size 252 x 252) dzp 0.0033053984 -> scaling image by 1.0030490232713904 mosaic get_fwhm: self.fwhm = 3.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2777 3025 and amp range 2006 4053 and image y 1642 1890 and amp range 0 2039 Range in image: x 0 249 , y 0 249 (with image size 249 x 249) dzp 0.0061123776 -> scaling image by 1.005645584425507 Faked up EXPNUM 75500159 Faked up EXPNUM 75500159 Faked up EXPNUM 75500159 90prime get_fwhm: self.fwhm = 2.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1701 1846 and amp range 0 2015 and image y 1692 1836 and amp range 0 2047 Range in image: x 0 146 , y 0 145 (with image size 146 x 145) dzp -0.01149955 -> scaling image by 0.9894644150522871 Faked up EXPNUM 79000144 Faked up EXPNUM 79000144 Faked up EXPNUM 79000144 90prime get_fwhm: self.fwhm = 3.85 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1707 1851 and amp range 0 2015 and image y 1687 1831 and amp range 0 2047 Range in image: x 0 145 , y 0 145 (with image size 145 x 145) dzp -0.023075538 -> scaling image by 0.9789709052881876 Stage tims : Wall: 4.12 s, CPU: 1.19 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 171 MB, VmData: 205 MB, maxrss: 0.246076 MB Stage tims finished: 2020-06-15T06:31:17.385281 Resources for stage tims : 4.098 s worker CPU, 15.946 s worker Wall, Wall: 4.122 s, Cores in use: 1.28, Total efficiency (on 8 cores): 16.0 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/PGC2338738-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/PGC2338738-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-15T06:31:17.432767 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01378.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01596.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01485.fits Matched 7 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/metrics/cus/reference-custom-272531p49289.fits Stage refs : Wall: 4.32 s, CPU: 4.01 s, VmPeak: 993 MB, VmSize: 987 MB, VmRSS: 219 MB, VmData: 250 MB, maxrss: 0.246076 MB Stage refs finished: 2020-06-15T06:31:21.750065 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.319 s, Cores in use: 0.93, Total efficiency (on 8 cores): 11.6 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/PGC2338738-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/PGC2338738-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-06-15T06:31:21.776757 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/metrics/cus/outlier-mask-custom-272531p49289.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/metrics/cus/outliers-pre-custom-272531p49289.jpg Image ksb_170527_091109_ooi_g_ls9-CCD1 g : masking 126 positive outlier pixels and 0 negative outlier pixels Image k4m_160516_100657_ooi_zd_ls9-CCD4 z : masking 0 positive outlier pixels and 112 negative outlier pixels Image k4m_160523_092108_ooi_zd_ls9-CCD4 z : masking 993 positive outlier pixels and 0 negative outlier pixels Image k4m_170809_083842_ooi_zd_ls9-CCD1 z : masking 1919 positive outlier pixels and 0 negative outlier pixels Image k4m_160518_095527_ooi_zd_ls9-CCD3 z : masking 212 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/metrics/cus/outlier-mask-custom-272531p49289.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/metrics/cus/outliers-post-custom-272531p49289.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/metrics/cus/outliers-masked-pos-custom-272531p49289.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/metrics/cus/outliers-masked-neg-custom-272531p49289.jpg Stage outliers : Wall: 0.78 s, CPU: 0.58 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 232 MB, VmData: 262 MB, maxrss: 0.246076 MB Stage outliers finished: 2020-06-15T06:31:22.557412 Resources for stage outliers : 0.613 s worker CPU, 0.613 s worker Wall, Wall: 0.782 s, Cores in use: 1.53, Total efficiency (on 8 cores): 19.2 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/PGC2338738-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/PGC2338738-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-06-15T06:31:22.584110 Stage halos : Wall: 0.30 s, CPU: 0.30 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 232 MB, VmData: 262 MB, maxrss: 0.246076 MB Stage halos finished: 2020-06-15T06:31:22.887417 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.305 s, Cores in use: 0.98, Total efficiency (on 8 cores): 12.3 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/PGC2338738-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/PGC2338738-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-15T06:31:22.915124 PSF sigmas in coadd pixels: ['3.69', '3.38', '2.83'] Using average PSF sigma 3.298769515821084 Gaussian PSF norm 0.08551515661246889 vs pixelized 0.058697738 average tim pixel scale / coadd scale: 1.7290647214506076 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.97', '2.36', '1.91'] Using average PSF sigma 2.0779076674160852 Gaussian PSF norm 0.13575906003786395 vs pixelized 0.11364207 average tim pixel scale / coadd scale: 1.7295843247992504 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.82', '1.48', '1.40', '1.39'] Using average PSF sigma 1.5222277128832624 Gaussian PSF norm 0.18531707798142788 vs pixelized 0.14653775 average tim pixel scale / coadd scale: 0.9909230843141945 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.17 s, CPU: 0.14 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 234 MB, VmData: 262 MB, maxrss: 0.246076 MB Stage fit_on_coadds finished: 2020-06-15T06:31:23.084008 Resources for stage fit_on_coadds : 0.156 s worker CPU, 0.156 s worker Wall, Wall: 0.170 s, Cores in use: 1.73, Total efficiency (on 8 cores): 21.7 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/PGC2338738-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/PGC2338738-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-06-15T06:31:23.099301 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 19 potential peaks Of 19 potential peaks: 5 in veto map, 4 cut by saddle test, 0 cut by aper test, 10 kept SED z : 10 new peaks Found 23 potential peaks Of 23 potential peaks: 18 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 13 potential peaks Of 13 potential peaks: 12 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 22 potential peaks Of 22 potential peaks: 20 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED Flat : 0 new peaks Found 27 potential peaks Of 27 potential peaks: 22 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 12 new sources Median coadd sky for g : 4.3012842e-05 Median coadd sky for r : 0.00020541399 Median coadd sky for z : 0.00013887181 Stage srcs : Wall: 0.47 s, CPU: 0.44 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 234 MB, VmData: 262 MB, maxrss: 0.246076 MB Stage srcs finished: 2020-06-15T06:31:23.572572 Resources for stage srcs : 0.066 s worker CPU, 0.067 s worker Wall, Wall: 0.474 s, Cores in use: 1.08, Total efficiency (on 8 cores): 13.5 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/PGC2338738-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/PGC2338738-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-15T06:31:23.588969 Blob 1 of 7, id: 3, sources: 9, size: 182x161, npix 15280, brick X: 63,245, Y: 61,222, one pixel: 71 61 Blob 2 of 7, id: 4, sources: 2, size: 52x51, npix 1441, brick X: 8,60, Y: 92,143, one pixel: 21 92 Blob 3 of 7, id: 0, sources: 3, size: 53x31, npix 1091, brick X: 113,166, Y: 0,31, one pixel: 118 0 Blob 4 of 7, id: 1, sources: 1, size: 30x41, npix 907, brick X: 215,245, Y: 16,57, one pixel: 232 16 Blob 5 of 7, id: 5, sources: 1, size: 21x32, npix 491, brick X: 0,21, Y: 200,232, one pixel: 5 200 Blob 6 of 7, id: 6, sources: 1, size: 30x19, npix 394, brick X: 168,198, Y: 226,245, one pixel: 182 226 Blob 7 of 7, id: 2, sources: 1, size: 20x20, npix 229, brick X: 79,99, Y: 35,55, one pixel: 87 35 Blob 7 finished, total: Wall: 0.15 s, CPU: 0.15 s, VmPeak: 793 MB, VmSize: 712 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.13952 MB Blob 6 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 804 MB, VmSize: 712 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139696 MB Blob 5 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 800 MB, VmSize: 712 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139556 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.53011, 49.27985), pm (-20.9, -8.9), parallax 2.817 with NanoMaggies: g=18.7, r=17.4, z=16.4 Reset brightness to NanoMaggies: g=18.6, r=17.1, z=15.9 Blob 3 finished, total: Wall: 0.85 s, CPU: 0.84 s, VmPeak: 811 MB, VmSize: 712 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141236 MB Blob 2 finished, total: Wall: 1.25 s, CPU: 1.24 s, VmPeak: 806 MB, VmSize: 712 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139436 MB Measuring 1 iterative sources Blob 4 finished, total: Wall: 2.17 s, CPU: 2.16 s, VmPeak: 792 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142232 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.712671, ee1=0.00566429, ee2=-0.47362 Measuring 3 iterative sources Blob 1 finished, total: Wall: 7.74 s, CPU: 7.74 s, VmPeak: 793 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144628 MB Old catalog: 18 New catalog: 20 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/metrics/cus/blobs-custom-272531p49289.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/metrics/cus/all-models-custom-272531p49289.fits Stage fitblobs : Wall: 8.14 s, CPU: 0.34 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 234 MB, VmData: 262 MB, maxrss: 0.246076 MB Stage fitblobs finished: 2020-06-15T06:31:31.724927 Resources for stage fitblobs : 13.326 s worker CPU, 13.362 s worker Wall, Wall: 8.137 s, Cores in use: 1.68, Total efficiency (on 8 cores): 21.0 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/PGC2338738-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/PGC2338738-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-06-15T06:31:31.743954 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/tmp-legacysurvey-custom-272531p49289-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/tmp-legacysurvey-custom-272531p49289-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/tmp-legacysurvey-custom-272531p49289-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/tmp-legacysurvey-custom-272531p49289-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-resid.jpg Stage coadds : Wall: 1.44 s, CPU: 0.78 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 235 MB, VmData: 262 MB, maxrss: 0.246076 MB Stage coadds finished: 2020-06-15T06:31:33.180682 Resources for stage coadds : 2.018 s worker CPU, 2.613 s worker Wall, Wall: 1.438 s, Cores in use: 1.94, Total efficiency (on 8 cores): 24.3 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/PGC2338738-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/PGC2338738-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-06-15T06:31:33.198065 Cut to 1 unWISE tiles Reading WISE tile 2717p499 band 4 Reading WISE tile 2717p499 band 1 Reading WISE tile 2717p499 band 3 Reading WISE tile 2717p499 band 2 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p499/unwise-2717p499-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p499/unwise-2717p499-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p499/unwise-2717p499-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p499/unwise-2717p499-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p499/unwise-2717p499-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 794 MB, VmSize: 794 MB, VmRSS: 146 MB, VmData: 176 MB, maxrss: 0.188932 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p499/unwise-2717p499-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p499/unwise-2717p499-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p499/unwise-2717p499-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p499/unwise-2717p499-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p499/unwise-2717p499-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 800 MB, VmSize: 788 MB, VmRSS: 139 MB, VmData: 170 MB, maxrss: 0.202568 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p499/unwise-2717p499-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p499/unwise-2717p499-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p499/unwise-2717p499-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p499/unwise-2717p499-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 804 MB, VmSize: 788 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.20478 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p499/unwise-2717p499-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p499/unwise-2717p499-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p499/unwise-2717p499-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p499/unwise-2717p499-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 794 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 173 MB, maxrss: 0.207168 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/tmp-legacysurvey-custom-272531p49289-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/tmp-legacysurvey-custom-272531p49289-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 1.96 s, CPU: 0.48 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 235 MB, VmData: 262 MB, maxrss: 0.246076 MB Stage wise_forced finished: 2020-06-15T06:31:35.157348 Resources for stage wise_forced : 3.043 s worker CPU, 4.411 s worker Wall, Wall: 1.961 s, Cores in use: 1.80, Total efficiency (on 8 cores): 22.5 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/PGC2338738-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/PGC2338738-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-06-15T06:31:35.172960 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/coadd/cus/custom-272531p49289/legacysurvey-custom-272531p49289-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/tractor-i/cus/tractor-custom-272531p49289.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/tractor/cus/tractor-custom-272531p49289.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/tractor/cus/brick-custom-272531p49289.sha256sum Stage writecat : Wall: 1.26 s, CPU: 1.05 s, VmPeak: 1129 MB, VmSize: 1001 MB, VmRSS: 237 MB, VmData: 262 MB, maxrss: 0.37414 MB Stage writecat finished: 2020-06-15T06:31:36.431165 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.259 s, Cores in use: 0.83, Total efficiency (on 8 cores): 10.4 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/PGC2338738-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2338738/PGC2338738-largegalaxy-writecat.p All done: 23.324 s worker CPU, 37.172 s worker Wall, Wall: 23.197 s, Cores in use: 1.41, Total efficiency (on 8 cores): 17.7 % Finished galaxy PGC2338738 in 0.417 minutes.