Started working on galaxy PGC2389717 at Mon Jun 15 06:45:53 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.307791 51.177916700000004 --width 295 --height 295 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/PGC2389717-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/PGC2389717-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-15T06:45:54.125975 legacypipe git version: DR9.5.2-29-gb5a6d7b1 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '276.307791', '51.177916700000004', '--width', '295', '--height', '295', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/PGC2389717-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/PGC2389717-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.307791 51.177916700000004 --width 295 --height 295 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/PGC2389717-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/PGC2389717-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 276.307791 51.177916700000004 Starting process 13914 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Starting process 13915 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB Starting process 13916 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB Starting process 13917 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057324 MB Starting process 13918 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB Starting process 13919 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057332 MB Starting process 13920 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057332 MB Starting process 13921 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057332 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-15T06:45:54.932650 Keeping 9 CCDs: k4m_160518_101541_ooi_zd_ls9.fits.fz k4m_160518_101541_ooi_zd_ls9-CCD3 z exptime 80.104 propid 2016A-0453 seeing 0.97 MJD 57526.428 object MzLS_655100_z k4m_170901_074318_ooi_zd_ls9.fits.fz k4m_170901_074318_ooi_zd_ls9-CCD4 z exptime 223.101 propid 2016A-0453 seeing 1.15 MJD 57997.322 object MzLS_654312_z k4m_160524_094305_ooi_zd_ls9.fits.fz k4m_160524_094305_ooi_zd_ls9-CCD2 z exptime 80.105 propid 2016A-0453 seeing 1.12 MJD 57532.405 object MzLS_653522_z ksb_170405_114054_ooi_r_ls9.fits.fz ksb_170405_114054_ooi_r_ls9-CCD1 r exptime 63.356 propid BASS seeing 1.31 MJD 57848.487 object 28351 ksb_180515_104237_ooi_g_ls9.fits.fz ksb_180515_104237_ooi_g_ls9-CCD1 g exptime 94.371 propid NOTBASS seeing 1.49 MJD 58253.446 object 28351 ksb_160712_065419_ooi_r_ls9.fits.fz ksb_160712_065419_ooi_r_ls9-CCD4 r exptime 182.7 propid BASS seeing 1.98 MJD 57581.288 object 28352 ksb_160706_102046_ooi_g_ls9.fits.fz ksb_160706_102046_ooi_g_ls9-CCD4 g exptime 171.0 propid BASS seeing 1.75 MJD 57575.431 object 28352 ksb_170619_073746_ooi_g_ls9.fits.fz ksb_170619_073746_ooi_g_ls9-CCD1 g exptime 239.4 propid BASS seeing 2.45 MJD 57923.318 object 28353 ksb_170624_064033_ooi_r_ls9.fits.fz ksb_170624_064033_ooi_r_ls9-CCD1 r exptime 75.599 propid BASS seeing 1.21 MJD 57928.278 object 28353 Faked up EXPNUM 79230107 Faked up EXPNUM 79230107 Faked up EXPNUM 79230107 90prime get_fwhm: self.fwhm = 5.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 552 727 and amp range 0 2015 and image y 2080 2253 and amp range 2048 4095 Range in image: x 0 176 , y 0 174 (with image size 176 x 174) dzp -0.034377232 -> scaling image by 0.9688334104074875 mosaic get_fwhm: self.fwhm = 4.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3026 3333 and amp range 2048 4095 and image y 492 799 and amp range 0 2039 Range in image: x 0 308 , y 0 308 (with image size 308 x 308) dzp 0.0072022504 -> scaling image by 1.0066555682883527 Faked up EXPNUM 75750124 Faked up EXPNUM 75750124 Faked up EXPNUM 75750124 90prime get_fwhm: self.fwhm = 3.87 Found 4 relevant rows in amp-corrections file. Found overlap: image x 446 618 and amp range 0 2015 and image y 1591 1762 and amp range 0 2047 Range in image: x 0 173 , y 0 172 (with image size 173 x 172) dzp 0.009539392 -> scaling image by 1.0088248156909383 Faked up EXPNUM 75810086 Faked up EXPNUM 75810086 Faked up EXPNUM 75810086 90prime get_fwhm: self.fwhm = 4.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 443 614 and amp range 0 2015 and image y 1600 1772 and amp range 0 2047 Range in image: x 0 172 , y 0 173 (with image size 172 x 173) dzp 0.009781551 -> scaling image by 1.0090498455107675 mosaic get_fwhm: self.fwhm = 4.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 322 621 and amp range 0 2047 and image y 2345 2646 and amp range 2022 4060 Range in image: x 0 300 , y 0 302 (with image size 300 x 302) dzp -0.016192675 -> scaling image by 0.9851966584456431 mosaic get_fwhm: self.fwhm = 3.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1892 2192 and amp range 0 2005 and image y 2822 3127 and amp range 2040 4078 Range in image: x 0 114 , y 0 306 (with image size 301 x 306) dzp 0.0022078273 -> scaling image by 1.0020355530120029 Found overlap: image x 1892 2192 and amp range 2006 4053 and image y 2822 3127 and amp range 2040 4078 Range in image: x 114 301 , y 0 306 (with image size 301 x 306) dzp -0.0026360443 -> scaling image by 0.99757505842151 Faked up EXPNUM 82530167 Faked up EXPNUM 82530167 Faked up EXPNUM 82530167 Faked up EXPNUM 79280079 Faked up EXPNUM 79280079 Faked up EXPNUM 79280079 90prime get_fwhm: self.fwhm = 2.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 580 755 and amp range 0 2015 and image y 2101 2274 and amp range 2048 4095 Range in image: x 0 176 , y 0 174 (with image size 176 x 174) dzp -0.041613504 -> scaling image by 0.9623977484321999 Stage tims : Wall: 3.06 s, CPU: 1.04 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 171 MB, VmData: 204 MB, maxrss: 0.384148 MB Stage tims finished: 2020-06-15T06:45:57.994443 Faked up EXPNUM 78480185 Faked up EXPNUM 78480185 Faked up EXPNUM 78480185 Resources for stage tims : 3.771 s worker CPU, 12.319 s worker Wall, Wall: 3.063 s, Cores in use: 1.57, Total efficiency (on 8 cores): 19.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/PGC2389717-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/PGC2389717-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-15T06:45:58.069941 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01379.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01380.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01276.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01487.fits Matched 4 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/metrics/cus/reference-custom-276307p51177.fits Stage refs : Wall: 4.88 s, CPU: 4.32 s, VmPeak: 1013 MB, VmSize: 1007 MB, VmRSS: 239 MB, VmData: 270 MB, maxrss: 0.384148 MB Stage refs finished: 2020-06-15T06:46:02.949192 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.881 s, Cores in use: 0.89, Total efficiency (on 8 cores): 11.1 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/PGC2389717-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/PGC2389717-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-06-15T06:46:02.972541 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/metrics/cus/outlier-mask-custom-276307p51177.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/metrics/cus/outliers-pre-custom-276307p51177.jpg Image ksb_160712_065419_ooi_r_ls9-CCD4 r : masking 1902 positive outlier pixels and 91 negative outlier pixels Image ksb_170624_064033_ooi_r_ls9-CCD1 r : masking 117 positive outlier pixels and 0 negative outlier pixels Image k4m_170901_074318_ooi_zd_ls9-CCD4 z : masking 389 positive outlier pixels and 0 negative outlier pixels Image k4m_160524_094305_ooi_zd_ls9-CCD2 z : masking 473 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/metrics/cus/outlier-mask-custom-276307p51177.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/metrics/cus/outliers-post-custom-276307p51177.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/metrics/cus/outliers-masked-pos-custom-276307p51177.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/metrics/cus/outliers-masked-neg-custom-276307p51177.jpg Stage outliers : Wall: 0.85 s, CPU: 0.59 s, VmPeak: 1016 MB, VmSize: 1016 MB, VmRSS: 255 MB, VmData: 283 MB, maxrss: 0.384148 MB Stage outliers finished: 2020-06-15T06:46:03.819647 Resources for stage outliers : 0.596 s worker CPU, 0.650 s worker Wall, Wall: 0.848 s, Cores in use: 1.40, Total efficiency (on 8 cores): 17.5 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/PGC2389717-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/PGC2389717-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-06-15T06:46:03.888606 Stage halos : Wall: 0.28 s, CPU: 0.28 s, VmPeak: 1016 MB, VmSize: 1016 MB, VmRSS: 255 MB, VmData: 283 MB, maxrss: 0.384148 MB Stage halos finished: 2020-06-15T06:46:04.173370 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.286 s, Cores in use: 0.97, Total efficiency (on 8 cores): 12.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/PGC2389717-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/PGC2389717-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-15T06:46:04.246498 PSF sigmas in coadd pixels: ['2.85', '3.98'] Using average PSF sigma 3.413757619514194 Gaussian PSF norm 0.08263468682173826 vs pixelized 0.0666295 average tim pixel scale / coadd scale: 1.7290856495485392 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-copsf-g.fits.fz PSF sigmas in coadd pixels: ['3.22', '1.96'] Using average PSF sigma 2.5897637653570214 Gaussian PSF norm 0.1089268432694242 vs pixelized 0.090133965 average tim pixel scale / coadd scale: 1.7287855246282033 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.57', '1.86', '1.83'] Using average PSF sigma 1.7528203707648233 Gaussian PSF norm 0.1609376502458089 vs pixelized 0.13795048 average tim pixel scale / coadd scale: 0.9909650988037918 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.17 s, CPU: 0.13 s, VmPeak: 1016 MB, VmSize: 1016 MB, VmRSS: 257 MB, VmData: 284 MB, maxrss: 0.384148 MB Stage fit_on_coadds finished: 2020-06-15T06:46:04.413378 Resources for stage fit_on_coadds : 0.136 s worker CPU, 0.136 s worker Wall, Wall: 0.168 s, Cores in use: 1.62, Total efficiency (on 8 cores): 20.2 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/PGC2389717-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/PGC2389717-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-06-15T06:46:04.427404 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 32 potential peaks Of 32 potential peaks: 9 in veto map, 3 cut by saddle test, 0 cut by aper test, 20 kept SED z : 20 new peaks Found 25 potential peaks Of 25 potential peaks: 24 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 25 potential peaks Of 25 potential peaks: 21 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 41 potential peaks Of 41 potential peaks: 34 in veto map, 3 cut by saddle test, 1 cut by aper test, 3 kept SED Flat : 3 new peaks Found 41 potential peaks Of 41 potential peaks: 34 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 27 new sources Median coadd sky for g : 0.00010409334 Median coadd sky for r : 0.0002014206 Median coadd sky for z : 0.00018525965 Stage srcs : Wall: 0.62 s, CPU: 0.58 s, VmPeak: 1016 MB, VmSize: 1016 MB, VmRSS: 258 MB, VmData: 284 MB, maxrss: 0.384148 MB Stage srcs finished: 2020-06-15T06:46:05.043137 Resources for stage srcs : 0.099 s worker CPU, 0.099 s worker Wall, Wall: 0.617 s, Cores in use: 1.10, Total efficiency (on 8 cores): 13.7 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/PGC2389717-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/PGC2389717-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-15T06:46:05.060848 Blob 1 of 11, id: 0, sources: 22, size: 204x274, npix 29810, brick X: 66,270, Y: 21,295, one pixel: 140 21 Blob 2 of 11, id: 1, sources: 2, size: 27x63, npix 1105, brick X: 268,295, Y: 28,91, one pixel: 289 28 Blob 3 of 11, id: 7, sources: 1, size: 38x37, npix 1003, brick X: 19,57, Y: 222,259, one pixel: 35 222 Blob 4 of 11, id: 10, sources: 3, size: 49x38, npix 956, brick X: 129,178, Y: 257,295, one pixel: 162 257 Blob 5 of 11, id: 8, sources: 1, size: 35x40, npix 949, brick X: 59,94, Y: 228,268, one pixel: 73 228 Blob 6 of 11, id: 4, sources: 1, size: 27x29, npix 500, brick X: 232,259, Y: 114,143, one pixel: 245 114 Blob 7 of 11, id: 2, sources: 1, size: 25x29, npix 438, brick X: 49,74, Y: 61,90, one pixel: 64 61 Blob 8 of 11, id: 6, sources: 1, size: 21x20, npix 239, brick X: 19,40, Y: 174,194, one pixel: 28 174 Blob 9 of 11, id: 9, sources: 1, size: 20x21, npix 229, brick X: 164,184, Y: 232,253, one pixel: 173 232 Blob 10 of 11, id: 3, sources: 1, size: 18x18, npix 180, brick X: 23,41, Y: 71,89, one pixel: 31 71 Blob 7 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 794 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142128 MB Blob 11 of 11, id: 5, sources: 1, size: 17x18, npix 162, brick X: 245,262, Y: 161,179, one pixel: 253 161 Blob 8 finished, total: Wall: 0.14 s, CPU: 0.14 s, VmPeak: 798 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.140888 MB Blob 9 finished, total: Wall: 0.20 s, CPU: 0.20 s, VmPeak: 794 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142128 MB Blob 10 finished, total: Wall: 0.14 s, CPU: 0.14 s, VmPeak: 798 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.140888 MB Blob 6 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 793 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142516 MB Blob 3 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 801 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141156 MB Blob 11 finished, total: Wall: 0.17 s, CPU: 0.17 s, VmPeak: 794 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142128 MB Blob 4 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 793 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142624 MB Measuring 1 iterative sources Blob 5 finished, total: Wall: 1.30 s, CPU: 1.30 s, VmPeak: 802 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142844 MB Blob 2 finished, total: Wall: 1.37 s, CPU: 1.37 s, VmPeak: 801 MB, VmSize: 712 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142636 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.02501, ee1=0.0743685, ee2=0.0381086 Measuring 2 iterative sources Blob 1 finished, total: Wall: 16.38 s, CPU: 16.35 s, VmPeak: 710 MB, VmSize: 699 MB, VmRSS: 140 MB, VmData: 175 MB, maxrss: 0.153264 MB Old catalog: 42 New catalog: 35 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/metrics/cus/blobs-custom-276307p51177.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/metrics/cus/all-models-custom-276307p51177.fits Stage fitblobs : Wall: 16.82 s, CPU: 0.39 s, VmPeak: 1016 MB, VmSize: 1016 MB, VmRSS: 258 MB, VmData: 284 MB, maxrss: 0.384148 MB Stage fitblobs finished: 2020-06-15T06:46:21.882011 Resources for stage fitblobs : 21.390 s worker CPU, 21.460 s worker Wall, Wall: 16.823 s, Cores in use: 1.29, Total efficiency (on 8 cores): 16.2 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/PGC2389717-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/PGC2389717-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-06-15T06:46:21.971649 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/tmp-legacysurvey-custom-276307p51177-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/tmp-legacysurvey-custom-276307p51177-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/tmp-legacysurvey-custom-276307p51177-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/tmp-legacysurvey-custom-276307p51177-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-resid.jpg Stage coadds : Wall: 1.65 s, CPU: 0.69 s, VmPeak: 1016 MB, VmSize: 1016 MB, VmRSS: 259 MB, VmData: 285 MB, maxrss: 0.384148 MB Stage coadds finished: 2020-06-15T06:46:23.626428 Resources for stage coadds : 2.602 s worker CPU, 3.790 s worker Wall, Wall: 1.656 s, Cores in use: 1.99, Total efficiency (on 8 cores): 24.8 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/PGC2389717-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/PGC2389717-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-06-15T06:46:23.644607 Cut to 1 unWISE tiles Reading WISE tile 2765p514 band 1 Reading WISE tile 2765p514 band 2 Reading WISE tile 2765p514 band 3 Reading WISE tile 2765p514 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 801 MB, VmSize: 793 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.18942 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 796 MB, VmSize: 793 MB, VmRSS: 149 MB, VmData: 175 MB, maxrss: 0.21398 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 798 MB, VmSize: 788 MB, VmRSS: 139 MB, VmData: 169 MB, maxrss: 0.202684 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 794 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 173 MB, maxrss: 0.206592 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/tmp-legacysurvey-custom-276307p51177-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/tmp-legacysurvey-custom-276307p51177-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 1.93 s, CPU: 0.60 s, VmPeak: 1016 MB, VmSize: 1016 MB, VmRSS: 259 MB, VmData: 285 MB, maxrss: 0.384148 MB Stage wise_forced finished: 2020-06-15T06:46:25.574153 Resources for stage wise_forced : 3.286 s worker CPU, 3.989 s worker Wall, Wall: 1.931 s, Cores in use: 2.01, Total efficiency (on 8 cores): 25.2 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/PGC2389717-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/PGC2389717-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-06-15T06:46:25.701407 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/coadd/cus/custom-276307p51177/legacysurvey-custom-276307p51177-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/tractor-i/cus/tractor-custom-276307p51177.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/tractor/cus/tractor-custom-276307p51177.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/tractor/cus/brick-custom-276307p51177.sha256sum Stage writecat : Wall: 0.80 s, CPU: 0.61 s, VmPeak: 1149 MB, VmSize: 1021 MB, VmRSS: 261 MB, VmData: 285 MB, maxrss: 0.39852 MB Stage writecat finished: 2020-06-15T06:46:26.503090 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.803 s, Cores in use: 0.77, Total efficiency (on 8 cores): 9.6 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/PGC2389717-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2389717/PGC2389717-largegalaxy-writecat.p All done: 31.882 s worker CPU, 42.449 s worker Wall, Wall: 31.603 s, Cores in use: 1.30, Total efficiency (on 8 cores): 16.3 % Finished galaxy PGC2389717 in 0.559 minutes.