Started working on galaxy PGC2376818 at Mon Jun 15 06:44:41 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 263.4857085 50.5759722 --width 269 --height 269 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/PGC2376818-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/PGC2376818-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-15T06:44:42.445248 legacypipe git version: DR9.5.2-29-gb5a6d7b1 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '263.4857085', '50.5759722', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/PGC2376818-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/PGC2376818-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 263.4857085 50.5759722 --width 269 --height 269 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/PGC2376818-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/PGC2376818-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 263.4857085 50.5759722 Starting process 27743 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB Starting process 27744 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB Starting process 27745 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057388 MB Starting process 27746 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057324 MB Starting process 27747 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057332 MB Starting process 27748 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057336 MB Starting process 27749 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057336 MB Starting process 27750 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057336 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-15T06:44:42.980976 Keeping 7 CCDs: k4m_160518_091348_ooi_zd_ls9.fits.fz k4m_160518_091348_ooi_zd_ls9-CCD1 z exptime 120.103 propid 2016A-0453 seeing 1.11 MJD 57526.385 object MzLS_652714_z k4m_160523_090321_ooi_zd_ls9.fits.fz k4m_160523_090321_ooi_zd_ls9-CCD4 z exptime 116.103 propid 2016A-0453 seeing 1.02 MJD 57531.377 object MzLS_651116_z k4m_170517_104459_ooi_zd_ls9.fits.fz k4m_170517_104459_ooi_zd_ls9-CCD2 z exptime 243.105 propid 2016A-0453 seeing 1.49 MJD 57890.448 object MzLS_651917_z ksb_170501_094514_ooi_r_ls9.fits.fz ksb_170501_094514_ooi_r_ls9-CCD2 r exptime 58.07 propid BASS seeing 0.97 MJD 57874.406 object 28273 ksb_170523_091904_ooi_g_ls9.fits.fz ksb_170523_091904_ooi_g_ls9-CCD2 g exptime 107.873 propid 2015A-0801 seeing 1.52 MJD 57896.388 object 28273 ksb_160711_064918_ooi_r_ls9.fits.fz ksb_160711_064918_ooi_r_ls9-CCD1 r exptime 85.9 propid BASS seeing 1.81 MJD 57580.284 object 27122 ksb_160707_075801_ooi_g_ls9.fits.fz ksb_160707_075801_ooi_g_ls9-CCD1 g exptime 235.8 propid BASS seeing 2.55 MJD 57576.332 object 27122 Faked up EXPNUM 75760077 Faked up EXPNUM 75760077 Faked up EXPNUM 75760077 90prime get_fwhm: self.fwhm = 5.63 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1418 1577 and amp range 0 2015 and image y 1682 1840 and amp range 0 2047 Range in image: x 0 160 , y 0 159 (with image size 160 x 159) dzp -0.011813398 -> scaling image by 0.989178436928226 mosaic get_fwhm: self.fwhm = 4.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1666 1939 and amp range 0 2005 and image y 2278 2550 and amp range 2040 4078 Range in image: x 0 274 , y 0 273 (with image size 274 x 273) dzp -0.005990375 -> scaling image by 0.994497853444703 Faked up EXPNUM 78740227 Faked up EXPNUM 78740227 Faked up EXPNUM 78740227 90prime get_fwhm: self.fwhm = 2.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1197 1354 and amp range 0 2015 and image y 2106 2264 and amp range 2048 4095 Range in image: x 0 158 , y 0 159 (with image size 158 x 159) dzp 0.05525464 -> scaling image by 1.0522086198429996 Faked up EXPNUM 78960154 Faked up EXPNUM 78960154 Faked up EXPNUM 78960154 90prime get_fwhm: self.fwhm = 3.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1206 1364 and amp range 0 2015 and image y 2097 2255 and amp range 2048 4095 Range in image: x 0 159 , y 0 159 (with image size 159 x 159) dzp 0.051889952 -> scaling image by 1.0489528829333021 mosaic get_fwhm: self.fwhm = 5.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 95 366 and amp range 0 2047 and image y 998 1271 and amp range 0 2039 Range in image: x 0 272 , y 0 274 (with image size 272 x 274) dzp -0.0096683735 -> scaling image by 0.9911346301237048 mosaic get_fwhm: self.fwhm = 3.91 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2819 3096 and amp range 2048 4095 and image y 1553 1826 and amp range 0 2021 Range in image: x 0 278 , y 0 274 (with image size 278 x 274) dzp -0.0006399284 -> scaling image by 0.9994107778325068 Faked up EXPNUM 75800080 Faked up EXPNUM 75800080 Faked up EXPNUM 75800080 90prime get_fwhm: self.fwhm = 3.99 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1400 1559 and amp range 0 2015 and image y 1700 1858 and amp range 0 2047 Range in image: x 0 160 , y 0 159 (with image size 160 x 159) dzp -0.01149955 -> scaling image by 0.9894644150522871 Stage tims : Wall: 3.06 s, CPU: 1.09 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 170 MB, VmData: 204 MB, maxrss: 0.246316 MB Stage tims finished: 2020-06-15T06:44:46.038422 Resources for stage tims : 3.399 s worker CPU, 10.487 s worker Wall, Wall: 3.059 s, Cores in use: 1.47, Total efficiency (on 8 cores): 18.3 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/PGC2376818-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/PGC2376818-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-15T06:44:46.058964 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01376.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01482.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01483.fits Matched 15 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/metrics/cus/reference-custom-263485p50575.fits Stage refs : Wall: 3.14 s, CPU: 2.79 s, VmPeak: 980 MB, VmSize: 974 MB, VmRSS: 205 MB, VmData: 237 MB, maxrss: 0.246316 MB Stage refs finished: 2020-06-15T06:44:49.199564 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.142 s, Cores in use: 0.89, Total efficiency (on 8 cores): 11.1 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/PGC2376818-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/PGC2376818-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-06-15T06:44:49.225142 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/metrics/cus/outlier-mask-custom-263485p50575.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/metrics/cus/outliers-pre-custom-263485p50575.jpg Image ksb_160707_075801_ooi_g_ls9-CCD1 g : masking 420 positive outlier pixels and 0 negative outlier pixels Image ksb_170501_094514_ooi_r_ls9-CCD2 r : masking 112 positive outlier pixels and 0 negative outlier pixels Image k4m_160518_091348_ooi_zd_ls9-CCD1 z : masking 0 positive outlier pixels and 264 negative outlier pixels Image k4m_160523_090321_ooi_zd_ls9-CCD4 z : masking 626 positive outlier pixels and 0 negative outlier pixels Image k4m_170517_104459_ooi_zd_ls9-CCD2 z : masking 148 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/metrics/cus/outlier-mask-custom-263485p50575.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/metrics/cus/outliers-post-custom-263485p50575.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/metrics/cus/outliers-masked-pos-custom-263485p50575.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/metrics/cus/outliers-masked-neg-custom-263485p50575.jpg Stage outliers : Wall: 0.79 s, CPU: 0.55 s, VmPeak: 983 MB, VmSize: 983 MB, VmRSS: 218 MB, VmData: 248 MB, maxrss: 0.246316 MB Stage outliers finished: 2020-06-15T06:44:50.018270 Resources for stage outliers : 0.597 s worker CPU, 0.625 s worker Wall, Wall: 0.794 s, Cores in use: 1.45, Total efficiency (on 8 cores): 18.1 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/PGC2376818-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/PGC2376818-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-06-15T06:44:50.123230 Stage halos : Wall: 0.53 s, CPU: 0.52 s, VmPeak: 983 MB, VmSize: 965 MB, VmRSS: 200 MB, VmData: 230 MB, maxrss: 0.246316 MB Stage halos finished: 2020-06-15T06:44:50.654186 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.532 s, Cores in use: 0.99, Total efficiency (on 8 cores): 12.3 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/PGC2376818-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/PGC2376818-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-06-15T06:44:50.736024 PSF sigmas in coadd pixels: ['2.47', '4.14'] Using average PSF sigma 3.303312643620557 Gaussian PSF norm 0.08539754549684148 vs pixelized 0.064590424 average tim pixel scale / coadd scale: 1.7290317630288652 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.58', '2.93'] Using average PSF sigma 2.2586014067532445 Gaussian PSF norm 0.12489799702170176 vs pixelized 0.11633755 average tim pixel scale / coadd scale: 1.7291322378939344 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.80', '1.65', '2.42'] Using average PSF sigma 1.9551948504500025 Gaussian PSF norm 0.14427963111142195 vs pixelized 0.11116911 average tim pixel scale / coadd scale: 0.9909455037057285 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.15 s, CPU: 0.12 s, VmPeak: 983 MB, VmSize: 965 MB, VmRSS: 203 MB, VmData: 231 MB, maxrss: 0.246316 MB Stage fit_on_coadds finished: 2020-06-15T06:44:50.888660 Resources for stage fit_on_coadds : 0.139 s worker CPU, 0.139 s worker Wall, Wall: 0.154 s, Cores in use: 1.70, Total efficiency (on 8 cores): 21.2 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/PGC2376818-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/PGC2376818-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-06-15T06:44:50.905683 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 23 potential peaks Of 23 potential peaks: 7 in veto map, 1 cut by saddle test, 0 cut by aper test, 15 kept SED z : 15 new peaks Found 17 potential peaks Of 17 potential peaks: 13 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 15 potential peaks Of 15 potential peaks: 13 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 25 potential peaks Of 25 potential peaks: 20 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 31 potential peaks Of 31 potential peaks: 25 in veto map, 6 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 19 new sources Median coadd sky for g : 8.664304e-05 Median coadd sky for r : 0.00016445771 Median coadd sky for z : -5.657566e-05 Stage srcs : Wall: 0.52 s, CPU: 0.48 s, VmPeak: 983 MB, VmSize: 965 MB, VmRSS: 203 MB, VmData: 231 MB, maxrss: 0.246316 MB Stage srcs finished: 2020-06-15T06:44:51.428107 Resources for stage srcs : 0.095 s worker CPU, 0.095 s worker Wall, Wall: 0.524 s, Cores in use: 1.10, Total efficiency (on 8 cores): 13.7 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/PGC2376818-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/PGC2376818-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-15T06:44:51.448005 Blob 1 of 16, id: 8, sources: 4, size: 129x124, npix 9650, brick X: 62,191, Y: 63,187, one pixel: 119 63 Blob 2 of 16, id: 3, sources: 3, size: 42x105, npix 3198, brick X: 227,269, Y: 6,111, one pixel: 245 6 Blob 3 of 16, id: 13, sources: 2, size: 55x63, npix 2088, brick X: 214,269, Y: 178,241, one pixel: 258 178 Blob 4 of 16, id: 7, sources: 2, size: 42x49, npix 1193, brick X: 3,45, Y: 61,110, one pixel: 32 61 Blob 5 of 16, id: 6, sources: 2, size: 49x46, npix 1064, brick X: 63,112, Y: 50,96, one pixel: 99 50 Blob 6 of 16, id: 1, sources: 1, size: 39x32, npix 929, brick X: 171,210, Y: 0,32, one pixel: 181 0 Blob 7 of 16, id: 4, sources: 2, size: 37x44, npix 928, brick X: 142,179, Y: 15,59, one pixel: 155 15 Blob 8 of 16, id: 0, sources: 1, size: 26x40, npix 765, brick X: 0,26, Y: 0,40, one pixel: 4 0 Blob 9 of 16, id: 12, sources: 1, size: 33x31, npix 733, brick X: 18,51, Y: 144,175, one pixel: 30 144 Measuring 2 iterative sources Measuring 2 iterative sources Measuring 1 iterative sources Blob 6 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 795 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143764 MB Blob 10 of 16, id: 15, sources: 1, size: 27x27, npix 489, brick X: 198,225, Y: 225,252, one pixel: 208 225 Blob 7 finished, total: Wall: 0.88 s, CPU: 0.88 s, VmPeak: 792 MB, VmSize: 712 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142336 MB Blob 11 of 16, id: 14, sources: 1, size: 27x24, npix 393, brick X: 44,71, Y: 211,235, one pixel: 55 211 Measuring 1 iterative sources Measuring 3 iterative sources Blob 4 finished, total: Wall: 1.06 s, CPU: 1.06 s, VmPeak: 796 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142608 MB Blob 12 of 16, id: 5, sources: 1, size: 24x25, npix 364, brick X: 30,54, Y: 26,51, one pixel: 40 26 Blob 8 finished, total: Wall: 1.08 s, CPU: 1.08 s, VmPeak: 658 MB, VmSize: 658 MB, VmRSS: 91 MB, VmData: 137 MB, maxrss: 0.093076 MB Blob 13 of 16, id: 2, sources: 1, size: 23x23, npix 338, brick X: 77,100, Y: 4,27, one pixel: 85 4 Blob 14 of 16, id: 10, sources: 1, size: 22x22, npix 302, brick X: 45,67, Y: 135,157, one pixel: 53 135 Blob 9 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 795 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143764 MB Blob 15 of 16, id: 11, sources: 1, size: 22x21, npix 272, brick X: 244,266, Y: 141,162, one pixel: 253 141 Blob 10 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 792 MB, VmSize: 712 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142528 MB Blob 16 of 16, id: 9, sources: 1, size: 21x22, npix 271, brick X: 49,70, Y: 93,115, one pixel: 59 93 Blob 12 finished, total: Wall: 0.18 s, CPU: 0.18 s, VmPeak: 658 MB, VmSize: 658 MB, VmRSS: 91 MB, VmData: 137 MB, maxrss: 0.093284 MB Blob 13 finished, total: Wall: 0.18 s, CPU: 0.18 s, VmPeak: 795 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143764 MB Blob 5 finished, total: Wall: 1.31 s, CPU: 1.31 s, VmPeak: 793 MB, VmSize: 712 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142772 MB Blob 14 finished, total: Wall: 0.15 s, CPU: 0.15 s, VmPeak: 792 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142528 MB Blob 15 finished, total: Wall: 0.15 s, CPU: 0.15 s, VmPeak: 658 MB, VmSize: 658 MB, VmRSS: 91 MB, VmData: 137 MB, maxrss: 0.093376 MB Blob 11 finished, total: Wall: 0.44 s, CPU: 0.44 s, VmPeak: 796 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142608 MB Blob 16 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 795 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143764 MB Measuring 2 iterative sources Blob 3 finished, total: Wall: 2.65 s, CPU: 2.64 s, VmPeak: 793 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143088 MB Blob 2 finished, total: Wall: 2.91 s, CPU: 2.91 s, VmPeak: 800 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14336 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.00929, ee1=0.0258888, ee2=-0.180669 Measuring 1 iterative sources Blob 1 finished, total: Wall: 4.72 s, CPU: 4.71 s, VmPeak: 797 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144568 MB Old catalog: 28 New catalog: 36 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/metrics/cus/blobs-custom-263485p50575.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/metrics/cus/all-models-custom-263485p50575.fits Stage fitblobs : Wall: 5.20 s, CPU: 0.47 s, VmPeak: 983 MB, VmSize: 965 MB, VmRSS: 203 MB, VmData: 231 MB, maxrss: 0.246316 MB Stage fitblobs finished: 2020-06-15T06:44:56.646912 Resources for stage fitblobs : 17.552 s worker CPU, 17.586 s worker Wall, Wall: 5.200 s, Cores in use: 3.47, Total efficiency (on 8 cores): 43.3 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/PGC2376818-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/PGC2376818-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-06-15T06:44:56.667061 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/tmp-legacysurvey-custom-263485p50575-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/tmp-legacysurvey-custom-263485p50575-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/tmp-legacysurvey-custom-263485p50575-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/tmp-legacysurvey-custom-263485p50575-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-resid.jpg Stage coadds : Wall: 1.68 s, CPU: 0.68 s, VmPeak: 983 MB, VmSize: 965 MB, VmRSS: 204 MB, VmData: 231 MB, maxrss: 0.246316 MB Stage coadds finished: 2020-06-15T06:44:58.351970 Resources for stage coadds : 2.622 s worker CPU, 3.470 s worker Wall, Wall: 1.686 s, Cores in use: 1.96, Total efficiency (on 8 cores): 24.5 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/PGC2376818-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/PGC2376818-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-06-15T06:44:58.379041 Cut to 1 unWISE tiles Reading WISE tile 2624p499 band 1 Reading WISE tile 2624p499 band 2 Reading WISE tile 2624p499 band 3 Reading WISE tile 2624p499 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2624p499/unwise-2624p499-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2624p499/unwise-2624p499-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2624p499/unwise-2624p499-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2624p499/unwise-2624p499-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2624p499/unwise-2624p499-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 794 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.20872 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2624p499/unwise-2624p499-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2624p499/unwise-2624p499-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2624p499/unwise-2624p499-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2624p499/unwise-2624p499-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2624p499/unwise-2624p499-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 795 MB, VmSize: 794 MB, VmRSS: 146 MB, VmData: 176 MB, maxrss: 0.186856 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2624p499/unwise-2624p499-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2624p499/unwise-2624p499-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2624p499/unwise-2624p499-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2624p499/unwise-2624p499-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 800 MB, VmSize: 788 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.203356 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2624p499/unwise-2624p499-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2624p499/unwise-2624p499-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2624p499/unwise-2624p499-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2624p499/unwise-2624p499-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 797 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.20898 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/tmp-legacysurvey-custom-263485p50575-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/tmp-legacysurvey-custom-263485p50575-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 4.38 s, CPU: 0.54 s, VmPeak: 983 MB, VmSize: 965 MB, VmRSS: 205 MB, VmData: 231 MB, maxrss: 0.246316 MB Stage wise_forced finished: 2020-06-15T06:45:02.760497 Resources for stage wise_forced : 3.260 s worker CPU, 4.039 s worker Wall, Wall: 4.383 s, Cores in use: 0.87, Total efficiency (on 8 cores): 10.8 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/PGC2376818-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/PGC2376818-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-06-15T06:45:02.820282 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/coadd/cus/custom-263485p50575/legacysurvey-custom-263485p50575-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/tractor-i/cus/tractor-custom-263485p50575.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/tractor/cus/tractor-custom-263485p50575.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/tractor/cus/brick-custom-263485p50575.sha256sum Stage writecat : Wall: 0.75 s, CPU: 0.58 s, VmPeak: 1097 MB, VmSize: 969 MB, VmRSS: 207 MB, VmData: 231 MB, maxrss: 0.342536 MB Stage writecat finished: 2020-06-15T06:45:03.566685 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.748 s, Cores in use: 0.78, Total efficiency (on 8 cores): 9.7 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/PGC2376818-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2376818/PGC2376818-largegalaxy-writecat.p All done: 27.667 s worker CPU, 36.445 s worker Wall, Wall: 20.620 s, Cores in use: 1.73, Total efficiency (on 8 cores): 21.6 % Finished galaxy PGC2376818 in 0.373 minutes.