Started working on galaxy PGC2653697 at Sun Jun 7 17:24:26 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 281.7955005 63.3248056 --width 251 --height 251 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/PGC2653697-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/PGC2653697-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T17:24:28.002678 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '281.7955005', '63.3248056', '--width', '251', '--height', '251', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/PGC2653697-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/PGC2653697-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 281.7955005 63.3248056 --width 251 --height 251 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/PGC2653697-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/PGC2653697-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 281.7955005 63.3248056 Starting process 60280 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 60281 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 60282 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 60283 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T17:24:28.995195 Keeping 10 CCDs: k4m_171028_053418_ooi_zd_ls9.fits.fz k4m_171028_053418_ooi_zd_ls9-CCD2 z exptime 236.104 propid 2016A-0453 seeing 1.39 MJD 58054.232 object MzLS_695973_z k4m_160607_093858_ooi_zd_ls9.fits.fz k4m_160607_093858_ooi_zd_ls9-CCD2 z exptime 98.106 propid 2016A-0453 seeing 1.14 MJD 57546.402 object MzLS_696542_z k4m_180205_115551_ooi_zd_ls9.fits.fz k4m_180205_115551_ooi_zd_ls9-CCD2 z exptime 156.103 propid 2016A-0453 seeing 1.06 MJD 58154.497 object MzLS_695973_z k4m_170929_061711_ooi_zd_ls9.fits.fz k4m_170929_061711_ooi_zd_ls9-CCD1 z exptime 250.102 propid 2016A-0453 seeing 1.54 MJD 58025.262 object MzLS_697107_z ksb_170624_104927_ooi_r_ls9.fits.fz ksb_170624_104927_ooi_r_ls9-CCD2 r exptime 122.804 propid BASS seeing 1.24 MJD 57928.451 object 41513 ksb_160712_091947_ooi_g_ls9.fits.fz ksb_160712_091947_ooi_g_ls9-CCD1 g exptime 139.1 propid BASS seeing 1.61 MJD 57581.389 object 40622 ksb_180519_074537_ooi_r_ls9.fits.fz ksb_180519_074537_ooi_r_ls9-CCD1 r exptime 84.206 propid NOTBASS seeing 1.16 MJD 58257.323 object 40622 ksb_170619_095852_ooi_r_ls9.fits.fz ksb_170619_095852_ooi_r_ls9-CCD1 r exptime 205.065 propid BASS seeing 1.80 MJD 57923.416 object 40621 ksb_180519_095245_ooi_g_ls9.fits.fz ksb_180519_095245_ooi_g_ls9-CCD1 g exptime 114.03 propid NOTBASS seeing 1.30 MJD 58257.412 object 40621 ksb_170622_074055_ooi_g_ls9.fits.fz ksb_170622_074055_ooi_g_ls9-CCD2 g exptime 171.234 propid 2015A-0801 seeing 1.47 MJD 57926.320 object 41513 mosaic get_fwhm: self.fwhm = 5.95 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2287 2541 and amp range 2006 4053 and image y 3801 4054 and amp range 2040 4078 Range in image: x 0 255 , y 0 254 (with image size 255 x 254) dzp 0.0036595785 -> scaling image by 1.003376283213225 mosaic get_fwhm: self.fwhm = 4.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 709 964 and amp range 0 2047 and image y 922 1177 and amp range 0 2039 Range in image: x 0 256 , y 0 256 (with image size 256 x 256) dzp -0.006320339 -> scaling image by 0.9941956631368829 mosaic get_fwhm: self.fwhm = 4.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3414 3675 and amp range 2048 4095 and image y 1434 1692 and amp range 0 2039 Range in image: x 0 262 , y 0 259 (with image size 262 x 259) dzp -0.012875672 -> scaling image by 0.9882111074411305 mosaic get_fwhm: self.fwhm = 5.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3436 3697 and amp range 2048 4095 and image y 1420 1679 and amp range 0 2039 Range in image: x 0 262 , y 0 260 (with image size 262 x 260) dzp -0.012875672 -> scaling image by 0.9882111074411305 Faked up EXPNUM 79280174 Faked up EXPNUM 79280174 Faked up EXPNUM 79280174 90prime get_fwhm: self.fwhm = 2.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3219 3366 and amp range 2016 4031 and image y 2962 3110 and amp range 2048 4095 Range in image: x 0 148 , y 0 149 (with image size 148 x 149) dzp 0.021366077 -> scaling image by 1.0198737893800265 Faked up EXPNUM 82570128 Faked up EXPNUM 82570128 Faked up EXPNUM 82570128 90prime get_fwhm: self.fwhm = 2.57 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3419 3566 and amp range 2016 4031 and image y 3440 3587 and amp range 2048 4095 Range in image: x 0 148 , y 0 148 (with image size 148 x 148) dzp 0.015744466 -> scaling image by 1.0146068417155982 Faked up EXPNUM 75810135 Faked up EXPNUM 75810135 Faked up EXPNUM 75810135 90prime get_fwhm: self.fwhm = 3.55 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3423 3570 and amp range 2016 4031 and image y 3408 3555 and amp range 2048 4095 Range in image: x 0 148 , y 0 148 (with image size 148 x 148) dzp 0.009677861 -> scaling image by 1.0089534840651213 Faked up EXPNUM 79230141 Faked up EXPNUM 79230141 Faked up EXPNUM 79230141 90prime get_fwhm: self.fwhm = 3.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1439 1589 and amp range 0 2015 and image y 1446 1595 and amp range 0 2047 Range in image: x 0 151 , y 0 150 (with image size 151 x 150) dzp -0.024106435 -> scaling image by 0.9780418215011345 Faked up EXPNUM 82570185 Faked up EXPNUM 82570185 Faked up EXPNUM 82570185 90prime get_fwhm: self.fwhm = 2.87 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1393 1542 and amp range 0 2015 and image y 1471 1620 and amp range 0 2047 Range in image: x 0 150 , y 0 150 (with image size 150 x 150) dzp -0.030770088 -> scaling image by 0.9720575212609548 Faked up EXPNUM 79260096 Faked up EXPNUM 79260096 Faked up EXPNUM 79260096 90prime get_fwhm: self.fwhm = 3.25 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3222 3370 and amp range 2016 4031 and image y 2955 3103 and amp range 2048 4095 Range in image: x 0 149 , y 0 149 (with image size 149 x 149) dzp 0.010008041 -> scaling image by 1.0092603604948323 Stage tims : Wall: 7.76 s, CPU: 1.25 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 172 MB, VmData: 205 MB, maxrss: 0.566608 MB Stage tims finished: 2020-06-07T17:24:36.756025 Resources for stage tims : 3.648 s worker CPU, 14.247 s worker Wall, Wall: 7.762 s, Cores in use: 0.63, Total efficiency (on 4 cores): 15.8 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/PGC2653697-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/PGC2653697-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T17:24:37.457785 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00668.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00743.fits Matched 2 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/metrics/cus/reference-custom-281795p63324.fits Stage refs : Wall: 5.71 s, CPU: 4.64 s, VmPeak: 992 MB, VmSize: 986 MB, VmRSS: 218 MB, VmData: 249 MB, maxrss: 0.566608 MB Stage refs finished: 2020-06-07T17:24:43.164797 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.708 s, Cores in use: 0.81, Total efficiency (on 4 cores): 20.3 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T17:24:43.166341 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/metrics/cus/outlier-mask-custom-281795p63324.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/metrics/cus/outliers-pre-custom-281795p63324.jpg Image ksb_170619_095852_ooi_r_ls9-CCD1 r : masking 838 positive outlier pixels and 0 negative outlier pixels Image k4m_171028_053418_ooi_zd_ls9-CCD2 z : masking 204 positive outlier pixels and 0 negative outlier pixels Image k4m_170929_061711_ooi_zd_ls9-CCD1 z : masking 3674 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/metrics/cus/outlier-mask-custom-281795p63324.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/metrics/cus/outliers-post-custom-281795p63324.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/metrics/cus/outliers-masked-pos-custom-281795p63324.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/metrics/cus/outliers-masked-neg-custom-281795p63324.jpg Stage outliers : Wall: 0.98 s, CPU: 0.70 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 230 MB, VmData: 261 MB, maxrss: 0.566608 MB Stage outliers finished: 2020-06-07T17:24:44.150910 Resources for stage outliers : 1.035 s worker CPU, 1.091 s worker Wall, Wall: 0.986 s, Cores in use: 1.76, Total efficiency (on 4 cores): 44.0 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T17:24:44.152822 Stage halos : Wall: 0.34 s, CPU: 0.33 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 231 MB, VmData: 261 MB, maxrss: 0.566608 MB Stage halos finished: 2020-06-07T17:24:44.493327 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.342 s, Cores in use: 0.96, Total efficiency (on 4 cores): 24.1 % Stage halos finished Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-06-07T17:24:44.495173 PSF sigmas in coadd pixels: ['2.61', '2.11', '2.39'] Using average PSF sigma 2.3718410903663325 Gaussian PSF norm 0.11893494590327232 vs pixelized 0.09818667 average tim pixel scale / coadd scale: 1.72926633768068 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.01', '1.89', '2.92'] Using average PSF sigma 2.273473499758093 Gaussian PSF norm 0.12408096764879566 vs pixelized 0.10579696 average tim pixel scale / coadd scale: 1.7291385696433086 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.27', '1.85', '1.73', '2.51'] Using average PSF sigma 2.0876477688552404 Gaussian PSF norm 0.13512566438761103 vs pixelized 0.10839122 average tim pixel scale / coadd scale: 0.9911048138524825 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.22 s, CPU: 0.19 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 232 MB, VmData: 261 MB, maxrss: 0.566608 MB Stage fit_on_coadds finished: 2020-06-07T17:24:44.714968 Resources for stage fit_on_coadds : 0.238 s worker CPU, 0.239 s worker Wall, Wall: 0.221 s, Cores in use: 1.95, Total efficiency (on 4 cores): 48.8 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T17:24:44.717926 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 26 potential peaks Of 26 potential peaks: 5 in veto map, 2 cut by saddle test, 0 cut by aper test, 19 kept SED z : 19 new peaks Found 23 potential peaks Of 23 potential peaks: 20 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 20 potential peaks Of 20 potential peaks: 14 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 29 potential peaks Of 29 potential peaks: 25 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED Flat : 0 new peaks Found 27 potential peaks Of 27 potential peaks: 25 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 21 new sources Median coadd sky for g : 0.00010891516 Median coadd sky for r : -5.952514e-05 Median coadd sky for z : 4.5404704e-05 Stage srcs : Wall: 0.86 s, CPU: 0.78 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 232 MB, VmData: 261 MB, maxrss: 0.566608 MB Stage srcs finished: 2020-06-07T17:24:45.574273 Resources for stage srcs : 0.121 s worker CPU, 0.121 s worker Wall, Wall: 0.857 s, Cores in use: 1.05, Total efficiency (on 4 cores): 26.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/PGC2653697-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/PGC2653697-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T17:24:45.591890 Blob 1 of 12, id: 0, sources: 5, size: 133x171, npix 12740, brick X: 55,188, Y: 0,171, one pixel: 99 0 Blob 2 of 12, id: 9, sources: 6, size: 139x77, npix 5637, brick X: 96,235, Y: 160,237, one pixel: 224 160 Blob 3 of 12, id: 10, sources: 3, size: 69x38, npix 1384, brick X: 7,76, Y: 188,226, one pixel: 66 188 Blob 4 of 12, id: 1, sources: 2, size: 42x46, npix 1242, brick X: 183,225, Y: 36,82, one pixel: 192 36 Blob 5 of 12, id: 6, sources: 2, size: 24x60, npix 1134, brick X: 227,251, Y: 92,152, one pixel: 241 92 Blob 4 finished, total: Wall: 1.44 s, CPU: 1.44 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141476 MB Blob 6 of 12, id: 11, sources: 1, size: 38x28, npix 743, brick X: 62,100, Y: 223,251, one pixel: 76 223 Blob 3 finished, total: Wall: 2.83 s, CPU: 2.83 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144108 MB Blob 7 of 12, id: 4, sources: 2, size: 34x36, npix 723, brick X: 37,71, Y: 56,92, one pixel: 51 56 Measuring 1 iterative sources Blob 6 finished, total: Wall: 0.63 s, CPU: 0.63 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144344 MB Blob 8 of 12, id: 7, sources: 1, size: 27x28, npix 507, brick X: 194,221, Y: 119,147, one pixel: 206 119 Blob 5 finished, total: Wall: 2.50 s, CPU: 2.50 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141592 MB Blob 9 of 12, id: 3, sources: 1, size: 26x27, npix 465, brick X: 0,26, Y: 54,81, one pixel: 10 54 Blob 2 finished, total: Wall: 4.11 s, CPU: 4.11 s, VmPeak: 808 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.143944 MB Blob 10 of 12, id: 2, sources: 1, size: 26x26, npix 427, brick X: 23,49, Y: 38,64, one pixel: 36 38 Blob 8 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141592 MB Blob 11 of 12, id: 8, sources: 1, size: 22x22, npix 303, brick X: 23,45, Y: 158,180, one pixel: 32 158 Blob 12 of 12, id: 5, sources: 1, size: 21x21, npix 250, brick X: 171,192, Y: 87,108, one pixel: 180 87 Blob 7 finished, total: Wall: 1.30 s, CPU: 1.30 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144344 MB Blob 9 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 808 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.14422 MB Blob 10 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141592 MB Blob 12 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 808 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.14422 MB Blob 11 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144344 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.36051, ee1=-0.0089762, ee2=-0.114968 Blob 1 finished, total: Wall: 5.61 s, CPU: 5.58 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 142 MB, VmData: 178 MB, maxrss: 0.145352 MB Old catalog: 30 New catalog: 27 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/metrics/cus/blobs-custom-281795p63324.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/metrics/cus/all-models-custom-281795p63324.fits Stage fitblobs : Wall: 6.90 s, CPU: 0.93 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 233 MB, VmData: 261 MB, maxrss: 0.566608 MB Stage fitblobs finished: 2020-06-07T17:24:52.490542 Resources for stage fitblobs : 21.014 s worker CPU, 21.135 s worker Wall, Wall: 6.900 s, Cores in use: 3.18, Total efficiency (on 4 cores): 79.5 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T17:24:52.492533 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/tmp-legacysurvey-custom-281795p63324-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/tmp-legacysurvey-custom-281795p63324-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/tmp-legacysurvey-custom-281795p63324-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/tmp-legacysurvey-custom-281795p63324-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-resid.jpg Stage coadds : Wall: 1.58 s, CPU: 0.80 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 233 MB, VmData: 261 MB, maxrss: 0.566608 MB Stage coadds finished: 2020-06-07T17:24:54.075673 Resources for stage coadds : 2.064 s worker CPU, 2.249 s worker Wall, Wall: 1.584 s, Cores in use: 1.81, Total efficiency (on 4 cores): 45.2 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T17:24:54.077450 Cut to 1 unWISE tiles Reading WISE tile 2807p636 band 3 Reading WISE tile 2807p636 band 4 Reading WISE tile 2807p636 band 2 Reading WISE tile 2807p636 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/280/2807p636/unwise-2807p636-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/280/2807p636/unwise-2807p636-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/280/2807p636/unwise-2807p636-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/280/2807p636/unwise-2807p636-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/280/2807p636/unwise-2807p636-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 807 MB, VmSize: 795 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.188432 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/280/2807p636/unwise-2807p636-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/280/2807p636/unwise-2807p636-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/280/2807p636/unwise-2807p636-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/280/2807p636/unwise-2807p636-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/280/2807p636/unwise-2807p636-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 809 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.207892 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/280/2807p636/unwise-2807p636-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/280/2807p636/unwise-2807p636-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/280/2807p636/unwise-2807p636-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/280/2807p636/unwise-2807p636-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 808 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208816 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/280/2807p636/unwise-2807p636-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/280/2807p636/unwise-2807p636-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/280/2807p636/unwise-2807p636-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/280/2807p636/unwise-2807p636-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 807 MB, VmSize: 788 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.20466 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/tmp-legacysurvey-custom-281795p63324-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/tmp-legacysurvey-custom-281795p63324-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.21 s, CPU: 0.81 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 234 MB, VmData: 261 MB, maxrss: 0.566608 MB Stage wise_forced finished: 2020-06-07T17:24:57.287027 Resources for stage wise_forced : 5.169 s worker CPU, 6.936 s worker Wall, Wall: 3.211 s, Cores in use: 1.86, Total efficiency (on 4 cores): 46.6 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T17:24:57.289156 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/coadd/cus/custom-281795p63324/legacysurvey-custom-281795p63324-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/tractor-i/cus/tractor-custom-281795p63324.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/tractor/cus/tractor-custom-281795p63324.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/281/PGC2653697/tractor/cus/brick-custom-281795p63324.sha256sum Stage writecat : Wall: 1.39 s, CPU: 0.77 s, VmPeak: 1127 MB, VmSize: 999 MB, VmRSS: 236 MB, VmData: 261 MB, maxrss: 0.566608 MB Stage writecat finished: 2020-06-07T17:24:58.683568 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.396 s, Cores in use: 0.55, Total efficiency (on 4 cores): 13.8 % Stage writecat finished All done: 33.291 s worker CPU, 46.021 s worker Wall, Wall: 29.698 s, Cores in use: 1.50, Total efficiency (on 4 cores): 37.5 % Finished galaxy PGC2653697 in 0.546 minutes.