Started working on galaxy PGC2248830 at Sun Jun 7 20:22:39 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.229735 44.643299 --width 239 --height 239 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/PGC2248830-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/PGC2248830-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T20:22:40.317707 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.229735', '44.643299', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/PGC2248830-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/PGC2248830-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.229735 44.643299 --width 239 --height 239 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/PGC2248830-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/PGC2248830-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 272.229735 44.643299 Starting process 2395 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Starting process 2396 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Starting process 2397 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Starting process 2398 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T20:22:40.612629 Keeping 9 CCDs: k4m_170529_111838_ooi_zd_ls9.fits.fz k4m_170529_111838_ooi_zd_ls9-CCD1 z exptime 80.105 propid 2016A-0453 seeing 0.85 MJD 57902.471 object MzLS_626528_z k4m_160511_101659_ooi_zd_ls9.fits.fz k4m_160511_101659_ooi_zd_ls9-CCD2 z exptime 80.103 propid 2016A-0453 seeing 0.94 MJD 57519.428 object MzLS_625633_z k4m_160504_102602_ooi_zd_ls9.fits.fz k4m_160504_102602_ooi_zd_ls9-CCD1 z exptime 80.103 propid 2016A-0453 seeing 0.99 MJD 57512.435 object MzLS_627419_z ksb_180518_101107_ooi_r_ls9.fits.fz ksb_180518_101107_ooi_r_ls9-CCD2 r exptime 80.725 propid NOTBASS seeing 1.38 MJD 58256.424 object 21213 ksb_170621_055643_ooi_g_ls9.fits.fz ksb_170621_055643_ooi_g_ls9-CCD2 g exptime 129.208 propid BASS seeing 1.32 MJD 57925.248 object 21213 ksb_160605_092305_ooi_r_ls9.fits.fz ksb_160605_092305_ooi_r_ls9-CCD1 r exptime 136.9 propid BASS seeing 1.94 MJD 57544.391 object 19972 ksb_160704_082116_ooi_g_ls9.fits.fz ksb_160704_082116_ooi_g_ls9-CCD1 g exptime 97.9 propid BASS seeing 1.49 MJD 57573.348 object 19972 ksb_160603_084546_ooi_g_ls9.fits.fz ksb_160603_084546_ooi_g_ls9-CCD2 g exptime 85.8 propid BASS seeing 1.30 MJD 57542.365 object 21211 ksb_160604_081730_ooi_r_ls9.fits.fz ksb_160604_081730_ooi_r_ls9-CCD2 r exptime 52.2 propid BASS seeing 1.14 MJD 57543.345 object 21211 mosaic get_fwhm: self.fwhm = 3.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 742 987 and amp range 0 2005 and image y 2149 2393 and amp range 2040 4078 Range in image: x 0 246 , y 0 245 (with image size 246 x 245) dzp -0.005990375 -> scaling image by 0.994497853444703 Faked up EXPNUM 82560190 Faked up EXPNUM 82560190 Faked up EXPNUM 82560190 90prime get_fwhm: self.fwhm = 3.05 Found 4 relevant rows in amp-corrections file. Found overlap: image x 665 805 and amp range 0 2015 and image y 1915 2056 and amp range 0 2047 Range in image: x 0 141 , y 0 133 (with image size 141 x 142) dzp -0.003875085 -> scaling image by 0.9964372765054066 Found overlap: image x 665 805 and amp range 0 2015 and image y 1915 2056 and amp range 2048 4095 Range in image: x 0 141 , y 133 142 (with image size 141 x 142) dzp 0.0503617 -> scaling image by 1.047477444828492 mosaic get_fwhm: self.fwhm = 3.61 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1870 2112 and amp range 0 2047 and image y 2699 2941 and amp range 2040 4078 Range in image: x 0 178 , y 0 243 (with image size 243 x 243) dzp 0.008550294 -> scaling image by 1.0079062018164673 Found overlap: image x 1870 2112 and amp range 2048 4095 and image y 2699 2941 and amp range 2040 4078 Range in image: x 178 243 , y 0 243 (with image size 243 x 243) dzp -0.009154885 -> scaling image by 0.9916034885139223 mosaic get_fwhm: self.fwhm = 3.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3423 3664 and amp range 2006 4053 and image y 3741 3981 and amp range 2040 4078 Range in image: x 0 242 , y 0 241 (with image size 242 x 241) dzp 0.012593497 -> scaling image by 1.0116665687010755 Faked up EXPNUM 79250020 Faked up EXPNUM 79250020 Faked up EXPNUM 79250020 90prime get_fwhm: self.fwhm = 2.91 Found 4 relevant rows in amp-corrections file. Found overlap: image x 676 816 and amp range 0 2015 and image y 1910 2050 and amp range 0 2047 Range in image: x 0 141 , y 0 138 (with image size 141 x 141) dzp 0.0003063402 -> scaling image by 1.0002821895558327 Found overlap: image x 676 816 and amp range 0 2015 and image y 1910 2050 and amp range 2048 4095 Range in image: x 0 141 , y 138 141 (with image size 141 x 141) dzp 0.051889952 -> scaling image by 1.0489528829333021 Faked up EXPNUM 75420124 Faked up EXPNUM 75420124 Faked up EXPNUM 75420124 90prime get_fwhm: self.fwhm = 2.87 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2665 2804 and amp range 2016 4031 and image y 3929 4068 and amp range 2048 4095 Range in image: x 0 140 , y 0 140 (with image size 140 x 140) dzp 0.0026774607 -> scaling image by 1.002469075566243 Faked up EXPNUM 75440156 Faked up EXPNUM 75440156 Faked up EXPNUM 75440156 90prime get_fwhm: self.fwhm = 4.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 870 1011 and amp range 0 2015 and image y 1958 2098 and amp range 0 2047 Range in image: x 0 142 , y 0 90 (with image size 142 x 141) dzp -0.01149955 -> scaling image by 0.9894644150522871 Found overlap: image x 870 1011 and amp range 0 2015 and image y 1958 2098 and amp range 2048 4095 Range in image: x 0 142 , y 90 141 (with image size 142 x 141) dzp -0.00015519658 -> scaling image by 0.9998570688798908 Faked up EXPNUM 75730133 Faked up EXPNUM 75730133 Faked up EXPNUM 75730133 90prime get_fwhm: self.fwhm = 3.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 881 1023 and amp range 0 2015 and image y 1943 2084 and amp range 0 2047 Range in image: x 0 143 , y 0 105 (with image size 143 x 142) dzp -0.011813398 -> scaling image by 0.989178436928226 Found overlap: image x 881 1023 and amp range 0 2015 and image y 1943 2084 and amp range 2048 4095 Range in image: x 0 143 , y 105 142 (with image size 143 x 142) dzp -0.0051191514 -> scaling image by 0.9952961850385206 Faked up EXPNUM 75430139 Faked up EXPNUM 75430139 Faked up EXPNUM 75430139 90prime get_fwhm: self.fwhm = 2.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2672 2812 and amp range 2016 4031 and image y 3951 4080 and amp range 2048 4095 Range in image: x 0 141 , y 0 130 (with image size 141 x 130) dzp 0.0002007609 -> scaling image by 1.0001849247187462 Stage tims : Wall: 4.01 s, CPU: 0.77 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 170 MB, VmData: 204 MB, maxrss: 0.566596 MB Stage tims finished: 2020-06-07T20:22:44.625980 Resources for stage tims : 3.193 s worker CPU, 10.464 s worker Wall, Wall: 4.014 s, Cores in use: 0.99, Total efficiency (on 4 cores): 24.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/PGC2248830-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/PGC2248830-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T20:22:44.985184 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01830.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01711.fits Matched 5 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/metrics/cus/reference-custom-272229p44643.fits Stage refs : Wall: 4.85 s, CPU: 4.57 s, VmPeak: 998 MB, VmSize: 992 MB, VmRSS: 223 MB, VmData: 254 MB, maxrss: 0.566596 MB Stage refs finished: 2020-06-07T20:22:49.835030 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.851 s, Cores in use: 0.94, Total efficiency (on 4 cores): 23.6 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T20:22:49.836646 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/metrics/cus/outlier-mask-custom-272229p44643.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/metrics/cus/outliers-pre-custom-272229p44643.jpg Image ksb_160704_082116_ooi_g_ls9-CCD1 g : masking 153 positive outlier pixels and 0 negative outlier pixels Image ksb_160605_092305_ooi_r_ls9-CCD1 r : masking 41 positive outlier pixels and 0 negative outlier pixels Image k4m_160511_101659_ooi_zd_ls9-CCD2 z : masking 1071 positive outlier pixels and 0 negative outlier pixels Image k4m_170529_111838_ooi_zd_ls9-CCD1 z : masking 391 positive outlier pixels and 0 negative outlier pixels Image k4m_160504_102602_ooi_zd_ls9-CCD1 z : masking 242 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/metrics/cus/outlier-mask-custom-272229p44643.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/metrics/cus/outliers-post-custom-272229p44643.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/metrics/cus/outliers-masked-pos-custom-272229p44643.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/metrics/cus/outliers-masked-neg-custom-272229p44643.jpg Stage outliers : Wall: 0.70 s, CPU: 0.47 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 235 MB, VmData: 264 MB, maxrss: 0.566596 MB Stage outliers finished: 2020-06-07T20:22:50.535788 Resources for stage outliers : 0.751 s worker CPU, 0.753 s worker Wall, Wall: 0.700 s, Cores in use: 1.74, Total efficiency (on 4 cores): 43.5 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T20:22:50.537506 Stage halos : Wall: 0.17 s, CPU: 0.16 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 235 MB, VmData: 264 MB, maxrss: 0.566596 MB Stage halos finished: 2020-06-07T20:22:50.708583 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.172 s, Cores in use: 0.96, Total efficiency (on 4 cores): 24.1 % Stage halos finished Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-06-07T20:22:50.710338 PSF sigmas in coadd pixels: ['2.14', '2.42', '2.11'] Using average PSF sigma 2.224303996041242 Gaussian PSF norm 0.126823847943421 vs pixelized 0.10580884 average tim pixel scale / coadd scale: 1.7289422187627157 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.25', '3.16', '1.85'] Using average PSF sigma 2.4160541459253637 Gaussian PSF norm 0.11675847259037074 vs pixelized 0.08569137 average tim pixel scale / coadd scale: 1.7293730443201334 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.38', '1.52', '1.61'] Using average PSF sigma 1.5025660566260834 Gaussian PSF norm 0.18774202340714663 vs pixelized 0.15738077 average tim pixel scale / coadd scale: 0.9909330734819571 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.18 s, CPU: 0.14 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 237 MB, VmData: 265 MB, maxrss: 0.566596 MB Stage fit_on_coadds finished: 2020-06-07T20:22:50.887887 Resources for stage fit_on_coadds : 0.166 s worker CPU, 0.167 s worker Wall, Wall: 0.179 s, Cores in use: 1.74, Total efficiency (on 4 cores): 43.6 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T20:22:50.890566 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 32 potential peaks Of 32 potential peaks: 12 in veto map, 4 cut by saddle test, 0 cut by aper test, 16 kept SED z : 16 new peaks Found 34 potential peaks Of 34 potential peaks: 30 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 29 potential peaks Of 29 potential peaks: 26 in veto map, 2 cut by saddle test, 1 cut by aper test, 0 kept SED g : 0 new peaks Found 52 potential peaks Of 52 potential peaks: 42 in veto map, 7 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 57 potential peaks Of 57 potential peaks: 51 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 21 new sources Median coadd sky for g : 0.000390131 Median coadd sky for r : 0.0009621635 Median coadd sky for z : -0.00012497032 Stage srcs : Wall: 0.42 s, CPU: 0.39 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 237 MB, VmData: 265 MB, maxrss: 0.566596 MB Stage srcs finished: 2020-06-07T20:22:51.311954 Resources for stage srcs : 0.092 s worker CPU, 0.100 s worker Wall, Wall: 0.422 s, Cores in use: 1.14, Total efficiency (on 4 cores): 28.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/PGC2248830-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/PGC2248830-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T20:22:51.325159 Blob 1 of 10, id: 4, sources: 14, size: 186x187, npix 19241, brick X: 38,224, Y: 30,217, one pixel: 139 30 Blob 2 of 10, id: 7, sources: 3, size: 46x56, npix 1655, brick X: 193,239, Y: 55,111, one pixel: 225 55 Blob 3 of 10, id: 1, sources: 2, size: 38x41, npix 942, brick X: 154,192, Y: 0,41, one pixel: 161 0 Blob 4 of 10, id: 8, sources: 1, size: 29x29, npix 655, brick X: 210,239, Y: 210,239, one pixel: 225 210 Blob 5 of 10, id: 6, sources: 1, size: 28x28, npix 486, brick X: 168,196, Y: 42,70, one pixel: 180 42 Blob 4 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 808 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141256 MB Blob 6 of 10, id: 9, sources: 1, size: 27x26, npix 454, brick X: 6,33, Y: 213,239, one pixel: 16 213 Blob 3 finished, total: Wall: 1.20 s, CPU: 1.20 s, VmPeak: 815 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142148 MB Blob 7 of 10, id: 2, sources: 1, size: 23x24, npix 350, brick X: 110,133, Y: 1,25, one pixel: 119 1 Blob 8 of 10, id: 0, sources: 1, size: 23x23, npix 314, brick X: 17,40, Y: 0,23, one pixel: 26 0 Blob 5 finished, total: Wall: 1.00 s, CPU: 1.00 s, VmPeak: 808 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.1416 MB Blob 9 of 10, id: 5, sources: 1, size: 19x18, npix 198, brick X: 5,24, Y: 36,54, one pixel: 13 36 Blob 6 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 815 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142148 MB Blob 10 of 10, id: 3, sources: 1, size: 17x17, npix 145, brick X: 62,79, Y: 2,19, one pixel: 70 2 Blob 7 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 808 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.1416 MB Blob 8 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 815 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142148 MB Blob 9 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 808 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.1416 MB Measuring 2 iterative sources Blob 10 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 815 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142148 MB Blob 2 finished, total: Wall: 2.98 s, CPU: 2.98 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141336 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.611855, ee1=0.0883483, ee2=-0.152029 Measuring 3 iterative sources Blob 1 finished, total: Wall: 12.27 s, CPU: 12.26 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 146 MB, VmData: 179 MB, maxrss: 0.149896 MB Old catalog: 35 New catalog: 29 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/metrics/cus/blobs-custom-272229p44643.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/metrics/cus/all-models-custom-272229p44643.fits Stage fitblobs : Wall: 12.56 s, CPU: 0.28 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 237 MB, VmData: 265 MB, maxrss: 0.566596 MB Stage fitblobs finished: 2020-06-07T20:23:03.890073 Resources for stage fitblobs : 20.677 s worker CPU, 20.700 s worker Wall, Wall: 12.566 s, Cores in use: 1.67, Total efficiency (on 4 cores): 41.7 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T20:23:03.892375 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/tmp-legacysurvey-custom-272229p44643-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/tmp-legacysurvey-custom-272229p44643-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/tmp-legacysurvey-custom-272229p44643-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/tmp-legacysurvey-custom-272229p44643-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-resid.jpg Stage coadds : Wall: 1.15 s, CPU: 0.48 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 238 MB, VmData: 265 MB, maxrss: 0.566596 MB Stage coadds finished: 2020-06-07T20:23:05.040625 Resources for stage coadds : 2.108 s worker CPU, 2.158 s worker Wall, Wall: 1.149 s, Cores in use: 2.25, Total efficiency (on 4 cores): 56.3 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T20:23:05.042360 Cut to 2 unWISE tiles Reading WISE tile 2725p439 band 1 Reading WISE tile 2725p439 band 2 Reading WISE tile 2725p439 band 3 Reading WISE tile 2725p439 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2725p439/unwise-2725p439-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2725p439/unwise-2725p439-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2725p439/unwise-2725p439-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2725p439/unwise-2725p439-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2725p439/unwise-2725p439-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2726p454 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2725p439/unwise-2725p439-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2725p439/unwise-2725p439-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2725p439/unwise-2725p439-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2725p439/unwise-2725p439-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2725p439/unwise-2725p439-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2726p454 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2725p439/unwise-2725p439-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2725p439/unwise-2725p439-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2725p439/unwise-2725p439-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2725p439/unwise-2725p439-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2726p454 band 2 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2725p439/unwise-2725p439-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2725p439/unwise-2725p439-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2725p439/unwise-2725p439-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2725p439/unwise-2725p439-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2726p454 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2726p454/unwise-2726p454-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2726p454/unwise-2726p454-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2726p454/unwise-2726p454-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2726p454/unwise-2726p454-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2726p454/unwise-2726p454-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 815 MB, VmSize: 797 MB, VmRSS: 149 MB, VmData: 178 MB, maxrss: 0.188672 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2726p454/unwise-2726p454-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2726p454/unwise-2726p454-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2726p454/unwise-2726p454-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2726p454/unwise-2726p454-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2726p454/unwise-2726p454-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 808 MB, VmSize: 792 MB, VmRSS: 146 MB, VmData: 173 MB, maxrss: 0.20462 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2726p454/unwise-2726p454-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2726p454/unwise-2726p454-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2726p454/unwise-2726p454-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2726p454/unwise-2726p454-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 806 MB, VmSize: 792 MB, VmRSS: 148 MB, VmData: 173 MB, maxrss: 0.213124 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2726p454/unwise-2726p454-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2726p454/unwise-2726p454-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2726p454/unwise-2726p454-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2726p454/unwise-2726p454-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 807 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208428 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/tmp-legacysurvey-custom-272229p44643-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/tmp-legacysurvey-custom-272229p44643-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.43 s, CPU: 0.36 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 238 MB, VmData: 265 MB, maxrss: 0.566596 MB Stage wise_forced finished: 2020-06-07T20:23:08.475338 Resources for stage wise_forced : 9.150 s worker CPU, 10.726 s worker Wall, Wall: 3.434 s, Cores in use: 2.77, Total efficiency (on 4 cores): 69.2 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T20:23:08.477065 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/coadd/cus/custom-272229p44643/legacysurvey-custom-272229p44643-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/tractor-i/cus/tractor-custom-272229p44643.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/tractor/cus/tractor-custom-272229p44643.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2248830/tractor/cus/brick-custom-272229p44643.sha256sum Stage writecat : Wall: 0.62 s, CPU: 0.42 s, VmPeak: 1133 MB, VmSize: 1005 MB, VmRSS: 240 MB, VmData: 265 MB, maxrss: 0.566596 MB Stage writecat finished: 2020-06-07T20:23:09.095379 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.619 s, Cores in use: 0.69, Total efficiency (on 4 cores): 17.2 % Stage writecat finished All done: 36.138 s worker CPU, 45.071 s worker Wall, Wall: 28.487 s, Cores in use: 1.55, Total efficiency (on 4 cores): 38.8 % Finished galaxy PGC2248830 in 0.514 minutes.