Started working on galaxy PGC2368721 at Mon Jun 15 08:01:58 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 282.823791 50.293944399999994 --width 245 --height 245 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/PGC2368721-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/PGC2368721-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-15T08:01:59.019853 legacypipe git version: DR9.5.2-29-gb5a6d7b1 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '282.823791', '50.293944399999994', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/PGC2368721-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/PGC2368721-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 282.823791 50.293944399999994 --width 245 --height 245 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/PGC2368721-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/PGC2368721-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 282.823791 50.293944399999994 Starting process 25539 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB Starting process 25540 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057324 MB Starting process 25541 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057324 MB Starting process 25542 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057324 MB Starting process 25543 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB Starting process 25544 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057332 MB Starting process 25545 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057332 MB Starting process 25546 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057332 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-15T08:01:59.659223 Keeping 9 CCDs: k4m_160518_105921_ooi_zd_ls9.fits.fz k4m_160518_105921_ooi_zd_ls9-CCD4 z exptime 80.105 propid 2016A-0453 seeing 0.97 MJD 57526.458 object MzLS_650334_z k4m_160525_101745_ooi_zd_ls9.fits.fz k4m_160525_101745_ooi_zd_ls9-CCD1 z exptime 103.103 propid 2016A-0453 seeing 1.31 MJD 57533.429 object MzLS_651138_z k4m_170910_065838_ooi_zd_ls9.fits.fz k4m_170910_065838_ooi_zd_ls9-CCD3 z exptime 183.103 propid 2016A-0453 seeing 1.08 MJD 58006.291 object MzLS_651938_z ksb_170405_121011_ooi_r_ls9.fits.fz ksb_170405_121011_ooi_r_ls9-CCD3 r exptime 205.035 propid BASS seeing 1.21 MJD 57848.507 object 27251 ksb_160704_092654_ooi_g_ls9.fits.fz ksb_160704_092654_ooi_g_ls9-CCD3 g exptime 103.4 propid BASS seeing 1.19 MJD 57573.394 object 27252 ksb_160712_071915_ooi_r_ls9.fits.fz ksb_160712_071915_ooi_r_ls9-CCD3 r exptime 99.8 propid BASS seeing 1.83 MJD 57581.305 object 27252 ksb_180510_094058_ooi_g_ls9.fits.fz ksb_180510_094058_ooi_g_ls9-CCD3 g exptime 107.619 propid NOTBASS seeing 1.35 MJD 58248.403 object 27251 ksb_160705_094252_ooi_g_ls9.fits.fz ksb_160705_094252_ooi_g_ls9-CCD2 g exptime 79.9 propid BASS seeing 1.27 MJD 57574.405 object 28393 ksb_170624_071328_ooi_r_ls9.fits.fz ksb_170624_071328_ooi_r_ls9-CCD2 r exptime 75.459 propid BASS seeing 1.17 MJD 57928.301 object 28393 mosaic get_fwhm: self.fwhm = 5.05 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3187 3434 and amp range 2006 4053 and image y 2261 2508 and amp range 2040 4078 Range in image: x 0 248 , y 0 248 (with image size 248 x 248) dzp -0.006092005 -> scaling image by 0.9944047680378836 Faked up EXPNUM 75730157 Faked up EXPNUM 75730157 Faked up EXPNUM 75730157 90prime get_fwhm: self.fwhm = 2.63 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3705 3847 and amp range 2016 4031 and image y 2560 2702 and amp range 2048 4095 Range in image: x 0 143 , y 0 143 (with image size 143 x 143) dzp -0.0012536051 -> scaling image by 0.9988460533227724 Faked up EXPNUM 78480199 Faked up EXPNUM 78480199 Faked up EXPNUM 78480199 90prime get_fwhm: self.fwhm = 2.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1713 1855 and amp range 0 2015 and image y 592 734 and amp range 0 2047 Range in image: x 0 143 , y 0 143 (with image size 143 x 143) dzp -0.043123975 -> scaling image by 0.961059796099719 mosaic get_fwhm: self.fwhm = 3.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1652 1904 and amp range 0 2047 and image y 3186 3437 and amp range 2022 4060 Range in image: x 0 253 , y 0 252 (with image size 253 x 252) dzp 0.0033053984 -> scaling image by 1.0030490232713904 mosaic get_fwhm: self.fwhm = 4.17 Found 4 relevant rows in amp-corrections file. Found overlap: image x 494 745 and amp range 0 2005 and image y 564 813 and amp range 0 2039 Range in image: x 0 252 , y 0 250 (with image size 252 x 250) dzp 0.0014252509 -> scaling image by 1.0013135665633692 Faked up EXPNUM 75740145 Faked up EXPNUM 75740145 Faked up EXPNUM 75740145 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3455 3599 and amp range 2016 4031 and image y 1442 1587 and amp range 0 2047 Range in image: x 0 145 , y 0 146 (with image size 145 x 146) dzp -0.008960029 -> scaling image by 0.9917814665476246 Faked up EXPNUM 82480162 Faked up EXPNUM 82480162 Faked up EXPNUM 82480162 90prime get_fwhm: self.fwhm = 2.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1726 1869 and amp range 0 2015 and image y 594 737 and amp range 0 2047 Range in image: x 0 144 , y 0 144 (with image size 144 x 144) dzp -0.03692675 -> scaling image by 0.9665610717922232 Faked up EXPNUM 75810094 Faked up EXPNUM 75810094 Faked up EXPNUM 75810094 90prime get_fwhm: self.fwhm = 4.03 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3707 3850 and amp range 2016 4031 and image y 2574 2717 and amp range 2048 4095 Range in image: x 0 144 , y 0 144 (with image size 144 x 144) dzp -0.0005558773 -> scaling image by 0.99948814914245 Faked up EXPNUM 79280096 Faked up EXPNUM 79280096 Faked up EXPNUM 79280096 90prime get_fwhm: self.fwhm = 2.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3443 3588 and amp range 2016 4031 and image y 1454 1599 and amp range 0 2047 Range in image: x 0 146 , y 0 146 (with image size 146 x 146) dzp 0.032776505 -> scaling image by 1.0306485625912574 Stage tims : Wall: 3.24 s, CPU: 0.89 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 171 MB, VmData: 204 MB, maxrss: 0.384164 MB Stage tims finished: 2020-06-15T08:02:02.894989 Resources for stage tims : 4.031 s worker CPU, 11.878 s worker Wall, Wall: 3.237 s, Cores in use: 1.52, Total efficiency (on 8 cores): 19.0 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/PGC2368721-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/PGC2368721-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-15T08:02:02.917191 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01488.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01489.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01381.fits Matched 7 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/metrics/cus/reference-custom-282823p50293.fits Stage refs : Wall: 6.55 s, CPU: 5.71 s, VmPeak: 1033 MB, VmSize: 1026 MB, VmRSS: 258 MB, VmData: 289 MB, maxrss: 0.384164 MB Stage refs finished: 2020-06-15T08:02:09.464302 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.548 s, Cores in use: 0.87, Total efficiency (on 8 cores): 10.9 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/PGC2368721-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/PGC2368721-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-06-15T08:02:09.537446 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/metrics/cus/outlier-mask-custom-282823p50293.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/metrics/cus/outliers-pre-custom-282823p50293.jpg Image ksb_170405_121011_ooi_r_ls9-CCD3 r : masking 91 positive outlier pixels and 0 negative outlier pixels Image k4m_160525_101745_ooi_zd_ls9-CCD1 z : masking 848 positive outlier pixels and 0 negative outlier pixels Image k4m_170910_065838_ooi_zd_ls9-CCD3 z : masking 1412 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/metrics/cus/outlier-mask-custom-282823p50293.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/metrics/cus/outliers-post-custom-282823p50293.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/metrics/cus/outliers-masked-pos-custom-282823p50293.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/metrics/cus/outliers-masked-neg-custom-282823p50293.jpg Stage outliers : Wall: 0.92 s, CPU: 0.65 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 271 MB, VmData: 301 MB, maxrss: 0.384164 MB Stage outliers finished: 2020-06-15T08:02:10.460723 Resources for stage outliers : 0.561 s worker CPU, 0.562 s worker Wall, Wall: 0.925 s, Cores in use: 1.31, Total efficiency (on 8 cores): 16.4 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/PGC2368721-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/PGC2368721-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-06-15T08:02:10.539066 Stage halos : Wall: 0.34 s, CPU: 0.33 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 272 MB, VmData: 301 MB, maxrss: 0.384164 MB Stage halos finished: 2020-06-15T08:02:10.876579 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.339 s, Cores in use: 0.98, Total efficiency (on 8 cores): 12.2 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/PGC2368721-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/PGC2368721-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-15T08:02:10.992425 PSF sigmas in coadd pixels: ['1.94', '2.19', '2.07'] Using average PSF sigma 2.063137332428917 Gaussian PSF norm 0.13673098118086494 vs pixelized 0.10503009 average tim pixel scale / coadd scale: 1.729480150859547 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.97', '2.96', '1.91'] Using average PSF sigma 2.2785868324331404 Gaussian PSF norm 0.12380251994726452 vs pixelized 0.11440264 average tim pixel scale / coadd scale: 1.729245809482709 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.57', '2.13', '1.76'] Using average PSF sigma 1.8202562116398446 Gaussian PSF norm 0.15497532158933972 vs pixelized 0.13930638 average tim pixel scale / coadd scale: 0.9909485362804288 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.17 s, CPU: 0.14 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 274 MB, VmData: 302 MB, maxrss: 0.384164 MB Stage fit_on_coadds finished: 2020-06-15T08:02:11.164816 Resources for stage fit_on_coadds : 0.154 s worker CPU, 0.154 s worker Wall, Wall: 0.174 s, Cores in use: 1.70, Total efficiency (on 8 cores): 21.3 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/PGC2368721-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/PGC2368721-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-06-15T08:02:11.180729 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 37 potential peaks Of 37 potential peaks: 16 in veto map, 6 cut by saddle test, 0 cut by aper test, 15 kept SED z : 15 new peaks Found 51 potential peaks Of 51 potential peaks: 43 in veto map, 8 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 50 potential peaks Of 50 potential peaks: 40 in veto map, 8 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 64 potential peaks Of 64 potential peaks: 54 in veto map, 9 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 61 potential peaks Of 61 potential peaks: 49 in veto map, 10 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 20 new sources Median coadd sky for g : 0.0005345414 Median coadd sky for r : 0.0010939024 Median coadd sky for z : -0.00014533111 Stage srcs : Wall: 0.94 s, CPU: 0.90 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 274 MB, VmData: 302 MB, maxrss: 0.384164 MB Stage srcs finished: 2020-06-15T08:02:12.116856 Resources for stage srcs : 0.080 s worker CPU, 0.081 s worker Wall, Wall: 0.937 s, Cores in use: 1.05, Total efficiency (on 8 cores): 13.1 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/PGC2368721-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/PGC2368721-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-15T08:02:12.135302 Blob 1 of 5, id: 0, sources: 28, size: 215x245, npix 28793, brick X: 30,245, Y: 0,245, one pixel: 43 0 Blob 2 of 5, id: 1, sources: 2, size: 37x34, npix 751, brick X: 159,196, Y: 0,34, one pixel: 163 0 Blob 3 of 5, id: 3, sources: 1, size: 33x31, npix 673, brick X: 7,40, Y: 85,116, one pixel: 21 85 Blob 4 of 5, id: 2, sources: 1, size: 24x23, npix 340, brick X: 152,176, Y: 27,50, one pixel: 162 27 Blob 5 of 5, id: 4, sources: 1, size: 16x17, npix 144, brick X: 0,16, Y: 192,209, one pixel: 7 192 Blob 4 finished, total: Wall: 0.15 s, CPU: 0.15 s, VmPeak: 808 MB, VmSize: 712 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141512 MB Blob 5 finished, total: Wall: 0.15 s, CPU: 0.15 s, VmPeak: 793 MB, VmSize: 712 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141488 MB Blob 3 finished, total: Wall: 0.44 s, CPU: 0.44 s, VmPeak: 793 MB, VmSize: 712 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141368 MB Blob 2 finished, total: Wall: 0.67 s, CPU: 0.66 s, VmPeak: 798 MB, VmSize: 712 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141596 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (282.83233, 50.27927), pm (-1.7, 2.3), parallax 0.486 with NanoMaggies: g=13.6, r=12.7, z=12.3 Reset brightness to NanoMaggies: g=13.6, r=12.7, z=12.3 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (282.80970, 50.29222), pm (-12.4, -13.1), parallax 0.405 with NanoMaggies: g=16.4, r=15, z=18.6 Reset brightness to NanoMaggies: g=16.4, r=16, z=15.9 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (282.80816, 50.29546), pm (1.8, -8.1), parallax 0.612 with NanoMaggies: g=16.3, r=15.4, z=15.9 Reset brightness to NanoMaggies: g=17.1, r=16.5, z=16.3 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.210827, ee1=-0.0398592, ee2=0.0490406 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (282.80972, 50.29348), pm (1.1, 1.1), parallax 0.537 with NanoMaggies: g=20.8, r=19.4, z=18.4 Reset brightness to NanoMaggies: g=20.5, r=19.3, z=18.6 Measuring 14 iterative sources Blob 1 finished, total: Wall: 17.36 s, CPU: 17.34 s, VmPeak: 801 MB, VmSize: 725 MB, VmRSS: 159 MB, VmData: 191 MB, maxrss: 0.162552 MB Old catalog: 44 New catalog: 41 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/metrics/cus/blobs-custom-282823p50293.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/metrics/cus/all-models-custom-282823p50293.fits Stage fitblobs : Wall: 20.96 s, CPU: 0.39 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 276 MB, VmData: 302 MB, maxrss: 0.384164 MB Stage fitblobs finished: 2020-06-15T08:02:33.094797 Resources for stage fitblobs : 18.805 s worker CPU, 18.857 s worker Wall, Wall: 20.961 s, Cores in use: 0.92, Total efficiency (on 8 cores): 11.4 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/PGC2368721-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/PGC2368721-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-06-15T08:02:33.111128 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/tmp-legacysurvey-custom-282823p50293-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/tmp-legacysurvey-custom-282823p50293-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/tmp-legacysurvey-custom-282823p50293-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/tmp-legacysurvey-custom-282823p50293-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-resid.jpg Stage coadds : Wall: 1.52 s, CPU: 0.81 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 276 MB, VmData: 302 MB, maxrss: 0.384164 MB Stage coadds finished: 2020-06-15T08:02:34.630271 Resources for stage coadds : 2.374 s worker CPU, 2.802 s worker Wall, Wall: 1.520 s, Cores in use: 2.09, Total efficiency (on 8 cores): 26.2 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/PGC2368721-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/PGC2368721-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-06-15T08:02:36.662091 Cut to 1 unWISE tiles Reading WISE tile 2833p499 band 3 Reading WISE tile 2833p499 band 4 Reading WISE tile 2833p499 band 2 Reading WISE tile 2833p499 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 795 MB, VmSize: 790 MB, VmRSS: 143 MB, VmData: 176 MB, maxrss: 0.184492 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 801 MB, VmSize: 795 MB, VmRSS: 152 MB, VmData: 177 MB, maxrss: 0.216716 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 852 MB, VmSize: 852 MB, VmRSS: 204 MB, VmData: 234 MB, maxrss: 0.208644 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 798 MB, VmSize: 787 MB, VmRSS: 141 MB, VmData: 173 MB, maxrss: 0.20378 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/tmp-legacysurvey-custom-282823p50293-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/tmp-legacysurvey-custom-282823p50293-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 1.86 s, CPU: 0.51 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 277 MB, VmData: 302 MB, maxrss: 0.384164 MB Stage wise_forced finished: 2020-06-15T08:02:38.526138 Resources for stage wise_forced : 3.317 s worker CPU, 3.803 s worker Wall, Wall: 1.865 s, Cores in use: 2.05, Total efficiency (on 8 cores): 25.7 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/PGC2368721-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/PGC2368721-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-06-15T08:02:38.547960 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/coadd/cus/custom-282823p50293/legacysurvey-custom-282823p50293-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/tractor-i/cus/tractor-custom-282823p50293.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/tractor/cus/tractor-custom-282823p50293.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/tractor/cus/brick-custom-282823p50293.sha256sum Stage writecat : Wall: 0.95 s, CPU: 0.73 s, VmPeak: 1169 MB, VmSize: 1041 MB, VmRSS: 279 MB, VmData: 302 MB, maxrss: 0.416288 MB Stage writecat finished: 2020-06-15T08:02:39.501254 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.954 s, Cores in use: 0.77, Total efficiency (on 8 cores): 9.6 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/PGC2368721-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2368721/PGC2368721-largegalaxy-writecat.p All done: 29.325 s worker CPU, 38.142 s worker Wall, Wall: 39.883 s, Cores in use: 1.02, Total efficiency (on 8 cores): 12.7 % Finished galaxy PGC2368721 in 0.698 minutes.