Started working on galaxy DR8-2780p470-2756 at Mon Jun 15 08:45:43 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.99602505023773 46.99025224927469 --width 115 --height 115 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/DR8-2780p470-2756-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/DR8-2780p470-2756-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-15T08:45:44.660790 legacypipe git version: DR9.5.2-29-gb5a6d7b1 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '277.99602505023773', '46.99025224927469', '--width', '115', '--height', '115', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/DR8-2780p470-2756-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/DR8-2780p470-2756-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.99602505023773 46.99025224927469 --width 115 --height 115 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/DR8-2780p470-2756-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/DR8-2780p470-2756-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 277.99602505023773 46.99025224927469 Starting process 45356 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Starting process 45357 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Starting process 45358 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB Starting process 45359 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB Starting process 45360 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB Starting process 45361 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057332 MB Starting process 45362 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057332 MB Starting process 45363 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057332 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-15T08:45:45.738123 Keeping 9 CCDs: k4m_160513_104112_ooi_zd_ls9.fits.fz k4m_160513_104112_ooi_zd_ls9-CCD3 z exptime 80.103 propid 2016A-0453 seeing 0.96 MJD 57521.445 object MzLS_637886_z k4m_170806_094544_ooi_zd_ls9.fits.fz k4m_170806_094544_ooi_zd_ls9-CCD1 z exptime 183.105 propid 2016A-0453 seeing 1.28 MJD 57971.407 object MzLS_637031_z k4m_160518_102334_ooi_zd_ls9.fits.fz k4m_160518_102334_ooi_zd_ls9-CCD4 z exptime 80.103 propid 2016A-0453 seeing 0.94 MJD 57526.433 object MzLS_636173_z ksb_180515_105859_ooi_g_ls9.fits.fz ksb_180515_105859_ooi_g_ls9-CCD4 g exptime 93.043 propid NOTBASS seeing 1.30 MJD 58253.458 object 23691 ksb_160611_104224_ooi_r_ls9.fits.fz ksb_160611_104224_ooi_r_ls9-CCD4 r exptime 67.5 propid BASS seeing 1.04 MJD 57550.446 object 23691 ksb_170624_102757_ooi_r_ls9.fits.fz ksb_170624_102757_ooi_r_ls9-CCD3 r exptime 91.7 propid BASS seeing 1.68 MJD 57928.436 object 23693 ksb_170621_072622_ooi_g_ls9.fits.fz ksb_170621_072622_ooi_g_ls9-CCD3 g exptime 133.2 propid BASS seeing 1.34 MJD 57925.310 object 23693 ksb_160704_090503_ooi_g_ls9.fits.fz ksb_160704_090503_ooi_g_ls9-CCD2 g exptime 94.9 propid BASS seeing 1.26 MJD 57573.379 object 23682 ksb_160605_101307_ooi_r_ls9.fits.fz ksb_160605_101307_ooi_r_ls9-CCD2 r exptime 55.8 propid BASS seeing 1.04 MJD 57544.426 object 23682 mosaic get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 828 946 and amp range 0 2005 and image y 2780 2899 and amp range 2040 4078 Range in image: x 0 119 , y 0 120 (with image size 119 x 120) dzp 0.0022078273 -> scaling image by 1.0020355530120029 mosaic get_fwhm: self.fwhm = 3.63 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1963 2080 and amp range 0 2047 and image y 989 1105 and amp range 0 2021 Range in image: x 0 85 , y 0 117 (with image size 118 x 117) dzp 0.005139143 -> scaling image by 1.0047445456970268 Found overlap: image x 1963 2080 and amp range 2048 4095 and image y 989 1105 and amp range 0 2021 Range in image: x 85 118 , y 0 117 (with image size 118 x 117) dzp -0.0006399284 -> scaling image by 0.9994107778325068 Faked up EXPNUM 79280166 Faked up EXPNUM 79280166 Faked up EXPNUM 79280166 90prime get_fwhm: self.fwhm = 3.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2184 2251 and amp range 2016 4031 and image y 1266 1333 and amp range 0 2047 Range in image: x 0 68 , y 0 68 (with image size 68 x 68) dzp -0.0023383768 -> scaling image by 0.9978485929508539 Faked up EXPNUM 79250043 Faked up EXPNUM 79250043 Faked up EXPNUM 79250043 90prime get_fwhm: self.fwhm = 2.95 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2185 2252 and amp range 2016 4031 and image y 1267 1334 and amp range 0 2047 Range in image: x 0 68 , y 0 68 (with image size 68 x 68) dzp -3.875605e-05 -> scaling image by 0.9999643049955675 mosaic get_fwhm: self.fwhm = 4.93 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3507 3623 and amp range 2006 4053 and image y 2460 2576 and amp range 2040 4078 Range in image: x 0 117 , y 0 117 (with image size 117 x 117) dzp 0.0036595785 -> scaling image by 1.003376283213225 Faked up EXPNUM 75730149 Faked up EXPNUM 75730149 Faked up EXPNUM 75730149 90prime get_fwhm: self.fwhm = 2.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1935 2003 and amp range 0 2015 and image y 1673 1741 and amp range 0 2047 Range in image: x 0 69 , y 0 69 (with image size 69 x 69) dzp -0.008523628 -> scaling image by 0.992180183483648 Faked up EXPNUM 82530174 Faked up EXPNUM 82530174 Faked up EXPNUM 82530174 90prime get_fwhm: self.fwhm = 2.87 Found 4 relevant rows in amp-corrections file. Found overlap: image x 15 76 and amp range 0 2015 and image y 3221 3288 and amp range 2048 4095 Range in image: x 0 62 , y 0 68 (with image size 62 x 68) dzp 0.027550658 -> scaling image by 1.0256997821704772 Faked up EXPNUM 75500179 Faked up EXPNUM 75500179 Faked up EXPNUM 75500179 90prime get_fwhm: self.fwhm = 2.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 15 70 and amp range 0 2015 and image y 3246 3313 and amp range 2048 4095 Range in image: x 0 56 , y 0 68 (with image size 56 x 68) dzp 0.004205519 -> scaling image by 1.0038809374310762 Faked up EXPNUM 75440176 Faked up EXPNUM 75440176 Faked up EXPNUM 75440176 90prime get_fwhm: self.fwhm = 2.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1927 1994 and amp range 0 2015 and image y 1685 1753 and amp range 0 2047 Range in image: x 0 68 , y 0 69 (with image size 68 x 69) dzp -0.006045583 -> scaling image by 0.9944472857505693 Stage tims : Wall: 2.99 s, CPU: 1.17 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 168 MB, VmData: 201 MB, maxrss: 0.262512 MB Stage tims finished: 2020-06-15T08:45:48.731325 Resources for stage tims : 3.819 s worker CPU, 9.952 s worker Wall, Wall: 2.994 s, Cores in use: 1.67, Total efficiency (on 8 cores): 20.9 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/DR8-2780p470-2756-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/DR8-2780p470-2756-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-15T08:45:48.762238 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01713.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01598.fits Matched 5 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/metrics/cus/reference-custom-277996p46990.fits Stage refs : Wall: 5.31 s, CPU: 5.03 s, VmPeak: 1009 MB, VmSize: 1003 MB, VmRSS: 231 MB, VmData: 263 MB, maxrss: 0.262512 MB Stage refs finished: 2020-06-15T08:45:54.068139 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.307 s, Cores in use: 0.95, Total efficiency (on 8 cores): 11.9 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/DR8-2780p470-2756-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/DR8-2780p470-2756-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-06-15T08:45:54.086012 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/metrics/cus/outlier-mask-custom-277996p46990.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/metrics/cus/outliers-pre-custom-277996p46990.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/metrics/cus/outlier-mask-custom-277996p46990.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/metrics/cus/outliers-post-custom-277996p46990.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/metrics/cus/outliers-masked-pos-custom-277996p46990.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/metrics/cus/outliers-masked-neg-custom-277996p46990.jpg Stage outliers : Wall: 0.74 s, CPU: 0.63 s, VmPeak: 1013 MB, VmSize: 1013 MB, VmRSS: 236 MB, VmData: 266 MB, maxrss: 0.262512 MB Stage outliers finished: 2020-06-15T08:45:54.821995 Resources for stage outliers : 0.148 s worker CPU, 0.148 s worker Wall, Wall: 0.737 s, Cores in use: 1.06, Total efficiency (on 8 cores): 13.3 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/DR8-2780p470-2756-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/DR8-2780p470-2756-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-06-15T08:45:54.846810 Stage halos : Wall: 0.40 s, CPU: 0.39 s, VmPeak: 1013 MB, VmSize: 1013 MB, VmRSS: 237 MB, VmData: 266 MB, maxrss: 0.262512 MB Stage halos finished: 2020-06-15T08:45:55.247066 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.401 s, Cores in use: 0.99, Total efficiency (on 8 cores): 12.3 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/DR8-2780p470-2756-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/DR8-2780p470-2756-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-06-15T08:45:55.270431 PSF sigmas in coadd pixels: ['2.11', '2.17', '2.04'] Using average PSF sigma 2.107423611845343 Gaussian PSF norm 0.13385765927091653 vs pixelized 0.10531932 average tim pixel scale / coadd scale: 1.7296163834460818 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.69', '2.73', '1.68'] Using average PSF sigma 2.0333366630844742 Gaussian PSF norm 0.1387349163054749 vs pixelized 0.13375683 average tim pixel scale / coadd scale: 1.7292484088324522 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.56', '2.08', '1.53'] Using average PSF sigma 1.7219179027791693 Gaussian PSF norm 0.16382592417360792 vs pixelized 0.13500237 average tim pixel scale / coadd scale: 0.9909675648535481 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.12 s, CPU: 0.06 s, VmPeak: 1013 MB, VmSize: 1013 MB, VmRSS: 238 MB, VmData: 266 MB, maxrss: 0.262512 MB Stage fit_on_coadds finished: 2020-06-15T08:45:55.387601 Resources for stage fit_on_coadds : 0.032 s worker CPU, 0.032 s worker Wall, Wall: 0.118 s, Cores in use: 0.77, Total efficiency (on 8 cores): 9.7 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/DR8-2780p470-2756-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/DR8-2780p470-2756-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-06-15T08:45:55.402565 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 7 potential peaks Of 7 potential peaks: 2 in veto map, 1 cut by saddle test, 0 cut by aper test, 4 kept SED z : 4 new peaks Found 5 potential peaks Of 5 potential peaks: 5 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 4 potential peaks Of 4 potential peaks: 4 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 6 potential peaks Of 6 potential peaks: 6 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED Flat : 0 new peaks Found 7 potential peaks Of 7 potential peaks: 6 in veto map, 0 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 5 new sources Median coadd sky for g : 5.555015e-05 Median coadd sky for r : -1.555645e-05 Median coadd sky for z : 0.00018629967 Stage srcs : Wall: 0.49 s, CPU: 0.47 s, VmPeak: 1013 MB, VmSize: 1013 MB, VmRSS: 239 MB, VmData: 266 MB, maxrss: 0.262512 MB Stage srcs finished: 2020-06-15T08:45:55.895272 Resources for stage srcs : 0.026 s worker CPU, 0.026 s worker Wall, Wall: 0.494 s, Cores in use: 1.02, Total efficiency (on 8 cores): 12.7 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/DR8-2780p470-2756-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/DR8-2780p470-2756-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-15T08:45:55.907113 Blob 1 of 4, id: 0, sources: 4, size: 70x104, npix 4343, brick X: 27,97, Y: 11,115, one pixel: 41 11 Blob 2 of 4, id: 2, sources: 1, size: 23x30, npix 550, brick X: 0,23, Y: 85,115, one pixel: 4 85 Blob 3 of 4, id: 3, sources: 1, size: 24x21, npix 331, brick X: 77,101, Y: 94,115, one pixel: 87 94 Blob 4 of 4, id: 1, sources: 1, size: 19x18, npix 189, brick X: 94,113, Y: 23,41, one pixel: 103 23 Blob 4 finished, total: Wall: 0.14 s, CPU: 0.14 s, VmPeak: 799 MB, VmSize: 712 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141404 MB Blob 3 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 796 MB, VmSize: 712 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141296 MB Blob 2 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 806 MB, VmSize: 712 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141772 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.0453607, ee1=0.0993986, ee2=0.215687 Blob 1 finished, total: Wall: 3.61 s, CPU: 3.61 s, VmPeak: 795 MB, VmSize: 712 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.14272 MB Old catalog: 14 New catalog: 7 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/metrics/cus/blobs-custom-277996p46990.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/metrics/cus/all-models-custom-277996p46990.fits Stage fitblobs : Wall: 4.19 s, CPU: 0.45 s, VmPeak: 1013 MB, VmSize: 1013 MB, VmRSS: 239 MB, VmData: 266 MB, maxrss: 0.262512 MB Stage fitblobs finished: 2020-06-15T08:46:00.093738 Resources for stage fitblobs : 4.650 s worker CPU, 4.670 s worker Wall, Wall: 4.188 s, Cores in use: 1.22, Total efficiency (on 8 cores): 15.2 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/DR8-2780p470-2756-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/DR8-2780p470-2756-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-06-15T08:46:00.110000 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/tmp-legacysurvey-custom-277996p46990-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/tmp-legacysurvey-custom-277996p46990-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/tmp-legacysurvey-custom-277996p46990-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/tmp-legacysurvey-custom-277996p46990-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-resid.jpg Stage coadds : Wall: 1.45 s, CPU: 0.62 s, VmPeak: 1013 MB, VmSize: 1013 MB, VmRSS: 239 MB, VmData: 266 MB, maxrss: 0.262512 MB Stage coadds finished: 2020-06-15T08:46:01.555827 Resources for stage coadds : 1.759 s worker CPU, 2.635 s worker Wall, Wall: 1.447 s, Cores in use: 1.64, Total efficiency (on 8 cores): 20.6 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/DR8-2780p470-2756-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/DR8-2780p470-2756-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-06-15T08:46:01.570529 Cut to 1 unWISE tiles Reading WISE tile 2770p469 band 1 Reading WISE tile 2770p469 band 3 Reading WISE tile 2770p469 band 2 Reading WISE tile 2770p469 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 797 MB, VmSize: 789 MB, VmRSS: 142 MB, VmData: 175 MB, maxrss: 0.183124 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 795 MB, VmSize: 788 MB, VmRSS: 140 MB, VmData: 169 MB, maxrss: 0.203596 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 793 MB, VmSize: 783 MB, VmRSS: 135 MB, VmData: 169 MB, maxrss: 0.197516 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 799 MB, VmSize: 783 MB, VmRSS: 135 MB, VmData: 169 MB, maxrss: 0.197744 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/tmp-legacysurvey-custom-277996p46990-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/tmp-legacysurvey-custom-277996p46990-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 1.77 s, CPU: 0.58 s, VmPeak: 1013 MB, VmSize: 1013 MB, VmRSS: 240 MB, VmData: 266 MB, maxrss: 0.262512 MB Stage wise_forced finished: 2020-06-15T08:46:03.337070 Resources for stage wise_forced : 3.004 s worker CPU, 3.445 s worker Wall, Wall: 1.768 s, Cores in use: 2.03, Total efficiency (on 8 cores): 25.4 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/DR8-2780p470-2756-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/DR8-2780p470-2756-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-06-15T08:46:03.351727 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/coadd/cus/custom-277996p46990/legacysurvey-custom-277996p46990-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/tractor-i/cus/tractor-custom-277996p46990.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/tractor/cus/tractor-custom-277996p46990.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/tractor/cus/brick-custom-277996p46990.sha256sum Stage writecat : Wall: 0.83 s, CPU: 0.59 s, VmPeak: 1145 MB, VmSize: 1017 MB, VmRSS: 242 MB, VmData: 266 MB, maxrss: 0.378824 MB Stage writecat finished: 2020-06-15T08:46:04.185870 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.835 s, Cores in use: 0.70, Total efficiency (on 8 cores): 8.8 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/DR8-2780p470-2756-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/DR8-2780p470-2756/DR8-2780p470-2756-largegalaxy-writecat.p All done: 13.440 s worker CPU, 20.912 s worker Wall, Wall: 18.481 s, Cores in use: 1.27, Total efficiency (on 8 cores): 15.9 % Finished galaxy DR8-2780p470-2756 in 0.349 minutes.