Started working on galaxy PGC3129771 at Sun Jun 7 18:56:32 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 116.07767999999999 40.3609673 --width 275 --height 275 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/PGC3129771-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/PGC3129771-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T18:56:34.014155 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '116.07767999999999', '40.3609673', '--width', '275', '--height', '275', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/PGC3129771-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/PGC3129771-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 116.07767999999999 40.3609673 --width 275 --height 275 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/PGC3129771-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/PGC3129771-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 116.07767999999999 40.3609673 Starting process 39658 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057276 MB Starting process 39664 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 39676 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 39672 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T18:56:34.707699 Keeping 9 CCDs: k4m_160226_045719_ooi_zd_ls9.fits.fz k4m_160226_045719_ooi_zd_ls9-CCD1 z exptime 94.104 propid 2016A-0453 seeing 1.49 MJD 57444.206 object MzLS_605975_z k4m_160228_044653_ooi_zd_ls9.fits.fz k4m_160228_044653_ooi_zd_ls9-CCD2 z exptime 85.103 propid 2016A-0453 seeing 0.91 MJD 57446.199 object MzLS_605017_z k4m_170130_060329_ooi_zd_ls9.fits.fz k4m_170130_060329_ooi_zd_ls9-CCD3 z exptime 80.104 propid 2016A-0453 seeing 1.16 MJD 57783.252 object MzLS_606929_z ksb_160312_034452_ooi_r_ls9.fits.fz ksb_160312_034452_ooi_r_ls9-CCD3 r exptime 94.6 propid 2015A-0801 seeing 1.48 MJD 57459.156 object 13702 ksb_180115_080043_ooi_g_ls9.fits.fz ksb_180115_080043_ooi_g_ls9-CCD3 g exptime 89.194 propid BASS seeing 1.26 MJD 58133.334 object 13702 ksb_170320_033742_ooi_r_ls9.fits.fz ksb_170320_033742_ooi_r_ls9-CCD3 r exptime 93.363 propid BASS seeing 1.15 MJD 57832.151 object 13701 ksb_160211_044755_ooi_g_ls9.fits.fz ksb_160211_044755_ooi_g_ls9-CCD3 g exptime 108.2 propid 2015A-0801 seeing 1.21 MJD 57429.200 object 13701 ksb_170214_054032_ooi_r_ls9.fits.fz ksb_170214_054032_ooi_r_ls9-CCD2 r exptime 250.0 propid BASS seeing 1.54 MJD 57798.236 object 15013 ksb_180115_080250_ooi_g_ls9.fits.fz ksb_180115_080250_ooi_g_ls9-CCD2 g exptime 85.904 propid BASS seeing 1.07 MJD 58133.335 object 15013 mosaic get_fwhm: self.fwhm = 3.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2111 2392 and amp range 2048 4095 and image y 1328 1608 and amp range 0 2039 Range in image: x 0 282 , y 0 281 (with image size 282 x 281) dzp 0.0072022504 -> scaling image by 1.0066555682883527 mosaic get_fwhm: self.fwhm = 4.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 991 1270 and amp range 0 2005 and image y 67 343 and amp range 0 2039 Range in image: x 0 280 , y 0 277 (with image size 280 x 277) dzp 0.0013971253 -> scaling image by 1.0012876282438632 mosaic get_fwhm: self.fwhm = 5.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3685 3963 and amp range 2006 4053 and image y 654 936 and amp range 0 2039 Range in image: x 0 279 , y 0 283 (with image size 279 x 283) dzp 0.001388291 -> scaling image by 1.0012794811153327 Faked up EXPNUM 74590035 Faked up EXPNUM 74590035 Faked up EXPNUM 74590035 90prime get_fwhm: self.fwhm = 3.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3126 3287 and amp range 2016 4031 and image y 3036 3196 and amp range 2048 4095 Range in image: x 0 162 , y 0 161 (with image size 162 x 161) dzp -0.0005558773 -> scaling image by 0.99948814914245 Faked up EXPNUM 81330146 Faked up EXPNUM 81330146 Faked up EXPNUM 81330146 90prime get_fwhm: self.fwhm = 2.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3171 3330 and amp range 2016 4031 and image y 3029 3190 and amp range 2048 4095 Range in image: x 0 160 , y 0 162 (with image size 160 x 162) dzp -0.01723723 -> scaling image by 0.9842492857213068 Faked up EXPNUM 77980091 Faked up EXPNUM 77980091 Faked up EXPNUM 77980091 90prime get_fwhm: self.fwhm = 3.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2897 3058 and amp range 2016 4031 and image y 941 1103 and amp range 0 2047 Range in image: x 0 162 , y 0 163 (with image size 162 x 163) dzp 0.032776505 -> scaling image by 1.0306485625912574 Faked up EXPNUM 74290100 Faked up EXPNUM 74290100 Faked up EXPNUM 74290100 90prime get_fwhm: self.fwhm = 2.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1174 1334 and amp range 0 2015 and image y 1047 1207 and amp range 0 2047 Range in image: x 0 161 , y 0 161 (with image size 161 x 161) dzp -0.03470582 -> scaling image by 0.9685402452207784 Faked up EXPNUM 78320060 Faked up EXPNUM 78320060 Faked up EXPNUM 78320060 90prime get_fwhm: self.fwhm = 2.53 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1169 1329 and amp range 0 2015 and image y 1046 1206 and amp range 0 2047 Range in image: x 0 161 , y 0 161 (with image size 161 x 161) dzp -0.043123975 -> scaling image by 0.961059796099719 Faked up EXPNUM 81330147 Faked up EXPNUM 81330147 Faked up EXPNUM 81330147 90prime get_fwhm: self.fwhm = 2.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2923 3084 and amp range 2016 4031 and image y 962 1124 and amp range 0 2047 Range in image: x 0 162 , y 0 163 (with image size 162 x 163) dzp 0.009189803 -> scaling image by 1.0085000434534261 Stage tims : Wall: 6.66 s, CPU: 0.92 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 171 MB, VmData: 205 MB, maxrss: 0.566568 MB Stage tims finished: 2020-06-07T18:56:41.363923 Resources for stage tims : 3.311 s worker CPU, 15.359 s worker Wall, Wall: 6.657 s, Cores in use: 0.63, Total efficiency (on 4 cores): 15.9 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/PGC3129771-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/PGC3129771-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T18:56:41.383436 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02153.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02281.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02025.fits Matched 6 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/metrics/cus/reference-custom-116077p40360.fits Stage refs : Wall: 4.05 s, CPU: 2.49 s, VmPeak: 974 MB, VmSize: 969 MB, VmRSS: 199 MB, VmData: 232 MB, maxrss: 0.566568 MB Stage refs finished: 2020-06-07T18:56:45.429467 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.047 s, Cores in use: 0.62, Total efficiency (on 4 cores): 15.4 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T18:56:45.431200 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/metrics/cus/outlier-mask-custom-116077p40360.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/metrics/cus/outliers-pre-custom-116077p40360.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/metrics/cus/outlier-mask-custom-116077p40360.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/metrics/cus/outliers-post-custom-116077p40360.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/metrics/cus/outliers-masked-pos-custom-116077p40360.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/metrics/cus/outliers-masked-neg-custom-116077p40360.jpg Stage outliers : Wall: 1.73 s, CPU: 1.06 s, VmPeak: 978 MB, VmSize: 978 MB, VmRSS: 214 MB, VmData: 244 MB, maxrss: 0.566568 MB Stage outliers finished: 2020-06-07T18:56:47.159390 Resources for stage outliers : 1.431 s worker CPU, 1.437 s worker Wall, Wall: 1.729 s, Cores in use: 1.44, Total efficiency (on 4 cores): 36.0 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T18:56:47.161180 Stage halos : Wall: 0.34 s, CPU: 0.33 s, VmPeak: 978 MB, VmSize: 978 MB, VmRSS: 214 MB, VmData: 244 MB, maxrss: 0.566568 MB Stage halos finished: 2020-06-07T18:56:47.504348 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.344 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.2 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T18:56:47.506110 PSF sigmas in coadd pixels: ['2.04', '1.96', '1.75'] Using average PSF sigma 1.9165624662333605 Gaussian PSF norm 0.1471878932953758 vs pixelized 0.12985311 average tim pixel scale / coadd scale: 1.730084666299797 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.41', '1.86', '2.50'] Using average PSF sigma 2.254443568701617 Gaussian PSF norm 0.12512834461247688 vs pixelized 0.105591655 average tim pixel scale / coadd scale: 1.7294184996156405 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.42', '1.48', '1.88'] Using average PSF sigma 1.9268663281358138 Gaussian PSF norm 0.14640081029740995 vs pixelized 0.12134725 average tim pixel scale / coadd scale: 0.9908464618155178 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.43 s, CPU: 0.20 s, VmPeak: 978 MB, VmSize: 978 MB, VmRSS: 216 MB, VmData: 244 MB, maxrss: 0.566568 MB Stage fit_on_coadds finished: 2020-06-07T18:56:47.936666 Resources for stage fit_on_coadds : 0.482 s worker CPU, 0.505 s worker Wall, Wall: 0.432 s, Cores in use: 1.59, Total efficiency (on 4 cores): 39.6 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T18:56:47.939385 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 25 potential peaks Of 25 potential peaks: 3 in veto map, 2 cut by saddle test, 0 cut by aper test, 20 kept SED z : 20 new peaks Found 16 potential peaks Of 16 potential peaks: 15 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 16 potential peaks Of 16 potential peaks: 13 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 23 potential peaks Of 23 potential peaks: 21 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED Flat : 0 new peaks Found 26 potential peaks Of 26 potential peaks: 23 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 23 new sources Median coadd sky for g : 4.6560566e-05 Median coadd sky for r : 0.0001144599 Median coadd sky for z : -5.8287173e-06 Stage srcs : Wall: 0.60 s, CPU: 0.54 s, VmPeak: 978 MB, VmSize: 978 MB, VmRSS: 216 MB, VmData: 244 MB, maxrss: 0.566568 MB Stage srcs finished: 2020-06-07T18:56:48.539680 Resources for stage srcs : 0.130 s worker CPU, 0.130 s worker Wall, Wall: 0.601 s, Cores in use: 1.12, Total efficiency (on 4 cores): 28.0 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/PGC3129771-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/PGC3129771-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T18:56:48.553810 Blob 1 of 18, id: 5, sources: 2, size: 99x83, npix 4482, brick X: 84,183, Y: 100,183, one pixel: 159 100 Blob 2 of 18, id: 0, sources: 5, size: 82x49, npix 2253, brick X: 0,82, Y: 0,49, one pixel: 0 0 Blob 3 of 18, id: 13, sources: 2, size: 56x69, npix 2212, brick X: 51,107, Y: 195,264, one pixel: 80 195 Blob 4 of 18, id: 10, sources: 1, size: 53x53, npix 1698, brick X: 136,189, Y: 163,216, one pixel: 152 163 Blob 5 of 18, id: 11, sources: 2, size: 48x41, npix 1267, brick X: 217,265, Y: 182,223, one pixel: 228 182 Measuring 2 iterative sources Blob 2 finished, total: Wall: 2.11 s, CPU: 2.11 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.14392 MB Blob 6 of 18, id: 14, sources: 2, size: 39x44, npix 977, brick X: 185,224, Y: 206,250, one pixel: 205 206 Measuring 1 iterative sources Blob 3 finished, total: Wall: 2.76 s, CPU: 2.76 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144428 MB Blob 4 finished, total: Wall: 2.76 s, CPU: 2.76 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143128 MB Blob 7 of 18, id: 15, sources: 1, size: 34x35, npix 791, brick X: 139,173, Y: 230,265, one pixel: 154 230 Blob 8 of 18, id: 6, sources: 1, size: 26x28, npix 488, brick X: 62,88, Y: 111,139, one pixel: 72 111 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.19341, ee1=-0.355757, ee2=0.807307 Measuring 1 iterative sources Blob 1 finished, total: Wall: 3.34 s, CPU: 3.34 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144284 MB Blob 9 of 18, id: 9, sources: 1, size: 26x27, npix 443, brick X: 54,80, Y: 142,169, one pixel: 66 142 Blob 7 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144428 MB Blob 10 of 18, id: 8, sources: 1, size: 26x24, npix 399, brick X: 195,221, Y: 134,158, one pixel: 205 134 Blob 6 finished, total: Wall: 1.05 s, CPU: 1.05 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143804 MB Blob 11 of 18, id: 1, sources: 1, size: 25x26, npix 394, brick X: 106,131, Y: 54,80, one pixel: 116 54 Blob 9 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144428 MB Blob 12 of 18, id: 17, sources: 1, size: 25x24, npix 386, brick X: 226,251, Y: 247,271, one pixel: 238 247 Blob 8 finished, total: Wall: 0.58 s, CPU: 0.58 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144752 MB Blob 13 of 18, id: 7, sources: 1, size: 23x22, npix 312, brick X: 6,29, Y: 126,148, one pixel: 15 126 Blob 14 of 18, id: 2, sources: 1, size: 23x22, npix 294, brick X: 208,231, Y: 61,83, one pixel: 218 61 Blob 10 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143804 MB Blob 15 of 18, id: 12, sources: 1, size: 22x22, npix 292, brick X: 31,53, Y: 191,213, one pixel: 40 191 Blob 11 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144428 MB Blob 16 of 18, id: 4, sources: 1, size: 21x21, npix 239, brick X: 190,211, Y: 78,99, one pixel: 200 78 Blob 12 finished, total: Wall: 0.54 s, CPU: 0.54 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144752 MB Blob 17 of 18, id: 3, sources: 1, size: 19x19, npix 217, brick X: 144,163, Y: 65,84, one pixel: 152 65 Blob 13 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143804 MB Blob 18 of 18, id: 16, sources: 1, size: 18x17, npix 162, brick X: 171,189, Y: 245,262, one pixel: 179 245 Blob 15 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144752 MB Blob 14 finished, total: Wall: 0.32 s, CPU: 0.31 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144428 MB Blob 18 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144428 MB Blob 5 finished, total: Wall: 2.86 s, CPU: 2.86 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.14392 MB Blob 17 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144752 MB Blob 16 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143804 MB Old catalog: 27 New catalog: 25 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/metrics/cus/blobs-custom-116077p40360.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/metrics/cus/all-models-custom-116077p40360.fits Stage fitblobs : Wall: 5.71 s, CPU: 0.54 s, VmPeak: 978 MB, VmSize: 978 MB, VmRSS: 217 MB, VmData: 244 MB, maxrss: 0.566568 MB Stage fitblobs finished: 2020-06-07T18:56:54.266894 Resources for stage fitblobs : 20.130 s worker CPU, 20.204 s worker Wall, Wall: 5.714 s, Cores in use: 3.62, Total efficiency (on 4 cores): 90.4 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T18:56:54.268770 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/tmp-legacysurvey-custom-116077p40360-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/tmp-legacysurvey-custom-116077p40360-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/tmp-legacysurvey-custom-116077p40360-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/tmp-legacysurvey-custom-116077p40360-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-resid.jpg Stage coadds : Wall: 1.45 s, CPU: 0.67 s, VmPeak: 978 MB, VmSize: 978 MB, VmRSS: 217 MB, VmData: 244 MB, maxrss: 0.566568 MB Stage coadds finished: 2020-06-07T18:56:55.716050 Resources for stage coadds : 1.969 s worker CPU, 2.117 s worker Wall, Wall: 1.448 s, Cores in use: 1.82, Total efficiency (on 4 cores): 45.5 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T18:56:55.717671 Cut to 1 unWISE tiles Reading WISE tile 1167p408 band 2 Reading WISE tile 1167p408 band 1 Reading WISE tile 1167p408 band 4 Reading WISE tile 1167p408 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/116/1167p408/unwise-1167p408-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/116/1167p408/unwise-1167p408-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/116/1167p408/unwise-1167p408-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/116/1167p408/unwise-1167p408-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/116/1167p408/unwise-1167p408-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 805 MB, VmSize: 794 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.189988 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/116/1167p408/unwise-1167p408-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/116/1167p408/unwise-1167p408-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/116/1167p408/unwise-1167p408-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/116/1167p408/unwise-1167p408-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/116/1167p408/unwise-1167p408-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 806 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208704 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/116/1167p408/unwise-1167p408-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/116/1167p408/unwise-1167p408-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/116/1167p408/unwise-1167p408-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/116/1167p408/unwise-1167p408-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 805 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 173 MB, maxrss: 0.207488 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/116/1167p408/unwise-1167p408-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/116/1167p408/unwise-1167p408-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/116/1167p408/unwise-1167p408-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/116/1167p408/unwise-1167p408-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 805 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.209012 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/tmp-legacysurvey-custom-116077p40360-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/tmp-legacysurvey-custom-116077p40360-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.50 s, CPU: 0.68 s, VmPeak: 978 MB, VmSize: 978 MB, VmRSS: 218 MB, VmData: 244 MB, maxrss: 0.566568 MB Stage wise_forced finished: 2020-06-07T18:56:58.213501 Resources for stage wise_forced : 4.763 s worker CPU, 5.825 s worker Wall, Wall: 2.497 s, Cores in use: 2.18, Total efficiency (on 4 cores): 54.5 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T18:56:58.215234 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/coadd/cus/custom-116077p40360/legacysurvey-custom-116077p40360-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/tractor-i/cus/tractor-custom-116077p40360.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/tractor/cus/tractor-custom-116077p40360.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3129771/tractor/cus/brick-custom-116077p40360.sha256sum Stage writecat : Wall: 1.21 s, CPU: 0.79 s, VmPeak: 1110 MB, VmSize: 982 MB, VmRSS: 220 MB, VmData: 244 MB, maxrss: 0.566568 MB Stage writecat finished: 2020-06-07T18:56:59.422383 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.208 s, Cores in use: 0.66, Total efficiency (on 4 cores): 16.4 % Stage writecat finished All done: 32.218 s worker CPU, 45.579 s worker Wall, Wall: 24.720 s, Cores in use: 1.64, Total efficiency (on 4 cores): 40.9 % Finished galaxy PGC3129771 in 0.447 minutes.