Started working on galaxy PGC3131148 at Sun Jun 7 17:09:37 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 128.1042015 46.2072677 --width 233 --height 233 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/PGC3131148-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/PGC3131148-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T17:09:38.138346 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '128.1042015', '46.2072677', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/PGC3131148-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/PGC3131148-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 128.1042015 46.2072677 --width 233 --height 233 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/PGC3131148-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/PGC3131148-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 128.1042015 46.2072677 Starting process 1258 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 1264 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 1266 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 1267 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T17:09:38.819698 Keeping 10 CCDs: k4m_160402_041519_ooi_zd_ls9.fits.fz k4m_160402_041519_ooi_zd_ls9-CCD2 z exptime 80.103 propid 2016A-0453 seeing 0.97 MJD 57480.177 object MzLS_632530_z k4m_170412_044106_ooi_zd_ls9.fits.fz k4m_170412_044106_ooi_zd_ls9-CCD3 z exptime 250.106 propid 2016A-0453 seeing 2.00 MJD 57855.195 object MzLS_634269_z k4m_160311_051958_ooi_zd_ls9.fits.fz k4m_160311_051958_ooi_zd_ls9-CCD1 z exptime 80.104 propid 2016A-0453 seeing 1.07 MJD 57458.222 object MzLS_633401_z k4m_160403_034022_ooi_zd_ls9.fits.fz k4m_160403_034022_ooi_zd_ls9-CCD4 z exptime 80.102 propid 2016A-0453 seeing 0.83 MJD 57481.153 object MzLS_632529_z ksb_170327_042718_ooi_g_ls9.fits.fz ksb_170327_042718_ooi_g_ls9-CCD3 g exptime 66.8 propid BASS seeing 1.16 MJD 57839.186 object 21453 ksb_190104_123846_ooi_g_ls9.fits.fz ksb_190104_123846_ooi_g_ls9-CCD3 g exptime 124.3 propid NOTBASS seeing 1.81 MJD 58487.527 object ksb_170322_051410_ooi_r_ls9.fits.fz ksb_170322_051410_ooi_r_ls9-CCD3 r exptime 82.26 propid BASS seeing 1.30 MJD 57834.218 object 21451 ksb_160311_044907_ooi_g_ls9.fits.fz ksb_160311_044907_ooi_g_ls9-CCD2 g exptime 175.9 propid 2015A-0801 seeing 1.46 MJD 57458.201 object 21442 ksb_160314_050054_ooi_r_ls9.fits.fz ksb_160314_050054_ooi_r_ls9-CCD2 r exptime 112.3 propid 2015A-0801 seeing 1.08 MJD 57461.209 object 21442 ksb_180223_082923_ooi_r_ls9.fits.fz ksb_180223_082923_ooi_r_ls9-CCD3 r exptime 97.917 propid BASS seeing 2.92 MJD 58172.354 object 21453 mosaic get_fwhm: self.fwhm = 4.13 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3445 3680 and amp range 2006 4053 and image y 1232 1470 and amp range 0 2039 Range in image: x 0 236 , y 0 239 (with image size 236 x 239) dzp 0.001388291 -> scaling image by 1.0012794811153327 mosaic get_fwhm: self.fwhm = 3.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1916 2156 and amp range 0 2047 and image y 7 199 and amp range 0 2039 Range in image: x 0 132 , y 0 193 (with image size 241 x 193) dzp -0.006320339 -> scaling image by 0.9941956631368829 Found overlap: image x 1916 2156 and amp range 2048 4095 and image y 7 199 and amp range 0 2039 Range in image: x 132 241 , y 0 193 (with image size 241 x 193) dzp 0.0072022504 -> scaling image by 1.0066555682883527 mosaic get_fwhm: self.fwhm = 3.21 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1919 2159 and amp range 0 2047 and image y 3598 3839 and amp range 2022 4060 Range in image: x 0 129 , y 0 242 (with image size 241 x 242) dzp 0.0033053984 -> scaling image by 1.0030490232713904 Found overlap: image x 1919 2159 and amp range 2048 4095 and image y 3598 3839 and amp range 2022 4060 Range in image: x 129 241 , y 0 242 (with image size 241 x 242) dzp -0.0028835079 -> scaling image by 0.9973477146455455 mosaic get_fwhm: self.fwhm = 7.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 762 999 and amp range 0 2005 and image y 380 616 and amp range 0 2039 Range in image: x 0 238 , y 0 237 (with image size 238 x 237) dzp 0.0013971253 -> scaling image by 1.0012876282438632 Faked up EXPNUM 78390067 Faked up EXPNUM 78390067 Faked up EXPNUM 78390067 90prime get_fwhm: self.fwhm = 2.57 Found 4 relevant rows in amp-corrections file. Found overlap: image x 411 547 and amp range 0 2015 and image y 1398 1534 and amp range 0 2047 Range in image: x 0 137 , y 0 137 (with image size 137 x 137) dzp -0.036130503 -> scaling image by 0.9672701794860779 Faked up EXPNUM 84870085 Faked up EXPNUM 84870085 Faked up EXPNUM 84870085 90prime get_fwhm: self.fwhm = 3.99 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2381 2517 and amp range 2016 4031 and image y 3498 3635 and amp range 2048 4095 Range in image: x 0 137 , y 0 138 (with image size 137 x 138) dzp -0.021718625 -> scaling image by 0.9801951516091928 Faked up EXPNUM 74580055 Faked up EXPNUM 74580055 Faked up EXPNUM 74580055 90prime get_fwhm: self.fwhm = 3.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 181 317 and amp range 0 2015 and image y 1848 1984 and amp range 0 2047 Range in image: x 0 137 , y 0 137 (with image size 137 x 137) dzp -0.008523628 -> scaling image by 0.992180183483648 Faked up EXPNUM 74610051 Faked up EXPNUM 74610051 Faked up EXPNUM 74610051 90prime get_fwhm: self.fwhm = 2.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 175 311 and amp range 0 2015 and image y 1834 1971 and amp range 0 2047 Range in image: x 0 137 , y 0 138 (with image size 137 x 138) dzp -0.006045583 -> scaling image by 0.9944472857505693 Faked up EXPNUM 78340074 Faked up EXPNUM 78340074 Faked up EXPNUM 78340074 90prime get_fwhm: self.fwhm = 2.87 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2386 2523 and amp range 2016 4031 and image y 3380 3516 and amp range 2048 4095 Range in image: x 0 138 , y 0 137 (with image size 138 x 137) dzp -0.035697103 -> scaling image by 0.9676563679910417 Faked up EXPNUM 81720169 Faked up EXPNUM 81720169 Faked up EXPNUM 81720169 90prime get_fwhm: self.fwhm = 6.43 Found 4 relevant rows in amp-corrections file. Found overlap: image x 448 584 and amp range 0 2015 and image y 1399 1535 and amp range 0 2047 Range in image: x 0 137 , y 0 137 (with image size 137 x 137) dzp -0.039144866 -> scaling image by 0.9645884414840357 Stage tims : Wall: 5.56 s, CPU: 0.96 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 171 MB, VmData: 205 MB, maxrss: 0.56788 MB Stage tims finished: 2020-06-07T17:09:44.377616 Resources for stage tims : 3.591 s worker CPU, 14.013 s worker Wall, Wall: 5.559 s, Cores in use: 0.82, Total efficiency (on 4 cores): 20.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/PGC3131148-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/PGC3131148-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T17:09:44.401882 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01665.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01782.fits Matched 11 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/metrics/cus/reference-custom-128104p46207.fits Stage refs : Wall: 2.54 s, CPU: 1.99 s, VmPeak: 972 MB, VmSize: 959 MB, VmRSS: 189 MB, VmData: 222 MB, maxrss: 0.56788 MB Stage refs finished: 2020-06-07T17:09:46.938003 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.537 s, Cores in use: 0.79, Total efficiency (on 4 cores): 19.6 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T17:09:46.939531 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/metrics/cus/outlier-mask-custom-128104p46207.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/metrics/cus/outliers-pre-custom-128104p46207.jpg Image ksb_190104_123846_ooi_g_ls9-CCD3 g : masking 75 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/metrics/cus/outlier-mask-custom-128104p46207.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/metrics/cus/outliers-post-custom-128104p46207.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/metrics/cus/outliers-masked-pos-custom-128104p46207.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/metrics/cus/outliers-masked-neg-custom-128104p46207.jpg Stage outliers : Wall: 0.83 s, CPU: 0.62 s, VmPeak: 972 MB, VmSize: 969 MB, VmRSS: 201 MB, VmData: 231 MB, maxrss: 0.56788 MB Stage outliers finished: 2020-06-07T17:09:47.765704 Resources for stage outliers : 0.693 s worker CPU, 0.696 s worker Wall, Wall: 0.827 s, Cores in use: 1.59, Total efficiency (on 4 cores): 39.7 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T17:09:47.767497 Stage halos : Wall: 0.34 s, CPU: 0.31 s, VmPeak: 972 MB, VmSize: 969 MB, VmRSS: 201 MB, VmData: 231 MB, maxrss: 0.56788 MB Stage halos finished: 2020-06-07T17:09:48.104256 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.338 s, Cores in use: 0.94, Total efficiency (on 4 cores): 23.4 % Stage halos finished Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-06-07T17:09:48.106052 PSF sigmas in coadd pixels: ['1.89', '2.94', '2.38'] Using average PSF sigma 2.402739461284855 Gaussian PSF norm 0.11740548499712454 vs pixelized 0.09362542 average tim pixel scale / coadd scale: 1.7301781762405546 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.11', '1.76', '4.74'] Using average PSF sigma 2.8692665517201537 Gaussian PSF norm 0.09831599354363209 vs pixelized 0.09754689 average tim pixel scale / coadd scale: 1.730119390946365 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.57', '3.24', '1.74', '1.35'] Using average PSF sigma 1.9773681179949834 Gaussian PSF norm 0.14266174780845428 vs pixelized 0.112953976 average tim pixel scale / coadd scale: 0.9908093627629346 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.18 s, CPU: 0.17 s, VmPeak: 972 MB, VmSize: 969 MB, VmRSS: 203 MB, VmData: 232 MB, maxrss: 0.56788 MB Stage fit_on_coadds finished: 2020-06-07T17:09:48.290359 Resources for stage fit_on_coadds : 0.144 s worker CPU, 0.144 s worker Wall, Wall: 0.185 s, Cores in use: 1.68, Total efficiency (on 4 cores): 42.1 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T17:09:48.293121 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 17 potential peaks Of 17 potential peaks: 2 in veto map, 6 cut by saddle test, 0 cut by aper test, 9 kept SED z : 9 new peaks Found 16 potential peaks Of 16 potential peaks: 11 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 15 potential peaks Of 15 potential peaks: 10 in veto map, 4 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 21 potential peaks Of 21 potential peaks: 15 in veto map, 3 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 22 potential peaks Of 22 potential peaks: 17 in veto map, 4 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 16 new sources Median coadd sky for g : 1.6008853e-05 Median coadd sky for r : 0.00028361293 Median coadd sky for z : 0.000115514056 Stage srcs : Wall: 0.51 s, CPU: 0.47 s, VmPeak: 972 MB, VmSize: 969 MB, VmRSS: 204 MB, VmData: 232 MB, maxrss: 0.56788 MB Stage srcs finished: 2020-06-07T17:09:48.807879 Resources for stage srcs : 0.079 s worker CPU, 0.079 s worker Wall, Wall: 0.516 s, Cores in use: 1.07, Total efficiency (on 4 cores): 26.7 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/PGC3131148-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/PGC3131148-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T17:09:48.820316 Blob 1 of 13, id: 4, sources: 4, size: 133x86, npix 6887, brick X: 58,191, Y: 72,158, one pixel: 120 72 Blob 2 of 13, id: 6, sources: 1, size: 68x81, npix 3264, brick X: 64,132, Y: 148,229, one pixel: 86 148 Blob 3 of 13, id: 2, sources: 2, size: 45x30, npix 756, brick X: 30,75, Y: 45,75, one pixel: 39 45 Blob 4 of 13, id: 5, sources: 1, size: 22x44, npix 725, brick X: 0,22, Y: 142,186, one pixel: 4 142 Blob 5 of 13, id: 0, sources: 2, size: 31x39, npix 664, brick X: 171,202, Y: 0,39, one pixel: 178 0 Blob 4 finished, total: Wall: 1.18 s, CPU: 1.18 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139656 MB Blob 6 of 13, id: 1, sources: 1, size: 31x31, npix 659, brick X: 136,167, Y: 12,43, one pixel: 151 12 Blob 3 finished, total: Wall: 1.31 s, CPU: 1.31 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.141916 MB Blob 7 of 13, id: 7, sources: 1, size: 28x28, npix 513, brick X: 188,216, Y: 155,183, one pixel: 201 155 Blob 6 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.141916 MB Blob 8 of 13, id: 8, sources: 1, size: 25x25, npix 414, brick X: 146,171, Y: 162,187, one pixel: 156 162 Measuring 4 iterative sources Blob 5 finished, total: Wall: 1.40 s, CPU: 1.40 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141716 MB Blob 9 of 13, id: 3, sources: 1, size: 21x21, npix 279, brick X: 145,166, Y: 57,78, one pixel: 153 57 Blob 10 of 13, id: 11, sources: 1, size: 18x23, npix 278, brick X: 215,233, Y: 186,209, one pixel: 225 186 Blob 7 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.14196 MB Blob 11 of 13, id: 10, sources: 1, size: 21x20, npix 240, brick X: 44,65, Y: 181,201, one pixel: 53 181 Blob 9 finished, total: Wall: 0.20 s, CPU: 0.20 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.14196 MB Blob 12 of 13, id: 9, sources: 1, size: 19x18, npix 189, brick X: 127,146, Y: 172,190, one pixel: 135 172 Blob 8 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141716 MB Blob 13 of 13, id: 12, sources: 1, size: 18x16, npix 165, brick X: 137,155, Y: 217,233, one pixel: 146 217 Blob 11 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141716 MB Blob 12 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141716 MB Blob 10 finished, total: Wall: 0.47 s, CPU: 0.47 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.14196 MB Blob 13 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141716 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.212722, ee1=-0.118288, ee2=-0.153507 Measuring 3 iterative sources Blob 2 finished, total: Wall: 5.06 s, CPU: 5.05 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14294 MB Blob 1 finished, total: Wall: 7.87 s, CPU: 7.87 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.14438 MB Old catalog: 19 New catalog: 24 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/metrics/cus/blobs-custom-128104p46207.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/metrics/cus/all-models-custom-128104p46207.fits Stage fitblobs : Wall: 9.06 s, CPU: 0.41 s, VmPeak: 972 MB, VmSize: 969 MB, VmRSS: 204 MB, VmData: 232 MB, maxrss: 0.56788 MB Stage fitblobs finished: 2020-06-07T17:09:57.879854 Resources for stage fitblobs : 20.464 s worker CPU, 20.541 s worker Wall, Wall: 9.061 s, Cores in use: 2.30, Total efficiency (on 4 cores): 57.6 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T17:09:57.881731 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/tmp-legacysurvey-custom-128104p46207-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/tmp-legacysurvey-custom-128104p46207-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/tmp-legacysurvey-custom-128104p46207-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/tmp-legacysurvey-custom-128104p46207-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-resid.jpg Stage coadds : Wall: 1.38 s, CPU: 0.59 s, VmPeak: 972 MB, VmSize: 969 MB, VmRSS: 204 MB, VmData: 232 MB, maxrss: 0.56788 MB Stage coadds finished: 2020-06-07T17:09:59.259552 Resources for stage coadds : 2.086 s worker CPU, 2.307 s worker Wall, Wall: 1.379 s, Cores in use: 1.94, Total efficiency (on 4 cores): 48.6 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T17:09:59.261210 Cut to 2 unWISE tiles Reading WISE tile 1278p454 band 1 Reading WISE tile 1278p454 band 2 Reading WISE tile 1278p454 band 3 Reading WISE tile 1278p454 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/127/1278p454/unwise-1278p454-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/127/1278p454/unwise-1278p454-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/127/1278p454/unwise-1278p454-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/127/1278p454/unwise-1278p454-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/127/1278p454/unwise-1278p454-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1287p469 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/127/1278p454/unwise-1278p454-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/127/1278p454/unwise-1278p454-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/127/1278p454/unwise-1278p454-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/127/1278p454/unwise-1278p454-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/127/1278p454/unwise-1278p454-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1287p469 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/127/1278p454/unwise-1278p454-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/127/1278p454/unwise-1278p454-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/127/1278p454/unwise-1278p454-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/127/1278p454/unwise-1278p454-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1287p469 band 1 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/127/1278p454/unwise-1278p454-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/127/1278p454/unwise-1278p454-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/127/1278p454/unwise-1278p454-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/127/1278p454/unwise-1278p454-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1287p469 band 2 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1287p469/unwise-1287p469-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1287p469/unwise-1287p469-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1287p469/unwise-1287p469-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1287p469/unwise-1287p469-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1287p469/unwise-1287p469-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 806 MB, VmSize: 797 MB, VmRSS: 149 MB, VmData: 179 MB, maxrss: 0.189524 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1287p469/unwise-1287p469-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1287p469/unwise-1287p469-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1287p469/unwise-1287p469-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1287p469/unwise-1287p469-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1287p469/unwise-1287p469-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.204764 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1287p469/unwise-1287p469-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1287p469/unwise-1287p469-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1287p469/unwise-1287p469-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1287p469/unwise-1287p469-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 803 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208912 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1287p469/unwise-1287p469-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1287p469/unwise-1287p469-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1287p469/unwise-1287p469-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1287p469/unwise-1287p469-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.204964 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/tmp-legacysurvey-custom-128104p46207-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/tmp-legacysurvey-custom-128104p46207-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 4.60 s, CPU: 0.54 s, VmPeak: 972 MB, VmSize: 968 MB, VmRSS: 204 MB, VmData: 231 MB, maxrss: 0.56788 MB Stage wise_forced finished: 2020-06-07T17:10:03.860843 Resources for stage wise_forced : 9.556 s worker CPU, 11.930 s worker Wall, Wall: 4.601 s, Cores in use: 2.19, Total efficiency (on 4 cores): 54.8 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T17:10:03.862467 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/coadd/cus/custom-128104p46207/legacysurvey-custom-128104p46207-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/tractor-i/cus/tractor-custom-128104p46207.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/tractor/cus/tractor-custom-128104p46207.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC3131148/tractor/cus/brick-custom-128104p46207.sha256sum Stage writecat : Wall: 2.30 s, CPU: 0.55 s, VmPeak: 1100 MB, VmSize: 972 MB, VmRSS: 206 MB, VmData: 231 MB, maxrss: 0.56788 MB Stage writecat finished: 2020-06-07T17:10:06.159791 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.298 s, Cores in use: 0.24, Total efficiency (on 4 cores): 5.9 % Stage writecat finished All done: 36.615 s worker CPU, 49.714 s worker Wall, Wall: 27.345 s, Cores in use: 1.58, Total efficiency (on 4 cores): 39.6 % Finished galaxy PGC3131148 in 0.490 minutes.