Started working on galaxy PGC2128874 at Sun Jun 7 19:53:42 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 166.63259399999998 38.5030081 --width 233 --height 233 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/PGC2128874-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/PGC2128874-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T19:53:43.049183 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '166.63259399999998', '38.5030081', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/PGC2128874-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/PGC2128874-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 166.63259399999998 38.5030081 --width 233 --height 233 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/PGC2128874-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/PGC2128874-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 166.63259399999998 38.5030081 Starting process 58214 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 58215 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 58217 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 58219 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T19:53:43.356978 Keeping 13 CCDs: k4m_170204_095616_ooi_zd_ls9.fits.fz k4m_170204_095616_ooi_zd_ls9-CCD4 z exptime 82.107 propid 2016A-0453 seeing 0.69 MJD 57788.414 object MzLS_595358_z k4m_160303_081948_ooi_zd_ls9.fits.fz k4m_160303_081948_ooi_zd_ls9-CCD3 z exptime 80.102 propid 2016A-0453 seeing 1.16 MJD 57450.347 object MzLS_597324_z k4m_160226_091858_ooi_zd_ls9.fits.fz k4m_160226_091858_ooi_zd_ls9-CCD2 z exptime 80.103 propid 2016A-0453 seeing 0.93 MJD 57444.388 object MzLS_596343_z ksb_160209_092142_ooi_r_ls9.fits.fz ksb_160209_092142_ooi_r_ls9-CCD3 r exptime 86.7 propid 2015A-0801 seeing 1.37 MJD 57427.390 object 11441 ksb_170528_035609_ooi_g_ls9.fits.fz ksb_170528_035609_ooi_g_ls9-CCD3 g exptime 193.446 propid 2015A-0801 seeing 1.39 MJD 57901.164 object 11441 ksb_160217_093851_ooi_r_ls9.fits.fz ksb_160217_093851_ooi_r_ls9-CCD3 r exptime 97.2 propid 2015A-0801 seeing 1.25 MJD 57435.402 object 11441 ksb_170223_060311_ooi_g_ls9.fits.fz ksb_170223_060311_ooi_g_ls9-CCD4 g exptime 150.0 propid BASS seeing 1.76 MJD 57807.252 object 12773 ksb_160207_102921_ooi_r_ls9.fits.fz ksb_160207_102921_ooi_r_ls9-CCD1 r exptime 140.3 propid 2015A-0801 seeing 1.45 MJD 57425.437 object 11432 ksb_160211_091652_ooi_g_ls9.fits.fz ksb_160211_091652_ooi_g_ls9-CCD1 g exptime 98.1 propid 2015A-0801 seeing 1.35 MJD 57429.387 object 11432 ksb_160216_090336_ooi_r_ls9.fits.fz ksb_160216_090336_ooi_r_ls9-CCD3 r exptime 150.6 propid 2015A-0801 seeing 1.76 MJD 57434.378 object 11442 ksb_160211_092436_ooi_g_ls9.fits.fz ksb_160211_092436_ooi_g_ls9-CCD3 g exptime 97.7 propid 2015A-0801 seeing 1.24 MJD 57429.392 object 11442 ksb_160217_094122_ooi_r_ls9.fits.fz ksb_160217_094122_ooi_r_ls9-CCD2 r exptime 99.9 propid 2015A-0801 seeing 1.24 MJD 57435.404 object 12761 ksb_170528_034733_ooi_g_ls9.fits.fz ksb_170528_034733_ooi_g_ls9-CCD2 g exptime 224.84 propid 2015A-0801 seeing 1.62 MJD 57901.158 object 12761 mosaic get_fwhm: self.fwhm = 4.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2323 2558 and amp range 2006 4053 and image y 134 368 and amp range 0 2039 Range in image: x 0 236 , y 0 235 (with image size 236 x 235) dzp -0.00064781494 -> scaling image by 0.9994035183523652 Faked up EXPNUM 74270166 Faked up EXPNUM 74270166 Faked up EXPNUM 74270166 90prime get_fwhm: self.fwhm = 3.03 Found 4 relevant rows in amp-corrections file. Found overlap: image x 48 185 and amp range 0 2015 and image y 1988 2124 and amp range 0 2047 Range in image: x 0 138 , y 0 60 (with image size 138 x 137) dzp -0.024507914 -> scaling image by 0.9776802328037623 Found overlap: image x 48 185 and amp range 0 2015 and image y 1988 2124 and amp range 2048 4095 Range in image: x 0 138 , y 60 137 (with image size 138 x 137) dzp -0.011545347 -> scaling image by 0.9894226798649194 mosaic get_fwhm: self.fwhm = 3.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 764 1000 and amp range 0 2047 and image y 916 1154 and amp range 0 2039 Range in image: x 0 237 , y 0 239 (with image size 237 x 239) dzp -0.006320339 -> scaling image by 0.9941956631368829 mosaic get_fwhm: self.fwhm = 2.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3484 3724 and amp range 2048 4095 and image y 740 976 and amp range 0 2021 Range in image: x 0 241 , y 0 237 (with image size 241 x 237) dzp -0.03444113 -> scaling image by 0.9687763957004109 Faked up EXPNUM 79010031 Faked up EXPNUM 79010031 Faked up EXPNUM 79010031 90prime get_fwhm: self.fwhm = 3.07 Found 4 relevant rows in amp-corrections file. Found overlap: image x 53 190 and amp range 0 2015 and image y 1992 2128 and amp range 0 2047 Range in image: x 0 138 , y 0 56 (with image size 138 x 137) dzp -0.036130503 -> scaling image by 0.9672701794860779 Found overlap: image x 53 190 and amp range 0 2015 and image y 1992 2128 and amp range 2048 4095 Range in image: x 0 138 , y 56 137 (with image size 138 x 137) dzp -0.045992933 -> scaling image by 0.958523636456738 Faked up EXPNUM 74250142 Faked up EXPNUM 74250142 Faked up EXPNUM 74250142 90prime get_fwhm: self.fwhm = 3.19 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1972 2110 and amp range 0 2015 and image y 467 604 and amp range 0 2047 Range in image: x 0 44 , y 0 138 (with image size 139 x 138) dzp -0.01149955 -> scaling image by 0.9894644150522871 Found overlap: image x 1972 2110 and amp range 2016 4031 and image y 467 604 and amp range 0 2047 Range in image: x 44 139 , y 0 138 (with image size 139 x 138) dzp -0.0041296566 -> scaling image by 0.9962036700684744 Faked up EXPNUM 74350150 Faked up EXPNUM 74350150 Faked up EXPNUM 74350150 90prime get_fwhm: self.fwhm = 2.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 61 198 and amp range 0 2015 and image y 1983 2119 and amp range 0 2047 Range in image: x 0 138 , y 0 65 (with image size 138 x 137) dzp -0.024507914 -> scaling image by 0.9776802328037623 Found overlap: image x 61 198 and amp range 0 2015 and image y 1983 2119 and amp range 2048 4095 Range in image: x 0 138 , y 65 137 (with image size 138 x 137) dzp -0.011545347 -> scaling image by 0.9894226798649194 Faked up EXPNUM 78070062 Faked up EXPNUM 78070062 Faked up EXPNUM 78070062 90prime get_fwhm: self.fwhm = 3.89 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1861 1996 and amp range 0 2015 and image y 2950 3086 and amp range 2048 4095 Range in image: x 0 136 , y 0 137 (with image size 136 x 137) dzp 0.019393893 -> scaling image by 1.0180229229717446 Faked up EXPNUM 74290197 Faked up EXPNUM 74290197 Faked up EXPNUM 74290197 90prime get_fwhm: self.fwhm = 2.99 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1988 2125 and amp range 0 2015 and image y 455 593 and amp range 0 2047 Range in image: x 0 28 , y 0 139 (with image size 138 x 139) dzp -0.011813398 -> scaling image by 0.989178436928226 Found overlap: image x 1988 2125 and amp range 2016 4031 and image y 455 593 and amp range 0 2047 Range in image: x 28 138 , y 0 139 (with image size 138 x 139) dzp -0.0032519526 -> scaling image by 0.9970093219958882 Faked up EXPNUM 74290200 Faked up EXPNUM 74290200 Faked up EXPNUM 74290200 90prime get_fwhm: self.fwhm = 2.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2044 2180 and amp range 2016 4031 and image y 3992 4080 and amp range 2048 4095 Range in image: x 0 137 , y 0 89 (with image size 137 x 89) dzp -0.0012536051 -> scaling image by 0.9988460533227724 Faked up EXPNUM 74350151 Faked up EXPNUM 74350151 Faked up EXPNUM 74350151 90prime get_fwhm: self.fwhm = 2.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3785 3922 and amp range 2016 4031 and image y 1268 1406 and amp range 0 2047 Range in image: x 0 138 , y 0 139 (with image size 138 x 139) dzp -0.012503507 -> scaling image by 0.9885499019198392 Faked up EXPNUM 74340136 Faked up EXPNUM 74340136 Faked up EXPNUM 74340136 90prime get_fwhm: self.fwhm = 3.89 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2036 2172 and amp range 2016 4031 and image y 3979 4080 and amp range 2048 4095 Range in image: x 0 137 , y 0 102 (with image size 137 x 102) dzp -0.0005558773 -> scaling image by 0.99948814914245 Faked up EXPNUM 79010029 Faked up EXPNUM 79010029 Faked up EXPNUM 79010029 90prime get_fwhm: self.fwhm = 3.57 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3794 3931 and amp range 2016 4031 and image y 1288 1426 and amp range 0 2047 Range in image: x 0 138 , y 0 139 (with image size 138 x 139) dzp 0.01918938 -> scaling image by 1.017831182878158 Stage tims : Wall: 5.41 s, CPU: 0.86 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 172 MB, VmData: 205 MB, maxrss: 0.566508 MB Stage tims finished: 2020-06-07T19:53:48.762470 Resources for stage tims : 3.797 s worker CPU, 14.602 s worker Wall, Wall: 5.407 s, Cores in use: 0.86, Total efficiency (on 4 cores): 21.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/PGC2128874-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/PGC2128874-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T19:53:48.783664 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02171.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02427.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02299.fits Matched 8 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/metrics/cus/reference-custom-166632p38503.fits Stage refs : Wall: 1.55 s, CPU: 1.12 s, VmPeak: 973 MB, VmSize: 952 MB, VmRSS: 183 MB, VmData: 215 MB, maxrss: 0.566508 MB Stage refs finished: 2020-06-07T19:53:50.334505 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.552 s, Cores in use: 0.72, Total efficiency (on 4 cores): 18.0 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T19:53:50.335921 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/metrics/cus/outlier-mask-custom-166632p38503.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/metrics/cus/outliers-pre-custom-166632p38503.jpg Image ksb_170223_060311_ooi_g_ls9-CCD4 g : masking 123 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/metrics/cus/outlier-mask-custom-166632p38503.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/metrics/cus/outliers-post-custom-166632p38503.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/metrics/cus/outliers-masked-pos-custom-166632p38503.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/metrics/cus/outliers-masked-neg-custom-166632p38503.jpg Stage outliers : Wall: 0.78 s, CPU: 0.58 s, VmPeak: 973 MB, VmSize: 962 MB, VmRSS: 195 MB, VmData: 226 MB, maxrss: 0.566508 MB Stage outliers finished: 2020-06-07T19:53:51.120737 Resources for stage outliers : 0.829 s worker CPU, 0.835 s worker Wall, Wall: 0.786 s, Cores in use: 1.79, Total efficiency (on 4 cores): 44.8 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T19:53:51.122299 Stage halos : Wall: 0.17 s, CPU: 0.17 s, VmPeak: 973 MB, VmSize: 962 MB, VmRSS: 195 MB, VmData: 226 MB, maxrss: 0.566508 MB Stage halos finished: 2020-06-07T19:53:51.295837 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.174 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.2 % Stage halos finished Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-06-07T19:53:51.297405 PSF sigmas in coadd pixels: ['2.26', '2.86', '2.20', '2.01', '2.63'] Using average PSF sigma 2.3919648786078285 Gaussian PSF norm 0.11793433686955429 vs pixelized 0.0968036 average tim pixel scale / coadd scale: 1.729518221335784 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.23', '2.04', '2.35', '2.86', '2.01'] Using average PSF sigma 2.2973694394815167 Gaussian PSF norm 0.12279034748435712 vs pixelized 0.108569086 average tim pixel scale / coadd scale: 1.7292901583883256 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.12', '1.88', '1.51'] Using average PSF sigma 1.5025205414898062 Gaussian PSF norm 0.18774771058648587 vs pixelized 0.15030144 average tim pixel scale / coadd scale: 0.9909114122340982 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.22 s, CPU: 0.19 s, VmPeak: 973 MB, VmSize: 962 MB, VmRSS: 198 MB, VmData: 227 MB, maxrss: 0.566508 MB Stage fit_on_coadds finished: 2020-06-07T19:53:51.513947 Resources for stage fit_on_coadds : 0.211 s worker CPU, 0.214 s worker Wall, Wall: 0.217 s, Cores in use: 1.84, Total efficiency (on 4 cores): 46.0 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T19:53:51.516796 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 18 potential peaks Of 18 potential peaks: 8 in veto map, 2 cut by saddle test, 0 cut by aper test, 8 kept SED z : 8 new peaks Found 20 potential peaks Of 20 potential peaks: 17 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 32 potential peaks Of 32 potential peaks: 29 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 39 potential peaks Of 39 potential peaks: 33 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 44 potential peaks Of 44 potential peaks: 40 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 10 new sources Median coadd sky for g : 0.00042321824 Median coadd sky for r : 0.00079571403 Median coadd sky for z : -0.00013925246 Stage srcs : Wall: 0.41 s, CPU: 0.37 s, VmPeak: 973 MB, VmSize: 962 MB, VmRSS: 198 MB, VmData: 227 MB, maxrss: 0.566508 MB Stage srcs finished: 2020-06-07T19:53:51.922819 Resources for stage srcs : 0.093 s worker CPU, 0.101 s worker Wall, Wall: 0.407 s, Cores in use: 1.13, Total efficiency (on 4 cores): 28.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/PGC2128874-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/PGC2128874-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T19:53:51.932442 Blob 1 of 4, id: 2, sources: 8, size: 184x184, npix 21268, brick X: 16,200, Y: 10,194, one pixel: 92 10 Blob 2 of 4, id: 1, sources: 1, size: 32x33, npix 692, brick X: 2,34, Y: 5,38, one pixel: 23 5 Blob 3 of 4, id: 0, sources: 2, size: 36x34, npix 671, brick X: 148,184, Y: 0,34, one pixel: 152 0 Blob 4 of 4, id: 3, sources: 1, size: 26x27, npix 460, brick X: 166,192, Y: 37,64, one pixel: 176 37 Blob 4 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141192 MB Measuring 2 iterative sources Blob 2 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141676 MB Blob 3 finished, total: Wall: 1.34 s, CPU: 1.34 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141664 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.784088, ee1=-0.129339, ee2=-0.273081 Measuring 2 iterative sources Blob 1 finished, total: Wall: 10.11 s, CPU: 10.11 s, VmPeak: 803 MB, VmSize: 714 MB, VmRSS: 147 MB, VmData: 179 MB, maxrss: 0.150652 MB Old catalog: 14 New catalog: 15 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/metrics/cus/blobs-custom-166632p38503.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/metrics/cus/all-models-custom-166632p38503.fits Stage fitblobs : Wall: 11.87 s, CPU: 0.26 s, VmPeak: 973 MB, VmSize: 962 MB, VmRSS: 198 MB, VmData: 227 MB, maxrss: 0.566508 MB Stage fitblobs finished: 2020-06-07T19:54:03.804423 Resources for stage fitblobs : 12.962 s worker CPU, 12.978 s worker Wall, Wall: 11.873 s, Cores in use: 1.11, Total efficiency (on 4 cores): 27.8 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T19:54:03.806445 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/tmp-legacysurvey-custom-166632p38503-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/tmp-legacysurvey-custom-166632p38503-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/tmp-legacysurvey-custom-166632p38503-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/tmp-legacysurvey-custom-166632p38503-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-resid.jpg Stage coadds : Wall: 2.77 s, CPU: 0.57 s, VmPeak: 973 MB, VmSize: 962 MB, VmRSS: 199 MB, VmData: 227 MB, maxrss: 0.566508 MB Stage coadds finished: 2020-06-07T19:54:06.575674 Resources for stage coadds : 1.809 s worker CPU, 1.929 s worker Wall, Wall: 2.770 s, Cores in use: 0.86, Total efficiency (on 4 cores): 21.5 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T19:54:06.577337 Cut to 1 unWISE tiles Reading WISE tile 1667p378 band 1 Reading WISE tile 1667p378 band 2 Reading WISE tile 1667p378 band 4 Reading WISE tile 1667p378 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1667p378/unwise-1667p378-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1667p378/unwise-1667p378-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1667p378/unwise-1667p378-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1667p378/unwise-1667p378-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1667p378/unwise-1667p378-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 804 MB, VmSize: 794 MB, VmRSS: 146 MB, VmData: 176 MB, maxrss: 0.187804 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1667p378/unwise-1667p378-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1667p378/unwise-1667p378-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1667p378/unwise-1667p378-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1667p378/unwise-1667p378-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1667p378/unwise-1667p378-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 803 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208532 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1667p378/unwise-1667p378-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1667p378/unwise-1667p378-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1667p378/unwise-1667p378-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1667p378/unwise-1667p378-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 803 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208764 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1667p378/unwise-1667p378-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1667p378/unwise-1667p378-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1667p378/unwise-1667p378-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1667p378/unwise-1667p378-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 803 MB, VmSize: 792 MB, VmRSS: 149 MB, VmData: 173 MB, maxrss: 0.21332 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/tmp-legacysurvey-custom-166632p38503-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/tmp-legacysurvey-custom-166632p38503-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.08 s, CPU: 0.35 s, VmPeak: 973 MB, VmSize: 962 MB, VmRSS: 200 MB, VmData: 227 MB, maxrss: 0.566508 MB Stage wise_forced finished: 2020-06-07T19:54:08.657152 Resources for stage wise_forced : 4.683 s worker CPU, 5.751 s worker Wall, Wall: 2.081 s, Cores in use: 2.42, Total efficiency (on 4 cores): 60.5 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T19:54:08.658875 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/coadd/cus/custom-166632p38503/legacysurvey-custom-166632p38503-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/tractor-i/cus/tractor-custom-166632p38503.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/tractor/cus/tractor-custom-166632p38503.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC2128874/tractor/cus/brick-custom-166632p38503.sha256sum Stage writecat : Wall: 0.64 s, CPU: 0.36 s, VmPeak: 1094 MB, VmSize: 966 MB, VmRSS: 202 MB, VmData: 227 MB, maxrss: 0.566508 MB Stage writecat finished: 2020-06-07T19:54:09.299182 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.641 s, Cores in use: 0.57, Total efficiency (on 4 cores): 14.2 % Stage writecat finished All done: 24.384 s worker CPU, 36.412 s worker Wall, Wall: 25.951 s, Cores in use: 1.13, Total efficiency (on 4 cores): 28.2 % Finished galaxy PGC2128874 in 0.459 minutes.