Started working on galaxy PGC2650796 at Sun Jun 7 18:31:21 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.299583 63.1650833 --width 233 --height 233 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T18:31:22.689868 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '273.299583', '63.1650833', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.299583 63.1650833 --width 233 --height 233 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 273.299583 63.1650833 Starting process 39955 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 39957 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 39959 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 39961 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T18:31:23.187030 Keeping 12 CCDs: k4m_170604_111518_ooi_zd_ls9.fits.fz k4m_170604_111518_ooi_zd_ls9-CCD1 z exptime 95.104 propid 2016A-0453 seeing 0.98 MJD 57908.469 object MzLS_696535_z k4m_170927_043228_ooi_zd_ls9.fits.fz k4m_170927_043228_ooi_zd_ls9-CCD4 z exptime 184.105 propid 2016A-0453 seeing 1.74 MJD 58023.189 object MzLS_695392_z k4m_171029_040850_ooi_zd_ls9.fits.fz k4m_171029_040850_ooi_zd_ls9-CCD2 z exptime 97.103 propid 2016A-0453 seeing 0.91 MJD 58055.173 object MzLS_695966_z k4m_170928_044032_ooi_zd_ls9.fits.fz k4m_170928_044032_ooi_zd_ls9-CCD3 z exptime 194.102 propid 2016A-0453 seeing 1.31 MJD 58024.195 object MzLS_697100_z ksb_180424_114352_ooi_r_ls9.fits.fz ksb_180424_114352_ooi_r_ls9-CCD2 r exptime 126.608 propid BASS seeing 1.52 MJD 58232.489 object 40582 ksb_160712_083115_ooi_g_ls9.fits.fz ksb_160712_083115_ooi_g_ls9-CCD2 g exptime 97.4 propid BASS seeing 1.72 MJD 57581.355 object 40582 ksb_180418_112943_ooi_g_ls9.fits.fz ksb_180418_112943_ooi_g_ls9-CCD3 g exptime 100.377 propid BASS seeing 1.38 MJD 58226.479 object 40591 ksb_180508_100728_ooi_r_ls9.fits.fz ksb_180508_100728_ooi_r_ls9-CCD3 r exptime 107.978 propid NOTBASS seeing 1.34 MJD 58246.422 object 40591 ksb_180418_112022_ooi_g_ls9.fits.fz ksb_180418_112022_ooi_g_ls9-CCD1 g exptime 96.871 propid BASS seeing 1.39 MJD 58226.472 object 40581 ksb_180423_115418_ooi_r_ls9.fits.fz ksb_180423_115418_ooi_r_ls9-CCD1 r exptime 250.0 propid BASS seeing 1.26 MJD 58231.496 object 40581 ksb_180520_095338_ooi_r_ls9.fits.fz ksb_180520_095338_ooi_r_ls9-CCD3 r exptime 101.06 propid NOTBASS seeing 1.24 MJD 58258.412 object 40593 ksb_170622_064356_ooi_g_ls9.fits.fz ksb_170622_064356_ooi_g_ls9-CCD3 g exptime 140.88 propid 2015A-0801 seeing 1.54 MJD 57926.281 object 40593 mosaic get_fwhm: self.fwhm = 5.03 Found 4 relevant rows in amp-corrections file. Found overlap: image x 67 307 and amp range 0 2005 and image y 2282 2525 and amp range 2040 4078 Range in image: x 0 241 , y 0 244 (with image size 241 x 244) dzp 0.01523814 -> scaling image by 1.014133796220052 mosaic get_fwhm: self.fwhm = 3.49 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1200 1435 and amp range 0 2047 and image y 3417 3652 and amp range 2040 4078 Range in image: x 0 236 , y 0 236 (with image size 236 x 236) dzp 0.003927584 -> scaling image by 1.0036239891963392 mosaic get_fwhm: self.fwhm = 3.79 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2783 3018 and amp range 2006 4053 and image y 3279 3513 and amp range 2040 4078 Range in image: x 0 236 , y 0 235 (with image size 236 x 235) dzp 0.012593497 -> scaling image by 1.0116665687010755 mosaic get_fwhm: self.fwhm = 6.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3945 4088 and amp range 2048 4095 and image y 2460 2698 and amp range 2022 4060 Range in image: x 0 144 , y 0 239 (with image size 144 x 239) dzp -0.019603321 -> scaling image by 0.9821066946375949 Faked up EXPNUM 82320171 Faked up EXPNUM 82320171 Faked up EXPNUM 82320171 90prime get_fwhm: self.fwhm = 3.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 501 639 and amp range 0 2015 and image y 2264 2402 and amp range 2048 4095 Range in image: x 0 139 , y 0 139 (with image size 139 x 139) dzp 0.0503617 -> scaling image by 1.047477444828492 Faked up EXPNUM 82260187 Faked up EXPNUM 82260187 Faked up EXPNUM 82260187 90prime get_fwhm: self.fwhm = 3.05 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2770 2906 and amp range 2016 4031 and image y 3731 3868 and amp range 2048 4095 Range in image: x 0 137 , y 0 138 (with image size 137 x 138) dzp -0.01723723 -> scaling image by 0.9842492857213068 Faked up EXPNUM 75810119 Faked up EXPNUM 75810119 Faked up EXPNUM 75810119 90prime get_fwhm: self.fwhm = 3.79 Found 4 relevant rows in amp-corrections file. Found overlap: image x 504 641 and amp range 0 2015 and image y 2254 2391 and amp range 2048 4095 Range in image: x 0 138 , y 0 138 (with image size 138 x 138) dzp 0.01693853 -> scaling image by 1.015723292931903 Faked up EXPNUM 82460199 Faked up EXPNUM 82460199 Faked up EXPNUM 82460199 90prime get_fwhm: self.fwhm = 2.95 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2778 2914 and amp range 2016 4031 and image y 3762 3898 and amp range 2048 4095 Range in image: x 0 137 , y 0 137 (with image size 137 x 137) dzp -0.0072602304 -> scaling image by 0.9933353884052984 Faked up EXPNUM 82260183 Faked up EXPNUM 82260183 Faked up EXPNUM 82260183 90prime get_fwhm: self.fwhm = 3.07 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2649 2788 and amp range 2016 4031 and image y 292 432 and amp range 0 2047 Range in image: x 0 140 , y 0 141 (with image size 140 x 141) dzp -0.019046262 -> scaling image by 0.9826107140833663 Faked up EXPNUM 82310187 Faked up EXPNUM 82310187 Faked up EXPNUM 82310187 90prime get_fwhm: self.fwhm = 2.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2650 2790 and amp range 2016 4031 and image y 313 453 and amp range 0 2047 Range in image: x 0 141 , y 0 141 (with image size 141 x 141) dzp -0.03177219 -> scaling image by 0.9711607558798585 Faked up EXPNUM 82580117 Faked up EXPNUM 82580117 Faked up EXPNUM 82580117 90prime get_fwhm: self.fwhm = 2.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 765 901 and amp range 0 2015 and image y 1787 1923 and amp range 0 2047 Range in image: x 0 137 , y 0 137 (with image size 137 x 137) dzp -0.039144866 -> scaling image by 0.9645884414840357 Faked up EXPNUM 79260081 Faked up EXPNUM 79260081 Faked up EXPNUM 79260081 90prime get_fwhm: self.fwhm = 3.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 771 907 and amp range 0 2015 and image y 1791 1927 and amp range 0 2047 Range in image: x 0 137 , y 0 137 (with image size 137 x 137) dzp -0.036130503 -> scaling image by 0.9672701794860779 Stage tims : Wall: 8.68 s, CPU: 1.02 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 171 MB, VmData: 205 MB, maxrss: 0.566576 MB Stage tims finished: 2020-06-07T18:31:31.866158 Resources for stage tims : 3.594 s worker CPU, 23.022 s worker Wall, Wall: 8.680 s, Cores in use: 0.53, Total efficiency (on 4 cores): 13.3 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T18:31:31.888285 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00666.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00741.fits Matched 1 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/metrics/cus/reference-custom-273299p63165.fits Stage refs : Wall: 4.37 s, CPU: 3.37 s, VmPeak: 983 MB, VmSize: 977 MB, VmRSS: 208 MB, VmData: 240 MB, maxrss: 0.566576 MB Stage refs finished: 2020-06-07T18:31:36.257096 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.370 s, Cores in use: 0.77, Total efficiency (on 4 cores): 19.3 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T18:31:36.258845 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/metrics/cus/outlier-mask-custom-273299p63165.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/metrics/cus/outliers-pre-custom-273299p63165.jpg Image ksb_180418_112022_ooi_g_ls9-CCD1 g : masking 105 positive outlier pixels and 0 negative outlier pixels Image ksb_180423_115418_ooi_r_ls9-CCD1 r : masking 122 positive outlier pixels and 0 negative outlier pixels Image k4m_170927_043228_ooi_zd_ls9-CCD4 z : masking 106 positive outlier pixels and 0 negative outlier pixels Image k4m_170928_044032_ooi_zd_ls9-CCD3 z : masking 5175 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/metrics/cus/outlier-mask-custom-273299p63165.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/metrics/cus/outliers-post-custom-273299p63165.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/metrics/cus/outliers-masked-pos-custom-273299p63165.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/metrics/cus/outliers-masked-neg-custom-273299p63165.jpg Stage outliers : Wall: 0.95 s, CPU: 0.72 s, VmPeak: 987 MB, VmSize: 987 MB, VmRSS: 219 MB, VmData: 250 MB, maxrss: 0.566576 MB Stage outliers finished: 2020-06-07T18:31:37.211072 Resources for stage outliers : 0.937 s worker CPU, 0.946 s worker Wall, Wall: 0.953 s, Cores in use: 1.74, Total efficiency (on 4 cores): 43.5 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T18:31:37.212878 Stage halos : Wall: 0.24 s, CPU: 0.23 s, VmPeak: 987 MB, VmSize: 987 MB, VmRSS: 219 MB, VmData: 250 MB, maxrss: 0.566576 MB Stage halos finished: 2020-06-07T18:31:37.454870 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.243 s, Cores in use: 0.96, Total efficiency (on 4 cores): 24.0 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T18:31:37.456419 PSF sigmas in coadd pixels: ['2.79', '2.25', '2.26', '2.49'] Using average PSF sigma 2.4473798229913544 Gaussian PSF norm 0.11526400157580882 vs pixelized 0.10116189 average tim pixel scale / coadd scale: 1.7297743272679709 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.47', '2.17', '2.04', '2.01'] Using average PSF sigma 2.171853793234561 Gaussian PSF norm 0.12988663999971742 vs pixelized 0.11262501 average tim pixel scale / coadd scale: 1.7301104431847494 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.60', '2.82', '1.47', '2.12'] Using average PSF sigma 2.0030546095126676 Gaussian PSF norm 0.14083230204218464 vs pixelized 0.11491093 average tim pixel scale / coadd scale: 0.9909949913258372 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.23 s, CPU: 0.19 s, VmPeak: 987 MB, VmSize: 987 MB, VmRSS: 222 MB, VmData: 251 MB, maxrss: 0.566576 MB Stage fit_on_coadds finished: 2020-06-07T18:31:37.686964 Resources for stage fit_on_coadds : 0.264 s worker CPU, 0.274 s worker Wall, Wall: 0.232 s, Cores in use: 1.97, Total efficiency (on 4 cores): 49.2 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T18:31:37.689849 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 26 potential peaks Of 26 potential peaks: 5 in veto map, 3 cut by saddle test, 0 cut by aper test, 18 kept SED z : 18 new peaks Found 35 potential peaks Of 35 potential peaks: 26 in veto map, 5 cut by saddle test, 0 cut by aper test, 4 kept SED r : 4 new peaks Found 36 potential peaks Of 36 potential peaks: 28 in veto map, 8 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 45 potential peaks Of 45 potential peaks: 36 in veto map, 8 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 46 potential peaks Of 46 potential peaks: 41 in veto map, 4 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 24 new sources Median coadd sky for g : 8.7569075e-05 Median coadd sky for r : 0.00022571516 Median coadd sky for z : -0.0007975913 Stage srcs : Wall: 0.54 s, CPU: 0.50 s, VmPeak: 987 MB, VmSize: 987 MB, VmRSS: 223 MB, VmData: 251 MB, maxrss: 0.566576 MB Stage srcs finished: 2020-06-07T18:31:38.232553 Resources for stage srcs : 0.094 s worker CPU, 0.106 s worker Wall, Wall: 0.544 s, Cores in use: 1.10, Total efficiency (on 4 cores): 27.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T18:31:38.245402 Blob 1 of 11, id: 4, sources: 15, size: 216x167, npix 21760, brick X: 0,216, Y: 28,195, one pixel: 101 28 Blob 2 of 11, id: 8, sources: 3, size: 35x65, npix 1800, brick X: 0,35, Y: 168,233, one pixel: 20 168 Blob 3 of 11, id: 7, sources: 1, size: 29x30, npix 581, brick X: 202,231, Y: 120,150, one pixel: 215 120 Blob 4 of 11, id: 9, sources: 1, size: 27x28, npix 494, brick X: 88,115, Y: 194,222, one pixel: 100 194 Blob 5 of 11, id: 5, sources: 1, size: 26x26, npix 416, brick X: 150,176, Y: 34,60, one pixel: 162 34 Blob 3 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141728 MB Blob 6 of 11, id: 2, sources: 1, size: 26x25, npix 409, brick X: 62,88, Y: 25,50, one pixel: 75 25 Blob 4 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14176 MB Blob 7 of 11, id: 6, sources: 1, size: 23x23, npix 328, brick X: 199,222, Y: 59,82, one pixel: 209 59 Blob 8 of 11, id: 1, sources: 1, size: 22x23, npix 314, brick X: 10,32, Y: 7,30, one pixel: 21 7 Blob 5 finished, total: Wall: 0.47 s, CPU: 0.47 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141728 MB Blob 9 of 11, id: 0, sources: 1, size: 27x16, npix 292, brick X: 129,156, Y: 0,16, one pixel: 131 0 Blob 6 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14176 MB Blob 10 of 11, id: 3, sources: 1, size: 16x23, npix 252, brick X: 0,16, Y: 28,51, one pixel: 5 28 Blob 7 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141728 MB Blob 11 of 11, id: 10, sources: 1, size: 19x18, npix 189, brick X: 54,73, Y: 214,232, one pixel: 62 214 Blob 8 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14176 MB Measuring 1 iterative sources Blob 10 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14176 MB Blob 9 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141784 MB Blob 11 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14176 MB Blob 2 finished, total: Wall: 2.77 s, CPU: 2.77 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.141992 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (273.31870, 63.16393), pm (1.2, -10.4), parallax 0.577 with NanoMaggies: g=22.1, r=(flux -293), z=16 Reset brightness to NanoMaggies: g=15.8, r=15.4, z=15.2 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.05038, ee1=-0.182637, ee2=-0.0111297 Measuring 12 iterative sources Blob 1 finished, total: Wall: 16.64 s, CPU: 16.64 s, VmPeak: 807 MB, VmSize: 723 MB, VmRSS: 156 MB, VmData: 189 MB, maxrss: 0.160172 MB Old catalog: 32 New catalog: 38 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/metrics/cus/blobs-custom-273299p63165.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/metrics/cus/all-models-custom-273299p63165.fits Stage fitblobs : Wall: 16.97 s, CPU: 0.31 s, VmPeak: 987 MB, VmSize: 987 MB, VmRSS: 223 MB, VmData: 251 MB, maxrss: 0.566576 MB Stage fitblobs finished: 2020-06-07T18:31:55.218523 Resources for stage fitblobs : 24.245 s worker CPU, 24.286 s worker Wall, Wall: 16.974 s, Cores in use: 1.45, Total efficiency (on 4 cores): 36.2 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T18:31:55.220492 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/tmp-legacysurvey-custom-273299p63165-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/tmp-legacysurvey-custom-273299p63165-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/tmp-legacysurvey-custom-273299p63165-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/tmp-legacysurvey-custom-273299p63165-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-resid.jpg Stage coadds : Wall: 1.19 s, CPU: 0.50 s, VmPeak: 987 MB, VmSize: 987 MB, VmRSS: 223 MB, VmData: 251 MB, maxrss: 0.566576 MB Stage coadds finished: 2020-06-07T18:31:56.407307 Resources for stage coadds : 2.047 s worker CPU, 2.148 s worker Wall, Wall: 1.188 s, Cores in use: 2.15, Total efficiency (on 4 cores): 53.7 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T18:31:56.408831 Cut to 1 unWISE tiles Reading WISE tile 2741p636 band 1 Reading WISE tile 2741p636 band 2 Reading WISE tile 2741p636 band 3 Reading WISE tile 2741p636 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 807 MB, VmSize: 798 MB, VmRSS: 155 MB, VmData: 180 MB, maxrss: 0.201744 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 806 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.208728 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 806 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 174 MB, maxrss: 0.206808 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 806 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.208856 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/tmp-legacysurvey-custom-273299p63165-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/tmp-legacysurvey-custom-273299p63165-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.40 s, CPU: 0.46 s, VmPeak: 987 MB, VmSize: 987 MB, VmRSS: 224 MB, VmData: 251 MB, maxrss: 0.566576 MB Stage wise_forced finished: 2020-06-07T18:31:58.811236 Resources for stage wise_forced : 4.502 s worker CPU, 6.181 s worker Wall, Wall: 2.404 s, Cores in use: 2.07, Total efficiency (on 4 cores): 51.7 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T18:31:58.813099 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63165/legacysurvey-custom-273299p63165-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/tractor-i/cus/tractor-custom-273299p63165.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/tractor/cus/tractor-custom-273299p63165.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/tractor/cus/brick-custom-273299p63165.sha256sum Stage writecat : Wall: 0.81 s, CPU: 0.56 s, VmPeak: 1119 MB, VmSize: 991 MB, VmRSS: 226 MB, VmData: 251 MB, maxrss: 0.566576 MB Stage writecat finished: 2020-06-07T18:31:59.618731 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.807 s, Cores in use: 0.70, Total efficiency (on 4 cores): 17.5 % Stage writecat finished All done: 35.685 s worker CPU, 56.965 s worker Wall, Wall: 36.437 s, Cores in use: 1.20, Total efficiency (on 4 cores): 29.9 % Finished galaxy PGC2650796 in 0.650 minutes. Started working on galaxy PGC2650796 at Fri Aug 7 09:16:52 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.2991685587903 63.16481078017001 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T09:16:54.538502 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '273.2991685587903', '63.16481078017001', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.2991685587903 63.16481078017001 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 273.2991685587903 63.16481078017001 Starting process 33544 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 33546 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 33548 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 33550 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 33552 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 33554 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059556 MB Starting process 33556 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059556 MB Starting process 33557 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 33560 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 33562 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 33564 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 33566 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 33568 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 33570 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 33572 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 33574 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T09:16:56.968385 Keeping 12 CCDs: k4m_170604_111518_ooi_zd_ls9-CCD1 z expnum 131706 exptime 95.104 propid 2016A-0453 seeing 0.98 MJD 57908.469 object MzLS_696535_z mosaic/CP/V4.3/CP20170603/k4m_170604_111518_ooi_zd_ls9.fits.fz k4m_170927_043228_ooi_zd_ls9-CCD4 z expnum 141016 exptime 184.105 propid 2016A-0453 seeing 1.74 MJD 58023.189 object MzLS_695392_z mosaic/CP/V4.3/CP20170926/k4m_170927_043228_ooi_zd_ls9.fits.fz k4m_171029_040850_ooi_zd_ls9-CCD2 z expnum 143914 exptime 97.103 propid 2016A-0453 seeing 0.91 MJD 58055.173 object MzLS_695966_z mosaic/CP/V4.3/CP20171028/k4m_171029_040850_ooi_zd_ls9.fits.fz k4m_170928_044032_ooi_zd_ls9-CCD3 z expnum 141148 exptime 194.102 propid 2016A-0453 seeing 1.31 MJD 58024.195 object MzLS_697100_z mosaic/CP/V4.3/CP20170927/k4m_170928_044032_ooi_zd_ls9.fits.fz ksb_180424_114352_ooi_r_ls9-CCD2 r expnum 82320171 exptime 126.608 propid BASS seeing 1.52 MJD 58232.489 object 40582 90prime/CP/V2.3/CP20180423/ksb_180424_114352_ooi_r_ls9.fits.fz ksb_160712_083115_ooi_g_ls9-CCD2 g expnum 75810119 exptime 97.4 propid BASS seeing 1.72 MJD 57581.355 object 40582 90prime/CP/V2.3/CP20160711/ksb_160712_083115_ooi_g_ls9.fits.fz ksb_180418_112943_ooi_g_ls9-CCD3 g expnum 82260187 exptime 100.377 propid BASS seeing 1.38 MJD 58226.479 object 40591 90prime/CP/V2.3/CP20180417/ksb_180418_112943_ooi_g_ls9.fits.fz ksb_180508_100728_ooi_r_ls9-CCD3 r expnum 82460199 exptime 107.978 propid NOTBASS seeing 1.34 MJD 58246.422 object 40591 90prime/CP/V2.3/CP20180507/ksb_180508_100728_ooi_r_ls9.fits.fz ksb_180418_112022_ooi_g_ls9-CCD1 g expnum 82260183 exptime 96.871 propid BASS seeing 1.39 MJD 58226.472 object 40581 90prime/CP/V2.3/CP20180417/ksb_180418_112022_ooi_g_ls9.fits.fz ksb_180423_115418_ooi_r_ls9-CCD1 r expnum 82310187 exptime 250.0 propid BASS seeing 1.26 MJD 58231.496 object 40581 90prime/CP/V2.3/CP20180422/ksb_180423_115418_ooi_r_ls9.fits.fz ksb_180520_095338_ooi_r_ls9-CCD3 r expnum 82580117 exptime 101.06 propid NOTBASS seeing 1.24 MJD 58258.412 object 40593 90prime/CP/V2.3/CP20180519/ksb_180520_095338_ooi_r_ls9.fits.fz ksb_170622_064356_ooi_g_ls9-CCD3 g expnum 79260081 exptime 140.88 propid 2015A-0801 seeing 1.54 MJD 57926.281 object 40593 90prime/CP/V2.3/CP20170621/ksb_170622_064356_ooi_g_ls9.fits.fz mosaic get_fwhm: self.fwhm = 3.79 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2779 3014 and amp range 2006 4053 and image y 3276 3510 and amp range 2040 4078 Range in image: x 0 236 , y 0 235 (with image size 236 x 235) dzp 0.012593497 -> scaling image by 1.0116665687010755 mosaic get_fwhm: self.fwhm = 6.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3941 4088 and amp range 2048 4095 and image y 2457 2696 and amp range 2022 4060 Range in image: x 0 148 , y 0 240 (with image size 148 x 240) dzp -0.019603321 -> scaling image by 0.9821066946375949 mosaic get_fwhm: self.fwhm = 3.49 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1196 1431 and amp range 0 2047 and image y 3414 3649 and amp range 2040 4078 Range in image: x 0 236 , y 0 236 (with image size 236 x 236) dzp 0.003927584 -> scaling image by 1.0036239891963392 Faked up EXPNUM 82260183 Faked up EXPNUM 82260183 Faked up EXPNUM 82260183 90prime get_fwhm: self.fwhm = 3.07 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2651 2790 and amp range 2016 4031 and image y 294 433 and amp range 0 2047 Range in image: x 0 140 , y 0 140 (with image size 140 x 140) dzp -0.019046262 -> scaling image by 0.9826107140833663 Faked up EXPNUM 82260187 Faked up EXPNUM 82260187 Faked up EXPNUM 82260187 90prime get_fwhm: self.fwhm = 3.05 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2772 2909 and amp range 2016 4031 and image y 3733 3869 and amp range 2048 4095 Range in image: x 0 138 , y 0 137 (with image size 138 x 137) dzp -0.01723723 -> scaling image by 0.9842492857213068 Faked up EXPNUM 82320171 Faked up EXPNUM 82320171 Faked up EXPNUM 82320171 90prime get_fwhm: self.fwhm = 3.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 504 641 and amp range 0 2015 and image y 2266 2403 and amp range 2048 4095 Range in image: x 0 138 , y 0 138 (with image size 138 x 138) dzp 0.0503617 -> scaling image by 1.047477444828492 Faked up EXPNUM 82460199 Faked up EXPNUM 82460199 Faked up EXPNUM 82460199 90prime get_fwhm: self.fwhm = 2.95 Found 4 relevant rows in amp-corrections file. Faked up EXPNUM 82310187 Faked up EXPNUM 82310187 Faked up EXPNUM 82310187 90prime get_fwhm: self.fwhm = 2.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2653 2792 and amp range 2016 4031 and image y 315 454 and amp range 0 2047 Range in image: x 0 140 , y 0 140 (with image size 140 x 140) dzp -0.03177219 -> scaling image by 0.9711607558798585 Found overlap: image x 2780 2916 and amp range 2016 4031 and image y 3763 3900 and amp range 2048 4095 Range in image: x 0 137 , y 0 138 (with image size 137 x 138) dzp -0.0072602304 -> scaling image by 0.9933353884052984 Faked up EXPNUM 82580117 Faked up EXPNUM 82580117 Faked up EXPNUM 82580117 90prime get_fwhm: self.fwhm = 2.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 768 903 and amp range 0 2015 and image y 1788 1924 and amp range 0 2047 Range in image: x 0 136 , y 0 137 (with image size 136 x 137) dzp -0.039144866 -> scaling image by 0.9645884414840357 Faked up EXPNUM 75810119 Faked up EXPNUM 75810119 Faked up EXPNUM 75810119 90prime get_fwhm: self.fwhm = 3.79 Found 4 relevant rows in amp-corrections file. Found overlap: image x 507 644 and amp range 0 2015 and image y 2255 2393 and amp range 2048 4095 Range in image: x 0 138 , y 0 139 (with image size 138 x 139) dzp 0.01693853 -> scaling image by 1.015723292931903 mosaic get_fwhm: self.fwhm = 5.03 Found 4 relevant rows in amp-corrections file. Found overlap: image x 63 304 and amp range 0 2005 and image y 2280 2523 and amp range 2040 4078 Range in image: x 0 242 , y 0 244 (with image size 242 x 244) dzp 0.01523814 -> scaling image by 1.014133796220052 Faked up EXPNUM 79260081 Faked up EXPNUM 79260081 Faked up EXPNUM 79260081 90prime get_fwhm: self.fwhm = 3.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 773 910 and amp range 0 2015 and image y 1793 1929 and amp range 0 2047 Range in image: x 0 138 , y 0 137 (with image size 138 x 137) dzp -0.036130503 -> scaling image by 0.9672701794860779 Stage tims : Wall: 130.00 s, CPU: 1.62 s, VmPeak: 952 MB, VmSize: 952 MB, VmRSS: 174 MB, VmData: 207 MB, maxrss: 0.177668 MB Stage tims finished: 2020-08-07T09:19:06.968202 Resources for stage tims : 6.247 s worker CPU, 577.245 s worker Wall, Wall: 130.001 s, Cores in use: 0.06, Total efficiency (on 16 cores): 0.4 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T09:19:06.989061 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00666.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00741.fits Matched 1 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/metrics/cus/reference-custom-273299p63164.fits Stage refs : Wall: 4.21 s, CPU: 3.10 s, VmPeak: 993 MB, VmSize: 987 MB, VmRSS: 210 MB, VmData: 243 MB, maxrss: 0.215256 MB Stage refs finished: 2020-08-07T09:19:11.197005 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.209 s, Cores in use: 0.74, Total efficiency (on 16 cores): 4.6 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T09:19:11.218142 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/metrics/cus/outlier-mask-custom-273299p63164.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/metrics/cus/outliers-pre-custom-273299p63164.jpg Image ksb_180418_112022_ooi_g_ls9-CCD1 g : masking 108 positive outlier pixels and 0 negative outlier pixels Image ksb_180423_115418_ooi_r_ls9-CCD1 r : masking 123 positive outlier pixels and 0 negative outlier pixels Image k4m_170928_044032_ooi_zd_ls9-CCD3 z : masking 5279 positive outlier pixels and 244 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/metrics/cus/outlier-mask-custom-273299p63164.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/metrics/cus/outliers-post-custom-273299p63164.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/metrics/cus/outliers-masked-pos-custom-273299p63164.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/metrics/cus/outliers-masked-neg-custom-273299p63164.jpg Stage outliers : Wall: 0.86 s, CPU: 0.64 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 225 MB, VmData: 255 MB, maxrss: 0.230072 MB Stage outliers finished: 2020-08-07T09:19:12.075710 Resources for stage outliers : 0.816 s worker CPU, 0.961 s worker Wall, Wall: 0.859 s, Cores in use: 1.70, Total efficiency (on 16 cores): 10.6 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T09:19:12.199081 Stage halos : Wall: 0.35 s, CPU: 0.34 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 225 MB, VmData: 255 MB, maxrss: 0.230396 MB Stage halos finished: 2020-08-07T09:19:12.551120 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.353 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T09:19:12.576223 PSF sigmas in coadd pixels: ['2.79', '2.25', '2.26', '2.49'] Using average PSF sigma 2.4473798229913544 Gaussian PSF norm 0.11526400157580882 vs pixelized 0.10116273 average tim pixel scale / coadd scale: 1.7297743272679709 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.47', '2.17', '2.04', '2.01'] Using average PSF sigma 2.171853793234561 Gaussian PSF norm 0.12988663999971742 vs pixelized 0.11262151 average tim pixel scale / coadd scale: 1.7301104431847494 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.60', '2.82', '1.47', '2.12'] Using average PSF sigma 2.0030546095126676 Gaussian PSF norm 0.14083230204218464 vs pixelized 0.11490579 average tim pixel scale / coadd scale: 0.9909949913258372 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.16 s, CPU: 0.16 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 227 MB, VmData: 255 MB, maxrss: 0.232008 MB Stage fit_on_coadds finished: 2020-08-07T09:19:12.740460 Resources for stage fit_on_coadds : 0.204 s worker CPU, 0.204 s worker Wall, Wall: 0.166 s, Cores in use: 2.21, Total efficiency (on 16 cores): 13.8 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T09:19:12.750130 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 288 potential peaks Of 288 potential peaks: 271 in veto map, 2 cut by saddle test, 0 cut by aper test, 15 kept SED z : 15 new peaks Found 34 potential peaks Of 34 potential peaks: 21 in veto map, 6 cut by saddle test, 0 cut by aper test, 7 kept SED r : 7 new peaks Found 35 potential peaks Of 35 potential peaks: 27 in veto map, 8 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 54 potential peaks Of 54 potential peaks: 47 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 51 potential peaks Of 51 potential peaks: 47 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 23 new sources Median coadd sky for g : 8.353383e-05 Median coadd sky for r : 0.00021548045 Median coadd sky for z : -0.00088667823 Stage srcs : Wall: 0.57 s, CPU: 0.54 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 227 MB, VmData: 255 MB, maxrss: 0.232364 MB Stage srcs finished: 2020-08-07T09:19:13.319465 Resources for stage srcs : 0.075 s worker CPU, 0.075 s worker Wall, Wall: 0.571 s, Cores in use: 1.07, Total efficiency (on 16 cores): 6.7 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T09:19:13.329632 Blob 1 of 8, id: 3, sources: 17, size: 233x167, npix 24239, brick X: 0,233, Y: 32,199, one pixel: 97 32 Blob 2 of 8, id: 6, sources: 3, size: 31x62, npix 1534, brick X: 0,31, Y: 171,233, one pixel: 19 171 Blob 3 of 8, id: 7, sources: 1, size: 27x27, npix 484, brick X: 85,112, Y: 198,225, one pixel: 96 198 Blob 4 of 8, id: 0, sources: 1, size: 30x20, npix 417, brick X: 125,155, Y: 0,20, one pixel: 129 0 Blob 5 of 8, id: 2, sources: 1, size: 25x25, npix 408, brick X: 60,85, Y: 29,54, one pixel: 72 29 Blob 6 of 8, id: 4, sources: 1, size: 26x26, npix 408, brick X: 148,174, Y: 38,64, one pixel: 159 38 Blob 7 of 8, id: 5, sources: 1, size: 23x23, npix 327, brick X: 197,220, Y: 63,86, one pixel: 206 63 Blob 8 of 8, id: 1, sources: 1, size: 23x23, npix 317, brick X: 7,30, Y: 11,34, one pixel: 18 11 Blob 8 finished, total: Wall: 0.18 s, CPU: 0.17 s, VmPeak: 803 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.14512 MB Blob 7 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 805 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 183 MB, maxrss: 0.14488 MB Blob 6 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145572 MB Blob 5 finished, total: Wall: 0.44 s, CPU: 0.44 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145892 MB Blob 3 finished, total: Wall: 0.47 s, CPU: 0.47 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.09494 MB Blob 4 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145092 MB Measuring 1 iterative sources Blob 2 finished, total: Wall: 1.65 s, CPU: 1.64 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147328 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.78498, ee1=-0.138541, ee2=-0.0204239 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (273.31870, 63.16393), pm (1.2, -10.4), parallax 0.577 with NanoMaggies: g=16.7, r=(flux -6.24e+03), z=15.4 Reset brightness to NanoMaggies: g=15.8, r=15.4, z=15.2 Measuring 8 iterative sources Blob 1 finished, total: Wall: 12.21 s, CPU: 12.18 s, VmPeak: 792 MB, VmSize: 736 MB, VmRSS: 159 MB, VmData: 191 MB, maxrss: 0.163208 MB Old catalog: 32 New catalog: 29 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/metrics/cus/blobs-custom-273299p63164.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/metrics/cus/all-models-custom-273299p63164.fits Stage fitblobs : Wall: 18.80 s, CPU: 0.37 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 228 MB, VmData: 255 MB, maxrss: 0.233544 MB Stage fitblobs finished: 2020-08-07T09:19:32.126227 Resources for stage fitblobs : 16.141 s worker CPU, 16.208 s worker Wall, Wall: 18.798 s, Cores in use: 0.88, Total efficiency (on 16 cores): 5.5 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T09:19:32.153273 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/tmp-legacysurvey-custom-273299p63164-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/tmp-legacysurvey-custom-273299p63164-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/tmp-legacysurvey-custom-273299p63164-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/tmp-legacysurvey-custom-273299p63164-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-resid.jpg Stage coadds : Wall: 8.95 s, CPU: 0.62 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 229 MB, VmData: 255 MB, maxrss: 0.234056 MB Stage coadds finished: 2020-08-07T09:19:41.099347 Resources for stage coadds : 7.451 s worker CPU, 8.951 s worker Wall, Wall: 8.948 s, Cores in use: 0.90, Total efficiency (on 16 cores): 5.6 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T09:19:41.111214 Cut to 1 unWISE tiles Reading WISE tile 2741p636 band 1 Reading WISE tile 2741p636 band 2 Reading WISE tile 2741p636 band 4 Reading WISE tile 2741p636 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 810 MB, VmSize: 797 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.203528 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 805 MB, VmSize: 797 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.203792 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 810 MB, VmSize: 798 MB, VmRSS: 143 MB, VmData: 176 MB, maxrss: 0.183376 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p636/unwise-2741p636-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 809 MB, VmSize: 792 MB, VmRSS: 137 MB, VmData: 171 MB, maxrss: 0.200804 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/tmp-legacysurvey-custom-273299p63164-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/tmp-legacysurvey-custom-273299p63164-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.00 s, CPU: 0.56 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 229 MB, VmData: 255 MB, maxrss: 0.234772 MB Stage wise_forced finished: 2020-08-07T09:19:44.111155 Resources for stage wise_forced : 3.034 s worker CPU, 6.729 s worker Wall, Wall: 3.001 s, Cores in use: 1.20, Total efficiency (on 16 cores): 7.5 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T09:19:44.123345 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/coadd/cus/custom-273299p63164/legacysurvey-custom-273299p63164-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/tractor-i/cus/tractor-custom-273299p63164.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/tractor/cus/tractor-custom-273299p63164.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/tractor/cus/brick-custom-273299p63164.sha256sum Stage writecat : Wall: 0.93 s, CPU: 0.61 s, VmPeak: 1130 MB, VmSize: 1002 MB, VmRSS: 231 MB, VmData: 255 MB, maxrss: 0.367824 MB Stage writecat finished: 2020-08-07T09:19:45.050191 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.928 s, Cores in use: 0.66, Total efficiency (on 16 cores): 4.1 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2650796/PGC2650796-largegalaxy-writecat.p All done: 33.972 s worker CPU, 610.376 s worker Wall, Wall: 168.110 s, Cores in use: 0.25, Total efficiency (on 16 cores): 1.6 % Finished galaxy PGC2650796 in 2.881 minutes.