Started working on galaxy PGC2659530 at Sun Jun 7 17:26:35 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 128.656125 63.680194400000005 --width 323 --height 323 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/PGC2659530-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/PGC2659530-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T17:26:37.992813 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '128.656125', '63.680194400000005', '--width', '323', '--height', '323', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/PGC2659530-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/PGC2659530-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 128.656125 63.680194400000005 --width 323 --height 323 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/PGC2659530-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/PGC2659530-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 128.656125 63.680194400000005 Starting process 24126 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 24127 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 24129 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 24131 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T17:26:38.493365 Keeping 10 CCDs: k4m_170402_045453_ooi_zd_ls9.fits.fz k4m_170402_045453_ooi_zd_ls9-CCD2 z exptime 102.103 propid 2016A-0453 seeing 1.51 MJD 57845.205 object MzLS_696987_z k4m_170402_045453_ooi_zd_ls9.fits.fz k4m_170402_045453_ooi_zd_ls9-CCD4 z exptime 102.103 propid 2016A-0453 seeing 1.43 MJD 57845.205 object MzLS_696987_z k4m_170405_045809_ooi_zd_ls9.fits.fz k4m_170405_045809_ooi_zd_ls9-CCD1 z exptime 105.104 propid 2016A-0453 seeing 0.92 MJD 57848.207 object MzLS_698109_z k4m_171008_105648_ooi_zd_ls9.fits.fz k4m_171008_105648_ooi_zd_ls9-CCD2 z exptime 149.103 propid 2016A-0453 seeing 0.99 MJD 58034.456 object MzLS_697550_z ksb_180410_061233_ooi_g_ls9.fits.fz ksb_180410_061233_ooi_g_ls9-CCD3 g exptime 250.0 propid BASS seeing 1.42 MJD 58218.259 object 39932 ksb_190131_091241_ooi_r_ls9.fits.fz ksb_190131_091241_ooi_r_ls9-CCD3 r exptime 98.96 propid NOTBASS seeing 1.19 MJD 58514.384 object ksb_190107_114553_ooi_g_ls9.fits.fz ksb_190107_114553_ooi_g_ls9-CCD4 g exptime 110.766 propid NOTBASS seeing 1.31 MJD 58490.490 object ksb_180419_044240_ooi_r_ls9.fits.fz ksb_180419_044240_ooi_r_ls9-CCD4 r exptime 242.764 propid BASS seeing 1.54 MJD 58227.196 object 40841 ksb_180321_075352_ooi_r_ls9.fits.fz ksb_180321_075352_ooi_r_ls9-CCD4 r exptime 125.067 propid BASS seeing 1.29 MJD 58198.329 object 40843 ksb_181213_113224_ooi_g_ls9.fits.fz ksb_181213_113224_ooi_g_ls9-CCD4 g exptime 250.0 propid NOTBASS seeing 2.85 MJD 58465.481 object mosaic get_fwhm: self.fwhm = 3.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 188 515 and amp range 0 2047 and image y 2103 2430 and amp range 2040 4078 Range in image: x 0 328 , y 0 328 (with image size 328 x 328) dzp 0.003927584 -> scaling image by 1.0036239891963392 mosaic get_fwhm: self.fwhm = 3.53 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1750 2077 and amp range 0 2005 and image y 2137 2467 and amp range 2040 4078 Range in image: x 0 256 , y 0 331 (with image size 328 x 331) dzp 0.032569118 -> scaling image by 1.0304517167935139 Found overlap: image x 1750 2077 and amp range 2006 4053 and image y 2137 2467 and amp range 2040 4078 Range in image: x 256 328 , y 0 331 (with image size 328 x 331) dzp 0.012593497 -> scaling image by 1.0116665687010755 mosaic get_fwhm: self.fwhm = 5.49 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2887 3216 and amp range 2048 4095 and image y 0 84 and amp range 0 2021 Range in image: x 0 330 , y 0 85 (with image size 330 x 85) dzp -0.03444113 -> scaling image by 0.9687763957004109 Faked up EXPNUM 82180080 Faked up EXPNUM 82180080 Faked up EXPNUM 82180080 90prime get_fwhm: self.fwhm = 3.13 Found 4 relevant rows in amp-corrections file. Found overlap: image x 598 789 and amp range 0 2015 and image y 2904 3093 and amp range 2048 4095 Range in image: x 0 192 , y 0 190 (with image size 192 x 190) dzp -0.027600318 -> scaling image by 0.9748995562775561 Faked up EXPNUM 84900057 Faked up EXPNUM 84900057 Faked up EXPNUM 84900057 90prime get_fwhm: self.fwhm = 2.89 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2386 2575 and amp range 2016 4031 and image y 1925 2114 and amp range 0 2047 Range in image: x 0 190 , y 0 123 (with image size 190 x 190) dzp 0.01073364 -> scaling image by 1.0099350760198083 Found overlap: image x 2386 2575 and amp range 2016 4031 and image y 1925 2114 and amp range 2048 4095 Range in image: x 0 190 , y 123 190 (with image size 190 x 190) dzp 0.008089546 -> scaling image by 1.0074785731993958 Faked up EXPNUM 85140170 Faked up EXPNUM 85140170 Faked up EXPNUM 85140170 90prime get_fwhm: self.fwhm = 2.63 Found 4 relevant rows in amp-corrections file. Found overlap: image x 583 775 and amp range 0 2015 and image y 2890 3080 and amp range 2048 4095 Range in image: x 0 193 , y 0 191 (with image size 193 x 191) dzp -0.049615838 -> scaling image by 0.9553305476021174 Faked up EXPNUM 81980062 Faked up EXPNUM 81980062 Faked up EXPNUM 81980062 90prime get_fwhm: self.fwhm = 2.85 Found 4 relevant rows in amp-corrections file. Found overlap: image x 400 587 and amp range 0 2015 and image y 15 115 and amp range 0 2047 Range in image: x 0 188 , y 0 101 (with image size 188 x 101) dzp 0.014080205 -> scaling image by 1.0130528017623828 Faked up EXPNUM 82270047 Faked up EXPNUM 82270047 Faked up EXPNUM 82270047 90prime get_fwhm: self.fwhm = 3.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2407 2594 and amp range 2016 4031 and image y 1911 2100 and amp range 0 2047 Range in image: x 0 188 , y 0 137 (with image size 188 x 190) dzp 0.043530058 -> scaling image by 1.0409072255640852 Found overlap: image x 2407 2594 and amp range 2016 4031 and image y 1911 2100 and amp range 2048 4095 Range in image: x 0 188 , y 137 190 (with image size 188 x 190) dzp 0.044050463 -> scaling image by 1.0414062625929388 Faked up EXPNUM 84650118 Faked up EXPNUM 84650118 Faked up EXPNUM 84650118 90prime get_fwhm: self.fwhm = 6.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 407 593 and amp range 0 2015 and image y 15 104 and amp range 0 2047 Range in image: x 0 187 , y 0 90 (with image size 187 x 90) dzp 0.003375487 -> scaling image by 1.0031137761215583 Stage tims : Wall: 7.23 s, CPU: 0.94 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 171 MB, VmData: 205 MB, maxrss: 0.566588 MB Stage tims finished: 2020-06-07T17:26:45.721920 Resources for stage tims : 3.527 s worker CPU, 13.668 s worker Wall, Wall: 7.230 s, Cores in use: 0.62, Total efficiency (on 4 cores): 15.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/PGC2659530-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/PGC2659530-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T17:26:45.743997 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00568.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00637.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00711.fits Matched 8 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/metrics/cus/reference-custom-128656p63680.fits Stage refs : Wall: 3.23 s, CPU: 2.02 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 192 MB, VmData: 224 MB, maxrss: 0.566588 MB Stage refs finished: 2020-06-07T17:26:48.978960 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.236 s, Cores in use: 0.63, Total efficiency (on 4 cores): 15.7 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T17:26:48.980392 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/metrics/cus/outlier-mask-custom-128656p63680.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/metrics/cus/outliers-pre-custom-128656p63680.jpg Image ksb_190107_114553_ooi_g_ls9-CCD4 g : masking 163 positive outlier pixels and 0 negative outlier pixels Image ksb_180321_075352_ooi_r_ls9-CCD4 r : masking 106 positive outlier pixels and 0 negative outlier pixels Image ksb_180419_044240_ooi_r_ls9-CCD4 r : masking 692 positive outlier pixels and 161 negative outlier pixels Image k4m_171008_105648_ooi_zd_ls9-CCD2 z : masking 1176 positive outlier pixels and 0 negative outlier pixels Image k4m_170405_045809_ooi_zd_ls9-CCD1 z : masking 1585 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/metrics/cus/outlier-mask-custom-128656p63680.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/metrics/cus/outliers-post-custom-128656p63680.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/metrics/cus/outliers-masked-pos-custom-128656p63680.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/metrics/cus/outliers-masked-neg-custom-128656p63680.jpg Stage outliers : Wall: 1.66 s, CPU: 1.27 s, VmPeak: 972 MB, VmSize: 957 MB, VmRSS: 195 MB, VmData: 225 MB, maxrss: 0.566588 MB Stage outliers finished: 2020-06-07T17:26:50.635541 Resources for stage outliers : 1.082 s worker CPU, 1.096 s worker Wall, Wall: 1.656 s, Cores in use: 1.42, Total efficiency (on 4 cores): 35.6 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T17:26:50.637401 Stage halos : Wall: 0.49 s, CPU: 0.48 s, VmPeak: 972 MB, VmSize: 957 MB, VmRSS: 195 MB, VmData: 225 MB, maxrss: 0.566588 MB Stage halos finished: 2020-06-07T17:26:51.129455 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.493 s, Cores in use: 0.98, Total efficiency (on 4 cores): 24.5 % Stage halos finished Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-06-07T17:26:51.131211 PSF sigmas in coadd pixels: ['2.30', '2.13', '4.62'] Using average PSF sigma 3.0184534372153684 Gaussian PSF norm 0.09345673128359426 vs pixelized 0.0721841 average tim pixel scale / coadd scale: 1.731325955777109 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.94', '2.50', '2.10'] Using average PSF sigma 2.177841768611048 Gaussian PSF norm 0.12952951671681293 vs pixelized 0.10703226 average tim pixel scale / coadd scale: 1.7309745103618457 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.31', '1.49', '1.61'] Using average PSF sigma 1.8034059190557077 Gaussian PSF norm 0.15642334806219751 vs pixelized 0.13084616 average tim pixel scale / coadd scale: 0.9909616996541277 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.24 s, CPU: 0.19 s, VmPeak: 972 MB, VmSize: 957 MB, VmRSS: 199 MB, VmData: 227 MB, maxrss: 0.566588 MB Stage fit_on_coadds finished: 2020-06-07T17:26:51.371823 Resources for stage fit_on_coadds : 0.252 s worker CPU, 0.265 s worker Wall, Wall: 0.242 s, Cores in use: 1.81, Total efficiency (on 4 cores): 45.4 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T17:26:51.374180 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 23 potential peaks Of 23 potential peaks: 10 in veto map, 1 cut by saddle test, 0 cut by aper test, 12 kept SED z : 12 new peaks Found 96 potential peaks Of 96 potential peaks: 84 in veto map, 10 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 30 potential peaks Of 30 potential peaks: 27 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 83 potential peaks Of 83 potential peaks: 71 in veto map, 9 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 90 potential peaks Of 90 potential peaks: 76 in veto map, 12 cut by saddle test, 2 cut by aper test, 0 kept SED Red : 0 new peaks Adding 17 new sources Median coadd sky for g : 0.00027117928 Median coadd sky for r : 0.0011334457 Median coadd sky for z : 0.00013702388 Stage srcs : Wall: 1.31 s, CPU: 1.22 s, VmPeak: 972 MB, VmSize: 957 MB, VmRSS: 199 MB, VmData: 227 MB, maxrss: 0.566588 MB Stage srcs finished: 2020-06-07T17:26:52.688399 Resources for stage srcs : 0.195 s worker CPU, 0.195 s worker Wall, Wall: 1.315 s, Cores in use: 1.08, Total efficiency (on 4 cores): 27.0 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/PGC2659530-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/PGC2659530-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T17:26:52.791555 Blob 1 of 11, id: 2, sources: 7, size: 256x262, npix 33886, brick X: 30,286, Y: 8,270, one pixel: 147 8 Blob 2 of 11, id: 8, sources: 2, size: 62x71, npix 2961, brick X: 11,73, Y: 246,317, one pixel: 38 246 Blob 3 of 11, id: 0, sources: 4, size: 54x98, npix 2632, brick X: 269,323, Y: 0,98, one pixel: 278 0 Blob 4 of 11, id: 5, sources: 1, size: 40x46, npix 1128, brick X: 47,87, Y: 150,196, one pixel: 64 150 Blob 5 of 11, id: 4, sources: 1, size: 24x41, npix 749, brick X: 0,24, Y: 150,191, one pixel: 5 150 Blob 4 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142736 MB Blob 6 of 11, id: 9, sources: 1, size: 28x32, npix 622, brick X: 295,323, Y: 278,310, one pixel: 310 278 Blob 5 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142736 MB Blob 7 of 11, id: 10, sources: 1, size: 26x25, npix 402, brick X: 119,145, Y: 293,318, one pixel: 130 293 Blob 6 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142736 MB Blob 8 of 11, id: 1, sources: 1, size: 26x24, npix 400, brick X: 201,227, Y: 4,28, one pixel: 210 4 Blob 7 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142736 MB Blob 9 of 11, id: 6, sources: 1, size: 23x23, npix 337, brick X: 239,262, Y: 165,188, one pixel: 248 165 Blob 10 of 11, id: 7, sources: 1, size: 24x23, npix 328, brick X: 53,77, Y: 213,236, one pixel: 65 213 Measuring 1 iterative sources Blob 8 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142736 MB Blob 2 finished, total: Wall: 3.22 s, CPU: 3.22 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144476 MB Blob 11 of 11, id: 3, sources: 1, size: 19x20, npix 227, brick X: 304,323, Y: 104,124, one pixel: 313 104 Blob 9 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142736 MB Blob 10 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144476 MB Blob 11 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142736 MB Blob 3 finished, total: Wall: 3.43 s, CPU: 3.42 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.14386 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.662217, ee1=0.262221, ee2=-0.0717216 Measuring 5 iterative sources Blob 1 finished, total: Wall: 19.62 s, CPU: 19.62 s, VmPeak: 803 MB, VmSize: 723 MB, VmRSS: 157 MB, VmData: 189 MB, maxrss: 0.174672 MB Old catalog: 25 New catalog: 23 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/metrics/cus/blobs-custom-128656p63680.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/metrics/cus/all-models-custom-128656p63680.fits Stage fitblobs : Wall: 20.05 s, CPU: 0.39 s, VmPeak: 972 MB, VmSize: 957 MB, VmRSS: 200 MB, VmData: 227 MB, maxrss: 0.566588 MB Stage fitblobs finished: 2020-06-07T17:27:12.840675 Resources for stage fitblobs : 29.796 s worker CPU, 29.830 s worker Wall, Wall: 20.050 s, Cores in use: 1.51, Total efficiency (on 4 cores): 37.6 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T17:27:12.842659 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/tmp-legacysurvey-custom-128656p63680-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/tmp-legacysurvey-custom-128656p63680-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/tmp-legacysurvey-custom-128656p63680-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/tmp-legacysurvey-custom-128656p63680-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-resid.jpg Stage coadds : Wall: 1.40 s, CPU: 0.69 s, VmPeak: 972 MB, VmSize: 957 MB, VmRSS: 201 MB, VmData: 228 MB, maxrss: 0.566588 MB Stage coadds finished: 2020-06-07T17:27:14.243796 Resources for stage coadds : 2.094 s worker CPU, 2.182 s worker Wall, Wall: 1.402 s, Cores in use: 1.98, Total efficiency (on 4 cores): 49.6 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T17:27:14.245400 Cut to 1 unWISE tiles Reading WISE tile 1288p636 band 1 Reading WISE tile 1288p636 band 2 Reading WISE tile 1288p636 band 3 Reading WISE tile 1288p636 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1288p636/unwise-1288p636-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1288p636/unwise-1288p636-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1288p636/unwise-1288p636-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1288p636/unwise-1288p636-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1288p636/unwise-1288p636-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 806 MB, VmSize: 794 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.18964 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1288p636/unwise-1288p636-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1288p636/unwise-1288p636-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1288p636/unwise-1288p636-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1288p636/unwise-1288p636-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1288p636/unwise-1288p636-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 809 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208548 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1288p636/unwise-1288p636-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1288p636/unwise-1288p636-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1288p636/unwise-1288p636-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1288p636/unwise-1288p636-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 803 MB, VmSize: 797 MB, VmRSS: 154 MB, VmData: 178 MB, maxrss: 0.218492 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1288p636/unwise-1288p636-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1288p636/unwise-1288p636-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1288p636/unwise-1288p636-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1288p636/unwise-1288p636-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 807 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.208788 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/tmp-legacysurvey-custom-128656p63680-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/tmp-legacysurvey-custom-128656p63680-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.16 s, CPU: 0.44 s, VmPeak: 972 MB, VmSize: 957 MB, VmRSS: 201 MB, VmData: 228 MB, maxrss: 0.566588 MB Stage wise_forced finished: 2020-06-07T17:27:16.403507 Resources for stage wise_forced : 4.421 s worker CPU, 5.406 s worker Wall, Wall: 2.159 s, Cores in use: 2.25, Total efficiency (on 4 cores): 56.3 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T17:27:16.405285 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/coadd/cus/custom-128656p63680/legacysurvey-custom-128656p63680-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/tractor-i/cus/tractor-custom-128656p63680.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/tractor/cus/tractor-custom-128656p63680.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC2659530/tractor/cus/brick-custom-128656p63680.sha256sum Stage writecat : Wall: 0.86 s, CPU: 0.51 s, VmPeak: 1089 MB, VmSize: 961 MB, VmRSS: 203 MB, VmData: 228 MB, maxrss: 0.566588 MB Stage writecat finished: 2020-06-07T17:27:17.261569 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.857 s, Cores in use: 0.60, Total efficiency (on 4 cores): 14.9 % Stage writecat finished All done: 41.369 s worker CPU, 52.645 s worker Wall, Wall: 38.774 s, Cores in use: 1.28, Total efficiency (on 4 cores): 32.0 % Finished galaxy PGC2659530 in 0.694 minutes.