Started working on galaxy PGC2306001 at Sun Jun 7 19:06:44 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 104.60162550000001 47.874444399999994 --width 269 --height 269 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/PGC2306001-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/PGC2306001-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T19:06:45.575752 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '104.60162550000001', '47.874444399999994', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/PGC2306001-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/PGC2306001-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 104.60162550000001 47.874444399999994 --width 269 --height 269 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/PGC2306001-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/PGC2306001-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 104.60162550000001 47.874444399999994 Starting process 31986 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 31987 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 31988 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 31989 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T19:06:45.963576 Keeping 11 CCDs: k4m_170302_035454_ooi_zd_ls9.fits.fz k4m_170302_035454_ooi_zd_ls9-CCD2 z exptime 80.104 propid 2016A-0453 seeing 0.98 MJD 57814.163 object MzLS_639382_z k4m_170322_045137_ooi_zd_ls9.fits.fz k4m_170322_045137_ooi_zd_ls9-CCD3 z exptime 80.104 propid 2016A-0453 seeing 0.84 MJD 57834.203 object MzLS_641071_z k4m_170222_052643_ooi_zd_ls9.fits.fz k4m_170222_052643_ooi_zd_ls9-CCD3 z exptime 80.105 propid 2016A-0453 seeing 0.90 MJD 57806.227 object MzLS_641071_z k4m_170316_034553_ooi_zd_ls9.fits.fz k4m_170316_034553_ooi_zd_ls9-CCD4 z exptime 120.103 propid 2016A-0453 seeing 1.01 MJD 57828.157 object MzLS_639381_z k4m_160226_033233_ooi_zd_ls9.fits.fz k4m_160226_033233_ooi_zd_ls9-CCD2 z exptime 80.103 propid 2016A-0453 seeing 0.81 MJD 57444.148 object MzLS_640228_z ksb_170131_050358_ooi_g_ls9.fits.fz ksb_170131_050358_ooi_g_ls9-CCD4 g exptime 140.4 propid BASS seeing 1.54 MJD 57784.211 object 23731 ksb_170301_031354_ooi_r_ls9.fits.fz ksb_170301_031354_ooi_r_ls9-CCD4 r exptime 135.642 propid BASS seeing 1.78 MJD 57813.135 object 23731 ksb_170214_030655_ooi_r_ls9.fits.fz ksb_170214_030655_ooi_r_ls9-CCD1 r exptime 126.375 propid BASS seeing 1.45 MJD 57798.130 object 23733 ksb_180310_031911_ooi_g_ls9.fits.fz ksb_180310_031911_ooi_g_ls9-CCD1 g exptime 58.96 propid BASS seeing 1.69 MJD 58187.138 object 23733 ksb_180313_040225_ooi_g_ls9.fits.fz ksb_180313_040225_ooi_g_ls9-CCD1 g exptime 250.0 propid BASS seeing 1.80 MJD 58190.168 object 23733 ksb_160206_051638_ooi_g_ls9.fits.fz ksb_160206_051638_ooi_g_ls9-CCD4 g exptime 250.0 propid 2015A-0801 seeing 1.85 MJD 57424.220 object 23732 mosaic get_fwhm: self.fwhm = 3.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2183 2454 and amp range 2006 4053 and image y 7 210 and amp range 0 2039 Range in image: x 0 272 , y 0 204 (with image size 272 x 204) dzp -0.016180232 -> scaling image by 0.9852079488029655 mosaic get_fwhm: self.fwhm = 3.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2202 2474 and amp range 2006 4053 and image y 7 256 and amp range 0 2039 Range in image: x 0 273 , y 0 250 (with image size 273 x 250) dzp -0.016180232 -> scaling image by 0.9852079488029655 mosaic get_fwhm: self.fwhm = 3.79 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3348 3631 and amp range 2048 4095 and image y 7 201 and amp range 0 2039 Range in image: x 0 284 , y 0 195 (with image size 284 x 195) dzp 0.0044767857 -> scaling image by 1.004131784351374 mosaic get_fwhm: self.fwhm = 3.89 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3335 3618 and amp range 2048 4095 and image y 3563 3845 and amp range 2022 4060 Range in image: x 0 284 , y 0 283 (with image size 284 x 283) dzp -0.02499645 -> scaling image by 0.9772404160512723 mosaic get_fwhm: self.fwhm = 3.11 Found 4 relevant rows in amp-corrections file. Found overlap: image x 592 864 and amp range 0 2047 and image y 1965 2237 and amp range 0 2039 Range in image: x 0 273 , y 0 75 (with image size 273 x 273) dzp -0.006320339 -> scaling image by 0.9941956631368829 Found overlap: image x 592 864 and amp range 0 2047 and image y 1965 2237 and amp range 2040 4078 Range in image: x 0 273 , y 75 273 (with image size 273 x 273) dzp 0.008550294 -> scaling image by 1.0079062018164673 Faked up EXPNUM 77840090 Faked up EXPNUM 77840090 Faked up EXPNUM 77840090 90prime get_fwhm: self.fwhm = 3.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 905 1061 and amp range 0 2015 and image y 410 566 and amp range 0 2047 Range in image: x 0 157 , y 0 157 (with image size 157 x 157) dzp 0.0029025706 -> scaling image by 1.002676942990926 Faked up EXPNUM 78130045 Faked up EXPNUM 78130045 Faked up EXPNUM 78130045 90prime get_fwhm: self.fwhm = 3.93 Found 4 relevant rows in amp-corrections file. Found overlap: image x 850 1006 and amp range 0 2015 and image y 344 500 and amp range 0 2047 Range in image: x 0 157 , y 0 157 (with image size 157 x 157) dzp 0.004145757 -> scaling image by 1.0038256824624485 Faked up EXPNUM 77980050 Faked up EXPNUM 77980050 Faked up EXPNUM 77980050 90prime get_fwhm: self.fwhm = 3.21 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3013 3170 and amp range 2016 4031 and image y 2825 2981 and amp range 2048 4095 Range in image: x 0 158 , y 0 157 (with image size 158 x 157) dzp 0.02308583 -> scaling image by 1.021490500713915 Faked up EXPNUM 81870050 Faked up EXPNUM 81870050 Faked up EXPNUM 81870050 90prime get_fwhm: self.fwhm = 3.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3024 3181 and amp range 2016 4031 and image y 2820 2976 and amp range 2048 4095 Range in image: x 0 158 , y 0 157 (with image size 158 x 157) dzp 0.016257986 -> scaling image by 1.01508683329102 Faked up EXPNUM 74240066 Faked up EXPNUM 74240066 Faked up EXPNUM 74240066 90prime get_fwhm: self.fwhm = 4.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2783 2940 and amp range 2016 4031 and image y 2350 2507 and amp range 2048 4095 Range in image: x 0 158 , y 0 158 (with image size 158 x 158) dzp 0.0013913503 -> scaling image by 1.001282302423891 Faked up EXPNUM 81900050 Faked up EXPNUM 81900050 Faked up EXPNUM 81900050 90prime get_fwhm: self.fwhm = 3.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3020 3177 and amp range 2016 4031 and image y 2813 2970 and amp range 2048 4095 Range in image: x 0 158 , y 0 158 (with image size 158 x 158) dzp 0.016257986 -> scaling image by 1.01508683329102 Stage tims : Wall: 5.14 s, CPU: 0.85 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 173 MB, VmData: 206 MB, maxrss: 0.566604 MB Stage tims finished: 2020-06-07T19:06:51.100674 Resources for stage tims : 3.918 s worker CPU, 14.561 s worker Wall, Wall: 5.138 s, Cores in use: 0.93, Total efficiency (on 4 cores): 23.2 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/PGC2306001-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/PGC2306001-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T19:06:51.127690 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01544.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01657.fits Matched 7 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/metrics/cus/reference-custom-104601p47874.fits Stage refs : Wall: 6.49 s, CPU: 4.75 s, VmPeak: 991 MB, VmSize: 985 MB, VmRSS: 218 MB, VmData: 250 MB, maxrss: 0.566604 MB Stage refs finished: 2020-06-07T19:06:57.617422 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.491 s, Cores in use: 0.73, Total efficiency (on 4 cores): 18.3 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T19:06:57.619077 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/metrics/cus/outlier-mask-custom-104601p47874.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/metrics/cus/outliers-pre-custom-104601p47874.jpg Image ksb_170131_050358_ooi_g_ls9-CCD4 g : masking 142 positive outlier pixels and 0 negative outlier pixels Image ksb_180310_031911_ooi_g_ls9-CCD1 g : masking 124 positive outlier pixels and 0 negative outlier pixels Image ksb_180313_040225_ooi_g_ls9-CCD1 g : masking 173 positive outlier pixels and 0 negative outlier pixels Image ksb_160206_051638_ooi_g_ls9-CCD4 g : masking 73 positive outlier pixels and 0 negative outlier pixels Image ksb_170214_030655_ooi_r_ls9-CCD1 r : masking 126 positive outlier pixels and 0 negative outlier pixels Image k4m_170302_035454_ooi_zd_ls9-CCD2 z : masking 1536 positive outlier pixels and 0 negative outlier pixels Image k4m_170222_052643_ooi_zd_ls9-CCD3 z : masking 772 positive outlier pixels and 0 negative outlier pixels Image k4m_170316_034553_ooi_zd_ls9-CCD4 z : masking 1200 positive outlier pixels and 167 negative outlier pixels Image k4m_160226_033233_ooi_zd_ls9-CCD2 z : masking 1241 positive outlier pixels and 517 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/metrics/cus/outlier-mask-custom-104601p47874.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/metrics/cus/outliers-post-custom-104601p47874.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/metrics/cus/outliers-masked-pos-custom-104601p47874.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/metrics/cus/outliers-masked-neg-custom-104601p47874.jpg Stage outliers : Wall: 1.12 s, CPU: 0.77 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 232 MB, VmData: 261 MB, maxrss: 0.566604 MB Stage outliers finished: 2020-06-07T19:06:58.743369 Resources for stage outliers : 1.394 s worker CPU, 1.395 s worker Wall, Wall: 1.126 s, Cores in use: 1.92, Total efficiency (on 4 cores): 48.1 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T19:06:58.745395 Stage halos : Wall: 0.43 s, CPU: 0.40 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 232 MB, VmData: 261 MB, maxrss: 0.566604 MB Stage halos finished: 2020-06-07T19:06:59.176187 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.432 s, Cores in use: 0.94, Total efficiency (on 4 cores): 23.4 % Stage halos finished Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-06-07T19:06:59.178062 PSF sigmas in coadd pixels: ['2.50', '2.75', '2.92', '3.01'] Using average PSF sigma 2.7941234720735637 Gaussian PSF norm 0.10096003079081223 vs pixelized 0.08270901 average tim pixel scale / coadd scale: 1.7302170165242157 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.89', '2.36'] Using average PSF sigma 2.6280964865536314 Gaussian PSF norm 0.1073380651042248 vs pixelized 0.088885106 average tim pixel scale / coadd scale: 1.7298944472185982 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.60', '1.36', '1.46', '1.64', '1.31'] Using average PSF sigma 1.474832394526946 Gaussian PSF norm 0.19127244073341662 vs pixelized 0.15379708 average tim pixel scale / coadd scale: 0.9908116771839559 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.26 s, CPU: 0.22 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 235 MB, VmData: 263 MB, maxrss: 0.566604 MB Stage fit_on_coadds finished: 2020-06-07T19:06:59.440124 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.275 s worker CPU, 0.277 s worker Wall, Wall: 0.263 s, Cores in use: 1.89, Total efficiency (on 4 cores): 47.3 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T19:06:59.443168 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 39 potential peaks Of 39 potential peaks: 12 in veto map, 4 cut by saddle test, 0 cut by aper test, 23 kept SED z : 23 new peaks Found 59 potential peaks Of 59 potential peaks: 56 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 46 potential peaks Of 46 potential peaks: 42 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 90 potential peaks Of 90 potential peaks: 84 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 103 potential peaks Of 103 potential peaks: 94 in veto map, 8 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 26 new sources Median coadd sky for g : 0.00039978386 Median coadd sky for r : 0.0010638557 Median coadd sky for z : -0.0003245721 Stage srcs : Wall: 0.76 s, CPU: 0.70 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 236 MB, VmData: 263 MB, maxrss: 0.566604 MB Stage srcs finished: 2020-06-07T19:07:00.200427 Resources for stage srcs : 0.130 s worker CPU, 0.139 s worker Wall, Wall: 0.758 s, Cores in use: 1.10, Total efficiency (on 4 cores): 27.5 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/PGC2306001-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/PGC2306001-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T19:07:00.214142 Blob 1 of 8, id: 2, sources: 22, size: 235x265, npix 38988, brick X: 0,235, Y: 4,269, one pixel: 38 4 Blob 2 of 8, id: 0, sources: 2, size: 61x47, npix 1626, brick X: 192,253, Y: 0,47, one pixel: 212 0 Blob 3 of 8, id: 4, sources: 1, size: 40x47, npix 1375, brick X: 229,269, Y: 89,136, one pixel: 258 89 Blob 4 of 8, id: 5, sources: 2, size: 43x48, npix 1141, brick X: 5,48, Y: 203,251, one pixel: 36 203 Blob 5 of 8, id: 7, sources: 1, size: 42x25, npix 759, brick X: 31,73, Y: 244,269, one pixel: 49 244 Measuring 1 iterative sources Blob 3 finished, total: Wall: 1.02 s, CPU: 1.02 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142804 MB Blob 6 of 8, id: 6, sources: 3, size: 28x36, npix 569, brick X: 241,269, Y: 233,269, one pixel: 250 233 Blob 4 finished, total: Wall: 1.78 s, CPU: 1.78 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142912 MB Blob 7 of 8, id: 1, sources: 1, size: 20x21, npix 247, brick X: 249,269, Y: 3,24, one pixel: 258 3 Blob 8 of 8, id: 3, sources: 1, size: 20x18, npix 207, brick X: 244,264, Y: 58,76, one pixel: 252 58 Blob 2 finished, total: Wall: 2.05 s, CPU: 2.05 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143388 MB Blob 5 finished, total: Wall: 1.22 s, CPU: 1.22 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142804 MB Blob 7 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143388 MB Blob 8 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142804 MB Blob 6 finished, total: Wall: 1.31 s, CPU: 1.31 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143508 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.840908, ee1=0.0355401, ee2=-0.0656671 Measuring 9 iterative sources Blob 1 finished, total: Wall: 32.06 s, CPU: 32.06 s, VmPeak: 808 MB, VmSize: 718 MB, VmRSS: 151 MB, VmData: 183 MB, maxrss: 0.169852 MB Old catalog: 36 New catalog: 36 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/metrics/cus/blobs-custom-104601p47874.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/metrics/cus/all-models-custom-104601p47874.fits Stage fitblobs : Wall: 32.49 s, CPU: 0.38 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 237 MB, VmData: 263 MB, maxrss: 0.566604 MB Stage fitblobs finished: 2020-06-07T19:07:32.705033 Resources for stage fitblobs : 39.868 s worker CPU, 39.916 s worker Wall, Wall: 32.492 s, Cores in use: 1.24, Total efficiency (on 4 cores): 31.0 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T19:07:32.707333 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/tmp-legacysurvey-custom-104601p47874-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/tmp-legacysurvey-custom-104601p47874-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/tmp-legacysurvey-custom-104601p47874-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/tmp-legacysurvey-custom-104601p47874-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-resid.jpg Stage coadds : Wall: 1.58 s, CPU: 0.69 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 237 MB, VmData: 263 MB, maxrss: 0.566604 MB Stage coadds finished: 2020-06-07T19:07:34.290751 Resources for stage coadds : 2.304 s worker CPU, 2.478 s worker Wall, Wall: 1.584 s, Cores in use: 1.89, Total efficiency (on 4 cores): 47.2 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T19:07:34.292266 Cut to 2 unWISE tiles Reading WISE tile 1034p484 band 1 Reading WISE tile 1034p484 band 2 Reading WISE tile 1034p484 band 4 Reading WISE tile 1034p484 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1057p484 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1057p484 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1057p484 band 2 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1057p484 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1057p484/unwise-1057p484-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/105/1057p484/unwise-1057p484-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/105/1057p484/unwise-1057p484-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/105/1057p484/unwise-1057p484-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/105/1057p484/unwise-1057p484-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.16 s, CPU: 0.16 s, VmPeak: 808 MB, VmSize: 803 MB, VmRSS: 160 MB, VmData: 185 MB, maxrss: 0.206728 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1057p484/unwise-1057p484-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/105/1057p484/unwise-1057p484-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/105/1057p484/unwise-1057p484-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/105/1057p484/unwise-1057p484-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/105/1057p484/unwise-1057p484-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.14 s, CPU: 0.14 s, VmPeak: 810 MB, VmSize: 792 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209104 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1057p484/unwise-1057p484-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1057p484/unwise-1057p484-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1057p484/unwise-1057p484-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1057p484/unwise-1057p484-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 809 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.208748 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1057p484/unwise-1057p484-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1057p484/unwise-1057p484-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1057p484/unwise-1057p484-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1057p484/unwise-1057p484-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 806 MB, VmSize: 792 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.208628 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/tmp-legacysurvey-custom-104601p47874-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/tmp-legacysurvey-custom-104601p47874-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 4.73 s, CPU: 0.66 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 238 MB, VmData: 263 MB, maxrss: 0.566604 MB Stage wise_forced finished: 2020-06-07T19:07:39.020014 Resources for stage wise_forced : 8.044 s worker CPU, 11.616 s worker Wall, Wall: 4.729 s, Cores in use: 1.84, Total efficiency (on 4 cores): 46.0 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T19:07:39.021772 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/coadd/cus/custom-104601p47874/legacysurvey-custom-104601p47874-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/tractor-i/cus/tractor-custom-104601p47874.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/tractor/cus/tractor-custom-104601p47874.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2306001/tractor/cus/brick-custom-104601p47874.sha256sum Stage writecat : Wall: 1.71 s, CPU: 0.60 s, VmPeak: 1127 MB, VmSize: 999 MB, VmRSS: 240 MB, VmData: 263 MB, maxrss: 0.566604 MB Stage writecat finished: 2020-06-07T19:07:40.729802 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.709 s, Cores in use: 0.35, Total efficiency (on 4 cores): 8.8 % Stage writecat finished All done: 55.935 s worker CPU, 70.385 s worker Wall, Wall: 54.771 s, Cores in use: 1.20, Total efficiency (on 4 cores): 30.1 % Finished galaxy PGC2306001 in 0.945 minutes.