Started working on galaxy PGC3140321 at Sun Jun 7 19:42:52 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 208.34311050000002 66.3829554 --width 233 --height 233 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/PGC3140321-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/PGC3140321-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T19:42:55.397007 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '208.34311050000002', '66.3829554', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/PGC3140321-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/PGC3140321-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 208.34311050000002 66.3829554 --width 233 --height 233 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/PGC3140321-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/PGC3140321-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 208.34311050000002 66.3829554 Starting process 33353 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 33354 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 33355 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 33356 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T19:42:56.249066 Keeping 12 CCDs: k4m_170419_091015_ooi_zd_ls9.fits.fz k4m_170419_091015_ooi_zd_ls9-CCD2 z exptime 80.105 propid 2016A-0453 seeing 0.83 MJD 57862.382 object MzLS_704577_z k4m_171214_105815_ooi_zd_ls9.fits.fz k4m_171214_105815_ooi_zd_ls9-CCD1 z exptime 85.104 propid 2016A-0453 seeing 1.11 MJD 58101.457 object MzLS_705592_z k4m_170831_032310_ooi_zd_ls9.fits.fz k4m_170831_032310_ooi_zd_ls9-CCD4 z exptime 250.105 propid 2016A-0453 seeing 1.47 MJD 57996.141 object MzLS_705085_z ksb_180409_091408_ooi_r_ls9.fits.fz ksb_180409_091408_ooi_r_ls9-CCD2 r exptime 77.616 propid BASS seeing 1.22 MJD 58217.385 object 43733 ksb_180310_121420_ooi_r_ls9.fits.fz ksb_180310_121420_ooi_r_ls9-CCD2 r exptime 159.159 propid BASS seeing 1.41 MJD 58187.510 object 43733 ksb_170403_083911_ooi_g_ls9.fits.fz ksb_170403_083911_ooi_g_ls9-CCD1 g exptime 143.734 propid BASS seeing 1.71 MJD 57846.361 object 42902 ksb_180410_105229_ooi_r_ls9.fits.fz ksb_180410_105229_ooi_r_ls9-CCD1 r exptime 198.984 propid BASS seeing 1.99 MJD 58218.453 object 42902 ksb_170225_113703_ooi_g_ls9.fits.fz ksb_170225_113703_ooi_g_ls9-CCD3 g exptime 70.956 propid BASS seeing 1.26 MJD 57809.484 object 42911 ksb_170623_051344_ooi_r_ls9.fits.fz ksb_170623_051344_ooi_r_ls9-CCD3 r exptime 89.6 propid BASS seeing 2.84 MJD 57927.218 object 42911 ksb_180324_115930_ooi_g_ls9.fits.fz ksb_180324_115930_ooi_g_ls9-CCD2 g exptime 112.5 propid BASS seeing 1.36 MJD 58201.500 object 43733 ksb_180410_112315_ooi_r_ls9.fits.fz ksb_180410_112315_ooi_r_ls9-CCD3 r exptime 184.8 propid BASS seeing 1.53 MJD 58218.474 object 42912 ksb_170403_085005_ooi_g_ls9.fits.fz ksb_170403_085005_ooi_g_ls9-CCD3 g exptime 113.572 propid BASS seeing 1.84 MJD 57846.368 object 42912 mosaic get_fwhm: self.fwhm = 3.21 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2447 2683 and amp range 2048 4095 and image y 4050 4072 and amp range 2040 4078 Range in image: x 0 237 , y 0 23 (with image size 237 x 23) dzp -0.032976374 -> scaling image by 0.9700842429001929 Faked up EXPNUM 82170143 Faked up EXPNUM 82170143 Faked up EXPNUM 82170143 90prime get_fwhm: self.fwhm = 2.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2711 2849 and amp range 2016 4031 and image y 757 897 and amp range 0 2047 Range in image: x 0 139 , y 0 141 (with image size 139 x 141) dzp 0.014483032 -> scaling image by 1.0134287315188357 mosaic get_fwhm: self.fwhm = 4.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1298 1536 and amp range 0 2005 and image y 1945 2184 and amp range 0 2039 Range in image: x 0 239 , y 0 95 (with image size 239 x 240) dzp 0.009508088 -> scaling image by 1.0087957299815176 Found overlap: image x 1298 1536 and amp range 0 2005 and image y 1945 2184 and amp range 2040 4078 Range in image: x 0 239 , y 95 240 (with image size 239 x 240) dzp 0.014419514 -> scaling image by 1.0133694453441033 mosaic get_fwhm: self.fwhm = 5.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 7 35 and amp range 0 2047 and image y 2249 2485 and amp range 2022 4060 Range in image: x 0 29 , y 0 237 (with image size 29 x 237) dzp -0.016192675 -> scaling image by 0.9851966584456431 Faked up EXPNUM 81870166 Faked up EXPNUM 81870166 Faked up EXPNUM 81870166 90prime get_fwhm: self.fwhm = 3.11 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2727 2866 and amp range 2016 4031 and image y 751 891 and amp range 0 2047 Range in image: x 0 140 , y 0 141 (with image size 140 x 141) dzp 0.014483032 -> scaling image by 1.0134287315188357 Faked up EXPNUM 78460146 Faked up EXPNUM 78460146 Faked up EXPNUM 78460146 90prime get_fwhm: self.fwhm = 3.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2912 3051 and amp range 2016 4031 and image y 296 436 and amp range 0 2047 Range in image: x 0 140 , y 0 141 (with image size 140 x 141) dzp -0.011406615 -> scaling image by 0.9895491130016149 Faked up EXPNUM 78090229 Faked up EXPNUM 78090229 Faked up EXPNUM 78090229 90prime get_fwhm: self.fwhm = 2.79 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1014 1150 and amp range 0 2015 and image y 1695 1831 and amp range 0 2047 Range in image: x 0 137 , y 0 137 (with image size 137 x 137) dzp -0.036130503 -> scaling image by 0.9672701794860779 Faked up EXPNUM 82180172 Faked up EXPNUM 82180172 Faked up EXPNUM 82180172 90prime get_fwhm: self.fwhm = 4.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2905 3044 and amp range 2016 4031 and image y 291 431 and amp range 0 2047 Range in image: x 0 140 , y 0 141 (with image size 140 x 141) dzp -0.03177219 -> scaling image by 0.9711607558798585 Faked up EXPNUM 82010108 Faked up EXPNUM 82010108 Faked up EXPNUM 82010108 90prime get_fwhm: self.fwhm = 2.99 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2710 2849 and amp range 2016 4031 and image y 759 899 and amp range 0 2047 Range in image: x 0 140 , y 0 141 (with image size 140 x 141) dzp 0.009189803 -> scaling image by 1.0085000434534261 Faked up EXPNUM 82180180 Faked up EXPNUM 82180180 Faked up EXPNUM 82180180 90prime get_fwhm: self.fwhm = 3.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2987 3123 and amp range 2016 4031 and image y 3590 3727 and amp range 2048 4095 Range in image: x 0 137 , y 0 138 (with image size 137 x 138) dzp -0.0072602304 -> scaling image by 0.9933353884052984 Faked up EXPNUM 78460150 Faked up EXPNUM 78460150 Faked up EXPNUM 78460150 90prime get_fwhm: self.fwhm = 4.05 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2984 3121 and amp range 2016 4031 and image y 3641 3778 and amp range 2048 4095 Range in image: x 0 138 , y 0 138 (with image size 138 x 138) dzp -0.02530836 -> scaling image by 0.9769597156943128 Faked up EXPNUM 79270062 Faked up EXPNUM 79270062 Faked up EXPNUM 79270062 90prime get_fwhm: self.fwhm = 6.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1068 1205 and amp range 0 2015 and image y 1704 1839 and amp range 0 2047 Range in image: x 0 138 , y 0 136 (with image size 138 x 136) dzp -0.043123975 -> scaling image by 0.961059796099719 Stage tims : Wall: 7.14 s, CPU: 1.07 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 171 MB, VmData: 204 MB, maxrss: 0.566544 MB Stage tims finished: 2020-06-07T19:43:03.388813 Resources for stage tims : 3.363 s worker CPU, 17.514 s worker Wall, Wall: 7.141 s, Cores in use: 0.62, Total efficiency (on 4 cores): 15.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/PGC3140321-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/PGC3140321-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T19:43:04.137266 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00516.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00517.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00454.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00583.fits Matched 4 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/metrics/cus/reference-custom-208343p66382.fits Stage refs : Wall: 2.86 s, CPU: 1.52 s, VmPeak: 973 MB, VmSize: 955 MB, VmRSS: 184 MB, VmData: 217 MB, maxrss: 0.566544 MB Stage refs finished: 2020-06-07T19:43:07.000747 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.864 s, Cores in use: 0.53, Total efficiency (on 4 cores): 13.3 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T19:43:07.002344 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/metrics/cus/outlier-mask-custom-208343p66382.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/metrics/cus/outliers-pre-custom-208343p66382.jpg Image ksb_180410_112315_ooi_r_ls9-CCD3 r : masking 314 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/metrics/cus/outlier-mask-custom-208343p66382.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/metrics/cus/outliers-post-custom-208343p66382.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/metrics/cus/outliers-masked-pos-custom-208343p66382.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/metrics/cus/outliers-masked-neg-custom-208343p66382.jpg Stage outliers : Wall: 0.85 s, CPU: 0.67 s, VmPeak: 973 MB, VmSize: 965 MB, VmRSS: 197 MB, VmData: 228 MB, maxrss: 0.566544 MB Stage outliers finished: 2020-06-07T19:43:07.847699 Resources for stage outliers : 0.691 s worker CPU, 0.700 s worker Wall, Wall: 0.846 s, Cores in use: 1.60, Total efficiency (on 4 cores): 40.1 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T19:43:07.849230 Stage halos : Wall: 0.20 s, CPU: 0.20 s, VmPeak: 973 MB, VmSize: 965 MB, VmRSS: 197 MB, VmData: 228 MB, maxrss: 0.566544 MB Stage halos finished: 2020-06-07T19:43:08.053548 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.205 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.3 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T19:43:08.055393 PSF sigmas in coadd pixels: ['2.77', '2.05', '2.20', '2.98'] Using average PSF sigma 2.503016200899081 Gaussian PSF norm 0.11270194402758958 vs pixelized 0.09207078 average tim pixel scale / coadd scale: 1.7300849495622692 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.98', '2.29', '3.23', '4.61', '2.48'] Using average PSF sigma 2.919397537304016 Gaussian PSF norm 0.09662774191225255 vs pixelized 0.090838164 average tim pixel scale / coadd scale: 1.7300843597098274 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.35', '1.80', '2.39'] Using average PSF sigma 1.848602291885071 Gaussian PSF norm 0.1525989624767901 vs pixelized 0.1378099 average tim pixel scale / coadd scale: 0.9910673398936863 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.18 s, CPU: 0.17 s, VmPeak: 973 MB, VmSize: 965 MB, VmRSS: 199 MB, VmData: 228 MB, maxrss: 0.566544 MB Stage fit_on_coadds finished: 2020-06-07T19:43:08.239740 Resources for stage fit_on_coadds : 0.168 s worker CPU, 0.169 s worker Wall, Wall: 0.185 s, Cores in use: 1.85, Total efficiency (on 4 cores): 46.2 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T19:43:08.242792 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 6 potential peaks Of 6 potential peaks: 2 in veto map, 1 cut by saddle test, 0 cut by aper test, 3 kept SED z : 3 new peaks Found 8 potential peaks Of 8 potential peaks: 4 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 14 potential peaks Of 14 potential peaks: 10 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 14 potential peaks Of 14 potential peaks: 11 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED Flat : 0 new peaks Found 16 potential peaks Of 16 potential peaks: 12 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 7 new sources Median coadd sky for g : 0.00013251125 Median coadd sky for r : 0.000153163 Median coadd sky for z : 0.00024177515 Stage srcs : Wall: 0.46 s, CPU: 0.42 s, VmPeak: 973 MB, VmSize: 965 MB, VmRSS: 199 MB, VmData: 228 MB, maxrss: 0.566544 MB Stage srcs finished: 2020-06-07T19:43:08.701152 Resources for stage srcs : 0.094 s worker CPU, 0.097 s worker Wall, Wall: 0.459 s, Cores in use: 1.12, Total efficiency (on 4 cores): 28.1 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/PGC3140321-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/PGC3140321-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T19:43:08.712446 Blob 1 of 7, id: 1, sources: 3, size: 112x126, npix 8529, brick X: 62,174, Y: 63,189, one pixel: 147 63 Blob 2 of 7, id: 0, sources: 1, size: 86x66, npix 3937, brick X: 36,122, Y: 0,66, one pixel: 43 0 Blob 3 of 7, id: 6, sources: 1, size: 35x36, npix 841, brick X: 1,36, Y: 180,216, one pixel: 19 180 Blob 4 of 7, id: 3, sources: 1, size: 30x28, npix 533, brick X: 22,52, Y: 94,122, one pixel: 34 94 Blob 5 of 7, id: 2, sources: 1, size: 28x28, npix 515, brick X: 12,40, Y: 64,92, one pixel: 24 64 Blob 4 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 803 MB, VmSize: 712 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139352 MB Blob 6 of 7, id: 4, sources: 1, size: 24x24, npix 344, brick X: 32,56, Y: 164,188, one pixel: 42 164 Blob 3 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142032 MB Blob 7 of 7, id: 5, sources: 1, size: 22x22, npix 293, brick X: 196,218, Y: 178,200, one pixel: 206 178 Blob 5 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 803 MB, VmSize: 712 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14134 MB Blob 6 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142032 MB Blob 7 finished, total: Wall: 0.19 s, CPU: 0.19 s, VmPeak: 803 MB, VmSize: 712 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14134 MB Measuring 1 iterative sources Blob 2 finished, total: Wall: 2.25 s, CPU: 2.25 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142772 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.27601, ee1=0.11408, ee2=0.161346 Measuring 2 iterative sources Blob 1 finished, total: Wall: 3.64 s, CPU: 3.63 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144124 MB Old catalog: 13 New catalog: 12 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/metrics/cus/blobs-custom-208343p66382.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/metrics/cus/all-models-custom-208343p66382.fits Stage fitblobs : Wall: 4.02 s, CPU: 0.35 s, VmPeak: 973 MB, VmSize: 965 MB, VmRSS: 200 MB, VmData: 228 MB, maxrss: 0.566544 MB Stage fitblobs finished: 2020-06-07T19:43:12.735633 Resources for stage fitblobs : 8.272 s worker CPU, 8.340 s worker Wall, Wall: 4.024 s, Cores in use: 2.14, Total efficiency (on 4 cores): 53.6 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T19:43:12.737478 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/tmp-legacysurvey-custom-208343p66382-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/tmp-legacysurvey-custom-208343p66382-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/tmp-legacysurvey-custom-208343p66382-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/tmp-legacysurvey-custom-208343p66382-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-resid.jpg Stage coadds : Wall: 1.07 s, CPU: 0.43 s, VmPeak: 973 MB, VmSize: 965 MB, VmRSS: 200 MB, VmData: 228 MB, maxrss: 0.566544 MB Stage coadds finished: 2020-06-07T19:43:13.806932 Resources for stage coadds : 1.719 s worker CPU, 1.962 s worker Wall, Wall: 1.070 s, Cores in use: 2.01, Total efficiency (on 4 cores): 50.3 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T19:43:13.808593 Cut to 1 unWISE tiles Reading WISE tile 2078p666 band 1 Reading WISE tile 2078p666 band 3 Reading WISE tile 2078p666 band 2 Reading WISE tile 2078p666 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/207/2078p666/unwise-2078p666-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/207/2078p666/unwise-2078p666-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/207/2078p666/unwise-2078p666-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/207/2078p666/unwise-2078p666-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/207/2078p666/unwise-2078p666-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 803 MB, VmSize: 795 MB, VmRSS: 147 MB, VmData: 177 MB, maxrss: 0.187808 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/207/2078p666/unwise-2078p666-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/207/2078p666/unwise-2078p666-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/207/2078p666/unwise-2078p666-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/207/2078p666/unwise-2078p666-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/207/2078p666/unwise-2078p666-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 803 MB, VmSize: 788 MB, VmRSS: 140 MB, VmData: 169 MB, maxrss: 0.204272 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/207/2078p666/unwise-2078p666-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/207/2078p666/unwise-2078p666-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/207/2078p666/unwise-2078p666-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/207/2078p666/unwise-2078p666-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208724 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/207/2078p666/unwise-2078p666-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/207/2078p666/unwise-2078p666-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/207/2078p666/unwise-2078p666-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/207/2078p666/unwise-2078p666-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208668 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/tmp-legacysurvey-custom-208343p66382-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/tmp-legacysurvey-custom-208343p66382-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.38 s, CPU: 0.43 s, VmPeak: 973 MB, VmSize: 965 MB, VmRSS: 201 MB, VmData: 228 MB, maxrss: 0.566544 MB Stage wise_forced finished: 2020-06-07T19:43:16.188441 Resources for stage wise_forced : 5.036 s worker CPU, 6.186 s worker Wall, Wall: 2.381 s, Cores in use: 2.30, Total efficiency (on 4 cores): 57.4 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T19:43:16.190344 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/coadd/cus/custom-208343p66382/legacysurvey-custom-208343p66382-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/tractor-i/cus/tractor-custom-208343p66382.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/tractor/cus/tractor-custom-208343p66382.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC3140321/tractor/cus/brick-custom-208343p66382.sha256sum Stage writecat : Wall: 0.95 s, CPU: 0.48 s, VmPeak: 1097 MB, VmSize: 969 MB, VmRSS: 203 MB, VmData: 228 MB, maxrss: 0.566544 MB Stage writecat finished: 2020-06-07T19:43:17.136211 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.947 s, Cores in use: 0.51, Total efficiency (on 4 cores): 12.6 % Stage writecat finished All done: 19.347 s worker CPU, 34.970 s worker Wall, Wall: 20.894 s, Cores in use: 1.20, Total efficiency (on 4 cores): 30.1 % Finished galaxy PGC3140321 in 0.421 minutes.