Started working on galaxy PGC2390923 at Sun Jun 7 17:38:54 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 195.700368 51.246030700000006 --width 235 --height 235 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/PGC2390923-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/PGC2390923-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T17:38:56.348401 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '195.700368', '51.246030700000006', '--width', '235', '--height', '235', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/PGC2390923-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/PGC2390923-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 195.700368 51.246030700000006 --width 235 --height 235 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/PGC2390923-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/PGC2390923-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 195.700368 51.246030700000006 Starting process 54044 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 54047 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 54056 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 54057 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T17:38:57.067942 Keeping 11 CCDs: k4m_170504_054532_ooi_zd_ls9.fits.fz k4m_170504_054532_ooi_zd_ls9-CCD2 z exptime 88.104 propid 2016A-0453 seeing 1.24 MJD 57877.240 object MzLS_654224_z k4m_160511_055101_ooi_zd_ls9.fits.fz k4m_160511_055101_ooi_zd_ls9-CCD1 z exptime 80.105 propid 2016A-0453 seeing 1.11 MJD 57519.244 object MzLS_655796_z k4m_160503_060708_ooi_zd_ls9.fits.fz k4m_160503_060708_ooi_zd_ls9-CCD2 z exptime 80.105 propid 2016A-0453 seeing 1.01 MJD 57511.255 object MzLS_653433_z k4m_170325_100822_ooi_zd_ls9.fits.fz k4m_170325_100822_ooi_zd_ls9-CCD3 z exptime 80.105 propid 2016A-0453 seeing 0.84 MJD 57837.422 object MzLS_655012_z ksb_170402_082714_ooi_g_ls9.fits.fz ksb_170402_082714_ooi_g_ls9-CCD3 g exptime 80.826 propid BASS seeing 2.02 MJD 57845.352 object 27853 ksb_170421_083130_ooi_r_ls9.fits.fz ksb_170421_083130_ooi_r_ls9-CCD3 r exptime 73.082 propid BASS seeing 1.47 MJD 57864.355 object 27853 ksb_160502_064951_ooi_g_ls9.fits.fz ksb_160502_064951_ooi_g_ls9-CCD1 g exptime 80.7 propid 2015A-0801 seeing 2.07 MJD 57510.285 object 27842 ksb_170402_082913_ooi_g_ls9.fits.fz ksb_170402_082913_ooi_g_ls9-CCD4 g exptime 95.617 propid BASS seeing 1.79 MJD 57845.354 object 28993 ksb_170421_083329_ooi_r_ls9.fits.fz ksb_170421_083329_ooi_r_ls9-CCD4 r exptime 72.335 propid BASS seeing 1.38 MJD 57864.357 object 28993 ksb_160511_071602_ooi_r_ls9.fits.fz ksb_160511_071602_ooi_r_ls9-CCD3 r exptime 52.1 propid BASS seeing 1.48 MJD 57519.303 object 27851 ksb_160313_092735_ooi_g_ls9.fits.fz ksb_160313_092735_ooi_g_ls9-CCD3 g exptime 73.2 propid 2015A-0801 seeing 1.37 MJD 57460.394 object 27851 mosaic get_fwhm: self.fwhm = 3.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2890 3127 and amp range 2006 4053 and image y 2861 3102 and amp range 2040 4078 Range in image: x 0 238 , y 0 242 (with image size 238 x 242) dzp -0.0021409686 -> scaling image by 0.9980300379995196 mosaic get_fwhm: self.fwhm = 4.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 114 358 and amp range 0 2005 and image y 1451 1694 and amp range 0 2039 Range in image: x 0 245 , y 0 244 (with image size 245 x 244) dzp -0.011066288 -> scaling image by 0.989859339076806 mosaic get_fwhm: self.fwhm = 4.79 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1256 1493 and amp range 0 2047 and image y 3183 3419 and amp range 2040 4078 Range in image: x 0 238 , y 0 237 (with image size 238 x 237) dzp 0.015739892 -> scaling image by 1.0146025667655956 Faked up EXPNUM 78640162 Faked up EXPNUM 78640162 Faked up EXPNUM 78640162 90prime get_fwhm: self.fwhm = 3.25 Found 4 relevant rows in amp-corrections file. Found overlap: image x 117 254 and amp range 0 2015 and image y 332 469 and amp range 0 2047 Range in image: x 0 138 , y 0 138 (with image size 138 x 138) dzp -0.043123975 -> scaling image by 0.961059796099719 mosaic get_fwhm: self.fwhm = 3.89 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3997 4088 and amp range 2048 4095 and image y 3164 3402 and amp range 2040 4078 Range in image: x 0 92 , y 0 239 (with image size 92 x 239) dzp -0.009154885 -> scaling image by 0.9916034885139223 Faked up EXPNUM 78450150 Faked up EXPNUM 78450150 Faked up EXPNUM 78450150 90prime get_fwhm: self.fwhm = 4.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 111 249 and amp range 0 2015 and image y 345 482 and amp range 0 2047 Range in image: x 0 139 , y 0 138 (with image size 139 x 138) dzp -0.036130503 -> scaling image by 0.9672701794860779 Faked up EXPNUM 75100113 Faked up EXPNUM 75100113 Faked up EXPNUM 75100113 Faked up EXPNUM 78450151 Faked up EXPNUM 78450151 Faked up EXPNUM 78450151 90prime get_fwhm: self.fwhm = 3.95 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3879 4016 and amp range 2016 4031 and image y 355 491 and amp range 0 2047 Range in image: x 0 138 , y 0 137 (with image size 138 x 137) dzp 0.016679538 -> scaling image by 1.0154810312115594 Faked up EXPNUM 74600208 Faked up EXPNUM 74600208 Faked up EXPNUM 74600208 90prime get_fwhm: self.fwhm = 3.03 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2089 2226 and amp range 2016 4031 and image y 2315 2452 and amp range 2048 4095 Range in image: x 0 138 , y 0 138 (with image size 138 x 138) dzp -0.0012536051 -> scaling image by 0.9988460533227724 Faked up EXPNUM 78640163 Faked up EXPNUM 78640163 Faked up EXPNUM 78640163 90prime get_fwhm: self.fwhm = 3.05 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3888 4016 and amp range 2016 4031 and image y 356 492 and amp range 0 2047 Range in image: x 0 129 , y 0 137 (with image size 129 x 137) dzp 0.02499258 -> scaling image by 1.0232859986636875 Faked up EXPNUM 75190129 Faked up EXPNUM 75190129 Faked up EXPNUM 75190129 90prime get_fwhm: self.fwhm = 3.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2112 2249 and amp range 2016 4031 and image y 2332 2469 and amp range 2048 4095 Range in image: x 0 138 , y 0 138 (with image size 138 x 138) dzp -0.0005558773 -> scaling image by 0.99948814914245 Stage tims : Wall: 8.87 s, CPU: 1.06 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 171 MB, VmData: 204 MB, maxrss: 0.566556 MB Stage tims finished: 2020-06-07T17:39:05.936711 Resources for stage tims : 3.584 s worker CPU, 18.099 s worker Wall, Wall: 8.870 s, Cores in use: 0.52, Total efficiency (on 4 cores): 13.1 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/PGC2390923-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/PGC2390923-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T17:39:06.060234 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01356.fits Matched 13 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/metrics/cus/reference-custom-195700p51246.fits Stage refs : Wall: 1.91 s, CPU: 1.34 s, VmPeak: 972 MB, VmSize: 953 MB, VmRSS: 183 MB, VmData: 216 MB, maxrss: 0.566556 MB Stage refs finished: 2020-06-07T17:39:07.972469 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.913 s, Cores in use: 0.70, Total efficiency (on 4 cores): 17.5 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T17:39:07.973990 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/metrics/cus/outlier-mask-custom-195700p51246.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/metrics/cus/outliers-pre-custom-195700p51246.jpg Image ksb_170402_082913_ooi_g_ls9-CCD4 g : masking 83 positive outlier pixels and 0 negative outlier pixels Image ksb_160511_071602_ooi_r_ls9-CCD3 r : masking 86 positive outlier pixels and 0 negative outlier pixels Image k4m_170504_054532_ooi_zd_ls9-CCD2 z : masking 191 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/metrics/cus/outlier-mask-custom-195700p51246.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/metrics/cus/outliers-post-custom-195700p51246.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/metrics/cus/outliers-masked-pos-custom-195700p51246.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/metrics/cus/outliers-masked-neg-custom-195700p51246.jpg Stage outliers : Wall: 0.96 s, CPU: 0.72 s, VmPeak: 972 MB, VmSize: 962 MB, VmRSS: 195 MB, VmData: 226 MB, maxrss: 0.566556 MB Stage outliers finished: 2020-06-07T17:39:08.931816 Resources for stage outliers : 0.699 s worker CPU, 0.699 s worker Wall, Wall: 0.959 s, Cores in use: 1.48, Total efficiency (on 4 cores): 37.0 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T17:39:08.933838 Stage halos : Wall: 0.30 s, CPU: 0.30 s, VmPeak: 972 MB, VmSize: 962 MB, VmRSS: 195 MB, VmData: 226 MB, maxrss: 0.566556 MB Stage halos finished: 2020-06-07T17:39:09.234215 Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.302 s, Cores in use: 0.99, Total efficiency (on 4 cores): 24.8 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T17:39:09.236043 PSF sigmas in coadd pixels: ['3.28', '2.91', '2.23'] Using average PSF sigma 2.8052188934910487 Gaussian PSF norm 0.10056070577181085 vs pixelized 0.08028629 average tim pixel scale / coadd scale: 1.730232562635179 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.39', '2.25', '2.41'] Using average PSF sigma 2.347905438847218 Gaussian PSF norm 0.12014742463920607 vs pixelized 0.11244585 average tim pixel scale / coadd scale: 1.7296604390917274 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.02', '1.80', '1.64', '1.36'] Using average PSF sigma 1.705513585109647 Gaussian PSF norm 0.16540166800004844 vs pixelized 0.13767724 average tim pixel scale / coadd scale: 0.990843029340857 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.20 s, CPU: 0.16 s, VmPeak: 972 MB, VmSize: 962 MB, VmRSS: 197 MB, VmData: 226 MB, maxrss: 0.566556 MB Stage fit_on_coadds finished: 2020-06-07T17:39:09.431335 Resources for stage fit_on_coadds : 0.165 s worker CPU, 0.169 s worker Wall, Wall: 0.196 s, Cores in use: 1.67, Total efficiency (on 4 cores): 41.8 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T17:39:09.434300 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 11 potential peaks Of 11 potential peaks: 3 in veto map, 1 cut by saddle test, 0 cut by aper test, 7 kept SED z : 7 new peaks Found 18 potential peaks Of 18 potential peaks: 16 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 18 potential peaks Of 18 potential peaks: 16 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 30 potential peaks Of 30 potential peaks: 23 in veto map, 2 cut by saddle test, 0 cut by aper test, 5 kept SED Flat : 5 new peaks Found 25 potential peaks Of 25 potential peaks: 21 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 13 new sources Median coadd sky for g : 0.00044074026 Median coadd sky for r : 0.00063261285 Median coadd sky for z : -5.5763492e-05 Stage srcs : Wall: 0.55 s, CPU: 0.51 s, VmPeak: 972 MB, VmSize: 962 MB, VmRSS: 198 MB, VmData: 226 MB, maxrss: 0.566556 MB Stage srcs finished: 2020-06-07T17:39:09.986856 Resources for stage srcs : 0.094 s worker CPU, 0.094 s worker Wall, Wall: 0.553 s, Cores in use: 1.09, Total efficiency (on 4 cores): 27.2 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/PGC2390923-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/PGC2390923-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T17:39:10.497534 Blob 1 of 14, id: 3, sources: 3, size: 127x137, npix 11848, brick X: 55,182, Y: 46,183, one pixel: 115 46 Blob 2 of 14, id: 0, sources: 1, size: 68x52, npix 2603, brick X: 20,88, Y: 0,52, one pixel: 39 0 Blob 3 of 14, id: 12, sources: 1, size: 34x29, npix 721, brick X: 153,187, Y: 206,235, one pixel: 169 206 Blob 4 of 14, id: 1, sources: 1, size: 33x33, npix 663, brick X: 202,235, Y: 19,52, one pixel: 210 19 Blob 5 of 14, id: 2, sources: 1, size: 28x30, npix 553, brick X: 0,28, Y: 31,61, one pixel: 11 31 Blob 3 finished, total: Wall: 0.58 s, CPU: 0.58 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141588 MB Blob 6 of 14, id: 4, sources: 1, size: 29x29, npix 538, brick X: 162,191, Y: 47,76, one pixel: 177 47 Blob 4 finished, total: Wall: 0.89 s, CPU: 0.89 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.141948 MB Blob 7 of 14, id: 6, sources: 1, size: 38x24, npix 524, brick X: 184,222, Y: 92,116, one pixel: 194 92 Blob 2 finished, total: Wall: 1.10 s, CPU: 1.10 s, VmPeak: 802 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142588 MB Blob 8 of 14, id: 7, sources: 1, size: 21x31, npix 453, brick X: 0,21, Y: 111,142, one pixel: 5 111 Blob 7 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 802 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142588 MB Blob 9 of 14, id: 9, sources: 1, size: 25x25, npix 390, brick X: 15,40, Y: 166,191, one pixel: 26 166 Blob 6 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.141948 MB Blob 10 of 14, id: 13, sources: 1, size: 28x20, npix 387, brick X: 23,51, Y: 215,235, one pixel: 36 215 Blob 11 of 14, id: 5, sources: 1, size: 25x23, npix 359, brick X: 188,213, Y: 63,86, one pixel: 198 63 Blob 5 finished, total: Wall: 1.09 s, CPU: 1.09 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141588 MB Blob 8 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 802 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142588 MB Blob 12 of 14, id: 8, sources: 1, size: 22x22, npix 272, brick X: 23,45, Y: 139,161, one pixel: 33 139 Blob 13 of 14, id: 10, sources: 1, size: 15x21, npix 205, brick X: 220,235, Y: 166,187, one pixel: 229 166 Blob 11 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 802 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142588 MB Blob 14 of 14, id: 11, sources: 1, size: 18x19, npix 198, brick X: 99,117, Y: 206,225, one pixel: 107 206 Blob 9 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142576 MB Blob 12 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 802 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142588 MB Blob 10 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141588 MB Blob 14 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 802 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142588 MB Blob 13 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142596 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.552815, ee1=0.06676, ee2=0.0173056 Blob 1 finished, total: Wall: 3.62 s, CPU: 3.62 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.143936 MB Old catalog: 16 New catalog: 14 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/metrics/cus/blobs-custom-195700p51246.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/metrics/cus/all-models-custom-195700p51246.fits Stage fitblobs : Wall: 4.06 s, CPU: 0.34 s, VmPeak: 972 MB, VmSize: 962 MB, VmRSS: 198 MB, VmData: 226 MB, maxrss: 0.566556 MB Stage fitblobs finished: 2020-06-07T17:39:14.556262 Resources for stage fitblobs : 10.350 s worker CPU, 10.625 s worker Wall, Wall: 4.060 s, Cores in use: 2.63, Total efficiency (on 4 cores): 65.9 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T17:39:14.558205 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/tmp-legacysurvey-custom-195700p51246-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/tmp-legacysurvey-custom-195700p51246-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/tmp-legacysurvey-custom-195700p51246-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/tmp-legacysurvey-custom-195700p51246-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-resid.jpg Stage coadds : Wall: 1.21 s, CPU: 0.59 s, VmPeak: 972 MB, VmSize: 962 MB, VmRSS: 198 MB, VmData: 226 MB, maxrss: 0.566556 MB Stage coadds finished: 2020-06-07T17:39:15.765881 Resources for stage coadds : 1.858 s worker CPU, 1.947 s worker Wall, Wall: 1.209 s, Cores in use: 2.03, Total efficiency (on 4 cores): 50.7 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T17:39:15.767708 Cut to 1 unWISE tiles Reading WISE tile 1954p514 band 3 Reading WISE tile 1954p514 band 4 Reading WISE tile 1954p514 band 2 Reading WISE tile 1954p514 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1954p514/unwise-1954p514-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1954p514/unwise-1954p514-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1954p514/unwise-1954p514-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1954p514/unwise-1954p514-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1954p514/unwise-1954p514-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 802 MB, VmSize: 788 MB, VmRSS: 140 MB, VmData: 169 MB, maxrss: 0.20464 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1954p514/unwise-1954p514-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1954p514/unwise-1954p514-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1954p514/unwise-1954p514-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1954p514/unwise-1954p514-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/195/1954p514/unwise-1954p514-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 804 MB, VmSize: 794 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.188184 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1954p514/unwise-1954p514-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1954p514/unwise-1954p514-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1954p514/unwise-1954p514-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1954p514/unwise-1954p514-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 803 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208608 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1954p514/unwise-1954p514-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1954p514/unwise-1954p514-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1954p514/unwise-1954p514-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/195/1954p514/unwise-1954p514-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.20898 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/tmp-legacysurvey-custom-195700p51246-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/tmp-legacysurvey-custom-195700p51246-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.51 s, CPU: 0.53 s, VmPeak: 972 MB, VmSize: 962 MB, VmRSS: 199 MB, VmData: 226 MB, maxrss: 0.566556 MB Stage wise_forced finished: 2020-06-07T17:39:18.282550 Resources for stage wise_forced : 4.739 s worker CPU, 6.577 s worker Wall, Wall: 2.516 s, Cores in use: 2.09, Total efficiency (on 4 cores): 52.3 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T17:39:18.284242 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/coadd/cus/custom-195700p51246/legacysurvey-custom-195700p51246-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/tractor-i/cus/tractor-custom-195700p51246.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/tractor/cus/tractor-custom-195700p51246.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/195/PGC2390923/tractor/cus/brick-custom-195700p51246.sha256sum Stage writecat : Wall: 0.78 s, CPU: 0.48 s, VmPeak: 1095 MB, VmSize: 967 MB, VmRSS: 201 MB, VmData: 226 MB, maxrss: 0.566556 MB Stage writecat finished: 2020-06-07T17:39:19.067828 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.785 s, Cores in use: 0.62, Total efficiency (on 4 cores): 15.4 % Stage writecat finished All done: 21.490 s worker CPU, 38.212 s worker Wall, Wall: 22.004 s, Cores in use: 1.25, Total efficiency (on 4 cores): 31.3 % Finished galaxy PGC2390923 in 0.413 minutes.