Started working on galaxy PGC2692384 at Sun Jun 7 17:32:48 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 278.10022200000003 66.8953503 --width 465 --height 465 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T17:32:49.736977 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '278.10022200000003', '66.8953503', '--width', '465', '--height', '465', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 278.10022200000003 66.8953503 --width 465 --height 465 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 278.10022200000003 66.8953503 Starting process 9428 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.0576 MB Starting process 9429 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.0576 MB Starting process 9430 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.0576 MB Starting process 9431 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057604 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T17:32:56.694177 Keeping 13 CCDs: k4m_171110_040435_ooi_zd_ls9.fits.fz k4m_171110_040435_ooi_zd_ls9-CCD1 z exptime 129.103 propid 2016A-0453 seeing 1.03 MJD 58067.170 object MzLS_707133_z k4m_171122_023311_ooi_zd_ls9.fits.fz k4m_171122_023311_ooi_zd_ls9-CCD4 z exptime 124.103 propid 2016A-0453 seeing 1.04 MJD 58079.106 object MzLS_705640_z k4m_171001_060739_ooi_zd_ls9.fits.fz k4m_171001_060739_ooi_zd_ls9-CCD2 z exptime 124.103 propid 2016A-0453 seeing 0.85 MJD 58027.255 object MzLS_706142_z k4m_171123_025255_ooi_zd_ls9.fits.fz k4m_171123_025255_ooi_zd_ls9-CCD2 z exptime 216.103 propid 2016A-0453 seeing 1.13 MJD 58080.120 object MzLS_705641_z k4m_171116_031604_ooi_zd_ls9.fits.fz k4m_171116_031604_ooi_zd_ls9-CCD1 z exptime 107.105 propid 2016A-0453 seeing 0.85 MJD 58073.136 object MzLS_706639_z ksb_180715_051832_ooi_g_ls9.fits.fz ksb_180715_051832_ooi_g_ls9-CCD2 g exptime 150.708 propid NOTBASS seeing 1.28 MJD 58314.221 object 44001 ksb_180510_104743_ooi_r_ls9.fits.fz ksb_180510_104743_ooi_r_ls9-CCD2 r exptime 84.379 propid NOTBASS seeing 1.13 MJD 58248.450 object 44001 ksb_180722_071614_ooi_g_ls9.fits.fz ksb_180722_071614_ooi_g_ls9-CCD3 g exptime 250.0 propid NOTBASS seeing 1.43 MJD 58321.303 object 44013 ksb_180521_100205_ooi_r_ls9.fits.fz ksb_180521_100205_ooi_r_ls9-CCD3 r exptime 138.094 propid NOTBASS seeing 1.94 MJD 58259.418 object 44013 ksb_180522_100410_ooi_r_ls9.fits.fz ksb_180522_100410_ooi_r_ls9-CCD2 r exptime 173.51 propid NOTBASS seeing 1.72 MJD 58260.420 object 44002 ksb_180517_100259_ooi_g_ls9.fits.fz ksb_180517_100259_ooi_g_ls9-CCD2 g exptime 166.421 propid NOTBASS seeing 1.47 MJD 58255.419 object 44002 ksb_180722_073522_ooi_g_ls9.fits.fz ksb_180722_073522_ooi_g_ls9-CCD4 g exptime 250.0 propid NOTBASS seeing 1.64 MJD 58321.316 object 44011 ksb_180510_105554_ooi_r_ls9.fits.fz ksb_180510_105554_ooi_r_ls9-CCD4 r exptime 95.817 propid NOTBASS seeing 1.21 MJD 58248.455 object 44011 mosaic get_fwhm: self.fwhm = 3.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 183 664 and amp range 0 2005 and image y 2845 3315 and amp range 2040 4078 Range in image: x 0 482 , y 0 471 (with image size 482 x 471) dzp 0.014419514 -> scaling image by 1.0133694453441033 mosaic get_fwhm: self.fwhm = 4.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 4044 4088 and amp range 2048 4095 and image y 500 980 and amp range 0 2039 Range in image: x 0 45 , y 0 481 (with image size 45 x 481) dzp -0.012875672 -> scaling image by 0.9882111074411305 Faked up EXPNUM 82480188 Faked up EXPNUM 82480188 Faked up EXPNUM 82480188 90prime get_fwhm: self.fwhm = 2.49 Found 4 relevant rows in amp-corrections file. Found overlap: image x 550 825 and amp range 0 2015 and image y 15 155 and amp range 0 2047 Range in image: x 0 276 , y 0 141 (with image size 276 x 141) dzp -0.003875085 -> scaling image by 0.9964372765054066 Faked up EXPNUM 83210085 Faked up EXPNUM 83210085 Faked up EXPNUM 83210085 90prime get_fwhm: self.fwhm = 3.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2855 3124 and amp range 2016 4031 and image y 1399 1669 and amp range 0 2047 Range in image: x 0 270 , y 0 271 (with image size 270 x 271) dzp -0.0012233759 -> scaling image by 0.9988738637196966 Faked up EXPNUM 82590130 Faked up EXPNUM 82590130 Faked up EXPNUM 82590130 90prime get_fwhm: self.fwhm = 4.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2849 3118 and amp range 2016 4031 and image y 1400 1670 and amp range 0 2047 Range in image: x 0 270 , y 0 271 (with image size 270 x 271) dzp 0.0057031885 -> scaling image by 1.00526665101287 Faked up EXPNUM 82600089 Faked up EXPNUM 82600089 Faked up EXPNUM 82600089 90prime get_fwhm: self.fwhm = 3.79 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2561 2836 and amp range 2016 4031 and image y 1833 2110 and amp range 0 2047 Range in image: x 0 276 , y 0 215 (with image size 276 x 278) dzp 0.014483032 -> scaling image by 1.0134287315188357 Found overlap: image x 2561 2836 and amp range 2016 4031 and image y 1833 2110 and amp range 2048 4095 Range in image: x 0 276 , y 215 278 (with image size 276 x 278) dzp 0.019008487 -> scaling image by 1.0176616178968958 Faked up EXPNUM 83140042 Faked up EXPNUM 83140042 Faked up EXPNUM 83140042 90prime get_fwhm: self.fwhm = 2.83 Found 4 relevant rows in amp-corrections file. Found overlap: image x 550 823 and amp range 0 2015 and image y 15 149 and amp range 0 2047 Range in image: x 0 274 , y 0 135 (with image size 274 x 135) dzp -0.0036920775 -> scaling image by 0.9966052462302274 Faked up EXPNUM 82550142 Faked up EXPNUM 82550142 Faked up EXPNUM 82550142 90prime get_fwhm: self.fwhm = 3.25 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2576 2851 and amp range 2016 4031 and image y 1837 2114 and amp range 0 2047 Range in image: x 0 276 , y 0 211 (with image size 276 x 278) dzp 0.009189803 -> scaling image by 1.0085000434534261 Found overlap: image x 2576 2851 and amp range 2016 4031 and image y 1837 2114 and amp range 2048 4095 Range in image: x 0 276 , y 211 278 (with image size 276 x 278) dzp 0.013237011 -> scaling image by 1.012266359574015 Faked up EXPNUM 83210089 Faked up EXPNUM 83210089 Faked up EXPNUM 83210089 90prime get_fwhm: self.fwhm = 3.61 Found 4 relevant rows in amp-corrections file. Found overlap: image x 668 939 and amp range 0 2015 and image y 3346 3619 and amp range 2048 4095 Range in image: x 0 272 , y 0 274 (with image size 272 x 274) dzp 0.027550658 -> scaling image by 1.0256997821704772 mosaic get_fwhm: self.fwhm = 3.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1302 1771 and amp range 0 2047 and image y 2430 2901 and amp range 2040 4078 Range in image: x 0 470 , y 0 472 (with image size 470 x 472) dzp 0.003927584 -> scaling image by 1.0036239891963392 mosaic get_fwhm: self.fwhm = 3.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2880 3349 and amp range 2006 4053 and image y 2453 2921 and amp range 2040 4078 Range in image: x 0 470 , y 0 469 (with image size 470 x 469) dzp 0.0036595785 -> scaling image by 1.003376283213225 Faked up EXPNUM 82480192 Faked up EXPNUM 82480192 Faked up EXPNUM 82480192 90prime get_fwhm: self.fwhm = 2.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 671 941 and amp range 0 2015 and image y 3360 3632 and amp range 2048 4095 Range in image: x 0 271 , y 0 273 (with image size 271 x 273) dzp 0.04491909 -> scaling image by 1.0422397564357018 Stage tims : Wall: 27.90 s, CPU: 8.05 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 182 MB, VmData: 215 MB, maxrss: 0.56658 MB Stage tims finished: 2020-06-07T17:33:24.592051 Resources for stage tims : 3.605 s worker CPU, 72.812 s worker Wall, Wall: 27.899 s, Cores in use: 0.42, Total efficiency (on 4 cores): 10.4 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T17:33:24.623740 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00529.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00466.fits Matched 6 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/metrics/cus/reference-custom-278100p66895.fits Stage refs : Wall: 6.73 s, CPU: 6.13 s, VmPeak: 986 MB, VmSize: 980 MB, VmRSS: 221 MB, VmData: 253 MB, maxrss: 0.56658 MB Stage refs finished: 2020-06-07T17:33:31.351620 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.729 s, Cores in use: 0.91, Total efficiency (on 4 cores): 22.8 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T17:33:31.353385 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/metrics/cus/outlier-mask-custom-278100p66895.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/metrics/cus/outliers-pre-custom-278100p66895.jpg Image ksb_180722_073522_ooi_g_ls9-CCD4 g : masking 147 positive outlier pixels and 0 negative outlier pixels Image ksb_180722_071614_ooi_g_ls9-CCD3 g : masking 53 positive outlier pixels and 0 negative outlier pixels Image ksb_180517_100259_ooi_g_ls9-CCD2 g : masking 71 positive outlier pixels and 0 negative outlier pixels Image ksb_180510_104743_ooi_r_ls9-CCD2 r : masking 183 positive outlier pixels and 0 negative outlier pixels Image ksb_180521_100205_ooi_r_ls9-CCD3 r : masking 289 positive outlier pixels and 149 negative outlier pixels Image ksb_180522_100410_ooi_r_ls9-CCD2 r : masking 10679 positive outlier pixels and 0 negative outlier pixels Image k4m_171123_025255_ooi_zd_ls9-CCD2 z : masking 232 positive outlier pixels and 354 negative outlier pixels Image k4m_171110_040435_ooi_zd_ls9-CCD1 z : masking 528 positive outlier pixels and 0 negative outlier pixels Image k4m_171001_060739_ooi_zd_ls9-CCD2 z : masking 2293 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/metrics/cus/outlier-mask-custom-278100p66895.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/metrics/cus/outliers-post-custom-278100p66895.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/metrics/cus/outliers-masked-pos-custom-278100p66895.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/metrics/cus/outliers-masked-neg-custom-278100p66895.jpg Stage outliers : Wall: 6.87 s, CPU: 5.55 s, VmPeak: 990 MB, VmSize: 990 MB, VmRSS: 258 MB, VmData: 287 MB, maxrss: 0.56658 MB Stage outliers finished: 2020-06-07T17:33:38.220179 Resources for stage outliers : 3.843 s worker CPU, 4.020 s worker Wall, Wall: 6.868 s, Cores in use: 1.37, Total efficiency (on 4 cores): 34.2 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T17:33:38.221849 Stage halos : Wall: 5.07 s, CPU: 5.06 s, VmPeak: 990 MB, VmSize: 990 MB, VmRSS: 258 MB, VmData: 287 MB, maxrss: 0.56658 MB Stage halos finished: 2020-06-07T17:33:43.288491 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 5.068 s, Cores in use: 1.00, Total efficiency (on 4 cores): 25.0 % Stage halos finished Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-06-07T17:33:43.290316 PSF sigmas in coadd pixels: ['2.08', '2.32', '2.39', '2.66'] Using average PSF sigma 2.3636728843025594 Gaussian PSF norm 0.11934595249930909 vs pixelized 0.09777145 average tim pixel scale / coadd scale: 1.730402870030846 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.83', '3.14', '2.79', '1.97'] Using average PSF sigma 2.433720659797589 Gaussian PSF norm 0.11591091633225474 vs pixelized 0.0870861 average tim pixel scale / coadd scale: 1.7304893983847938 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.67', '1.38', '1.84', '1.39'] Using average PSF sigma 1.570998343822155 Gaussian PSF norm 0.17956402874846872 vs pixelized 0.15081552 average tim pixel scale / coadd scale: 0.9910967408720304 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.62 s, CPU: 0.54 s, VmPeak: 990 MB, VmSize: 990 MB, VmRSS: 260 MB, VmData: 288 MB, maxrss: 0.56658 MB Stage fit_on_coadds finished: 2020-06-07T17:33:43.912199 Resources for stage fit_on_coadds : 0.893 s worker CPU, 0.969 s worker Wall, Wall: 0.623 s, Cores in use: 2.31, Total efficiency (on 4 cores): 57.7 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T17:33:43.915306 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 68 potential peaks Of 68 potential peaks: 19 in veto map, 8 cut by saddle test, 0 cut by aper test, 41 kept SED z : 41 new peaks Found 49 potential peaks Of 49 potential peaks: 44 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 42 potential peaks Of 42 potential peaks: 37 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 74 potential peaks Of 74 potential peaks: 61 in veto map, 7 cut by saddle test, 0 cut by aper test, 6 kept SED Flat : 6 new peaks Found 89 potential peaks Of 89 potential peaks: 77 in veto map, 9 cut by saddle test, 0 cut by aper test, 3 kept SED Red : 3 new peaks Adding 52 new sources Median coadd sky for g : 1.4926118e-05 Median coadd sky for r : 5.7345766e-05 Median coadd sky for z : 0.00017504608 Stage srcs : Wall: 5.79 s, CPU: 5.67 s, VmPeak: 990 MB, VmSize: 990 MB, VmRSS: 261 MB, VmData: 288 MB, maxrss: 0.56658 MB Stage srcs finished: 2020-06-07T17:33:49.704636 Resources for stage srcs : 0.368 s worker CPU, 0.368 s worker Wall, Wall: 5.790 s, Cores in use: 1.04, Total efficiency (on 4 cores): 26.1 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T17:33:49.726046 Blob 1 of 33, id: 11, sources: 19, size: 369x223, npix 30609, brick X: 54,423, Y: 106,329, one pixel: 200 106 Blob 2 of 33, id: 4, sources: 6, size: 79x82, npix 3829, brick X: 259,338, Y: 40,122, one pixel: 287 40 Blob 3 of 33, id: 21, sources: 4, size: 73x96, npix 3781, brick X: 120,193, Y: 263,359, one pixel: 143 263 Blob 4 of 33, id: 0, sources: 2, size: 68x48, npix 2357, brick X: 89,157, Y: 0,48, one pixel: 97 0 Blob 5 of 33, id: 29, sources: 1, size: 53x55, npix 2059, brick X: 344,397, Y: 401,456, one pixel: 373 401 Measuring 2 iterative sources Blob 3 finished, total: Wall: 2.78 s, CPU: 2.73 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143116 MB Blob 6 of 33, id: 18, sources: 1, size: 48x46, npix 1457, brick X: 29,77, Y: 201,247, one pixel: 53 201 Blob 5 finished, total: Wall: 1.22 s, CPU: 1.22 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143808 MB Blob 7 of 33, id: 6, sources: 2, size: 50x42, npix 1376, brick X: 415,465, Y: 73,115, one pixel: 444 73 Blob 4 finished, total: Wall: 4.04 s, CPU: 3.98 s, VmPeak: 803 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145516 MB Blob 8 of 33, id: 24, sources: 2, size: 45x49, npix 1259, brick X: 146,191, Y: 360,409, one pixel: 172 360 Blob 2 finished, total: Wall: 4.99 s, CPU: 4.99 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.14364 MB Blob 9 of 33, id: 31, sources: 3, size: 44x34, npix 954, brick X: 49,93, Y: 431,465, one pixel: 77 431 Blob 7 finished, total: Wall: 1.26 s, CPU: 1.26 s, VmPeak: 803 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145516 MB Blob 10 of 33, id: 25, sources: 2, size: 30x44, npix 757, brick X: 277,307, Y: 377,421, one pixel: 287 377 Blob 6 finished, total: Wall: 1.43 s, CPU: 1.43 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143808 MB Blob 11 of 33, id: 20, sources: 1, size: 30x31, npix 614, brick X: 359,389, Y: 228,259, one pixel: 373 228 Blob 8 finished, total: Wall: 1.80 s, CPU: 1.80 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.143932 MB Blob 12 of 33, id: 13, sources: 2, size: 32x37, npix 576, brick X: 320,352, Y: 121,158, one pixel: 338 121 Blob 10 finished, total: Wall: 1.40 s, CPU: 1.39 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144148 MB Blob 13 of 33, id: 12, sources: 1, size: 28x30, npix 558, brick X: 248,276, Y: 119,149, one pixel: 259 119 Blob 9 finished, total: Wall: 1.87 s, CPU: 1.87 s, VmPeak: 803 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145516 MB Blob 14 of 33, id: 23, sources: 2, size: 23x35, npix 499, brick X: 245,268, Y: 357,392, one pixel: 255 357 Blob 11 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.143932 MB Blob 15 of 33, id: 15, sources: 1, size: 27x30, npix 486, brick X: 30,57, Y: 168,198, one pixel: 38 168 Blob 12 finished, total: Wall: 1.09 s, CPU: 1.09 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144148 MB Blob 16 of 33, id: 3, sources: 1, size: 26x27, npix 470, brick X: 55,81, Y: 26,53, one pixel: 66 26 Blob 13 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 803 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145516 MB Blob 17 of 33, id: 17, sources: 1, size: 25x29, npix 458, brick X: 359,384, Y: 196,225, one pixel: 371 196 Blob 14 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.143932 MB Blob 18 of 33, id: 26, sources: 1, size: 27x27, npix 436, brick X: 341,368, Y: 377,404, one pixel: 352 377 Measuring 1 iterative sources Blob 15 finished, total: Wall: 0.48 s, CPU: 0.48 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144148 MB Blob 19 of 33, id: 2, sources: 1, size: 25x26, npix 428, brick X: 440,465, Y: 13,39, one pixel: 450 13 Blob 16 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 803 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145516 MB Blob 20 of 33, id: 22, sources: 1, size: 24x26, npix 400, brick X: 214,238, Y: 333,359, one pixel: 224 333 Blob 17 finished, total: Wall: 0.63 s, CPU: 0.63 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.143932 MB Blob 21 of 33, id: 9, sources: 1, size: 24x26, npix 387, brick X: 95,119, Y: 90,116, one pixel: 107 90 Blob 18 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144148 MB Blob 22 of 33, id: 1, sources: 1, size: 26x19, npix 363, brick X: 375,401, Y: 0,19, one pixel: 379 0 Blob 23 of 33, id: 10, sources: 1, size: 24x24, npix 360, brick X: 360,384, Y: 96,120, one pixel: 371 96 Blob 19 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 803 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145764 MB Blob 20 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144116 MB Blob 24 of 33, id: 5, sources: 1, size: 23x23, npix 327, brick X: 56,79, Y: 68,91, one pixel: 67 68 Blob 25 of 33, id: 14, sources: 1, size: 23x23, npix 324, brick X: 412,435, Y: 162,185, one pixel: 424 162 Blob 21 finished, total: Wall: 0.57 s, CPU: 0.56 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144148 MB Blob 26 of 33, id: 27, sources: 1, size: 20x21, npix 257, brick X: 42,62, Y: 398,419, one pixel: 50 398 Blob 24 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144148 MB Blob 27 of 33, id: 19, sources: 1, size: 20x21, npix 249, brick X: 3,23, Y: 224,245, one pixel: 12 224 Blob 23 finished, total: Wall: 0.47 s, CPU: 0.47 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144116 MB Blob 28 of 33, id: 8, sources: 1, size: 19x21, npix 246, brick X: 144,163, Y: 82,103, one pixel: 152 82 Blob 26 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144116 MB Blob 29 of 33, id: 7, sources: 1, size: 20x21, npix 239, brick X: 11,31, Y: 77,98, one pixel: 21 77 Blob 25 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144148 MB Blob 30 of 33, id: 28, sources: 1, size: 19x20, npix 218, brick X: 119,138, Y: 400,420, one pixel: 128 400 Blob 27 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144116 MB Blob 31 of 33, id: 16, sources: 1, size: 19x19, npix 208, brick X: 342,361, Y: 172,191, one pixel: 350 172 Blob 29 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144116 MB Blob 32 of 33, id: 32, sources: 1, size: 19x19, npix 199, brick X: 215,234, Y: 435,454, one pixel: 224 435 Blob 22 finished, total: Wall: 1.83 s, CPU: 1.83 s, VmPeak: 803 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145764 MB Blob 33 of 33, id: 30, sources: 1, size: 17x17, npix 145, brick X: 258,275, Y: 409,426, one pixel: 266 409 Blob 31 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 803 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145764 MB Blob 32 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 803 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145764 MB Blob 30 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144116 MB Blob 33 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 803 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145764 MB Blob 28 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144148 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.53611, ee1=-0.813603, ee2=-0.861458 Measuring 13 iterative sources Blob 1 finished, total: Wall: 34.97 s, CPU: 34.96 s, VmPeak: 791 MB, VmSize: 755 MB, VmRSS: 191 MB, VmData: 220 MB, maxrss: 0.195968 MB Old catalog: 73 New catalog: 77 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/metrics/cus/blobs-custom-278100p66895.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/metrics/cus/all-models-custom-278100p66895.fits Stage fitblobs : Wall: 39.09 s, CPU: 4.20 s, VmPeak: 990 MB, VmSize: 990 MB, VmRSS: 261 MB, VmData: 288 MB, maxrss: 0.56658 MB Stage fitblobs finished: 2020-06-07T17:34:28.814600 Resources for stage fitblobs : 69.329 s worker CPU, 69.514 s worker Wall, Wall: 39.090 s, Cores in use: 1.88, Total efficiency (on 4 cores): 47.0 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T17:34:28.819372 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/tmp-legacysurvey-custom-278100p66895-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/tmp-legacysurvey-custom-278100p66895-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/tmp-legacysurvey-custom-278100p66895-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/tmp-legacysurvey-custom-278100p66895-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-resid.jpg Stage coadds : Wall: 4.65 s, CPU: 3.22 s, VmPeak: 1010 MB, VmSize: 1010 MB, VmRSS: 281 MB, VmData: 310 MB, maxrss: 0.56658 MB Stage coadds finished: 2020-06-07T17:34:33.464362 Resources for stage coadds : 3.567 s worker CPU, 3.924 s worker Wall, Wall: 4.646 s, Cores in use: 1.46, Total efficiency (on 4 cores): 36.5 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T17:34:33.465916 Cut to 1 unWISE tiles Reading WISE tile 2783p666 band 1 Reading WISE tile 2783p666 band 4 Reading WISE tile 2783p666 band 2 Reading WISE tile 2783p666 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.53 s, CPU: 0.84 s, VmPeak: 1062 MB, VmSize: 998 MB, VmRSS: 150 MB, VmData: 188 MB, maxrss: 0.19512 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.42 s, CPU: 0.51 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.21232 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.29 s, CPU: 0.36 s, VmPeak: 1010 MB, VmSize: 1010 MB, VmRSS: 168 MB, VmData: 200 MB, maxrss: 0.224336 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.23 s, CPU: 0.44 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 152 MB, VmData: 189 MB, maxrss: 0.2153 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/tmp-legacysurvey-custom-278100p66895-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/tmp-legacysurvey-custom-278100p66895-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 6.16 s, CPU: 3.83 s, VmPeak: 1010 MB, VmSize: 1010 MB, VmRSS: 282 MB, VmData: 310 MB, maxrss: 0.56658 MB Stage wise_forced finished: 2020-06-07T17:34:39.628618 Resources for stage wise_forced : 6.947 s worker CPU, 8.174 s worker Wall, Wall: 6.164 s, Cores in use: 1.75, Total efficiency (on 4 cores): 43.7 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T17:34:39.630386 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/tractor-i/cus/tractor-custom-278100p66895.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/tractor/cus/tractor-custom-278100p66895.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/tractor/cus/brick-custom-278100p66895.sha256sum Stage writecat : Wall: 4.61 s, CPU: 4.35 s, VmPeak: 1142 MB, VmSize: 1014 MB, VmRSS: 284 MB, VmData: 310 MB, maxrss: 0.56658 MB Stage writecat finished: 2020-06-07T17:34:44.245417 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.616 s, Cores in use: 0.94, Total efficiency (on 4 cores): 23.6 % Stage writecat finished All done: 88.555 s worker CPU, 159.784 s worker Wall, Wall: 107.556 s, Cores in use: 1.26, Total efficiency (on 4 cores): 31.4 % Finished galaxy PGC2692384 in 1.934 minutes. Started working on galaxy PGC2692384 at Thu Jul 23 06:57:06 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 278.10022200000003 66.8953503 --width 465 --height 465 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-07-23T06:57:08.392944 legacypipe git version: DR9.5.5-21-g66b1aacb Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '278.10022200000003', '66.8953503', '--width', '465', '--height', '465', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 278.10022200000003 66.8953503 --width 465 --height 465 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 278.10022200000003 66.8953503 Starting process 58783 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 58784 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 58785 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058876 MB Starting process 58786 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059168 MB Starting process 58787 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059176 MB Starting process 58788 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059176 MB Starting process 58789 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB Starting process 58790 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB Starting process 58791 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB Starting process 58792 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB Starting process 58793 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB Starting process 58794 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB Starting process 58795 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB Starting process 58796 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB Starting process 58797 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB Starting process 58798 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-07-23T06:57:09.174849 Keeping 13 CCDs: k4m_171110_040435_ooi_zd_ls9.fits.fz k4m_171110_040435_ooi_zd_ls9-CCD1 z exptime 129.103 propid 2016A-0453 seeing 1.03 MJD 58067.170 object MzLS_707133_z k4m_171122_023311_ooi_zd_ls9.fits.fz k4m_171122_023311_ooi_zd_ls9-CCD4 z exptime 124.103 propid 2016A-0453 seeing 1.04 MJD 58079.106 object MzLS_705640_z k4m_171001_060739_ooi_zd_ls9.fits.fz k4m_171001_060739_ooi_zd_ls9-CCD2 z exptime 124.103 propid 2016A-0453 seeing 0.85 MJD 58027.255 object MzLS_706142_z k4m_171123_025255_ooi_zd_ls9.fits.fz k4m_171123_025255_ooi_zd_ls9-CCD2 z exptime 216.103 propid 2016A-0453 seeing 1.13 MJD 58080.120 object MzLS_705641_z k4m_171116_031604_ooi_zd_ls9.fits.fz k4m_171116_031604_ooi_zd_ls9-CCD1 z exptime 107.105 propid 2016A-0453 seeing 0.85 MJD 58073.136 object MzLS_706639_z ksb_180715_051832_ooi_g_ls9.fits.fz ksb_180715_051832_ooi_g_ls9-CCD2 g exptime 150.708 propid NOTBASS seeing 1.28 MJD 58314.221 object 44001 ksb_180510_104743_ooi_r_ls9.fits.fz ksb_180510_104743_ooi_r_ls9-CCD2 r exptime 84.379 propid NOTBASS seeing 1.13 MJD 58248.450 object 44001 ksb_180722_071614_ooi_g_ls9.fits.fz ksb_180722_071614_ooi_g_ls9-CCD3 g exptime 250.0 propid NOTBASS seeing 1.43 MJD 58321.303 object 44013 ksb_180521_100205_ooi_r_ls9.fits.fz ksb_180521_100205_ooi_r_ls9-CCD3 r exptime 138.094 propid NOTBASS seeing 1.94 MJD 58259.418 object 44013 ksb_180522_100410_ooi_r_ls9.fits.fz ksb_180522_100410_ooi_r_ls9-CCD2 r exptime 173.51 propid NOTBASS seeing 1.72 MJD 58260.420 object 44002 ksb_180517_100259_ooi_g_ls9.fits.fz ksb_180517_100259_ooi_g_ls9-CCD2 g exptime 166.421 propid NOTBASS seeing 1.47 MJD 58255.419 object 44002 ksb_180722_073522_ooi_g_ls9.fits.fz ksb_180722_073522_ooi_g_ls9-CCD4 g exptime 250.0 propid NOTBASS seeing 1.64 MJD 58321.316 object 44011 ksb_180510_105554_ooi_r_ls9.fits.fz ksb_180510_105554_ooi_r_ls9-CCD4 r exptime 95.817 propid NOTBASS seeing 1.21 MJD 58248.455 object 44011 Faked up EXPNUM 83210085 Faked up EXPNUM 83210085 Faked up EXPNUM 83210085 90prime get_fwhm: self.fwhm = 3.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2855 3124 and amp range 2016 4031 and image y 1399 1669 and amp range 0 2047 Range in image: x 0 270 , y 0 271 (with image size 270 x 271) dzp -0.0012233759 -> scaling image by 0.9988738637196966 mosaic get_fwhm: self.fwhm = 4.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 4044 4088 and amp range 2048 4095 and image y 500 980 and amp range 0 2039 Range in image: x 0 45 , y 0 481 (with image size 45 x 481) dzp -0.012875672 -> scaling image by 0.9882111074411305 Faked up EXPNUM 82600089 Faked up EXPNUM 82600089 Faked up EXPNUM 82600089 90prime get_fwhm: self.fwhm = 3.79 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2561 2836 and amp range 2016 4031 and image y 1833 2110 and amp range 0 2047 Range in image: x 0 276 , y 0 215 (with image size 276 x 278) dzp 0.014483032 -> scaling image by 1.0134287315188357 Found overlap: image x 2561 2836 and amp range 2016 4031 and image y 1833 2110 and amp range 2048 4095 Range in image: x 0 276 , y 215 278 (with image size 276 x 278) dzp 0.019008487 -> scaling image by 1.0176616178968958 Faked up EXPNUM 82480192 Faked up EXPNUM 82480192 Faked up EXPNUM 82480192 90prime get_fwhm: self.fwhm = 2.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 671 941 and amp range 0 2015 and image y 3360 3632 and amp range 2048 4095 Range in image: x 0 271 , y 0 273 (with image size 271 x 273) dzp 0.04491909 -> scaling image by 1.0422397564357018 mosaic get_fwhm: self.fwhm = 3.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 183 664 and amp range 0 2005 and image y 2845 3315 and amp range 2040 4078 Range in image: x 0 482 , y 0 471 (with image size 482 x 471) dzp 0.014419514 -> scaling image by 1.0133694453441033 Faked up EXPNUM 83140042 Faked up EXPNUM 83140042 Faked up EXPNUM 83140042 90prime get_fwhm: self.fwhm = 2.83 Found 4 relevant rows in amp-corrections file. Found overlap: image x 550 823 and amp range 0 2015 and image y 15 149 and amp range 0 2047 Range in image: x 0 274 , y 0 135 (with image size 274 x 135) dzp -0.0036920775 -> scaling image by 0.9966052462302274 Faked up EXPNUM 82480188 Faked up EXPNUM 82480188 Faked up EXPNUM 82480188 90prime get_fwhm: self.fwhm = 2.49 Found 4 relevant rows in amp-corrections file. Found overlap: image x 550 825 and amp range 0 2015 and image y 15 155 and amp range 0 2047 Range in image: x 0 276 , y 0 141 (with image size 276 x 141) dzp -0.003875085 -> scaling image by 0.9964372765054066 Faked up EXPNUM 82550142 Faked up EXPNUM 82550142 Faked up EXPNUM 82550142 90prime get_fwhm: self.fwhm = 3.25 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2576 2851 and amp range 2016 4031 and image y 1837 2114 and amp range 0 2047 Range in image: x 0 276 , y 0 211 (with image size 276 x 278) dzp 0.009189803 -> scaling image by 1.0085000434534261 Found overlap: image x 2576 2851 and amp range 2016 4031 and image y 1837 2114 and amp range 2048 4095 Range in image: x 0 276 , y 211 278 (with image size 276 x 278) dzp 0.013237011 -> scaling image by 1.012266359574015 Faked up EXPNUM 82590130 Faked up EXPNUM 82590130 Faked up EXPNUM 82590130 90prime get_fwhm: self.fwhm = 4.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2849 3118 and amp range 2016 4031 and image y 1400 1670 and amp range 0 2047 Range in image: x 0 270 , y 0 271 (with image size 270 x 271) dzp 0.0057031885 -> scaling image by 1.00526665101287 mosaic get_fwhm: self.fwhm = 3.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2880 3349 and amp range 2006 4053 and image y 2453 2921 and amp range 2040 4078 Range in image: x 0 470 , y 0 469 (with image size 470 x 469) dzp 0.0036595785 -> scaling image by 1.003376283213225 Faked up EXPNUM 83210089 Faked up EXPNUM 83210089 Faked up EXPNUM 83210089 90prime get_fwhm: self.fwhm = 3.61 Found 4 relevant rows in amp-corrections file. Found overlap: image x 668 939 and amp range 0 2015 and image y 3346 3619 and amp range 2048 4095 Range in image: x 0 272 , y 0 274 (with image size 272 x 274) dzp 0.027550658 -> scaling image by 1.0256997821704772 mosaic get_fwhm: self.fwhm = 3.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1302 1771 and amp range 0 2047 and image y 2430 2901 and amp range 2040 4078 Range in image: x 0 470 , y 0 472 (with image size 470 x 472) dzp 0.003927584 -> scaling image by 1.0036239891963392 Stage tims : Wall: 8.96 s, CPU: 0.99 s, VmPeak: 945 MB, VmSize: 945 MB, VmRSS: 183 MB, VmData: 217 MB, maxrss: 0.18738 MB Stage tims finished: 2020-07-23T06:57:18.133680 Resources for stage tims : 7.308 s worker CPU, 66.021 s worker Wall, Wall: 8.961 s, Cores in use: 0.93, Total efficiency (on 16 cores): 5.8 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-tims.p Running stage refs Running stage refs at 2020-07-23T06:57:18.406091 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00529.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00466.fits Matched 6 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/metrics/cus/reference-custom-278100p66895.fits Stage refs : Wall: 6.86 s, CPU: 4.96 s, VmPeak: 989 MB, VmSize: 983 MB, VmRSS: 223 MB, VmData: 256 MB, maxrss: 0.228364 MB Stage refs finished: 2020-07-23T06:57:25.269430 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.865 s, Cores in use: 0.72, Total efficiency (on 16 cores): 4.5 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-07-23T06:57:25.406169 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/metrics/cus/outlier-mask-custom-278100p66895.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/metrics/cus/outliers-pre-custom-278100p66895.jpg Image ksb_180722_071614_ooi_g_ls9-CCD3 g : masking 53 positive outlier pixels and 0 negative outlier pixels Image ksb_180517_100259_ooi_g_ls9-CCD2 g : masking 71 positive outlier pixels and 0 negative outlier pixels Image ksb_180722_073522_ooi_g_ls9-CCD4 g : masking 147 positive outlier pixels and 0 negative outlier pixels Image ksb_180521_100205_ooi_r_ls9-CCD3 r : masking 289 positive outlier pixels and 149 negative outlier pixels Image ksb_180522_100410_ooi_r_ls9-CCD2 r : masking 10679 positive outlier pixels and 0 negative outlier pixels Image ksb_180510_104743_ooi_r_ls9-CCD2 r : masking 183 positive outlier pixels and 0 negative outlier pixels Image k4m_171123_025255_ooi_zd_ls9-CCD2 z : masking 232 positive outlier pixels and 354 negative outlier pixels Image k4m_171110_040435_ooi_zd_ls9-CCD1 z : masking 528 positive outlier pixels and 0 negative outlier pixels Image k4m_171001_060739_ooi_zd_ls9-CCD2 z : masking 2293 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/metrics/cus/outlier-mask-custom-278100p66895.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/metrics/cus/outliers-post-custom-278100p66895.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/metrics/cus/outliers-masked-pos-custom-278100p66895.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/metrics/cus/outliers-masked-neg-custom-278100p66895.jpg Stage outliers : Wall: 2.87 s, CPU: 1.29 s, VmPeak: 993 MB, VmSize: 993 MB, VmRSS: 263 MB, VmData: 292 MB, maxrss: 0.269384 MB Stage outliers finished: 2020-07-23T06:57:28.279078 Resources for stage outliers : 2.781 s worker CPU, 2.919 s worker Wall, Wall: 2.875 s, Cores in use: 1.42, Total efficiency (on 16 cores): 8.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-07-23T06:57:28.312848 Stage halos : Wall: 0.50 s, CPU: 0.48 s, VmPeak: 993 MB, VmSize: 993 MB, VmRSS: 264 MB, VmData: 293 MB, maxrss: 0.269832 MB Stage halos finished: 2020-07-23T06:57:28.809202 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.498 s, Cores in use: 0.96, Total efficiency (on 16 cores): 6.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-07-23T06:57:28.846174 PSF sigmas in coadd pixels: ['2.08', '2.32', '2.39', '2.66'] Using average PSF sigma 2.3636728843025594 Gaussian PSF norm 0.11934595249930909 vs pixelized 0.09777145 average tim pixel scale / coadd scale: 1.730402870030846 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.83', '3.14', '2.79', '1.97'] Using average PSF sigma 2.433720659797589 Gaussian PSF norm 0.11591091633225474 vs pixelized 0.0870861 average tim pixel scale / coadd scale: 1.7304893983847938 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.67', '1.38', '1.84', '1.39'] Using average PSF sigma 1.570998343822155 Gaussian PSF norm 0.17956402874846872 vs pixelized 0.15081552 average tim pixel scale / coadd scale: 0.9910967408720304 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.46 s, CPU: 0.46 s, VmPeak: 993 MB, VmSize: 993 MB, VmRSS: 265 MB, VmData: 293 MB, maxrss: 0.271304 MB Stage fit_on_coadds finished: 2020-07-23T06:57:29.302482 Resources for stage fit_on_coadds : 0.748 s worker CPU, 0.748 s worker Wall, Wall: 0.458 s, Cores in use: 2.63, Total efficiency (on 16 cores): 16.4 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-07-23T06:57:29.321374 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 66 potential peaks Of 66 potential peaks: 18 in veto map, 7 cut by saddle test, 0 cut by aper test, 41 kept SED z : 41 new peaks Found 49 potential peaks Of 49 potential peaks: 44 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 42 potential peaks Of 42 potential peaks: 37 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 74 potential peaks Of 74 potential peaks: 61 in veto map, 7 cut by saddle test, 0 cut by aper test, 6 kept SED Flat : 6 new peaks Found 89 potential peaks Of 89 potential peaks: 77 in veto map, 9 cut by saddle test, 0 cut by aper test, 3 kept SED Red : 3 new peaks Adding 52 new sources Median coadd sky for g : 1.4926118e-05 Median coadd sky for r : 5.7345766e-05 Median coadd sky for z : 0.00017504621 Stage srcs : Wall: 0.85 s, CPU: 0.77 s, VmPeak: 993 MB, VmSize: 993 MB, VmRSS: 265 MB, VmData: 293 MB, maxrss: 0.271816 MB Stage srcs finished: 2020-07-23T06:57:30.167058 Resources for stage srcs : 0.215 s worker CPU, 0.215 s worker Wall, Wall: 0.847 s, Cores in use: 1.17, Total efficiency (on 16 cores): 7.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-07-23T06:57:30.213714 Blob 1 of 33, id: 11, sources: 19, size: 369x223, npix 30609, brick X: 54,423, Y: 106,329, one pixel: 200 106 Blob 2 of 33, id: 4, sources: 6, size: 79x82, npix 3829, brick X: 259,338, Y: 40,122, one pixel: 287 40 Blob 3 of 33, id: 21, sources: 4, size: 73x96, npix 3781, brick X: 120,193, Y: 263,359, one pixel: 143 263 Blob 4 of 33, id: 0, sources: 2, size: 68x48, npix 2357, brick X: 89,157, Y: 0,48, one pixel: 97 0 Blob 5 of 33, id: 29, sources: 1, size: 53x55, npix 2059, brick X: 344,397, Y: 401,456, one pixel: 373 401 Blob 6 of 33, id: 18, sources: 1, size: 48x46, npix 1457, brick X: 29,77, Y: 201,247, one pixel: 53 201 Blob 7 of 33, id: 6, sources: 2, size: 50x42, npix 1376, brick X: 415,465, Y: 73,115, one pixel: 444 73 Blob 8 of 33, id: 24, sources: 2, size: 45x49, npix 1259, brick X: 146,191, Y: 360,409, one pixel: 172 360 Blob 9 of 33, id: 31, sources: 3, size: 44x34, npix 954, brick X: 49,93, Y: 431,465, one pixel: 77 431 Blob 10 of 33, id: 25, sources: 2, size: 30x44, npix 757, brick X: 277,307, Y: 377,421, one pixel: 287 377 Blob 11 of 33, id: 20, sources: 1, size: 30x31, npix 614, brick X: 359,389, Y: 228,259, one pixel: 373 228 Blob 12 of 33, id: 13, sources: 2, size: 32x37, npix 576, brick X: 320,352, Y: 121,158, one pixel: 338 121 Blob 13 of 33, id: 12, sources: 1, size: 28x30, npix 558, brick X: 248,276, Y: 119,149, one pixel: 259 119 Blob 14 of 33, id: 23, sources: 2, size: 23x35, npix 499, brick X: 245,268, Y: 357,392, one pixel: 255 357 Blob 15 of 33, id: 15, sources: 1, size: 27x30, npix 486, brick X: 30,57, Y: 168,198, one pixel: 38 168 Blob 16 of 33, id: 3, sources: 1, size: 26x27, npix 470, brick X: 55,81, Y: 26,53, one pixel: 66 26 Blob 17 of 33, id: 17, sources: 1, size: 25x29, npix 458, brick X: 359,384, Y: 196,225, one pixel: 371 196 Measuring 1 iterative sources Blob 15 finished, total: Wall: 0.48 s, CPU: 0.46 s, VmPeak: 800 MB, VmSize: 718 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.14702 MB Blob 18 of 33, id: 26, sources: 1, size: 27x27, npix 436, brick X: 341,368, Y: 377,404, one pixel: 352 377 Blob 11 finished, total: Wall: 0.80 s, CPU: 0.78 s, VmPeak: 807 MB, VmSize: 718 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146904 MB Blob 19 of 33, id: 2, sources: 1, size: 25x26, npix 428, brick X: 440,465, Y: 13,39, one pixel: 450 13 Blob 16 finished, total: Wall: 0.83 s, CPU: 0.77 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 105 MB, VmData: 151 MB, maxrss: 0.107944 MB Blob 13 finished, total: Wall: 0.86 s, CPU: 0.86 s, VmPeak: 805 MB, VmSize: 718 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147304 MB Blob 20 of 33, id: 22, sources: 1, size: 24x26, npix 400, brick X: 214,238, Y: 333,359, one pixel: 224 333 Blob 21 of 33, id: 9, sources: 1, size: 24x26, npix 387, brick X: 95,119, Y: 90,116, one pixel: 107 90 Blob 14 finished, total: Wall: 0.91 s, CPU: 0.88 s, VmPeak: 799 MB, VmSize: 718 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147104 MB Blob 22 of 33, id: 1, sources: 1, size: 26x19, npix 363, brick X: 375,401, Y: 0,19, one pixel: 379 0 Blob 23 of 33, id: 10, sources: 1, size: 24x24, npix 360, brick X: 360,384, Y: 96,120, one pixel: 371 96 Blob 12 finished, total: Wall: 1.10 s, CPU: 1.08 s, VmPeak: 687 MB, VmSize: 687 MB, VmRSS: 120 MB, VmData: 162 MB, maxrss: 0.122432 MB Blob 17 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 800 MB, VmSize: 718 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.14702 MB Blob 24 of 33, id: 5, sources: 1, size: 23x23, npix 327, brick X: 56,79, Y: 68,91, one pixel: 67 68 Blob 25 of 33, id: 14, sources: 1, size: 23x23, npix 324, brick X: 412,435, Y: 162,185, one pixel: 424 162 Blob 5 finished, total: Wall: 1.24 s, CPU: 1.24 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 100 MB, VmData: 144 MB, maxrss: 0.10206 MB Blob 26 of 33, id: 27, sources: 1, size: 20x21, npix 257, brick X: 42,62, Y: 398,419, one pixel: 50 398 Measuring 4 iterative sources Blob 7 finished, total: Wall: 1.35 s, CPU: 1.34 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 106 MB, VmData: 151 MB, maxrss: 0.108264 MB Blob 27 of 33, id: 19, sources: 1, size: 20x21, npix 249, brick X: 3,23, Y: 224,245, one pixel: 12 224 Blob 6 finished, total: Wall: 1.43 s, CPU: 1.43 s, VmPeak: 796 MB, VmSize: 718 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147144 MB Blob 28 of 33, id: 8, sources: 1, size: 19x21, npix 246, brick X: 144,163, Y: 82,103, one pixel: 152 82 Blob 24 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 100 MB, VmData: 144 MB, maxrss: 0.102168 MB Blob 29 of 33, id: 7, sources: 1, size: 20x21, npix 239, brick X: 11,31, Y: 77,98, one pixel: 21 77 Blob 21 finished, total: Wall: 0.58 s, CPU: 0.58 s, VmPeak: 799 MB, VmSize: 718 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147104 MB Blob 30 of 33, id: 28, sources: 1, size: 19x20, npix 218, brick X: 119,138, Y: 400,420, one pixel: 128 400 Blob 10 finished, total: Wall: 1.56 s, CPU: 1.56 s, VmPeak: 798 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147736 MB Blob 31 of 33, id: 16, sources: 1, size: 19x19, npix 208, brick X: 342,361, Y: 172,191, one pixel: 350 172 Blob 18 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 807 MB, VmSize: 718 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146904 MB Blob 32 of 33, id: 32, sources: 1, size: 19x19, npix 199, brick X: 215,234, Y: 435,454, one pixel: 224 435 Blob 19 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 106 MB, VmData: 151 MB, maxrss: 0.108092 MB Blob 33 of 33, id: 30, sources: 1, size: 17x17, npix 145, brick X: 258,275, Y: 409,426, one pixel: 266 409 Blob 23 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 800 MB, VmSize: 718 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.14702 MB Blob 20 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 805 MB, VmSize: 718 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147368 MB Blob 32 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 800 MB, VmSize: 718 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.14702 MB Blob 26 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 796 MB, VmSize: 718 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147144 MB Blob 31 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 106 MB, VmData: 151 MB, maxrss: 0.108092 MB Blob 33 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 805 MB, VmSize: 718 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147372 MB Blob 30 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 807 MB, VmSize: 718 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146904 MB Blob 29 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 798 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147736 MB Blob 9 finished, total: Wall: 1.92 s, CPU: 1.92 s, VmPeak: 797 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147584 MB Blob 8 finished, total: Wall: 1.94 s, CPU: 1.94 s, VmPeak: 802 MB, VmSize: 718 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147116 MB Blob 27 finished, total: Wall: 0.44 s, CPU: 0.44 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 100 MB, VmData: 144 MB, maxrss: 0.102168 MB Blob 25 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 673 MB, VmSize: 664 MB, VmRSS: 97 MB, VmData: 142 MB, maxrss: 0.108428 MB Blob 28 finished, total: Wall: 0.62 s, CPU: 0.61 s, VmPeak: 799 MB, VmSize: 718 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147104 MB Blob 22 finished, total: Wall: 1.04 s, CPU: 1.04 s, VmPeak: 687 MB, VmSize: 687 MB, VmRSS: 120 MB, VmData: 162 MB, maxrss: 0.122904 MB Blob 3 finished, total: Wall: 2.44 s, CPU: 2.44 s, VmPeak: 801 MB, VmSize: 718 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146836 MB Blob 2 finished, total: Wall: 3.55 s, CPU: 3.55 s, VmPeak: 803 MB, VmSize: 718 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14818 MB Blob 4 finished, total: Wall: 3.85 s, CPU: 3.84 s, VmPeak: 801 MB, VmSize: 718 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147792 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.53611, ee1=-0.813603, ee2=-0.861458 Measuring 12 iterative sources Blob 1 finished, total: Wall: 25.69 s, CPU: 25.68 s, VmPeak: 797 MB, VmSize: 756 MB, VmRSS: 191 MB, VmData: 220 MB, maxrss: 0.195888 MB Old catalog: 73 New catalog: 77 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/metrics/cus/blobs-custom-278100p66895.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/metrics/cus/all-models-custom-278100p66895.fits Stage fitblobs : Wall: 26.68 s, CPU: 1.04 s, VmPeak: 993 MB, VmSize: 993 MB, VmRSS: 266 MB, VmData: 293 MB, maxrss: 0.272124 MB Stage fitblobs finished: 2020-07-23T06:57:56.898492 Resources for stage fitblobs : 58.363 s worker CPU, 59.121 s worker Wall, Wall: 26.687 s, Cores in use: 2.23, Total efficiency (on 16 cores): 13.9 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-07-23T06:57:56.923819 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/tmp-legacysurvey-custom-278100p66895-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/tmp-legacysurvey-custom-278100p66895-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/tmp-legacysurvey-custom-278100p66895-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/tmp-legacysurvey-custom-278100p66895-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-resid.jpg Stage coadds : Wall: 2.52 s, CPU: 1.19 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 284 MB, VmData: 311 MB, maxrss: 0.29096 MB Stage coadds finished: 2020-07-23T06:57:59.438908 Resources for stage coadds : 8.582 s worker CPU, 9.579 s worker Wall, Wall: 2.517 s, Cores in use: 3.88, Total efficiency (on 16 cores): 24.3 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-07-23T06:57:59.463439 Cut to 1 unWISE tiles Reading WISE tile 2783p666 band 3 Reading WISE tile 2783p666 band 2 Reading WISE tile 2783p666 band 4 Reading WISE tile 2783p666 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.16 s, CPU: 0.44 s, VmPeak: 1015 MB, VmSize: 1015 MB, VmRSS: 170 MB, VmData: 204 MB, maxrss: 0.228268 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.23 s, CPU: 0.66 s, VmPeak: 1000 MB, VmSize: 1000 MB, VmRSS: 148 MB, VmData: 189 MB, maxrss: 0.19208 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.12 s, CPU: 0.28 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 147 MB, VmData: 187 MB, maxrss: 0.207844 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.12 s, CPU: 0.30 s, VmPeak: 998 MB, VmSize: 998 MB, VmRSS: 150 MB, VmData: 187 MB, maxrss: 0.212872 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/tmp-legacysurvey-custom-278100p66895-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/tmp-legacysurvey-custom-278100p66895-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.75 s, CPU: 0.93 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 285 MB, VmData: 311 MB, maxrss: 0.291536 MB Stage wise_forced finished: 2020-07-23T06:58:02.216730 Resources for stage wise_forced : 4.870 s worker CPU, 5.485 s worker Wall, Wall: 2.755 s, Cores in use: 2.10, Total efficiency (on 16 cores): 13.2 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-07-23T06:58:02.267935 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278100p66895/legacysurvey-custom-278100p66895-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/tractor-i/cus/tractor-custom-278100p66895.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/tractor/cus/tractor-custom-278100p66895.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/tractor/cus/brick-custom-278100p66895.sha256sum Stage writecat : Wall: 1.53 s, CPU: 0.61 s, VmPeak: 1144 MB, VmSize: 1016 MB, VmRSS: 286 MB, VmData: 311 MB, maxrss: 0.424284 MB Stage writecat finished: 2020-07-23T06:58:03.800976 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.535 s, Cores in use: 0.40, Total efficiency (on 16 cores): 2.5 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-writecat.p All done: 82.872 s worker CPU, 144.094 s worker Wall, Wall: 54.661 s, Cores in use: 1.75, Total efficiency (on 16 cores): 11.0 % Finished galaxy PGC2692384 in 0.960 minutes. Started working on galaxy PGC2692384 at Fri Aug 7 10:05:56 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 278.1018016277176 66.8949334924834 --width 465 --height 465 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T10:05:57.185742 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '278.1018016277176', '66.8949334924834', '--width', '465', '--height', '465', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 278.1018016277176 66.8949334924834 --width 465 --height 465 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 278.1018016277176 66.8949334924834 Starting process 13378 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 13379 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 13380 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 13381 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 13382 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 13383 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059556 MB Starting process 13384 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059556 MB Starting process 13385 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 13386 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 13387 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 13388 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 13389 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 13390 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 13391 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 13392 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 13393 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T10:05:57.658284 Keeping 13 CCDs: k4m_171110_040435_ooi_zd_ls9-CCD1 z expnum 145635 exptime 129.103 propid 2016A-0453 seeing 1.03 MJD 58067.170 object MzLS_707133_z mosaic/CP/V4.3/CP20171109/k4m_171110_040435_ooi_zd_ls9.fits.fz k4m_171122_023311_ooi_zd_ls9-CCD4 z expnum 148112 exptime 124.103 propid 2016A-0453 seeing 1.04 MJD 58079.106 object MzLS_705640_z mosaic/CP/V4.3/CP20171121/k4m_171122_023311_ooi_zd_ls9.fits.fz k4m_171001_060739_ooi_zd_ls9-CCD2 z expnum 141604 exptime 124.103 propid 2016A-0453 seeing 0.85 MJD 58027.255 object MzLS_706142_z mosaic/CP/V4.3/CP20170930/k4m_171001_060739_ooi_zd_ls9.fits.fz k4m_171123_025255_ooi_zd_ls9-CCD2 z expnum 148293 exptime 216.103 propid 2016A-0453 seeing 1.13 MJD 58080.120 object MzLS_705641_z mosaic/CP/V4.3/CP20171122/k4m_171123_025255_ooi_zd_ls9.fits.fz k4m_171116_031604_ooi_zd_ls9-CCD1 z expnum 146839 exptime 107.105 propid 2016A-0453 seeing 0.85 MJD 58073.136 object MzLS_706639_z mosaic/CP/V4.3/CP20171115/k4m_171116_031604_ooi_zd_ls9.fits.fz ksb_180715_051832_ooi_g_ls9-CCD2 g expnum 83140042 exptime 150.708 propid NOTBASS seeing 1.28 MJD 58314.221 object 44001 90prime/CP/V2.3/CP20180714/ksb_180715_051832_ooi_g_ls9.fits.fz ksb_180510_104743_ooi_r_ls9-CCD2 r expnum 82480188 exptime 84.379 propid NOTBASS seeing 1.13 MJD 58248.450 object 44001 90prime/CP/V2.3/CP20180509/ksb_180510_104743_ooi_r_ls9.fits.fz ksb_180722_071614_ooi_g_ls9-CCD3 g expnum 83210085 exptime 250.0 propid NOTBASS seeing 1.43 MJD 58321.303 object 44013 90prime/CP/V2.3/CP20180721/ksb_180722_071614_ooi_g_ls9.fits.fz ksb_180521_100205_ooi_r_ls9-CCD3 r expnum 82590130 exptime 138.094 propid NOTBASS seeing 1.94 MJD 58259.418 object 44013 90prime/CP/V2.3/CP20180520/ksb_180521_100205_ooi_r_ls9.fits.fz ksb_180522_100410_ooi_r_ls9-CCD2 r expnum 82600089 exptime 173.51 propid NOTBASS seeing 1.72 MJD 58260.420 object 44002 90prime/CP/V2.3/CP20180521/ksb_180522_100410_ooi_r_ls9.fits.fz ksb_180517_100259_ooi_g_ls9-CCD2 g expnum 82550142 exptime 166.421 propid NOTBASS seeing 1.47 MJD 58255.419 object 44002 90prime/CP/V2.3/CP20180516/ksb_180517_100259_ooi_g_ls9.fits.fz ksb_180722_073522_ooi_g_ls9-CCD4 g expnum 83210089 exptime 250.0 propid NOTBASS seeing 1.64 MJD 58321.316 object 44011 90prime/CP/V2.3/CP20180721/ksb_180722_073522_ooi_g_ls9.fits.fz ksb_180510_105554_ooi_r_ls9-CCD4 r expnum 82480192 exptime 95.817 propid NOTBASS seeing 1.21 MJD 58248.455 object 44011 90prime/CP/V2.3/CP20180509/ksb_180510_105554_ooi_r_ls9.fits.fz Faked up EXPNUM 82480188 Faked up EXPNUM 82480188 Faked up EXPNUM 82480188 90prime get_fwhm: self.fwhm = 2.49 Found 4 relevant rows in amp-corrections file. Found overlap: image x 554 828 and amp range 0 2015 and image y 15 149 and amp range 0 2047 Range in image: x 0 275 , y 0 135 (with image size 275 x 135) dzp -0.003875085 -> scaling image by 0.9964372765054066 Faked up EXPNUM 83140042 Faked up EXPNUM 83140042 Faked up EXPNUM 83140042 90prime get_fwhm: self.fwhm = 2.83 Found 4 relevant rows in amp-corrections file. Found overlap: image x 553 827 and amp range 0 2015 and image y 15 144 and amp range 0 2047 Range in image: x 0 275 , y 0 130 (with image size 275 x 130) dzp -0.0036920775 -> scaling image by 0.9966052462302274 Faked up EXPNUM 82590130 Faked up EXPNUM 82590130 Faked up EXPNUM 82590130 90prime get_fwhm: self.fwhm = 4.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2852 3121 and amp range 2016 4031 and image y 1395 1665 and amp range 0 2047 Range in image: x 0 270 , y 0 271 (with image size 270 x 271) dzp 0.0057031885 -> scaling image by 1.00526665101287 Faked up EXPNUM 82550142 Faked up EXPNUM 82550142 Faked up EXPNUM 82550142 90prime get_fwhm: self.fwhm = 3.25 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2579 2855 and amp range 2016 4031 and image y 1832 2109 and amp range 0 2047 Range in image: x 0 277 , y 0 216 (with image size 277 x 278) dzp 0.009189803 -> scaling image by 1.0085000434534261 Found overlap: image x 2579 2855 and amp range 2016 4031 and image y 1832 2109 and amp range 2048 4095 Range in image: x 0 277 , y 216 278 (with image size 277 x 278) dzp 0.013237011 -> scaling image by 1.012266359574015 Faked up EXPNUM 83210089 Faked up EXPNUM 83210089 Faked up EXPNUM 83210089 90prime get_fwhm: self.fwhm = 3.61 Found 4 relevant rows in amp-corrections file. Found overlap: image x 672 942 and amp range 0 2015 and image y 3341 3614 and amp range 2048 4095 Range in image: x 0 271 , y 0 274 (with image size 271 x 274) dzp 0.027550658 -> scaling image by 1.0256997821704772 Faked up EXPNUM 82600089 Faked up EXPNUM 82600089 Faked up EXPNUM 82600089 90prime get_fwhm: self.fwhm = 3.79 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2564 2839 and amp range 2016 4031 and image y 1828 2105 and amp range 0 2047 Range in image: x 0 276 , y 0 220 (with image size 276 x 278) dzp 0.014483032 -> scaling image by 1.0134287315188357 Found overlap: image x 2564 2839 and amp range 2016 4031 and image y 1828 2105 and amp range 2048 4095 Range in image: x 0 276 , y 220 278 (with image size 276 x 278) dzp 0.019008487 -> scaling image by 1.0176616178968958 Faked up EXPNUM 83210085 Faked up EXPNUM 83210085 Faked up EXPNUM 83210085 90prime get_fwhm: self.fwhm = 3.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2858 3127 and amp range 2016 4031 and image y 1394 1664 and amp range 0 2047 Range in image: x 0 270 , y 0 271 (with image size 270 x 271) dzp -0.0012233759 -> scaling image by 0.9988738637196966 Faked up EXPNUM 82480192 Faked up EXPNUM 82480192 Faked up EXPNUM 82480192 90prime get_fwhm: self.fwhm = 2.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 674 944 and amp range 0 2015 and image y 3355 3628 and amp range 2048 4095 Range in image: x 0 271 , y 0 274 (with image size 271 x 274) dzp 0.04491909 -> scaling image by 1.0422397564357018 mosaic get_fwhm: self.fwhm = 4.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 4038 4088 and amp range 2048 4095 and image y 509 989 and amp range 0 2039 Range in image: x 0 51 , y 0 481 (with image size 51 x 481) dzp -0.012875672 -> scaling image by 0.9882111074411305 mosaic get_fwhm: self.fwhm = 3.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1297 1765 and amp range 0 2047 and image y 2439 2910 and amp range 2040 4078 Range in image: x 0 469 , y 0 472 (with image size 469 x 472) dzp 0.003927584 -> scaling image by 1.0036239891963392 mosaic get_fwhm: self.fwhm = 3.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2875 3344 and amp range 2006 4053 and image y 2462 2929 and amp range 2040 4078 Range in image: x 0 470 , y 0 468 (with image size 470 x 468) dzp 0.0036595785 -> scaling image by 1.003376283213225 mosaic get_fwhm: self.fwhm = 3.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 177 658 and amp range 0 2005 and image y 2853 3323 and amp range 2040 4078 Range in image: x 0 482 , y 0 471 (with image size 482 x 471) dzp 0.014419514 -> scaling image by 1.0133694453441033 Stage tims : Wall: 18.89 s, CPU: 0.87 s, VmPeak: 952 MB, VmSize: 952 MB, VmRSS: 184 MB, VmData: 217 MB, maxrss: 0.188088 MB Stage tims finished: 2020-08-07T10:06:16.546120 Resources for stage tims : 7.614 s worker CPU, 51.387 s worker Wall, Wall: 18.890 s, Cores in use: 0.45, Total efficiency (on 16 cores): 2.8 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T10:06:16.580611 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00529.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00466.fits Matched 6 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/metrics/cus/reference-custom-278101p66894.fits Stage refs : Wall: 30.26 s, CPU: 3.39 s, VmPeak: 996 MB, VmSize: 990 MB, VmRSS: 224 MB, VmData: 256 MB, maxrss: 0.228988 MB Stage refs finished: 2020-08-07T10:06:46.835833 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 30.257 s, Cores in use: 0.11, Total efficiency (on 16 cores): 0.7 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T10:06:46.975581 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/metrics/cus/outlier-mask-custom-278101p66894.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/metrics/cus/outliers-pre-custom-278101p66894.jpg Image ksb_180722_071614_ooi_g_ls9-CCD3 g : masking 55 positive outlier pixels and 0 negative outlier pixels Image ksb_180517_100259_ooi_g_ls9-CCD2 g : masking 70 positive outlier pixels and 0 negative outlier pixels Image ksb_180722_073522_ooi_g_ls9-CCD4 g : masking 147 positive outlier pixels and 0 negative outlier pixels Image ksb_180510_104743_ooi_r_ls9-CCD2 r : masking 97 positive outlier pixels and 0 negative outlier pixels Image ksb_180521_100205_ooi_r_ls9-CCD3 r : masking 283 positive outlier pixels and 156 negative outlier pixels Image ksb_180522_100410_ooi_r_ls9-CCD2 r : masking 10657 positive outlier pixels and 0 negative outlier pixels Image k4m_171123_025255_ooi_zd_ls9-CCD2 z : masking 151 positive outlier pixels and 342 negative outlier pixels Image k4m_171110_040435_ooi_zd_ls9-CCD1 z : masking 567 positive outlier pixels and 0 negative outlier pixels Image k4m_171001_060739_ooi_zd_ls9-CCD2 z : masking 2301 positive outlier pixels and 0 negative outlier pixels Image k4m_171116_031604_ooi_zd_ls9-CCD1 z : masking 81 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/metrics/cus/outlier-mask-custom-278101p66894.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/metrics/cus/outliers-post-custom-278101p66894.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/metrics/cus/outliers-masked-pos-custom-278101p66894.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/metrics/cus/outliers-masked-neg-custom-278101p66894.jpg Stage outliers : Wall: 1.77 s, CPU: 1.17 s, VmPeak: 1000 MB, VmSize: 1000 MB, VmRSS: 264 MB, VmData: 297 MB, maxrss: 0.27056 MB Stage outliers finished: 2020-08-07T10:06:48.750490 Resources for stage outliers : 2.804 s worker CPU, 2.909 s worker Wall, Wall: 1.776 s, Cores in use: 2.24, Total efficiency (on 16 cores): 14.0 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T10:06:48.783825 Stage halos : Wall: 0.31 s, CPU: 0.29 s, VmPeak: 1000 MB, VmSize: 1000 MB, VmRSS: 265 MB, VmData: 297 MB, maxrss: 0.270892 MB Stage halos finished: 2020-08-07T10:06:49.094524 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.312 s, Cores in use: 0.95, Total efficiency (on 16 cores): 6.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T10:06:49.128462 PSF sigmas in coadd pixels: ['2.08', '2.32', '2.39', '2.66'] Using average PSF sigma 2.3636728843025594 Gaussian PSF norm 0.11934595249930909 vs pixelized 0.09777046 average tim pixel scale / coadd scale: 1.730402870030846 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.83', '3.14', '2.79', '1.97'] Using average PSF sigma 2.433720659797589 Gaussian PSF norm 0.11591091633225474 vs pixelized 0.087085135 average tim pixel scale / coadd scale: 1.7304893983847938 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.67', '1.38', '1.84', '1.39'] Using average PSF sigma 1.570998343822155 Gaussian PSF norm 0.17956402874846872 vs pixelized 0.1508213 average tim pixel scale / coadd scale: 0.9910967408720304 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.42 s, CPU: 0.42 s, VmPeak: 1000 MB, VmSize: 1000 MB, VmRSS: 266 MB, VmData: 297 MB, maxrss: 0.272368 MB Stage fit_on_coadds finished: 2020-08-07T10:06:49.547350 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.744 s worker CPU, 0.744 s worker Wall, Wall: 0.420 s, Cores in use: 2.78, Total efficiency (on 16 cores): 17.4 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T10:06:49.562577 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 64 potential peaks Of 64 potential peaks: 18 in veto map, 5 cut by saddle test, 0 cut by aper test, 41 kept SED z : 41 new peaks Found 50 potential peaks Of 50 potential peaks: 45 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 41 potential peaks Of 41 potential peaks: 36 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 73 potential peaks Of 73 potential peaks: 60 in veto map, 7 cut by saddle test, 0 cut by aper test, 6 kept SED Flat : 6 new peaks Found 90 potential peaks Of 90 potential peaks: 78 in veto map, 9 cut by saddle test, 0 cut by aper test, 3 kept SED Red : 3 new peaks Adding 52 new sources Median coadd sky for g : 1.0010588e-05 Median coadd sky for r : 5.609673e-05 Median coadd sky for z : 0.00015263003 Stage srcs : Wall: 0.85 s, CPU: 0.77 s, VmPeak: 1000 MB, VmSize: 1000 MB, VmRSS: 266 MB, VmData: 297 MB, maxrss: 0.272852 MB Stage srcs finished: 2020-08-07T10:06:50.408922 Resources for stage srcs : 0.212 s worker CPU, 0.212 s worker Wall, Wall: 0.848 s, Cores in use: 1.16, Total efficiency (on 16 cores): 7.2 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T10:06:50.596595 Blob 1 of 33, id: 11, sources: 19, size: 368x222, npix 30588, brick X: 63,431, Y: 112,334, one pixel: 207 112 Blob 2 of 33, id: 4, sources: 6, size: 80x82, npix 3826, brick X: 267,347, Y: 46,128, one pixel: 295 46 Blob 3 of 33, id: 21, sources: 4, size: 72x96, npix 3763, brick X: 129,201, Y: 269,365, one pixel: 151 269 Blob 4 of 33, id: 0, sources: 2, size: 69x53, npix 2682, brick X: 97,166, Y: 0,53, one pixel: 109 0 Blob 5 of 33, id: 29, sources: 1, size: 52x54, npix 2043, brick X: 353,405, Y: 407,461, one pixel: 380 407 Blob 6 of 33, id: 18, sources: 1, size: 47x46, npix 1458, brick X: 38,85, Y: 207,253, one pixel: 61 207 Blob 7 of 33, id: 24, sources: 2, size: 44x49, npix 1266, brick X: 155,199, Y: 366,415, one pixel: 180 366 Blob 8 of 33, id: 6, sources: 2, size: 42x42, npix 1178, brick X: 423,465, Y: 79,121, one pixel: 451 79 Blob 9 of 33, id: 31, sources: 3, size: 43x28, npix 808, brick X: 59,102, Y: 437,465, one pixel: 85 437 Blob 10 of 33, id: 25, sources: 2, size: 30x45, npix 770, brick X: 286,316, Y: 382,427, one pixel: 297 382 Blob 11 of 33, id: 20, sources: 1, size: 30x31, npix 595, brick X: 368,398, Y: 234,265, one pixel: 381 234 Blob 12 of 33, id: 13, sources: 2, size: 32x37, npix 567, brick X: 328,360, Y: 126,163, one pixel: 349 126 Blob 13 of 33, id: 12, sources: 1, size: 29x30, npix 560, brick X: 256,285, Y: 124,154, one pixel: 270 124 Blob 14 of 33, id: 23, sources: 2, size: 24x34, npix 502, brick X: 253,277, Y: 363,397, one pixel: 263 363 Blob 15 of 33, id: 1, sources: 1, size: 27x25, npix 494, brick X: 383,410, Y: 0,25, one pixel: 390 0 Blob 16 of 33, id: 15, sources: 1, size: 28x30, npix 478, brick X: 38,66, Y: 174,204, one pixel: 47 174 Blob 17 of 33, id: 3, sources: 1, size: 26x27, npix 469, brick X: 63,89, Y: 32,59, one pixel: 74 32 Measuring 1 iterative sources Blob 14 finished, total: Wall: 0.47 s, CPU: 0.47 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14788 MB Blob 18 of 33, id: 26, sources: 1, size: 26x28, npix 449, brick X: 350,376, Y: 382,410, one pixel: 362 382 Blob 11 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.14714 MB Blob 19 of 33, id: 17, sources: 1, size: 24x28, npix 440, brick X: 368,392, Y: 202,230, one pixel: 379 202 Blob 13 finished, total: Wall: 0.87 s, CPU: 0.87 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147748 MB Blob 20 of 33, id: 22, sources: 1, size: 25x25, npix 403, brick X: 222,247, Y: 339,364, one pixel: 232 339 Blob 16 finished, total: Wall: 0.97 s, CPU: 0.94 s, VmPeak: 788 MB, VmSize: 714 MB, VmRSS: 134 MB, VmData: 172 MB, maxrss: 0.137212 MB Blob 21 of 33, id: 9, sources: 1, size: 25x25, npix 389, brick X: 103,128, Y: 96,121, one pixel: 115 96 Blob 12 finished, total: Wall: 1.13 s, CPU: 1.12 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14686 MB Blob 22 of 33, id: 10, sources: 1, size: 24x24, npix 354, brick X: 369,393, Y: 102,126, one pixel: 379 102 Blob 10 finished, total: Wall: 1.25 s, CPU: 1.25 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147716 MB Blob 23 of 33, id: 5, sources: 1, size: 23x23, npix 336, brick X: 65,88, Y: 74,97, one pixel: 75 74 Blob 24 of 33, id: 14, sources: 1, size: 24x22, npix 317, brick X: 420,444, Y: 168,190, one pixel: 431 168 Blob 17 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14788 MB Blob 25 of 33, id: 2, sources: 1, size: 17x24, npix 276, brick X: 448,465, Y: 20,44, one pixel: 457 20 Blob 15 finished, total: Wall: 1.25 s, CPU: 1.25 s, VmPeak: 804 MB, VmSize: 725 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149396 MB Blob 26 of 33, id: 19, sources: 1, size: 21x21, npix 259, brick X: 11,32, Y: 230,251, one pixel: 20 230 Measuring 1 iterative sources Measuring 2 iterative sources Blob 18 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.14714 MB Blob 27 of 33, id: 7, sources: 1, size: 20x21, npix 249, brick X: 20,40, Y: 83,104, one pixel: 29 83 Blob 5 finished, total: Wall: 1.51 s, CPU: 1.51 s, VmPeak: 804 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148544 MB Blob 28 of 33, id: 8, sources: 1, size: 20x22, npix 249, brick X: 152,172, Y: 87,109, one pixel: 161 87 Blob 23 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14788 MB Blob 29 of 33, id: 27, sources: 1, size: 19x21, npix 237, brick X: 51,70, Y: 404,425, one pixel: 59 404 Blob 8 finished, total: Wall: 1.56 s, CPU: 1.55 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 97 MB, VmData: 142 MB, maxrss: 0.098872 MB Blob 30 of 33, id: 28, sources: 1, size: 19x20, npix 218, brick X: 128,147, Y: 406,426, one pixel: 136 406 Blob 21 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14774 MB Blob 31 of 33, id: 16, sources: 1, size: 19x18, npix 198, brick X: 350,369, Y: 178,196, one pixel: 358 178 Blob 28 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 97 MB, VmData: 142 MB, maxrss: 0.099028 MB Blob 32 of 33, id: 32, sources: 1, size: 18x19, npix 198, brick X: 224,242, Y: 441,460, one pixel: 232 441 Blob 22 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147716 MB Blob 33 of 33, id: 30, sources: 1, size: 17x17, npix 145, brick X: 266,283, Y: 414,431, one pixel: 274 414 Blob 20 finished, total: Wall: 0.83 s, CPU: 0.83 s, VmPeak: 788 MB, VmSize: 714 MB, VmRSS: 134 MB, VmData: 172 MB, maxrss: 0.137212 MB Blob 27 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14788 MB Blob 24 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 804 MB, VmSize: 725 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149396 MB Blob 29 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14774 MB Blob 31 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147716 MB Blob 33 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14788 MB Blob 32 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 788 MB, VmSize: 714 MB, VmRSS: 134 MB, VmData: 172 MB, maxrss: 0.137212 MB Blob 30 finished, total: Wall: 0.19 s, CPU: 0.19 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 97 MB, VmData: 142 MB, maxrss: 0.099028 MB Blob 9 finished, total: Wall: 1.99 s, CPU: 1.98 s, VmPeak: 805 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148008 MB Blob 7 finished, total: Wall: 2.00 s, CPU: 1.98 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147664 MB Blob 25 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.14714 MB Blob 19 finished, total: Wall: 1.26 s, CPU: 1.26 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148484 MB Blob 26 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 804 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148544 MB Blob 6 finished, total: Wall: 2.36 s, CPU: 2.36 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148236 MB Blob 3 finished, total: Wall: 2.65 s, CPU: 2.65 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 97 MB, VmData: 143 MB, maxrss: 0.099016 MB Blob 4 finished, total: Wall: 3.02 s, CPU: 3.01 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 99 MB, VmData: 143 MB, maxrss: 0.101104 MB Blob 2 finished, total: Wall: 3.51 s, CPU: 3.51 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147956 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.42883, ee1=-0.793858, ee2=-0.844568 Measuring 10 iterative sources Blob 1 finished, total: Wall: 26.55 s, CPU: 26.54 s, VmPeak: 749 MB, VmSize: 747 MB, VmRSS: 183 MB, VmData: 212 MB, maxrss: 0.18694 MB Old catalog: 72 New catalog: 73 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/metrics/cus/blobs-custom-278101p66894.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/metrics/cus/all-models-custom-278101p66894.fits Stage fitblobs : Wall: 30.06 s, CPU: 0.57 s, VmPeak: 1000 MB, VmSize: 1000 MB, VmRSS: 267 MB, VmData: 297 MB, maxrss: 0.273208 MB Stage fitblobs finished: 2020-08-07T10:07:20.660264 Resources for stage fitblobs : 59.943 s worker CPU, 60.120 s worker Wall, Wall: 30.065 s, Cores in use: 2.01, Total efficiency (on 16 cores): 12.6 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T10:07:24.569946 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/tmp-legacysurvey-custom-278101p66894-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/tmp-legacysurvey-custom-278101p66894-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/tmp-legacysurvey-custom-278101p66894-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/tmp-legacysurvey-custom-278101p66894-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-resid.jpg Stage coadds : Wall: 14.71 s, CPU: 1.02 s, VmPeak: 1022 MB, VmSize: 990 MB, VmRSS: 257 MB, VmData: 287 MB, maxrss: 0.296132 MB Stage coadds finished: 2020-08-07T10:07:39.275965 Resources for stage coadds : 8.593 s worker CPU, 9.118 s worker Wall, Wall: 14.708 s, Cores in use: 0.65, Total efficiency (on 16 cores): 4.1 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T10:07:39.314742 Cut to 1 unWISE tiles Reading WISE tile 2783p666 band 1 Reading WISE tile 2783p666 band 3 Reading WISE tile 2783p666 band 2 Reading WISE tile 2783p666 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.14 s, CPU: 0.40 s, VmPeak: 1069 MB, VmSize: 1005 MB, VmRSS: 150 MB, VmData: 187 MB, maxrss: 0.213092 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.21 s, CPU: 0.61 s, VmPeak: 1008 MB, VmSize: 1008 MB, VmRSS: 149 MB, VmData: 190 MB, maxrss: 0.190836 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.11 s, CPU: 0.25 s, VmPeak: 1002 MB, VmSize: 1002 MB, VmRSS: 143 MB, VmData: 184 MB, maxrss: 0.204712 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2783p666/unwise-2783p666-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.12 s, CPU: 0.29 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 146 MB, VmData: 188 MB, maxrss: 0.208124 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/tmp-legacysurvey-custom-278101p66894-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/tmp-legacysurvey-custom-278101p66894-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.36 s, CPU: 0.64 s, VmPeak: 1022 MB, VmSize: 994 MB, VmRSS: 262 MB, VmData: 291 MB, maxrss: 0.296132 MB Stage wise_forced finished: 2020-08-07T10:07:41.677018 Resources for stage wise_forced : 4.892 s worker CPU, 5.391 s worker Wall, Wall: 2.364 s, Cores in use: 2.34, Total efficiency (on 16 cores): 14.6 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T10:07:41.722305 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/coadd/cus/custom-278101p66894/legacysurvey-custom-278101p66894-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/tractor-i/cus/tractor-custom-278101p66894.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/tractor/cus/tractor-custom-278101p66894.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/tractor/cus/brick-custom-278101p66894.sha256sum Stage writecat : Wall: 0.88 s, CPU: 0.75 s, VmPeak: 1138 MB, VmSize: 1010 MB, VmRSS: 275 MB, VmData: 303 MB, maxrss: 0.413032 MB Stage writecat finished: 2020-08-07T10:07:42.600812 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.880 s, Cores in use: 0.86, Total efficiency (on 16 cores): 5.4 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/278/PGC2692384/PGC2692384-largegalaxy-writecat.p All done: 84.807 s worker CPU, 129.886 s worker Wall, Wall: 105.080 s, Cores in use: 0.90, Total efficiency (on 16 cores): 5.6 % Finished galaxy PGC2692384 in 1.779 minutes.