Started working on galaxy DR8-1579p720-3106 at Sun Jun 7 17:41:23 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 157.682309853772 72.0887581992499 --width 311 --height 311 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/DR8-1579p720-3106-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/DR8-1579p720-3106-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T17:41:24.586656 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '157.682309853772', '72.0887581992499', '--width', '311', '--height', '311', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/DR8-1579p720-3106-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/DR8-1579p720-3106-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 157.682309853772 72.0887581992499 --width 311 --height 311 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/DR8-1579p720-3106-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/DR8-1579p720-3106-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 157.682309853772 72.0887581992499 Starting process 51748 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 51749 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 51750 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 51751 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T17:41:25.309811 Keeping 10 CCDs: k4m_171123_082220_ooi_zd_ls9.fits.fz k4m_171123_082220_ooi_zd_ls9-CCD4 z exptime 250.102 propid 2016A-0453 seeing 1.21 MJD 58080.349 object MzLS_717709_z k4m_170520_061720_ooi_zd_ls9.fits.fz k4m_170520_061720_ooi_zd_ls9-CCD2 z exptime 161.105 propid 2016A-0453 seeing 1.34 MJD 57893.262 object MzLS_718103_z k4m_180116_070306_ooi_zd_ls9.fits.fz k4m_180116_070306_ooi_zd_ls9-CCD1 z exptime 249.106 propid 2016A-0453 seeing 0.90 MJD 58134.294 object MzLS_718493_z k4m_171207_073819_ooi_zd_ls9.fits.fz k4m_171207_073819_ooi_zd_ls9-CCD1 z exptime 250.104 propid 2016A-0453 seeing 1.70 MJD 58094.318 object MzLS_718493_z ksb_180511_042001_ooi_g_ls9.fits.fz ksb_180511_042001_ooi_g_ls9-CCD1 g exptime 250.0 propid NOTBASS seeing 2.12 MJD 58249.181 object 47343 ksb_180225_064742_ooi_r_ls9.fits.fz ksb_180225_064742_ooi_r_ls9-CCD1 r exptime 250.0 propid BASS seeing 1.40 MJD 58174.283 object 47343 ksb_180507_060616_ooi_r_ls9.fits.fz ksb_180507_060616_ooi_r_ls9-CCD4 r exptime 250.0 propid NOTBASS seeing 2.33 MJD 58245.254 object 47342 ksb_180516_041520_ooi_g_ls9.fits.fz ksb_180516_041520_ooi_g_ls9-CCD4 g exptime 185.76 propid NOTBASS seeing 1.26 MJD 58254.177 object 47342 ksb_180519_035627_ooi_r_ls9.fits.fz ksb_180519_035627_ooi_r_ls9-CCD1 r exptime 220.626 propid NOTBASS seeing 1.45 MJD 58257.164 object 47341 ksb_180509_035343_ooi_g_ls9.fits.fz ksb_180509_035343_ooi_g_ls9-CCD1 g exptime 206.4 propid NOTBASS seeing 1.75 MJD 58247.162 object 47341 mosaic get_fwhm: self.fwhm = 5.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 224 536 and amp range 0 2047 and image y 3059 3371 and amp range 2040 4078 Range in image: x 0 313 , y 0 313 (with image size 313 x 313) dzp 0.015739892 -> scaling image by 1.0146025667655956 mosaic get_fwhm: self.fwhm = 6.55 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1791 2105 and amp range 0 2005 and image y 3919 4072 and amp range 2040 4078 Range in image: x 0 215 , y 0 154 (with image size 315 x 154) dzp 0.014419514 -> scaling image by 1.0133694453441033 Found overlap: image x 1791 2105 and amp range 2006 4053 and image y 3919 4072 and amp range 2040 4078 Range in image: x 215 315 , y 0 154 (with image size 315 x 154) dzp 0.0036595785 -> scaling image by 1.003376283213225 mosaic get_fwhm: self.fwhm = 3.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1799 2113 and amp range 0 2005 and image y 3909 4072 and amp range 2040 4078 Range in image: x 0 207 , y 0 164 (with image size 315 x 164) dzp 0.014419514 -> scaling image by 1.0133694453441033 Found overlap: image x 1799 2113 and amp range 2006 4053 and image y 3909 4072 and amp range 2040 4078 Range in image: x 207 315 , y 0 164 (with image size 315 x 164) dzp 0.0036595785 -> scaling image by 1.003376283213225 mosaic get_fwhm: self.fwhm = 4.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2927 3244 and amp range 2048 4095 and image y 271 585 and amp range 0 2021 Range in image: x 0 318 , y 0 315 (with image size 318 x 315) dzp -0.029506588 -> scaling image by 0.9731893881648719 Faked up EXPNUM 82490038 Faked up EXPNUM 82490038 Faked up EXPNUM 82490038 90prime get_fwhm: self.fwhm = 4.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1269 1455 and amp range 0 2015 and image y 1456 1640 and amp range 0 2047 Range in image: x 0 187 , y 0 185 (with image size 187 x 185) dzp -0.030770088 -> scaling image by 0.9720575212609548 Faked up EXPNUM 82450059 Faked up EXPNUM 82450059 Faked up EXPNUM 82450059 90prime get_fwhm: self.fwhm = 5.13 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1135 1315 and amp range 0 2015 and image y 872 1052 and amp range 0 2047 Range in image: x 0 181 , y 0 181 (with image size 181 x 181) dzp 0.014080205 -> scaling image by 1.0130528017623828 Faked up EXPNUM 81740092 Faked up EXPNUM 81740092 Faked up EXPNUM 81740092 90prime get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1273 1458 and amp range 0 2015 and image y 1449 1633 and amp range 0 2047 Range in image: x 0 186 , y 0 185 (with image size 186 x 185) dzp -0.04811793 -> scaling image by 0.9566494556405901 Faked up EXPNUM 82540041 Faked up EXPNUM 82540041 Faked up EXPNUM 82540041 90prime get_fwhm: self.fwhm = 2.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1151 1331 and amp range 0 2015 and image y 861 1041 and amp range 0 2047 Range in image: x 0 181 , y 0 181 (with image size 181 x 181) dzp 0.0059804036 -> scaling image by 1.0055233530762397 Faked up EXPNUM 82470044 Faked up EXPNUM 82470044 Faked up EXPNUM 82470044 90prime get_fwhm: self.fwhm = 3.87 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3301 3483 and amp range 2016 4031 and image y 3407 3589 and amp range 2048 4095 Range in image: x 0 183 , y 0 183 (with image size 183 x 183) dzp 0.016257986 -> scaling image by 1.01508683329102 Faked up EXPNUM 82570045 Faked up EXPNUM 82570045 Faked up EXPNUM 82570045 90prime get_fwhm: self.fwhm = 3.21 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3301 3483 and amp range 2016 4031 and image y 3415 3596 and amp range 2048 4095 Range in image: x 0 183 , y 0 182 (with image size 183 x 182) dzp 0.015744466 -> scaling image by 1.0146068417155982 Stage tims : Wall: 5.51 s, CPU: 0.88 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 173 MB, VmData: 206 MB, maxrss: 0.566488 MB Stage tims finished: 2020-06-07T17:41:30.818207 Resources for stage tims : 3.726 s worker CPU, 11.061 s worker Wall, Wall: 5.510 s, Cores in use: 0.84, Total efficiency (on 4 cores): 20.9 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/DR8-1579p720-3106-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/DR8-1579p720-3106-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T17:41:30.841511 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00284.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00285.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00334.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00239.fits Matched 11 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/metrics/cus/reference-custom-157682p72088.fits Stage refs : Wall: 2.41 s, CPU: 1.67 s, VmPeak: 972 MB, VmSize: 957 MB, VmRSS: 189 MB, VmData: 221 MB, maxrss: 0.566488 MB Stage refs finished: 2020-06-07T17:41:33.248836 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.408 s, Cores in use: 0.70, Total efficiency (on 4 cores): 17.4 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T17:41:33.250308 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/metrics/cus/outlier-mask-custom-157682p72088.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/metrics/cus/outliers-pre-custom-157682p72088.jpg Image ksb_180509_035343_ooi_g_ls9-CCD1 g : masking 141 positive outlier pixels and 0 negative outlier pixels Image ksb_180511_042001_ooi_g_ls9-CCD1 g : masking 80 positive outlier pixels and 0 negative outlier pixels Image ksb_180225_064742_ooi_r_ls9-CCD1 r : masking 170 positive outlier pixels and 0 negative outlier pixels Image k4m_171207_073819_ooi_zd_ls9-CCD1 z : masking 626 positive outlier pixels and 175 negative outlier pixels Image k4m_180116_070306_ooi_zd_ls9-CCD1 z : masking 1101 positive outlier pixels and 0 negative outlier pixels Image k4m_171123_082220_ooi_zd_ls9-CCD4 z : masking 1359 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/metrics/cus/outlier-mask-custom-157682p72088.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/metrics/cus/outliers-post-custom-157682p72088.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/metrics/cus/outliers-masked-pos-custom-157682p72088.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/metrics/cus/outliers-masked-neg-custom-157682p72088.jpg Stage outliers : Wall: 1.66 s, CPU: 1.24 s, VmPeak: 972 MB, VmSize: 966 MB, VmRSS: 207 MB, VmData: 236 MB, maxrss: 0.566488 MB Stage outliers finished: 2020-06-07T17:41:34.913189 Resources for stage outliers : 1.345 s worker CPU, 1.385 s worker Wall, Wall: 1.664 s, Cores in use: 1.55, Total efficiency (on 4 cores): 38.8 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T17:41:34.914964 Stage halos : Wall: 0.37 s, CPU: 0.35 s, VmPeak: 972 MB, VmSize: 966 MB, VmRSS: 207 MB, VmData: 236 MB, maxrss: 0.566488 MB Stage halos finished: 2020-06-07T17:41:35.281100 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.367 s, Cores in use: 0.96, Total efficiency (on 4 cores): 24.1 % Stage halos finished Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-06-07T17:41:35.283023 PSF sigmas in coadd pixels: ['3.44', '2.04', '2.85'] Using average PSF sigma 2.77537700785784 Gaussian PSF norm 0.10164197187452077 vs pixelized 0.082032695 average tim pixel scale / coadd scale: 1.730102261898058 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.28', '3.78', '2.36'] Using average PSF sigma 2.805478340442283 Gaussian PSF norm 0.10055140604985244 vs pixelized 0.08072866 average tim pixel scale / coadd scale: 1.7303580645727747 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.97', '2.17', '1.46', '2.76'] Using average PSF sigma 2.091940521703437 Gaussian PSF norm 0.13484838065289373 vs pixelized 0.12938155 average tim pixel scale / coadd scale: 0.991132206999775 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.29 s, CPU: 0.25 s, VmPeak: 972 MB, VmSize: 966 MB, VmRSS: 208 MB, VmData: 236 MB, maxrss: 0.566488 MB Stage fit_on_coadds finished: 2020-06-07T17:41:35.571196 Resources for stage fit_on_coadds : 0.267 s worker CPU, 0.270 s worker Wall, Wall: 0.289 s, Cores in use: 1.78, Total efficiency (on 4 cores): 44.6 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T17:41:35.574057 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 22 potential peaks Of 22 potential peaks: 2 in veto map, 0 cut by saddle test, 0 cut by aper test, 20 kept SED z : 20 new peaks Found 18 potential peaks Of 18 potential peaks: 16 in veto map, 0 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 20 potential peaks Of 20 potential peaks: 17 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 25 potential peaks Of 25 potential peaks: 22 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 29 potential peaks Of 29 potential peaks: 25 in veto map, 1 cut by saddle test, 0 cut by aper test, 3 kept SED Red : 3 new peaks Adding 27 new sources Median coadd sky for g : 9.046977e-06 Median coadd sky for r : -0.0001494919 Median coadd sky for z : 0.00014100916 Stage srcs : Wall: 0.84 s, CPU: 0.73 s, VmPeak: 972 MB, VmSize: 966 MB, VmRSS: 208 MB, VmData: 236 MB, maxrss: 0.566488 MB Stage srcs finished: 2020-06-07T17:41:36.416248 Resources for stage srcs : 0.158 s worker CPU, 0.158 s worker Wall, Wall: 0.843 s, Cores in use: 1.05, Total efficiency (on 4 cores): 26.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/DR8-1579p720-3106-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/DR8-1579p720-3106-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T17:41:36.443314 Blob 1 of 23, id: 16, sources: 1, size: 106x53, npix 3499, brick X: 103,209, Y: 129,182, one pixel: 117 129 Blob 2 of 23, id: 0, sources: 4, size: 59x69, npix 2466, brick X: 0,59, Y: 1,70, one pixel: 15 1 Blob 3 of 23, id: 21, sources: 2, size: 56x54, npix 2089, brick X: 0,56, Y: 248,302, one pixel: 27 248 Blob 4 of 23, id: 11, sources: 2, size: 52x41, npix 1346, brick X: 182,234, Y: 77,118, one pixel: 193 77 Blob 5 of 23, id: 22, sources: 2, size: 36x40, npix 891, brick X: 144,180, Y: 271,311, one pixel: 154 271 Blob 4 finished, total: Wall: 2.56 s, CPU: 1.80 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143504 MB Blob 2 finished, total: Wall: 2.56 s, CPU: 2.56 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143768 MB Blob 6 of 23, id: 9, sources: 1, size: 35x35, npix 808, brick X: 95,130, Y: 70,105, one pixel: 112 70 Blob 7 of 23, id: 18, sources: 1, size: 34x33, npix 770, brick X: 15,49, Y: 209,242, one pixel: 26 209 Blob 3 finished, total: Wall: 2.75 s, CPU: 1.78 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143448 MB Blob 8 of 23, id: 19, sources: 1, size: 34x32, npix 739, brick X: 167,201, Y: 220,252, one pixel: 180 220 Measuring 1 iterative sources Blob 6 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144156 MB Blob 9 of 23, id: 12, sources: 1, size: 35x35, npix 729, brick X: 62,97, Y: 79,114, one pixel: 76 79 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.05139, ee1=-0.868914, ee2=-0.578679 Blob 1 finished, total: Wall: 3.46 s, CPU: 2.63 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143708 MB Blob 10 of 23, id: 5, sources: 1, size: 37x27, npix 647, brick X: 239,276, Y: 39,66, one pixel: 261 39 Blob 7 finished, total: Wall: 1.01 s, CPU: 1.01 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143448 MB Blob 11 of 23, id: 14, sources: 1, size: 29x30, npix 576, brick X: 255,284, Y: 88,118, one pixel: 267 88 Blob 5 finished, total: Wall: 1.36 s, CPU: 1.36 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144004 MB Blob 12 of 23, id: 17, sources: 1, size: 26x26, npix 419, brick X: 216,242, Y: 182,208, one pixel: 227 182 Measuring 1 iterative sources Blob 8 finished, total: Wall: 0.86 s, CPU: 0.86 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144156 MB Blob 13 of 23, id: 15, sources: 1, size: 25x25, npix 400, brick X: 152,177, Y: 109,134, one pixel: 162 109 Blob 9 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144476 MB Blob 14 of 23, id: 8, sources: 1, size: 24x25, npix 389, brick X: 40,64, Y: 60,85, one pixel: 50 60 Measuring 1 iterative sources Blob 11 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144004 MB Blob 15 of 23, id: 4, sources: 1, size: 23x25, npix 363, brick X: 193,216, Y: 34,59, one pixel: 204 34 Blob 12 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144156 MB Blob 16 of 23, id: 7, sources: 1, size: 23x24, npix 331, brick X: 61,84, Y: 48,72, one pixel: 71 48 Blob 17 of 23, id: 13, sources: 1, size: 16x28, npix 325, brick X: 0,16, Y: 80,108, one pixel: 1 80 Blob 10 finished, total: Wall: 1.08 s, CPU: 1.08 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14386 MB Blob 18 of 23, id: 3, sources: 1, size: 23x23, npix 323, brick X: 222,245, Y: 19,42, one pixel: 231 19 Blob 13 finished, total: Wall: 0.58 s, CPU: 0.58 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144476 MB Blob 19 of 23, id: 2, sources: 1, size: 23x21, npix 302, brick X: 88,111, Y: 12,33, one pixel: 97 12 Blob 14 finished, total: Wall: 0.48 s, CPU: 0.48 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144004 MB Blob 20 of 23, id: 10, sources: 1, size: 19x19, npix 199, brick X: 148,167, Y: 76,95, one pixel: 157 76 Blob 17 finished, total: Wall: 0.10 s, CPU: 0.10 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144476 MB Blob 21 of 23, id: 20, sources: 1, size: 18x19, npix 189, brick X: 244,262, Y: 232,251, one pixel: 252 232 Blob 15 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144156 MB Blob 22 of 23, id: 6, sources: 1, size: 18x17, npix 162, brick X: 136,154, Y: 46,63, one pixel: 144 46 Blob 19 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144476 MB Blob 23 of 23, id: 1, sources: 1, size: 17x17, npix 145, brick X: 276,293, Y: 8,25, one pixel: 284 8 Blob 21 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144476 MB Blob 18 finished, total: Wall: 0.54 s, CPU: 0.54 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144004 MB Blob 16 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14386 MB Blob 23 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144004 MB Blob 22 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144476 MB Blob 20 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144248 MB Old catalog: 33 New catalog: 27 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/metrics/cus/blobs-custom-157682p72088.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/metrics/cus/all-models-custom-157682p72088.fits Stage fitblobs : Wall: 6.54 s, CPU: 0.69 s, VmPeak: 972 MB, VmSize: 966 MB, VmRSS: 209 MB, VmData: 236 MB, maxrss: 0.566488 MB Stage fitblobs finished: 2020-06-07T17:41:42.981415 Resources for stage fitblobs : 20.064 s worker CPU, 22.840 s worker Wall, Wall: 6.539 s, Cores in use: 3.17, Total efficiency (on 4 cores): 79.4 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T17:41:42.983223 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/tmp-legacysurvey-custom-157682p72088-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/tmp-legacysurvey-custom-157682p72088-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/tmp-legacysurvey-custom-157682p72088-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/tmp-legacysurvey-custom-157682p72088-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-resid.jpg Stage coadds : Wall: 1.50 s, CPU: 0.75 s, VmPeak: 972 MB, VmSize: 966 MB, VmRSS: 209 MB, VmData: 237 MB, maxrss: 0.566488 MB Stage coadds finished: 2020-06-07T17:41:44.479630 Resources for stage coadds : 2.166 s worker CPU, 2.268 s worker Wall, Wall: 1.497 s, Cores in use: 1.94, Total efficiency (on 4 cores): 48.6 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T17:41:44.481390 Cut to 1 unWISE tiles Reading WISE tile 1556p726 band 1 Reading WISE tile 1556p726 band 4 Reading WISE tile 1556p726 band 3 Reading WISE tile 1556p726 band 2 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/155/1556p726/unwise-1556p726-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/155/1556p726/unwise-1556p726-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/155/1556p726/unwise-1556p726-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/155/1556p726/unwise-1556p726-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/155/1556p726/unwise-1556p726-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 805 MB, VmSize: 796 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.188664 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/155/1556p726/unwise-1556p726-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/155/1556p726/unwise-1556p726-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/155/1556p726/unwise-1556p726-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/155/1556p726/unwise-1556p726-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 807 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.208908 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/155/1556p726/unwise-1556p726-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/155/1556p726/unwise-1556p726-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/155/1556p726/unwise-1556p726-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/155/1556p726/unwise-1556p726-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/155/1556p726/unwise-1556p726-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 803 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.208952 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/155/1556p726/unwise-1556p726-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/155/1556p726/unwise-1556p726-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/155/1556p726/unwise-1556p726-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/155/1556p726/unwise-1556p726-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 174 MB, maxrss: 0.207692 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/tmp-legacysurvey-custom-157682p72088-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/tmp-legacysurvey-custom-157682p72088-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.30 s, CPU: 0.44 s, VmPeak: 972 MB, VmSize: 966 MB, VmRSS: 210 MB, VmData: 237 MB, maxrss: 0.566488 MB Stage wise_forced finished: 2020-06-07T17:41:47.786206 Resources for stage wise_forced : 4.846 s worker CPU, 6.564 s worker Wall, Wall: 3.306 s, Cores in use: 1.60, Total efficiency (on 4 cores): 40.0 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T17:41:47.788149 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/coadd/cus/custom-157682p72088/legacysurvey-custom-157682p72088-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/tractor-i/cus/tractor-custom-157682p72088.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/tractor/cus/tractor-custom-157682p72088.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/157/DR8-1579p720-3106/tractor/cus/brick-custom-157682p72088.sha256sum Stage writecat : Wall: 0.97 s, CPU: 0.58 s, VmPeak: 1099 MB, VmSize: 971 MB, VmRSS: 212 MB, VmData: 237 MB, maxrss: 0.566488 MB Stage writecat finished: 2020-06-07T17:41:48.755565 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.969 s, Cores in use: 0.60, Total efficiency (on 4 cores): 15.0 % Stage writecat finished All done: 32.574 s worker CPU, 44.547 s worker Wall, Wall: 23.451 s, Cores in use: 1.71, Total efficiency (on 4 cores): 42.9 % Finished galaxy DR8-1579p720-3106 in 0.429 minutes.