Started working on galaxy PGC062280 at Wed Aug 5 21:51:36 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 280.4976075 61.5279922 --width 337 --height 337 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/PGC062280-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/PGC062280-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T21:51:37.694125 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '280.4976075', '61.5279922', '--width', '337', '--height', '337', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/PGC062280-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/PGC062280-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 280.4976075 61.5279922 --width 337 --height 337 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/PGC062280-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/PGC062280-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 280.4976075 61.5279922 Starting process 5695 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB Starting process 5696 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 5697 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 5698 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 5699 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059464 MB Starting process 5700 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059472 MB Starting process 5701 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059472 MB Starting process 5702 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 5703 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 5704 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 5705 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 5706 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 5707 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 5708 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 5709 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 5710 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T21:51:38.130699 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 11 CCDs: k4m_171029_035109_ooi_zd_ls9-CCD4 z expnum 143907 exptime 110.103 propid 2016A-0453 seeing 0.96 MJD 58055.161 object MzLS_690672_z mosaic/CP/V4.3/CP20171028/k4m_171029_035109_ooi_zd_ls9.fits.fz k4m_170926_053922_ooi_zd_ls9-CCD3 z expnum 140905 exptime 200.102 propid 2016A-0453 seeing 1.60 MJD 58022.236 object MzLS_691875_z mosaic/CP/V4.3/CP20170925/k4m_170926_053922_ooi_zd_ls9.fits.fz k4m_160606_094125_ooi_zd_ls9-CCD2 z expnum 93802 exptime 92.104 propid 2016A-0453 seeing 1.04 MJD 57545.404 object MzLS_691276_z mosaic/CP/V4.3/CP20160605/k4m_160606_094125_ooi_zd_ls9.fits.fz ksb_180519_095740_ooi_g_ls9-CCD3 g expnum 82570187 exptime 102.928 propid NOTBASS seeing 1.23 MJD 58257.415 object 38791 90prime/CP/V2.3/CP20180518/ksb_180519_095740_ooi_g_ls9.fits.fz ksb_170619_101812_ooi_r_ls9-CCD3 r expnum 79230146 exptime 227.141 propid BASS seeing 1.64 MJD 57923.429 object 38791 90prime/CP/V2.3/CP20170618/ksb_170619_101812_ooi_r_ls9.fits.fz ksb_170621_104905_ooi_g_ls9-CCD2 g expnum 79250095 exptime 208.293 propid BASS seeing 1.49 MJD 57925.451 object 39713 90prime/CP/V2.3/CP20170620/ksb_170621_104905_ooi_g_ls9.fits.fz ksb_170624_104420_ooi_r_ls9-CCD2 r expnum 79280172 exptime 109.016 propid BASS seeing 1.24 MJD 57928.447 object 39713 90prime/CP/V2.3/CP20170623/ksb_170624_104420_ooi_r_ls9.fits.fz ksb_160712_090750_ooi_g_ls9-CCD1 g expnum 75810131 exptime 118.8 propid BASS seeing 1.79 MJD 57581.380 object 38782 90prime/CP/V2.3/CP20160711/ksb_160712_090750_ooi_g_ls9.fits.fz ksb_180519_074140_ooi_r_ls9-CCD1 r expnum 82570126 exptime 81.151 propid NOTBASS seeing 1.08 MJD 58257.321 object 38782 90prime/CP/V2.3/CP20180518/ksb_180519_074140_ooi_r_ls9.fits.fz ksb_170619_095454_ooi_r_ls9-CCD2 r expnum 79230140 exptime 199.64 propid BASS seeing 1.46 MJD 57923.413 object 39711 90prime/CP/V2.3/CP20170618/ksb_170619_095454_ooi_r_ls9.fits.fz ksb_180519_095019_ooi_g_ls9-CCD2 g expnum 82570184 exptime 109.683 propid NOTBASS seeing 1.17 MJD 58257.410 object 39711 90prime/CP/V2.3/CP20180518/ksb_180519_095019_ooi_g_ls9.fits.fz Faked up EXPNUM 75810131 Faked up EXPNUM 75810131 Faked up EXPNUM 75810131 90prime get_fwhm: self.fwhm = 3.95 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1751 1951 and amp range 0 2015 and image y 1253 1453 and amp range 0 2047 Range in image: x 0 201 , y 0 201 (with image size 201 x 201) dzp -0.011813398 -> scaling image by 0.989178436928226 Faked up EXPNUM 82570187 Faked up EXPNUM 82570187 Faked up EXPNUM 82570187 90prime get_fwhm: self.fwhm = 2.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 18 38 and amp range 0 2015 and image y 2691 2887 and amp range 2048 4095 Range in image: x 0 21 , y 0 197 (with image size 21 x 197) dzp -0.027600318 -> scaling image by 0.9748995562775561 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82570184 Faked up EXPNUM 82570184 Faked up EXPNUM 82570184 90prime get_fwhm: self.fwhm = 2.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3547 3746 and amp range 2016 4031 and image y 2808 3007 and amp range 2048 4095 Range in image: x 0 200 , y 0 200 (with image size 200 x 200) dzp 0.013237011 -> scaling image by 1.012266359574015 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 6.17 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1733 2075 and amp range 0 2005 and image y 1267 1611 and amp range 0 2039 Range in image: x 0 273 , y 0 345 (with image size 343 x 345) dzp 0.0014252509 -> scaling image by 1.0013135665633692 Found overlap: image x 1733 2075 and amp range 2006 4053 and image y 1267 1611 and amp range 0 2039 Range in image: x 273 343 , y 0 345 (with image size 343 x 345) dzp -0.006757846 -> scaling image by 0.993795123967763 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82570126 Faked up EXPNUM 82570126 Faked up EXPNUM 82570126 90prime get_fwhm: self.fwhm = 2.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1742 1943 and amp range 0 2015 and image y 1281 1481 and amp range 0 2047 Range in image: x 0 202 , y 0 201 (with image size 202 x 201) dzp -0.04811793 -> scaling image by 0.9566494556405901 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2847 3193 and amp range 2048 4095 and image y 715 1056 and amp range 0 2021 Range in image: x 0 347 , y 0 342 (with image size 347 x 342) dzp -0.029506588 -> scaling image by 0.9731893881648719 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.99 Found 4 relevant rows in amp-corrections file. Found overlap: image x 141 479 and amp range 0 2047 and image y 2043 2383 and amp range 2040 4078 Range in image: x 0 339 , y 0 341 (with image size 339 x 341) dzp 0.008550294 -> scaling image by 1.0079062018164673 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 79250095 Faked up EXPNUM 79250095 Faked up EXPNUM 79250095 90prime get_fwhm: self.fwhm = 3.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1552 1751 and amp range 0 2015 and image y 822 1023 and amp range 0 2047 Range in image: x 0 200 , y 0 202 (with image size 200 x 202) dzp 0.0003063402 -> scaling image by 1.0002821895558327 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 79280172 Faked up EXPNUM 79280172 Faked up EXPNUM 79280172 90prime get_fwhm: self.fwhm = 2.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1546 1745 and amp range 0 2015 and image y 826 1027 and amp range 0 2047 Range in image: x 0 200 , y 0 202 (with image size 200 x 202) dzp 0.005335051 -> scaling image by 1.0049258559887364 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 79230140 Faked up EXPNUM 79230140 Faked up EXPNUM 79230140 90prime get_fwhm: self.fwhm = 3.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3595 3794 and amp range 2016 4031 and image y 2811 3010 and amp range 2048 4095 Range in image: x 0 200 , y 0 200 (with image size 200 x 200) dzp 0.021366077 -> scaling image by 1.0198737893800265 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 6.05 s, CPU: 0.84 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 177 MB, VmData: 209 MB, maxrss: 0.181548 MB Stage tims finished: 2020-08-05T21:51:44.178481 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Faked up EXPNUM 79230146 Faked up EXPNUM 79230146 Faked up EXPNUM 79230146 90prime get_fwhm: self.fwhm = 3.63 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 6.382 s worker CPU, 30.366 s worker Wall, Wall: 6.049 s, Cores in use: 1.19, Total efficiency (on 16 cores): 7.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/PGC062280-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/PGC062280-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T21:51:44.201931 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00822.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00743.fits Matched 7 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/metrics/cus/reference-custom-280497p61527.fits Stage refs : Wall: 11.56 s, CPU: 4.54 s, VmPeak: 1010 MB, VmSize: 1004 MB, VmRSS: 227 MB, VmData: 256 MB, maxrss: 0.23194 MB Stage refs finished: 2020-08-05T21:51:55.766356 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 11.566 s, Cores in use: 0.39, Total efficiency (on 16 cores): 2.5 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/PGC062280-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/PGC062280-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T21:51:55.858409 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/metrics/cus/outlier-mask-custom-280497p61527.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/metrics/cus/outliers-pre-custom-280497p61527.jpg Image ksb_180519_095019_ooi_g_ls9-CCD2 g : masking 4321 positive outlier pixels and 0 negative outlier pixels Image ksb_170619_095454_ooi_r_ls9-CCD2 r : masking 172 positive outlier pixels and 0 negative outlier pixels Image k4m_170926_053922_ooi_zd_ls9-CCD3 z : masking 4482 positive outlier pixels and 358 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/metrics/cus/outlier-mask-custom-280497p61527.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/metrics/cus/outliers-post-custom-280497p61527.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/metrics/cus/outliers-masked-pos-custom-280497p61527.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/metrics/cus/outliers-masked-neg-custom-280497p61527.jpg Stage outliers : Wall: 1.31 s, CPU: 0.94 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 248 MB, VmData: 275 MB, maxrss: 0.25384 MB Stage outliers finished: 2020-08-05T21:51:57.164218 Resources for stage outliers : 1.082 s worker CPU, 1.297 s worker Wall, Wall: 1.307 s, Cores in use: 1.54, Total efficiency (on 16 cores): 9.7 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/PGC062280-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/PGC062280-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T21:51:57.276243 Stage halos : Wall: 0.98 s, CPU: 0.96 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 248 MB, VmData: 275 MB, maxrss: 0.253948 MB Stage halos finished: 2020-08-05T21:51:58.258501 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.983 s, Cores in use: 0.98, Total efficiency (on 16 cores): 6.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/PGC062280-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/PGC062280-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T21:51:58.454731 PSF sigmas in coadd pixels: ['2.00', '2.42', '2.91', '1.91'] Using average PSF sigma 2.30718043170087 Gaussian PSF norm 0.1222681971023462 vs pixelized 0.099534295 average tim pixel scale / coadd scale: 1.7296236649578622 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.01', '1.76', '2.38'] Using average PSF sigma 2.0482690594215947 Gaussian PSF norm 0.13772350389042062 vs pixelized 0.11285984 average tim pixel scale / coadd scale: 1.7294153004159567 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.56', '2.60', '1.68'] Using average PSF sigma 1.9467879931978116 Gaussian PSF norm 0.14490267700413886 vs pixelized 0.11943338 average tim pixel scale / coadd scale: 0.9909686645784394 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.26 s, CPU: 0.22 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 250 MB, VmData: 275 MB, maxrss: 0.255588 MB Stage fit_on_coadds finished: 2020-08-05T21:51:58.710221 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.325 s worker CPU, 0.325 s worker Wall, Wall: 0.257 s, Cores in use: 2.13, Total efficiency (on 16 cores): 13.3 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/PGC062280-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/PGC062280-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T21:51:58.733751 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 31 potential peaks Of 31 potential peaks: 9 in veto map, 3 cut by saddle test, 0 cut by aper test, 19 kept SED z : 19 new peaks Found 370 potential peaks Of 370 potential peaks: 354 in veto map, 10 cut by saddle test, 1 cut by aper test, 5 kept SED r : 5 new peaks Found 105 potential peaks Of 105 potential peaks: 95 in veto map, 10 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 261 potential peaks Of 261 potential peaks: 242 in veto map, 13 cut by saddle test, 0 cut by aper test, 6 kept SED Flat : 6 new peaks Found 250 potential peaks Of 250 potential peaks: 233 in veto map, 13 cut by saddle test, 1 cut by aper test, 3 kept SED Red : 3 new peaks Adding 33 new sources Median coadd sky for g : 0.00068193884 Median coadd sky for r : 0.0019038296 Median coadd sky for z : -7.056007e-05 Stage srcs : Wall: 1.36 s, CPU: 1.30 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 250 MB, VmData: 275 MB, maxrss: 0.256092 MB Stage srcs finished: 2020-08-05T21:52:00.097757 Resources for stage srcs : 0.162 s worker CPU, 0.162 s worker Wall, Wall: 1.365 s, Cores in use: 1.07, Total efficiency (on 16 cores): 6.7 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/PGC062280-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/PGC062280-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T21:52:00.165254 Blob 1 of 9, id: 1, sources: 30, size: 277x334, npix 69101, brick X: 60,337, Y: 3,337, one pixel: 223 3 Blob 2 of 9, id: 0, sources: 5, size: 103x88, npix 6364, brick X: 11,114, Y: 0,88, one pixel: 52 0 Blob 3 of 9, id: 2, sources: 1, size: 35x38, npix 733, brick X: 156,191, Y: 14,52, one pixel: 178 14 Blob 4 of 9, id: 4, sources: 1, size: 29x29, npix 467, brick X: 39,68, Y: 130,159, one pixel: 54 130 Blob 5 of 9, id: 3, sources: 1, size: 24x23, npix 340, brick X: 51,75, Y: 107,130, one pixel: 61 107 Blob 6 of 9, id: 6, sources: 1, size: 21x23, npix 292, brick X: 46,67, Y: 215,238, one pixel: 55 215 Blob 7 of 9, id: 5, sources: 1, size: 22x23, npix 282, brick X: 51,73, Y: 190,213, one pixel: 60 190 Blob 8 of 9, id: 7, sources: 1, size: 22x22, npix 271, brick X: 33,55, Y: 256,278, one pixel: 43 256 Blob 9 of 9, id: 8, sources: 1, size: 19x21, npix 255, brick X: 0,19, Y: 281,302, one pixel: 6 281 Blob 7 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 89 MB, VmData: 139 MB, maxrss: 0.091008 MB Blob 6 finished, total: Wall: 0.10 s, CPU: 0.10 s, VmPeak: 811 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151348 MB Blob 3 finished, total: Wall: 0.19 s, CPU: 0.19 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.094164 MB Blob 8 finished, total: Wall: 0.19 s, CPU: 0.18 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.096264 MB Blob 9 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 95 MB, VmData: 140 MB, maxrss: 0.096892 MB Blob 4 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 811 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.15166 MB Blob 5 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.096512 MB Blob 2 finished, total: Wall: 2.05 s, CPU: 2.05 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 184 MB, maxrss: 0.15266 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (280.50489, 61.54878), pm (-11.5, 13.6), parallax 1.700 with NanoMaggies: g=13.6, r=13.2, z=13 Reset brightness to NanoMaggies: g=13.6, r=13.2, z=13 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.7302, ee1=0.00141061, ee2=0.019997 Blob 1 finished, total: Wall: 20.76 s, CPU: 20.76 s, VmPeak: 813 MB, VmSize: 745 MB, VmRSS: 171 MB, VmData: 203 MB, maxrss: 0.185788 MB Old catalog: 47 New catalog: 35 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/metrics/cus/blobs-custom-280497p61527.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/metrics/cus/all-models-custom-280497p61527.fits Stage fitblobs : Wall: 21.32 s, CPU: 0.51 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 252 MB, VmData: 277 MB, maxrss: 0.257736 MB Stage fitblobs finished: 2020-08-05T21:52:21.484933 Resources for stage fitblobs : 24.496 s worker CPU, 24.607 s worker Wall, Wall: 21.321 s, Cores in use: 1.17, Total efficiency (on 16 cores): 7.3 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/PGC062280-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/PGC062280-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T21:52:21.919067 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/tmp-legacysurvey-custom-280497p61527-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/tmp-legacysurvey-custom-280497p61527-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/tmp-legacysurvey-custom-280497p61527-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/tmp-legacysurvey-custom-280497p61527-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-resid.jpg Stage coadds : Wall: 2.85 s, CPU: 0.97 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 252 MB, VmData: 277 MB, maxrss: 0.25806 MB Stage coadds finished: 2020-08-05T21:52:24.772856 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 8.059 s worker CPU, 12.641 s worker Wall, Wall: 2.855 s, Cores in use: 3.16, Total efficiency (on 16 cores): 19.8 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/PGC062280-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/PGC062280-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T21:52:24.818033 Cut to 1 unWISE tiles Reading WISE tile 2810p620 band 1 Reading WISE tile 2810p620 band 3 Reading WISE tile 2810p620 band 4 Reading WISE tile 2810p620 band 2 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 811 MB, VmSize: 804 MB, VmRSS: 145 MB, VmData: 172 MB, maxrss: 0.208228 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 814 MB, VmSize: 812 MB, VmRSS: 151 MB, VmData: 180 MB, maxrss: 0.214712 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 810 MB, VmSize: 799 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.203968 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 812 MB, VmSize: 808 MB, VmRSS: 149 MB, VmData: 175 MB, maxrss: 0.192428 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/tmp-legacysurvey-custom-280497p61527-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/tmp-legacysurvey-custom-280497p61527-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 8.74 s, CPU: 1.10 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 253 MB, VmData: 277 MB, maxrss: 0.258572 MB Stage wise_forced finished: 2020-08-05T21:52:33.557647 Resources for stage wise_forced : 3.118 s worker CPU, 11.556 s worker Wall, Wall: 8.741 s, Cores in use: 0.48, Total efficiency (on 16 cores): 3.0 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/PGC062280-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/PGC062280-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T21:52:33.710909 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/coadd/cus/custom-280497p61527/legacysurvey-custom-280497p61527-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/tractor-i/cus/tractor-custom-280497p61527.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/tractor/cus/tractor-custom-280497p61527.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/tractor/cus/brick-custom-280497p61527.sha256sum Stage writecat : Wall: 0.80 s, CPU: 0.64 s, VmPeak: 1146 MB, VmSize: 1018 MB, VmRSS: 254 MB, VmData: 277 MB, maxrss: 0.39124 MB Stage writecat finished: 2020-08-05T21:52:34.514663 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.805 s, Cores in use: 0.80, Total efficiency (on 16 cores): 5.0 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/PGC062280-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC062280/PGC062280-largegalaxy-writecat.p All done: 43.628 s worker CPU, 80.960 s worker Wall, Wall: 56.510 s, Cores in use: 0.99, Total efficiency (on 16 cores): 6.2 % Finished galaxy PGC062280 in 0.971 minutes. Started working on galaxy PGC062280 at Fri Aug 7 09:49:58 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 280.496189607194 61.52808609960485 --width 337 --height 337 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T09:49:59.200321 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '280.496189607194', '61.52808609960485', '--width', '337', '--height', '337', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 280.496189607194 61.52808609960485 --width 337 --height 337 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 280.496189607194 61.52808609960485 Starting process 38420 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 38422 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 38424 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 38426 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 38428 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059404 MB Starting process 38430 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059412 MB Starting process 38432 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059412 MB Starting process 38434 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 38436 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 38438 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 38442 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 38444 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 38440 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 38446 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 38448 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 38450 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T09:49:59.703221 Keeping 11 CCDs: k4m_171029_035109_ooi_zd_ls9-CCD4 z expnum 143907 exptime 110.103 propid 2016A-0453 seeing 0.96 MJD 58055.161 object MzLS_690672_z mosaic/CP/V4.3/CP20171028/k4m_171029_035109_ooi_zd_ls9.fits.fz k4m_170926_053922_ooi_zd_ls9-CCD3 z expnum 140905 exptime 200.102 propid 2016A-0453 seeing 1.60 MJD 58022.236 object MzLS_691875_z mosaic/CP/V4.3/CP20170925/k4m_170926_053922_ooi_zd_ls9.fits.fz k4m_160606_094125_ooi_zd_ls9-CCD2 z expnum 93802 exptime 92.104 propid 2016A-0453 seeing 1.04 MJD 57545.404 object MzLS_691276_z mosaic/CP/V4.3/CP20160605/k4m_160606_094125_ooi_zd_ls9.fits.fz ksb_180519_095740_ooi_g_ls9-CCD3 g expnum 82570187 exptime 102.928 propid NOTBASS seeing 1.23 MJD 58257.415 object 38791 90prime/CP/V2.3/CP20180518/ksb_180519_095740_ooi_g_ls9.fits.fz ksb_170619_101812_ooi_r_ls9-CCD3 r expnum 79230146 exptime 227.141 propid BASS seeing 1.64 MJD 57923.429 object 38791 90prime/CP/V2.3/CP20170618/ksb_170619_101812_ooi_r_ls9.fits.fz ksb_170621_104905_ooi_g_ls9-CCD2 g expnum 79250095 exptime 208.293 propid BASS seeing 1.49 MJD 57925.451 object 39713 90prime/CP/V2.3/CP20170620/ksb_170621_104905_ooi_g_ls9.fits.fz ksb_170624_104420_ooi_r_ls9-CCD2 r expnum 79280172 exptime 109.016 propid BASS seeing 1.24 MJD 57928.447 object 39713 90prime/CP/V2.3/CP20170623/ksb_170624_104420_ooi_r_ls9.fits.fz ksb_160712_090750_ooi_g_ls9-CCD1 g expnum 75810131 exptime 118.8 propid BASS seeing 1.79 MJD 57581.380 object 38782 90prime/CP/V2.3/CP20160711/ksb_160712_090750_ooi_g_ls9.fits.fz ksb_180519_074140_ooi_r_ls9-CCD1 r expnum 82570126 exptime 81.151 propid NOTBASS seeing 1.08 MJD 58257.321 object 38782 90prime/CP/V2.3/CP20180518/ksb_180519_074140_ooi_r_ls9.fits.fz ksb_170619_095454_ooi_r_ls9-CCD2 r expnum 79230140 exptime 199.64 propid BASS seeing 1.46 MJD 57923.413 object 39711 90prime/CP/V2.3/CP20170618/ksb_170619_095454_ooi_r_ls9.fits.fz ksb_180519_095019_ooi_g_ls9-CCD2 g expnum 82570184 exptime 109.683 propid NOTBASS seeing 1.17 MJD 58257.410 object 39711 90prime/CP/V2.3/CP20180518/ksb_180519_095019_ooi_g_ls9.fits.fz Faked up EXPNUM 82570187 Faked up EXPNUM 82570187 Faked up EXPNUM 82570187 90prime get_fwhm: self.fwhm = 2.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 18 37 and amp range 0 2015 and image y 2696 2893 and amp range 2048 4095 Range in image: x 0 20 , y 0 198 (with image size 20 x 198) dzp -0.027600318 -> scaling image by 0.9748995562775561 Faked up EXPNUM 75810131 Faked up EXPNUM 75810131 Faked up EXPNUM 75810131 90prime get_fwhm: self.fwhm = 3.95 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1751 1951 and amp range 0 2015 and image y 1259 1458 and amp range 0 2047 Range in image: x 0 201 , y 0 200 (with image size 201 x 200) dzp -0.011813398 -> scaling image by 0.989178436928226 Faked up EXPNUM 82570184 Faked up EXPNUM 82570184 Faked up EXPNUM 82570184 90prime get_fwhm: self.fwhm = 2.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3546 3745 and amp range 2016 4031 and image y 2813 3012 and amp range 2048 4095 Range in image: x 0 200 , y 0 200 (with image size 200 x 200) dzp 0.013237011 -> scaling image by 1.012266359574015 Faked up EXPNUM 82570126 Faked up EXPNUM 82570126 Faked up EXPNUM 82570126 90prime get_fwhm: self.fwhm = 2.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1741 1942 and amp range 0 2015 and image y 1287 1487 and amp range 0 2047 Range in image: x 0 202 , y 0 201 (with image size 202 x 201) dzp -0.04811793 -> scaling image by 0.9566494556405901 Faked up EXPNUM 79250095 Faked up EXPNUM 79250095 Faked up EXPNUM 79250095 90prime get_fwhm: self.fwhm = 3.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1552 1751 and amp range 0 2015 and image y 827 1028 and amp range 0 2047 Range in image: x 0 200 , y 0 202 (with image size 200 x 202) dzp 0.0003063402 -> scaling image by 1.0002821895558327 mosaic get_fwhm: self.fwhm = 6.17 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1734 2076 and amp range 0 2005 and image y 1258 1602 and amp range 0 2039 Range in image: x 0 272 , y 0 345 (with image size 343 x 345) dzp 0.0014252509 -> scaling image by 1.0013135665633692 Found overlap: image x 1734 2076 and amp range 2006 4053 and image y 1258 1602 and amp range 0 2039 Range in image: x 272 343 , y 0 345 (with image size 343 x 345) dzp -0.006757846 -> scaling image by 0.993795123967763 mosaic get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2848 3195 and amp range 2048 4095 and image y 706 1046 and amp range 0 2021 Range in image: x 0 348 , y 0 341 (with image size 348 x 341) dzp -0.029506588 -> scaling image by 0.9731893881648719 mosaic get_fwhm: self.fwhm = 3.99 Found 4 relevant rows in amp-corrections file. Found overlap: image x 142 481 and amp range 0 2047 and image y 2034 2373 and amp range 0 2039 Range in image: x 0 340 , y 0 6 (with image size 340 x 340) dzp -0.006320339 -> scaling image by 0.9941956631368829 Found overlap: image x 142 481 and amp range 0 2047 and image y 2034 2373 and amp range 2040 4078 Range in image: x 0 340 , y 6 340 (with image size 340 x 340) dzp 0.008550294 -> scaling image by 1.0079062018164673 Faked up EXPNUM 79280172 Faked up EXPNUM 79280172 Faked up EXPNUM 79280172 90prime get_fwhm: self.fwhm = 2.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1546 1745 and amp range 0 2015 and image y 831 1032 and amp range 0 2047 Range in image: x 0 200 , y 0 202 (with image size 200 x 202) dzp 0.005335051 -> scaling image by 1.0049258559887364 Faked up EXPNUM 79230140 Faked up EXPNUM 79230140 Faked up EXPNUM 79230140 90prime get_fwhm: self.fwhm = 3.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3595 3793 and amp range 2016 4031 and image y 2817 3015 and amp range 2048 4095 Range in image: x 0 199 , y 0 199 (with image size 199 x 199) dzp 0.021366077 -> scaling image by 1.0198737893800265 Stage tims : Wall: 25.40 s, CPU: 0.92 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 175 MB, VmData: 209 MB, maxrss: 0.179476 MB Stage tims finished: 2020-08-07T09:50:25.099986 Faked up EXPNUM 79230146 Faked up EXPNUM 79230146 Faked up EXPNUM 79230146 90prime get_fwhm: self.fwhm = 3.63 Resources for stage tims : 5.657 s worker CPU, 87.492 s worker Wall, Wall: 25.399 s, Cores in use: 0.26, Total efficiency (on 16 cores): 1.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T09:50:25.303756 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00822.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00743.fits Matched 7 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/metrics/cus/reference-custom-280496p61528.fits Stage refs : Wall: 31.61 s, CPU: 4.11 s, VmPeak: 1004 MB, VmSize: 998 MB, VmRSS: 225 MB, VmData: 256 MB, maxrss: 0.230044 MB Stage refs finished: 2020-08-07T09:50:56.910398 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 31.609 s, Cores in use: 0.13, Total efficiency (on 16 cores): 0.8 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T09:50:57.116726 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/metrics/cus/outlier-mask-custom-280496p61528.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/metrics/cus/outliers-pre-custom-280496p61528.jpg Image ksb_180519_095019_ooi_g_ls9-CCD2 g : masking 4466 positive outlier pixels and 0 negative outlier pixels Image ksb_170619_095454_ooi_r_ls9-CCD2 r : masking 175 positive outlier pixels and 0 negative outlier pixels Image k4m_170926_053922_ooi_zd_ls9-CCD3 z : masking 4527 positive outlier pixels and 362 negative outlier pixels Image k4m_160606_094125_ooi_zd_ls9-CCD2 z : masking 191 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/metrics/cus/outlier-mask-custom-280496p61528.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/metrics/cus/outliers-post-custom-280496p61528.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/metrics/cus/outliers-masked-pos-custom-280496p61528.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/metrics/cus/outliers-masked-neg-custom-280496p61528.jpg Stage outliers : Wall: 1.28 s, CPU: 0.72 s, VmPeak: 1007 MB, VmSize: 1007 MB, VmRSS: 246 MB, VmData: 275 MB, maxrss: 0.252216 MB Stage outliers finished: 2020-08-07T09:50:58.398071 Resources for stage outliers : 1.139 s worker CPU, 1.287 s worker Wall, Wall: 1.283 s, Cores in use: 1.45, Total efficiency (on 16 cores): 9.1 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T09:50:58.546548 Stage halos : Wall: 0.30 s, CPU: 0.29 s, VmPeak: 1007 MB, VmSize: 1007 MB, VmRSS: 246 MB, VmData: 275 MB, maxrss: 0.252232 MB Stage halos finished: 2020-08-07T09:50:58.846658 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.302 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T09:50:59.023085 PSF sigmas in coadd pixels: ['2.00', '2.42', '2.91', '1.91'] Using average PSF sigma 2.30718043170087 Gaussian PSF norm 0.1222681971023462 vs pixelized 0.0995387 average tim pixel scale / coadd scale: 1.7296236649578622 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.01', '1.76', '2.38'] Using average PSF sigma 2.0482690594215947 Gaussian PSF norm 0.13772350389042062 vs pixelized 0.11286457 average tim pixel scale / coadd scale: 1.7294153004159567 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.56', '2.60', '1.68'] Using average PSF sigma 1.9467879931978116 Gaussian PSF norm 0.14490267700413886 vs pixelized 0.11943436 average tim pixel scale / coadd scale: 0.9909686645784394 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.42 s, CPU: 0.22 s, VmPeak: 1007 MB, VmSize: 1007 MB, VmRSS: 248 MB, VmData: 275 MB, maxrss: 0.253772 MB Stage fit_on_coadds finished: 2020-08-07T09:50:59.443481 Resources for stage fit_on_coadds : 0.287 s worker CPU, 0.287 s worker Wall, Wall: 0.422 s, Cores in use: 1.21, Total efficiency (on 16 cores): 7.6 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T09:50:59.565548 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 32 potential peaks Of 32 potential peaks: 9 in veto map, 4 cut by saddle test, 0 cut by aper test, 19 kept SED z : 19 new peaks Found 401 potential peaks Of 401 potential peaks: 383 in veto map, 11 cut by saddle test, 1 cut by aper test, 6 kept SED r : 6 new peaks Found 113 potential peaks Of 113 potential peaks: 102 in veto map, 11 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 287 potential peaks Of 287 potential peaks: 268 in veto map, 14 cut by saddle test, 0 cut by aper test, 5 kept SED Flat : 5 new peaks Found 262 potential peaks Of 262 potential peaks: 243 in veto map, 14 cut by saddle test, 2 cut by aper test, 3 kept SED Red : 3 new peaks Adding 33 new sources Median coadd sky for g : 0.0007265281 Median coadd sky for r : 0.0019690027 Median coadd sky for z : -0.00016425422 Stage srcs : Wall: 1.03 s, CPU: 0.98 s, VmPeak: 1007 MB, VmSize: 1007 MB, VmRSS: 248 MB, VmData: 275 MB, maxrss: 0.254256 MB Stage srcs finished: 2020-08-07T09:51:00.591191 Resources for stage srcs : 0.122 s worker CPU, 0.122 s worker Wall, Wall: 1.027 s, Cores in use: 1.07, Total efficiency (on 16 cores): 6.7 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T09:51:00.730146 Blob 1 of 8, id: 1, sources: 31, size: 286x335, npix 72423, brick X: 51,337, Y: 2,337, one pixel: 213 2 Blob 2 of 8, id: 0, sources: 5, size: 103x87, npix 6296, brick X: 2,105, Y: 0,87, one pixel: 42 0 Blob 3 of 8, id: 2, sources: 1, size: 35x38, npix 726, brick X: 146,181, Y: 13,51, one pixel: 168 13 Blob 4 of 8, id: 4, sources: 1, size: 28x28, npix 469, brick X: 30,58, Y: 129,157, one pixel: 44 129 Blob 5 of 8, id: 3, sources: 1, size: 24x23, npix 330, brick X: 41,65, Y: 106,129, one pixel: 51 106 Blob 6 of 8, id: 5, sources: 1, size: 22x23, npix 292, brick X: 42,64, Y: 189,212, one pixel: 50 189 Blob 7 of 8, id: 6, sources: 1, size: 21x23, npix 292, brick X: 37,58, Y: 213,236, one pixel: 47 213 Blob 8 of 8, id: 7, sources: 1, size: 21x22, npix 272, brick X: 24,45, Y: 255,277, one pixel: 34 255 Blob 7 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.1476 MB Blob 8 finished, total: Wall: 0.11 s, CPU: 0.11 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148128 MB Blob 6 finished, total: Wall: 0.18 s, CPU: 0.17 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147752 MB Blob 3 finished, total: Wall: 0.19 s, CPU: 0.19 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144744 MB Blob 4 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.096652 MB Blob 5 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147744 MB Blob 2 finished, total: Wall: 1.94 s, CPU: 1.93 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148096 MB Exception in one_blob: brick custom-280496p61528, iblob 1 multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker result = (True, func(*args, **kwds)) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__ R = self.func(*args, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1637, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 376, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1989, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3771, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3739, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3295, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3284, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1131, in stage_fitblobs r = Riter.next(timeout) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next raise value AttributeError: 'NoneType' object has no attribute 'getBrightness' Something went wrong; please check the logfile. ERROR: galaxy PGC062280; please check the logfile. Finished galaxy PGC062280 in 1.329 minutes. Started working on galaxy PGC062280 at Fri Aug 7 12:08:47 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 280.496189607194 61.52808609960485 --width 337 --height 337 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T12:08:48.385955 legacypipe git version: DR9.5.11-watershed-4-gcc619972 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '280.496189607194', '61.52808609960485', '--width', '337', '--height', '337', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 280.496189607194 61.52808609960485 --width 337 --height 337 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 280.496189607194 61.52808609960485 Starting process 17036 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 17037 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 17038 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 17039 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 17040 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 17041 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 17042 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 17043 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 17044 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 17045 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 17046 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 17047 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 17048 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 17049 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 17050 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 17051 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 17052 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 17053 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 17054 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 17055 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 17056 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 17057 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 17058 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 17059 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 17060 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 17061 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 17062 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 17063 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 17064 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 17065 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 17066 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 17067 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-srcs.p and forcing stage srcs Runstage fit_on_coadds Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-fit_on_coadds.p and forcing stage fit_on_coadds Runstage halos Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-halos.p and forcing stage halos Runstage outliers Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-outliers.p and forcing stage outliers Runstage refs Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-refs.p and forcing stage refs Runstage tims Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-tims.p and forcing stage tims Running stage tims Running stage tims at 2020-08-07T12:08:48.922363 Keeping 11 CCDs: k4m_171029_035109_ooi_zd_ls9-CCD4 z expnum 143907 exptime 110.103 propid 2016A-0453 seeing 0.96 MJD 58055.161 object MzLS_690672_z mosaic/CP/V4.3/CP20171028/k4m_171029_035109_ooi_zd_ls9.fits.fz k4m_170926_053922_ooi_zd_ls9-CCD3 z expnum 140905 exptime 200.102 propid 2016A-0453 seeing 1.60 MJD 58022.236 object MzLS_691875_z mosaic/CP/V4.3/CP20170925/k4m_170926_053922_ooi_zd_ls9.fits.fz k4m_160606_094125_ooi_zd_ls9-CCD2 z expnum 93802 exptime 92.104 propid 2016A-0453 seeing 1.04 MJD 57545.404 object MzLS_691276_z mosaic/CP/V4.3/CP20160605/k4m_160606_094125_ooi_zd_ls9.fits.fz ksb_180519_095740_ooi_g_ls9-CCD3 g expnum 82570187 exptime 102.928 propid NOTBASS seeing 1.23 MJD 58257.415 object 38791 90prime/CP/V2.3/CP20180518/ksb_180519_095740_ooi_g_ls9.fits.fz ksb_170619_101812_ooi_r_ls9-CCD3 r expnum 79230146 exptime 227.141 propid BASS seeing 1.64 MJD 57923.429 object 38791 90prime/CP/V2.3/CP20170618/ksb_170619_101812_ooi_r_ls9.fits.fz ksb_170621_104905_ooi_g_ls9-CCD2 g expnum 79250095 exptime 208.293 propid BASS seeing 1.49 MJD 57925.451 object 39713 90prime/CP/V2.3/CP20170620/ksb_170621_104905_ooi_g_ls9.fits.fz ksb_170624_104420_ooi_r_ls9-CCD2 r expnum 79280172 exptime 109.016 propid BASS seeing 1.24 MJD 57928.447 object 39713 90prime/CP/V2.3/CP20170623/ksb_170624_104420_ooi_r_ls9.fits.fz ksb_160712_090750_ooi_g_ls9-CCD1 g expnum 75810131 exptime 118.8 propid BASS seeing 1.79 MJD 57581.380 object 38782 90prime/CP/V2.3/CP20160711/ksb_160712_090750_ooi_g_ls9.fits.fz ksb_180519_074140_ooi_r_ls9-CCD1 r expnum 82570126 exptime 81.151 propid NOTBASS seeing 1.08 MJD 58257.321 object 38782 90prime/CP/V2.3/CP20180518/ksb_180519_074140_ooi_r_ls9.fits.fz ksb_170619_095454_ooi_r_ls9-CCD2 r expnum 79230140 exptime 199.64 propid BASS seeing 1.46 MJD 57923.413 object 39711 90prime/CP/V2.3/CP20170618/ksb_170619_095454_ooi_r_ls9.fits.fz ksb_180519_095019_ooi_g_ls9-CCD2 g expnum 82570184 exptime 109.683 propid NOTBASS seeing 1.17 MJD 58257.410 object 39711 90prime/CP/V2.3/CP20180518/ksb_180519_095019_ooi_g_ls9.fits.fz Faked up EXPNUM 82570187 Faked up EXPNUM 82570187 Faked up EXPNUM 82570187 90prime get_fwhm: self.fwhm = 2.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 18 37 and amp range 0 2015 and image y 2696 2893 and amp range 2048 4095 Range in image: x 0 20 , y 0 198 (with image size 20 x 198) dzp -0.027600318 -> scaling image by 0.9748995562775561 mosaic get_fwhm: self.fwhm = 6.17 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1734 2076 and amp range 0 2005 and image y 1258 1602 and amp range 0 2039 Range in image: x 0 272 , y 0 345 (with image size 343 x 345) dzp 0.0014252509 -> scaling image by 1.0013135665633692 Found overlap: image x 1734 2076 and amp range 2006 4053 and image y 1258 1602 and amp range 0 2039 Range in image: x 272 343 , y 0 345 (with image size 343 x 345) dzp -0.006757846 -> scaling image by 0.993795123967763 Faked up EXPNUM 79250095 Faked up EXPNUM 79250095 Faked up EXPNUM 79250095 90prime get_fwhm: self.fwhm = 3.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1552 1751 and amp range 0 2015 and image y 827 1028 and amp range 0 2047 Range in image: x 0 200 , y 0 202 (with image size 200 x 202) dzp 0.0003063402 -> scaling image by 1.0002821895558327 Faked up EXPNUM 79230140 Faked up EXPNUM 79230140 Faked up EXPNUM 79230140 90prime get_fwhm: self.fwhm = 3.23 Found 4 relevant rows in amp-corrections file. Faked up EXPNUM 82570126 Faked up EXPNUM 82570126 Faked up EXPNUM 82570126 90prime get_fwhm: self.fwhm = 2.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3595 3793 and amp range 2016 4031 and image y 2817 3015 and amp range 2048 4095 Range in image: x 0 199 , y 0 199 (with image size 199 x 199) Found overlap: image x 1741 1942 and amp range 0 2015 and image y 1287 1487 and amp range 0 2047 dzp 0.021366077 -> scaling image by 1.0198737893800265 Range in image: x 0 202 , y 0 201 (with image size 202 x 201) dzp -0.04811793 -> scaling image by 0.9566494556405901 mosaic get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2848 3195 and amp range 2048 4095 and image y 706 1046 and amp range 0 2021 Faked up EXPNUM 75810131 Faked up EXPNUM 75810131 Faked up EXPNUM 75810131 90prime get_fwhm: self.fwhm = 3.95 Found 4 relevant rows in amp-corrections file. Range in image: x 0 348 , y 0 341 (with image size 348 x 341) dzp -0.029506588 -> scaling image by 0.9731893881648719 Found overlap: image x 1751 1951 and amp range 0 2015 and image y 1259 1458 and amp range 0 2047 Range in image: x 0 201 , y 0 200 (with image size 201 x 200) dzp -0.011813398 -> scaling image by 0.989178436928226 mosaic get_fwhm: self.fwhm = 3.99 Found 4 relevant rows in amp-corrections file. Found overlap: image x 142 481 and amp range 0 2047 and image y 2034 2373 and amp range 0 2039 Range in image: x 0 340 , y 0 6 (with image size 340 x 340) dzp -0.006320339 -> scaling image by 0.9941956631368829 Found overlap: image x 142 481 and amp range 0 2047 and image y 2034 2373 and amp range 2040 4078 Range in image: x 0 340 , y 6 340 (with image size 340 x 340) dzp 0.008550294 -> scaling image by 1.0079062018164673 Faked up EXPNUM 79280172 Faked up EXPNUM 79280172 Faked up EXPNUM 79280172 90prime get_fwhm: self.fwhm = 2.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1546 1745 and amp range 0 2015 and image y 831 1032 and amp range 0 2047 Range in image: x 0 200 , y 0 202 (with image size 200 x 202) dzp 0.005335051 -> scaling image by 1.0049258559887364 Faked up EXPNUM 82570184 Faked up EXPNUM 82570184 Faked up EXPNUM 82570184 90prime get_fwhm: self.fwhm = 2.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3546 3745 and amp range 2016 4031 and image y 2813 3012 and amp range 2048 4095 Range in image: x 0 200 , y 0 200 (with image size 200 x 200) dzp 0.013237011 -> scaling image by 1.012266359574015 Stage tims : Wall: 2.28 s, CPU: 0.82 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 176 MB, VmData: 210 MB, maxrss: 0.180252 MB Stage tims finished: 2020-08-07T12:08:51.198883 Faked up EXPNUM 79230146 Faked up EXPNUM 79230146 Faked up EXPNUM 79230146 90prime get_fwhm: self.fwhm = 3.63 Resources for stage tims : 6.018 s worker CPU, 13.452 s worker Wall, Wall: 2.280 s, Cores in use: 3.00, Total efficiency (on 32 cores): 9.4 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T12:08:51.229283 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00822.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00743.fits Matched 7 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/metrics/cus/reference-custom-280496p61528.fits Stage refs : Wall: 4.37 s, CPU: 4.15 s, VmPeak: 1004 MB, VmSize: 998 MB, VmRSS: 226 MB, VmData: 257 MB, maxrss: 0.231008 MB Stage refs finished: 2020-08-07T12:08:55.595852 Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 4.369 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T12:08:55.621023 Stage outliers : Wall: 0.30 s, CPU: 0.28 s, VmPeak: 1004 MB, VmSize: 998 MB, VmRSS: 226 MB, VmData: 257 MB, maxrss: 0.231708 MB Stage outliers finished: 2020-08-07T12:08:55.921149 Resources for stage outliers : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.302 s, Cores in use: 0.92, Total efficiency (on 32 cores): 2.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T12:08:55.948545 Stage halos : Wall: 0.25 s, CPU: 0.24 s, VmPeak: 1004 MB, VmSize: 998 MB, VmRSS: 230 MB, VmData: 262 MB, maxrss: 0.236 MB Stage halos finished: 2020-08-07T12:08:56.199796 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.254 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T12:08:56.249048 PSF sigmas in coadd pixels: ['2.00', '2.42', '2.91', '1.91'] Using average PSF sigma 2.30718043170087 Gaussian PSF norm 0.1222681971023462 vs pixelized 0.0995387 average tim pixel scale / coadd scale: 1.7296236649578622 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.01', '1.76', '2.38'] Using average PSF sigma 2.0482690594215947 Gaussian PSF norm 0.13772350389042062 vs pixelized 0.11286457 average tim pixel scale / coadd scale: 1.7294153004159567 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.56', '2.60', '1.68'] Using average PSF sigma 1.9467879931978116 Gaussian PSF norm 0.14490267700413886 vs pixelized 0.11943436 average tim pixel scale / coadd scale: 0.9909686645784394 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.31 s, CPU: 0.24 s, VmPeak: 1004 MB, VmSize: 1003 MB, VmRSS: 247 MB, VmData: 276 MB, maxrss: 0.253296 MB Stage fit_on_coadds finished: 2020-08-07T12:08:56.562707 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.334 s worker CPU, 0.493 s worker Wall, Wall: 0.316 s, Cores in use: 1.81, Total efficiency (on 32 cores): 5.7 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T12:08:56.576952 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 32 potential peaks Of 32 potential peaks: 9 in veto map, 4 cut by saddle test, 0 cut by aper test, 19 kept SED z : 19 new peaks Found 401 potential peaks Of 401 potential peaks: 383 in veto map, 11 cut by saddle test, 1 cut by aper test, 6 kept SED r : 6 new peaks Found 113 potential peaks Of 113 potential peaks: 102 in veto map, 11 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 287 potential peaks Of 287 potential peaks: 268 in veto map, 14 cut by saddle test, 0 cut by aper test, 5 kept SED Flat : 5 new peaks Found 262 potential peaks Of 262 potential peaks: 243 in veto map, 14 cut by saddle test, 2 cut by aper test, 3 kept SED Red : 3 new peaks Adding 33 new sources Median coadd sky for g : 0.0007265281 Median coadd sky for r : 0.0019690027 Median coadd sky for z : -0.00016425422 Stage srcs : Wall: 0.97 s, CPU: 0.87 s, VmPeak: 1004 MB, VmSize: 1003 MB, VmRSS: 248 MB, VmData: 276 MB, maxrss: 0.254172 MB Stage srcs finished: 2020-08-07T12:08:57.544305 Resources for stage srcs : 0.186 s worker CPU, 0.222 s worker Wall, Wall: 0.969 s, Cores in use: 1.09, Total efficiency (on 32 cores): 3.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T12:08:58.414759 Blob 1 of 8, id: 1, sources: 31, size: 286x335, npix 72423, brick X: 51,337, Y: 2,337, one pixel: 213 2 Blob 2 of 8, id: 0, sources: 5, size: 103x87, npix 6296, brick X: 2,105, Y: 0,87, one pixel: 42 0 Blob 3 of 8, id: 2, sources: 1, size: 35x38, npix 726, brick X: 146,181, Y: 13,51, one pixel: 168 13 Blob 4 of 8, id: 4, sources: 1, size: 28x28, npix 469, brick X: 30,58, Y: 129,157, one pixel: 44 129 Blob 5 of 8, id: 3, sources: 1, size: 24x23, npix 330, brick X: 41,65, Y: 106,129, one pixel: 51 106 Blob 6 of 8, id: 5, sources: 1, size: 22x23, npix 292, brick X: 42,64, Y: 189,212, one pixel: 50 189 Blob 7 of 8, id: 6, sources: 1, size: 21x23, npix 292, brick X: 37,58, Y: 213,236, one pixel: 47 213 Blob 8 of 8, id: 7, sources: 1, size: 21x22, npix 272, brick X: 24,45, Y: 255,277, one pixel: 34 255 Blob 7 finished, total: Wall: 0.11 s, CPU: 0.07 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 82 MB, VmData: 137 MB, maxrss: 0.084352 MB Blob 8 finished, total: Wall: 0.12 s, CPU: 0.12 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145052 MB Blob 6 finished, total: Wall: 0.13 s, CPU: 0.10 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 82 MB, VmData: 136 MB, maxrss: 0.083856 MB Blob 3 finished, total: Wall: 0.24 s, CPU: 0.20 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 88 MB, VmData: 138 MB, maxrss: 0.090608 MB Blob 5 finished, total: Wall: 0.36 s, CPU: 0.35 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.09388 MB Blob 4 finished, total: Wall: 0.37 s, CPU: 0.31 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089916 MB Blob 2 finished, total: Wall: 2.12 s, CPU: 2.12 s, VmPeak: 674 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.100192 MB Exception in one_blob: brick custom-280496p61528, iblob 1 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker result = (True, func(*args, **kwds)) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__ R = self.func(*args, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3775, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3743, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3299, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3288, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1135, in stage_fitblobs r = Riter.next(timeout) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next raise value AttributeError: 'NoneType' object has no attribute 'getBrightness' Something went wrong; please check the logfile. ERROR: galaxy PGC062280; please check the logfile. Finished galaxy PGC062280 in 0.369 minutes. Started working on galaxy PGC062280 at Fri Aug 7 12:33:37 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 280.496189607194 61.52808609960485 --width 337 --height 337 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T12:33:37.815156 legacypipe git version: DR9.5.11-watershed-4-gcc619972 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '280.496189607194', '61.52808609960485', '--width', '337', '--height', '337', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 280.496189607194 61.52808609960485 --width 337 --height 337 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 280.496189607194 61.52808609960485 Starting process 19846 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 19847 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 19848 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 19849 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 19850 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059476 MB Starting process 19851 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059424 MB Starting process 19852 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059424 MB Starting process 19853 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 19854 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 19855 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 19856 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 19857 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 19858 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19859 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19860 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19861 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19862 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 19863 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 19864 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 19865 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 19866 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 19867 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 19868 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 19869 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 19870 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 19871 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 19872 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 19873 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 19874 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 19875 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 19876 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 19877 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T12:33:38.219972 Keeping 11 CCDs: k4m_171029_035109_ooi_zd_ls9-CCD4 z expnum 143907 exptime 110.103 propid 2016A-0453 seeing 0.96 MJD 58055.161 object MzLS_690672_z mosaic/CP/V4.3/CP20171028/k4m_171029_035109_ooi_zd_ls9.fits.fz k4m_170926_053922_ooi_zd_ls9-CCD3 z expnum 140905 exptime 200.102 propid 2016A-0453 seeing 1.60 MJD 58022.236 object MzLS_691875_z mosaic/CP/V4.3/CP20170925/k4m_170926_053922_ooi_zd_ls9.fits.fz k4m_160606_094125_ooi_zd_ls9-CCD2 z expnum 93802 exptime 92.104 propid 2016A-0453 seeing 1.04 MJD 57545.404 object MzLS_691276_z mosaic/CP/V4.3/CP20160605/k4m_160606_094125_ooi_zd_ls9.fits.fz ksb_180519_095740_ooi_g_ls9-CCD3 g expnum 82570187 exptime 102.928 propid NOTBASS seeing 1.23 MJD 58257.415 object 38791 90prime/CP/V2.3/CP20180518/ksb_180519_095740_ooi_g_ls9.fits.fz ksb_170619_101812_ooi_r_ls9-CCD3 r expnum 79230146 exptime 227.141 propid BASS seeing 1.64 MJD 57923.429 object 38791 90prime/CP/V2.3/CP20170618/ksb_170619_101812_ooi_r_ls9.fits.fz ksb_170621_104905_ooi_g_ls9-CCD2 g expnum 79250095 exptime 208.293 propid BASS seeing 1.49 MJD 57925.451 object 39713 90prime/CP/V2.3/CP20170620/ksb_170621_104905_ooi_g_ls9.fits.fz ksb_170624_104420_ooi_r_ls9-CCD2 r expnum 79280172 exptime 109.016 propid BASS seeing 1.24 MJD 57928.447 object 39713 90prime/CP/V2.3/CP20170623/ksb_170624_104420_ooi_r_ls9.fits.fz ksb_160712_090750_ooi_g_ls9-CCD1 g expnum 75810131 exptime 118.8 propid BASS seeing 1.79 MJD 57581.380 object 38782 90prime/CP/V2.3/CP20160711/ksb_160712_090750_ooi_g_ls9.fits.fz ksb_180519_074140_ooi_r_ls9-CCD1 r expnum 82570126 exptime 81.151 propid NOTBASS seeing 1.08 MJD 58257.321 object 38782 90prime/CP/V2.3/CP20180518/ksb_180519_074140_ooi_r_ls9.fits.fz ksb_170619_095454_ooi_r_ls9-CCD2 r expnum 79230140 exptime 199.64 propid BASS seeing 1.46 MJD 57923.413 object 39711 90prime/CP/V2.3/CP20170618/ksb_170619_095454_ooi_r_ls9.fits.fz ksb_180519_095019_ooi_g_ls9-CCD2 g expnum 82570184 exptime 109.683 propid NOTBASS seeing 1.17 MJD 58257.410 object 39711 90prime/CP/V2.3/CP20180518/ksb_180519_095019_ooi_g_ls9.fits.fz Faked up EXPNUM 82570187 Faked up EXPNUM 82570187 Faked up EXPNUM 82570187 90prime get_fwhm: self.fwhm = 2.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 18 37 and amp range 0 2015 and image y 2696 2893 and amp range 2048 4095 Range in image: x 0 20 , y 0 198 (with image size 20 x 198) dzp -0.027600318 -> scaling image by 0.9748995562775561 Faked up EXPNUM 79250095 Faked up EXPNUM 79250095 Faked up EXPNUM 79250095 90prime get_fwhm: self.fwhm = 3.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1552 1751 and amp range 0 2015 and image y 827 1028 and amp range 0 2047 Range in image: x 0 200 , y 0 202 (with image size 200 x 202) dzp 0.0003063402 -> scaling image by 1.0002821895558327 Faked up EXPNUM 79280172 Faked up EXPNUM 79280172 Faked up EXPNUM 79280172 90prime get_fwhm: self.fwhm = 2.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1546 1745 and amp range 0 2015 and image y 831 1032 and amp range 0 2047 Range in image: x 0 200 , y 0 202 (with image size 200 x 202) dzp 0.005335051 -> scaling image by 1.0049258559887364 Faked up EXPNUM 82570184 Faked up EXPNUM 82570184 Faked up EXPNUM 82570184 90prime get_fwhm: self.fwhm = 2.59 Found 4 relevant rows in amp-corrections file. Faked up EXPNUM 82570126 Faked up EXPNUM 82570126 Faked up EXPNUM 82570126 90prime get_fwhm: self.fwhm = 2.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1741 1942 and amp range 0 2015 and image y 1287 1487 and amp range 0 2047 Range in image: x 0 202 , y 0 201 (with image size 202 x 201) dzp -0.04811793 -> scaling image by 0.9566494556405901 Found overlap: image x 3546 3745 and amp range 2016 4031 and image y 2813 3012 and amp range 2048 4095 Range in image: x 0 200 , y 0 200 (with image size 200 x 200) dzp 0.013237011 -> scaling image by 1.012266359574015 mosaic get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2848 3195 and amp range 2048 4095 and image y 706 1046 and amp range 0 2021 Range in image: x 0 348 , y 0 341 (with image size 348 x 341) dzp -0.029506588 -> scaling image by 0.9731893881648719 Faked up EXPNUM 75810131 Faked up EXPNUM 75810131 Faked up EXPNUM 75810131 90prime get_fwhm: self.fwhm = 3.95 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1751 1951 and amp range 0 2015 and image y 1259 1458 and amp range 0 2047 Range in image: x 0 201 , y 0 200 (with image size 201 x 200) dzp -0.011813398 -> scaling image by 0.989178436928226 mosaic get_fwhm: self.fwhm = 3.99 Found 4 relevant rows in amp-corrections file. mosaic get_fwhm: self.fwhm = 6.17 Found 4 relevant rows in amp-corrections file. Found overlap: image x 142 481 and amp range 0 2047 and image y 2034 2373 and amp range 0 2039 Range in image: x 0 340 , y 0 6 (with image size 340 x 340) dzp -0.006320339 -> scaling image by 0.9941956631368829 Found overlap: image x 1734 2076 and amp range 0 2005 and image y 1258 1602 and amp range 0 2039 Range in image: x 0 272 , y 0 345 (with image size 343 x 345) Found overlap: image x 142 481 and amp range 0 2047 and image y 2034 2373 and amp range 2040 4078 dzp 0.0014252509 -> scaling image by 1.0013135665633692 Range in image: x 0 340 , y 6 340 (with image size 340 x 340) dzp 0.008550294 -> scaling image by 1.0079062018164673 Found overlap: image x 1734 2076 and amp range 2006 4053 and image y 1258 1602 and amp range 0 2039 Range in image: x 272 343 , y 0 345 (with image size 343 x 345) dzp -0.006757846 -> scaling image by 0.993795123967763 Faked up EXPNUM 79230140 Faked up EXPNUM 79230140 Faked up EXPNUM 79230140 90prime get_fwhm: self.fwhm = 3.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3595 3793 and amp range 2016 4031 and image y 2817 3015 and amp range 2048 4095 Range in image: x 0 199 , y 0 199 (with image size 199 x 199) dzp 0.021366077 -> scaling image by 1.0198737893800265 Stage tims : Wall: 2.25 s, CPU: 0.80 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 176 MB, VmData: 210 MB, maxrss: 0.180248 MB Stage tims finished: 2020-08-07T12:33:40.474192 Resources for stage tims : 5.710 s worker CPU, 13.397 s worker Wall, Wall: 2.257 s, Cores in use: 2.88, Total efficiency (on 32 cores): 9.0 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T12:33:40.504185 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00822.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00743.fits Matched 7 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/metrics/cus/reference-custom-280496p61528.fits Stage refs : Wall: 4.25 s, CPU: 3.93 s, VmPeak: 1004 MB, VmSize: 998 MB, VmRSS: 226 MB, VmData: 257 MB, maxrss: 0.230968 MB Stage refs finished: 2020-08-07T12:33:44.755620 Faked up EXPNUM 79230146 Faked up EXPNUM 79230146 Faked up EXPNUM 79230146 90prime get_fwhm: self.fwhm = 3.63 Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 4.254 s, Cores in use: 0.92, Total efficiency (on 32 cores): 2.9 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T12:33:44.780358 Stage outliers : Wall: 0.66 s, CPU: 0.25 s, VmPeak: 1004 MB, VmSize: 998 MB, VmRSS: 226 MB, VmData: 257 MB, maxrss: 0.23172 MB Stage outliers finished: 2020-08-07T12:33:45.444323 Resources for stage outliers : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.666 s, Cores in use: 0.38, Total efficiency (on 32 cores): 1.2 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T12:33:45.472326 Stage halos : Wall: 0.23 s, CPU: 0.22 s, VmPeak: 1004 MB, VmSize: 998 MB, VmRSS: 230 MB, VmData: 262 MB, maxrss: 0.235936 MB Stage halos finished: 2020-08-07T12:33:45.704213 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.234 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T12:33:45.736093 PSF sigmas in coadd pixels: ['2.00', '2.42', '2.91', '1.91'] Using average PSF sigma 2.30718043170087 Gaussian PSF norm 0.1222681971023462 vs pixelized 0.0995387 average tim pixel scale / coadd scale: 1.7296236649578622 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.01', '1.76', '2.38'] Using average PSF sigma 2.0482690594215947 Gaussian PSF norm 0.13772350389042062 vs pixelized 0.11286457 average tim pixel scale / coadd scale: 1.7294153004159567 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.56', '2.60', '1.68'] Using average PSF sigma 1.9467879931978116 Gaussian PSF norm 0.14490267700413886 vs pixelized 0.11943435 average tim pixel scale / coadd scale: 0.9909686645784394 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.27 s, CPU: 0.23 s, VmPeak: 1004 MB, VmSize: 1003 MB, VmRSS: 246 MB, VmData: 275 MB, maxrss: 0.251736 MB Stage fit_on_coadds finished: 2020-08-07T12:33:46.010645 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.307 s worker CPU, 0.466 s worker Wall, Wall: 0.277 s, Cores in use: 1.93, Total efficiency (on 32 cores): 6.0 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T12:33:46.024967 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 32 potential peaks Of 32 potential peaks: 9 in veto map, 4 cut by saddle test, 0 cut by aper test, 19 kept SED z : 19 new peaks Found 401 potential peaks Of 401 potential peaks: 383 in veto map, 11 cut by saddle test, 1 cut by aper test, 6 kept SED r : 6 new peaks Found 113 potential peaks Of 113 potential peaks: 102 in veto map, 11 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 287 potential peaks Of 287 potential peaks: 268 in veto map, 14 cut by saddle test, 0 cut by aper test, 5 kept SED Flat : 5 new peaks Found 262 potential peaks Of 262 potential peaks: 243 in veto map, 14 cut by saddle test, 2 cut by aper test, 3 kept SED Red : 3 new peaks Adding 33 new sources Median coadd sky for g : 0.0007265281 Median coadd sky for r : 0.0019690027 Median coadd sky for z : -0.00016425425 Stage srcs : Wall: 0.96 s, CPU: 0.88 s, VmPeak: 1004 MB, VmSize: 1003 MB, VmRSS: 247 MB, VmData: 275 MB, maxrss: 0.25262 MB Stage srcs finished: 2020-08-07T12:33:46.980128 Resources for stage srcs : 0.141 s worker CPU, 0.179 s worker Wall, Wall: 0.957 s, Cores in use: 1.07, Total efficiency (on 32 cores): 3.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T12:33:46.995911 Blob 1 of 8, id: 1, sources: 31, size: 286x335, npix 72423, brick X: 51,337, Y: 2,337, one pixel: 213 2 Blob 2 of 8, id: 0, sources: 5, size: 103x87, npix 6296, brick X: 2,105, Y: 0,87, one pixel: 42 0 Blob 3 of 8, id: 2, sources: 1, size: 35x38, npix 726, brick X: 146,181, Y: 13,51, one pixel: 168 13 Blob 4 of 8, id: 4, sources: 1, size: 28x28, npix 469, brick X: 30,58, Y: 129,157, one pixel: 44 129 Blob 5 of 8, id: 3, sources: 1, size: 24x23, npix 330, brick X: 41,65, Y: 106,129, one pixel: 51 106 Blob 6 of 8, id: 5, sources: 1, size: 22x23, npix 292, brick X: 42,64, Y: 189,212, one pixel: 50 189 Blob 7 of 8, id: 6, sources: 1, size: 21x23, npix 292, brick X: 37,58, Y: 213,236, one pixel: 47 213 Blob 8 of 8, id: 7, sources: 1, size: 21x22, npix 272, brick X: 24,45, Y: 255,277, one pixel: 34 255 Blob 7 finished, total: Wall: 0.06 s, CPU: 0.05 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145076 MB Blob 6 finished, total: Wall: 0.10 s, CPU: 0.07 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 83 MB, VmData: 137 MB, maxrss: 0.084684 MB Blob 8 finished, total: Wall: 0.12 s, CPU: 0.11 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145256 MB Blob 3 finished, total: Wall: 0.23 s, CPU: 0.20 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.090776 MB Blob 4 finished, total: Wall: 0.35 s, CPU: 0.32 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089844 MB Blob 5 finished, total: Wall: 0.39 s, CPU: 0.36 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089688 MB Blob 2 finished, total: Wall: 2.16 s, CPU: 2.13 s, VmPeak: 674 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.099548 MB Exception in one_blob: brick custom-280496p61528, iblob 1 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker result = (True, func(*args, **kwds)) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__ R = self.func(*args, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3775, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3743, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3299, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3288, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1135, in stage_fitblobs r = Riter.next(timeout) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next raise value AttributeError: 'NoneType' object has no attribute 'getBrightness' Something went wrong; please check the logfile. ERROR: galaxy PGC062280; please check the logfile. Finished galaxy PGC062280 in 0.414 minutes. Started working on galaxy PGC062280 at Fri Aug 7 13:34:14 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 280.496189607194 61.52808609960485 --width 337 --height 337 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T13:34:14.753346 legacypipe git version: DR9.5.11-watershed-5-g77ea3463 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '280.496189607194', '61.52808609960485', '--width', '337', '--height', '337', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 280.496189607194 61.52808609960485 --width 337 --height 337 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 280.496189607194 61.52808609960485 Starting process 23600 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 23601 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 23602 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 23603 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 23604 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059408 MB Starting process 23605 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059356 MB Starting process 23606 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059356 MB Starting process 23607 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 23608 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 23609 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 23610 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 23611 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 23612 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 23613 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 23614 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 23615 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 23616 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 23617 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 23618 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 23619 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 23620 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 23621 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 23622 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 23623 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 23625 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 23626 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 23624 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 23627 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 23628 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 23629 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 23630 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 23631 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T13:34:15.248243 Keeping 11 CCDs: k4m_171029_035109_ooi_zd_ls9-CCD4 z expnum 143907 exptime 110.103 propid 2016A-0453 seeing 0.96 MJD 58055.161 object MzLS_690672_z mosaic/CP/V4.3/CP20171028/k4m_171029_035109_ooi_zd_ls9.fits.fz k4m_170926_053922_ooi_zd_ls9-CCD3 z expnum 140905 exptime 200.102 propid 2016A-0453 seeing 1.60 MJD 58022.236 object MzLS_691875_z mosaic/CP/V4.3/CP20170925/k4m_170926_053922_ooi_zd_ls9.fits.fz k4m_160606_094125_ooi_zd_ls9-CCD2 z expnum 93802 exptime 92.104 propid 2016A-0453 seeing 1.04 MJD 57545.404 object MzLS_691276_z mosaic/CP/V4.3/CP20160605/k4m_160606_094125_ooi_zd_ls9.fits.fz ksb_180519_095740_ooi_g_ls9-CCD3 g expnum 82570187 exptime 102.928 propid NOTBASS seeing 1.23 MJD 58257.415 object 38791 90prime/CP/V2.3/CP20180518/ksb_180519_095740_ooi_g_ls9.fits.fz ksb_170619_101812_ooi_r_ls9-CCD3 r expnum 79230146 exptime 227.141 propid BASS seeing 1.64 MJD 57923.429 object 38791 90prime/CP/V2.3/CP20170618/ksb_170619_101812_ooi_r_ls9.fits.fz ksb_170621_104905_ooi_g_ls9-CCD2 g expnum 79250095 exptime 208.293 propid BASS seeing 1.49 MJD 57925.451 object 39713 90prime/CP/V2.3/CP20170620/ksb_170621_104905_ooi_g_ls9.fits.fz ksb_170624_104420_ooi_r_ls9-CCD2 r expnum 79280172 exptime 109.016 propid BASS seeing 1.24 MJD 57928.447 object 39713 90prime/CP/V2.3/CP20170623/ksb_170624_104420_ooi_r_ls9.fits.fz ksb_160712_090750_ooi_g_ls9-CCD1 g expnum 75810131 exptime 118.8 propid BASS seeing 1.79 MJD 57581.380 object 38782 90prime/CP/V2.3/CP20160711/ksb_160712_090750_ooi_g_ls9.fits.fz ksb_180519_074140_ooi_r_ls9-CCD1 r expnum 82570126 exptime 81.151 propid NOTBASS seeing 1.08 MJD 58257.321 object 38782 90prime/CP/V2.3/CP20180518/ksb_180519_074140_ooi_r_ls9.fits.fz ksb_170619_095454_ooi_r_ls9-CCD2 r expnum 79230140 exptime 199.64 propid BASS seeing 1.46 MJD 57923.413 object 39711 90prime/CP/V2.3/CP20170618/ksb_170619_095454_ooi_r_ls9.fits.fz ksb_180519_095019_ooi_g_ls9-CCD2 g expnum 82570184 exptime 109.683 propid NOTBASS seeing 1.17 MJD 58257.410 object 39711 90prime/CP/V2.3/CP20180518/ksb_180519_095019_ooi_g_ls9.fits.fz Faked up EXPNUM 75810131 Faked up EXPNUM 75810131 Faked up EXPNUM 75810131 90prime get_fwhm: self.fwhm = 3.95 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1751 1951 and amp range 0 2015 and image y 1259 1458 and amp range 0 2047 Range in image: x 0 201 , y 0 200 (with image size 201 x 200) dzp -0.011813398 -> scaling image by 0.989178436928226 mosaic get_fwhm: self.fwhm = 6.17 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1734 2076 and amp range 0 2005 and image y 1258 1602 and amp range 0 2039 Range in image: x 0 272 , y 0 345 (with image size 343 x 345) dzp 0.0014252509 -> scaling image by 1.0013135665633692 Found overlap: image x 1734 2076 and amp range 2006 4053 and image y 1258 1602 and amp range 0 2039 Range in image: x 272 343 , y 0 345 (with image size 343 x 345) dzp -0.006757846 -> scaling image by 0.993795123967763 Faked up EXPNUM 79250095 Faked up EXPNUM 79250095 Faked up EXPNUM 79250095 90prime get_fwhm: self.fwhm = 3.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1552 1751 and amp range 0 2015 and image y 827 1028 and amp range 0 2047 Range in image: x 0 200 , y 0 202 (with image size 200 x 202) dzp 0.0003063402 -> scaling image by 1.0002821895558327 mosaic get_fwhm: self.fwhm = 3.99 Found 4 relevant rows in amp-corrections file. mosaic get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 142 481 and amp range 0 2047 and image y 2034 2373 and amp range 0 2039 Range in image: x 0 340 , y 0 6 (with image size 340 x 340) Found overlap: image x 2848 3195 and amp range 2048 4095 and image y 706 1046 and amp range 0 2021 dzp -0.006320339 -> scaling image by 0.9941956631368829 Range in image: x 0 348 , y 0 341 (with image size 348 x 341) dzp -0.029506588 -> scaling image by 0.9731893881648719 Found overlap: image x 142 481 and amp range 0 2047 and image y 2034 2373 and amp range 2040 4078 Range in image: x 0 340 , y 6 340 (with image size 340 x 340) dzp 0.008550294 -> scaling image by 1.0079062018164673 Faked up EXPNUM 79230140 Faked up EXPNUM 79230140 Faked up EXPNUM 79230140 90prime get_fwhm: self.fwhm = 3.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3595 3793 and amp range 2016 4031 and image y 2817 3015 and amp range 2048 4095 Range in image: x 0 199 , y 0 199 (with image size 199 x 199) dzp 0.021366077 -> scaling image by 1.0198737893800265 Faked up EXPNUM 82570184 Faked up EXPNUM 82570184 Faked up EXPNUM 82570184 90prime get_fwhm: self.fwhm = 2.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3546 3745 and amp range 2016 4031 and image y 2813 3012 and amp range 2048 4095 Range in image: x 0 200 , y 0 200 (with image size 200 x 200) dzp 0.013237011 -> scaling image by 1.012266359574015 Faked up EXPNUM 79280172 Faked up EXPNUM 79280172 Faked up EXPNUM 79280172 90prime get_fwhm: self.fwhm = 2.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1546 1745 and amp range 0 2015 and image y 831 1032 and amp range 0 2047 Range in image: x 0 200 , y 0 202 (with image size 200 x 202) dzp 0.005335051 -> scaling image by 1.0049258559887364 Faked up EXPNUM 82570126 Faked up EXPNUM 82570126 Faked up EXPNUM 82570126 90prime get_fwhm: self.fwhm = 2.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1741 1942 and amp range 0 2015 and image y 1287 1487 and amp range 0 2047 Range in image: x 0 202 , y 0 201 (with image size 202 x 201) dzp -0.04811793 -> scaling image by 0.9566494556405901 Faked up EXPNUM 82570187 Faked up EXPNUM 82570187 Faked up EXPNUM 82570187 90prime get_fwhm: self.fwhm = 2.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 18 37 and amp range 0 2015 and image y 2696 2893 and amp range 2048 4095 Range in image: x 0 20 , y 0 198 (with image size 20 x 198) dzp -0.027600318 -> scaling image by 0.9748995562775561 Stage tims : Wall: 5.68 s, CPU: 0.78 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 175 MB, VmData: 209 MB, maxrss: 0.17928 MB Stage tims finished: 2020-08-07T13:34:20.924952 Resources for stage tims : 5.511 s worker CPU, 18.166 s worker Wall, Wall: 5.679 s, Cores in use: 1.11, Total efficiency (on 32 cores): 3.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T13:34:23.170279 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00822.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00743.fits Matched 7 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/metrics/cus/reference-custom-280496p61528.fits Stage refs : Wall: 4.17 s, CPU: 3.97 s, VmPeak: 1004 MB, VmSize: 998 MB, VmRSS: 225 MB, VmData: 256 MB, maxrss: 0.23004 MB Stage refs finished: 2020-08-07T13:34:27.340572 Faked up EXPNUM 79230146 Faked up EXPNUM 79230146 Faked up EXPNUM 79230146 90prime get_fwhm: self.fwhm = 3.63 Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 4.173 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T13:34:27.386456 Stage outliers : Wall: 0.25 s, CPU: 0.23 s, VmPeak: 1004 MB, VmSize: 998 MB, VmRSS: 225 MB, VmData: 256 MB, maxrss: 0.23084 MB Stage outliers finished: 2020-08-07T13:34:27.633275 Resources for stage outliers : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.249 s, Cores in use: 0.93, Total efficiency (on 32 cores): 2.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T13:34:27.667552 Stage halos : Wall: 0.19 s, CPU: 0.18 s, VmPeak: 1004 MB, VmSize: 998 MB, VmRSS: 230 MB, VmData: 261 MB, maxrss: 0.235056 MB Stage halos finished: 2020-08-07T13:34:27.860409 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.195 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T13:34:27.886607 PSF sigmas in coadd pixels: ['2.00', '2.42', '2.91', '1.91'] Using average PSF sigma 2.30718043170087 Gaussian PSF norm 0.1222681971023462 vs pixelized 0.099538706 average tim pixel scale / coadd scale: 1.7296236649578622 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.01', '1.76', '2.38'] Using average PSF sigma 2.0482690594215947 Gaussian PSF norm 0.13772350389042062 vs pixelized 0.11286457 average tim pixel scale / coadd scale: 1.7294153004159567 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.56', '2.60', '1.68'] Using average PSF sigma 1.9467879931978116 Gaussian PSF norm 0.14490267700413886 vs pixelized 0.11943435 average tim pixel scale / coadd scale: 0.9909686645784394 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.30 s, CPU: 0.22 s, VmPeak: 1004 MB, VmSize: 1003 MB, VmRSS: 247 MB, VmData: 276 MB, maxrss: 0.25342 MB Stage fit_on_coadds finished: 2020-08-07T13:34:28.182960 Resources for stage fit_on_coadds : 0.323 s worker CPU, 0.512 s worker Wall, Wall: 0.298 s, Cores in use: 1.84, Total efficiency (on 32 cores): 5.8 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-fit_on_coadds.p Running stage srcs Warning: Stellar halo subtraction is only implemented for DECam Running stage srcs at 2020-08-07T13:34:28.196491 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 32 potential peaks Of 32 potential peaks: 9 in veto map, 4 cut by saddle test, 0 cut by aper test, 19 kept SED z : 19 new peaks Found 401 potential peaks Of 401 potential peaks: 383 in veto map, 11 cut by saddle test, 1 cut by aper test, 6 kept SED r : 6 new peaks Found 113 potential peaks Of 113 potential peaks: 102 in veto map, 11 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 287 potential peaks Of 287 potential peaks: 268 in veto map, 14 cut by saddle test, 0 cut by aper test, 5 kept SED Flat : 5 new peaks Found 262 potential peaks Of 262 potential peaks: 243 in veto map, 14 cut by saddle test, 2 cut by aper test, 3 kept SED Red : 3 new peaks Adding 33 new sources Median coadd sky for g : 0.0007265281 Median coadd sky for r : 0.0019690027 Median coadd sky for z : -0.00016425425 Stage srcs : Wall: 1.02 s, CPU: 0.84 s, VmPeak: 1004 MB, VmSize: 1003 MB, VmRSS: 248 MB, VmData: 276 MB, maxrss: 0.254168 MB Stage srcs finished: 2020-08-07T13:34:29.213146 Resources for stage srcs : 0.166 s worker CPU, 0.216 s worker Wall, Wall: 1.019 s, Cores in use: 0.99, Total efficiency (on 32 cores): 3.1 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T13:34:29.242501 Blob 1 of 8, id: 1, sources: 31, size: 286x335, npix 72423, brick X: 51,337, Y: 2,337, one pixel: 213 2 Blob 2 of 8, id: 0, sources: 5, size: 103x87, npix 6296, brick X: 2,105, Y: 0,87, one pixel: 42 0 Blob 3 of 8, id: 2, sources: 1, size: 35x38, npix 726, brick X: 146,181, Y: 13,51, one pixel: 168 13 Blob 4 of 8, id: 4, sources: 1, size: 28x28, npix 469, brick X: 30,58, Y: 129,157, one pixel: 44 129 Blob 5 of 8, id: 3, sources: 1, size: 24x23, npix 330, brick X: 41,65, Y: 106,129, one pixel: 51 106 Blob 6 of 8, id: 5, sources: 1, size: 22x23, npix 292, brick X: 42,64, Y: 189,212, one pixel: 50 189 Blob 7 of 8, id: 6, sources: 1, size: 21x23, npix 292, brick X: 37,58, Y: 213,236, one pixel: 47 213 Blob 8 of 8, id: 7, sources: 1, size: 21x22, npix 272, brick X: 24,45, Y: 255,277, one pixel: 34 255 Blob 6 finished, total: Wall: 0.10 s, CPU: 0.06 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145164 MB Blob 7 finished, total: Wall: 0.15 s, CPU: 0.07 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 83 MB, VmData: 137 MB, maxrss: 0.084884 MB Blob 8 finished, total: Wall: 0.21 s, CPU: 0.13 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089992 MB Blob 3 finished, total: Wall: 0.28 s, CPU: 0.20 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.090764 MB Blob 5 finished, total: Wall: 0.36 s, CPU: 0.32 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146584 MB Blob 4 finished, total: Wall: 0.37 s, CPU: 0.29 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089852 MB Blob 2 finished, total: Wall: 2.04 s, CPU: 1.98 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145916 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (280.50489, 61.54878), pm (-11.5, 13.6), parallax 1.700 with NanoMaggies: g=13.6, r=13.2, z=13 Reset brightness to NanoMaggies: g=13.6, r=13.2, z=13 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.55525, ee1=0.00956272, ee2=0.0363888 Blob 1 finished, total: Wall: 29.34 s, CPU: 29.29 s, VmPeak: 737 MB, VmSize: 706 MB, VmRSS: 140 MB, VmData: 174 MB, maxrss: 0.175224 MB Old catalog: 46 New catalog: 29 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/metrics/cus/blobs-custom-280496p61528.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/metrics/cus/all-models-custom-280496p61528.fits Stage fitblobs : Wall: 29.72 s, CPU: 0.33 s, VmPeak: 1004 MB, VmSize: 1003 MB, VmRSS: 251 MB, VmData: 278 MB, maxrss: 0.257056 MB Stage fitblobs finished: 2020-08-07T13:34:58.962200 Resources for stage fitblobs : 32.454 s worker CPU, 33.016 s worker Wall, Wall: 29.722 s, Cores in use: 1.10, Total efficiency (on 32 cores): 3.4 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T13:34:58.983802 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/tmp-legacysurvey-custom-280496p61528-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/tmp-legacysurvey-custom-280496p61528-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/tmp-legacysurvey-custom-280496p61528-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/tmp-legacysurvey-custom-280496p61528-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-resid.jpg Stage coadds : Wall: 2.34 s, CPU: 0.81 s, VmPeak: 1007 MB, VmSize: 1007 MB, VmRSS: 252 MB, VmData: 278 MB, maxrss: 0.25812 MB Stage coadds finished: 2020-08-07T13:35:01.326486 Resources for stage coadds : 24.994 s worker CPU, 25.996 s worker Wall, Wall: 2.345 s, Cores in use: 11.00, Total efficiency (on 32 cores): 34.4 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T13:35:01.418871 Cut to 1 unWISE tiles Reading WISE tile 2810p620 band 1 Reading WISE tile 2810p620 band 2 Reading WISE tile 2810p620 band 3 Reading WISE tile 2810p620 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 810 MB, VmSize: 797 MB, VmRSS: 142 MB, VmData: 176 MB, maxrss: 0.183636 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 813 MB, VmSize: 792 MB, VmRSS: 137 MB, VmData: 170 MB, maxrss: 0.194964 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 811 MB, VmSize: 797 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.202304 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/281/2810p620/unwise-2810p620-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 801 MB, VmSize: 801 MB, VmRSS: 144 MB, VmData: 179 MB, maxrss: 0.202692 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/tmp-legacysurvey-custom-280496p61528-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/tmp-legacysurvey-custom-280496p61528-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 1.89 s, CPU: 0.49 s, VmPeak: 1007 MB, VmSize: 1007 MB, VmRSS: 253 MB, VmData: 278 MB, maxrss: 0.258632 MB Stage wise_forced finished: 2020-08-07T13:35:03.308787 Resources for stage wise_forced : 3.236 s worker CPU, 4.409 s worker Wall, Wall: 1.892 s, Cores in use: 1.97, Total efficiency (on 32 cores): 6.2 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T13:35:03.327866 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/coadd/cus/custom-280496p61528/legacysurvey-custom-280496p61528-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/tractor-i/cus/tractor-custom-280496p61528.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/tractor/cus/tractor-custom-280496p61528.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/tractor/cus/brick-custom-280496p61528.sha256sum Stage writecat : Wall: 1.29 s, CPU: 0.58 s, VmPeak: 1140 MB, VmSize: 1012 MB, VmRSS: 254 MB, VmData: 278 MB, maxrss: 0.391516 MB Stage writecat finished: 2020-08-07T13:35:04.614952 Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 1.290 s, Cores in use: 0.45, Total efficiency (on 32 cores): 1.4 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC062280/PGC062280-largegalaxy-writecat.p All done: 66.692 s worker CPU, 82.325 s worker Wall, Wall: 49.389 s, Cores in use: 1.52, Total efficiency (on 32 cores): 4.8 % Finished galaxy PGC062280 in 0.853 minutes.