Started working on galaxy PGC2308960 at Wed Aug 5 22:10:43 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 263.200608 48.021465299999996 --width 425 --height 425 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/PGC2308960-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/PGC2308960-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T22:10:44.858445 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '263.200608', '48.021465299999996', '--width', '425', '--height', '425', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/PGC2308960-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/PGC2308960-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 263.200608 48.021465299999996 --width 425 --height 425 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/PGC2308960-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/PGC2308960-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 263.200608 48.021465299999996 Starting process 48550 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 48551 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 48552 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 48553 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 48554 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 48555 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 48556 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 48557 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 48558 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 48559 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 48560 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 48562 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 48563 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 48561 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 48565 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 48564 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T22:10:46.161059 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 11 CCDs: k4m_160519_090227_ooi_zd_ls9-CCD4 z expnum 90222 exptime 87.103 propid 2016A-0453 seeing 0.83 MJD 57527.377 object MzLS_641256_z mosaic/CP/V4.3/CP20160518/k4m_160519_090227_ooi_zd_ls9.fits.fz k4m_160511_093205_ooi_zd_ls9-CCD2 z expnum 88350 exptime 80.104 propid 2016A-0453 seeing 0.81 MJD 57519.397 object MzLS_640414_z mosaic/CP/V4.3/CP20160510/k4m_160511_093205_ooi_zd_ls9.fits.fz k4m_170505_111543_ooi_zd_ls9-CCD1 z expnum 126750 exptime 80.106 propid 2016A-0453 seeing 1.05 MJD 57878.469 object MzLS_642096_z mosaic/CP/V4.3/CP20170504/k4m_170505_111543_ooi_zd_ls9.fits.fz k4m_160519_090635_ooi_zd_ls9-CCD2 z expnum 90224 exptime 82.104 propid 2016A-0453 seeing 0.89 MJD 57527.380 object MzLS_641257_z mosaic/CP/V4.3/CP20160518/k4m_160519_090635_ooi_zd_ls9.fits.fz ksb_180418_095014_ooi_g_ls9-CCD4 g expnum 82260147 exptime 92.628 propid BASS seeing 1.33 MJD 58226.410 object 24782 90prime/CP/V2.3/CP20180417/ksb_180418_095014_ooi_g_ls9.fits.fz ksb_160612_094942_ooi_r_ls9-CCD4 r expnum 75510106 exptime 77.9 propid BASS seeing 1.46 MJD 57551.410 object 24782 90prime/CP/V2.3/CP20160611/ksb_160612_094942_ooi_r_ls9.fits.fz ksb_160707_070913_ooi_g_ls9-CCD4 g expnum 75760067 exptime 244.4 propid BASS seeing 2.92 MJD 57576.298 object 24782 90prime/CP/V2.3/CP20160706/ksb_160707_070913_ooi_g_ls9.fits.fz ksb_170530_084626_ooi_g_ls9-CCD1 g expnum 79030068 exptime 119.664 propid 2015A-0801 seeing 1.38 MJD 57903.366 object 24783 90prime/CP/V2.3/CP20170529/ksb_170530_084626_ooi_g_ls9.fits.fz ksb_170430_100248_ooi_r_ls9-CCD1 r expnum 78730231 exptime 63.423 propid BASS seeing 1.46 MJD 57873.419 object 24783 90prime/CP/V2.3/CP20170429/ksb_170430_100248_ooi_r_ls9.fits.fz ksb_170604_100032_ooi_g_ls9-CCD1 g expnum 79080173 exptime 86.158 propid BASS seeing 1.38 MJD 57908.417 object 24781 90prime/CP/V2.3/CP20170603/ksb_170604_100032_ooi_g_ls9.fits.fz ksb_160530_102312_ooi_r_ls9-CCD1 r expnum 75380214 exptime 101.0 propid BASS seeing 1.33 MJD 57538.433 object 24781 90prime/CP/V2.3/CP20160529/ksb_160530_102312_ooi_r_ls9.fits.fz Faked up EXPNUM 75760067 Faked up EXPNUM 75760067 Faked up EXPNUM 75760067 90prime get_fwhm: self.fwhm = 6.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1643 1890 and amp range 0 2015 and image y 971 1218 and amp range 0 2047 Range in image: x 0 248 , y 0 248 (with image size 248 x 248) dzp 0.009539392 -> scaling image by 1.0088248156909383 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82260147 Faked up EXPNUM 82260147 Faked up EXPNUM 82260147 90prime get_fwhm: self.fwhm = 2.93 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1636 1884 and amp range 0 2015 and image y 974 1221 and amp range 0 2047 Range in image: x 0 249 , y 0 248 (with image size 249 x 248) dzp 0.0059804036 -> scaling image by 1.0055233530762397 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 78730231 Faked up EXPNUM 78730231 Faked up EXPNUM 78730231 90prime get_fwhm: self.fwhm = 3.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1800 2050 and amp range 0 2015 and image y 1461 1710 and amp range 0 2047 Range in image: x 0 216 , y 0 250 (with image size 251 x 250) dzp -0.024106435 -> scaling image by 0.9780418215011345 Found overlap: image x 1800 2050 and amp range 2016 4031 and image y 1461 1710 and amp range 0 2047 Range in image: x 216 251 , y 0 250 (with image size 251 x 250) dzp -0.006547878 -> scaling image by 0.9939873303458991 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.43 Found 4 relevant rows in amp-corrections file. Found overlap: image x 7 270 and amp range 0 2047 and image y 7 425 and amp range 0 2039 Range in image: x 0 264 , y 0 419 (with image size 264 x 419) dzp -0.006320339 -> scaling image by 0.9941956631368829 mosaic get_fwhm: self.fwhm = 3.11 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2551 2988 and amp range 2048 4095 and image y 1154 1590 and amp range 0 2039 Range in image: x 0 438 , y 0 437 (with image size 438 x 437) dzp 0.0072022504 -> scaling image by 1.0066555682883527 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 79080173 Faked up EXPNUM 79080173 Faked up EXPNUM 79080173 90prime get_fwhm: self.fwhm = 3.05 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3801 4016 and amp range 2016 4031 and image y 3458 3706 and amp range 2048 4095 Range in image: x 0 216 , y 0 249 (with image size 216 x 249) dzp 0.020521455 -> scaling image by 1.0190807119283773 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.19 Found 4 relevant rows in amp-corrections file. Found overlap: image x 7 299 and amp range 0 2047 and image y 3602 4040 and amp range 2022 4060 Range in image: x 0 293 , y 0 439 (with image size 293 x 439) dzp 0.0033053984 -> scaling image by 1.0030490232713904 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.05 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1410 1844 and amp range 0 2005 and image y 1255 1690 and amp range 0 2039 Range in image: x 0 435 , y 0 436 (with image size 435 x 436) dzp 0.007397243 -> scaling image by 1.006836374469654 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75380214 Faked up EXPNUM 75380214 Faked up EXPNUM 75380214 90prime get_fwhm: self.fwhm = 2.93 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3809 4016 and amp range 2016 4031 and image y 3478 3725 and amp range 2048 4095 Range in image: x 0 208 , y 0 248 (with image size 208 x 248) dzp 0.01301769 -> scaling image by 1.0120619004021345 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 79030068 Faked up EXPNUM 79030068 Faked up EXPNUM 79030068 90prime get_fwhm: self.fwhm = 3.05 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1786 2037 and amp range 0 2015 and image y 1464 1714 and amp range 0 2047 Range in image: x 0 230 , y 0 251 (with image size 252 x 251) dzp -0.023075538 -> scaling image by 0.9789709052881876 Found overlap: image x 1786 2037 and amp range 2016 4031 and image y 1464 1714 and amp range 0 2047 Range in image: x 230 252 , y 0 251 (with image size 252 x 251) dzp -0.011406615 -> scaling image by 0.9895491130016149 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75510106 Faked up EXPNUM 75510106 Faked up EXPNUM 75510106 90prime get_fwhm: self.fwhm = 3.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1638 1886 and amp range 0 2015 and image y 979 1226 and amp range 0 2047 Range in image: x 0 249 , y 0 248 (with image size 249 x 248) dzp 0.009781551 -> scaling image by 1.0090498455107675 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 17.27 s, CPU: 1.44 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 182 MB, VmData: 214 MB, maxrss: 0.186492 MB Stage tims finished: 2020-08-05T22:11:03.430689 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 6.206 s worker CPU, 51.418 s worker Wall, Wall: 17.271 s, Cores in use: 0.44, Total efficiency (on 16 cores): 2.8 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/PGC2308960-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/PGC2308960-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T22:11:03.745200 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01593.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01594.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01483.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01708.fits Matched 11 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/metrics/cus/reference-custom-263200p48021.fits Stage refs : Wall: 12.07 s, CPU: 3.92 s, VmPeak: 997 MB, VmSize: 992 MB, VmRSS: 217 MB, VmData: 248 MB, maxrss: 0.222516 MB Stage refs finished: 2020-08-05T22:11:15.810662 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 12.067 s, Cores in use: 0.33, Total efficiency (on 16 cores): 2.0 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/PGC2308960-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/PGC2308960-largegalaxy-refs.p Running stage outliers WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage outliers at 2020-08-05T22:11:16.176476 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/metrics/cus/outlier-mask-custom-263200p48021.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/metrics/cus/outliers-pre-custom-263200p48021.jpg Image ksb_160530_102312_ooi_r_ls9-CCD1 r : masking 58 positive outlier pixels and 0 negative outlier pixels Image ksb_170430_100248_ooi_r_ls9-CCD1 r : masking 75 positive outlier pixels and 0 negative outlier pixels Image k4m_160519_090227_ooi_zd_ls9-CCD4 z : masking 363 positive outlier pixels and 0 negative outlier pixels Image k4m_160519_090635_ooi_zd_ls9-CCD2 z : masking 0 positive outlier pixels and 1005 negative outlier pixels Image k4m_170505_111543_ooi_zd_ls9-CCD1 z : masking 1391 positive outlier pixels and 310 negative outlier pixels Image k4m_160511_093205_ooi_zd_ls9-CCD2 z : masking 1567 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/metrics/cus/outlier-mask-custom-263200p48021.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/metrics/cus/outliers-post-custom-263200p48021.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/metrics/cus/outliers-masked-pos-custom-263200p48021.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/metrics/cus/outliers-masked-neg-custom-263200p48021.jpg Stage outliers : Wall: 1.93 s, CPU: 1.47 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 253 MB, VmData: 283 MB, maxrss: 0.258848 MB Stage outliers finished: 2020-08-05T22:11:18.108877 Resources for stage outliers : 2.086 s worker CPU, 2.286 s worker Wall, Wall: 1.934 s, Cores in use: 1.84, Total efficiency (on 16 cores): 11.5 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/PGC2308960-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/PGC2308960-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T22:11:18.193328 Stage halos : Wall: 0.34 s, CPU: 0.32 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 253 MB, VmData: 283 MB, maxrss: 0.259144 MB Stage halos finished: 2020-08-05T22:11:18.530962 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.339 s, Cores in use: 0.96, Total efficiency (on 16 cores): 6.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/PGC2308960-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/PGC2308960-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T22:11:18.569607 PSF sigmas in coadd pixels: ['2.16', '4.75', '2.24', '2.24'] Using average PSF sigma 2.8483852106965304 Gaussian PSF norm 0.09903674219151562 vs pixelized 0.07536676 average tim pixel scale / coadd scale: 1.7296189661333266 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.38', '2.38', '2.16'] Using average PSF sigma 2.303442599032628 Gaussian PSF norm 0.12246660363594429 vs pixelized 0.094856255 average tim pixel scale / coadd scale: 1.7294080355666748 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.35', '1.31', '1.71', '1.45'] Using average PSF sigma 1.4526272926824657 Gaussian PSF norm 0.19419626300215892 vs pixelized 0.16318966 average tim pixel scale / coadd scale: 0.9909099376029938 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.38 s, CPU: 0.34 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 257 MB, VmData: 286 MB, maxrss: 0.263136 MB Stage fit_on_coadds finished: 2020-08-05T22:11:18.945311 Resources for stage fit_on_coadds : 0.553 s worker CPU, 0.553 s worker Wall, Wall: 0.377 s, Cores in use: 2.37, Total efficiency (on 16 cores): 14.8 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/PGC2308960-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/PGC2308960-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T22:11:18.962020 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 100 potential peaks Of 100 potential peaks: 61 in veto map, 8 cut by saddle test, 0 cut by aper test, 31 kept SED z : 31 new peaks Found 81 potential peaks Of 81 potential peaks: 74 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 52 potential peaks Of 52 potential peaks: 46 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 117 potential peaks Of 117 potential peaks: 102 in veto map, 11 cut by saddle test, 1 cut by aper test, 3 kept SED Flat : 3 new peaks Found 166 potential peaks Of 166 potential peaks: 152 in veto map, 9 cut by saddle test, 0 cut by aper test, 5 kept SED Red : 5 new peaks Adding 43 new sources Median coadd sky for g : 0.00017122246 Median coadd sky for r : 0.00035721523 Median coadd sky for z : 0.00017167626 Stage srcs : Wall: 0.90 s, CPU: 0.81 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 258 MB, VmData: 286 MB, maxrss: 0.263796 MB Stage srcs finished: 2020-08-05T22:11:19.859986 Resources for stage srcs : 0.226 s worker CPU, 0.226 s worker Wall, Wall: 0.899 s, Cores in use: 1.15, Total efficiency (on 16 cores): 7.2 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/PGC2308960-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/PGC2308960-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T22:11:19.877316 Blob 1 of 31, id: 13, sources: 17, size: 300x229, npix 38503, brick X: 71,371, Y: 117,346, one pixel: 224 117 Blob 2 of 31, id: 24, sources: 2, size: 47x69, npix 2025, brick X: 82,129, Y: 322,391, one pixel: 91 322 Blob 3 of 31, id: 22, sources: 3, size: 51x67, npix 1919, brick X: 322,373, Y: 311,378, one pixel: 344 311 Blob 4 of 31, id: 7, sources: 2, size: 50x51, npix 1759, brick X: 270,320, Y: 55,106, one pixel: 292 55 Blob 5 of 31, id: 6, sources: 1, size: 47x45, npix 1558, brick X: 1,48, Y: 49,94, one pixel: 23 49 Blob 6 of 31, id: 2, sources: 1, size: 50x36, npix 1063, brick X: 281,331, Y: 14,50, one pixel: 294 14 Blob 7 of 31, id: 20, sources: 1, size: 35x42, npix 1002, brick X: 12,47, Y: 291,333, one pixel: 21 291 Blob 8 of 31, id: 12, sources: 1, size: 39x38, npix 966, brick X: 65,104, Y: 115,153, one pixel: 82 115 Blob 9 of 31, id: 26, sources: 2, size: 31x48, npix 953, brick X: 366,397, Y: 358,406, one pixel: 379 358 Blob 10 of 31, id: 23, sources: 1, size: 24x42, npix 775, brick X: 0,24, Y: 322,364, one pixel: 5 322 Blob 11 of 31, id: 10, sources: 1, size: 39x30, npix 733, brick X: 319,358, Y: 103,133, one pixel: 329 103 Blob 12 of 31, id: 0, sources: 1, size: 38x22, npix 634, brick X: 353,391, Y: 0,22, one pixel: 357 0 Blob 13 of 31, id: 4, sources: 1, size: 30x31, npix 620, brick X: 101,131, Y: 45,76, one pixel: 114 45 Blob 14 of 31, id: 19, sources: 1, size: 35x25, npix 592, brick X: 302,337, Y: 284,309, one pixel: 313 284 Blob 15 of 31, id: 17, sources: 2, size: 43x24, npix 591, brick X: 18,61, Y: 245,269, one pixel: 27 245 Blob 16 of 31, id: 21, sources: 1, size: 27x27, npix 470, brick X: 293,320, Y: 306,333, one pixel: 303 306 Blob 17 of 31, id: 18, sources: 1, size: 27x24, npix 395, brick X: 365,392, Y: 260,284, one pixel: 374 260 Measuring 2 iterative sources Blob 12 finished, total: Wall: 0.61 s, CPU: 0.60 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.0976 MB Blob 18 of 31, id: 3, sources: 1, size: 26x25, npix 392, brick X: 118,144, Y: 25,50, one pixel: 129 25 Blob 16 finished, total: Wall: 0.66 s, CPU: 0.65 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 98 MB, VmData: 143 MB, maxrss: 0.100108 MB Blob 19 of 31, id: 25, sources: 1, size: 24x24, npix 364, brick X: 152,176, Y: 347,371, one pixel: 162 347 Blob 13 finished, total: Wall: 0.70 s, CPU: 0.69 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.09794 MB Blob 20 of 31, id: 1, sources: 1, size: 19x26, npix 354, brick X: 0,19, Y: 13,39, one pixel: 5 13 Blob 21 of 31, id: 14, sources: 1, size: 23x23, npix 337, brick X: 41,64, Y: 122,145, one pixel: 51 122 Blob 18 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 98 MB, VmData: 144 MB, maxrss: 0.100316 MB Blob 4 finished, total: Wall: 0.97 s, CPU: 0.96 s, VmPeak: 808 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151068 MB Blob 22 of 31, id: 27, sources: 1, size: 23x23, npix 325, brick X: 250,273, Y: 372,395, one pixel: 260 372 Measuring 1 iterative sources Blob 6 finished, total: Wall: 1.01 s, CPU: 1.01 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 96 MB, VmData: 141 MB, maxrss: 0.097824 MB Blob 8 finished, total: Wall: 1.02 s, CPU: 1.01 s, VmPeak: 808 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151796 MB Blob 23 of 31, id: 29, sources: 1, size: 23x23, npix 306, brick X: 39,62, Y: 398,421, one pixel: 48 398 Blob 24 of 31, id: 28, sources: 1, size: 23x21, npix 300, brick X: 203,226, Y: 389,410, one pixel: 211 389 Blob 25 of 31, id: 5, sources: 1, size: 22x21, npix 270, brick X: 311,333, Y: 46,67, one pixel: 322 46 Blob 5 finished, total: Wall: 1.09 s, CPU: 1.08 s, VmPeak: 809 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150612 MB Blob 26 of 31, id: 8, sources: 1, size: 21x21, npix 259, brick X: 159,180, Y: 85,106, one pixel: 167 85 Blob 11 finished, total: Wall: 1.29 s, CPU: 1.28 s, VmPeak: 804 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151488 MB Blob 14 finished, total: Wall: 1.27 s, CPU: 1.27 s, VmPeak: 810 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.15164 MB Blob 27 of 31, id: 11, sources: 1, size: 20x19, npix 227, brick X: 116,136, Y: 108,127, one pixel: 124 108 Blob 28 of 31, id: 9, sources: 1, size: 20x19, npix 208, brick X: 382,402, Y: 97,116, one pixel: 391 97 Blob 25 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 804 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151488 MB Blob 29 of 31, id: 15, sources: 1, size: 18x19, npix 189, brick X: 68,86, Y: 186,205, one pixel: 77 186 Measuring 1 iterative sources Blob 17 finished, total: Wall: 0.83 s, CPU: 0.83 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097716 MB Blob 30 of 31, id: 30, sources: 1, size: 17x17, npix 145, brick X: 311,328, Y: 398,415, one pixel: 319 398 Blob 19 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 671 MB, VmSize: 670 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.098064 MB Blob 31 of 31, id: 16, sources: 1, size: 15x17, npix 141, brick X: 0,15, Y: 197,214, one pixel: 6 197 Blob 26 finished, total: Wall: 0.24 s, CPU: 0.23 s, VmPeak: 810 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151984 MB Blob 15 finished, total: Wall: 1.55 s, CPU: 1.54 s, VmPeak: 814 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150996 MB Blob 29 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 671 MB, VmSize: 670 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.098132 MB Blob 21 finished, total: Wall: 0.58 s, CPU: 0.58 s, VmPeak: 808 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151068 MB Blob 23 finished, total: Wall: 0.55 s, CPU: 0.54 s, VmPeak: 808 MB, VmSize: 731 MB, VmRSS: 149 MB, VmData: 183 MB, maxrss: 0.152204 MB Blob 20 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 98 MB, VmData: 144 MB, maxrss: 0.100316 MB Blob 27 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 804 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151488 MB Blob 22 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 96 MB, VmData: 141 MB, maxrss: 0.09798 MB Blob 28 finished, total: Wall: 0.17 s, CPU: 0.17 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.09778 MB Blob 10 finished, total: Wall: 1.68 s, CPU: 1.68 s, VmPeak: 802 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 183 MB, maxrss: 0.152688 MB Blob 9 finished, total: Wall: 1.74 s, CPU: 1.73 s, VmPeak: 804 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151684 MB Blob 24 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 809 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151552 MB Blob 30 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 810 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151984 MB Blob 2 finished, total: Wall: 1.93 s, CPU: 1.93 s, VmPeak: 808 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150336 MB Blob 31 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.098132 MB Measuring 1 iterative sources Blob 7 finished, total: Wall: 2.16 s, CPU: 2.15 s, VmPeak: 808 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151524 MB Blob 3 finished, total: Wall: 2.64 s, CPU: 2.64 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 97 MB, VmData: 145 MB, maxrss: 0.099664 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.52753, ee1=-0.114003, ee2=0.0878879 Measuring 9 iterative sources Blob 1 finished, total: Wall: 30.05 s, CPU: 30.04 s, VmPeak: 803 MB, VmSize: 765 MB, VmRSS: 191 MB, VmData: 217 MB, maxrss: 0.196072 MB Old catalog: 61 New catalog: 60 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/metrics/cus/blobs-custom-263200p48021.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/metrics/cus/all-models-custom-263200p48021.fits Stage fitblobs : Wall: 31.21 s, CPU: 1.10 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 258 MB, VmData: 286 MB, maxrss: 0.264152 MB Stage fitblobs finished: 2020-08-05T22:11:51.087172 Resources for stage fitblobs : 57.004 s worker CPU, 58.384 s worker Wall, Wall: 31.211 s, Cores in use: 1.86, Total efficiency (on 16 cores): 11.6 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/PGC2308960-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/PGC2308960-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T22:11:51.295539 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/tmp-legacysurvey-custom-263200p48021-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/tmp-legacysurvey-custom-263200p48021-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/tmp-legacysurvey-custom-263200p48021-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/tmp-legacysurvey-custom-263200p48021-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-resid.jpg Stage coadds : Wall: 11.64 s, CPU: 2.67 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 271 MB, VmData: 298 MB, maxrss: 0.277472 MB Stage coadds finished: 2020-08-05T22:12:02.939797 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 9.421 s worker CPU, 16.442 s worker Wall, Wall: 11.646 s, Cores in use: 1.04, Total efficiency (on 16 cores): 6.5 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/PGC2308960-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/PGC2308960-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-05T22:12:02.962127 Cut to 1 unWISE tiles Reading WISE tile 2632p484 band 1 Reading WISE tile 2632p484 band 2 Reading WISE tile 2632p484 band 3 Reading WISE tile 2632p484 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 806 MB, VmSize: 804 MB, VmRSS: 147 MB, VmData: 172 MB, maxrss: 0.209228 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 810 MB, VmSize: 807 MB, VmRSS: 149 MB, VmData: 174 MB, maxrss: 0.21146 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 814 MB, VmSize: 807 MB, VmRSS: 152 MB, VmData: 175 MB, maxrss: 0.216204 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.13 s, CPU: 0.13 s, VmPeak: 809 MB, VmSize: 809 MB, VmRSS: 156 MB, VmData: 177 MB, maxrss: 0.201188 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/tmp-legacysurvey-custom-263200p48021-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/tmp-legacysurvey-custom-263200p48021-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 9.44 s, CPU: 0.83 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 272 MB, VmData: 298 MB, maxrss: 0.278176 MB Stage wise_forced finished: 2020-08-05T22:12:12.403734 Resources for stage wise_forced : 3.243 s worker CPU, 12.211 s worker Wall, Wall: 9.443 s, Cores in use: 0.43, Total efficiency (on 16 cores): 2.7 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/PGC2308960-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/PGC2308960-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T22:12:12.565678 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/coadd/cus/custom-263200p48021/legacysurvey-custom-263200p48021-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/tractor-i/cus/tractor-custom-263200p48021.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/tractor/cus/tractor-custom-263200p48021.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/tractor/cus/brick-custom-263200p48021.sha256sum Stage writecat : Wall: 2.74 s, CPU: 1.88 s, VmPeak: 1146 MB, VmSize: 1018 MB, VmRSS: 273 MB, VmData: 298 MB, maxrss: 0.411056 MB Stage writecat finished: 2020-08-05T22:12:15.302990 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.739 s, Cores in use: 0.69, Total efficiency (on 16 cores): 4.3 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/PGC2308960-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC2308960/PGC2308960-largegalaxy-writecat.p All done: 78.743 s worker CPU, 141.525 s worker Wall, Wall: 89.174 s, Cores in use: 1.05, Total efficiency (on 16 cores): 6.6 % Finished galaxy PGC2308960 in 1.541 minutes. Started working on galaxy PGC2308960 at Fri Aug 7 10:15:26 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 263.1999690808324 48.02167672698017 --width 425 --height 425 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/PGC2308960-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/PGC2308960-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T10:15:27.548273 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '263.1999690808324', '48.02167672698017', '--width', '425', '--height', '425', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/PGC2308960-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/PGC2308960-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 263.1999690808324 48.02167672698017 --width 425 --height 425 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/PGC2308960-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/PGC2308960-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 263.1999690808324 48.02167672698017 Starting process 22561 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 22562 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 22563 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 22564 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 22565 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05948 MB Starting process 22566 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059492 MB Starting process 22567 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059492 MB Starting process 22568 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 22569 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 22570 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 22571 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 22572 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 22573 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 22574 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 22575 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 22576 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T10:15:28.276032 Keeping 11 CCDs: k4m_160519_090227_ooi_zd_ls9-CCD4 z expnum 90222 exptime 87.103 propid 2016A-0453 seeing 0.83 MJD 57527.377 object MzLS_641256_z mosaic/CP/V4.3/CP20160518/k4m_160519_090227_ooi_zd_ls9.fits.fz k4m_160511_093205_ooi_zd_ls9-CCD2 z expnum 88350 exptime 80.104 propid 2016A-0453 seeing 0.81 MJD 57519.397 object MzLS_640414_z mosaic/CP/V4.3/CP20160510/k4m_160511_093205_ooi_zd_ls9.fits.fz k4m_170505_111543_ooi_zd_ls9-CCD1 z expnum 126750 exptime 80.106 propid 2016A-0453 seeing 1.05 MJD 57878.469 object MzLS_642096_z mosaic/CP/V4.3/CP20170504/k4m_170505_111543_ooi_zd_ls9.fits.fz k4m_160519_090635_ooi_zd_ls9-CCD2 z expnum 90224 exptime 82.104 propid 2016A-0453 seeing 0.89 MJD 57527.380 object MzLS_641257_z mosaic/CP/V4.3/CP20160518/k4m_160519_090635_ooi_zd_ls9.fits.fz ksb_180418_095014_ooi_g_ls9-CCD4 g expnum 82260147 exptime 92.628 propid BASS seeing 1.33 MJD 58226.410 object 24782 90prime/CP/V2.3/CP20180417/ksb_180418_095014_ooi_g_ls9.fits.fz ksb_160612_094942_ooi_r_ls9-CCD4 r expnum 75510106 exptime 77.9 propid BASS seeing 1.46 MJD 57551.410 object 24782 90prime/CP/V2.3/CP20160611/ksb_160612_094942_ooi_r_ls9.fits.fz ksb_160707_070913_ooi_g_ls9-CCD4 g expnum 75760067 exptime 244.4 propid BASS seeing 2.92 MJD 57576.298 object 24782 90prime/CP/V2.3/CP20160706/ksb_160707_070913_ooi_g_ls9.fits.fz ksb_170530_084626_ooi_g_ls9-CCD1 g expnum 79030068 exptime 119.664 propid 2015A-0801 seeing 1.38 MJD 57903.366 object 24783 90prime/CP/V2.3/CP20170529/ksb_170530_084626_ooi_g_ls9.fits.fz ksb_170430_100248_ooi_r_ls9-CCD1 r expnum 78730231 exptime 63.423 propid BASS seeing 1.46 MJD 57873.419 object 24783 90prime/CP/V2.3/CP20170429/ksb_170430_100248_ooi_r_ls9.fits.fz ksb_170604_100032_ooi_g_ls9-CCD1 g expnum 79080173 exptime 86.158 propid BASS seeing 1.38 MJD 57908.417 object 24781 90prime/CP/V2.3/CP20170603/ksb_170604_100032_ooi_g_ls9.fits.fz ksb_160530_102312_ooi_r_ls9-CCD1 r expnum 75380214 exptime 101.0 propid BASS seeing 1.33 MJD 57538.433 object 24781 90prime/CP/V2.3/CP20160529/ksb_160530_102312_ooi_r_ls9.fits.fz Faked up EXPNUM 82260147 Faked up EXPNUM 82260147 Faked up EXPNUM 82260147 90prime get_fwhm: self.fwhm = 2.93 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1634 1882 and amp range 0 2015 and image y 977 1224 and amp range 0 2047 Range in image: x 0 249 , y 0 248 (with image size 249 x 248) dzp 0.0059804036 -> scaling image by 1.0055233530762397 Faked up EXPNUM 78730231 Faked up EXPNUM 78730231 Faked up EXPNUM 78730231 90prime get_fwhm: self.fwhm = 3.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1798 2049 and amp range 0 2015 and image y 1464 1713 and amp range 0 2047 Range in image: x 0 218 , y 0 250 (with image size 252 x 250) dzp -0.024106435 -> scaling image by 0.9780418215011345 Found overlap: image x 1798 2049 and amp range 2016 4031 and image y 1464 1713 and amp range 0 2047 Range in image: x 218 252 , y 0 250 (with image size 252 x 250) dzp -0.006547878 -> scaling image by 0.9939873303458991 Faked up EXPNUM 79080173 Faked up EXPNUM 79080173 Faked up EXPNUM 79080173 90prime get_fwhm: self.fwhm = 3.05 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3800 4016 and amp range 2016 4031 and image y 3462 3709 and amp range 2048 4095 Range in image: x 0 217 , y 0 248 (with image size 217 x 248) dzp 0.020521455 -> scaling image by 1.0190807119283773 Faked up EXPNUM 75760067 Faked up EXPNUM 75760067 Faked up EXPNUM 75760067 90prime get_fwhm: self.fwhm = 6.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1641 1889 and amp range 0 2015 and image y 975 1222 and amp range 0 2047 Range in image: x 0 249 , y 0 248 (with image size 249 x 248) dzp 0.009539392 -> scaling image by 1.0088248156909383 mosaic get_fwhm: self.fwhm = 3.43 Found 4 relevant rows in amp-corrections file. Found overlap: image x 7 272 and amp range 0 2047 and image y 7 419 and amp range 0 2039 Range in image: x 0 266 , y 0 413 (with image size 266 x 413) dzp -0.006320339 -> scaling image by 0.9941956631368829 mosaic get_fwhm: self.fwhm = 4.05 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1413 1847 and amp range 0 2005 and image y 1249 1684 and amp range 0 2039 Range in image: x 0 435 , y 0 436 (with image size 435 x 436) dzp 0.007397243 -> scaling image by 1.006836374469654 mosaic get_fwhm: self.fwhm = 3.19 Found 4 relevant rows in amp-corrections file. Found overlap: image x 7 302 and amp range 0 2047 and image y 3596 4034 and amp range 2022 4060 Range in image: x 0 296 , y 0 439 (with image size 296 x 439) dzp 0.0033053984 -> scaling image by 1.0030490232713904 mosaic get_fwhm: self.fwhm = 3.11 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2554 2991 and amp range 2048 4095 and image y 1148 1584 and amp range 0 2039 Range in image: x 0 438 , y 0 437 (with image size 438 x 437) dzp 0.0072022504 -> scaling image by 1.0066555682883527 Faked up EXPNUM 75380214 Faked up EXPNUM 75380214 Faked up EXPNUM 75380214 90prime get_fwhm: self.fwhm = 2.93 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3807 4016 and amp range 2016 4031 and image y 3482 3729 and amp range 2048 4095 Range in image: x 0 210 , y 0 248 (with image size 210 x 248) dzp 0.01301769 -> scaling image by 1.0120619004021345 Faked up EXPNUM 79030068 Faked up EXPNUM 79030068 Faked up EXPNUM 79030068 90prime get_fwhm: self.fwhm = 3.05 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1785 2035 and amp range 0 2015 and image y 1468 1717 and amp range 0 2047 Range in image: x 0 231 , y 0 250 (with image size 251 x 250) dzp -0.023075538 -> scaling image by 0.9789709052881876 Found overlap: image x 1785 2035 and amp range 2016 4031 and image y 1468 1717 and amp range 0 2047 Range in image: x 231 251 , y 0 250 (with image size 251 x 250) dzp -0.011406615 -> scaling image by 0.9895491130016149 Faked up EXPNUM 75510106 Faked up EXPNUM 75510106 Faked up EXPNUM 75510106 90prime get_fwhm: self.fwhm = 3.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1637 1884 and amp range 0 2015 and image y 983 1230 and amp range 0 2047 Range in image: x 0 248 , y 0 248 (with image size 248 x 248) dzp 0.009781551 -> scaling image by 1.0090498455107675 Stage tims : Wall: 85.18 s, CPU: 0.88 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 180 MB, VmData: 214 MB, maxrss: 0.184356 MB Stage tims finished: 2020-08-07T10:16:53.453377 Resources for stage tims : 5.810 s worker CPU, 253.695 s worker Wall, Wall: 85.179 s, Cores in use: 0.08, Total efficiency (on 16 cores): 0.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/PGC2308960-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/PGC2308960-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T10:16:56.162198 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01593.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01594.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01483.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01708.fits Matched 11 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/metrics/cus/reference-custom-263199p48021.fits Stage refs : Wall: 36.99 s, CPU: 3.39 s, VmPeak: 991 MB, VmSize: 985 MB, VmRSS: 215 MB, VmData: 248 MB, maxrss: 0.220016 MB Stage refs finished: 2020-08-07T10:17:33.154691 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 36.994 s, Cores in use: 0.09, Total efficiency (on 16 cores): 0.6 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/PGC2308960-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/PGC2308960-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T10:17:33.252824 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/metrics/cus/outlier-mask-custom-263199p48021.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/metrics/cus/outliers-pre-custom-263199p48021.jpg Image ksb_160530_102312_ooi_r_ls9-CCD1 r : masking 60 positive outlier pixels and 0 negative outlier pixels Image ksb_170430_100248_ooi_r_ls9-CCD1 r : masking 74 positive outlier pixels and 0 negative outlier pixels Image k4m_160519_090227_ooi_zd_ls9-CCD4 z : masking 398 positive outlier pixels and 0 negative outlier pixels Image k4m_160519_090635_ooi_zd_ls9-CCD2 z : masking 0 positive outlier pixels and 1027 negative outlier pixels Image k4m_160511_093205_ooi_zd_ls9-CCD2 z : masking 1555 positive outlier pixels and 0 negative outlier pixels Image k4m_170505_111543_ooi_zd_ls9-CCD1 z : masking 1390 positive outlier pixels and 320 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/metrics/cus/outlier-mask-custom-263199p48021.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/metrics/cus/outliers-post-custom-263199p48021.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/metrics/cus/outliers-masked-pos-custom-263199p48021.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/metrics/cus/outliers-masked-neg-custom-263199p48021.jpg Stage outliers : Wall: 10.62 s, CPU: 1.11 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 249 MB, VmData: 281 MB, maxrss: 0.255044 MB Stage outliers finished: 2020-08-07T10:17:43.875589 Resources for stage outliers : 2.250 s worker CPU, 2.390 s worker Wall, Wall: 10.625 s, Cores in use: 0.32, Total efficiency (on 16 cores): 2.0 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/PGC2308960-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/PGC2308960-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T10:17:50.564354 Stage halos : Wall: 0.52 s, CPU: 0.45 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 249 MB, VmData: 281 MB, maxrss: 0.255248 MB Stage halos finished: 2020-08-07T10:17:51.082619 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.520 s, Cores in use: 0.86, Total efficiency (on 16 cores): 5.4 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/PGC2308960-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/PGC2308960-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T10:17:51.118770 PSF sigmas in coadd pixels: ['2.16', '4.75', '2.24', '2.24'] Using average PSF sigma 2.8483852106965304 Gaussian PSF norm 0.09903674219151562 vs pixelized 0.07536733 average tim pixel scale / coadd scale: 1.7296189661333266 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.38', '2.38', '2.16'] Using average PSF sigma 2.303442599032628 Gaussian PSF norm 0.12246660363594429 vs pixelized 0.09485244 average tim pixel scale / coadd scale: 1.7294080355666748 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.35', '1.31', '1.71', '1.45'] Using average PSF sigma 1.4526272926824657 Gaussian PSF norm 0.19419626300215892 vs pixelized 0.16318539 average tim pixel scale / coadd scale: 0.9909099376029938 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.87 s, CPU: 0.34 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 255 MB, VmData: 286 MB, maxrss: 0.261284 MB Stage fit_on_coadds finished: 2020-08-07T10:17:51.988166 Resources for stage fit_on_coadds : 0.525 s worker CPU, 0.525 s worker Wall, Wall: 0.871 s, Cores in use: 1.00, Total efficiency (on 16 cores): 6.2 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/PGC2308960-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/PGC2308960-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T10:17:52.104727 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 99 potential peaks Of 99 potential peaks: 59 in veto map, 7 cut by saddle test, 0 cut by aper test, 33 kept SED z : 33 new peaks Found 81 potential peaks Of 81 potential peaks: 73 in veto map, 5 cut by saddle test, 0 cut by aper test, 3 kept SED r : 3 new peaks Found 53 potential peaks Of 53 potential peaks: 46 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 117 potential peaks Of 117 potential peaks: 102 in veto map, 12 cut by saddle test, 1 cut by aper test, 2 kept SED Flat : 2 new peaks Found 166 potential peaks Of 166 potential peaks: 152 in veto map, 9 cut by saddle test, 0 cut by aper test, 5 kept SED Red : 5 new peaks Adding 46 new sources Median coadd sky for g : 0.00016361971 Median coadd sky for r : 0.0003581175 Median coadd sky for z : 0.00013934018 Stage srcs : Wall: 1.02 s, CPU: 0.92 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 256 MB, VmData: 286 MB, maxrss: 0.26192 MB Stage srcs finished: 2020-08-07T10:17:53.129370 Resources for stage srcs : 0.217 s worker CPU, 0.217 s worker Wall, Wall: 1.026 s, Cores in use: 1.11, Total efficiency (on 16 cores): 6.9 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/PGC2308960-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/PGC2308960-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T10:17:55.037386 Blob 1 of 34, id: 14, sources: 16, size: 300x229, npix 38530, brick X: 65,365, Y: 114,343, one pixel: 219 114 Blob 2 of 34, id: 24, sources: 2, size: 47x70, npix 2033, brick X: 76,123, Y: 319,389, one pixel: 85 319 Blob 3 of 34, id: 23, sources: 3, size: 51x67, npix 1922, brick X: 316,367, Y: 308,375, one pixel: 338 308 Blob 4 of 34, id: 8, sources: 2, size: 51x51, npix 1759, brick X: 264,315, Y: 52,103, one pixel: 286 52 Blob 5 of 34, id: 7, sources: 1, size: 42x45, npix 1490, brick X: 0,42, Y: 46,91, one pixel: 17 46 Blob 6 of 34, id: 1, sources: 1, size: 50x36, npix 1093, brick X: 275,325, Y: 11,47, one pixel: 289 11 Blob 7 of 34, id: 21, sources: 1, size: 35x43, npix 1002, brick X: 6,41, Y: 288,331, one pixel: 16 288 Blob 8 of 34, id: 13, sources: 1, size: 39x39, npix 987, brick X: 59,98, Y: 112,151, one pixel: 76 112 Blob 9 of 34, id: 27, sources: 2, size: 32x48, npix 959, brick X: 360,392, Y: 355,403, one pixel: 373 355 Blob 10 of 34, id: 11, sources: 1, size: 39x30, npix 732, brick X: 313,352, Y: 100,130, one pixel: 324 100 Blob 11 of 34, id: 5, sources: 1, size: 30x31, npix 618, brick X: 95,125, Y: 42,73, one pixel: 109 42 Blob 12 of 34, id: 18, sources: 2, size: 43x25, npix 592, brick X: 12,55, Y: 242,267, one pixel: 21 242 Blob 13 of 34, id: 20, sources: 1, size: 35x25, npix 583, brick X: 296,331, Y: 281,306, one pixel: 307 281 Blob 14 of 34, id: 0, sources: 2, size: 36x19, npix 498, brick X: 348,384, Y: 0,19, one pixel: 352 0 Blob 15 of 34, id: 25, sources: 1, size: 19x35, npix 475, brick X: 0,19, Y: 324,359, one pixel: 4 324 Blob 16 of 34, id: 22, sources: 1, size: 27x27, npix 471, brick X: 287,314, Y: 303,330, one pixel: 297 303 Blob 17 of 34, id: 19, sources: 1, size: 27x24, npix 395, brick X: 359,386, Y: 257,281, one pixel: 369 257 Measuring 2 iterative sources Blob 11 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 809 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146712 MB Blob 18 of 34, id: 4, sources: 1, size: 25x25, npix 390, brick X: 113,138, Y: 22,47, one pixel: 123 22 Blob 16 finished, total: Wall: 0.69 s, CPU: 0.67 s, VmPeak: 808 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147112 MB Blob 19 of 34, id: 33, sources: 2, size: 30x17, npix 378, brick X: 225,255, Y: 408,425, one pixel: 239 408 Blob 20 of 34, id: 26, sources: 1, size: 24x25, npix 356, brick X: 146,170, Y: 344,369, one pixel: 157 344 Blob 14 finished, total: Wall: 0.86 s, CPU: 0.83 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 97 MB, VmData: 142 MB, maxrss: 0.099052 MB Blob 4 finished, total: Wall: 0.93 s, CPU: 0.90 s, VmPeak: 803 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147304 MB Blob 21 of 34, id: 15, sources: 1, size: 23x23, npix 337, brick X: 35,58, Y: 119,142, one pixel: 46 119 Measuring 1 iterative sources Blob 18 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 808 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147112 MB Blob 22 of 34, id: 29, sources: 1, size: 23x23, npix 327, brick X: 244,267, Y: 369,392, one pixel: 254 369 Measuring 1 iterative sources Blob 6 finished, total: Wall: 1.04 s, CPU: 1.03 s, VmPeak: 810 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.1478 MB Blob 8 finished, total: Wall: 1.04 s, CPU: 1.01 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 97 MB, VmData: 142 MB, maxrss: 0.099008 MB Blob 23 of 34, id: 31, sources: 1, size: 23x23, npix 316, brick X: 33,56, Y: 395,418, one pixel: 42 395 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (263.19681, 48.03751), pm (-15.4, 13.3), parallax 0.684 with NanoMaggies: g=20.7, r=19.6, z=19.1 Reset brightness to NanoMaggies: g=20.5, r=19.7, z=19.3 Blob 19 finished, total: Wall: 0.15 s, CPU: 0.15 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 97 MB, VmData: 142 MB, maxrss: 0.099184 MB Blob 24 of 34, id: 30, sources: 1, size: 24x21, npix 310, brick X: 197,221, Y: 386,407, one pixel: 205 386 Blob 25 of 34, id: 17, sources: 1, size: 18x22, npix 276, brick X: 407,425, Y: 198,220, one pixel: 416 198 Blob 26 of 34, id: 6, sources: 1, size: 22x21, npix 270, brick X: 305,327, Y: 43,64, one pixel: 316 43 Blob 15 finished, total: Wall: 1.19 s, CPU: 1.19 s, VmPeak: 808 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147428 MB Blob 27 of 34, id: 9, sources: 1, size: 21x21, npix 269, brick X: 153,174, Y: 82,103, one pixel: 161 82 Blob 5 finished, total: Wall: 1.23 s, CPU: 1.22 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.098392 MB Blob 28 of 34, id: 12, sources: 1, size: 20x19, npix 236, brick X: 110,130, Y: 105,124, one pixel: 118 105 Blob 10 finished, total: Wall: 1.25 s, CPU: 1.24 s, VmPeak: 808 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147156 MB Blob 29 of 34, id: 3, sources: 1, size: 19x20, npix 208, brick X: 406,425, Y: 17,37, one pixel: 415 17 Blob 13 finished, total: Wall: 1.28 s, CPU: 1.27 s, VmPeak: 814 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.1479 MB Blob 30 of 34, id: 10, sources: 1, size: 20x19, npix 208, brick X: 376,396, Y: 94,113, one pixel: 386 94 Blob 12 finished, total: Wall: 1.31 s, CPU: 1.30 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.09626 MB Blob 31 of 34, id: 2, sources: 1, size: 13x23, npix 192, brick X: 0,13, Y: 12,35, one pixel: 2 12 Blob 26 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.098528 MB Blob 32 of 34, id: 16, sources: 1, size: 18x19, npix 189, brick X: 62,80, Y: 183,202, one pixel: 71 183 Blob 27 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 808 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147156 MB Blob 33 of 34, id: 32, sources: 1, size: 17x17, npix 145, brick X: 305,322, Y: 395,412, one pixel: 313 395 Blob 17 finished, total: Wall: 0.83 s, CPU: 0.83 s, VmPeak: 809 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147528 MB Blob 34 of 34, id: 28, sources: 1, size: 11x18, npix 115, brick X: 414,425, Y: 361,379, one pixel: 422 361 Blob 21 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 808 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147112 MB Blob 30 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.098528 MB Blob 28 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148476 MB Blob 23 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 97 MB, VmData: 142 MB, maxrss: 0.099256 MB Blob 29 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.096396 MB Blob 32 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 809 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147528 MB Blob 20 finished, total: Wall: 0.72 s, CPU: 0.72 s, VmPeak: 803 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148188 MB Blob 22 finished, total: Wall: 0.61 s, CPU: 0.61 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.14846 MB Blob 34 finished, total: Wall: 0.12 s, CPU: 0.12 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.098528 MB Blob 2 finished, total: Wall: 1.72 s, CPU: 1.71 s, VmPeak: 802 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.147992 MB Blob 25 finished, total: Wall: 0.49 s, CPU: 0.49 s, VmPeak: 808 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147428 MB Blob 9 finished, total: Wall: 1.80 s, CPU: 1.80 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 95 MB, VmData: 140 MB, maxrss: 0.0968 MB Blob 24 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 97 MB, VmData: 142 MB, maxrss: 0.09926 MB Blob 33 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 808 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147112 MB Blob 31 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 808 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147156 MB Blob 7 finished, total: Wall: 2.07 s, CPU: 2.05 s, VmPeak: 804 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.14852 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 2.83 s, CPU: 2.82 s, VmPeak: 804 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148592 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.21553, ee1=-0.0985639, ee2=0.0754615 Measuring 2 iterative sources Blob 1 finished, total: Wall: 21.93 s, CPU: 21.92 s, VmPeak: 808 MB, VmSize: 737 MB, VmRSS: 161 MB, VmData: 192 MB, maxrss: 0.177868 MB Old catalog: 65 New catalog: 52 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/metrics/cus/blobs-custom-263199p48021.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/metrics/cus/all-models-custom-263199p48021.fits Stage fitblobs : Wall: 22.35 s, CPU: 0.48 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 256 MB, VmData: 286 MB, maxrss: 0.262276 MB Stage fitblobs finished: 2020-08-07T10:18:17.387784 Resources for stage fitblobs : 49.088 s worker CPU, 49.396 s worker Wall, Wall: 22.352 s, Cores in use: 2.22, Total efficiency (on 16 cores): 13.9 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/PGC2308960-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/PGC2308960-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T10:18:17.406587 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/tmp-legacysurvey-custom-263199p48021-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/tmp-legacysurvey-custom-263199p48021-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/tmp-legacysurvey-custom-263199p48021-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/tmp-legacysurvey-custom-263199p48021-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-resid.jpg Stage coadds : Wall: 16.43 s, CPU: 0.93 s, VmPeak: 1008 MB, VmSize: 1008 MB, VmRSS: 269 MB, VmData: 299 MB, maxrss: 0.275952 MB Stage coadds finished: 2020-08-07T10:18:33.835955 Resources for stage coadds : 8.610 s worker CPU, 9.070 s worker Wall, Wall: 16.431 s, Cores in use: 0.58, Total efficiency (on 16 cores): 3.6 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/PGC2308960-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/PGC2308960-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T10:18:33.922023 Cut to 1 unWISE tiles Reading WISE tile 2632p484 band 2 Reading WISE tile 2632p484 band 1 Reading WISE tile 2632p484 band 4 Reading WISE tile 2632p484 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 814 MB, VmSize: 800 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.209704 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 802 MB, VmSize: 797 MB, VmRSS: 143 MB, VmData: 171 MB, maxrss: 0.204596 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 802 MB, VmSize: 800 MB, VmRSS: 143 MB, VmData: 174 MB, maxrss: 0.204684 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/263/2632p484/unwise-2632p484-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 811 MB, VmSize: 811 MB, VmRSS: 159 MB, VmData: 182 MB, maxrss: 0.206956 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/tmp-legacysurvey-custom-263199p48021-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/tmp-legacysurvey-custom-263199p48021-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 31.40 s, CPU: 0.70 s, VmPeak: 1008 MB, VmSize: 1008 MB, VmRSS: 270 MB, VmData: 299 MB, maxrss: 0.276656 MB Stage wise_forced finished: 2020-08-07T10:19:05.322014 Resources for stage wise_forced : 3.113 s worker CPU, 26.212 s worker Wall, Wall: 31.402 s, Cores in use: 0.12, Total efficiency (on 16 cores): 0.8 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/PGC2308960-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/PGC2308960-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T10:19:05.343496 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/coadd/cus/custom-263199p48021/legacysurvey-custom-263199p48021-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/tractor-i/cus/tractor-custom-263199p48021.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/tractor/cus/tractor-custom-263199p48021.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/tractor/cus/brick-custom-263199p48021.sha256sum Stage writecat : Wall: 2.01 s, CPU: 0.71 s, VmPeak: 1140 MB, VmSize: 1012 MB, VmRSS: 272 MB, VmData: 299 MB, maxrss: 0.40954 MB Stage writecat finished: 2020-08-07T10:19:07.351387 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.010 s, Cores in use: 0.36, Total efficiency (on 16 cores): 2.2 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/PGC2308960-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2308960/PGC2308960-largegalaxy-writecat.p All done: 69.617 s worker CPU, 341.511 s worker Wall, Wall: 219.401 s, Cores in use: 0.36, Total efficiency (on 16 cores): 2.3 % Finished galaxy PGC2308960 in 3.778 minutes.