Started working on galaxy PGC2464760 at Wed Aug 5 22:08:02 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.543405 54.27440260000001 --width 397 --height 397 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/PGC2464760-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/PGC2464760-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T22:08:02.773404 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '273.543405', '54.27440260000001', '--width', '397', '--height', '397', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/PGC2464760-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/PGC2464760-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.543405 54.27440260000001 --width 397 --height 397 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/PGC2464760-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/PGC2464760-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 273.543405 54.27440260000001 Starting process 6864 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 6865 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 6866 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 6867 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 6868 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059472 MB Starting process 6869 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05942 MB Starting process 6870 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05942 MB Starting process 6871 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 6872 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 6873 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 6874 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 6875 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 6877 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 6879 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 6881 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 6883 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T22:08:03.244274 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 13 CCDs: k4m_160531_091834_ooi_zd_ls9-CCD4 z expnum 92486 exptime 80.102 propid 2016A-0453 seeing 0.78 MJD 57539.388 object MzLS_666504_z mosaic/CP/V4.3/CP20160530/k4m_160531_091834_ooi_zd_ls9.fits.fz k4m_160529_092729_ooi_zd_ls9-CCD1 z expnum 92112 exptime 115.103 propid 2016A-0453 seeing 1.37 MJD 57537.394 object MzLS_667238_z mosaic/CP/V4.3/CP20160528/k4m_160529_092729_ooi_zd_ls9.fits.fz k4m_170908_060318_ooi_zd_ls9-CCD2 z expnum 138856 exptime 208.103 propid 2016A-0453 seeing 0.96 MJD 58004.252 object MzLS_665767_z mosaic/CP/V4.3/CP20170907/k4m_170908_060318_ooi_zd_ls9.fits.fz k4m_170603_111903_ooi_zd_ls9-CCD3 z expnum 131536 exptime 84.105 propid 2016A-0453 seeing 0.84 MJD 57907.472 object MzLS_667237_z mosaic/CP/V4.3/CP20170602/k4m_170603_111903_ooi_zd_ls9.fits.fz k4m_171001_031254_ooi_zd_ls9-CCD4 z expnum 141535 exptime 100.106 propid 2016A-0453 seeing 1.04 MJD 58027.134 object MzLS_665766_z mosaic/CP/V4.3/CP20170930/k4m_171001_031254_ooi_zd_ls9.fits.fz ksb_170624_063440_ooi_r_ls9-CCD3 r expnum 79280076 exptime 97.212 propid BASS seeing 1.15 MJD 57928.274 object 31673 90prime/CP/V2.3/CP20170623/ksb_170624_063440_ooi_r_ls9.fits.fz ksb_170523_110302_ooi_g_ls9-CCD3 g expnum 78960194 exptime 151.987 propid 2015A-0801 seeing 1.71 MJD 57896.460 object 31673 90prime/CP/V2.3/CP20170522/ksb_170523_110302_ooi_g_ls9.fits.fz ksb_180515_100952_ooi_g_ls9-CCD1 g expnum 82530152 exptime 86.014 propid NOTBASS seeing 1.41 MJD 58253.424 object 31661 90prime/CP/V2.3/CP20180514/ksb_180515_100952_ooi_g_ls9.fits.fz ksb_170405_112941_ooi_r_ls9-CCD1 r expnum 78480178 exptime 53.962 propid BASS seeing 1.31 MJD 57848.479 object 31661 90prime/CP/V2.3/CP20170404/ksb_170405_112941_ooi_r_ls9.fits.fz ksb_170622_101129_ooi_r_ls9-CCD4 r expnum 79260133 exptime 90.75 propid 2015A-0801 seeing 1.33 MJD 57926.425 object 32743 90prime/CP/V2.3/CP20170621/ksb_170622_101129_ooi_r_ls9.fits.fz ksb_170523_105951_ooi_g_ls9-CCD4 g expnum 78960193 exptime 153.273 propid 2015A-0801 seeing 1.73 MJD 57896.458 object 32743 90prime/CP/V2.3/CP20170522/ksb_170523_105951_ooi_g_ls9.fits.fz ksb_160707_110805_ooi_g_ls9-CCD1 g expnum 75760120 exptime 229.7 propid BASS seeing 1.99 MJD 57576.464 object 31662 90prime/CP/V2.3/CP20160706/ksb_160707_110805_ooi_g_ls9.fits.fz ksb_160713_084447_ooi_r_ls9-CCD1 r expnum 75820096 exptime 90.7 propid BASS seeing 1.52 MJD 57582.364 object 31662 90prime/CP/V2.3/CP20160712/ksb_160713_084447_ooi_r_ls9.fits.fz mosaic get_fwhm: self.fwhm = 3.01 Swapping in SKY_JOHN values for 1 splinesky cells; 44.266907 -> 44.236378 Faked up EXPNUM 75820096 Faked up EXPNUM 75820096 Faked up EXPNUM 75820096 90prime get_fwhm: self.fwhm = 3.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3782 4014 and amp range 2016 4031 and image y 3614 3845 and amp range 2048 4095 Range in image: x 0 233 , y 0 232 (with image size 233 x 232) dzp 0.01301769 -> scaling image by 1.0120619004021345 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 78480178 Faked up EXPNUM 78480178 Faked up EXPNUM 78480178 90prime get_fwhm: self.fwhm = 2.89 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1769 2003 and amp range 0 2015 and image y 1634 1867 and amp range 0 2047 Range in image: x 0 235 , y 0 234 (with image size 235 x 234) dzp -0.024106435 -> scaling image by 0.9780418215011345 Faked up EXPNUM 78960194 Faked up EXPNUM 78960194 Faked up EXPNUM 78960194 90prime get_fwhm: self.fwhm = 3.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 18 77 and amp range 0 2015 and image y 3153 3385 and amp range 2048 4095 Range in image: x 0 60 , y 0 233 (with image size 60 x 233) dzp -0.045992933 -> scaling image by 0.958523636456738 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Found 4 relevant rows in amp-corrections file. Found overlap: image x 7 235 and amp range 0 2047 and image y 468 866 and amp range 0 2021 Range in image: x 0 229 , y 0 399 (with image size 229 x 399) dzp 0.005139143 -> scaling image by 1.0047445456970268 mosaic get_fwhm: self.fwhm = 3.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2524 2932 and amp range 2048 4095 and image y 7 64 and amp range 0 2039 Range in image: x 0 409 , y 0 58 (with image size 409 x 58) dzp -0.012875672 -> scaling image by 0.9882111074411305 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82530152 Faked up EXPNUM 82530152 Faked up EXPNUM 82530152 90prime get_fwhm: self.fwhm = 3.11 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1748 1983 and amp range 0 2015 and image y 1634 1868 and amp range 0 2047 Range in image: x 0 236 , y 0 235 (with image size 236 x 235) dzp -0.030770088 -> scaling image by 0.9720575212609548 Faked up EXPNUM 75760120 Faked up EXPNUM 75760120 Faked up EXPNUM 75760120 90prime get_fwhm: self.fwhm = 4.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3768 3999 and amp range 2016 4031 and image y 3605 3837 and amp range 2048 4095 Range in image: x 0 232 , y 0 233 (with image size 232 x 233) dzp 0.009677861 -> scaling image by 1.0089534840651213 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 79260133 Faked up EXPNUM 79260133 Faked up EXPNUM 79260133 90prime get_fwhm: self.fwhm = 2.93 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3629 3862 and amp range 2016 4031 and image y 2386 2619 and amp range 2048 4095 Range in image: x 0 234 , y 0 234 (with image size 234 x 234) dzp 0.0004463038 -> scaling image by 1.0004111454932232 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 78960193 Faked up EXPNUM 78960193 Faked up EXPNUM 78960193 90prime get_fwhm: self.fwhm = 3.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3641 3873 and amp range 2016 4031 and image y 2398 2630 and amp range 2048 4095 Range in image: x 0 233 , y 0 233 (with image size 233 x 233) dzp -0.0030897402 -> scaling image by 0.9971582894587289 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 79280076 Faked up EXPNUM 79280076 Faked up EXPNUM 79280076 90prime get_fwhm: self.fwhm = 2.55 Found 4 relevant rows in amp-corrections file. Found overlap: image x 18 57 and amp range 0 2015 and image y 3145 3377 and amp range 2048 4095 Range in image: x 0 40 , y 0 233 (with image size 40 x 233) dzp -0.07725406 -> scaling image by 0.9313188157188347 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1401 1806 and amp range 0 2005 and image y 3342 3759 and amp range 2040 4078 Range in image: x 0 406 , y 0 418 (with image size 406 x 418) dzp 0.012956044 -> scaling image by 1.012004439021001 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.01 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2527 2942 and amp range 2048 4095 and image y 3271 3680 and amp range 2022 4060 Range in image: x 0 416 , y 0 410 (with image size 416 x 410) dzp -0.019603321 -> scaling image by 0.9821066946375949 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 5.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1374 1780 and amp range 0 2005 and image y 7 64 and amp range 0 2039 Range in image: x 0 407 , y 0 58 (with image size 407 x 58) dzp -0.011066288 -> scaling image by 0.989859339076806 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 4.78 s, CPU: 0.88 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 181 MB, VmData: 213 MB, maxrss: 0.185736 MB Stage tims finished: 2020-08-05T22:08:08.023597 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 8.735 s worker CPU, 31.852 s worker Wall, Wall: 4.781 s, Cores in use: 2.01, Total efficiency (on 16 cores): 12.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/PGC2464760-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/PGC2464760-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T22:08:08.312376 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01176.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01177.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01276.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01081.fits Matched 5 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/metrics/cus/reference-custom-273543p54274.fits Stage refs : Wall: 17.40 s, CPU: 5.15 s, VmPeak: 1011 MB, VmSize: 1006 MB, VmRSS: 231 MB, VmData: 261 MB, maxrss: 0.23688 MB Stage refs finished: 2020-08-05T22:08:25.714123 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 17.403 s, Cores in use: 0.30, Total efficiency (on 16 cores): 1.9 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/PGC2464760-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/PGC2464760-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T22:08:26.288294 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/metrics/cus/outlier-mask-custom-273543p54274.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/metrics/cus/outliers-pre-custom-273543p54274.jpg Image ksb_160707_110805_ooi_g_ls9-CCD1 g : masking 116 positive outlier pixels and 0 negative outlier pixels Image ksb_170405_112941_ooi_r_ls9-CCD1 r : masking 98 positive outlier pixels and 0 negative outlier pixels Image ksb_170622_101129_ooi_r_ls9-CCD4 r : masking 32 positive outlier pixels and 0 negative outlier pixels Image k4m_160529_092729_ooi_zd_ls9-CCD1 z : masking 113 positive outlier pixels and 0 negative outlier pixels Image k4m_170908_060318_ooi_zd_ls9-CCD2 z : masking 0 positive outlier pixels and 155 negative outlier pixels Image k4m_160531_091834_ooi_zd_ls9-CCD4 z : masking 250 positive outlier pixels and 0 negative outlier pixels Image k4m_170603_111903_ooi_zd_ls9-CCD3 z : masking 953 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/metrics/cus/outlier-mask-custom-273543p54274.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/metrics/cus/outliers-post-custom-273543p54274.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/metrics/cus/outliers-masked-pos-custom-273543p54274.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/metrics/cus/outliers-masked-neg-custom-273543p54274.jpg Stage outliers : Wall: 3.12 s, CPU: 0.91 s, VmPeak: 1015 MB, VmSize: 1015 MB, VmRSS: 259 MB, VmData: 286 MB, maxrss: 0.26562 MB Stage outliers finished: 2020-08-05T22:08:29.412961 Resources for stage outliers : 1.721 s worker CPU, 1.781 s worker Wall, Wall: 3.126 s, Cores in use: 0.84, Total efficiency (on 16 cores): 5.3 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/PGC2464760-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/PGC2464760-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T22:08:29.572052 Stage halos : Wall: 0.27 s, CPU: 0.26 s, VmPeak: 1016 MB, VmSize: 1016 MB, VmRSS: 260 MB, VmData: 287 MB, maxrss: 0.265896 MB Stage halos finished: 2020-08-05T22:08:29.842327 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.272 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/PGC2464760-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/PGC2464760-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T22:08:30.086276 PSF sigmas in coadd pixels: ['2.77', '2.29', '2.81', '3.23'] Using average PSF sigma 2.774560568652364 Gaussian PSF norm 0.1016718809317235 vs pixelized 0.08308366 average tim pixel scale / coadd scale: 1.7295559319020568 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.88', '2.13', '2.16', '2.46'] Using average PSF sigma 2.155761046272266 Gaussian PSF norm 0.13085624321010692 vs pixelized 0.10947883 average tim pixel scale / coadd scale: 1.72903161306638 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.27', '2.22', '1.56', '1.36', '1.69'] Using average PSF sigma 1.6217195091939822 Gaussian PSF norm 0.17394795473237126 vs pixelized 0.14270312 average tim pixel scale / coadd scale: 0.9909087129093649 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.31 s, CPU: 0.30 s, VmPeak: 1016 MB, VmSize: 1016 MB, VmRSS: 263 MB, VmData: 289 MB, maxrss: 0.269688 MB Stage fit_on_coadds finished: 2020-08-05T22:08:30.393117 Resources for stage fit_on_coadds : 0.412 s worker CPU, 0.412 s worker Wall, Wall: 0.308 s, Cores in use: 2.30, Total efficiency (on 16 cores): 14.4 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/PGC2464760-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/PGC2464760-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T22:08:30.805416 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 38 potential peaks Of 38 potential peaks: 14 in veto map, 3 cut by saddle test, 0 cut by aper test, 21 kept SED z : 21 new peaks Found 47 potential peaks Of 47 potential peaks: 43 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 37 potential peaks Of 37 potential peaks: 35 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 89 potential peaks Of 89 potential peaks: 73 in veto map, 9 cut by saddle test, 0 cut by aper test, 7 kept SED Flat : 7 new peaks Found 78 potential peaks Of 78 potential peaks: 67 in veto map, 5 cut by saddle test, 0 cut by aper test, 6 kept SED Red : 6 new peaks Adding 35 new sources Median coadd sky for g : 0.00026689097 Median coadd sky for r : 0.00041354593 Median coadd sky for z : 0.00019107998 Stage srcs : Wall: 0.75 s, CPU: 0.69 s, VmPeak: 1016 MB, VmSize: 1016 MB, VmRSS: 264 MB, VmData: 289 MB, maxrss: 0.27026 MB Stage srcs finished: 2020-08-05T22:08:31.558388 Resources for stage srcs : 0.157 s worker CPU, 0.157 s worker Wall, Wall: 0.754 s, Cores in use: 1.13, Total efficiency (on 16 cores): 7.0 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/PGC2464760-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/PGC2464760-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T22:08:31.669520 Blob 1 of 28, id: 2, sources: 9, size: 190x246, npix 27918, brick X: 110,300, Y: 44,290, one pixel: 171 44 Blob 2 of 28, id: 17, sources: 4, size: 101x61, npix 3187, brick X: 54,155, Y: 256,317, one pixel: 103 256 Blob 3 of 28, id: 20, sources: 2, size: 55x85, npix 2968, brick X: 214,269, Y: 312,397, one pixel: 237 312 Blob 4 of 28, id: 4, sources: 3, size: 55x47, npix 1371, brick X: 73,128, Y: 58,105, one pixel: 82 58 Blob 5 of 28, id: 12, sources: 2, size: 40x62, npix 1351, brick X: 79,119, Y: 161,223, one pixel: 94 161 Blob 6 of 28, id: 18, sources: 2, size: 53x40, npix 1348, brick X: 341,394, Y: 284,324, one pixel: 356 284 Blob 7 of 28, id: 16, sources: 1, size: 46x43, npix 1315, brick X: 1,47, Y: 249,292, one pixel: 23 249 Blob 8 of 28, id: 24, sources: 1, size: 40x42, npix 1125, brick X: 283,323, Y: 328,370, one pixel: 302 328 Blob 9 of 28, id: 26, sources: 2, size: 39x28, npix 675, brick X: 112,151, Y: 369,397, one pixel: 136 369 Blob 10 of 28, id: 22, sources: 1, size: 30x30, npix 626, brick X: 22,52, Y: 318,348, one pixel: 32 318 Blob 11 of 28, id: 0, sources: 1, size: 29x29, npix 535, brick X: 366,395, Y: 13,42, one pixel: 378 13 Blob 12 of 28, id: 9, sources: 1, size: 28x28, npix 514, brick X: 60,88, Y: 133,161, one pixel: 73 133 Blob 13 of 28, id: 14, sources: 1, size: 26x29, npix 496, brick X: 310,336, Y: 213,242, one pixel: 324 213 Blob 14 of 28, id: 15, sources: 1, size: 27x26, npix 430, brick X: 72,99, Y: 238,264, one pixel: 84 238 Blob 15 of 28, id: 6, sources: 1, size: 21x25, npix 311, brick X: 0,21, Y: 109,134, one pixel: 6 109 Blob 16 of 28, id: 11, sources: 1, size: 23x22, npix 309, brick X: 291,314, Y: 155,177, one pixel: 299 155 Blob 17 of 28, id: 1, sources: 1, size: 22x21, npix 271, brick X: 36,58, Y: 41,62, one pixel: 45 41 Blob 18 of 28, id: 21, sources: 1, size: 20x22, npix 259, brick X: 260,280, Y: 313,335, one pixel: 269 313 Blob 14 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 809 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151184 MB Blob 19 of 28, id: 23, sources: 1, size: 20x21, npix 248, brick X: 159,179, Y: 319,340, one pixel: 169 319 Blob 13 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 809 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151168 MB Blob 20 of 28, id: 10, sources: 1, size: 20x20, npix 247, brick X: 320,340, Y: 139,159, one pixel: 328 139 Blob 17 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 809 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151184 MB Blob 21 of 28, id: 25, sources: 1, size: 21x20, npix 240, brick X: 168,189, Y: 346,366, one pixel: 177 346 Blob 18 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 809 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151168 MB Blob 22 of 28, id: 19, sources: 1, size: 19x19, npix 217, brick X: 33,52, Y: 295,314, one pixel: 41 295 Blob 11 finished, total: Wall: 0.63 s, CPU: 0.63 s, VmPeak: 805 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.15152 MB Blob 16 finished, total: Wall: 0.63 s, CPU: 0.62 s, VmPeak: 810 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151608 MB Blob 23 of 28, id: 27, sources: 1, size: 20x17, npix 214, brick X: 350,370, Y: 380,397, one pixel: 359 380 Blob 12 finished, total: Wall: 0.64 s, CPU: 0.63 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.098524 MB Blob 24 of 28, id: 8, sources: 1, size: 19x18, npix 198, brick X: 295,314, Y: 122,140, one pixel: 303 122 Blob 25 of 28, id: 5, sources: 1, size: 19x18, npix 189, brick X: 343,362, Y: 80,98, one pixel: 351 80 Blob 10 finished, total: Wall: 0.72 s, CPU: 0.72 s, VmPeak: 791 MB, VmSize: 719 MB, VmRSS: 135 MB, VmData: 171 MB, maxrss: 0.138124 MB Blob 26 of 28, id: 13, sources: 1, size: 18x19, npix 189, brick X: 38,56, Y: 209,228, one pixel: 46 209 Blob 20 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 809 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151168 MB Blob 27 of 28, id: 7, sources: 1, size: 18x18, npix 180, brick X: 325,343, Y: 110,128, one pixel: 333 110 Blob 22 finished, total: Wall: 0.10 s, CPU: 0.10 s, VmPeak: 810 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151608 MB Blob 28 of 28, id: 3, sources: 1, size: 18x17, npix 162, brick X: 318,336, Y: 55,72, one pixel: 326 55 Blob 15 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 95 MB, VmData: 140 MB, maxrss: 0.097032 MB Blob 24 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 791 MB, VmSize: 719 MB, VmRSS: 135 MB, VmData: 171 MB, maxrss: 0.138124 MB Blob 7 finished, total: Wall: 0.86 s, CPU: 0.85 s, VmPeak: 809 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150284 MB Blob 28 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 791 MB, VmSize: 719 MB, VmRSS: 135 MB, VmData: 171 MB, maxrss: 0.138124 MB Blob 21 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 805 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.15152 MB Measuring 1 iterative sources Blob 27 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 95 MB, VmData: 140 MB, maxrss: 0.097164 MB Blob 25 finished, total: Wall: 0.29 s, CPU: 0.28 s, VmPeak: 809 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151168 MB Blob 6 finished, total: Wall: 1.08 s, CPU: 1.07 s, VmPeak: 805 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.15114 MB Blob 26 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 810 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151608 MB Blob 8 finished, total: Wall: 1.16 s, CPU: 1.14 s, VmPeak: 804 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.15156 MB Blob 9 finished, total: Wall: 1.16 s, CPU: 1.15 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.098516 MB Blob 3 finished, total: Wall: 1.21 s, CPU: 1.20 s, VmPeak: 811 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150808 MB Blob 19 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 809 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151184 MB Blob 23 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.098628 MB Blob 5 finished, total: Wall: 1.37 s, CPU: 1.37 s, VmPeak: 807 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.15132 MB Measuring 1 iterative sources Blob 4 finished, total: Wall: 1.54 s, CPU: 1.53 s, VmPeak: 787 MB, VmSize: 719 MB, VmRSS: 136 MB, VmData: 171 MB, maxrss: 0.139744 MB Measuring 2 iterative sources Blob 2 finished, total: Wall: 2.68 s, CPU: 2.66 s, VmPeak: 807 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151692 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.74301, ee1=0.204249, ee2=0.012091 Measuring 2 iterative sources Blob 1 finished, total: Wall: 13.02 s, CPU: 13.00 s, VmPeak: 809 MB, VmSize: 740 MB, VmRSS: 163 MB, VmData: 192 MB, maxrss: 0.16664 MB Old catalog: 54 New catalog: 41 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/metrics/cus/blobs-custom-273543p54274.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/metrics/cus/all-models-custom-273543p54274.fits Stage fitblobs : Wall: 16.87 s, CPU: 0.51 s, VmPeak: 1016 MB, VmSize: 1016 MB, VmRSS: 264 MB, VmData: 289 MB, maxrss: 0.270616 MB Stage fitblobs finished: 2020-08-05T22:08:48.540187 Resources for stage fitblobs : 31.576 s worker CPU, 32.616 s worker Wall, Wall: 16.873 s, Cores in use: 1.90, Total efficiency (on 16 cores): 11.9 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/PGC2464760-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/PGC2464760-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T22:08:48.625827 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/tmp-legacysurvey-custom-273543p54274-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/tmp-legacysurvey-custom-273543p54274-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/tmp-legacysurvey-custom-273543p54274-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/tmp-legacysurvey-custom-273543p54274-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-resid.jpg Stage coadds : Wall: 4.74 s, CPU: 0.91 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 268 MB, VmData: 292 MB, maxrss: 0.2743 MB Stage coadds finished: 2020-08-05T22:08:53.364370 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 7.220 s worker CPU, 11.394 s worker Wall, Wall: 4.740 s, Cores in use: 1.72, Total efficiency (on 16 cores): 10.7 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/PGC2464760-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/PGC2464760-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T22:08:53.575021 Cut to 1 unWISE tiles Reading WISE tile 2731p545 band 1 Reading WISE tile 2731p545 band 2 Reading WISE tile 2731p545 band 3 Reading WISE tile 2731p545 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 809 MB, VmSize: 809 MB, VmRSS: 151 MB, VmData: 177 MB, maxrss: 0.195996 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 809 MB, VmSize: 806 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.210964 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 811 MB, VmSize: 806 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.210832 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 810 MB, VmSize: 803 MB, VmRSS: 144 MB, VmData: 171 MB, maxrss: 0.207656 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/tmp-legacysurvey-custom-273543p54274-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/tmp-legacysurvey-custom-273543p54274-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 13.05 s, CPU: 0.54 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 268 MB, VmData: 292 MB, maxrss: 0.274824 MB Stage wise_forced finished: 2020-08-05T22:09:06.630034 Resources for stage wise_forced : 3.072 s worker CPU, 5.403 s worker Wall, Wall: 13.057 s, Cores in use: 0.28, Total efficiency (on 16 cores): 1.7 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/PGC2464760-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/PGC2464760-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T22:09:06.842017 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/coadd/cus/custom-273543p54274/legacysurvey-custom-273543p54274-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/tractor-i/cus/tractor-custom-273543p54274.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/tractor/cus/tractor-custom-273543p54274.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/tractor/cus/brick-custom-273543p54274.sha256sum Stage writecat : Wall: 1.35 s, CPU: 0.61 s, VmPeak: 1151 MB, VmSize: 1023 MB, VmRSS: 270 MB, VmData: 292 MB, maxrss: 0.407704 MB Stage writecat finished: 2020-08-05T22:09:08.189183 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.349 s, Cores in use: 0.45, Total efficiency (on 16 cores): 2.8 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/PGC2464760-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2464760/PGC2464760-largegalaxy-writecat.p All done: 52.898 s worker CPU, 83.620 s worker Wall, Wall: 65.077 s, Cores in use: 0.98, Total efficiency (on 16 cores): 6.1 % Finished galaxy PGC2464760 in 1.111 minutes. Started working on galaxy PGC2464760 at Fri Aug 7 10:15:30 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.54285728412634 54.27406393115966 --width 397 --height 397 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/PGC2464760-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/PGC2464760-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T10:15:31.370856 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '273.54285728412634', '54.27406393115966', '--width', '397', '--height', '397', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/PGC2464760-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/PGC2464760-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.54285728412634 54.27406393115966 --width 397 --height 397 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/PGC2464760-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/PGC2464760-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 273.54285728412634 54.27406393115966 Starting process 51048 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 51050 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 51052 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 51054 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 51056 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB Starting process 51058 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB Starting process 51060 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB Starting process 51063 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 51064 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 51066 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 51068 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 51071 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 51073 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 51075 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 51077 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 51078 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T10:15:31.774421 Keeping 13 CCDs: k4m_160531_091834_ooi_zd_ls9-CCD4 z expnum 92486 exptime 80.102 propid 2016A-0453 seeing 0.78 MJD 57539.388 object MzLS_666504_z mosaic/CP/V4.3/CP20160530/k4m_160531_091834_ooi_zd_ls9.fits.fz k4m_160529_092729_ooi_zd_ls9-CCD1 z expnum 92112 exptime 115.103 propid 2016A-0453 seeing 1.37 MJD 57537.394 object MzLS_667238_z mosaic/CP/V4.3/CP20160528/k4m_160529_092729_ooi_zd_ls9.fits.fz k4m_170908_060318_ooi_zd_ls9-CCD2 z expnum 138856 exptime 208.103 propid 2016A-0453 seeing 0.96 MJD 58004.252 object MzLS_665767_z mosaic/CP/V4.3/CP20170907/k4m_170908_060318_ooi_zd_ls9.fits.fz k4m_170603_111903_ooi_zd_ls9-CCD3 z expnum 131536 exptime 84.105 propid 2016A-0453 seeing 0.84 MJD 57907.472 object MzLS_667237_z mosaic/CP/V4.3/CP20170602/k4m_170603_111903_ooi_zd_ls9.fits.fz k4m_171001_031254_ooi_zd_ls9-CCD4 z expnum 141535 exptime 100.106 propid 2016A-0453 seeing 1.04 MJD 58027.134 object MzLS_665766_z mosaic/CP/V4.3/CP20170930/k4m_171001_031254_ooi_zd_ls9.fits.fz ksb_170624_063440_ooi_r_ls9-CCD3 r expnum 79280076 exptime 97.212 propid BASS seeing 1.15 MJD 57928.274 object 31673 90prime/CP/V2.3/CP20170623/ksb_170624_063440_ooi_r_ls9.fits.fz ksb_170523_110302_ooi_g_ls9-CCD3 g expnum 78960194 exptime 151.987 propid 2015A-0801 seeing 1.71 MJD 57896.460 object 31673 90prime/CP/V2.3/CP20170522/ksb_170523_110302_ooi_g_ls9.fits.fz ksb_180515_100952_ooi_g_ls9-CCD1 g expnum 82530152 exptime 86.014 propid NOTBASS seeing 1.41 MJD 58253.424 object 31661 90prime/CP/V2.3/CP20180514/ksb_180515_100952_ooi_g_ls9.fits.fz ksb_170405_112941_ooi_r_ls9-CCD1 r expnum 78480178 exptime 53.962 propid BASS seeing 1.31 MJD 57848.479 object 31661 90prime/CP/V2.3/CP20170404/ksb_170405_112941_ooi_r_ls9.fits.fz ksb_170622_101129_ooi_r_ls9-CCD4 r expnum 79260133 exptime 90.75 propid 2015A-0801 seeing 1.33 MJD 57926.425 object 32743 90prime/CP/V2.3/CP20170621/ksb_170622_101129_ooi_r_ls9.fits.fz ksb_170523_105951_ooi_g_ls9-CCD4 g expnum 78960193 exptime 153.273 propid 2015A-0801 seeing 1.73 MJD 57896.458 object 32743 90prime/CP/V2.3/CP20170522/ksb_170523_105951_ooi_g_ls9.fits.fz ksb_160707_110805_ooi_g_ls9-CCD1 g expnum 75760120 exptime 229.7 propid BASS seeing 1.99 MJD 57576.464 object 31662 90prime/CP/V2.3/CP20160706/ksb_160707_110805_ooi_g_ls9.fits.fz ksb_160713_084447_ooi_r_ls9-CCD1 r expnum 75820096 exptime 90.7 propid BASS seeing 1.52 MJD 57582.364 object 31662 90prime/CP/V2.3/CP20160712/ksb_160713_084447_ooi_r_ls9.fits.fz Faked up EXPNUM 82530152 Faked up EXPNUM 82530152 Faked up EXPNUM 82530152 90prime get_fwhm: self.fwhm = 3.11 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1750 1985 and amp range 0 2015 and image y 1636 1870 and amp range 0 2047 Range in image: x 0 236 , y 0 235 (with image size 236 x 235) dzp -0.030770088 -> scaling image by 0.9720575212609548 Faked up EXPNUM 75760120 Faked up EXPNUM 75760120 Faked up EXPNUM 75760120 90prime get_fwhm: self.fwhm = 4.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3771 4002 and amp range 2016 4031 and image y 3608 3839 and amp range 2048 4095 Range in image: x 0 232 , y 0 232 (with image size 232 x 232) dzp 0.009677861 -> scaling image by 1.0089534840651213 Faked up EXPNUM 78960194 Faked up EXPNUM 78960194 Faked up EXPNUM 78960194 90prime get_fwhm: self.fwhm = 3.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 18 80 and amp range 0 2015 and image y 3156 3388 and amp range 2048 4095 Range in image: x 0 63 , y 0 233 (with image size 63 x 233) dzp -0.045992933 -> scaling image by 0.958523636456738 Faked up EXPNUM 78960193 Faked up EXPNUM 78960193 Faked up EXPNUM 78960193 90prime get_fwhm: self.fwhm = 3.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3643 3876 and amp range 2016 4031 and image y 2401 2633 and amp range 2048 4095 Range in image: x 0 234 , y 0 233 (with image size 234 x 233) dzp -0.0030897402 -> scaling image by 0.9971582894587289 Faked up EXPNUM 79260133 Faked up EXPNUM 79260133 Faked up EXPNUM 79260133 90prime get_fwhm: self.fwhm = 2.93 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3632 3865 and amp range 2016 4031 and image y 2389 2621 and amp range 2048 4095 Range in image: x 0 234 , y 0 233 (with image size 234 x 233) dzp 0.0004463038 -> scaling image by 1.0004111454932232 Faked up EXPNUM 75820096 Faked up EXPNUM 75820096 Faked up EXPNUM 75820096 90prime get_fwhm: self.fwhm = 3.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3785 4016 and amp range 2016 4031 and image y 3617 3848 and amp range 2048 4095 Range in image: x 0 232 , y 0 232 (with image size 232 x 232) dzp 0.01301769 -> scaling image by 1.0120619004021345 Faked up EXPNUM 78480178 Faked up EXPNUM 78480178 Faked up EXPNUM 78480178 90prime get_fwhm: self.fwhm = 2.89 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1771 2006 and amp range 0 2015 and image y 1636 1870 and amp range 0 2047 Range in image: x 0 236 , y 0 235 (with image size 236 x 235) dzp -0.024106435 -> scaling image by 0.9780418215011345 Faked up EXPNUM 79280076 Faked up EXPNUM 79280076 Faked up EXPNUM 79280076 90prime get_fwhm: self.fwhm = 2.55 Found 4 relevant rows in amp-corrections file. Found overlap: image x 18 60 and amp range 0 2015 and image y 3147 3379 and amp range 2048 4095 Range in image: x 0 43 , y 0 233 (with image size 43 x 233) dzp -0.07725406 -> scaling image by 0.9313188157188347 mosaic get_fwhm: self.fwhm = 3.01 Swapping in SKY_JOHN values for 1 splinesky cells; 44.266907 -> 44.236378 mosaic get_fwhm: self.fwhm = 3.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2520 2927 and amp range 2048 4095 and image y 7 59 and amp range 0 2039 Range in image: x 0 408 , y 0 53 (with image size 408 x 53) dzp -0.012875672 -> scaling image by 0.9882111074411305 Found 4 relevant rows in amp-corrections file. Found overlap: image x 7 230 and amp range 0 2047 and image y 463 862 and amp range 0 2021 Range in image: x 0 224 , y 0 400 (with image size 224 x 400) dzp 0.005139143 -> scaling image by 1.0047445456970268 mosaic get_fwhm: self.fwhm = 4.01 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2523 2937 and amp range 2048 4095 and image y 3267 3675 and amp range 2022 4060 Range in image: x 0 415 , y 0 409 (with image size 415 x 409) dzp -0.019603321 -> scaling image by 0.9821066946375949 mosaic get_fwhm: self.fwhm = 5.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1369 1775 and amp range 0 2005 and image y 7 60 and amp range 0 2039 Range in image: x 0 407 , y 0 54 (with image size 407 x 54) dzp -0.011066288 -> scaling image by 0.989859339076806 mosaic get_fwhm: self.fwhm = 3.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1396 1801 and amp range 0 2005 and image y 3338 3754 and amp range 2040 4078 Range in image: x 0 406 , y 0 417 (with image size 406 x 417) dzp 0.012956044 -> scaling image by 1.012004439021001 Stage tims : Wall: 14.08 s, CPU: 0.82 s, VmPeak: 952 MB, VmSize: 952 MB, VmRSS: 179 MB, VmData: 212 MB, maxrss: 0.183064 MB Stage tims finished: 2020-08-07T10:15:45.856569 Resources for stage tims : 7.815 s worker CPU, 97.753 s worker Wall, Wall: 14.084 s, Cores in use: 0.61, Total efficiency (on 16 cores): 3.8 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/PGC2464760-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/PGC2464760-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T10:15:45.890013 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01176.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01177.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01276.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01081.fits Matched 5 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/metrics/cus/reference-custom-273542p54274.fits Stage refs : Wall: 50.73 s, CPU: 3.78 s, VmPeak: 1005 MB, VmSize: 999 MB, VmRSS: 228 MB, VmData: 260 MB, maxrss: 0.233904 MB Stage refs finished: 2020-08-07T10:16:36.622646 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 50.734 s, Cores in use: 0.07, Total efficiency (on 16 cores): 0.5 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/PGC2464760-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/PGC2464760-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T10:16:36.665174 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/metrics/cus/outlier-mask-custom-273542p54274.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/metrics/cus/outliers-pre-custom-273542p54274.jpg Image ksb_160707_110805_ooi_g_ls9-CCD1 g : masking 177 positive outlier pixels and 0 negative outlier pixels Image ksb_170405_112941_ooi_r_ls9-CCD1 r : masking 97 positive outlier pixels and 0 negative outlier pixels Image k4m_170908_060318_ooi_zd_ls9-CCD2 z : masking 0 positive outlier pixels and 141 negative outlier pixels Image k4m_160531_091834_ooi_zd_ls9-CCD4 z : masking 255 positive outlier pixels and 0 negative outlier pixels Image k4m_170603_111903_ooi_zd_ls9-CCD3 z : masking 897 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/metrics/cus/outlier-mask-custom-273542p54274.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/metrics/cus/outliers-post-custom-273542p54274.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/metrics/cus/outliers-masked-pos-custom-273542p54274.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/metrics/cus/outliers-masked-neg-custom-273542p54274.jpg Stage outliers : Wall: 1.30 s, CPU: 0.93 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 260 MB, VmData: 288 MB, maxrss: 0.266016 MB Stage outliers finished: 2020-08-07T10:16:37.964231 Resources for stage outliers : 1.503 s worker CPU, 1.636 s worker Wall, Wall: 1.301 s, Cores in use: 1.87, Total efficiency (on 16 cores): 11.7 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/PGC2464760-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/PGC2464760-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T10:16:37.992621 Stage halos : Wall: 0.35 s, CPU: 0.29 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 260 MB, VmData: 289 MB, maxrss: 0.26638 MB Stage halos finished: 2020-08-07T10:16:38.343336 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.352 s, Cores in use: 0.83, Total efficiency (on 16 cores): 5.2 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/PGC2464760-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/PGC2464760-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T10:16:38.634503 PSF sigmas in coadd pixels: ['2.77', '2.29', '2.81', '3.23'] Using average PSF sigma 2.774560568652364 Gaussian PSF norm 0.1016718809317235 vs pixelized 0.08307646 average tim pixel scale / coadd scale: 1.7295559319020568 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.88', '2.13', '2.16', '2.46'] Using average PSF sigma 2.155761046272266 Gaussian PSF norm 0.13085624321010692 vs pixelized 0.10946582 average tim pixel scale / coadd scale: 1.72903161306638 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.27', '2.22', '1.56', '1.36', '1.69'] Using average PSF sigma 1.6217195091939822 Gaussian PSF norm 0.17394795473237126 vs pixelized 0.14270046 average tim pixel scale / coadd scale: 0.9909087129093649 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.33 s, CPU: 0.32 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 262 MB, VmData: 289 MB, maxrss: 0.267888 MB Stage fit_on_coadds finished: 2020-08-07T10:16:38.963985 Resources for stage fit_on_coadds : 0.394 s worker CPU, 0.394 s worker Wall, Wall: 0.331 s, Cores in use: 2.15, Total efficiency (on 16 cores): 13.4 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/PGC2464760-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/PGC2464760-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T10:16:39.047171 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 40 potential peaks Of 40 potential peaks: 17 in veto map, 3 cut by saddle test, 0 cut by aper test, 20 kept SED z : 20 new peaks Found 49 potential peaks Of 49 potential peaks: 45 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 38 potential peaks Of 38 potential peaks: 36 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 89 potential peaks Of 89 potential peaks: 75 in veto map, 7 cut by saddle test, 0 cut by aper test, 7 kept SED Flat : 7 new peaks Found 76 potential peaks Of 76 potential peaks: 66 in veto map, 4 cut by saddle test, 0 cut by aper test, 6 kept SED Red : 6 new peaks Adding 34 new sources Median coadd sky for g : 0.00025761168 Median coadd sky for r : 0.0003995824 Median coadd sky for z : 0.00014569101 Stage srcs : Wall: 0.80 s, CPU: 0.71 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 262 MB, VmData: 289 MB, maxrss: 0.268372 MB Stage srcs finished: 2020-08-07T10:16:39.849393 Resources for stage srcs : 0.183 s worker CPU, 0.183 s worker Wall, Wall: 0.804 s, Cores in use: 1.11, Total efficiency (on 16 cores): 6.9 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/PGC2464760-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/PGC2464760-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T10:16:40.058515 Blob 1 of 29, id: 3, sources: 8, size: 189x245, npix 27964, brick X: 106,295, Y: 49,294, one pixel: 166 49 Blob 2 of 29, id: 19, sources: 4, size: 100x60, npix 3201, brick X: 50,150, Y: 261,321, one pixel: 98 261 Blob 3 of 29, id: 22, sources: 2, size: 55x80, npix 2862, brick X: 210,265, Y: 317,397, one pixel: 231 317 Blob 4 of 29, id: 5, sources: 3, size: 54x47, npix 1378, brick X: 69,123, Y: 63,110, one pixel: 77 63 Blob 5 of 29, id: 14, sources: 2, size: 40x64, npix 1368, brick X: 75,115, Y: 166,230, one pixel: 89 166 Blob 6 of 29, id: 20, sources: 2, size: 54x41, npix 1343, brick X: 336,390, Y: 288,329, one pixel: 356 288 Blob 7 of 29, id: 18, sources: 1, size: 43x43, npix 1271, brick X: 0,43, Y: 254,297, one pixel: 18 254 Blob 8 of 29, id: 26, sources: 1, size: 39x42, npix 1121, brick X: 279,318, Y: 332,374, one pixel: 299 332 Blob 9 of 29, id: 24, sources: 1, size: 31x31, npix 622, brick X: 17,48, Y: 322,353, one pixel: 29 322 Blob 10 of 29, id: 1, sources: 1, size: 29x30, npix 535, brick X: 361,390, Y: 17,47, one pixel: 374 17 Blob 11 of 29, id: 10, sources: 1, size: 28x28, npix 503, brick X: 56,84, Y: 138,166, one pixel: 67 138 Blob 12 of 29, id: 16, sources: 1, size: 26x28, npix 498, brick X: 305,331, Y: 218,246, one pixel: 318 218 Blob 13 of 29, id: 28, sources: 1, size: 28x23, npix 460, brick X: 119,147, Y: 374,397, one pixel: 130 374 Blob 14 of 29, id: 17, sources: 1, size: 26x25, npix 424, brick X: 68,94, Y: 243,268, one pixel: 79 243 Blob 15 of 29, id: 11, sources: 2, size: 15x28, npix 316, brick X: 382,397, Y: 141,169, one pixel: 392 141 Blob 16 of 29, id: 13, sources: 1, size: 23x22, npix 301, brick X: 287,310, Y: 160,182, one pixel: 295 160 Blob 17 of 29, id: 2, sources: 1, size: 22x22, npix 270, brick X: 32,54, Y: 45,67, one pixel: 42 45 Blob 18 of 29, id: 23, sources: 1, size: 20x22, npix 259, brick X: 256,276, Y: 318,340, one pixel: 264 318 Blob 14 finished, total: Wall: 0.26 s, CPU: 0.25 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147768 MB Blob 19 of 29, id: 12, sources: 1, size: 21x21, npix 240, brick X: 315,336, Y: 143,164, one pixel: 325 143 Blob 17 finished, total: Wall: 0.10 s, CPU: 0.10 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147768 MB Blob 20 of 29, id: 25, sources: 1, size: 21x20, npix 239, brick X: 154,175, Y: 324,344, one pixel: 164 324 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (273.51797, 54.27093), pm (-4.7, 1.7), parallax 1.806 with NanoMaggies: g=22, r=20.6, z=18.4 Reset brightness to NanoMaggies: g=21.8, r=20.4, z=18.5 Blob 15 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 805 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147284 MB Blob 21 of 29, id: 27, sources: 1, size: 20x20, npix 238, brick X: 164,184, Y: 351,371, one pixel: 172 351 Blob 18 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147768 MB Blob 22 of 29, id: 0, sources: 1, size: 21x16, npix 226, brick X: 304,325, Y: 0,16, one pixel: 308 0 Blob 19 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 805 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148276 MB Blob 23 of 29, id: 21, sources: 1, size: 19x19, npix 208, brick X: 29,48, Y: 300,319, one pixel: 37 300 Blob 12 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 807 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146932 MB Blob 24 of 29, id: 9, sources: 1, size: 19x19, npix 199, brick X: 290,309, Y: 126,145, one pixel: 299 126 Blob 10 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 804 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147556 MB Blob 25 of 29, id: 8, sources: 1, size: 17x20, npix 191, brick X: 0,17, Y: 118,138, one pixel: 6 118 Blob 23 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 804 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147556 MB Blob 26 of 29, id: 6, sources: 1, size: 19x18, npix 189, brick X: 338,357, Y: 84,102, one pixel: 347 84 Blob 11 finished, total: Wall: 0.69 s, CPU: 0.67 s, VmPeak: 787 MB, VmSize: 711 MB, VmRSS: 130 MB, VmData: 169 MB, maxrss: 0.133584 MB Blob 27 of 29, id: 7, sources: 1, size: 19x18, npix 189, brick X: 320,339, Y: 114,132, one pixel: 329 114 Blob 16 finished, total: Wall: 0.69 s, CPU: 0.68 s, VmPeak: 805 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148044 MB Blob 9 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147192 MB Blob 28 of 29, id: 4, sources: 1, size: 19x18, npix 180, brick X: 313,332, Y: 59,77, one pixel: 322 59 Blob 29 of 29, id: 15, sources: 1, size: 18x18, npix 171, brick X: 34,52, Y: 214,232, one pixel: 42 214 Blob 24 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 804 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147556 MB Blob 25 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 787 MB, VmSize: 711 MB, VmRSS: 130 MB, VmData: 169 MB, maxrss: 0.133584 MB Blob 21 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 805 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148276 MB Blob 28 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 804 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147556 MB Measuring 1 iterative sources Blob 22 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 807 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146932 MB Blob 7 finished, total: Wall: 0.93 s, CPU: 0.90 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 97 MB, VmData: 142 MB, maxrss: 0.098968 MB Blob 27 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148252 MB Blob 13 finished, total: Wall: 1.01 s, CPU: 1.00 s, VmPeak: 811 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146928 MB Blob 26 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 805 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148044 MB Blob 20 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147768 MB Blob 6 finished, total: Wall: 1.13 s, CPU: 1.12 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 94 MB, VmData: 139 MB, maxrss: 0.096 MB Blob 3 finished, total: Wall: 1.14 s, CPU: 1.13 s, VmPeak: 809 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147048 MB Blob 29 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 787 MB, VmSize: 711 MB, VmRSS: 130 MB, VmData: 169 MB, maxrss: 0.133584 MB Blob 8 finished, total: Wall: 1.27 s, CPU: 1.26 s, VmPeak: 791 MB, VmSize: 711 MB, VmRSS: 131 MB, VmData: 169 MB, maxrss: 0.133728 MB Blob 5 finished, total: Wall: 1.40 s, CPU: 1.40 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148404 MB Measuring 1 iterative sources Blob 4 finished, total: Wall: 1.55 s, CPU: 1.54 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 95 MB, VmData: 140 MB, maxrss: 0.097476 MB Measuring 2 iterative sources Blob 2 finished, total: Wall: 2.61 s, CPU: 2.61 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147884 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.29839, ee1=0.184108, ee2=0.00571132 Measuring 3 iterative sources Blob 1 finished, total: Wall: 21.04 s, CPU: 21.04 s, VmPeak: 809 MB, VmSize: 736 MB, VmRSS: 160 MB, VmData: 191 MB, maxrss: 0.164132 MB Old catalog: 53 New catalog: 39 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/metrics/cus/blobs-custom-273542p54274.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/metrics/cus/all-models-custom-273542p54274.fits Stage fitblobs : Wall: 22.72 s, CPU: 0.50 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 262 MB, VmData: 289 MB, maxrss: 0.268728 MB Stage fitblobs finished: 2020-08-07T10:17:02.778205 Resources for stage fitblobs : 38.879 s worker CPU, 39.121 s worker Wall, Wall: 22.721 s, Cores in use: 1.73, Total efficiency (on 16 cores): 10.8 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/PGC2464760-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/PGC2464760-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T10:17:02.796665 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/tmp-legacysurvey-custom-273542p54274-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/tmp-legacysurvey-custom-273542p54274-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/tmp-legacysurvey-custom-273542p54274-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/tmp-legacysurvey-custom-273542p54274-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-resid.jpg Stage coadds : Wall: 3.70 s, CPU: 0.82 s, VmPeak: 1013 MB, VmSize: 1013 MB, VmRSS: 266 MB, VmData: 292 MB, maxrss: 0.272436 MB Stage coadds finished: 2020-08-07T10:17:06.497117 Resources for stage coadds : 7.238 s worker CPU, 7.751 s worker Wall, Wall: 3.702 s, Cores in use: 2.18, Total efficiency (on 16 cores): 13.6 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/PGC2464760-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/PGC2464760-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T10:17:06.513750 Cut to 1 unWISE tiles Reading WISE tile 2731p545 band 3 Reading WISE tile 2731p545 band 1 Reading WISE tile 2731p545 band 4 Reading WISE tile 2731p545 band 2 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 805 MB, VmSize: 803 MB, VmRSS: 150 MB, VmData: 176 MB, maxrss: 0.193648 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 809 MB, VmSize: 800 MB, VmRSS: 150 MB, VmData: 174 MB, maxrss: 0.212568 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 811 MB, VmSize: 800 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.20714 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2731p545/unwise-2731p545-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 807 MB, VmSize: 800 MB, VmRSS: 150 MB, VmData: 174 MB, maxrss: 0.212512 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/tmp-legacysurvey-custom-273542p54274-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/tmp-legacysurvey-custom-273542p54274-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.19 s, CPU: 0.56 s, VmPeak: 1013 MB, VmSize: 1013 MB, VmRSS: 267 MB, VmData: 292 MB, maxrss: 0.272964 MB Stage wise_forced finished: 2020-08-07T10:17:08.702823 Resources for stage wise_forced : 3.238 s worker CPU, 4.743 s worker Wall, Wall: 2.191 s, Cores in use: 1.73, Total efficiency (on 16 cores): 10.8 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/PGC2464760-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/PGC2464760-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T10:17:08.724785 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/coadd/cus/custom-273542p54274/legacysurvey-custom-273542p54274-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/tractor-i/cus/tractor-custom-273542p54274.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/tractor/cus/tractor-custom-273542p54274.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/tractor/cus/brick-custom-273542p54274.sha256sum Stage writecat : Wall: 0.76 s, CPU: 0.60 s, VmPeak: 1145 MB, VmSize: 1017 MB, VmRSS: 268 MB, VmData: 292 MB, maxrss: 0.405848 MB Stage writecat finished: 2020-08-07T10:17:09.489212 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.766 s, Cores in use: 0.79, Total efficiency (on 16 cores): 4.9 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/PGC2464760-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2464760/PGC2464760-largegalaxy-writecat.p All done: 59.254 s worker CPU, 151.585 s worker Wall, Wall: 97.780 s, Cores in use: 0.70, Total efficiency (on 16 cores): 4.4 % Finished galaxy PGC2464760 in 1.657 minutes.