Started working on galaxy PGC2697718 at Wed Aug 5 20:44:36 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.39250150000004 67.2878571 --width 269 --height 269 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/PGC2697718-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/PGC2697718-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T20:44:38.370077 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.39250150000004', '67.2878571', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/PGC2697718-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/PGC2697718-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.39250150000004 67.2878571 --width 269 --height 269 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/PGC2697718-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/PGC2697718-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 272.39250150000004 67.2878571 Starting process 64037 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 64038 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 64039 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 64040 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 64041 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059476 MB Starting process 64042 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059484 MB Starting process 64043 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059484 MB Starting process 64044 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 64045 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 64046 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 64047 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 64048 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 64049 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 64050 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 64051 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 64052 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T20:44:38.960205 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 11 CCDs: k4m_171002_045924_ooi_zd_ls9-CCD3 z expnum 141824 exptime 103.105 propid 2016A-0453 seeing 1.02 MJD 58028.208 object MzLS_708104_z mosaic/CP/V4.3/CP20171001/k4m_171002_045924_ooi_zd_ls9.fits.fz k4m_180206_115146_ooi_zd_ls9-CCD1 z expnum 160839 exptime 136.106 propid 2016A-0453 seeing 1.09 MJD 58155.494 object MzLS_707618_z mosaic/CP/V4.3/CP20180205/k4m_180206_115146_ooi_zd_ls9.fits.fz k4m_170607_111116_ooi_zd_ls9-CCD1 z expnum 132248 exptime 168.106 propid 2016A-0453 seeing 1.03 MJD 57911.466 object MzLS_707618_z mosaic/CP/V4.3/CP20170606/k4m_170607_111116_ooi_zd_ls9.fits.fz k4m_171126_022436_ooi_zd_ls9-CCD2 z expnum 149146 exptime 128.104 propid 2016A-0453 seeing 0.88 MJD 58083.100 object MzLS_707129_z mosaic/CP/V4.3/CP20171125/k4m_171126_022436_ooi_zd_ls9.fits.fz ksb_180416_102639_ooi_g_ls9-CCD2 g expnum 82240142 exptime 249.4 propid BASS seeing 1.66 MJD 58224.435 object 44773 90prime/CP/V2.3/CP20180415/ksb_180416_102639_ooi_g_ls9.fits.fz ksb_180521_093049_ooi_r_ls9-CCD2 r expnum 82590119 exptime 101.393 propid NOTBASS seeing 1.93 MJD 58259.396 object 44773 90prime/CP/V2.3/CP20180520/ksb_180521_093049_ooi_r_ls9.fits.fz ksb_180521_094010_ooi_r_ls9-CCD4 r expnum 82590123 exptime 165.5 propid NOTBASS seeing 2.34 MJD 58259.403 object 44783 90prime/CP/V2.3/CP20180520/ksb_180521_094010_ooi_r_ls9.fits.fz ksb_180517_094715_ooi_g_ls9-CCD1 g expnum 82550136 exptime 105.647 propid NOTBASS seeing 1.60 MJD 58255.408 object 43982 90prime/CP/V2.3/CP20180516/ksb_180517_094715_ooi_g_ls9.fits.fz ksb_180522_093250_ooi_r_ls9-CCD1 r expnum 82600078 exptime 119.424 propid NOTBASS seeing 1.37 MJD 58260.398 object 43982 90prime/CP/V2.3/CP20180521/ksb_180522_093250_ooi_r_ls9.fits.fz ksb_180516_073452_ooi_g_ls9-CCD1 g expnum 82540108 exptime 137.97 propid NOTBASS seeing 1.63 MJD 58254.316 object 43981 90prime/CP/V2.3/CP20180515/ksb_180516_073452_ooi_g_ls9.fits.fz ksb_180510_102808_ooi_r_ls9-CCD1 r expnum 82480179 exptime 94.544 propid NOTBASS seeing 1.25 MJD 58248.436 object 43981 90prime/CP/V2.3/CP20180509/ksb_180510_102808_ooi_r_ls9.fits.fz Faked up EXPNUM 82590119 Faked up EXPNUM 82590119 Faked up EXPNUM 82590119 90prime get_fwhm: self.fwhm = 4.25 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3465 3626 and amp range 2016 4031 and image y 327 490 and amp range 0 2047 Range in image: x 0 162 , y 0 164 (with image size 162 x 164) dzp 0.014483032 -> scaling image by 1.0134287315188357 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82550136 Faked up EXPNUM 82550136 Faked up EXPNUM 82550136 90prime get_fwhm: self.fwhm = 3.53 Found 4 relevant rows in amp-corrections file. Faked up EXPNUM 82480179 Faked up EXPNUM 82480179 Faked up EXPNUM 82480179 90prime get_fwhm: self.fwhm = 2.75 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1720 1880 and amp range 0 2015 and image y 1922 2081 and amp range 0 2047 Range in image: x 0 161 , y 0 126 (with image size 161 x 160) Found overlap: image x 3710 3868 and amp range 2016 4031 and image y 3866 4023 and amp range 2048 4095 dzp -0.04811793 -> scaling image by 0.9566494556405901 Range in image: x 0 159 , y 0 158 (with image size 159 x 158) dzp 0.016257986 -> scaling image by 1.01508683329102 Found overlap: image x 1720 1880 and amp range 0 2015 and image y 1922 2081 and amp range 2048 4095 Range in image: x 0 161 , y 126 160 (with image size 161 x 160) dzp -0.05213645 -> scaling image by 0.953115252660837 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.95 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2999 3269 and amp range 2006 4053 and image y 2223 2494 and amp range 2040 4078 Range in image: x 0 271 , y 0 272 (with image size 271 x 272) dzp 0.012593497 -> scaling image by 1.0116665687010755 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82240142 Faked up EXPNUM 82240142 Faked up EXPNUM 82240142 90prime get_fwhm: self.fwhm = 3.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3438 3599 and amp range 2016 4031 and image y 349 512 and amp range 0 2047 Range in image: x 0 162 , y 0 164 (with image size 162 x 164) dzp 0.009189803 -> scaling image by 1.0085000434534261 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82540108 Faked up EXPNUM 82540108 Faked up EXPNUM 82540108 90prime get_fwhm: self.fwhm = 3.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1698 1858 and amp range 0 2015 and image y 1916 2076 and amp range 0 2047 Range in image: x 0 161 , y 0 132 (with image size 161 x 161) dzp -0.030770088 -> scaling image by 0.9720575212609548 Found overlap: image x 1698 1858 and amp range 0 2015 and image y 1916 2076 and amp range 2048 4095 Range in image: x 0 161 , y 132 161 (with image size 161 x 161) dzp -0.031697065 -> scaling image by 0.9712279547101786 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82590123 Faked up EXPNUM 82590123 Faked up EXPNUM 82590123 90prime get_fwhm: self.fwhm = 5.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3587 3744 and amp range 2016 4031 and image y 4037 4080 and amp range 2048 4095 Range in image: x 0 158 , y 0 44 (with image size 158 x 44) dzp 0.044050463 -> scaling image by 1.0414062625929388 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82600078 Faked up EXPNUM 82600078 Faked up EXPNUM 82600078 90prime get_fwhm: self.fwhm = 3.03 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3716 3874 and amp range 2016 4031 and image y 3848 4006 and amp range 2048 4095 Range in image: x 0 159 , y 0 159 (with image size 159 x 159) dzp 0.015744466 -> scaling image by 1.0146068417155982 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1432 1705 and amp range 0 2047 and image y 3696 3967 and amp range 2040 4078 Range in image: x 0 274 , y 0 272 (with image size 274 x 272) dzp 0.003927584 -> scaling image by 1.0036239891963392 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.93 Found 4 relevant rows in amp-corrections file. Found overlap: image x 297 574 and amp range 0 2005 and image y 186 460 and amp range 0 2039 Range in image: x 0 278 , y 0 275 (with image size 278 x 275) dzp 0.0014252509 -> scaling image by 1.0013135665633692 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.21 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3003 3273 and amp range 2006 4053 and image y 2298 2569 and amp range 2040 4078 Range in image: x 0 271 , y 0 272 (with image size 271 x 272) dzp 0.0036595785 -> scaling image by 1.003376283213225 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 18.73 s, CPU: 0.90 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 177 MB, VmData: 209 MB, maxrss: 0.1808 MB Stage tims finished: 2020-08-05T20:44:57.689911 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 6.153 s worker CPU, 61.193 s worker Wall, Wall: 18.731 s, Cores in use: 0.38, Total efficiency (on 16 cores): 2.4 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/PGC2697718-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/PGC2697718-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T20:44:57.712139 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00528.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00465.fits Matched 5 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/metrics/cus/reference-custom-272392p67287.fits Stage refs : Wall: 7.61 s, CPU: 3.28 s, VmPeak: 997 MB, VmSize: 992 MB, VmRSS: 211 MB, VmData: 243 MB, maxrss: 0.21638 MB Stage refs finished: 2020-08-05T20:45:05.324718 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.614 s, Cores in use: 0.43, Total efficiency (on 16 cores): 2.7 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/PGC2697718-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/PGC2697718-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T20:45:05.357472 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/metrics/cus/outlier-mask-custom-272392p67287.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/metrics/cus/outliers-pre-custom-272392p67287.jpg Image ksb_180516_073452_ooi_g_ls9-CCD1 g : masking 97 positive outlier pixels and 0 negative outlier pixels Image ksb_180521_093049_ooi_r_ls9-CCD2 r : masking 92 positive outlier pixels and 0 negative outlier pixels Image k4m_171002_045924_ooi_zd_ls9-CCD3 z : masking 116 positive outlier pixels and 0 negative outlier pixels Image k4m_171126_022436_ooi_zd_ls9-CCD2 z : masking 74 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/metrics/cus/outlier-mask-custom-272392p67287.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/metrics/cus/outliers-post-custom-272392p67287.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/metrics/cus/outliers-masked-pos-custom-272392p67287.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/metrics/cus/outliers-masked-neg-custom-272392p67287.jpg Stage outliers : Wall: 1.20 s, CPU: 0.91 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 227 MB, VmData: 256 MB, maxrss: 0.232952 MB Stage outliers finished: 2020-08-05T20:45:06.560627 Resources for stage outliers : 0.900 s worker CPU, 1.025 s worker Wall, Wall: 1.204 s, Cores in use: 1.51, Total efficiency (on 16 cores): 9.4 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/PGC2697718-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/PGC2697718-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T20:45:06.628665 Stage halos : Wall: 0.56 s, CPU: 0.55 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 228 MB, VmData: 256 MB, maxrss: 0.23324 MB Stage halos finished: 2020-08-05T20:45:07.184066 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.557 s, Cores in use: 0.99, Total efficiency (on 16 cores): 6.2 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/PGC2697718-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/PGC2697718-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T20:45:07.297219 PSF sigmas in coadd pixels: ['2.69', '2.60', '2.64'] Using average PSF sigma 2.643264355222866 Gaussian PSF norm 0.10672212607735689 vs pixelized 0.087080956 average tim pixel scale / coadd scale: 1.7302669540317799 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-copsf-g.fits.fz PSF sigmas in coadd pixels: ['3.13', '3.79', '2.23', '2.02'] Using average PSF sigma 2.794545623207767 Gaussian PSF norm 0.10094477951305403 vs pixelized 0.0786043 average tim pixel scale / coadd scale: 1.7303630299972839 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.66', '1.78', '1.67', '1.43'] Using average PSF sigma 1.6320073849138772 Gaussian PSF norm 0.17285141867710643 vs pixelized 0.1372521 average tim pixel scale / coadd scale: 0.9910154362113165 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.19 s, CPU: 0.17 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 229 MB, VmData: 256 MB, maxrss: 0.234836 MB Stage fit_on_coadds finished: 2020-08-05T20:45:07.490977 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.217 s worker CPU, 0.217 s worker Wall, Wall: 0.195 s, Cores in use: 2.00, Total efficiency (on 16 cores): 12.5 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/PGC2697718-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/PGC2697718-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T20:45:07.504590 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 25 potential peaks Of 25 potential peaks: 10 in veto map, 1 cut by saddle test, 0 cut by aper test, 14 kept SED z : 14 new peaks Found 22 potential peaks Of 22 potential peaks: 18 in veto map, 3 cut by saddle test, 1 cut by aper test, 0 kept SED r : 0 new peaks Found 20 potential peaks Of 20 potential peaks: 17 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 30 potential peaks Of 30 potential peaks: 24 in veto map, 1 cut by saddle test, 0 cut by aper test, 5 kept SED Flat : 5 new peaks Found 34 potential peaks Of 34 potential peaks: 30 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 21 new sources Median coadd sky for g : 0.00012823654 Median coadd sky for r : 0.00019806404 Median coadd sky for z : -1.5761882e-05 Stage srcs : Wall: 0.78 s, CPU: 0.73 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 230 MB, VmData: 256 MB, maxrss: 0.235336 MB Stage srcs finished: 2020-08-05T20:45:08.285375 Resources for stage srcs : 0.078 s worker CPU, 0.078 s worker Wall, Wall: 0.782 s, Cores in use: 1.03, Total efficiency (on 16 cores): 6.5 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/PGC2697718-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/PGC2697718-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T20:45:08.300831 Blob 1 of 18, id: 7, sources: 10, size: 128x149, npix 13209, brick X: 73,201, Y: 66,215, one pixel: 116 66 Blob 2 of 18, id: 0, sources: 2, size: 59x41, npix 1715, brick X: 31,90, Y: 0,41, one pixel: 57 0 Blob 3 of 18, id: 11, sources: 1, size: 45x39, npix 1148, brick X: 12,57, Y: 151,190, one pixel: 28 151 Blob 4 of 18, id: 15, sources: 1, size: 41x34, npix 953, brick X: 202,243, Y: 224,258, one pixel: 220 224 Blob 5 of 18, id: 2, sources: 1, size: 35x37, npix 917, brick X: 234,269, Y: 14,51, one pixel: 250 14 Blob 6 of 18, id: 10, sources: 1, size: 32x33, npix 711, brick X: 41,73, Y: 110,143, one pixel: 55 110 Blob 7 of 18, id: 17, sources: 1, size: 31x28, npix 708, brick X: 0,31, Y: 241,269, one pixel: 7 241 Blob 8 of 18, id: 16, sources: 2, size: 37x29, npix 644, brick X: 106,143, Y: 234,263, one pixel: 128 234 Blob 9 of 18, id: 9, sources: 1, size: 29x29, npix 557, brick X: 200,229, Y: 103,132, one pixel: 214 103 Blob 10 of 18, id: 4, sources: 1, size: 23x23, npix 328, brick X: 6,29, Y: 31,54, one pixel: 16 31 Blob 11 of 18, id: 13, sources: 1, size: 21x23, npix 301, brick X: 46,67, Y: 209,232, one pixel: 56 209 Blob 12 of 18, id: 8, sources: 1, size: 19x19, npix 217, brick X: 42,61, Y: 84,103, one pixel: 50 84 Blob 13 of 18, id: 6, sources: 1, size: 20x19, npix 209, brick X: 172,192, Y: 42,61, one pixel: 180 42 Blob 14 of 18, id: 14, sources: 1, size: 19x19, npix 208, brick X: 181,200, Y: 222,241, one pixel: 189 222 Blob 15 of 18, id: 12, sources: 1, size: 16x20, npix 203, brick X: 253,269, Y: 189,209, one pixel: 261 189 Blob 16 of 18, id: 3, sources: 1, size: 18x19, npix 189, brick X: 96,114, Y: 28,47, one pixel: 104 28 Blob 17 of 18, id: 1, sources: 1, size: 21x13, npix 181, brick X: 132,153, Y: 0,13, one pixel: 133 0 Blob 18 of 18, id: 5, sources: 1, size: 18x17, npix 162, brick X: 111,129, Y: 37,54, one pixel: 119 37 Blob 13 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 88 MB, VmData: 139 MB, maxrss: 0.09036 MB Blob 14 finished, total: Wall: 0.08 s, CPU: 0.07 s, VmPeak: 811 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150964 MB Blob 18 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 811 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150964 MB Blob 17 finished, total: Wall: 0.11 s, CPU: 0.11 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 88 MB, VmData: 139 MB, maxrss: 0.09036 MB Blob 11 finished, total: Wall: 0.28 s, CPU: 0.27 s, VmPeak: 803 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150588 MB Blob 12 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 805 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.15064 MB Blob 16 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 94 MB, VmData: 141 MB, maxrss: 0.096152 MB Blob 9 finished, total: Wall: 0.44 s, CPU: 0.44 s, VmPeak: 804 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150664 MB Blob 15 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.094508 MB Blob 8 finished, total: Wall: 0.60 s, CPU: 0.59 s, VmPeak: 809 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149988 MB Blob 6 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095212 MB Measuring 1 iterative sources Blob 5 finished, total: Wall: 0.72 s, CPU: 0.72 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150724 MB Blob 3 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150804 MB Blob 10 finished, total: Wall: 0.83 s, CPU: 0.83 s, VmPeak: 810 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150924 MB Blob 7 finished, total: Wall: 0.93 s, CPU: 0.92 s, VmPeak: 810 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.151032 MB Blob 4 finished, total: Wall: 1.11 s, CPU: 1.11 s, VmPeak: 802 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151284 MB Blob 2 finished, total: Wall: 1.23 s, CPU: 1.22 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097192 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.14924, ee1=-0.0358716, ee2=-0.411335 Measuring 1 iterative sources Blob 1 finished, total: Wall: 7.67 s, CPU: 7.66 s, VmPeak: 811 MB, VmSize: 732 MB, VmRSS: 151 MB, VmData: 184 MB, maxrss: 0.154332 MB Old catalog: 33 New catalog: 26 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/metrics/cus/blobs-custom-272392p67287.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/metrics/cus/all-models-custom-272392p67287.fits Stage fitblobs : Wall: 8.20 s, CPU: 0.52 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 230 MB, VmData: 256 MB, maxrss: 0.235756 MB Stage fitblobs finished: 2020-08-05T20:45:16.505487 Resources for stage fitblobs : 16.896 s worker CPU, 17.035 s worker Wall, Wall: 8.206 s, Cores in use: 2.12, Total efficiency (on 16 cores): 13.3 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/PGC2697718-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/PGC2697718-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T20:45:16.525163 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/tmp-legacysurvey-custom-272392p67287-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/tmp-legacysurvey-custom-272392p67287-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/tmp-legacysurvey-custom-272392p67287-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/tmp-legacysurvey-custom-272392p67287-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-resid.jpg Stage coadds : Wall: 2.97 s, CPU: 0.98 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 231 MB, VmData: 256 MB, maxrss: 0.236208 MB Stage coadds finished: 2020-08-05T20:45:19.493666 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 7.922 s worker CPU, 12.350 s worker Wall, Wall: 2.970 s, Cores in use: 3.00, Total efficiency (on 16 cores): 18.7 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/PGC2697718-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/PGC2697718-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T20:45:19.528996 Cut to 1 unWISE tiles Reading WISE tile 2709p666 band 1 Reading WISE tile 2709p666 band 2 Reading WISE tile 2709p666 band 3 Reading WISE tile 2709p666 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 812 MB, VmSize: 803 MB, VmRSS: 144 MB, VmData: 171 MB, maxrss: 0.207152 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 807 MB, VmSize: 807 MB, VmRSS: 148 MB, VmData: 175 MB, maxrss: 0.191072 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 811 MB, VmSize: 804 MB, VmRSS: 146 MB, VmData: 172 MB, maxrss: 0.210668 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 808 MB, VmSize: 805 MB, VmRSS: 146 MB, VmData: 173 MB, maxrss: 0.209736 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/tmp-legacysurvey-custom-272392p67287-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/tmp-legacysurvey-custom-272392p67287-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.54 s, CPU: 0.86 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 231 MB, VmData: 256 MB, maxrss: 0.236912 MB Stage wise_forced finished: 2020-08-05T20:45:22.064963 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.328 s worker CPU, 5.262 s worker Wall, Wall: 2.537 s, Cores in use: 1.65, Total efficiency (on 16 cores): 10.3 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/PGC2697718-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/PGC2697718-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T20:45:22.079066 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/coadd/cus/custom-272392p67287/legacysurvey-custom-272392p67287-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/tractor-i/cus/tractor-custom-272392p67287.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/tractor/cus/tractor-custom-272392p67287.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/tractor/cus/brick-custom-272392p67287.sha256sum Stage writecat : Wall: 0.72 s, CPU: 0.55 s, VmPeak: 1133 MB, VmSize: 1005 MB, VmRSS: 233 MB, VmData: 256 MB, maxrss: 0.369792 MB Stage writecat finished: 2020-08-05T20:45:22.797415 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.720 s, Cores in use: 0.76, Total efficiency (on 16 cores): 4.8 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/PGC2697718-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2697718/PGC2697718-largegalaxy-writecat.p All done: 35.497 s worker CPU, 97.165 s worker Wall, Wall: 43.856 s, Cores in use: 1.03, Total efficiency (on 16 cores): 6.4 % Finished galaxy PGC2697718 in 0.780 minutes. Started working on galaxy PGC2697718 at Fri Aug 7 09:29:29 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.39043863375275 67.28752579920312 --width 269 --height 269 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T09:29:30.371131 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.39043863375275', '67.28752579920312', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.39043863375275 67.28752579920312 --width 269 --height 269 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 272.39043863375275 67.28752579920312 Starting process 33041 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 33042 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 33043 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 33044 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 33045 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05932 MB Starting process 33046 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059328 MB Starting process 33047 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059328 MB Starting process 33048 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 33049 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 33050 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 33051 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 33052 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 33053 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 33054 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 33055 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 33056 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T09:29:30.800540 Keeping 11 CCDs: k4m_171002_045924_ooi_zd_ls9-CCD3 z expnum 141824 exptime 103.105 propid 2016A-0453 seeing 1.02 MJD 58028.208 object MzLS_708104_z mosaic/CP/V4.3/CP20171001/k4m_171002_045924_ooi_zd_ls9.fits.fz k4m_180206_115146_ooi_zd_ls9-CCD1 z expnum 160839 exptime 136.106 propid 2016A-0453 seeing 1.09 MJD 58155.494 object MzLS_707618_z mosaic/CP/V4.3/CP20180205/k4m_180206_115146_ooi_zd_ls9.fits.fz k4m_170607_111116_ooi_zd_ls9-CCD1 z expnum 132248 exptime 168.106 propid 2016A-0453 seeing 1.03 MJD 57911.466 object MzLS_707618_z mosaic/CP/V4.3/CP20170606/k4m_170607_111116_ooi_zd_ls9.fits.fz k4m_171126_022436_ooi_zd_ls9-CCD2 z expnum 149146 exptime 128.104 propid 2016A-0453 seeing 0.88 MJD 58083.100 object MzLS_707129_z mosaic/CP/V4.3/CP20171125/k4m_171126_022436_ooi_zd_ls9.fits.fz ksb_180416_102639_ooi_g_ls9-CCD2 g expnum 82240142 exptime 249.4 propid BASS seeing 1.66 MJD 58224.435 object 44773 90prime/CP/V2.3/CP20180415/ksb_180416_102639_ooi_g_ls9.fits.fz ksb_180521_093049_ooi_r_ls9-CCD2 r expnum 82590119 exptime 101.393 propid NOTBASS seeing 1.93 MJD 58259.396 object 44773 90prime/CP/V2.3/CP20180520/ksb_180521_093049_ooi_r_ls9.fits.fz ksb_180521_094010_ooi_r_ls9-CCD4 r expnum 82590123 exptime 165.5 propid NOTBASS seeing 2.34 MJD 58259.403 object 44783 90prime/CP/V2.3/CP20180520/ksb_180521_094010_ooi_r_ls9.fits.fz ksb_180517_094715_ooi_g_ls9-CCD1 g expnum 82550136 exptime 105.647 propid NOTBASS seeing 1.60 MJD 58255.408 object 43982 90prime/CP/V2.3/CP20180516/ksb_180517_094715_ooi_g_ls9.fits.fz ksb_180522_093250_ooi_r_ls9-CCD1 r expnum 82600078 exptime 119.424 propid NOTBASS seeing 1.37 MJD 58260.398 object 43982 90prime/CP/V2.3/CP20180521/ksb_180522_093250_ooi_r_ls9.fits.fz ksb_180516_073452_ooi_g_ls9-CCD1 g expnum 82540108 exptime 137.97 propid NOTBASS seeing 1.63 MJD 58254.316 object 43981 90prime/CP/V2.3/CP20180515/ksb_180516_073452_ooi_g_ls9.fits.fz ksb_180510_102808_ooi_r_ls9-CCD1 r expnum 82480179 exptime 94.544 propid NOTBASS seeing 1.25 MJD 58248.436 object 43981 90prime/CP/V2.3/CP20180509/ksb_180510_102808_ooi_r_ls9.fits.fz mosaic get_fwhm: self.fwhm = 3.93 Found 4 relevant rows in amp-corrections file. Found overlap: image x 292 569 and amp range 0 2005 and image y 175 449 and amp range 0 2039 Range in image: x 0 278 , y 0 275 (with image size 278 x 275) dzp 0.0014252509 -> scaling image by 1.0013135665633692 mosaic get_fwhm: self.fwhm = 3.95 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2994 3265 and amp range 2006 4053 and image y 2212 2483 and amp range 2040 4078 Range in image: x 0 272 , y 0 272 (with image size 272 x 272) dzp 0.012593497 -> scaling image by 1.0116665687010755 mosaic get_fwhm: self.fwhm = 3.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1428 1700 and amp range 0 2047 and image y 3685 3956 and amp range 2040 4078 Range in image: x 0 273 , y 0 272 (with image size 273 x 272) dzp 0.003927584 -> scaling image by 1.0036239891963392 mosaic get_fwhm: self.fwhm = 4.21 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2999 3269 and amp range 2006 4053 and image y 2287 2558 and amp range 2040 4078 Range in image: x 0 271 , y 0 272 (with image size 271 x 272) dzp 0.0036595785 -> scaling image by 1.003376283213225 Faked up EXPNUM 82590123 Faked up EXPNUM 82590123 Faked up EXPNUM 82590123 90prime get_fwhm: self.fwhm = 5.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3589 3747 and amp range 2016 4031 and image y 4037 4080 and amp range 2048 4095 Range in image: x 0 159 , y 0 44 (with image size 159 x 44) dzp 0.044050463 -> scaling image by 1.0414062625929388 Faked up EXPNUM 82600078 Faked up EXPNUM 82600078 Faked up EXPNUM 82600078 90prime get_fwhm: self.fwhm = 3.03 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3719 3877 and amp range 2016 4031 and image y 3855 4012 and amp range 2048 4095 Range in image: x 0 159 , y 0 158 (with image size 159 x 158) dzp 0.015744466 -> scaling image by 1.0146068417155982 Faked up EXPNUM 82590119 Faked up EXPNUM 82590119 Faked up EXPNUM 82590119 90prime get_fwhm: self.fwhm = 4.25 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3467 3629 and amp range 2016 4031 and image y 333 496 and amp range 0 2047 Range in image: x 0 163 , y 0 164 (with image size 163 x 164) dzp 0.014483032 -> scaling image by 1.0134287315188357 Faked up EXPNUM 82550136 Faked up EXPNUM 82550136 Faked up EXPNUM 82550136 90prime get_fwhm: self.fwhm = 3.53 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3713 3870 and amp range 2016 4031 and image y 3872 4029 and amp range 2048 4095 Range in image: x 0 158 , y 0 158 (with image size 158 x 158) dzp 0.016257986 -> scaling image by 1.01508683329102 Faked up EXPNUM 82480179 Faked up EXPNUM 82480179 Faked up EXPNUM 82480179 90prime get_fwhm: self.fwhm = 2.75 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1723 1883 and amp range 0 2015 and image y 1928 2087 and amp range 0 2047 Range in image: x 0 161 , y 0 120 (with image size 161 x 160) dzp -0.04811793 -> scaling image by 0.9566494556405901 Found overlap: image x 1723 1883 and amp range 0 2015 and image y 1928 2087 and amp range 2048 4095 Range in image: x 0 161 , y 120 160 (with image size 161 x 160) dzp -0.05213645 -> scaling image by 0.953115252660837 Faked up EXPNUM 82540108 Faked up EXPNUM 82540108 Faked up EXPNUM 82540108 90prime get_fwhm: self.fwhm = 3.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1700 1861 and amp range 0 2015 and image y 1923 2082 and amp range 0 2047 Range in image: x 0 162 , y 0 125 (with image size 162 x 160) dzp -0.030770088 -> scaling image by 0.9720575212609548 Found overlap: image x 1700 1861 and amp range 0 2015 and image y 1923 2082 and amp range 2048 4095 Range in image: x 0 162 , y 125 160 (with image size 162 x 160) dzp -0.031697065 -> scaling image by 0.9712279547101786 Faked up EXPNUM 82240142 Faked up EXPNUM 82240142 Faked up EXPNUM 82240142 90prime get_fwhm: self.fwhm = 3.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3441 3602 and amp range 2016 4031 and image y 355 518 and amp range 0 2047 Range in image: x 0 162 , y 0 164 (with image size 162 x 164) dzp 0.009189803 -> scaling image by 1.0085000434534261 Stage tims : Wall: 61.95 s, CPU: 0.86 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.178428 MB Stage tims finished: 2020-08-07T09:30:32.750538 Resources for stage tims : 5.747 s worker CPU, 286.543 s worker Wall, Wall: 61.952 s, Cores in use: 0.11, Total efficiency (on 16 cores): 0.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T09:30:32.775353 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00528.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00465.fits Matched 5 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/metrics/cus/reference-custom-272390p67287.fits Stage refs : Wall: 3.34 s, CPU: 3.03 s, VmPeak: 990 MB, VmSize: 985 MB, VmRSS: 209 MB, VmData: 242 MB, maxrss: 0.21396 MB Stage refs finished: 2020-08-07T09:30:36.114955 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.341 s, Cores in use: 0.91, Total efficiency (on 16 cores): 5.7 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T09:30:36.157417 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/metrics/cus/outlier-mask-custom-272390p67287.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/metrics/cus/outliers-pre-custom-272390p67287.jpg Image ksb_180416_102639_ooi_g_ls9-CCD2 g : masking 74 positive outlier pixels and 0 negative outlier pixels Image ksb_180516_073452_ooi_g_ls9-CCD1 g : masking 100 positive outlier pixels and 0 negative outlier pixels Image k4m_171002_045924_ooi_zd_ls9-CCD3 z : masking 120 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/metrics/cus/outlier-mask-custom-272390p67287.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/metrics/cus/outliers-post-custom-272390p67287.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/metrics/cus/outliers-masked-pos-custom-272390p67287.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/metrics/cus/outliers-masked-neg-custom-272390p67287.jpg Stage outliers : Wall: 0.89 s, CPU: 0.58 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 226 MB, VmData: 256 MB, maxrss: 0.231224 MB Stage outliers finished: 2020-08-07T09:30:37.049495 Resources for stage outliers : 0.839 s worker CPU, 0.955 s worker Wall, Wall: 0.893 s, Cores in use: 1.58, Total efficiency (on 16 cores): 9.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T09:30:37.144593 Stage halos : Wall: 0.23 s, CPU: 0.22 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 226 MB, VmData: 256 MB, maxrss: 0.23148 MB Stage halos finished: 2020-08-07T09:30:37.370198 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.227 s, Cores in use: 0.96, Total efficiency (on 16 cores): 6.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T09:30:37.397780 PSF sigmas in coadd pixels: ['2.69', '2.60', '2.64'] Using average PSF sigma 2.643264355222866 Gaussian PSF norm 0.10672212607735689 vs pixelized 0.087079644 average tim pixel scale / coadd scale: 1.7302669540317799 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-copsf-g.fits.fz PSF sigmas in coadd pixels: ['3.13', '3.79', '2.23', '2.02'] Using average PSF sigma 2.794545623207767 Gaussian PSF norm 0.10094477951305403 vs pixelized 0.078599 average tim pixel scale / coadd scale: 1.7303630299972839 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.66', '1.78', '1.67', '1.43'] Using average PSF sigma 1.6320073849138772 Gaussian PSF norm 0.17285141867710643 vs pixelized 0.13724057 average tim pixel scale / coadd scale: 0.9910154362113165 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.26 s, CPU: 0.18 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 228 MB, VmData: 256 MB, maxrss: 0.233072 MB Stage fit_on_coadds finished: 2020-08-07T09:30:37.653722 Resources for stage fit_on_coadds : 0.205 s worker CPU, 0.205 s worker Wall, Wall: 0.257 s, Cores in use: 1.48, Total efficiency (on 16 cores): 9.3 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-fit_on_coadds.p Running stage srcs Warning: Stellar halo subtraction is only implemented for DECam Running stage srcs at 2020-08-07T09:30:37.675979 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 26 potential peaks Of 26 potential peaks: 9 in veto map, 1 cut by saddle test, 0 cut by aper test, 16 kept SED z : 16 new peaks Found 27 potential peaks Of 27 potential peaks: 22 in veto map, 2 cut by saddle test, 0 cut by aper test, 3 kept SED r : 3 new peaks Found 24 potential peaks Of 24 potential peaks: 23 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 33 potential peaks Of 33 potential peaks: 28 in veto map, 1 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 36 potential peaks Of 36 potential peaks: 32 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 24 new sources Median coadd sky for g : 0.00011340295 Median coadd sky for r : 0.00018657057 Median coadd sky for z : -0.00012432462 Stage srcs : Wall: 0.43 s, CPU: 0.40 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 228 MB, VmData: 256 MB, maxrss: 0.233556 MB Stage srcs finished: 2020-08-07T09:30:38.110553 Resources for stage srcs : 0.079 s worker CPU, 0.079 s worker Wall, Wall: 0.436 s, Cores in use: 1.10, Total efficiency (on 16 cores): 6.9 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T09:30:38.132615 Blob 1 of 20, id: 8, sources: 10, size: 128x149, npix 13236, brick X: 62,190, Y: 71,220, one pixel: 104 71 Blob 2 of 20, id: 0, sources: 2, size: 59x45, npix 1782, brick X: 20,79, Y: 0,45, one pixel: 51 0 Blob 3 of 20, id: 3, sources: 2, size: 46x37, npix 1172, brick X: 223,269, Y: 19,56, one pixel: 237 19 Blob 4 of 20, id: 13, sources: 1, size: 45x39, npix 1145, brick X: 1,46, Y: 156,195, one pixel: 15 156 Blob 5 of 20, id: 17, sources: 1, size: 41x35, npix 970, brick X: 191,232, Y: 228,263, one pixel: 211 228 Blob 6 of 20, id: 11, sources: 1, size: 32x32, npix 700, brick X: 30,62, Y: 115,147, one pixel: 43 115 Blob 7 of 20, id: 18, sources: 2, size: 37x29, npix 636, brick X: 95,132, Y: 238,267, one pixel: 119 238 Blob 8 of 20, id: 12, sources: 1, size: 24x36, npix 613, brick X: 245,269, Y: 115,151, one pixel: 260 115 Blob 9 of 20, id: 10, sources: 1, size: 29x29, npix 556, brick X: 189,218, Y: 108,137, one pixel: 202 108 Blob 10 of 20, id: 2, sources: 2, size: 33x20, npix 467, brick X: 154,187, Y: 0,20, one pixel: 159 0 Blob 11 of 20, id: 14, sources: 1, size: 24x25, npix 371, brick X: 242,266, Y: 192,217, one pixel: 251 192 Blob 12 of 20, id: 1, sources: 1, size: 27x18, npix 344, brick X: 118,145, Y: 0,18, one pixel: 122 0 Blob 13 of 20, id: 19, sources: 2, size: 20x21, npix 328, brick X: 0,20, Y: 248,269, one pixel: 2 248 Blob 14 of 20, id: 15, sources: 1, size: 21x22, npix 300, brick X: 35,56, Y: 214,236, one pixel: 44 214 Blob 15 of 20, id: 5, sources: 1, size: 18x22, npix 255, brick X: 0,18, Y: 36,58, one pixel: 7 36 Blob 16 of 20, id: 9, sources: 1, size: 19x20, npix 209, brick X: 31,50, Y: 88,108, one pixel: 40 88 Blob 17 of 20, id: 16, sources: 1, size: 19x20, npix 209, brick X: 170,189, Y: 226,246, one pixel: 179 226 Blob 18 of 20, id: 7, sources: 1, size: 20x18, npix 207, brick X: 161,181, Y: 47,65, one pixel: 169 47 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.38345, 67.27731), pm (-2.1, 0.5), parallax 0.093 with NanoMaggies: g=19.5, r=19, z=18.1 Reset brightness to NanoMaggies: g=19.5, r=18.6, z=18.2 Blob 10 finished, total: Wall: 0.15 s, CPU: 0.15 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147256 MB Blob 19 of 20, id: 4, sources: 1, size: 18x19, npix 189, brick X: 85,103, Y: 33,52, one pixel: 93 33 Blob 17 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147256 MB Blob 20 of 20, id: 6, sources: 1, size: 18x18, npix 180, brick X: 100,118, Y: 41,59, one pixel: 108 41 Blob 14 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146772 MB Blob 18 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147256 MB Blob 16 finished, total: Wall: 0.33 s, CPU: 0.32 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.09322 MB Blob 20 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147256 MB Blob 9 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145804 MB Blob 13 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146864 MB Blob 19 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146772 MB Blob 4 finished, total: Wall: 0.66 s, CPU: 0.65 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146896 MB Blob 11 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 803 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.146972 MB Blob 6 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.094316 MB Measuring 1 iterative sources Blob 8 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 805 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147072 MB Blob 7 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 92 MB, VmData: 138 MB, maxrss: 0.094476 MB Blob 12 finished, total: Wall: 0.88 s, CPU: 0.88 s, VmPeak: 802 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146616 MB Blob 15 finished, total: Wall: 0.88 s, CPU: 0.88 s, VmPeak: 804 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14702 MB Blob 3 finished, total: Wall: 1.08 s, CPU: 1.05 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147368 MB Blob 2 finished, total: Wall: 1.18 s, CPU: 1.17 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.096012 MB Blob 5 finished, total: Wall: 1.20 s, CPU: 1.20 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097512 MB Exception in one_blob: brick custom-272390p67287, iblob 8 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1637, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 376, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1989, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker result = (True, func(*args, **kwds)) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__ R = self.func(*args, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1637, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 376, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1989, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3771, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3739, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3295, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3284, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1131, in stage_fitblobs r = Riter.next(timeout) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next raise value AttributeError: 'NoneType' object has no attribute 'getBrightness' Something went wrong; please check the logfile. ERROR: galaxy PGC2697718; please check the logfile. Finished galaxy PGC2697718 in 1.201 minutes. Started working on galaxy PGC2697718 at Fri Aug 7 12:05:50 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.39043863375275 67.28752579920312 --width 269 --height 269 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T12:05:51.249604 legacypipe git version: DR9.5.11-watershed-4-gcc619972 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.39043863375275', '67.28752579920312', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.39043863375275 67.28752579920312 --width 269 --height 269 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 272.39043863375275 67.28752579920312 Starting process 16506 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 16507 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16508 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16509 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16510 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 16511 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 16512 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 16513 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 16514 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 16515 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 16516 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 16517 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16518 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16519 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16520 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16521 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16522 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 16523 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 16524 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 16525 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 16526 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 16527 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 16528 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 16529 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 16530 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 16531 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 16532 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 16533 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 16534 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 16535 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 16536 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 16537 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-srcs.p and forcing stage srcs Runstage fit_on_coadds Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-fit_on_coadds.p and forcing stage fit_on_coadds Runstage halos Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-halos.p and forcing stage halos Runstage outliers Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-outliers.p and forcing stage outliers Runstage refs Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-refs.p and forcing stage refs Runstage tims Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-tims.p and forcing stage tims Running stage tims Running stage tims at 2020-08-07T12:05:51.711126 Keeping 11 CCDs: k4m_171002_045924_ooi_zd_ls9-CCD3 z expnum 141824 exptime 103.105 propid 2016A-0453 seeing 1.02 MJD 58028.208 object MzLS_708104_z mosaic/CP/V4.3/CP20171001/k4m_171002_045924_ooi_zd_ls9.fits.fz k4m_180206_115146_ooi_zd_ls9-CCD1 z expnum 160839 exptime 136.106 propid 2016A-0453 seeing 1.09 MJD 58155.494 object MzLS_707618_z mosaic/CP/V4.3/CP20180205/k4m_180206_115146_ooi_zd_ls9.fits.fz k4m_170607_111116_ooi_zd_ls9-CCD1 z expnum 132248 exptime 168.106 propid 2016A-0453 seeing 1.03 MJD 57911.466 object MzLS_707618_z mosaic/CP/V4.3/CP20170606/k4m_170607_111116_ooi_zd_ls9.fits.fz k4m_171126_022436_ooi_zd_ls9-CCD2 z expnum 149146 exptime 128.104 propid 2016A-0453 seeing 0.88 MJD 58083.100 object MzLS_707129_z mosaic/CP/V4.3/CP20171125/k4m_171126_022436_ooi_zd_ls9.fits.fz ksb_180416_102639_ooi_g_ls9-CCD2 g expnum 82240142 exptime 249.4 propid BASS seeing 1.66 MJD 58224.435 object 44773 90prime/CP/V2.3/CP20180415/ksb_180416_102639_ooi_g_ls9.fits.fz ksb_180521_093049_ooi_r_ls9-CCD2 r expnum 82590119 exptime 101.393 propid NOTBASS seeing 1.93 MJD 58259.396 object 44773 90prime/CP/V2.3/CP20180520/ksb_180521_093049_ooi_r_ls9.fits.fz ksb_180521_094010_ooi_r_ls9-CCD4 r expnum 82590123 exptime 165.5 propid NOTBASS seeing 2.34 MJD 58259.403 object 44783 90prime/CP/V2.3/CP20180520/ksb_180521_094010_ooi_r_ls9.fits.fz ksb_180517_094715_ooi_g_ls9-CCD1 g expnum 82550136 exptime 105.647 propid NOTBASS seeing 1.60 MJD 58255.408 object 43982 90prime/CP/V2.3/CP20180516/ksb_180517_094715_ooi_g_ls9.fits.fz ksb_180522_093250_ooi_r_ls9-CCD1 r expnum 82600078 exptime 119.424 propid NOTBASS seeing 1.37 MJD 58260.398 object 43982 90prime/CP/V2.3/CP20180521/ksb_180522_093250_ooi_r_ls9.fits.fz ksb_180516_073452_ooi_g_ls9-CCD1 g expnum 82540108 exptime 137.97 propid NOTBASS seeing 1.63 MJD 58254.316 object 43981 90prime/CP/V2.3/CP20180515/ksb_180516_073452_ooi_g_ls9.fits.fz ksb_180510_102808_ooi_r_ls9-CCD1 r expnum 82480179 exptime 94.544 propid NOTBASS seeing 1.25 MJD 58248.436 object 43981 90prime/CP/V2.3/CP20180509/ksb_180510_102808_ooi_r_ls9.fits.fz Faked up EXPNUM 82600078 Faked up EXPNUM 82600078 Faked up EXPNUM 82600078 90prime get_fwhm: self.fwhm = 3.03 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3719 3877 and amp range 2016 4031 and image y 3855 4012 and amp range 2048 4095 Range in image: x 0 159 , y 0 158 (with image size 159 x 158) dzp 0.015744466 -> scaling image by 1.0146068417155982 mosaic get_fwhm: self.fwhm = 3.95 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2994 3265 and amp range 2006 4053 and image y 2212 2483 and amp range 2040 4078 Range in image: x 0 272 , y 0 272 (with image size 272 x 272) dzp 0.012593497 -> scaling image by 1.0116665687010755 Faked up EXPNUM 82540108 Faked up EXPNUM 82540108 Faked up EXPNUM 82540108 90prime get_fwhm: self.fwhm = 3.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1700 1861 and amp range 0 2015 and image y 1923 2082 and amp range 0 2047 Range in image: x 0 162 , y 0 125 (with image size 162 x 160) dzp -0.030770088 -> scaling image by 0.9720575212609548 Found overlap: image x 1700 1861 and amp range 0 2015 and image y 1923 2082 and amp range 2048 4095 Range in image: x 0 162 , y 125 160 (with image size 162 x 160) dzp -0.031697065 -> scaling image by 0.9712279547101786 mosaic get_fwhm: self.fwhm = 4.21 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2999 3269 and amp range 2006 4053 and image y 2287 2558 and amp range 2040 4078 Range in image: x 0 271 , y 0 272 (with image size 271 x 272) dzp 0.0036595785 -> scaling image by 1.003376283213225 Faked up EXPNUM 82590119 Faked up EXPNUM 82590119 Faked up EXPNUM 82590119 90prime get_fwhm: self.fwhm = 4.25 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3467 3629 and amp range 2016 4031 and image y 333 496 and amp range 0 2047 Range in image: x 0 163 , y 0 164 (with image size 163 x 164) dzp 0.014483032 -> scaling image by 1.0134287315188357 mosaic get_fwhm: self.fwhm = 3.93 Found 4 relevant rows in amp-corrections file. Found overlap: image x 292 569 and amp range 0 2005 and image y 175 449 and amp range 0 2039 Range in image: x 0 278 , y 0 275 (with image size 278 x 275) dzp 0.0014252509 -> scaling image by 1.0013135665633692 Faked up EXPNUM 82480179 Faked up EXPNUM 82480179 Faked up EXPNUM 82480179 90prime get_fwhm: self.fwhm = 2.75 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1723 1883 and amp range 0 2015 and image y 1928 2087 and amp range 0 2047 Range in image: x 0 161 , y 0 120 (with image size 161 x 160) dzp -0.04811793 -> scaling image by 0.9566494556405901 Found overlap: image x 1723 1883 and amp range 0 2015 and image y 1928 2087 and amp range 2048 4095 Range in image: x 0 161 , y 120 160 (with image size 161 x 160) dzp -0.05213645 -> scaling image by 0.953115252660837 Faked up EXPNUM 82240142 Faked up EXPNUM 82240142 Faked up EXPNUM 82240142 90prime get_fwhm: self.fwhm = 3.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3441 3602 and amp range 2016 4031 and image y 355 518 and amp range 0 2047 Range in image: x 0 162 , y 0 164 (with image size 162 x 164) dzp 0.009189803 -> scaling image by 1.0085000434534261 Faked up EXPNUM 82590123 Faked up EXPNUM 82590123 Faked up EXPNUM 82590123 90prime get_fwhm: self.fwhm = 5.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3589 3747 and amp range 2016 4031 and image y 4037 4080 and amp range 2048 4095 Range in image: x 0 159 , y 0 44 (with image size 159 x 44) dzp 0.044050463 -> scaling image by 1.0414062625929388 Faked up EXPNUM 82550136 Faked up EXPNUM 82550136 Faked up EXPNUM 82550136 90prime get_fwhm: self.fwhm = 3.53 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3713 3870 and amp range 2016 4031 and image y 3872 4029 and amp range 2048 4095 Range in image: x 0 158 , y 0 158 (with image size 158 x 158) dzp 0.016257986 -> scaling image by 1.01508683329102 mosaic get_fwhm: self.fwhm = 3.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1428 1700 and amp range 0 2047 and image y 3685 3956 and amp range 2040 4078 Range in image: x 0 273 , y 0 272 (with image size 273 x 272) dzp 0.003927584 -> scaling image by 1.0036239891963392 Stage tims : Wall: 4.58 s, CPU: 0.86 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 175 MB, VmData: 208 MB, maxrss: 0.179056 MB Stage tims finished: 2020-08-07T12:05:56.290804 Resources for stage tims : 5.856 s worker CPU, 12.062 s worker Wall, Wall: 4.582 s, Cores in use: 1.47, Total efficiency (on 32 cores): 4.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T12:05:56.344349 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00528.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00465.fits Matched 5 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/metrics/cus/reference-custom-272390p67287.fits Stage refs : Wall: 3.24 s, CPU: 2.94 s, VmPeak: 990 MB, VmSize: 985 MB, VmRSS: 209 MB, VmData: 242 MB, maxrss: 0.2144 MB Stage refs finished: 2020-08-07T12:05:59.583596 Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 3.241 s, Cores in use: 0.91, Total efficiency (on 32 cores): 2.8 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T12:05:59.610818 Stage outliers : Wall: 0.38 s, CPU: 0.36 s, VmPeak: 990 MB, VmSize: 985 MB, VmRSS: 210 MB, VmData: 242 MB, maxrss: 0.215412 MB Stage outliers finished: 2020-08-07T12:05:59.992511 Resources for stage outliers : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.384 s, Cores in use: 0.93, Total efficiency (on 32 cores): 2.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T12:06:00.020635 Stage halos : Wall: 0.27 s, CPU: 0.25 s, VmPeak: 990 MB, VmSize: 985 MB, VmRSS: 213 MB, VmData: 246 MB, maxrss: 0.218424 MB Stage halos finished: 2020-08-07T12:06:00.288006 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.269 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T12:06:00.315714 PSF sigmas in coadd pixels: ['2.69', '2.60', '2.64'] Using average PSF sigma 2.643264355222866 Gaussian PSF norm 0.10672212607735689 vs pixelized 0.087079644 average tim pixel scale / coadd scale: 1.7302669540317799 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-copsf-g.fits.fz PSF sigmas in coadd pixels: ['3.13', '3.79', '2.23', '2.02'] Using average PSF sigma 2.794545623207767 Gaussian PSF norm 0.10094477951305403 vs pixelized 0.078599 average tim pixel scale / coadd scale: 1.7303630299972839 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.66', '1.78', '1.67', '1.43'] Using average PSF sigma 1.6320073849138772 Gaussian PSF norm 0.17285141867710643 vs pixelized 0.13724057 average tim pixel scale / coadd scale: 0.9910154362113165 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.35 s, CPU: 0.18 s, VmPeak: 990 MB, VmSize: 990 MB, VmRSS: 227 MB, VmData: 256 MB, maxrss: 0.23196 MB Stage fit_on_coadds finished: 2020-08-07T12:06:00.669297 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.239 s worker CPU, 0.379 s worker Wall, Wall: 0.356 s, Cores in use: 1.19, Total efficiency (on 32 cores): 3.7 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T12:06:00.681342 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 26 potential peaks Of 26 potential peaks: 9 in veto map, 1 cut by saddle test, 0 cut by aper test, 16 kept SED z : 16 new peaks Found 27 potential peaks Of 27 potential peaks: 22 in veto map, 2 cut by saddle test, 0 cut by aper test, 3 kept SED r : 3 new peaks Found 24 potential peaks Of 24 potential peaks: 23 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 33 potential peaks Of 33 potential peaks: 28 in veto map, 1 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 36 potential peaks Of 36 potential peaks: 32 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 24 new sources Median coadd sky for g : 0.000113402915 Median coadd sky for r : 0.00018657057 Median coadd sky for z : -0.00012432462 Stage srcs : Wall: 0.51 s, CPU: 0.46 s, VmPeak: 990 MB, VmSize: 990 MB, VmRSS: 227 MB, VmData: 256 MB, maxrss: 0.23286 MB Stage srcs finished: 2020-08-07T12:06:01.194296 Resources for stage srcs : 0.126 s worker CPU, 0.126 s worker Wall, Wall: 0.515 s, Cores in use: 1.13, Total efficiency (on 32 cores): 3.5 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T12:06:01.207724 Blob 1 of 20, id: 8, sources: 10, size: 128x149, npix 13236, brick X: 62,190, Y: 71,220, one pixel: 104 71 Blob 2 of 20, id: 0, sources: 2, size: 59x45, npix 1782, brick X: 20,79, Y: 0,45, one pixel: 51 0 Blob 3 of 20, id: 3, sources: 2, size: 46x37, npix 1172, brick X: 223,269, Y: 19,56, one pixel: 237 19 Blob 4 of 20, id: 13, sources: 1, size: 45x39, npix 1145, brick X: 1,46, Y: 156,195, one pixel: 15 156 Blob 5 of 20, id: 17, sources: 1, size: 41x35, npix 970, brick X: 191,232, Y: 228,263, one pixel: 211 228 Blob 6 of 20, id: 11, sources: 1, size: 32x32, npix 700, brick X: 30,62, Y: 115,147, one pixel: 43 115 Blob 7 of 20, id: 18, sources: 2, size: 37x29, npix 636, brick X: 95,132, Y: 238,267, one pixel: 119 238 Blob 8 of 20, id: 12, sources: 1, size: 24x36, npix 613, brick X: 245,269, Y: 115,151, one pixel: 260 115 Blob 9 of 20, id: 10, sources: 1, size: 29x29, npix 556, brick X: 189,218, Y: 108,137, one pixel: 202 108 Blob 10 of 20, id: 2, sources: 2, size: 33x20, npix 467, brick X: 154,187, Y: 0,20, one pixel: 159 0 Blob 11 of 20, id: 14, sources: 1, size: 24x25, npix 371, brick X: 242,266, Y: 192,217, one pixel: 251 192 Blob 12 of 20, id: 1, sources: 1, size: 27x18, npix 344, brick X: 118,145, Y: 0,18, one pixel: 122 0 Blob 13 of 20, id: 19, sources: 2, size: 20x21, npix 328, brick X: 0,20, Y: 248,269, one pixel: 2 248 Blob 14 of 20, id: 15, sources: 1, size: 21x22, npix 300, brick X: 35,56, Y: 214,236, one pixel: 44 214 Blob 15 of 20, id: 5, sources: 1, size: 18x22, npix 255, brick X: 0,18, Y: 36,58, one pixel: 7 36 Blob 16 of 20, id: 9, sources: 1, size: 19x20, npix 209, brick X: 31,50, Y: 88,108, one pixel: 40 88 Blob 17 of 20, id: 16, sources: 1, size: 19x20, npix 209, brick X: 170,189, Y: 226,246, one pixel: 179 226 Blob 18 of 20, id: 7, sources: 1, size: 20x18, npix 207, brick X: 161,181, Y: 47,65, one pixel: 169 47 Blob 19 of 20, id: 4, sources: 1, size: 18x19, npix 189, brick X: 85,103, Y: 33,52, one pixel: 93 33 Blob 20 of 20, id: 6, sources: 1, size: 18x18, npix 180, brick X: 100,118, Y: 41,59, one pixel: 108 41 Blob 20 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 802 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146292 MB Blob 18 finished, total: Wall: 0.09 s, CPU: 0.08 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 85 MB, VmData: 138 MB, maxrss: 0.086648 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.38345, 67.27731), pm (-2.1, 0.5), parallax 0.093 with NanoMaggies: g=19.9, r=19.5, z=18.2 Reset brightness to NanoMaggies: g=19.5, r=18.6, z=18.2 Blob 17 finished, total: Wall: 0.15 s, CPU: 0.10 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 82 MB, VmData: 137 MB, maxrss: 0.083936 MB Blob 10 finished, total: Wall: 0.17 s, CPU: 0.17 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 86 MB, VmData: 138 MB, maxrss: 0.088008 MB Blob 19 finished, total: Wall: 0.22 s, CPU: 0.21 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093124 MB Blob 16 finished, total: Wall: 0.23 s, CPU: 0.22 s, VmPeak: 803 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146136 MB Blob 14 finished, total: Wall: 0.31 s, CPU: 0.26 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089668 MB Blob 9 finished, total: Wall: 0.39 s, CPU: 0.38 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092416 MB Blob 4 finished, total: Wall: 0.52 s, CPU: 0.49 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.091012 MB Blob 6 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.14498 MB Measuring 1 iterative sources Blob 7 finished, total: Wall: 0.62 s, CPU: 0.59 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.090728 MB Blob 11 finished, total: Wall: 0.61 s, CPU: 0.57 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089824 MB Blob 13 finished, total: Wall: 0.66 s, CPU: 0.63 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.08982 MB Blob 15 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093472 MB Blob 12 finished, total: Wall: 0.69 s, CPU: 0.68 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092376 MB Blob 8 finished, total: Wall: 0.74 s, CPU: 0.71 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.08994 MB Blob 3 finished, total: Wall: 0.92 s, CPU: 0.90 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.09108 MB Blob 5 finished, total: Wall: 0.97 s, CPU: 0.96 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.1455 MB Blob 2 finished, total: Wall: 1.05 s, CPU: 1.03 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.09156 MB Exception in one_blob: brick custom-272390p67287, iblob 8 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker result = (True, func(*args, **kwds)) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__ R = self.func(*args, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3775, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3743, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3299, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3288, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1135, in stage_fitblobs r = Riter.next(timeout) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next raise value AttributeError: 'NoneType' object has no attribute 'getBrightness' Something went wrong; please check the logfile. ERROR: galaxy PGC2697718; please check the logfile. Finished galaxy PGC2697718 in 0.244 minutes. Started working on galaxy PGC2697718 at Fri Aug 7 12:31:59 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.39043863375275 67.28752579920312 --width 269 --height 269 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T12:32:00.503105 legacypipe git version: DR9.5.11-watershed-4-gcc619972 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.39043863375275', '67.28752579920312', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.39043863375275 67.28752579920312 --width 269 --height 269 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 272.39043863375275 67.28752579920312 Starting process 16220 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 16221 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16222 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16223 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16224 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 16225 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 16226 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 16227 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 16228 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 16229 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 16230 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 16231 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 16232 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16233 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16234 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16235 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 16236 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 16237 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 16238 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 16239 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 16240 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 16241 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 16242 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 16243 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 16244 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 16245 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 16246 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 16247 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 16249 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 16250 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 16248 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 16251 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T12:32:00.937007 Keeping 11 CCDs: k4m_171002_045924_ooi_zd_ls9-CCD3 z expnum 141824 exptime 103.105 propid 2016A-0453 seeing 1.02 MJD 58028.208 object MzLS_708104_z mosaic/CP/V4.3/CP20171001/k4m_171002_045924_ooi_zd_ls9.fits.fz k4m_180206_115146_ooi_zd_ls9-CCD1 z expnum 160839 exptime 136.106 propid 2016A-0453 seeing 1.09 MJD 58155.494 object MzLS_707618_z mosaic/CP/V4.3/CP20180205/k4m_180206_115146_ooi_zd_ls9.fits.fz k4m_170607_111116_ooi_zd_ls9-CCD1 z expnum 132248 exptime 168.106 propid 2016A-0453 seeing 1.03 MJD 57911.466 object MzLS_707618_z mosaic/CP/V4.3/CP20170606/k4m_170607_111116_ooi_zd_ls9.fits.fz k4m_171126_022436_ooi_zd_ls9-CCD2 z expnum 149146 exptime 128.104 propid 2016A-0453 seeing 0.88 MJD 58083.100 object MzLS_707129_z mosaic/CP/V4.3/CP20171125/k4m_171126_022436_ooi_zd_ls9.fits.fz ksb_180416_102639_ooi_g_ls9-CCD2 g expnum 82240142 exptime 249.4 propid BASS seeing 1.66 MJD 58224.435 object 44773 90prime/CP/V2.3/CP20180415/ksb_180416_102639_ooi_g_ls9.fits.fz ksb_180521_093049_ooi_r_ls9-CCD2 r expnum 82590119 exptime 101.393 propid NOTBASS seeing 1.93 MJD 58259.396 object 44773 90prime/CP/V2.3/CP20180520/ksb_180521_093049_ooi_r_ls9.fits.fz ksb_180521_094010_ooi_r_ls9-CCD4 r expnum 82590123 exptime 165.5 propid NOTBASS seeing 2.34 MJD 58259.403 object 44783 90prime/CP/V2.3/CP20180520/ksb_180521_094010_ooi_r_ls9.fits.fz ksb_180517_094715_ooi_g_ls9-CCD1 g expnum 82550136 exptime 105.647 propid NOTBASS seeing 1.60 MJD 58255.408 object 43982 90prime/CP/V2.3/CP20180516/ksb_180517_094715_ooi_g_ls9.fits.fz ksb_180522_093250_ooi_r_ls9-CCD1 r expnum 82600078 exptime 119.424 propid NOTBASS seeing 1.37 MJD 58260.398 object 43982 90prime/CP/V2.3/CP20180521/ksb_180522_093250_ooi_r_ls9.fits.fz ksb_180516_073452_ooi_g_ls9-CCD1 g expnum 82540108 exptime 137.97 propid NOTBASS seeing 1.63 MJD 58254.316 object 43981 90prime/CP/V2.3/CP20180515/ksb_180516_073452_ooi_g_ls9.fits.fz ksb_180510_102808_ooi_r_ls9-CCD1 r expnum 82480179 exptime 94.544 propid NOTBASS seeing 1.25 MJD 58248.436 object 43981 90prime/CP/V2.3/CP20180509/ksb_180510_102808_ooi_r_ls9.fits.fz mosaic get_fwhm: self.fwhm = 3.95 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2994 3265 and amp range 2006 4053 and image y 2212 2483 and amp range 2040 4078 Range in image: x 0 272 , y 0 272 (with image size 272 x 272) dzp 0.012593497 -> scaling image by 1.0116665687010755 Faked up EXPNUM 82590119 Faked up EXPNUM 82590119 Faked up EXPNUM 82590119 90prime get_fwhm: self.fwhm = 4.25 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3467 3629 and amp range 2016 4031 and image y 333 496 and amp range 0 2047 Range in image: x 0 163 , y 0 164 (with image size 163 x 164) dzp 0.014483032 -> scaling image by 1.0134287315188357 mosaic get_fwhm: self.fwhm = 3.93 Found 4 relevant rows in amp-corrections file. Found overlap: image x 292 569 and amp range 0 2005 and image y 175 449 and amp range 0 2039 Range in image: x 0 278 , y 0 275 (with image size 278 x 275) dzp 0.0014252509 -> scaling image by 1.0013135665633692 Faked up EXPNUM 82480179 Faked up EXPNUM 82480179 Faked up EXPNUM 82480179 90prime get_fwhm: self.fwhm = 2.75 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1723 1883 and amp range 0 2015 and image y 1928 2087 and amp range 0 2047 Range in image: x 0 161 , y 0 120 (with image size 161 x 160) dzp -0.04811793 -> scaling image by 0.9566494556405901 Found overlap: image x 1723 1883 and amp range 0 2015 and image y 1928 2087 and amp range 2048 4095 Range in image: x 0 161 , y 120 160 (with image size 161 x 160) dzp -0.05213645 -> scaling image by 0.953115252660837 mosaic get_fwhm: self.fwhm = 4.21 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2999 3269 and amp range 2006 4053 and image y 2287 2558 and amp range 2040 4078 Range in image: x 0 271 , y 0 272 (with image size 271 x 272) dzp 0.0036595785 -> scaling image by 1.003376283213225 Faked up EXPNUM 82590123 Faked up EXPNUM 82590123 Faked up EXPNUM 82590123 90prime get_fwhm: self.fwhm = 5.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3589 3747 and amp range 2016 4031 and image y 4037 4080 and amp range 2048 4095 Range in image: x 0 159 , y 0 44 (with image size 159 x 44) dzp 0.044050463 -> scaling image by 1.0414062625929388 mosaic get_fwhm: self.fwhm = 3.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1428 1700 and amp range 0 2047 and image y 3685 3956 and amp range 2040 4078 Range in image: x 0 273 , y 0 272 (with image size 273 x 272) dzp 0.003927584 -> scaling image by 1.0036239891963392 Faked up EXPNUM 82240142 Faked up EXPNUM 82240142 Faked up EXPNUM 82240142 90prime get_fwhm: self.fwhm = 3.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3441 3602 and amp range 2016 4031 and image y 355 518 and amp range 0 2047 Range in image: x 0 162 , y 0 164 (with image size 162 x 164) dzp 0.009189803 -> scaling image by 1.0085000434534261 Faked up EXPNUM 82540108 Faked up EXPNUM 82540108 Faked up EXPNUM 82540108 90prime get_fwhm: self.fwhm = 3.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1700 1861 and amp range 0 2015 and image y 1923 2082 and amp range 0 2047 Range in image: x 0 162 , y 0 125 (with image size 162 x 160) dzp -0.030770088 -> scaling image by 0.9720575212609548 Found overlap: image x 1700 1861 and amp range 0 2015 and image y 1923 2082 and amp range 2048 4095 Range in image: x 0 162 , y 125 160 (with image size 162 x 160) dzp -0.031697065 -> scaling image by 0.9712279547101786 Faked up EXPNUM 82600078 Faked up EXPNUM 82600078 Faked up EXPNUM 82600078 90prime get_fwhm: self.fwhm = 3.03 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3719 3877 and amp range 2016 4031 and image y 3855 4012 and amp range 2048 4095 Range in image: x 0 159 , y 0 158 (with image size 159 x 158) dzp 0.015744466 -> scaling image by 1.0146068417155982 Faked up EXPNUM 82550136 Faked up EXPNUM 82550136 Faked up EXPNUM 82550136 90prime get_fwhm: self.fwhm = 3.53 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3713 3870 and amp range 2016 4031 and image y 3872 4029 and amp range 2048 4095 Range in image: x 0 158 , y 0 158 (with image size 158 x 158) dzp 0.016257986 -> scaling image by 1.01508683329102 Stage tims : Wall: 2.30 s, CPU: 0.79 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.178316 MB Stage tims finished: 2020-08-07T12:32:03.232225 Resources for stage tims : 5.693 s worker CPU, 13.954 s worker Wall, Wall: 2.298 s, Cores in use: 2.82, Total efficiency (on 32 cores): 8.8 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T12:32:03.266436 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00528.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00465.fits Matched 5 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/metrics/cus/reference-custom-272390p67287.fits Stage refs : Wall: 3.17 s, CPU: 2.93 s, VmPeak: 990 MB, VmSize: 985 MB, VmRSS: 209 MB, VmData: 242 MB, maxrss: 0.213856 MB Stage refs finished: 2020-08-07T12:32:06.431926 Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 3.168 s, Cores in use: 0.93, Total efficiency (on 32 cores): 2.9 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T12:32:06.456332 Stage outliers : Wall: 0.27 s, CPU: 0.25 s, VmPeak: 990 MB, VmSize: 985 MB, VmRSS: 210 MB, VmData: 242 MB, maxrss: 0.214876 MB Stage outliers finished: 2020-08-07T12:32:06.726610 Resources for stage outliers : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.272 s, Cores in use: 0.93, Total efficiency (on 32 cores): 2.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T12:32:06.752100 Stage halos : Wall: 0.21 s, CPU: 0.20 s, VmPeak: 990 MB, VmSize: 985 MB, VmRSS: 213 MB, VmData: 246 MB, maxrss: 0.217872 MB Stage halos finished: 2020-08-07T12:32:06.962458 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.212 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T12:32:07.007779 PSF sigmas in coadd pixels: ['2.69', '2.60', '2.64'] Using average PSF sigma 2.643264355222866 Gaussian PSF norm 0.10672212607735689 vs pixelized 0.087079644 average tim pixel scale / coadd scale: 1.7302669540317799 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-copsf-g.fits.fz PSF sigmas in coadd pixels: ['3.13', '3.79', '2.23', '2.02'] Using average PSF sigma 2.794545623207767 Gaussian PSF norm 0.10094477951305403 vs pixelized 0.078599 average tim pixel scale / coadd scale: 1.7303630299972839 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.66', '1.78', '1.67', '1.43'] Using average PSF sigma 1.6320073849138772 Gaussian PSF norm 0.17285141867710643 vs pixelized 0.13724057 average tim pixel scale / coadd scale: 0.9910154362113165 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.20 s, CPU: 0.18 s, VmPeak: 990 MB, VmSize: 990 MB, VmRSS: 226 MB, VmData: 255 MB, maxrss: 0.230968 MB Stage fit_on_coadds finished: 2020-08-07T12:32:07.205394 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.223 s worker CPU, 0.312 s worker Wall, Wall: 0.200 s, Cores in use: 2.03, Total efficiency (on 32 cores): 6.3 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T12:32:07.235669 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 26 potential peaks Of 26 potential peaks: 9 in veto map, 1 cut by saddle test, 0 cut by aper test, 16 kept SED z : 16 new peaks Found 27 potential peaks Of 27 potential peaks: 22 in veto map, 2 cut by saddle test, 0 cut by aper test, 3 kept SED r : 3 new peaks Found 24 potential peaks Of 24 potential peaks: 23 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 33 potential peaks Of 33 potential peaks: 28 in veto map, 1 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 36 potential peaks Of 36 potential peaks: 32 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 24 new sources Median coadd sky for g : 0.000113402915 Median coadd sky for r : 0.00018657057 Median coadd sky for z : -0.00012432456 Stage srcs : Wall: 0.48 s, CPU: 0.42 s, VmPeak: 990 MB, VmSize: 990 MB, VmRSS: 226 MB, VmData: 255 MB, maxrss: 0.23188 MB Stage srcs finished: 2020-08-07T12:32:07.710752 Resources for stage srcs : 0.102 s worker CPU, 0.112 s worker Wall, Wall: 0.477 s, Cores in use: 1.10, Total efficiency (on 32 cores): 3.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T12:32:07.730864 Blob 1 of 20, id: 8, sources: 10, size: 128x149, npix 13236, brick X: 62,190, Y: 71,220, one pixel: 104 71 Blob 2 of 20, id: 0, sources: 2, size: 59x45, npix 1782, brick X: 20,79, Y: 0,45, one pixel: 51 0 Blob 3 of 20, id: 3, sources: 2, size: 46x37, npix 1172, brick X: 223,269, Y: 19,56, one pixel: 237 19 Blob 4 of 20, id: 13, sources: 1, size: 45x39, npix 1145, brick X: 1,46, Y: 156,195, one pixel: 15 156 Blob 5 of 20, id: 17, sources: 1, size: 41x35, npix 970, brick X: 191,232, Y: 228,263, one pixel: 211 228 Blob 6 of 20, id: 11, sources: 1, size: 32x32, npix 700, brick X: 30,62, Y: 115,147, one pixel: 43 115 Blob 7 of 20, id: 18, sources: 2, size: 37x29, npix 636, brick X: 95,132, Y: 238,267, one pixel: 119 238 Blob 8 of 20, id: 12, sources: 1, size: 24x36, npix 613, brick X: 245,269, Y: 115,151, one pixel: 260 115 Blob 9 of 20, id: 10, sources: 1, size: 29x29, npix 556, brick X: 189,218, Y: 108,137, one pixel: 202 108 Blob 10 of 20, id: 2, sources: 2, size: 33x20, npix 467, brick X: 154,187, Y: 0,20, one pixel: 159 0 Blob 11 of 20, id: 14, sources: 1, size: 24x25, npix 371, brick X: 242,266, Y: 192,217, one pixel: 251 192 Blob 12 of 20, id: 1, sources: 1, size: 27x18, npix 344, brick X: 118,145, Y: 0,18, one pixel: 122 0 Blob 13 of 20, id: 19, sources: 2, size: 20x21, npix 328, brick X: 0,20, Y: 248,269, one pixel: 2 248 Blob 14 of 20, id: 15, sources: 1, size: 21x22, npix 300, brick X: 35,56, Y: 214,236, one pixel: 44 214 Blob 15 of 20, id: 5, sources: 1, size: 18x22, npix 255, brick X: 0,18, Y: 36,58, one pixel: 7 36 Blob 16 of 20, id: 9, sources: 1, size: 19x20, npix 209, brick X: 31,50, Y: 88,108, one pixel: 40 88 Blob 17 of 20, id: 16, sources: 1, size: 19x20, npix 209, brick X: 170,189, Y: 226,246, one pixel: 179 226 Blob 18 of 20, id: 7, sources: 1, size: 20x18, npix 207, brick X: 161,181, Y: 47,65, one pixel: 169 47 Blob 19 of 20, id: 4, sources: 1, size: 18x19, npix 189, brick X: 85,103, Y: 33,52, one pixel: 93 33 Blob 20 of 20, id: 6, sources: 1, size: 18x18, npix 180, brick X: 100,118, Y: 41,59, one pixel: 108 41 Blob 20 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 85 MB, VmData: 138 MB, maxrss: 0.087456 MB Blob 18 finished, total: Wall: 0.08 s, CPU: 0.07 s, VmPeak: 802 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146268 MB Blob 17 finished, total: Wall: 0.13 s, CPU: 0.10 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 82 MB, VmData: 137 MB, maxrss: 0.083912 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.38345, 67.27731), pm (-2.1, 0.5), parallax 0.093 with NanoMaggies: g=19.9, r=19.5, z=18.2 Reset brightness to NanoMaggies: g=19.5, r=18.6, z=18.2 Blob 10 finished, total: Wall: 0.18 s, CPU: 0.13 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 83 MB, VmData: 137 MB, maxrss: 0.084488 MB Blob 19 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145528 MB Blob 16 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.091752 MB Blob 14 finished, total: Wall: 0.30 s, CPU: 0.26 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089656 MB Blob 9 finished, total: Wall: 0.37 s, CPU: 0.36 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.144912 MB Blob 4 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 805 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145868 MB Blob 6 finished, total: Wall: 0.56 s, CPU: 0.53 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 138 MB, maxrss: 0.090284 MB Measuring 1 iterative sources Blob 7 finished, total: Wall: 0.60 s, CPU: 0.56 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 88 MB, VmData: 138 MB, maxrss: 0.0906 MB Blob 12 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145104 MB Blob 8 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145324 MB Blob 13 finished, total: Wall: 0.68 s, CPU: 0.64 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089884 MB Blob 11 finished, total: Wall: 0.69 s, CPU: 0.64 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089872 MB Blob 15 finished, total: Wall: 0.71 s, CPU: 0.67 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089732 MB Blob 3 finished, total: Wall: 0.94 s, CPU: 0.91 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.09108 MB Blob 5 finished, total: Wall: 1.03 s, CPU: 0.99 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.090856 MB Blob 2 finished, total: Wall: 1.09 s, CPU: 1.05 s, VmPeak: 667 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.091168 MB Exception in one_blob: brick custom-272390p67287, iblob 8 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker result = (True, func(*args, **kwds)) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__ R = self.func(*args, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3775, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3743, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3299, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3288, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1135, in stage_fitblobs r = Riter.next(timeout) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next raise value AttributeError: 'NoneType' object has no attribute 'getBrightness' Something went wrong; please check the logfile. ERROR: galaxy PGC2697718; please check the logfile. Finished galaxy PGC2697718 in 0.246 minutes. Started working on galaxy PGC2697718 at Fri Aug 7 13:32:21 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.39043863375275 67.28752579920312 --width 269 --height 269 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T13:32:21.918313 legacypipe git version: DR9.5.11-watershed-5-g77ea3463 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.39043863375275', '67.28752579920312', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.39043863375275 67.28752579920312 --width 269 --height 269 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 272.39043863375275 67.28752579920312 Starting process 19958 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 19959 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 19960 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 19961 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 19962 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059416 MB Starting process 19963 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059424 MB Starting process 19964 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059424 MB Starting process 19965 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 19966 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 19967 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 19968 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 19969 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 19970 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 19971 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19972 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19973 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19974 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 19975 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 19976 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 19977 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 19978 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 19979 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 19980 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 19981 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 19982 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 19983 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 19984 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 19985 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 19986 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 19987 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 19988 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 19989 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T13:32:22.798800 Keeping 11 CCDs: k4m_171002_045924_ooi_zd_ls9-CCD3 z expnum 141824 exptime 103.105 propid 2016A-0453 seeing 1.02 MJD 58028.208 object MzLS_708104_z mosaic/CP/V4.3/CP20171001/k4m_171002_045924_ooi_zd_ls9.fits.fz k4m_180206_115146_ooi_zd_ls9-CCD1 z expnum 160839 exptime 136.106 propid 2016A-0453 seeing 1.09 MJD 58155.494 object MzLS_707618_z mosaic/CP/V4.3/CP20180205/k4m_180206_115146_ooi_zd_ls9.fits.fz k4m_170607_111116_ooi_zd_ls9-CCD1 z expnum 132248 exptime 168.106 propid 2016A-0453 seeing 1.03 MJD 57911.466 object MzLS_707618_z mosaic/CP/V4.3/CP20170606/k4m_170607_111116_ooi_zd_ls9.fits.fz k4m_171126_022436_ooi_zd_ls9-CCD2 z expnum 149146 exptime 128.104 propid 2016A-0453 seeing 0.88 MJD 58083.100 object MzLS_707129_z mosaic/CP/V4.3/CP20171125/k4m_171126_022436_ooi_zd_ls9.fits.fz ksb_180416_102639_ooi_g_ls9-CCD2 g expnum 82240142 exptime 249.4 propid BASS seeing 1.66 MJD 58224.435 object 44773 90prime/CP/V2.3/CP20180415/ksb_180416_102639_ooi_g_ls9.fits.fz ksb_180521_093049_ooi_r_ls9-CCD2 r expnum 82590119 exptime 101.393 propid NOTBASS seeing 1.93 MJD 58259.396 object 44773 90prime/CP/V2.3/CP20180520/ksb_180521_093049_ooi_r_ls9.fits.fz ksb_180521_094010_ooi_r_ls9-CCD4 r expnum 82590123 exptime 165.5 propid NOTBASS seeing 2.34 MJD 58259.403 object 44783 90prime/CP/V2.3/CP20180520/ksb_180521_094010_ooi_r_ls9.fits.fz ksb_180517_094715_ooi_g_ls9-CCD1 g expnum 82550136 exptime 105.647 propid NOTBASS seeing 1.60 MJD 58255.408 object 43982 90prime/CP/V2.3/CP20180516/ksb_180517_094715_ooi_g_ls9.fits.fz ksb_180522_093250_ooi_r_ls9-CCD1 r expnum 82600078 exptime 119.424 propid NOTBASS seeing 1.37 MJD 58260.398 object 43982 90prime/CP/V2.3/CP20180521/ksb_180522_093250_ooi_r_ls9.fits.fz ksb_180516_073452_ooi_g_ls9-CCD1 g expnum 82540108 exptime 137.97 propid NOTBASS seeing 1.63 MJD 58254.316 object 43981 90prime/CP/V2.3/CP20180515/ksb_180516_073452_ooi_g_ls9.fits.fz ksb_180510_102808_ooi_r_ls9-CCD1 r expnum 82480179 exptime 94.544 propid NOTBASS seeing 1.25 MJD 58248.436 object 43981 90prime/CP/V2.3/CP20180509/ksb_180510_102808_ooi_r_ls9.fits.fz mosaic get_fwhm: self.fwhm = 4.21 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2999 3269 and amp range 2006 4053 and image y 2287 2558 and amp range 2040 4078 Range in image: x 0 271 , y 0 272 (with image size 271 x 272) dzp 0.0036595785 -> scaling image by 1.003376283213225 Faked up EXPNUM 82240142 Faked up EXPNUM 82240142 Faked up EXPNUM 82240142 90prime get_fwhm: self.fwhm = 3.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3441 3602 and amp range 2016 4031 and image y 355 518 and amp range 0 2047 Range in image: x 0 162 , y 0 164 (with image size 162 x 164) dzp 0.009189803 -> scaling image by 1.0085000434534261 Faked up EXPNUM 82600078 Faked up EXPNUM 82600078 Faked up EXPNUM 82600078 90prime get_fwhm: self.fwhm = 3.03 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3719 3877 and amp range 2016 4031 and image y 3855 4012 and amp range 2048 4095 Range in image: x 0 159 , y 0 158 (with image size 159 x 158) dzp 0.015744466 -> scaling image by 1.0146068417155982 Faked up EXPNUM 82540108 Faked up EXPNUM 82540108 Faked up EXPNUM 82540108 90prime get_fwhm: self.fwhm = 3.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1700 1861 and amp range 0 2015 and image y 1923 2082 and amp range 0 2047 Range in image: x 0 162 , y 0 125 (with image size 162 x 160) dzp -0.030770088 -> scaling image by 0.9720575212609548 Found overlap: image x 1700 1861 and amp range 0 2015 and image y 1923 2082 and amp range 2048 4095 Range in image: x 0 162 , y 125 160 (with image size 162 x 160) dzp -0.031697065 -> scaling image by 0.9712279547101786 Faked up EXPNUM 82550136 Faked up EXPNUM 82550136 Faked up EXPNUM 82550136 90prime get_fwhm: self.fwhm = 3.53 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3713 3870 and amp range 2016 4031 and image y 3872 4029 and amp range 2048 4095 Range in image: x 0 158 , y 0 158 (with image size 158 x 158) dzp 0.016257986 -> scaling image by 1.01508683329102 mosaic get_fwhm: self.fwhm = 3.93 Found 4 relevant rows in amp-corrections file. Found overlap: image x 292 569 and amp range 0 2005 and image y 175 449 and amp range 0 2039 Range in image: x 0 278 , y 0 275 (with image size 278 x 275) dzp 0.0014252509 -> scaling image by 1.0013135665633692 mosaic get_fwhm: self.fwhm = 3.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1428 1700 and amp range 0 2047 and image y 3685 3956 and amp range 2040 4078 Range in image: x 0 273 , y 0 272 (with image size 273 x 272) dzp 0.003927584 -> scaling image by 1.0036239891963392 Faked up EXPNUM 82590119 Faked up EXPNUM 82590119 Faked up EXPNUM 82590119 90prime get_fwhm: self.fwhm = 4.25 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3467 3629 and amp range 2016 4031 and image y 333 496 and amp range 0 2047 Range in image: x 0 163 , y 0 164 (with image size 163 x 164) dzp 0.014483032 -> scaling image by 1.0134287315188357 mosaic get_fwhm: self.fwhm = 3.95 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2994 3265 and amp range 2006 4053 and image y 2212 2483 and amp range 2040 4078 Range in image: x 0 272 , y 0 272 (with image size 272 x 272) dzp 0.012593497 -> scaling image by 1.0116665687010755 Faked up EXPNUM 82590123 Faked up EXPNUM 82590123 Faked up EXPNUM 82590123 90prime get_fwhm: self.fwhm = 5.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3589 3747 and amp range 2016 4031 and image y 4037 4080 and amp range 2048 4095 Range in image: x 0 159 , y 0 44 (with image size 159 x 44) dzp 0.044050463 -> scaling image by 1.0414062625929388 Faked up EXPNUM 82480179 Faked up EXPNUM 82480179 Faked up EXPNUM 82480179 90prime get_fwhm: self.fwhm = 2.75 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1723 1883 and amp range 0 2015 and image y 1928 2087 and amp range 0 2047 Range in image: x 0 161 , y 0 120 (with image size 161 x 160) dzp -0.04811793 -> scaling image by 0.9566494556405901 Found overlap: image x 1723 1883 and amp range 0 2015 and image y 1928 2087 and amp range 2048 4095 Range in image: x 0 161 , y 120 160 (with image size 161 x 160) dzp -0.05213645 -> scaling image by 0.953115252660837 Stage tims : Wall: 5.30 s, CPU: 0.89 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.178356 MB Stage tims finished: 2020-08-07T13:32:28.103276 Resources for stage tims : 5.384 s worker CPU, 18.368 s worker Wall, Wall: 5.307 s, Cores in use: 1.18, Total efficiency (on 32 cores): 3.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T13:32:28.131469 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00528.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00465.fits Matched 5 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/metrics/cus/reference-custom-272390p67287.fits Stage refs : Wall: 3.49 s, CPU: 3.08 s, VmPeak: 990 MB, VmSize: 985 MB, VmRSS: 209 MB, VmData: 242 MB, maxrss: 0.2139 MB Stage refs finished: 2020-08-07T13:32:31.618493 Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 3.490 s, Cores in use: 0.88, Total efficiency (on 32 cores): 2.8 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T13:32:31.642542 Stage outliers : Wall: 0.62 s, CPU: 0.57 s, VmPeak: 990 MB, VmSize: 985 MB, VmRSS: 210 MB, VmData: 242 MB, maxrss: 0.214916 MB Stage outliers finished: 2020-08-07T13:32:32.264333 Resources for stage outliers : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.624 s, Cores in use: 0.92, Total efficiency (on 32 cores): 2.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T13:32:32.289882 Stage halos : Wall: 0.25 s, CPU: 0.24 s, VmPeak: 990 MB, VmSize: 985 MB, VmRSS: 213 MB, VmData: 246 MB, maxrss: 0.217948 MB Stage halos finished: 2020-08-07T13:32:32.538188 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.250 s, Cores in use: 0.96, Total efficiency (on 32 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T13:32:32.565028 PSF sigmas in coadd pixels: ['2.69', '2.60', '2.64'] Using average PSF sigma 2.643264355222866 Gaussian PSF norm 0.10672212607735689 vs pixelized 0.087079644 average tim pixel scale / coadd scale: 1.7302669540317799 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-copsf-g.fits.fz PSF sigmas in coadd pixels: ['3.13', '3.79', '2.23', '2.02'] Using average PSF sigma 2.794545623207767 Gaussian PSF norm 0.10094477951305403 vs pixelized 0.078599 average tim pixel scale / coadd scale: 1.7303630299972839 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.66', '1.78', '1.67', '1.43'] Using average PSF sigma 1.6320073849138772 Gaussian PSF norm 0.17285141867710643 vs pixelized 0.13724057 average tim pixel scale / coadd scale: 0.9910154362113165 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.22 s, CPU: 0.17 s, VmPeak: 990 MB, VmSize: 990 MB, VmRSS: 227 MB, VmData: 256 MB, maxrss: 0.232296 MB Stage fit_on_coadds finished: 2020-08-07T13:32:32.780561 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.239 s worker CPU, 0.328 s worker Wall, Wall: 0.218 s, Cores in use: 1.91, Total efficiency (on 32 cores): 6.0 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T13:32:32.802629 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 26 potential peaks Of 26 potential peaks: 9 in veto map, 1 cut by saddle test, 0 cut by aper test, 16 kept SED z : 16 new peaks Found 27 potential peaks Of 27 potential peaks: 22 in veto map, 2 cut by saddle test, 0 cut by aper test, 3 kept SED r : 3 new peaks Found 24 potential peaks Of 24 potential peaks: 23 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 33 potential peaks Of 33 potential peaks: 28 in veto map, 1 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 36 potential peaks Of 36 potential peaks: 32 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 24 new sources Median coadd sky for g : 0.00011340295 Median coadd sky for r : 0.00018657057 Median coadd sky for z : -0.00012432462 Stage srcs : Wall: 0.68 s, CPU: 0.53 s, VmPeak: 990 MB, VmSize: 990 MB, VmRSS: 228 MB, VmData: 256 MB, maxrss: 0.232972 MB Stage srcs finished: 2020-08-07T13:32:33.481542 Resources for stage srcs : 0.091 s worker CPU, 0.107 s worker Wall, Wall: 0.681 s, Cores in use: 0.92, Total efficiency (on 32 cores): 2.9 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T13:32:33.495103 Blob 1 of 20, id: 8, sources: 10, size: 128x149, npix 13236, brick X: 62,190, Y: 71,220, one pixel: 104 71 Blob 2 of 20, id: 0, sources: 2, size: 59x45, npix 1782, brick X: 20,79, Y: 0,45, one pixel: 51 0 Blob 3 of 20, id: 3, sources: 2, size: 46x37, npix 1172, brick X: 223,269, Y: 19,56, one pixel: 237 19 Blob 4 of 20, id: 13, sources: 1, size: 45x39, npix 1145, brick X: 1,46, Y: 156,195, one pixel: 15 156 Blob 5 of 20, id: 17, sources: 1, size: 41x35, npix 970, brick X: 191,232, Y: 228,263, one pixel: 211 228 Blob 6 of 20, id: 11, sources: 1, size: 32x32, npix 700, brick X: 30,62, Y: 115,147, one pixel: 43 115 Blob 7 of 20, id: 18, sources: 2, size: 37x29, npix 636, brick X: 95,132, Y: 238,267, one pixel: 119 238 Blob 8 of 20, id: 12, sources: 1, size: 24x36, npix 613, brick X: 245,269, Y: 115,151, one pixel: 260 115 Blob 9 of 20, id: 10, sources: 1, size: 29x29, npix 556, brick X: 189,218, Y: 108,137, one pixel: 202 108 Blob 10 of 20, id: 2, sources: 2, size: 33x20, npix 467, brick X: 154,187, Y: 0,20, one pixel: 159 0 Blob 11 of 20, id: 14, sources: 1, size: 24x25, npix 371, brick X: 242,266, Y: 192,217, one pixel: 251 192 Blob 12 of 20, id: 1, sources: 1, size: 27x18, npix 344, brick X: 118,145, Y: 0,18, one pixel: 122 0 Blob 13 of 20, id: 19, sources: 2, size: 20x21, npix 328, brick X: 0,20, Y: 248,269, one pixel: 2 248 Blob 14 of 20, id: 15, sources: 1, size: 21x22, npix 300, brick X: 35,56, Y: 214,236, one pixel: 44 214 Blob 15 of 20, id: 5, sources: 1, size: 18x22, npix 255, brick X: 0,18, Y: 36,58, one pixel: 7 36 Blob 16 of 20, id: 9, sources: 1, size: 19x20, npix 209, brick X: 31,50, Y: 88,108, one pixel: 40 88 Blob 17 of 20, id: 16, sources: 1, size: 19x20, npix 209, brick X: 170,189, Y: 226,246, one pixel: 179 226 Blob 18 of 20, id: 7, sources: 1, size: 20x18, npix 207, brick X: 161,181, Y: 47,65, one pixel: 169 47 Blob 19 of 20, id: 4, sources: 1, size: 18x19, npix 189, brick X: 85,103, Y: 33,52, one pixel: 93 33 Blob 20 of 20, id: 6, sources: 1, size: 18x18, npix 180, brick X: 100,118, Y: 41,59, one pixel: 108 41 Blob 18 finished, total: Wall: 0.15 s, CPU: 0.07 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 82 MB, VmData: 137 MB, maxrss: 0.083892 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.38345, 67.27731), pm (-2.1, 0.5), parallax 0.093 with NanoMaggies: g=19.9, r=19.5, z=18.2 Reset brightness to NanoMaggies: g=19.5, r=18.6, z=18.2 Blob 20 finished, total: Wall: 0.17 s, CPU: 0.09 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 84 MB, VmData: 137 MB, maxrss: 0.085564 MB Blob 10 finished, total: Wall: 0.21 s, CPU: 0.13 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 82 MB, VmData: 137 MB, maxrss: 0.0844 MB Blob 17 finished, total: Wall: 0.20 s, CPU: 0.10 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 82 MB, VmData: 137 MB, maxrss: 0.08388 MB Blob 19 finished, total: Wall: 0.26 s, CPU: 0.21 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093308 MB Blob 14 finished, total: Wall: 0.32 s, CPU: 0.26 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145452 MB Blob 16 finished, total: Wall: 0.39 s, CPU: 0.33 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.09254 MB Blob 9 finished, total: Wall: 0.47 s, CPU: 0.38 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.08998 MB Blob 4 finished, total: Wall: 0.60 s, CPU: 0.55 s, VmPeak: 802 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145864 MB Blob 6 finished, total: Wall: 0.61 s, CPU: 0.54 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 138 MB, maxrss: 0.090236 MB Blob 7 finished, total: Wall: 0.62 s, CPU: 0.54 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.090768 MB Blob 11 finished, total: Wall: 0.65 s, CPU: 0.60 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145144 MB Measuring 1 iterative sources Blob 13 finished, total: Wall: 0.70 s, CPU: 0.63 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.09196 MB Blob 15 finished, total: Wall: 0.70 s, CPU: 0.65 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145524 MB Blob 8 finished, total: Wall: 0.74 s, CPU: 0.68 s, VmPeak: 803 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146288 MB Blob 12 finished, total: Wall: 0.75 s, CPU: 0.70 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092384 MB Blob 3 finished, total: Wall: 0.92 s, CPU: 0.84 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.0911 MB Blob 2 finished, total: Wall: 1.07 s, CPU: 1.00 s, VmPeak: 667 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.0912 MB Blob 5 finished, total: Wall: 1.10 s, CPU: 1.02 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.09118 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.566603, ee1=-0.016701, ee2=-0.35215 Measuring 2 iterative sources Blob 1 finished, total: Wall: 8.21 s, CPU: 8.21 s, VmPeak: 804 MB, VmSize: 728 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150908 MB Old catalog: 35 New catalog: 31 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/metrics/cus/blobs-custom-272390p67287.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/metrics/cus/all-models-custom-272390p67287.fits Stage fitblobs : Wall: 8.72 s, CPU: 0.54 s, VmPeak: 990 MB, VmSize: 990 MB, VmRSS: 228 MB, VmData: 256 MB, maxrss: 0.233392 MB Stage fitblobs finished: 2020-08-07T13:32:42.210891 Resources for stage fitblobs : 17.807 s worker CPU, 19.200 s worker Wall, Wall: 8.718 s, Cores in use: 2.10, Total efficiency (on 32 cores): 6.6 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T13:32:42.226122 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/tmp-legacysurvey-custom-272390p67287-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/tmp-legacysurvey-custom-272390p67287-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/tmp-legacysurvey-custom-272390p67287-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/tmp-legacysurvey-custom-272390p67287-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-resid.jpg Stage coadds : Wall: 2.04 s, CPU: 0.60 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 230 MB, VmData: 256 MB, maxrss: 0.235212 MB Stage coadds finished: 2020-08-07T13:32:44.267052 Resources for stage coadds : 24.343 s worker CPU, 25.390 s worker Wall, Wall: 2.043 s, Cores in use: 12.21, Total efficiency (on 32 cores): 38.2 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T13:32:44.280723 Cut to 1 unWISE tiles Reading WISE tile 2709p666 band 1 Reading WISE tile 2709p666 band 3 Reading WISE tile 2709p666 band 2 Reading WISE tile 2709p666 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 813 MB, VmSize: 798 MB, VmRSS: 143 MB, VmData: 176 MB, maxrss: 0.182872 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 803 MB, VmSize: 797 MB, VmRSS: 140 MB, VmData: 171 MB, maxrss: 0.202904 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 802 MB, VmSize: 797 MB, VmRSS: 140 MB, VmData: 171 MB, maxrss: 0.203036 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/270/2709p666/unwise-2709p666-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 805 MB, VmSize: 801 MB, VmRSS: 145 MB, VmData: 179 MB, maxrss: 0.200932 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/tmp-legacysurvey-custom-272390p67287-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/tmp-legacysurvey-custom-272390p67287-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.04 s, CPU: 0.60 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 230 MB, VmData: 256 MB, maxrss: 0.235932 MB Stage wise_forced finished: 2020-08-07T13:32:46.324840 Resources for stage wise_forced : 3.433 s worker CPU, 4.685 s worker Wall, Wall: 2.046 s, Cores in use: 1.97, Total efficiency (on 32 cores): 6.2 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T13:32:46.340260 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/coadd/cus/custom-272390p67287/legacysurvey-custom-272390p67287-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/tractor-i/cus/tractor-custom-272390p67287.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/tractor/cus/tractor-custom-272390p67287.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/tractor/cus/brick-custom-272390p67287.sha256sum Stage writecat : Wall: 0.94 s, CPU: 0.80 s, VmPeak: 1127 MB, VmSize: 999 MB, VmRSS: 232 MB, VmData: 256 MB, maxrss: 0.368816 MB Stage writecat finished: 2020-08-07T13:32:47.285283 Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.948 s, Cores in use: 0.85, Total efficiency (on 32 cores): 2.6 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2697718/PGC2697718-largegalaxy-writecat.p All done: 51.304 s worker CPU, 68.086 s worker Wall, Wall: 24.514 s, Cores in use: 2.43, Total efficiency (on 32 cores): 7.6 % Finished galaxy PGC2697718 in 0.444 minutes.