Started working on galaxy PGC2397869 at Wed Aug 5 18:44:45 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.573 51.661968200000004 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T18:44:46.404757 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '276.573', '51.661968200000004', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.573 51.661968200000004 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 276.573 51.661968200000004 Starting process 55664 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 55665 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 55666 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 55667 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 55668 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB Starting process 55669 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 55670 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 55671 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 55672 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 55673 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 55674 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 55675 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 55676 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 55677 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 55678 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 55679 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T18:44:46.860259 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 11 CCDs: k4m_170905_054428_ooi_zd_ls9-CCD3 z expnum 138321 exptime 100.104 propid 2016A-0453 seeing 1.27 MJD 58001.239 object MzLS_656665_z mosaic/CP/V4.3/CP20170904/k4m_170905_054428_ooi_zd_ls9.fits.fz k4m_170926_042840_ooi_zd_ls9-CCD3 z expnum 140885 exptime 148.103 propid 2016A-0453 seeing 1.37 MJD 58022.187 object MzLS_656665_z mosaic/CP/V4.3/CP20170925/k4m_170926_042840_ooi_zd_ls9.fits.fz k4m_160524_100301_ooi_zd_ls9-CCD4 z expnum 91260 exptime 80.103 propid 2016A-0453 seeing 1.09 MJD 57532.419 object MzLS_655883_z mosaic/CP/V4.3/CP20160523/k4m_160524_100301_ooi_zd_ls9.fits.fz k4m_160527_094915_ooi_zd_ls9-CCD3 z expnum 91886 exptime 80.105 propid 2016A-0453 seeing 0.75 MJD 57535.409 object MzLS_657443_z mosaic/CP/V4.3/CP20160526/k4m_160527_094915_ooi_zd_ls9.fits.fz k4m_160524_100908_ooi_zd_ls9-CCD2 z expnum 91263 exptime 80.105 propid 2016A-0453 seeing 1.19 MJD 57532.423 object MzLS_655884_z mosaic/CP/V4.3/CP20160523/k4m_160524_100908_ooi_zd_ls9.fits.fz ksb_170619_074223_ooi_g_ls9-CCD2 g expnum 79230108 exptime 235.8 propid BASS seeing 1.74 MJD 57923.321 object 29483 90prime/CP/V2.3/CP20170618/ksb_170619_074223_ooi_g_ls9.fits.fz ksb_170624_064226_ooi_r_ls9-CCD2 r expnum 79280080 exptime 82.27 propid BASS seeing 1.19 MJD 57928.279 object 29483 90prime/CP/V2.3/CP20170623/ksb_170624_064226_ooi_r_ls9.fits.fz ksb_160712_065419_ooi_r_ls9-CCD3 r expnum 75810086 exptime 182.7 propid BASS seeing 1.95 MJD 57581.288 object 28352 90prime/CP/V2.3/CP20160711/ksb_160712_065419_ooi_r_ls9.fits.fz ksb_160706_102046_ooi_g_ls9-CCD3 g expnum 75750124 exptime 171.0 propid BASS seeing 1.80 MJD 57575.431 object 28352 90prime/CP/V2.3/CP20160705/ksb_160706_102046_ooi_g_ls9.fits.fz ksb_170405_114235_ooi_r_ls9-CCD2 r expnum 78480186 exptime 62.704 propid BASS seeing 1.31 MJD 57848.488 object 29481 90prime/CP/V2.3/CP20170404/ksb_170405_114235_ooi_r_ls9.fits.fz ksb_180515_102448_ooi_g_ls9-CCD2 g expnum 82530159 exptime 92.952 propid NOTBASS seeing 1.27 MJD 58253.434 object 29481 90prime/CP/V2.3/CP20180514/ksb_180515_102448_ooi_g_ls9.fits.fz Faked up EXPNUM 75810086 Faked up EXPNUM 75810086 Faked up EXPNUM 75810086 90prime get_fwhm: self.fwhm = 4.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 784 920 and amp range 0 2015 and image y 335 471 and amp range 0 2047 Range in image: x 0 137 , y 0 137 (with image size 137 x 137) dzp -0.024507914 -> scaling image by 0.9776802328037623 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75750124 Faked up EXPNUM 75750124 Faked up EXPNUM 75750124 90prime get_fwhm: self.fwhm = 3.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 788 924 and amp range 0 2015 and image y 327 463 and amp range 0 2047 Range in image: x 0 137 , y 0 137 (with image size 137 x 137) dzp -0.03470582 -> scaling image by 0.9685402452207784 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 78480186 Faked up EXPNUM 78480186 Faked up EXPNUM 78480186 90prime get_fwhm: self.fwhm = 2.89 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2518 2654 and amp range 2016 4031 and image y 3389 3526 and amp range 2048 4095 Range in image: x 0 137 , y 0 138 (with image size 137 x 138) dzp 0.021366077 -> scaling image by 1.0198737893800265 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82530159 Faked up EXPNUM 82530159 Faked up EXPNUM 82530159 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2530 2667 and amp range 2016 4031 and image y 3378 3515 and amp range 2048 4095 Range in image: x 0 138 , y 0 138 (with image size 138 x 138) dzp 0.013237011 -> scaling image by 1.012266359574015 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 79280080 Faked up EXPNUM 79280080 Faked up EXPNUM 79280080 90prime get_fwhm: self.fwhm = 2.63 Found 4 relevant rows in amp-corrections file. Found overlap: image x 517 654 and amp range 0 2015 and image y 1382 1520 and amp range 0 2047 Range in image: x 0 138 , y 0 139 (with image size 138 x 139) dzp 0.005335051 -> scaling image by 1.0049258559887364 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 2.87 Found 4 relevant rows in amp-corrections file. Found overlap: image x 487 726 and amp range 0 2005 and image y 200 436 and amp range 0 2039 Range in image: x 0 240 , y 0 237 (with image size 240 x 237) dzp -0.005856539 -> scaling image by 0.9946204500110131 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 5.27 Found 4 relevant rows in amp-corrections file. mosaic get_fwhm: self.fwhm = 4.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3217 3453 and amp range 2006 4053 and image y 2850 3090 and amp range 2040 4078 Range in image: x 0 237 , y 0 241 (with image size 237 x 241) dzp 0.0056365696 -> scaling image by 1.005204971477435 Found overlap: image x 1625 1864 and amp range 0 2047 and image y 168 409 and amp range 0 2039 Range in image: x 0 240 , y 0 242 (with image size 240 x 242) dzp -0.006320339 -> scaling image by 0.9941956631368829 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.19 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1654 1895 and amp range 0 2047 and image y 3793 4034 and amp range 2022 4060 Range in image: x 0 242 , y 0 242 (with image size 242 x 242) dzp 0.0033053984 -> scaling image by 1.0030490232713904 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 79230108 Faked up EXPNUM 79230108 Faked up EXPNUM 79230108 90prime get_fwhm: self.fwhm = 3.83 Found 4 relevant rows in amp-corrections file. Found overlap: image x 487 624 and amp range 0 2015 and image y 1362 1500 and amp range 0 2047 Range in image: x 0 138 , y 0 139 (with image size 138 x 139) dzp 0.0003063402 -> scaling image by 1.0002821895558327 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.91 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3221 3458 and amp range 2006 4053 and image y 3115 3356 and amp range 2040 4078 Range in image: x 0 238 , y 0 242 (with image size 238 x 242) dzp 0.0056365696 -> scaling image by 1.005204971477435 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 33.99 s, CPU: 0.95 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 176 MB, VmData: 208 MB, maxrss: 0.219332 MB Stage tims finished: 2020-08-05T18:45:20.853813 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 7.033 s worker CPU, 122.221 s worker Wall, Wall: 33.995 s, Cores in use: 0.23, Total efficiency (on 16 cores): 1.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T18:45:20.888619 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01379.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01380.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01276.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01487.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/metrics/cus/reference-custom-276573p51661.fits Stage refs : Wall: 48.38 s, CPU: 4.56 s, VmPeak: 1026 MB, VmSize: 1020 MB, VmRSS: 241 MB, VmData: 271 MB, maxrss: 0.247192 MB Stage refs finished: 2020-08-05T18:46:09.273085 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 48.386 s, Cores in use: 0.09, Total efficiency (on 16 cores): 0.6 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T18:46:09.295242 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/metrics/cus/outlier-mask-custom-276573p51661.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/metrics/cus/outliers-pre-custom-276573p51661.jpg Image ksb_170619_074223_ooi_g_ls9-CCD2 g : masking 113 positive outlier pixels and 0 negative outlier pixels Image ksb_160712_065419_ooi_r_ls9-CCD3 r : masking 2142 positive outlier pixels and 0 negative outlier pixels Image k4m_170926_042840_ooi_zd_ls9-CCD3 z : masking 2441 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/metrics/cus/outlier-mask-custom-276573p51661.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/metrics/cus/outliers-post-custom-276573p51661.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/metrics/cus/outliers-masked-pos-custom-276573p51661.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/metrics/cus/outliers-masked-neg-custom-276573p51661.jpg Stage outliers : Wall: 0.78 s, CPU: 0.61 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 255 MB, VmData: 281 MB, maxrss: 0.260828 MB Stage outliers finished: 2020-08-05T18:46:10.074905 Resources for stage outliers : 0.668 s worker CPU, 0.743 s worker Wall, Wall: 0.781 s, Cores in use: 1.64, Total efficiency (on 16 cores): 10.3 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T18:46:10.148462 Stage halos : Wall: 0.21 s, CPU: 0.20 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 255 MB, VmData: 282 MB, maxrss: 0.26108 MB Stage halos finished: 2020-08-05T18:46:10.354964 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.208 s, Cores in use: 0.96, Total efficiency (on 16 cores): 6.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T18:46:10.379989 PSF sigmas in coadd pixels: ['2.82', '2.92', '2.07'] Using average PSF sigma 2.602894953294897 Gaussian PSF norm 0.10837732480013688 vs pixelized 0.084971435 average tim pixel scale / coadd scale: 1.7296505748927025 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.94', '3.17', '2.13'] Using average PSF sigma 2.4110764274010656 Gaussian PSF norm 0.11699952293837167 vs pixelized 0.09635499 average tim pixel scale / coadd scale: 1.729286532628684 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.07', '2.22', '1.77', '1.21', '1.94'] Using average PSF sigma 1.8409568070599527 Gaussian PSF norm 0.1532327052389619 vs pixelized 0.1357864 average tim pixel scale / coadd scale: 0.990897795640444 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-copsf-z.fits.fz Stage fit_on_coadds : Wall: 1.04 s, CPU: 0.15 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 256 MB, VmData: 282 MB, maxrss: 0.262572 MB Stage fit_on_coadds finished: 2020-08-05T18:46:11.420876 Resources for stage fit_on_coadds : 0.183 s worker CPU, 0.183 s worker Wall, Wall: 1.042 s, Cores in use: 0.32, Total efficiency (on 16 cores): 2.0 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T18:46:11.432695 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 34 potential peaks Of 34 potential peaks: 10 in veto map, 0 cut by saddle test, 0 cut by aper test, 24 kept SED z : 24 new peaks Found 23 potential peaks Of 23 potential peaks: 23 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 22 potential peaks Of 22 potential peaks: 20 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 37 potential peaks Of 37 potential peaks: 30 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 42 potential peaks Of 42 potential peaks: 35 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept SED Red : 3 new peaks Adding 31 new sources Median coadd sky for g : 0.00015754146 Median coadd sky for r : 0.00044674508 Median coadd sky for z : -0.00041342655 Stage srcs : Wall: 0.55 s, CPU: 0.51 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 257 MB, VmData: 282 MB, maxrss: 0.263076 MB Stage srcs finished: 2020-08-05T18:46:11.978704 Resources for stage srcs : 0.076 s worker CPU, 0.076 s worker Wall, Wall: 0.547 s, Cores in use: 1.07, Total efficiency (on 16 cores): 6.7 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T18:46:11.990755 Blob 1 of 16, id: 2, sources: 19, size: 165x176, npix 15199, brick X: 50,215, Y: 13,189, one pixel: 190 13 Blob 2 of 16, id: 12, sources: 6, size: 89x53, npix 3317, brick X: 112,201, Y: 180,233, one pixel: 143 180 Blob 3 of 16, id: 0, sources: 4, size: 82x60, npix 3025, brick X: 0,82, Y: 0,60, one pixel: 15 0 Blob 4 of 16, id: 5, sources: 2, size: 29x57, npix 1054, brick X: 204,233, Y: 95,152, one pixel: 222 95 Blob 5 of 16, id: 4, sources: 1, size: 41x30, npix 828, brick X: 37,78, Y: 65,95, one pixel: 52 65 Blob 6 of 16, id: 10, sources: 1, size: 34x34, npix 808, brick X: 83,117, Y: 179,213, one pixel: 97 179 Blob 7 of 16, id: 3, sources: 1, size: 31x33, npix 659, brick X: 202,233, Y: 35,68, one pixel: 226 35 Blob 8 of 16, id: 14, sources: 1, size: 28x33, npix 595, brick X: 2,30, Y: 199,232, one pixel: 11 199 Blob 9 of 16, id: 7, sources: 1, size: 25x25, npix 380, brick X: 12,37, Y: 119,144, one pixel: 23 119 Blob 10 of 16, id: 11, sources: 1, size: 22x22, npix 284, brick X: 10,32, Y: 180,202, one pixel: 20 180 Blob 11 of 16, id: 6, sources: 1, size: 21x21, npix 270, brick X: 50,71, Y: 98,119, one pixel: 58 98 Blob 12 of 16, id: 9, sources: 1, size: 19x19, npix 199, brick X: 193,212, Y: 170,189, one pixel: 202 170 Blob 13 of 16, id: 13, sources: 1, size: 19x19, npix 199, brick X: 208,227, Y: 183,202, one pixel: 216 183 Blob 14 of 16, id: 8, sources: 1, size: 18x18, npix 171, brick X: 184,202, Y: 140,158, one pixel: 192 140 Blob 15 of 16, id: 1, sources: 1, size: 17x18, npix 162, brick X: 84,101, Y: 11,29, one pixel: 92 11 Blob 16 of 16, id: 15, sources: 1, size: 17x15, npix 153, brick X: 83,100, Y: 218,233, one pixel: 91 218 Blob 11 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 86 MB, VmData: 138 MB, maxrss: 0.088324 MB Blob 15 finished, total: Wall: 0.10 s, CPU: 0.08 s, VmPeak: 814 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149488 MB Blob 13 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 805 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149616 MB Blob 16 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 90 MB, VmData: 137 MB, maxrss: 0.091872 MB Blob 14 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.094616 MB Blob 12 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 807 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149548 MB Measuring 1 iterative sources Blob 10 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.09288 MB Blob 9 finished, total: Wall: 0.66 s, CPU: 0.62 s, VmPeak: 805 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149164 MB Blob 6 finished, total: Wall: 0.72 s, CPU: 0.71 s, VmPeak: 805 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149148 MB Blob 7 finished, total: Wall: 0.88 s, CPU: 0.88 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150572 MB Blob 4 finished, total: Wall: 0.93 s, CPU: 0.92 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.092884 MB Blob 5 finished, total: Wall: 1.07 s, CPU: 1.06 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150792 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.58026, 51.65123), pm (-6.1, -4.6), parallax 0.449 with NanoMaggies: g=17.8, r=17, z=16.7 Reset brightness to NanoMaggies: g=17.8, r=17, z=16.7 Blob 3 finished, total: Wall: 1.08 s, CPU: 1.07 s, VmPeak: 804 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149836 MB Blob 8 finished, total: Wall: 1.16 s, CPU: 1.16 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150852 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.56405, 51.67705), pm (-8.1, 4.6), parallax 1.515 with NanoMaggies: g=17.5, r=16.2, z=15.6 Reset brightness to NanoMaggies: g=17.5, r=16.2, z=15.6 Measuring 1 iterative sources Blob 2 finished, total: Wall: 2.33 s, CPU: 2.33 s, VmPeak: 809 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151392 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.40493, ee1=-0.295146, ee2=0.364143 Measuring 5 iterative sources Blob 1 finished, total: Wall: 14.12 s, CPU: 14.11 s, VmPeak: 811 MB, VmSize: 733 MB, VmRSS: 150 MB, VmData: 184 MB, maxrss: 0.153732 MB Old catalog: 51 New catalog: 45 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/metrics/cus/blobs-custom-276573p51661.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/metrics/cus/all-models-custom-276573p51661.fits Stage fitblobs : Wall: 14.59 s, CPU: 0.49 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 257 MB, VmData: 282 MB, maxrss: 0.263244 MB Stage fitblobs finished: 2020-08-05T18:46:26.584971 Resources for stage fitblobs : 24.903 s worker CPU, 25.069 s worker Wall, Wall: 14.596 s, Cores in use: 1.74, Total efficiency (on 16 cores): 10.9 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T18:46:26.598461 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/tmp-legacysurvey-custom-276573p51661-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/tmp-legacysurvey-custom-276573p51661-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/tmp-legacysurvey-custom-276573p51661-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/tmp-legacysurvey-custom-276573p51661-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-resid.jpg Stage coadds : Wall: 2.12 s, CPU: 0.51 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 257 MB, VmData: 282 MB, maxrss: 0.263568 MB Stage coadds finished: 2020-08-05T18:46:28.722578 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 8.315 s worker CPU, 11.633 s worker Wall, Wall: 2.125 s, Cores in use: 4.15, Total efficiency (on 16 cores): 26.0 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T18:46:28.735681 Cut to 1 unWISE tiles Reading WISE tile 2765p514 band 1 Reading WISE tile 2765p514 band 2 Reading WISE tile 2765p514 band 4 Reading WISE tile 2765p514 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 811 MB, VmSize: 810 MB, VmRSS: 153 MB, VmData: 178 MB, maxrss: 0.196668 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 813 MB, VmSize: 804 MB, VmRSS: 145 MB, VmData: 172 MB, maxrss: 0.208536 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 813 MB, VmSize: 804 MB, VmRSS: 145 MB, VmData: 172 MB, maxrss: 0.20858 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 809 MB, VmSize: 806 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.210352 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/tmp-legacysurvey-custom-276573p51661-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/tmp-legacysurvey-custom-276573p51661-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 22.98 s, CPU: 0.56 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 258 MB, VmData: 282 MB, maxrss: 0.26408 MB Stage wise_forced finished: 2020-08-05T18:46:51.718140 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.153 s worker CPU, 26.050 s worker Wall, Wall: 22.984 s, Cores in use: 0.16, Total efficiency (on 16 cores): 1.0 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T18:46:51.732468 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/tractor-i/cus/tractor-custom-276573p51661.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/tractor/cus/tractor-custom-276573p51661.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/tractor/cus/brick-custom-276573p51661.sha256sum Stage writecat : Wall: 0.81 s, CPU: 0.57 s, VmPeak: 1163 MB, VmSize: 1035 MB, VmRSS: 260 MB, VmData: 282 MB, maxrss: 0.39696 MB Stage writecat finished: 2020-08-05T18:46:52.546246 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.815 s, Cores in use: 0.70, Total efficiency (on 16 cores): 4.4 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-writecat.p All done: 44.334 s worker CPU, 185.981 s worker Wall, Wall: 125.706 s, Cores in use: 0.43, Total efficiency (on 16 cores): 2.7 % Finished galaxy PGC2397869 in 2.125 minutes. Started working on galaxy PGC2397869 at Wed Aug 5 19:10:00 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.573 51.661968200000004 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T19:10:02.593186 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '276.573', '51.661968200000004', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.573 51.661968200000004 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 276.573 51.661968200000004 Starting process 59640 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 59641 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 59642 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 59643 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 59644 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB Starting process 59645 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 59646 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 59647 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 59648 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 59649 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 59650 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 59651 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 59652 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 59653 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 59654 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 59655 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 59656 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 59657 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 59658 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 59659 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 59660 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 59661 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 59662 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 59663 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 59664 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 59665 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 59666 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 59667 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 59668 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 59669 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 59670 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 59671 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T19:10:03.329798 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 11 CCDs: k4m_170905_054428_ooi_zd_ls9-CCD3 z expnum 138321 exptime 100.104 propid 2016A-0453 seeing 1.27 MJD 58001.239 object MzLS_656665_z mosaic/CP/V4.3/CP20170904/k4m_170905_054428_ooi_zd_ls9.fits.fz k4m_170926_042840_ooi_zd_ls9-CCD3 z expnum 140885 exptime 148.103 propid 2016A-0453 seeing 1.37 MJD 58022.187 object MzLS_656665_z mosaic/CP/V4.3/CP20170925/k4m_170926_042840_ooi_zd_ls9.fits.fz k4m_160524_100301_ooi_zd_ls9-CCD4 z expnum 91260 exptime 80.103 propid 2016A-0453 seeing 1.09 MJD 57532.419 object MzLS_655883_z mosaic/CP/V4.3/CP20160523/k4m_160524_100301_ooi_zd_ls9.fits.fz k4m_160527_094915_ooi_zd_ls9-CCD3 z expnum 91886 exptime 80.105 propid 2016A-0453 seeing 0.75 MJD 57535.409 object MzLS_657443_z mosaic/CP/V4.3/CP20160526/k4m_160527_094915_ooi_zd_ls9.fits.fz k4m_160524_100908_ooi_zd_ls9-CCD2 z expnum 91263 exptime 80.105 propid 2016A-0453 seeing 1.19 MJD 57532.423 object MzLS_655884_z mosaic/CP/V4.3/CP20160523/k4m_160524_100908_ooi_zd_ls9.fits.fz ksb_170619_074223_ooi_g_ls9-CCD2 g expnum 79230108 exptime 235.8 propid BASS seeing 1.74 MJD 57923.321 object 29483 90prime/CP/V2.3/CP20170618/ksb_170619_074223_ooi_g_ls9.fits.fz ksb_170624_064226_ooi_r_ls9-CCD2 r expnum 79280080 exptime 82.27 propid BASS seeing 1.19 MJD 57928.279 object 29483 90prime/CP/V2.3/CP20170623/ksb_170624_064226_ooi_r_ls9.fits.fz ksb_160712_065419_ooi_r_ls9-CCD3 r expnum 75810086 exptime 182.7 propid BASS seeing 1.95 MJD 57581.288 object 28352 90prime/CP/V2.3/CP20160711/ksb_160712_065419_ooi_r_ls9.fits.fz ksb_160706_102046_ooi_g_ls9-CCD3 g expnum 75750124 exptime 171.0 propid BASS seeing 1.80 MJD 57575.431 object 28352 90prime/CP/V2.3/CP20160705/ksb_160706_102046_ooi_g_ls9.fits.fz ksb_170405_114235_ooi_r_ls9-CCD2 r expnum 78480186 exptime 62.704 propid BASS seeing 1.31 MJD 57848.488 object 29481 90prime/CP/V2.3/CP20170404/ksb_170405_114235_ooi_r_ls9.fits.fz ksb_180515_102448_ooi_g_ls9-CCD2 g expnum 82530159 exptime 92.952 propid NOTBASS seeing 1.27 MJD 58253.434 object 29481 90prime/CP/V2.3/CP20180514/ksb_180515_102448_ooi_g_ls9.fits.fz Faked up EXPNUM 82530159 Faked up EXPNUM 82530159 Faked up EXPNUM 82530159 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2530 2667 and amp range 2016 4031 and image y 3378 3515 and amp range 2048 4095 Range in image: x 0 138 , y 0 138 (with image size 138 x 138) dzp 0.013237011 -> scaling image by 1.012266359574015 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 5.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3217 3453 and amp range 2006 4053 and image y 2850 3090 and amp range 2040 4078 Range in image: x 0 237 , y 0 241 (with image size 237 x 241) dzp 0.0056365696 -> scaling image by 1.005204971477435 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 2.87 Found 4 relevant rows in amp-corrections file. Found overlap: image x 487 726 and amp range 0 2005 and image y 200 436 and amp range 0 2039 Range in image: x 0 240 , y 0 237 (with image size 240 x 237) dzp -0.005856539 -> scaling image by 0.9946204500110131 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 79280080 Faked up EXPNUM 79280080 Faked up EXPNUM 79280080 90prime get_fwhm: self.fwhm = 2.63 Found 4 relevant rows in amp-corrections file. Found overlap: image x 517 654 and amp range 0 2015 and image y 1382 1520 and amp range 0 2047 Range in image: x 0 138 , y 0 139 (with image size 138 x 139) dzp 0.005335051 -> scaling image by 1.0049258559887364 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75810086 Faked up EXPNUM 75810086 Faked up EXPNUM 75810086 90prime get_fwhm: self.fwhm = 4.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 784 920 and amp range 0 2015 and image y 335 471 and amp range 0 2047 Range in image: x 0 137 , y 0 137 (with image size 137 x 137) dzp -0.024507914 -> scaling image by 0.9776802328037623 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1625 1864 and amp range 0 2047 and image y 168 409 and amp range 0 2039 Range in image: x 0 240 , y 0 242 (with image size 240 x 242) dzp -0.006320339 -> scaling image by 0.9941956631368829 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75750124 Faked up EXPNUM 75750124 Faked up EXPNUM 75750124 90prime get_fwhm: self.fwhm = 3.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 788 924 and amp range 0 2015 and image y 327 463 and amp range 0 2047 Range in image: x 0 137 , y 0 137 (with image size 137 x 137) dzp -0.03470582 -> scaling image by 0.9685402452207784 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.91 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3221 3458 and amp range 2006 4053 and image y 3115 3356 and amp range 2040 4078 Range in image: x 0 238 , y 0 242 (with image size 238 x 242) dzp 0.0056365696 -> scaling image by 1.005204971477435 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.19 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1654 1895 and amp range 0 2047 and image y 3793 4034 and amp range 2022 4060 Range in image: x 0 242 , y 0 242 (with image size 242 x 242) dzp 0.0033053984 -> scaling image by 1.0030490232713904 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 79230108 Faked up EXPNUM 79230108 Faked up EXPNUM 79230108 90prime get_fwhm: self.fwhm = 3.83 Found 4 relevant rows in amp-corrections file. Found overlap: image x 487 624 and amp range 0 2015 and image y 1362 1500 and amp range 0 2047 Range in image: x 0 138 , y 0 139 (with image size 138 x 139) dzp 0.0003063402 -> scaling image by 1.0002821895558327 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 78480186 Faked up EXPNUM 78480186 Faked up EXPNUM 78480186 90prime get_fwhm: self.fwhm = 2.89 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2518 2654 and amp range 2016 4031 and image y 3389 3526 and amp range 2048 4095 Range in image: x 0 137 , y 0 138 (with image size 137 x 138) dzp 0.021366077 -> scaling image by 1.0198737893800265 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 8.56 s, CPU: 1.06 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 176 MB, VmData: 208 MB, maxrss: 0.21792 MB Stage tims finished: 2020-08-05T19:10:11.889953 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 5.959 s worker CPU, 35.589 s worker Wall, Wall: 8.563 s, Cores in use: 0.82, Total efficiency (on 32 cores): 2.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T19:10:16.909981 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01379.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01380.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01276.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01487.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/metrics/cus/reference-custom-276573p51661.fits Stage refs : Wall: 8.07 s, CPU: 5.36 s, VmPeak: 1026 MB, VmSize: 1020 MB, VmRSS: 241 MB, VmData: 270 MB, maxrss: 0.24656 MB Stage refs finished: 2020-08-05T19:10:24.975473 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 8.068 s, Cores in use: 0.66, Total efficiency (on 32 cores): 2.1 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T19:10:25.034895 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/metrics/cus/outlier-mask-custom-276573p51661.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/metrics/cus/outliers-pre-custom-276573p51661.jpg Image ksb_170619_074223_ooi_g_ls9-CCD2 g : masking 113 positive outlier pixels and 0 negative outlier pixels Image ksb_160712_065419_ooi_r_ls9-CCD3 r : masking 2142 positive outlier pixels and 0 negative outlier pixels Image k4m_170926_042840_ooi_zd_ls9-CCD3 z : masking 2441 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/metrics/cus/outlier-mask-custom-276573p51661.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/metrics/cus/outliers-post-custom-276573p51661.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/metrics/cus/outliers-masked-pos-custom-276573p51661.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/metrics/cus/outliers-masked-neg-custom-276573p51661.jpg Stage outliers : Wall: 1.85 s, CPU: 1.15 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 255 MB, VmData: 282 MB, maxrss: 0.26142 MB Stage outliers finished: 2020-08-05T19:10:26.889295 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage outliers : 0.813 s worker CPU, 1.383 s worker Wall, Wall: 1.857 s, Cores in use: 1.06, Total efficiency (on 32 cores): 3.3 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T19:10:26.915221 Stage halos : Wall: 1.12 s, CPU: 1.09 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 256 MB, VmData: 282 MB, maxrss: 0.261756 MB Stage halos finished: 2020-08-05T19:10:28.035582 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 1.122 s, Cores in use: 0.97, Total efficiency (on 32 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T19:10:28.170217 PSF sigmas in coadd pixels: ['2.82', '2.92', '2.07'] Using average PSF sigma 2.602894953294897 Gaussian PSF norm 0.10837732480013688 vs pixelized 0.084971435 average tim pixel scale / coadd scale: 1.7296505748927025 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.94', '3.17', '2.13'] Using average PSF sigma 2.4110764274010656 Gaussian PSF norm 0.11699952293837167 vs pixelized 0.09635499 average tim pixel scale / coadd scale: 1.729286532628684 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.07', '2.22', '1.77', '1.21', '1.94'] Using average PSF sigma 1.8409568070599527 Gaussian PSF norm 0.1532327052389619 vs pixelized 0.1357864 average tim pixel scale / coadd scale: 0.990897795640444 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.17 s, CPU: 0.16 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 257 MB, VmData: 282 MB, maxrss: 0.263224 MB Stage fit_on_coadds finished: 2020-08-05T19:10:28.344287 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.155 s worker CPU, 0.155 s worker Wall, Wall: 0.176 s, Cores in use: 1.78, Total efficiency (on 32 cores): 5.6 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-fit_on_coadds.p Running stage srcs Warning: Stellar halo subtraction is only implemented for DECam Running stage srcs at 2020-08-05T19:10:28.359309 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 34 potential peaks Of 34 potential peaks: 10 in veto map, 0 cut by saddle test, 0 cut by aper test, 24 kept SED z : 24 new peaks Found 23 potential peaks Of 23 potential peaks: 23 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 22 potential peaks Of 22 potential peaks: 20 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 37 potential peaks Of 37 potential peaks: 30 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 42 potential peaks Of 42 potential peaks: 35 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept SED Red : 3 new peaks Adding 31 new sources Median coadd sky for g : 0.00015754148 Median coadd sky for r : 0.00044674508 Median coadd sky for z : -0.00041342666 Stage srcs : Wall: 0.97 s, CPU: 0.91 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 258 MB, VmData: 282 MB, maxrss: 0.263728 MB Stage srcs finished: 2020-08-05T19:10:29.324872 Resources for stage srcs : 0.091 s worker CPU, 0.091 s worker Wall, Wall: 0.968 s, Cores in use: 1.04, Total efficiency (on 32 cores): 3.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T19:10:29.338717 Blob 1 of 16, id: 2, sources: 19, size: 165x176, npix 15199, brick X: 50,215, Y: 13,189, one pixel: 190 13 Blob 2 of 16, id: 12, sources: 6, size: 89x53, npix 3317, brick X: 112,201, Y: 180,233, one pixel: 143 180 Blob 3 of 16, id: 0, sources: 4, size: 82x60, npix 3025, brick X: 0,82, Y: 0,60, one pixel: 15 0 Blob 4 of 16, id: 5, sources: 2, size: 29x57, npix 1054, brick X: 204,233, Y: 95,152, one pixel: 222 95 Blob 5 of 16, id: 4, sources: 1, size: 41x30, npix 828, brick X: 37,78, Y: 65,95, one pixel: 52 65 Blob 6 of 16, id: 10, sources: 1, size: 34x34, npix 808, brick X: 83,117, Y: 179,213, one pixel: 97 179 Blob 7 of 16, id: 3, sources: 1, size: 31x33, npix 659, brick X: 202,233, Y: 35,68, one pixel: 226 35 Blob 8 of 16, id: 14, sources: 1, size: 28x33, npix 595, brick X: 2,30, Y: 199,232, one pixel: 11 199 Blob 9 of 16, id: 7, sources: 1, size: 25x25, npix 380, brick X: 12,37, Y: 119,144, one pixel: 23 119 Blob 10 of 16, id: 11, sources: 1, size: 22x22, npix 284, brick X: 10,32, Y: 180,202, one pixel: 20 180 Blob 11 of 16, id: 6, sources: 1, size: 21x21, npix 270, brick X: 50,71, Y: 98,119, one pixel: 58 98 Blob 12 of 16, id: 9, sources: 1, size: 19x19, npix 199, brick X: 193,212, Y: 170,189, one pixel: 202 170 Blob 13 of 16, id: 13, sources: 1, size: 19x19, npix 199, brick X: 208,227, Y: 183,202, one pixel: 216 183 Blob 14 of 16, id: 8, sources: 1, size: 18x18, npix 171, brick X: 184,202, Y: 140,158, one pixel: 192 140 Blob 15 of 16, id: 1, sources: 1, size: 17x18, npix 162, brick X: 84,101, Y: 11,29, one pixel: 92 11 Blob 16 of 16, id: 15, sources: 1, size: 17x15, npix 153, brick X: 83,100, Y: 218,233, one pixel: 91 218 Blob 15 finished, total: Wall: 0.11 s, CPU: 0.10 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 86 MB, VmData: 139 MB, maxrss: 0.087968 MB Blob 11 finished, total: Wall: 0.11 s, CPU: 0.10 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 87 MB, VmData: 139 MB, maxrss: 0.088792 MB Blob 13 finished, total: Wall: 0.18 s, CPU: 0.17 s, VmPeak: 804 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149304 MB Blob 16 finished, total: Wall: 0.21 s, CPU: 0.20 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.09426 MB Blob 12 finished, total: Wall: 0.23 s, CPU: 0.22 s, VmPeak: 812 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150088 MB Blob 14 finished, total: Wall: 0.23 s, CPU: 0.22 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 90 MB, VmData: 137 MB, maxrss: 0.091736 MB Measuring 1 iterative sources Blob 9 finished, total: Wall: 0.48 s, CPU: 0.46 s, VmPeak: 811 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149912 MB Blob 10 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.093712 MB Blob 6 finished, total: Wall: 0.58 s, CPU: 0.57 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.09324 MB Blob 4 finished, total: Wall: 0.79 s, CPU: 0.78 s, VmPeak: 809 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150476 MB Blob 7 finished, total: Wall: 0.79 s, CPU: 0.78 s, VmPeak: 807 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149676 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.58026, 51.65123), pm (-6.1, -4.6), parallax 0.449 with NanoMaggies: g=17.8, r=17, z=16.7 Reset brightness to NanoMaggies: g=17.8, r=17, z=16.7 Blob 3 finished, total: Wall: 0.97 s, CPU: 0.96 s, VmPeak: 670 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.095348 MB Blob 8 finished, total: Wall: 1.03 s, CPU: 1.03 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.0952 MB Blob 5 finished, total: Wall: 1.12 s, CPU: 1.11 s, VmPeak: 805 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149552 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.56405, 51.67705), pm (-8.1, 4.6), parallax 1.515 with NanoMaggies: g=17.5, r=16.2, z=15.6 Reset brightness to NanoMaggies: g=17.5, r=16.2, z=15.6 Measuring 1 iterative sources Blob 2 finished, total: Wall: 2.25 s, CPU: 2.24 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.15154 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.40493, ee1=-0.295146, ee2=0.364143 Measuring 5 iterative sources Blob 1 finished, total: Wall: 14.95 s, CPU: 14.95 s, VmPeak: 689 MB, VmSize: 686 MB, VmRSS: 112 MB, VmData: 157 MB, maxrss: 0.117112 MB Old catalog: 51 New catalog: 45 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/metrics/cus/blobs-custom-276573p51661.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/metrics/cus/all-models-custom-276573p51661.fits Stage fitblobs : Wall: 16.05 s, CPU: 1.05 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 258 MB, VmData: 282 MB, maxrss: 0.263896 MB Stage fitblobs finished: 2020-08-05T19:10:45.390325 Resources for stage fitblobs : 24.638 s worker CPU, 25.210 s worker Wall, Wall: 16.054 s, Cores in use: 1.60, Total efficiency (on 32 cores): 5.0 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T19:10:45.413422 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/tmp-legacysurvey-custom-276573p51661-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/tmp-legacysurvey-custom-276573p51661-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/tmp-legacysurvey-custom-276573p51661-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/tmp-legacysurvey-custom-276573p51661-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-resid.jpg Stage coadds : Wall: 10.90 s, CPU: 1.27 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 258 MB, VmData: 282 MB, maxrss: 0.26422 MB Stage coadds finished: 2020-08-05T19:10:56.308625 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 25.626 s worker CPU, 44.054 s worker Wall, Wall: 10.898 s, Cores in use: 2.47, Total efficiency (on 32 cores): 7.7 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T19:10:56.328150 Cut to 1 unWISE tiles Reading WISE tile 2765p514 band 1 Reading WISE tile 2765p514 band 2 Reading WISE tile 2765p514 band 3 Reading WISE tile 2765p514 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 809 MB, VmSize: 809 MB, VmRSS: 150 MB, VmData: 176 MB, maxrss: 0.195656 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 805 MB, VmSize: 802 MB, VmRSS: 143 MB, VmData: 174 MB, maxrss: 0.205796 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 808 MB, VmSize: 806 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.21064 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 808 MB, VmSize: 806 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.210496 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/tmp-legacysurvey-custom-276573p51661-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/tmp-legacysurvey-custom-276573p51661-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 5.87 s, CPU: 0.89 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 259 MB, VmData: 282 MB, maxrss: 0.264732 MB Stage wise_forced finished: 2020-08-05T19:11:02.198919 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.245 s worker CPU, 10.150 s worker Wall, Wall: 5.873 s, Cores in use: 0.71, Total efficiency (on 32 cores): 2.2 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T19:11:02.220732 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/coadd/cus/custom-276573p51661/legacysurvey-custom-276573p51661-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/tractor-i/cus/tractor-custom-276573p51661.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/tractor/cus/tractor-custom-276573p51661.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/tractor/cus/brick-custom-276573p51661.sha256sum Stage writecat : Wall: 1.69 s, CPU: 1.26 s, VmPeak: 1163 MB, VmSize: 1035 MB, VmRSS: 260 MB, VmData: 282 MB, maxrss: 0.397612 MB Stage writecat finished: 2020-08-05T19:11:03.915513 Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 1.697 s, Cores in use: 0.75, Total efficiency (on 32 cores): 2.3 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC2397869/PGC2397869-largegalaxy-writecat.p All done: 60.533 s worker CPU, 116.638 s worker Wall, Wall: 60.613 s, Cores in use: 1.24, Total efficiency (on 32 cores): 3.9 % Finished galaxy PGC2397869 in 1.058 minutes. Started working on galaxy PGC2397869 at Fri Aug 7 09:19:44 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.5717609516164 51.66182827516561 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T09:19:45.572977 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '276.5717609516164', '51.66182827516561', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.5717609516164 51.66182827516561 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 276.5717609516164 51.66182827516561 Starting process 27300 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 27301 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 27302 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 27304 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 27306 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 27308 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 27310 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 27312 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 27314 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 27316 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 27319 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 27317 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 27321 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 27326 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 27328 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 27324 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T09:19:46.134819 Keeping 11 CCDs: k4m_170905_054428_ooi_zd_ls9-CCD3 z expnum 138321 exptime 100.104 propid 2016A-0453 seeing 1.27 MJD 58001.239 object MzLS_656665_z mosaic/CP/V4.3/CP20170904/k4m_170905_054428_ooi_zd_ls9.fits.fz k4m_170926_042840_ooi_zd_ls9-CCD3 z expnum 140885 exptime 148.103 propid 2016A-0453 seeing 1.37 MJD 58022.187 object MzLS_656665_z mosaic/CP/V4.3/CP20170925/k4m_170926_042840_ooi_zd_ls9.fits.fz k4m_160524_100301_ooi_zd_ls9-CCD4 z expnum 91260 exptime 80.103 propid 2016A-0453 seeing 1.09 MJD 57532.419 object MzLS_655883_z mosaic/CP/V4.3/CP20160523/k4m_160524_100301_ooi_zd_ls9.fits.fz k4m_160527_094915_ooi_zd_ls9-CCD3 z expnum 91886 exptime 80.105 propid 2016A-0453 seeing 0.75 MJD 57535.409 object MzLS_657443_z mosaic/CP/V4.3/CP20160526/k4m_160527_094915_ooi_zd_ls9.fits.fz k4m_160524_100908_ooi_zd_ls9-CCD2 z expnum 91263 exptime 80.105 propid 2016A-0453 seeing 1.19 MJD 57532.423 object MzLS_655884_z mosaic/CP/V4.3/CP20160523/k4m_160524_100908_ooi_zd_ls9.fits.fz ksb_170619_074223_ooi_g_ls9-CCD2 g expnum 79230108 exptime 235.8 propid BASS seeing 1.74 MJD 57923.321 object 29483 90prime/CP/V2.3/CP20170618/ksb_170619_074223_ooi_g_ls9.fits.fz ksb_170624_064226_ooi_r_ls9-CCD2 r expnum 79280080 exptime 82.27 propid BASS seeing 1.19 MJD 57928.279 object 29483 90prime/CP/V2.3/CP20170623/ksb_170624_064226_ooi_r_ls9.fits.fz ksb_160712_065419_ooi_r_ls9-CCD3 r expnum 75810086 exptime 182.7 propid BASS seeing 1.95 MJD 57581.288 object 28352 90prime/CP/V2.3/CP20160711/ksb_160712_065419_ooi_r_ls9.fits.fz ksb_160706_102046_ooi_g_ls9-CCD3 g expnum 75750124 exptime 171.0 propid BASS seeing 1.80 MJD 57575.431 object 28352 90prime/CP/V2.3/CP20160705/ksb_160706_102046_ooi_g_ls9.fits.fz ksb_170405_114235_ooi_r_ls9-CCD2 r expnum 78480186 exptime 62.704 propid BASS seeing 1.31 MJD 57848.488 object 29481 90prime/CP/V2.3/CP20170404/ksb_170405_114235_ooi_r_ls9.fits.fz ksb_180515_102448_ooi_g_ls9-CCD2 g expnum 82530159 exptime 92.952 propid NOTBASS seeing 1.27 MJD 58253.434 object 29481 90prime/CP/V2.3/CP20180514/ksb_180515_102448_ooi_g_ls9.fits.fz mosaic get_fwhm: self.fwhm = 4.91 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3219 3456 and amp range 2006 4053 and image y 3105 3345 and amp range 2040 4078 Range in image: x 0 238 , y 0 241 (with image size 238 x 241) dzp 0.0056365696 -> scaling image by 1.005204971477435 mosaic get_fwhm: self.fwhm = 2.87 Found 4 relevant rows in amp-corrections file. mosaic get_fwhm: self.fwhm = 5.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 485 724 and amp range 0 2005 and image y 190 426 and amp range 0 2039 Range in image: x 0 240 , y 0 237 (with image size 240 x 237) dzp -0.005856539 -> scaling image by 0.9946204500110131 Found overlap: image x 3215 3451 and amp range 2006 4053 and image y 2839 3079 and amp range 2040 4078 Range in image: x 0 237 , y 0 241 (with image size 237 x 241) dzp 0.0056365696 -> scaling image by 1.005204971477435 mosaic get_fwhm: self.fwhm = 4.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1623 1862 and amp range 0 2047 and image y 157 398 and amp range 0 2039 Range in image: x 0 240 , y 0 242 (with image size 240 x 242) dzp -0.006320339 -> scaling image by 0.9941956631368829 Faked up EXPNUM 79230108 Faked up EXPNUM 79230108 Faked up EXPNUM 79230108 90prime get_fwhm: self.fwhm = 3.83 Found 4 relevant rows in amp-corrections file. Found overlap: image x 488 625 and amp range 0 2015 and image y 1368 1506 and amp range 0 2047 Range in image: x 0 138 , y 0 139 (with image size 138 x 139) dzp 0.0003063402 -> scaling image by 1.0002821895558327 Faked up EXPNUM 75750124 Faked up EXPNUM 75750124 Faked up EXPNUM 75750124 90prime get_fwhm: self.fwhm = 3.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 789 925 and amp range 0 2015 and image y 333 469 and amp range 0 2047 Range in image: x 0 137 , y 0 137 (with image size 137 x 137) dzp -0.03470582 -> scaling image by 0.9685402452207784 Faked up EXPNUM 82530159 Faked up EXPNUM 82530159 Faked up EXPNUM 82530159 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2531 2668 and amp range 2016 4031 and image y 3384 3521 and amp range 2048 4095 Range in image: x 0 138 , y 0 138 (with image size 138 x 138) dzp 0.013237011 -> scaling image by 1.012266359574015 Faked up EXPNUM 79280080 Faked up EXPNUM 79280080 Faked up EXPNUM 79280080 90prime get_fwhm: self.fwhm = 2.63 Found 4 relevant rows in amp-corrections file. Found overlap: image x 518 655 and amp range 0 2015 and image y 1388 1526 and amp range 0 2047 Range in image: x 0 138 , y 0 139 (with image size 138 x 139) dzp 0.005335051 -> scaling image by 1.0049258559887364 Faked up EXPNUM 75810086 Faked up EXPNUM 75810086 Faked up EXPNUM 75810086 90prime get_fwhm: self.fwhm = 4.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 785 922 and amp range 0 2015 and image y 342 477 and amp range 0 2047 Range in image: x 0 138 , y 0 136 (with image size 138 x 136) dzp -0.024507914 -> scaling image by 0.9776802328037623 Faked up EXPNUM 78480186 Faked up EXPNUM 78480186 Faked up EXPNUM 78480186 90prime get_fwhm: self.fwhm = 2.89 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2519 2656 and amp range 2016 4031 and image y 3396 3532 and amp range 2048 4095 Range in image: x 0 138 , y 0 137 (with image size 138 x 137) dzp 0.021366077 -> scaling image by 1.0198737893800265 mosaic get_fwhm: self.fwhm = 4.19 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1652 1893 and amp range 0 2047 and image y 3783 4023 and amp range 2022 4060 Range in image: x 0 242 , y 0 241 (with image size 242 x 241) dzp 0.0033053984 -> scaling image by 1.0030490232713904 Stage tims : Wall: 156.64 s, CPU: 1.06 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.178416 MB Stage tims finished: 2020-08-07T09:22:22.776826 Resources for stage tims : 5.590 s worker CPU, 365.958 s worker Wall, Wall: 156.644 s, Cores in use: 0.04, Total efficiency (on 16 cores): 0.3 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T09:22:27.089467 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01379.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01380.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01276.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01487.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/metrics/cus/reference-custom-276571p51661.fits Stage refs : Wall: 5.74 s, CPU: 4.66 s, VmPeak: 1019 MB, VmSize: 1014 MB, VmRSS: 239 MB, VmData: 271 MB, maxrss: 0.244876 MB Stage refs finished: 2020-08-07T09:22:32.827424 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.740 s, Cores in use: 0.81, Total efficiency (on 16 cores): 5.1 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T09:22:32.866746 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/metrics/cus/outlier-mask-custom-276571p51661.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/metrics/cus/outliers-pre-custom-276571p51661.jpg Image ksb_170619_074223_ooi_g_ls9-CCD2 g : masking 110 positive outlier pixels and 0 negative outlier pixels Image ksb_160712_065419_ooi_r_ls9-CCD3 r : masking 2080 positive outlier pixels and 0 negative outlier pixels Image k4m_170926_042840_ooi_zd_ls9-CCD3 z : masking 2555 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/metrics/cus/outlier-mask-custom-276571p51661.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/metrics/cus/outliers-post-custom-276571p51661.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/metrics/cus/outliers-masked-pos-custom-276571p51661.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/metrics/cus/outliers-masked-neg-custom-276571p51661.jpg Stage outliers : Wall: 0.88 s, CPU: 0.69 s, VmPeak: 1024 MB, VmSize: 1024 MB, VmRSS: 252 MB, VmData: 280 MB, maxrss: 0.258088 MB Stage outliers finished: 2020-08-07T09:22:33.744868 Resources for stage outliers : 0.654 s worker CPU, 0.731 s worker Wall, Wall: 0.880 s, Cores in use: 1.53, Total efficiency (on 16 cores): 9.6 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T09:22:33.768782 Stage halos : Wall: 0.27 s, CPU: 0.26 s, VmPeak: 1024 MB, VmSize: 1024 MB, VmRSS: 252 MB, VmData: 281 MB, maxrss: 0.258516 MB Stage halos finished: 2020-08-07T09:22:34.037863 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.271 s, Cores in use: 0.96, Total efficiency (on 16 cores): 6.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T09:22:34.137590 PSF sigmas in coadd pixels: ['2.82', '2.92', '2.07'] Using average PSF sigma 2.602894953294897 Gaussian PSF norm 0.10837732480013688 vs pixelized 0.08496977 average tim pixel scale / coadd scale: 1.7296505748927025 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.94', '3.17', '2.13'] Using average PSF sigma 2.4110764274010656 Gaussian PSF norm 0.11699952293837167 vs pixelized 0.09635607 average tim pixel scale / coadd scale: 1.729286532628684 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.07', '2.22', '1.77', '1.21', '1.94'] Using average PSF sigma 1.8409568070599527 Gaussian PSF norm 0.1532327052389619 vs pixelized 0.13578466 average tim pixel scale / coadd scale: 0.990897795640444 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.16 s, CPU: 0.15 s, VmPeak: 1024 MB, VmSize: 1024 MB, VmRSS: 255 MB, VmData: 282 MB, maxrss: 0.261204 MB Stage fit_on_coadds finished: 2020-08-07T09:22:34.293089 Resources for stage fit_on_coadds : 0.165 s worker CPU, 0.165 s worker Wall, Wall: 0.157 s, Cores in use: 2.03, Total efficiency (on 16 cores): 12.7 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T09:22:34.302844 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 36 potential peaks Of 36 potential peaks: 10 in veto map, 1 cut by saddle test, 0 cut by aper test, 25 kept SED z : 25 new peaks Found 22 potential peaks Of 22 potential peaks: 22 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 22 potential peaks Of 22 potential peaks: 19 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 36 potential peaks Of 36 potential peaks: 31 in veto map, 2 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 43 potential peaks Of 43 potential peaks: 37 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 32 new sources Median coadd sky for g : 0.00015355367 Median coadd sky for r : 0.0004693864 Median coadd sky for z : -0.00049772696 Stage srcs : Wall: 0.45 s, CPU: 0.42 s, VmPeak: 1024 MB, VmSize: 1024 MB, VmRSS: 256 MB, VmData: 282 MB, maxrss: 0.261952 MB Stage srcs finished: 2020-08-07T09:22:34.753340 Resources for stage srcs : 0.075 s worker CPU, 0.075 s worker Wall, Wall: 0.452 s, Cores in use: 1.09, Total efficiency (on 16 cores): 6.8 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T09:22:34.786089 Blob 1 of 15, id: 3, sources: 19, size: 164x176, npix 15239, brick X: 40,204, Y: 15,191, one pixel: 179 15 Blob 2 of 15, id: 0, sources: 4, size: 71x97, npix 3794, brick X: 0,71, Y: 0,97, one pixel: 6 0 Blob 3 of 15, id: 12, sources: 6, size: 89x51, npix 3157, brick X: 101,190, Y: 182,233, one pixel: 132 182 Blob 4 of 15, id: 5, sources: 3, size: 39x74, npix 1758, brick X: 194,233, Y: 97,171, one pixel: 211 97 Blob 5 of 15, id: 10, sources: 1, size: 34x34, npix 812, brick X: 73,107, Y: 181,215, one pixel: 86 181 Blob 6 of 15, id: 4, sources: 2, size: 37x33, npix 727, brick X: 191,228, Y: 36,69, one pixel: 216 36 Blob 7 of 15, id: 14, sources: 1, size: 20x27, npix 379, brick X: 0,20, Y: 206,233, one pixel: 4 206 Blob 8 of 15, id: 7, sources: 1, size: 24x25, npix 376, brick X: 2,26, Y: 121,146, one pixel: 12 121 Blob 9 of 15, id: 11, sources: 1, size: 22x22, npix 294, brick X: 0,22, Y: 182,204, one pixel: 9 182 Blob 10 of 15, id: 6, sources: 1, size: 21x21, npix 269, brick X: 39,60, Y: 100,121, one pixel: 47 100 Blob 11 of 15, id: 13, sources: 1, size: 20x19, npix 209, brick X: 197,217, Y: 185,204, one pixel: 205 185 Blob 12 of 15, id: 1, sources: 1, size: 19x19, npix 199, brick X: 207,226, Y: 10,29, one pixel: 216 10 Blob 13 of 15, id: 9, sources: 1, size: 19x19, npix 199, brick X: 183,202, Y: 172,191, one pixel: 191 172 Blob 14 of 15, id: 2, sources: 1, size: 18x18, npix 180, brick X: 73,91, Y: 13,31, one pixel: 81 13 Blob 15 of 15, id: 8, sources: 1, size: 18x18, npix 180, brick X: 174,192, Y: 142,160, one pixel: 182 142 Blob 14 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 804 MB, VmSize: 724 MB, VmRSS: 140 MB, VmData: 182 MB, maxrss: 0.143844 MB Blob 10 finished, total: Wall: 0.10 s, CPU: 0.09 s, VmPeak: 805 MB, VmSize: 724 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144592 MB Blob 12 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 807 MB, VmSize: 724 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144836 MB Blob 15 finished, total: Wall: 0.26 s, CPU: 0.25 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.0949 MB Blob 13 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146104 MB Blob 8 finished, total: Wall: 0.48 s, CPU: 0.48 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146088 MB Blob 11 finished, total: Wall: 0.60 s, CPU: 0.59 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146096 MB Blob 9 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.094648 MB Blob 6 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.093008 MB Blob 5 finished, total: Wall: 0.88 s, CPU: 0.88 s, VmPeak: 805 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145904 MB Blob 4 finished, total: Wall: 0.92 s, CPU: 0.92 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145276 MB Blob 7 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146828 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.56405, 51.67705), pm (-8.1, 4.6), parallax 1.515 with NanoMaggies: g=17.5, r=16.2, z=15.6 Reset brightness to NanoMaggies: g=17.5, r=16.2, z=15.6 Blob 3 finished, total: Wall: 1.67 s, CPU: 1.67 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097472 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.58026, 51.65123), pm (-6.1, -4.6), parallax 0.449 with NanoMaggies: g=17.8, r=17, z=14 Reset brightness to NanoMaggies: g=17.8, r=17, z=16.7 Blob 2 finished, total: Wall: 1.94 s, CPU: 1.94 s, VmPeak: 671 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.09768 MB Exception in one_blob: brick custom-276571p51661, iblob 3 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1637, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 376, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1989, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker result = (True, func(*args, **kwds)) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__ R = self.func(*args, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1637, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 376, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1989, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3771, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3739, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3295, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3284, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1131, in stage_fitblobs r = Riter.next(timeout) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next raise value AttributeError: 'NoneType' object has no attribute 'getBrightness' Something went wrong; please check the logfile. ERROR: galaxy PGC2397869; please check the logfile. Finished galaxy PGC2397869 in 2.897 minutes. Started working on galaxy PGC2397869 at Fri Aug 7 12:00:37 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.5717609516164 51.66182827516561 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T12:00:38.499787 legacypipe git version: DR9.5.11-watershed-4-gcc619972 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '276.5717609516164', '51.66182827516561', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.5717609516164 51.66182827516561 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 276.5717609516164 51.66182827516561 Starting process 11948 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 11949 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 11950 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 11951 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 11952 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059408 MB Starting process 11953 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059356 MB Starting process 11954 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059356 MB Starting process 11955 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 11956 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 11957 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 11958 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 11959 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 11960 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 11961 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 11962 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 11963 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 11964 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 11965 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 11966 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 11967 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 11968 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 11969 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 11970 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 11971 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 11972 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 11973 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 11974 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 11975 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 11976 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 11977 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 11978 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 11979 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-srcs.p and forcing stage srcs Runstage fit_on_coadds Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-fit_on_coadds.p and forcing stage fit_on_coadds Runstage halos Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-halos.p and forcing stage halos Runstage outliers Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-outliers.p and forcing stage outliers Runstage refs Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-refs.p and forcing stage refs Runstage tims Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-tims.p and forcing stage tims Running stage tims Running stage tims at 2020-08-07T12:00:39.432867 Keeping 11 CCDs: k4m_170905_054428_ooi_zd_ls9-CCD3 z expnum 138321 exptime 100.104 propid 2016A-0453 seeing 1.27 MJD 58001.239 object MzLS_656665_z mosaic/CP/V4.3/CP20170904/k4m_170905_054428_ooi_zd_ls9.fits.fz k4m_170926_042840_ooi_zd_ls9-CCD3 z expnum 140885 exptime 148.103 propid 2016A-0453 seeing 1.37 MJD 58022.187 object MzLS_656665_z mosaic/CP/V4.3/CP20170925/k4m_170926_042840_ooi_zd_ls9.fits.fz k4m_160524_100301_ooi_zd_ls9-CCD4 z expnum 91260 exptime 80.103 propid 2016A-0453 seeing 1.09 MJD 57532.419 object MzLS_655883_z mosaic/CP/V4.3/CP20160523/k4m_160524_100301_ooi_zd_ls9.fits.fz k4m_160527_094915_ooi_zd_ls9-CCD3 z expnum 91886 exptime 80.105 propid 2016A-0453 seeing 0.75 MJD 57535.409 object MzLS_657443_z mosaic/CP/V4.3/CP20160526/k4m_160527_094915_ooi_zd_ls9.fits.fz k4m_160524_100908_ooi_zd_ls9-CCD2 z expnum 91263 exptime 80.105 propid 2016A-0453 seeing 1.19 MJD 57532.423 object MzLS_655884_z mosaic/CP/V4.3/CP20160523/k4m_160524_100908_ooi_zd_ls9.fits.fz ksb_170619_074223_ooi_g_ls9-CCD2 g expnum 79230108 exptime 235.8 propid BASS seeing 1.74 MJD 57923.321 object 29483 90prime/CP/V2.3/CP20170618/ksb_170619_074223_ooi_g_ls9.fits.fz ksb_170624_064226_ooi_r_ls9-CCD2 r expnum 79280080 exptime 82.27 propid BASS seeing 1.19 MJD 57928.279 object 29483 90prime/CP/V2.3/CP20170623/ksb_170624_064226_ooi_r_ls9.fits.fz ksb_160712_065419_ooi_r_ls9-CCD3 r expnum 75810086 exptime 182.7 propid BASS seeing 1.95 MJD 57581.288 object 28352 90prime/CP/V2.3/CP20160711/ksb_160712_065419_ooi_r_ls9.fits.fz ksb_160706_102046_ooi_g_ls9-CCD3 g expnum 75750124 exptime 171.0 propid BASS seeing 1.80 MJD 57575.431 object 28352 90prime/CP/V2.3/CP20160705/ksb_160706_102046_ooi_g_ls9.fits.fz ksb_170405_114235_ooi_r_ls9-CCD2 r expnum 78480186 exptime 62.704 propid BASS seeing 1.31 MJD 57848.488 object 29481 90prime/CP/V2.3/CP20170404/ksb_170405_114235_ooi_r_ls9.fits.fz ksb_180515_102448_ooi_g_ls9-CCD2 g expnum 82530159 exptime 92.952 propid NOTBASS seeing 1.27 MJD 58253.434 object 29481 90prime/CP/V2.3/CP20180514/ksb_180515_102448_ooi_g_ls9.fits.fz Faked up EXPNUM 75810086 Faked up EXPNUM 75810086 Faked up EXPNUM 75810086 90prime get_fwhm: self.fwhm = 4.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 785 922 and amp range 0 2015 and image y 342 477 and amp range 0 2047 Range in image: x 0 138 , y 0 136 (with image size 138 x 136) dzp -0.024507914 -> scaling image by 0.9776802328037623 mosaic get_fwhm: self.fwhm = 2.87 Found 4 relevant rows in amp-corrections file. Found overlap: image x 485 724 and amp range 0 2005 and image y 190 426 and amp range 0 2039 Range in image: x 0 240 , y 0 237 (with image size 240 x 237) dzp -0.005856539 -> scaling image by 0.9946204500110131 Faked up EXPNUM 79230108 Faked up EXPNUM 79230108 Faked up EXPNUM 79230108 90prime get_fwhm: self.fwhm = 3.83 Found 4 relevant rows in amp-corrections file. Found overlap: image x 488 625 and amp range 0 2015 and image y 1368 1506 and amp range 0 2047 Range in image: x 0 138 , y 0 139 (with image size 138 x 139) dzp 0.0003063402 -> scaling image by 1.0002821895558327 mosaic get_fwhm: self.fwhm = 4.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1623 1862 and amp range 0 2047 and image y 157 398 and amp range 0 2039 mosaic get_fwhm: self.fwhm = 4.19 Found 4 relevant rows in amp-corrections file. Range in image: x 0 240 , y 0 242 (with image size 240 x 242) dzp -0.006320339 -> scaling image by 0.9941956631368829 Found overlap: image x 1652 1893 and amp range 0 2047 and image y 3783 4023 and amp range 2022 4060 Range in image: x 0 242 , y 0 241 (with image size 242 x 241) dzp 0.0033053984 -> scaling image by 1.0030490232713904 Faked up EXPNUM 75750124 Faked up EXPNUM 75750124 Faked up EXPNUM 75750124 90prime get_fwhm: self.fwhm = 3.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 789 925 and amp range 0 2015 and image y 333 469 and amp range 0 2047 Range in image: x 0 137 , y 0 137 (with image size 137 x 137) dzp -0.03470582 -> scaling image by 0.9685402452207784 mosaic get_fwhm: self.fwhm = 5.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3215 3451 and amp range 2006 4053 and image y 2839 3079 and amp range 2040 4078 Range in image: x 0 237 , y 0 241 (with image size 237 x 241) dzp 0.0056365696 -> scaling image by 1.005204971477435 Faked up EXPNUM 79280080 Faked up EXPNUM 79280080 Faked up EXPNUM 79280080 90prime get_fwhm: self.fwhm = 2.63 Found 4 relevant rows in amp-corrections file. Found overlap: image x 518 655 and amp range 0 2015 and image y 1388 1526 and amp range 0 2047 Range in image: x 0 138 , y 0 139 (with image size 138 x 139) dzp 0.005335051 -> scaling image by 1.0049258559887364 mosaic get_fwhm: self.fwhm = 4.91 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3219 3456 and amp range 2006 4053 and image y 3105 3345 and amp range 2040 4078 Range in image: x 0 238 , y 0 241 (with image size 238 x 241) dzp 0.0056365696 -> scaling image by 1.005204971477435 Faked up EXPNUM 78480186 Faked up EXPNUM 78480186 Faked up EXPNUM 78480186 90prime get_fwhm: self.fwhm = 2.89 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2519 2656 and amp range 2016 4031 and image y 3396 3532 and amp range 2048 4095 Range in image: x 0 138 , y 0 137 (with image size 138 x 137) dzp 0.021366077 -> scaling image by 1.0198737893800265 Faked up EXPNUM 82530159 Faked up EXPNUM 82530159 Faked up EXPNUM 82530159 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2531 2668 and amp range 2016 4031 and image y 3384 3521 and amp range 2048 4095 Range in image: x 0 138 , y 0 138 (with image size 138 x 138) dzp 0.013237011 -> scaling image by 1.012266359574015 Stage tims : Wall: 3.03 s, CPU: 1.13 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 174 MB, VmData: 207 MB, maxrss: 0.215144 MB Stage tims finished: 2020-08-07T12:00:42.466807 Resources for stage tims : 5.960 s worker CPU, 15.118 s worker Wall, Wall: 3.037 s, Cores in use: 2.34, Total efficiency (on 32 cores): 7.3 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T12:00:44.822600 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01379.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01380.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01276.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01487.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/metrics/cus/reference-custom-276571p51661.fits Stage refs : Wall: 5.60 s, CPU: 4.43 s, VmPeak: 1019 MB, VmSize: 1014 MB, VmRSS: 238 MB, VmData: 270 MB, maxrss: 0.244184 MB Stage refs finished: 2020-08-07T12:00:50.424083 Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 5.604 s, Cores in use: 0.79, Total efficiency (on 32 cores): 2.5 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T12:00:50.510857 Stage outliers : Wall: 0.29 s, CPU: 0.26 s, VmPeak: 1019 MB, VmSize: 1014 MB, VmRSS: 239 MB, VmData: 270 MB, maxrss: 0.24524 MB Stage outliers finished: 2020-08-07T12:00:50.800614 Resources for stage outliers : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.292 s, Cores in use: 0.91, Total efficiency (on 32 cores): 2.8 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T12:00:51.510842 Stage halos : Wall: 0.38 s, CPU: 0.37 s, VmPeak: 1019 MB, VmSize: 1014 MB, VmRSS: 242 MB, VmData: 273 MB, maxrss: 0.247604 MB Stage halos finished: 2020-08-07T12:00:51.892535 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.384 s, Cores in use: 0.97, Total efficiency (on 32 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T12:00:52.359799 PSF sigmas in coadd pixels: ['2.82', '2.92', '2.07'] Using average PSF sigma 2.602894953294897 Gaussian PSF norm 0.10837732480013688 vs pixelized 0.08496977 average tim pixel scale / coadd scale: 1.7296505748927025 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.94', '3.17', '2.13'] Using average PSF sigma 2.4110764274010656 Gaussian PSF norm 0.11699952293837167 vs pixelized 0.09635607 average tim pixel scale / coadd scale: 1.729286532628684 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.07', '2.22', '1.77', '1.21', '1.94'] Using average PSF sigma 1.8409568070599527 Gaussian PSF norm 0.1532327052389619 vs pixelized 0.13578466 average tim pixel scale / coadd scale: 0.990897795640444 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-copsf-z.fits.fz Stage fit_on_coadds : Wall: 1.86 s, CPU: 0.16 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 252 MB, VmData: 281 MB, maxrss: 0.25844 MB Stage fit_on_coadds finished: 2020-08-07T12:00:54.223894 Resources for stage fit_on_coadds : 0.201 s worker CPU, 0.301 s worker Wall, Wall: 1.866 s, Cores in use: 0.19, Total efficiency (on 32 cores): 0.6 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-fit_on_coadds.p Running stage srcs Warning: Stellar halo subtraction is only implemented for DECam Running stage srcs at 2020-08-07T12:00:54.430043 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 36 potential peaks Of 36 potential peaks: 10 in veto map, 1 cut by saddle test, 0 cut by aper test, 25 kept SED z : 25 new peaks Found 22 potential peaks Of 22 potential peaks: 22 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 22 potential peaks Of 22 potential peaks: 19 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 36 potential peaks Of 36 potential peaks: 31 in veto map, 2 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 43 potential peaks Of 43 potential peaks: 37 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 32 new sources Median coadd sky for g : 0.00015355366 Median coadd sky for r : 0.0004693864 Median coadd sky for z : -0.0004977268 Stage srcs : Wall: 0.54 s, CPU: 0.49 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 253 MB, VmData: 281 MB, maxrss: 0.259148 MB Stage srcs finished: 2020-08-07T12:00:54.965310 Resources for stage srcs : 0.071 s worker CPU, 0.095 s worker Wall, Wall: 0.537 s, Cores in use: 1.04, Total efficiency (on 32 cores): 3.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T12:00:54.979146 Blob 1 of 15, id: 3, sources: 19, size: 164x176, npix 15239, brick X: 40,204, Y: 15,191, one pixel: 179 15 Blob 2 of 15, id: 0, sources: 4, size: 71x97, npix 3794, brick X: 0,71, Y: 0,97, one pixel: 6 0 Blob 3 of 15, id: 12, sources: 6, size: 89x51, npix 3157, brick X: 101,190, Y: 182,233, one pixel: 132 182 Blob 4 of 15, id: 5, sources: 3, size: 39x74, npix 1758, brick X: 194,233, Y: 97,171, one pixel: 211 97 Blob 5 of 15, id: 10, sources: 1, size: 34x34, npix 812, brick X: 73,107, Y: 181,215, one pixel: 86 181 Blob 6 of 15, id: 4, sources: 2, size: 37x33, npix 727, brick X: 191,228, Y: 36,69, one pixel: 216 36 Blob 7 of 15, id: 14, sources: 1, size: 20x27, npix 379, brick X: 0,20, Y: 206,233, one pixel: 4 206 Blob 8 of 15, id: 7, sources: 1, size: 24x25, npix 376, brick X: 2,26, Y: 121,146, one pixel: 12 121 Blob 9 of 15, id: 11, sources: 1, size: 22x22, npix 294, brick X: 0,22, Y: 182,204, one pixel: 9 182 Blob 10 of 15, id: 6, sources: 1, size: 21x21, npix 269, brick X: 39,60, Y: 100,121, one pixel: 47 100 Blob 11 of 15, id: 13, sources: 1, size: 20x19, npix 209, brick X: 197,217, Y: 185,204, one pixel: 205 185 Blob 12 of 15, id: 1, sources: 1, size: 19x19, npix 199, brick X: 207,226, Y: 10,29, one pixel: 216 10 Blob 13 of 15, id: 9, sources: 1, size: 19x19, npix 199, brick X: 183,202, Y: 172,191, one pixel: 191 172 Blob 14 of 15, id: 2, sources: 1, size: 18x18, npix 180, brick X: 73,91, Y: 13,31, one pixel: 81 13 Blob 15 of 15, id: 8, sources: 1, size: 18x18, npix 180, brick X: 174,192, Y: 142,160, one pixel: 182 142 Blob 12 finished, total: Wall: 0.15 s, CPU: 0.07 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 86 MB, VmData: 139 MB, maxrss: 0.08828 MB Blob 14 finished, total: Wall: 0.20 s, CPU: 0.12 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 82 MB, VmData: 137 MB, maxrss: 0.083936 MB Blob 10 finished, total: Wall: 0.22 s, CPU: 0.11 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 85 MB, VmData: 138 MB, maxrss: 0.08702 MB Blob 15 finished, total: Wall: 0.27 s, CPU: 0.16 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145536 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.58026, 51.65123), pm (-6.1, -4.6), parallax 0.449 with NanoMaggies: g=17.8, r=17, z=14 Reset brightness to NanoMaggies: g=17.8, r=17, z=16.7 Blob 13 finished, total: Wall: 0.34 s, CPU: 0.24 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 87 MB, VmData: 137 MB, maxrss: 0.089596 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.56405, 51.67705), pm (-8.1, 4.6), parallax 1.515 with NanoMaggies: g=17.5, r=16.2, z=15.6 Reset brightness to NanoMaggies: g=17.5, r=16.2, z=15.6 Blob 11 finished, total: Wall: 0.48 s, CPU: 0.37 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092144 MB Blob 8 finished, total: Wall: 0.55 s, CPU: 0.44 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 183 MB, maxrss: 0.144572 MB Blob 9 finished, total: Wall: 0.64 s, CPU: 0.51 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089716 MB Blob 5 finished, total: Wall: 0.76 s, CPU: 0.67 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 88 MB, VmData: 138 MB, maxrss: 0.090364 MB Blob 6 finished, total: Wall: 0.80 s, CPU: 0.73 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.090648 MB Blob 7 finished, total: Wall: 0.96 s, CPU: 0.86 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145348 MB Blob 4 finished, total: Wall: 0.99 s, CPU: 0.89 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 90 MB, VmData: 139 MB, maxrss: 0.092276 MB Blob 3 finished, total: Wall: 1.70 s, CPU: 1.64 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 93 MB, VmData: 141 MB, maxrss: 0.096024 MB Blob 2 finished, total: Wall: 1.76 s, CPU: 1.68 s, VmPeak: 805 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.1463 MB Exception in one_blob: brick custom-276571p51661, iblob 3 multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker result = (True, func(*args, **kwds)) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__ R = self.func(*args, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3775, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3743, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3299, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3288, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1135, in stage_fitblobs r = Riter.next(timeout) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next raise value AttributeError: 'NoneType' object has no attribute 'getBrightness' Something went wrong; please check the logfile. ERROR: galaxy PGC2397869; please check the logfile. Finished galaxy PGC2397869 in 0.346 minutes. Started working on galaxy PGC2397869 at Fri Aug 7 12:30:52 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.5717609516164 51.66182827516561 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T12:30:53.243457 legacypipe git version: DR9.5.11-watershed-4-gcc619972 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '276.5717609516164', '51.66182827516561', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.5717609516164 51.66182827516561 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 276.5717609516164 51.66182827516561 Starting process 16129 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 16130 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16131 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16132 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16133 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 16134 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 16135 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 16136 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 16137 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 16138 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 16139 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 16140 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 16141 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16142 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16143 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16144 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16145 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 16146 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 16147 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 16148 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 16149 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 16150 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 16151 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 16152 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 16153 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 16154 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 16155 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 16156 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 16157 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 16158 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 16159 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 16160 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T12:30:53.664389 Keeping 11 CCDs: k4m_170905_054428_ooi_zd_ls9-CCD3 z expnum 138321 exptime 100.104 propid 2016A-0453 seeing 1.27 MJD 58001.239 object MzLS_656665_z mosaic/CP/V4.3/CP20170904/k4m_170905_054428_ooi_zd_ls9.fits.fz k4m_170926_042840_ooi_zd_ls9-CCD3 z expnum 140885 exptime 148.103 propid 2016A-0453 seeing 1.37 MJD 58022.187 object MzLS_656665_z mosaic/CP/V4.3/CP20170925/k4m_170926_042840_ooi_zd_ls9.fits.fz k4m_160524_100301_ooi_zd_ls9-CCD4 z expnum 91260 exptime 80.103 propid 2016A-0453 seeing 1.09 MJD 57532.419 object MzLS_655883_z mosaic/CP/V4.3/CP20160523/k4m_160524_100301_ooi_zd_ls9.fits.fz k4m_160527_094915_ooi_zd_ls9-CCD3 z expnum 91886 exptime 80.105 propid 2016A-0453 seeing 0.75 MJD 57535.409 object MzLS_657443_z mosaic/CP/V4.3/CP20160526/k4m_160527_094915_ooi_zd_ls9.fits.fz k4m_160524_100908_ooi_zd_ls9-CCD2 z expnum 91263 exptime 80.105 propid 2016A-0453 seeing 1.19 MJD 57532.423 object MzLS_655884_z mosaic/CP/V4.3/CP20160523/k4m_160524_100908_ooi_zd_ls9.fits.fz ksb_170619_074223_ooi_g_ls9-CCD2 g expnum 79230108 exptime 235.8 propid BASS seeing 1.74 MJD 57923.321 object 29483 90prime/CP/V2.3/CP20170618/ksb_170619_074223_ooi_g_ls9.fits.fz ksb_170624_064226_ooi_r_ls9-CCD2 r expnum 79280080 exptime 82.27 propid BASS seeing 1.19 MJD 57928.279 object 29483 90prime/CP/V2.3/CP20170623/ksb_170624_064226_ooi_r_ls9.fits.fz ksb_160712_065419_ooi_r_ls9-CCD3 r expnum 75810086 exptime 182.7 propid BASS seeing 1.95 MJD 57581.288 object 28352 90prime/CP/V2.3/CP20160711/ksb_160712_065419_ooi_r_ls9.fits.fz ksb_160706_102046_ooi_g_ls9-CCD3 g expnum 75750124 exptime 171.0 propid BASS seeing 1.80 MJD 57575.431 object 28352 90prime/CP/V2.3/CP20160705/ksb_160706_102046_ooi_g_ls9.fits.fz ksb_170405_114235_ooi_r_ls9-CCD2 r expnum 78480186 exptime 62.704 propid BASS seeing 1.31 MJD 57848.488 object 29481 90prime/CP/V2.3/CP20170404/ksb_170405_114235_ooi_r_ls9.fits.fz ksb_180515_102448_ooi_g_ls9-CCD2 g expnum 82530159 exptime 92.952 propid NOTBASS seeing 1.27 MJD 58253.434 object 29481 90prime/CP/V2.3/CP20180514/ksb_180515_102448_ooi_g_ls9.fits.fz mosaic get_fwhm: self.fwhm = 4.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1623 1862 and amp range 0 2047 and image y 157 398 and amp range 0 2039 Range in image: x 0 240 , y 0 242 (with image size 240 x 242) dzp -0.006320339 -> scaling image by 0.9941956631368829 mosaic get_fwhm: self.fwhm = 5.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3215 3451 and amp range 2006 4053 and image y 2839 3079 and amp range 2040 4078 Range in image: x 0 237 , y 0 241 (with image size 237 x 241) dzp 0.0056365696 -> scaling image by 1.005204971477435 Faked up EXPNUM 75810086 Faked up EXPNUM 75810086 Faked up EXPNUM 75810086 90prime get_fwhm: self.fwhm = 4.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 785 922 and amp range 0 2015 and image y 342 477 and amp range 0 2047 Range in image: x 0 138 , y 0 136 (with image size 138 x 136) dzp -0.024507914 -> scaling image by 0.9776802328037623 mosaic get_fwhm: self.fwhm = 4.19 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1652 1893 and amp range 0 2047 and image y 3783 4023 and amp range 2022 4060 Range in image: x 0 242 , y 0 241 (with image size 242 x 241) dzp 0.0033053984 -> scaling image by 1.0030490232713904 mosaic get_fwhm: self.fwhm = 2.87 Found 4 relevant rows in amp-corrections file. Found overlap: image x 485 724 and amp range 0 2005 and image y 190 426 and amp range 0 2039 Range in image: x 0 240 , y 0 237 (with image size 240 x 237) dzp -0.005856539 -> scaling image by 0.9946204500110131 Faked up EXPNUM 75750124 Faked up EXPNUM 75750124 Faked up EXPNUM 75750124 90prime get_fwhm: self.fwhm = 3.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 789 925 and amp range 0 2015 and image y 333 469 and amp range 0 2047 Range in image: x 0 137 , y 0 137 (with image size 137 x 137) dzp -0.03470582 -> scaling image by 0.9685402452207784 Faked up EXPNUM 82530159 Faked up EXPNUM 82530159 Faked up EXPNUM 82530159 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2531 2668 and amp range 2016 4031 and image y 3384 3521 and amp range 2048 4095 Range in image: x 0 138 , y 0 138 (with image size 138 x 138) dzp 0.013237011 -> scaling image by 1.012266359574015 Faked up EXPNUM 78480186 Faked up EXPNUM 78480186 Faked up EXPNUM 78480186 90prime get_fwhm: self.fwhm = 2.89 Found 4 relevant rows in amp-corrections file. Faked up EXPNUM 79280080 Faked up EXPNUM 79280080 Faked up EXPNUM 79280080 90prime get_fwhm: self.fwhm = 2.63 Found 4 relevant rows in amp-corrections file. Found overlap: image x 518 655 and amp range 0 2015 and image y 1388 1526 and amp range 0 2047 Range in image: x 0 138 , y 0 139 (with image size 138 x 139) Found overlap: image x 2519 2656 and amp range 2016 4031 and image y 3396 3532 and amp range 2048 4095 dzp 0.005335051 -> scaling image by 1.0049258559887364 Range in image: x 0 138 , y 0 137 (with image size 138 x 137) dzp 0.021366077 -> scaling image by 1.0198737893800265 Faked up EXPNUM 79230108 Faked up EXPNUM 79230108 Faked up EXPNUM 79230108 90prime get_fwhm: self.fwhm = 3.83 Found 4 relevant rows in amp-corrections file. Found overlap: image x 488 625 and amp range 0 2015 and image y 1368 1506 and amp range 0 2047 Range in image: x 0 138 , y 0 139 (with image size 138 x 139) dzp 0.0003063402 -> scaling image by 1.0002821895558327 mosaic get_fwhm: self.fwhm = 4.91 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3219 3456 and amp range 2006 4053 and image y 3105 3345 and amp range 2040 4078 Range in image: x 0 238 , y 0 241 (with image size 238 x 241) dzp 0.0056365696 -> scaling image by 1.005204971477435 Stage tims : Wall: 2.32 s, CPU: 0.76 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.21518 MB Stage tims finished: 2020-08-07T12:30:55.983957 Resources for stage tims : 5.740 s worker CPU, 13.586 s worker Wall, Wall: 2.322 s, Cores in use: 2.80, Total efficiency (on 32 cores): 8.8 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T12:30:56.070504 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01379.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01380.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01276.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01487.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/metrics/cus/reference-custom-276571p51661.fits Stage refs : Wall: 4.60 s, CPU: 4.31 s, VmPeak: 1019 MB, VmSize: 1014 MB, VmRSS: 239 MB, VmData: 271 MB, maxrss: 0.244948 MB Stage refs finished: 2020-08-07T12:31:00.667580 Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 4.600 s, Cores in use: 0.94, Total efficiency (on 32 cores): 2.9 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T12:31:00.692051 Stage outliers : Wall: 0.29 s, CPU: 0.26 s, VmPeak: 1019 MB, VmSize: 1014 MB, VmRSS: 240 MB, VmData: 271 MB, maxrss: 0.246088 MB Stage outliers finished: 2020-08-07T12:31:00.984330 Resources for stage outliers : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.295 s, Cores in use: 0.88, Total efficiency (on 32 cores): 2.8 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T12:31:01.012149 Stage halos : Wall: 0.22 s, CPU: 0.20 s, VmPeak: 1019 MB, VmSize: 1014 MB, VmRSS: 243 MB, VmData: 274 MB, maxrss: 0.248452 MB Stage halos finished: 2020-08-07T12:31:01.229138 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.219 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T12:31:01.963201 PSF sigmas in coadd pixels: ['2.82', '2.92', '2.07'] Using average PSF sigma 2.602894953294897 Gaussian PSF norm 0.10837732480013688 vs pixelized 0.08496977 average tim pixel scale / coadd scale: 1.7296505748927025 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.94', '3.17', '2.13'] Using average PSF sigma 2.4110764274010656 Gaussian PSF norm 0.11699952293837167 vs pixelized 0.09635607 average tim pixel scale / coadd scale: 1.729286532628684 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.07', '2.22', '1.77', '1.21', '1.94'] Using average PSF sigma 1.8409568070599527 Gaussian PSF norm 0.1532327052389619 vs pixelized 0.13578466 average tim pixel scale / coadd scale: 0.990897795640444 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.17 s, CPU: 0.16 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 252 MB, VmData: 280 MB, maxrss: 0.25816 MB Stage fit_on_coadds finished: 2020-08-07T12:31:02.137452 Resources for stage fit_on_coadds : 0.195 s worker CPU, 0.319 s worker Wall, Wall: 0.176 s, Cores in use: 2.03, Total efficiency (on 32 cores): 6.3 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T12:31:02.149028 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 36 potential peaks Of 36 potential peaks: 10 in veto map, 1 cut by saddle test, 0 cut by aper test, 25 kept SED z : 25 new peaks Found 22 potential peaks Of 22 potential peaks: 22 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 22 potential peaks Of 22 potential peaks: 19 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 36 potential peaks Of 36 potential peaks: 31 in veto map, 2 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 43 potential peaks Of 43 potential peaks: 37 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 32 new sources Median coadd sky for g : 0.00015355366 Median coadd sky for r : 0.0004693864 Median coadd sky for z : -0.0004977267 Stage srcs : Wall: 0.50 s, CPU: 0.45 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 253 MB, VmData: 280 MB, maxrss: 0.258848 MB Stage srcs finished: 2020-08-07T12:31:02.648781 Resources for stage srcs : 0.095 s worker CPU, 0.100 s worker Wall, Wall: 0.502 s, Cores in use: 1.10, Total efficiency (on 32 cores): 3.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T12:31:02.662128 Blob 1 of 15, id: 3, sources: 19, size: 164x176, npix 15239, brick X: 40,204, Y: 15,191, one pixel: 179 15 Blob 2 of 15, id: 0, sources: 4, size: 71x97, npix 3794, brick X: 0,71, Y: 0,97, one pixel: 6 0 Blob 3 of 15, id: 12, sources: 6, size: 89x51, npix 3157, brick X: 101,190, Y: 182,233, one pixel: 132 182 Blob 4 of 15, id: 5, sources: 3, size: 39x74, npix 1758, brick X: 194,233, Y: 97,171, one pixel: 211 97 Blob 5 of 15, id: 10, sources: 1, size: 34x34, npix 812, brick X: 73,107, Y: 181,215, one pixel: 86 181 Blob 6 of 15, id: 4, sources: 2, size: 37x33, npix 727, brick X: 191,228, Y: 36,69, one pixel: 216 36 Blob 7 of 15, id: 14, sources: 1, size: 20x27, npix 379, brick X: 0,20, Y: 206,233, one pixel: 4 206 Blob 8 of 15, id: 7, sources: 1, size: 24x25, npix 376, brick X: 2,26, Y: 121,146, one pixel: 12 121 Blob 9 of 15, id: 11, sources: 1, size: 22x22, npix 294, brick X: 0,22, Y: 182,204, one pixel: 9 182 Blob 10 of 15, id: 6, sources: 1, size: 21x21, npix 269, brick X: 39,60, Y: 100,121, one pixel: 47 100 Blob 11 of 15, id: 13, sources: 1, size: 20x19, npix 209, brick X: 197,217, Y: 185,204, one pixel: 205 185 Blob 12 of 15, id: 1, sources: 1, size: 19x19, npix 199, brick X: 207,226, Y: 10,29, one pixel: 216 10 Blob 13 of 15, id: 9, sources: 1, size: 19x19, npix 199, brick X: 183,202, Y: 172,191, one pixel: 191 172 Blob 14 of 15, id: 2, sources: 1, size: 18x18, npix 180, brick X: 73,91, Y: 13,31, one pixel: 81 13 Blob 15 of 15, id: 8, sources: 1, size: 18x18, npix 180, brick X: 174,192, Y: 142,160, one pixel: 182 142 Blob 14 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.144992 MB Blob 12 finished, total: Wall: 0.12 s, CPU: 0.09 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 82 MB, VmData: 136 MB, maxrss: 0.083664 MB Blob 10 finished, total: Wall: 0.13 s, CPU: 0.08 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 82 MB, VmData: 137 MB, maxrss: 0.0839 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.58026, 51.65123), pm (-6.1, -4.6), parallax 0.449 with NanoMaggies: g=17.8, r=17, z=14 Reset brightness to NanoMaggies: g=17.8, r=17, z=16.7 Blob 13 finished, total: Wall: 0.19 s, CPU: 0.19 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093548 MB Blob 15 finished, total: Wall: 0.22 s, CPU: 0.17 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089776 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.56405, 51.67705), pm (-8.1, 4.6), parallax 1.515 with NanoMaggies: g=17.5, r=16.2, z=15.6 Reset brightness to NanoMaggies: g=17.5, r=16.2, z=15.6 Blob 11 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145584 MB Blob 8 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 805 MB, VmSize: 724 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144524 MB Blob 9 finished, total: Wall: 0.55 s, CPU: 0.51 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089688 MB Blob 5 finished, total: Wall: 0.69 s, CPU: 0.65 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.09072 MB Blob 6 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092592 MB Blob 7 finished, total: Wall: 0.92 s, CPU: 0.90 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 89 MB, VmData: 137 MB, maxrss: 0.091148 MB Blob 4 finished, total: Wall: 0.95 s, CPU: 0.91 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 90 MB, VmData: 139 MB, maxrss: 0.092488 MB Blob 2 finished, total: Wall: 1.63 s, CPU: 1.63 s, VmPeak: 805 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146464 MB Blob 3 finished, total: Wall: 1.66 s, CPU: 1.61 s, VmPeak: 671 MB, VmSize: 670 MB, VmRSS: 94 MB, VmData: 141 MB, maxrss: 0.096464 MB Exception in one_blob: brick custom-276571p51661, iblob 3 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker result = (True, func(*args, **kwds)) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__ R = self.func(*args, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3775, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3743, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3299, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3288, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1135, in stage_fitblobs r = Riter.next(timeout) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next raise value AttributeError: 'NoneType' object has no attribute 'getBrightness' Something went wrong; please check the logfile. ERROR: galaxy PGC2397869; please check the logfile. Finished galaxy PGC2397869 in 0.222 minutes. Started working on galaxy PGC2397869 at Fri Aug 7 13:29:01 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.5717609516164 51.66182827516561 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T13:29:03.153555 legacypipe git version: DR9.5.11-watershed-5-g77ea3463 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '276.5717609516164', '51.66182827516561', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.5717609516164 51.66182827516561 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 276.5717609516164 51.66182827516561 Starting process 19981 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 19982 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 19983 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 19984 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 19985 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059476 MB Starting process 19986 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059424 MB Starting process 19987 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059424 MB Starting process 19988 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 19989 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 19990 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 19991 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 19992 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19993 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19994 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19995 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19996 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19997 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 19998 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 19999 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 20000 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 20001 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 20002 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 20003 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 20004 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 20005 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 20008 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 20009 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 20007 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 20010 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 20011 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 20012 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 20013 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T13:29:04.479711 Keeping 11 CCDs: k4m_170905_054428_ooi_zd_ls9-CCD3 z expnum 138321 exptime 100.104 propid 2016A-0453 seeing 1.27 MJD 58001.239 object MzLS_656665_z mosaic/CP/V4.3/CP20170904/k4m_170905_054428_ooi_zd_ls9.fits.fz k4m_170926_042840_ooi_zd_ls9-CCD3 z expnum 140885 exptime 148.103 propid 2016A-0453 seeing 1.37 MJD 58022.187 object MzLS_656665_z mosaic/CP/V4.3/CP20170925/k4m_170926_042840_ooi_zd_ls9.fits.fz k4m_160524_100301_ooi_zd_ls9-CCD4 z expnum 91260 exptime 80.103 propid 2016A-0453 seeing 1.09 MJD 57532.419 object MzLS_655883_z mosaic/CP/V4.3/CP20160523/k4m_160524_100301_ooi_zd_ls9.fits.fz k4m_160527_094915_ooi_zd_ls9-CCD3 z expnum 91886 exptime 80.105 propid 2016A-0453 seeing 0.75 MJD 57535.409 object MzLS_657443_z mosaic/CP/V4.3/CP20160526/k4m_160527_094915_ooi_zd_ls9.fits.fz k4m_160524_100908_ooi_zd_ls9-CCD2 z expnum 91263 exptime 80.105 propid 2016A-0453 seeing 1.19 MJD 57532.423 object MzLS_655884_z mosaic/CP/V4.3/CP20160523/k4m_160524_100908_ooi_zd_ls9.fits.fz ksb_170619_074223_ooi_g_ls9-CCD2 g expnum 79230108 exptime 235.8 propid BASS seeing 1.74 MJD 57923.321 object 29483 90prime/CP/V2.3/CP20170618/ksb_170619_074223_ooi_g_ls9.fits.fz ksb_170624_064226_ooi_r_ls9-CCD2 r expnum 79280080 exptime 82.27 propid BASS seeing 1.19 MJD 57928.279 object 29483 90prime/CP/V2.3/CP20170623/ksb_170624_064226_ooi_r_ls9.fits.fz ksb_160712_065419_ooi_r_ls9-CCD3 r expnum 75810086 exptime 182.7 propid BASS seeing 1.95 MJD 57581.288 object 28352 90prime/CP/V2.3/CP20160711/ksb_160712_065419_ooi_r_ls9.fits.fz ksb_160706_102046_ooi_g_ls9-CCD3 g expnum 75750124 exptime 171.0 propid BASS seeing 1.80 MJD 57575.431 object 28352 90prime/CP/V2.3/CP20160705/ksb_160706_102046_ooi_g_ls9.fits.fz ksb_170405_114235_ooi_r_ls9-CCD2 r expnum 78480186 exptime 62.704 propid BASS seeing 1.31 MJD 57848.488 object 29481 90prime/CP/V2.3/CP20170404/ksb_170405_114235_ooi_r_ls9.fits.fz ksb_180515_102448_ooi_g_ls9-CCD2 g expnum 82530159 exptime 92.952 propid NOTBASS seeing 1.27 MJD 58253.434 object 29481 90prime/CP/V2.3/CP20180514/ksb_180515_102448_ooi_g_ls9.fits.fz Faked up EXPNUM 75810086 Faked up EXPNUM 75810086 Faked up EXPNUM 75810086 90prime get_fwhm: self.fwhm = 4.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 785 922 and amp range 0 2015 and image y 342 477 and amp range 0 2047 Range in image: x 0 138 , y 0 136 (with image size 138 x 136) dzp -0.024507914 -> scaling image by 0.9776802328037623 mosaic get_fwhm: self.fwhm = 2.87 Found 4 relevant rows in amp-corrections file. Found overlap: image x 485 724 and amp range 0 2005 and image y 190 426 and amp range 0 2039 Range in image: x 0 240 , y 0 237 (with image size 240 x 237) dzp -0.005856539 -> scaling image by 0.9946204500110131 mosaic get_fwhm: self.fwhm = 5.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3215 3451 and amp range 2006 4053 and image y 2839 3079 and amp range 2040 4078 Range in image: x 0 237 , y 0 241 (with image size 237 x 241) dzp 0.0056365696 -> scaling image by 1.005204971477435 Faked up EXPNUM 78480186 Faked up EXPNUM 78480186 Faked up EXPNUM 78480186 90prime get_fwhm: self.fwhm = 2.89 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2519 2656 and amp range 2016 4031 and image y 3396 3532 and amp range 2048 4095 Range in image: x 0 138 , y 0 137 (with image size 138 x 137) dzp 0.021366077 -> scaling image by 1.0198737893800265 mosaic get_fwhm: self.fwhm = 4.19 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1652 1893 and amp range 0 2047 and image y 3783 4023 and amp range 2022 4060 Range in image: x 0 242 , y 0 241 (with image size 242 x 241) dzp 0.0033053984 -> scaling image by 1.0030490232713904 Faked up EXPNUM 79280080 Faked up EXPNUM 79280080 Faked up EXPNUM 79280080 90prime get_fwhm: self.fwhm = 2.63 Found 4 relevant rows in amp-corrections file. Found overlap: image x 518 655 and amp range 0 2015 and image y 1388 1526 and amp range 0 2047 Range in image: x 0 138 , y 0 139 (with image size 138 x 139) dzp 0.005335051 -> scaling image by 1.0049258559887364 Faked up EXPNUM 79230108 Faked up EXPNUM 79230108 Faked up EXPNUM 79230108 90prime get_fwhm: self.fwhm = 3.83 Found 4 relevant rows in amp-corrections file. Found overlap: image x 488 625 and amp range 0 2015 and image y 1368 1506 and amp range 0 2047 Range in image: x 0 138 , y 0 139 (with image size 138 x 139) dzp 0.0003063402 -> scaling image by 1.0002821895558327 Faked up EXPNUM 82530159 Faked up EXPNUM 82530159 Faked up EXPNUM 82530159 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2531 2668 and amp range 2016 4031 and image y 3384 3521 and amp range 2048 4095 Range in image: x 0 138 , y 0 138 (with image size 138 x 138) dzp 0.013237011 -> scaling image by 1.012266359574015 mosaic get_fwhm: self.fwhm = 4.91 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3219 3456 and amp range 2006 4053 and image y 3105 3345 and amp range 2040 4078 Range in image: x 0 238 , y 0 241 (with image size 238 x 241) dzp 0.0056365696 -> scaling image by 1.005204971477435 Faked up EXPNUM 75750124 Faked up EXPNUM 75750124 Faked up EXPNUM 75750124 90prime get_fwhm: self.fwhm = 3.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 789 925 and amp range 0 2015 and image y 333 469 and amp range 0 2047 Range in image: x 0 137 , y 0 137 (with image size 137 x 137) dzp -0.03470582 -> scaling image by 0.9685402452207784 mosaic get_fwhm: self.fwhm = 4.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1623 1862 and amp range 0 2047 and image y 157 398 and amp range 0 2039 Range in image: x 0 240 , y 0 242 (with image size 240 x 242) dzp -0.006320339 -> scaling image by 0.9941956631368829 Stage tims : Wall: 7.02 s, CPU: 1.01 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.178376 MB Stage tims finished: 2020-08-07T13:29:11.503226 Resources for stage tims : 5.480 s worker CPU, 28.687 s worker Wall, Wall: 7.026 s, Cores in use: 0.92, Total efficiency (on 32 cores): 2.9 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T13:29:11.526368 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01379.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01380.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01276.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01487.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/metrics/cus/reference-custom-276571p51661.fits Stage refs : Wall: 7.11 s, CPU: 4.38 s, VmPeak: 1019 MB, VmSize: 1014 MB, VmRSS: 239 MB, VmData: 271 MB, maxrss: 0.24478 MB Stage refs finished: 2020-08-07T13:29:18.637478 Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 7.114 s, Cores in use: 0.62, Total efficiency (on 32 cores): 1.9 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T13:29:18.717671 Stage outliers : Wall: 0.32 s, CPU: 0.31 s, VmPeak: 1019 MB, VmSize: 1014 MB, VmRSS: 240 MB, VmData: 271 MB, maxrss: 0.245708 MB Stage outliers finished: 2020-08-07T13:29:19.041157 Resources for stage outliers : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.326 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T13:29:19.133700 Stage halos : Wall: 0.21 s, CPU: 0.20 s, VmPeak: 1019 MB, VmSize: 1014 MB, VmRSS: 242 MB, VmData: 274 MB, maxrss: 0.248072 MB Stage halos finished: 2020-08-07T13:29:19.344552 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.213 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T13:29:19.410847 PSF sigmas in coadd pixels: ['2.82', '2.92', '2.07'] Using average PSF sigma 2.602894953294897 Gaussian PSF norm 0.10837732480013688 vs pixelized 0.08496977 average tim pixel scale / coadd scale: 1.7296505748927025 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.94', '3.17', '2.13'] Using average PSF sigma 2.4110764274010656 Gaussian PSF norm 0.11699952293837167 vs pixelized 0.09635607 average tim pixel scale / coadd scale: 1.729286532628684 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.07', '2.22', '1.77', '1.21', '1.94'] Using average PSF sigma 1.8409568070599527 Gaussian PSF norm 0.1532327052389619 vs pixelized 0.13578466 average tim pixel scale / coadd scale: 0.990897795640444 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.17 s, CPU: 0.15 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 252 MB, VmData: 281 MB, maxrss: 0.25846 MB Stage fit_on_coadds finished: 2020-08-07T13:29:19.579220 Resources for stage fit_on_coadds : 0.176 s worker CPU, 0.254 s worker Wall, Wall: 0.171 s, Cores in use: 1.94, Total efficiency (on 32 cores): 6.0 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T13:29:19.590257 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 36 potential peaks Of 36 potential peaks: 10 in veto map, 1 cut by saddle test, 0 cut by aper test, 25 kept SED z : 25 new peaks Found 22 potential peaks Of 22 potential peaks: 22 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 22 potential peaks Of 22 potential peaks: 19 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 36 potential peaks Of 36 potential peaks: 31 in veto map, 2 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 43 potential peaks Of 43 potential peaks: 37 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 32 new sources Median coadd sky for g : 0.0001535537 Median coadd sky for r : 0.0004693864 Median coadd sky for z : -0.0004977269 Stage srcs : Wall: 0.54 s, CPU: 0.39 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 253 MB, VmData: 281 MB, maxrss: 0.25914 MB Stage srcs finished: 2020-08-07T13:29:20.127445 Resources for stage srcs : 0.091 s worker CPU, 0.110 s worker Wall, Wall: 0.539 s, Cores in use: 0.89, Total efficiency (on 32 cores): 2.8 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T13:29:20.144259 Blob 1 of 15, id: 3, sources: 19, size: 164x176, npix 15239, brick X: 40,204, Y: 15,191, one pixel: 179 15 Blob 2 of 15, id: 0, sources: 4, size: 71x97, npix 3794, brick X: 0,71, Y: 0,97, one pixel: 6 0 Blob 3 of 15, id: 12, sources: 6, size: 89x51, npix 3157, brick X: 101,190, Y: 182,233, one pixel: 132 182 Blob 4 of 15, id: 5, sources: 3, size: 39x74, npix 1758, brick X: 194,233, Y: 97,171, one pixel: 211 97 Blob 5 of 15, id: 10, sources: 1, size: 34x34, npix 812, brick X: 73,107, Y: 181,215, one pixel: 86 181 Blob 6 of 15, id: 4, sources: 2, size: 37x33, npix 727, brick X: 191,228, Y: 36,69, one pixel: 216 36 Blob 7 of 15, id: 14, sources: 1, size: 20x27, npix 379, brick X: 0,20, Y: 206,233, one pixel: 4 206 Blob 8 of 15, id: 7, sources: 1, size: 24x25, npix 376, brick X: 2,26, Y: 121,146, one pixel: 12 121 Blob 9 of 15, id: 11, sources: 1, size: 22x22, npix 294, brick X: 0,22, Y: 182,204, one pixel: 9 182 Blob 10 of 15, id: 6, sources: 1, size: 21x21, npix 269, brick X: 39,60, Y: 100,121, one pixel: 47 100 Blob 11 of 15, id: 13, sources: 1, size: 20x19, npix 209, brick X: 197,217, Y: 185,204, one pixel: 205 185 Blob 12 of 15, id: 1, sources: 1, size: 19x19, npix 199, brick X: 207,226, Y: 10,29, one pixel: 216 10 Blob 13 of 15, id: 9, sources: 1, size: 19x19, npix 199, brick X: 183,202, Y: 172,191, one pixel: 191 172 Blob 14 of 15, id: 2, sources: 1, size: 18x18, npix 180, brick X: 73,91, Y: 13,31, one pixel: 81 13 Blob 15 of 15, id: 8, sources: 1, size: 18x18, npix 180, brick X: 174,192, Y: 142,160, one pixel: 182 142 Blob 10 finished, total: Wall: 0.19 s, CPU: 0.08 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 85 MB, VmData: 138 MB, maxrss: 0.086756 MB Blob 14 finished, total: Wall: 0.21 s, CPU: 0.08 s, VmPeak: 805 MB, VmSize: 724 MB, VmRSS: 139 MB, VmData: 182 MB, maxrss: 0.142296 MB Blob 12 finished, total: Wall: 0.34 s, CPU: 0.08 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 82 MB, VmData: 137 MB, maxrss: 0.083716 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.58026, 51.65123), pm (-6.1, -4.6), parallax 0.449 with NanoMaggies: g=17.8, r=17, z=14 Reset brightness to NanoMaggies: g=17.8, r=17, z=16.7 Blob 13 finished, total: Wall: 0.40 s, CPU: 0.18 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145212 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.56405, 51.67705), pm (-8.1, 4.6), parallax 1.515 with NanoMaggies: g=17.5, r=16.2, z=15.6 Reset brightness to NanoMaggies: g=17.5, r=16.2, z=15.6 Blob 15 finished, total: Wall: 0.44 s, CPU: 0.18 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 87 MB, VmData: 137 MB, maxrss: 0.08952 MB Blob 11 finished, total: Wall: 0.54 s, CPU: 0.37 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 87 MB, VmData: 137 MB, maxrss: 0.089516 MB Blob 8 finished, total: Wall: 0.63 s, CPU: 0.43 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089844 MB Blob 9 finished, total: Wall: 0.76 s, CPU: 0.50 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089796 MB Blob 6 finished, total: Wall: 0.82 s, CPU: 0.71 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 183 MB, maxrss: 0.14486 MB Blob 5 finished, total: Wall: 0.91 s, CPU: 0.66 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 88 MB, VmData: 138 MB, maxrss: 0.090552 MB Blob 4 finished, total: Wall: 1.03 s, CPU: 0.89 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145328 MB Blob 7 finished, total: Wall: 1.05 s, CPU: 0.85 s, VmPeak: 807 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.14556 MB Blob 3 finished, total: Wall: 1.74 s, CPU: 1.60 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 94 MB, VmData: 141 MB, maxrss: 0.096012 MB Blob 2 finished, total: Wall: 1.86 s, CPU: 1.74 s, VmPeak: 672 MB, VmSize: 670 MB, VmRSS: 94 MB, VmData: 141 MB, maxrss: 0.0968 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.27161, ee1=-0.21781, ee2=0.193135 Measuring 3 iterative sources Blob 1 finished, total: Wall: 12.22 s, CPU: 12.17 s, VmPeak: 692 MB, VmSize: 689 MB, VmRSS: 113 MB, VmData: 157 MB, maxrss: 0.118352 MB Old catalog: 52 New catalog: 40 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/metrics/cus/blobs-custom-276571p51661.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/metrics/cus/all-models-custom-276571p51661.fits Stage fitblobs : Wall: 13.88 s, CPU: 0.57 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 254 MB, VmData: 281 MB, maxrss: 0.259832 MB Stage fitblobs finished: 2020-08-07T13:29:34.024238 Resources for stage fitblobs : 20.750 s worker CPU, 23.810 s worker Wall, Wall: 13.882 s, Cores in use: 1.54, Total efficiency (on 32 cores): 4.8 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T13:29:34.051842 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/tmp-legacysurvey-custom-276571p51661-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/tmp-legacysurvey-custom-276571p51661-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/tmp-legacysurvey-custom-276571p51661-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/tmp-legacysurvey-custom-276571p51661-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-resid.jpg Stage coadds : Wall: 2.01 s, CPU: 0.65 s, VmPeak: 1024 MB, VmSize: 1024 MB, VmRSS: 255 MB, VmData: 281 MB, maxrss: 0.26092 MB Stage coadds finished: 2020-08-07T13:29:36.062864 Resources for stage coadds : 24.606 s worker CPU, 25.512 s worker Wall, Wall: 2.013 s, Cores in use: 12.55, Total efficiency (on 32 cores): 39.2 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T13:29:36.088173 Cut to 1 unWISE tiles Reading WISE tile 2765p514 band 4 Reading WISE tile 2765p514 band 3 Reading WISE tile 2765p514 band 2 Reading WISE tile 2765p514 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.17 s, CPU: 0.10 s, VmPeak: 792 MB, VmSize: 792 MB, VmRSS: 135 MB, VmData: 170 MB, maxrss: 0.193268 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 805 MB, VmSize: 800 MB, VmRSS: 143 MB, VmData: 174 MB, maxrss: 0.205716 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.27 s, CPU: 0.11 s, VmPeak: 809 MB, VmSize: 802 MB, VmRSS: 146 MB, VmData: 176 MB, maxrss: 0.187128 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p514/unwise-2765p514-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 814 MB, VmSize: 793 MB, VmRSS: 140 MB, VmData: 171 MB, maxrss: 0.201524 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/tmp-legacysurvey-custom-276571p51661-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/tmp-legacysurvey-custom-276571p51661-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.65 s, CPU: 0.71 s, VmPeak: 1024 MB, VmSize: 1024 MB, VmRSS: 255 MB, VmData: 281 MB, maxrss: 0.261604 MB Stage wise_forced finished: 2020-08-07T13:29:39.739626 Resources for stage wise_forced : 3.397 s worker CPU, 5.850 s worker Wall, Wall: 3.654 s, Cores in use: 1.13, Total efficiency (on 32 cores): 3.5 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T13:29:40.350210 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/coadd/cus/custom-276571p51661/legacysurvey-custom-276571p51661-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/tractor-i/cus/tractor-custom-276571p51661.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/tractor/cus/tractor-custom-276571p51661.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/tractor/cus/brick-custom-276571p51661.sha256sum Stage writecat : Wall: 4.36 s, CPU: 0.57 s, VmPeak: 1156 MB, VmSize: 1028 MB, VmRSS: 257 MB, VmData: 281 MB, maxrss: 0.394468 MB Stage writecat finished: 2020-08-07T13:29:44.705668 Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 4.358 s, Cores in use: 0.13, Total efficiency (on 32 cores): 0.4 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC2397869/PGC2397869-largegalaxy-writecat.p All done: 54.507 s worker CPU, 84.231 s worker Wall, Wall: 40.248 s, Cores in use: 1.58, Total efficiency (on 32 cores): 4.9 % Finished galaxy PGC2397869 in 0.726 minutes.