Started working on galaxy PGC2707501 at Wed Aug 5 19:30:37 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 267.21511499999997 67.869003 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T19:30:40.728078 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '267.21511499999997', '67.869003', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 267.21511499999997 67.869003 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 267.21511499999997 67.869003 Starting process 59430 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 59431 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 59432 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 59433 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 59434 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05934 MB Starting process 59435 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059328 MB Starting process 59436 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059328 MB Starting process 59437 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 59440 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 59441 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 59442 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 59444 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 59445 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 59446 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 59447 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 59448 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T19:30:42.363436 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 13 CCDs: k4m_171121_020531_ooi_zd_ls9-CCD4 z expnum 147902 exptime 250.104 propid 2016A-0453 seeing 1.03 MJD 58078.087 object MzLS_708581_z mosaic/CP/V4.3/CP20171120/k4m_171121_020531_ooi_zd_ls9.fits.fz k4m_171001_044024_ooi_zd_ls9-CCD2 z expnum 141567 exptime 101.104 propid 2016A-0453 seeing 0.88 MJD 58027.195 object MzLS_708101_z mosaic/CP/V4.3/CP20170930/k4m_171001_044024_ooi_zd_ls9.fits.fz k4m_170605_105754_ooi_zd_ls9-CCD1 z expnum 131889 exptime 90.106 propid 2016A-0453 seeing 1.00 MJD 57909.457 object MzLS_709059_z mosaic/CP/V4.3/CP20170604/k4m_170605_105754_ooi_zd_ls9.fits.fz k4m_171001_044506_ooi_zd_ls9-CCD3 z expnum 141569 exptime 108.104 propid 2016A-0453 seeing 0.92 MJD 58027.198 object MzLS_709533_z mosaic/CP/V4.3/CP20170930/k4m_171001_044506_ooi_zd_ls9.fits.fz ksb_180521_092125_ooi_r_ls9-CCD3 r expnum 82590115 exptime 106.299 propid NOTBASS seeing 1.68 MJD 58259.390 object 44763 90prime/CP/V2.3/CP20180520/ksb_180521_092125_ooi_r_ls9.fits.fz ksb_180722_052222_ooi_g_ls9-CCD1 g expnum 83210061 exptime 250.0 propid NOTBASS seeing 1.48 MJD 58321.224 object 44753 90prime/CP/V2.3/CP20180721/ksb_180722_052222_ooi_g_ls9.fits.fz ksb_180722_051716_ooi_g_ls9-CCD1 g expnum 83210060 exptime 250.0 propid NOTBASS seeing 1.49 MJD 58321.220 object 44753 90prime/CP/V2.3/CP20180721/ksb_180722_051716_ooi_g_ls9.fits.fz ksb_180521_090209_ooi_r_ls9-CCD1 r expnum 82590107 exptime 102.701 propid NOTBASS seeing 1.54 MJD 58259.377 object 44753 90prime/CP/V2.3/CP20180520/ksb_180521_090209_ooi_r_ls9.fits.fz ksb_180508_094209_ooi_r_ls9-CCD2 r expnum 82460189 exptime 122.236 propid NOTBASS seeing 1.26 MJD 58246.404 object 44751 90prime/CP/V2.3/CP20180507/ksb_180508_094209_ooi_r_ls9.fits.fz ksb_180509_081711_ooi_g_ls9-CCD2 g expnum 82470132 exptime 127.1 propid NOTBASS seeing 1.56 MJD 58247.345 object 44751 90prime/CP/V2.3/CP20180508/ksb_180509_081711_ooi_g_ls9.fits.fz ksb_180522_085841_ooi_r_ls9-CCD2 r expnum 82600066 exptime 150.72 propid NOTBASS seeing 1.46 MJD 58260.374 object 44752 90prime/CP/V2.3/CP20180521/ksb_180522_085841_ooi_r_ls9.fits.fz ksb_180611_091606_ooi_g_ls9-CCD2 g expnum 82800125 exptime 130.231 propid NOTBASS seeing 2.02 MJD 58280.386 object 44752 90prime/CP/V2.3/CP20180610/ksb_180611_091606_ooi_g_ls9.fits.fz ksb_180416_100650_ooi_g_ls9-CCD3 g expnum 82240137 exptime 133.5 propid BASS seeing 1.50 MJD 58224.421 object 44763 90prime/CP/V2.3/CP20180415/ksb_180416_100650_ooi_g_ls9.fits.fz Faked up EXPNUM 83210061 Faked up EXPNUM 83210061 Faked up EXPNUM 83210061 90prime get_fwhm: self.fwhm = 3.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2919 3066 and amp range 2016 4031 and image y 78 225 and amp range 0 2047 Range in image: x 0 148 , y 0 148 (with image size 148 x 148) dzp -0.019046262 -> scaling image by 0.9826107140833663 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1381 1634 and amp range 0 2047 and image y 3077 3330 and amp range 2022 4060 Range in image: x 0 254 , y 0 254 (with image size 254 x 254) dzp -0.016192675 -> scaling image by 0.9851966584456431 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 83210060 Faked up EXPNUM 83210060 Faked up EXPNUM 83210060 90prime get_fwhm: self.fwhm = 3.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2920 3067 and amp range 2016 4031 and image y 78 226 and amp range 0 2047 Range in image: x 0 148 , y 0 149 (with image size 148 x 149) dzp -0.019046262 -> scaling image by 0.9826107140833663 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82800125 Faked up EXPNUM 82800125 Faked up EXPNUM 82800125 90prime get_fwhm: self.fwhm = 4.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2884 3027 and amp range 2016 4031 and image y 4046 4080 and amp range 2048 4095 Range in image: x 0 144 , y 0 35 (with image size 144 x 35) dzp 0.013237011 -> scaling image by 1.012266359574015 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82600066 Faked up EXPNUM 82600066 Faked up EXPNUM 82600066 90prime get_fwhm: self.fwhm = 3.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2878 3021 and amp range 2016 4031 and image y 4037 4080 and amp range 2048 4095 Range in image: x 0 144 , y 0 44 (with image size 144 x 44) dzp 0.019008487 -> scaling image by 1.0176616178968958 mosaic get_fwhm: self.fwhm = 3.87 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2933 3179 and amp range 2006 4053 and image y 2829 3075 and amp range 2040 4078 Range in image: x 0 247 , y 0 247 (with image size 247 x 247) dzp 0.012593497 -> scaling image by 1.0116665687010755 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82590107 Faked up EXPNUM 82590107 Faked up EXPNUM 82590107 90prime get_fwhm: self.fwhm = 3.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2979 3126 and amp range 2016 4031 and image y 104 251 and amp range 0 2047 Range in image: x 0 148 , y 0 148 (with image size 148 x 148) dzp -0.03177219 -> scaling image by 0.9711607558798585 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82590115 Faked up EXPNUM 82590115 Faked up EXPNUM 82590115 90prime get_fwhm: self.fwhm = 3.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3139 3282 and amp range 2016 4031 and image y 3589 3733 and amp range 2048 4095 Range in image: x 0 144 , y 0 145 (with image size 144 x 145) dzp -0.0072602304 -> scaling image by 0.9933353884052984 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82240137 Faked up EXPNUM 82240137 Faked up EXPNUM 82240137 90prime get_fwhm: self.fwhm = 3.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3077 3221 and amp range 2016 4031 and image y 3581 3725 and amp range 2048 4095 Range in image: x 0 145 , y 0 145 (with image size 145 x 145) dzp -0.01723723 -> scaling image by 0.9842492857213068 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.53 Found 4 relevant rows in amp-corrections file. Found overlap: image x 222 474 and amp range 0 2005 and image y 7 115 and amp range 0 2039 Range in image: x 0 253 , y 0 109 (with image size 253 x 109) dzp 0.0014252509 -> scaling image by 1.0013135665633692 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82460189 Faked up EXPNUM 82460189 Faked up EXPNUM 82460189 90prime get_fwhm: self.fwhm = 2.79 Found 4 relevant rows in amp-corrections file. Found overlap: image x 866 1011 and amp range 0 2015 and image y 2067 2213 and amp range 2048 4095 Range in image: x 0 146 , y 0 147 (with image size 146 x 147) dzp 0.0503617 -> scaling image by 1.047477444828492 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82470132 Faked up EXPNUM 82470132 Faked up EXPNUM 82470132 90prime get_fwhm: self.fwhm = 3.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 871 1016 and amp range 0 2015 and image y 2118 2264 and amp range 2048 4095 Range in image: x 0 146 , y 0 147 (with image size 146 x 147) dzp 0.0459271 -> scaling image by 1.0432078344950917 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 16.80 s, CPU: 1.67 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 175 MB, VmData: 207 MB, maxrss: 0.179032 MB Stage tims finished: 2020-08-05T19:30:59.158542 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 8.351 s worker CPU, 76.340 s worker Wall, Wall: 16.797 s, Cores in use: 0.60, Total efficiency (on 16 cores): 3.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T19:30:59.193663 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00464.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00527.fits Matched 20 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/metrics/cus/reference-custom-267215p67869.fits Stage refs : Wall: 11.22 s, CPU: 4.11 s, VmPeak: 993 MB, VmSize: 989 MB, VmRSS: 206 MB, VmData: 238 MB, maxrss: 0.211344 MB Stage refs finished: 2020-08-05T19:31:10.410349 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 11.218 s, Cores in use: 0.37, Total efficiency (on 16 cores): 2.3 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T19:31:10.494325 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/metrics/cus/outlier-mask-custom-267215p67869.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/metrics/cus/outliers-pre-custom-267215p67869.jpg Image ksb_180416_100650_ooi_g_ls9-CCD3 g : masking 165 positive outlier pixels and 0 negative outlier pixels Image ksb_180521_090209_ooi_r_ls9-CCD1 r : masking 75 positive outlier pixels and 0 negative outlier pixels Image k4m_171121_020531_ooi_zd_ls9-CCD4 z : masking 265 positive outlier pixels and 0 negative outlier pixels Image k4m_170605_105754_ooi_zd_ls9-CCD1 z : masking 657 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/metrics/cus/outlier-mask-custom-267215p67869.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/metrics/cus/outliers-post-custom-267215p67869.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/metrics/cus/outliers-masked-pos-custom-267215p67869.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/metrics/cus/outliers-masked-neg-custom-267215p67869.jpg Stage outliers : Wall: 4.08 s, CPU: 3.75 s, VmPeak: 998 MB, VmSize: 998 MB, VmRSS: 221 MB, VmData: 249 MB, maxrss: 0.225852 MB Stage outliers finished: 2020-08-05T19:31:14.574311 Resources for stage outliers : 0.770 s worker CPU, 0.841 s worker Wall, Wall: 4.082 s, Cores in use: 1.11, Total efficiency (on 16 cores): 6.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T19:31:14.685953 Stage halos : Wall: 2.86 s, CPU: 2.49 s, VmPeak: 998 MB, VmSize: 998 MB, VmRSS: 221 MB, VmData: 249 MB, maxrss: 0.226328 MB Stage halos finished: 2020-08-05T19:31:17.550351 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 2.866 s, Cores in use: 0.87, Total efficiency (on 16 cores): 5.4 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T19:31:17.578939 PSF sigmas in coadd pixels: ['2.41', '2.42', '2.54', '3.28', '2.44'] Using average PSF sigma 2.616436883383332 Gaussian PSF norm 0.10781639471810973 vs pixelized 0.08894045 average tim pixel scale / coadd scale: 1.7300446096537563 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.73', '2.50', '2.05', '2.38'] Using average PSF sigma 2.4150768013256316 Gaussian PSF norm 0.1168057229563204 vs pixelized 0.09062944 average tim pixel scale / coadd scale: 1.7303246396010783 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.67', '1.63', '1.49'] Using average PSF sigma 1.59822769303777 Gaussian PSF norm 0.17650475774055532 vs pixelized 0.14102073 average tim pixel scale / coadd scale: 0.9909836275019605 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.18 s, CPU: 0.16 s, VmPeak: 998 MB, VmSize: 998 MB, VmRSS: 223 MB, VmData: 250 MB, maxrss: 0.2285 MB Stage fit_on_coadds finished: 2020-08-05T19:31:17.754821 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.164 s worker CPU, 0.164 s worker Wall, Wall: 0.177 s, Cores in use: 1.86, Total efficiency (on 16 cores): 11.6 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T19:31:17.766042 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 9 potential peaks Of 9 potential peaks: 3 in veto map, 0 cut by saddle test, 0 cut by aper test, 6 kept SED z : 6 new peaks Found 17 potential peaks Of 17 potential peaks: 10 in veto map, 3 cut by saddle test, 0 cut by aper test, 4 kept SED r : 4 new peaks Found 11 potential peaks Of 11 potential peaks: 10 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 19 potential peaks Of 19 potential peaks: 14 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 23 potential peaks Of 23 potential peaks: 16 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept SED Red : 3 new peaks Adding 15 new sources Median coadd sky for g : 5.585311e-06 Median coadd sky for r : 9.225727e-05 Median coadd sky for z : -0.00024073533 Stage srcs : Wall: 2.81 s, CPU: 2.74 s, VmPeak: 998 MB, VmSize: 998 MB, VmRSS: 224 MB, VmData: 250 MB, maxrss: 0.229236 MB Stage srcs finished: 2020-08-05T19:31:20.572395 Resources for stage srcs : 0.076 s worker CPU, 0.076 s worker Wall, Wall: 2.808 s, Cores in use: 1.00, Total efficiency (on 16 cores): 6.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T19:31:20.587469 Blob 1 of 8, id: 2, sources: 5, size: 152x112, npix 9001, brick X: 38,190, Y: 83,195, one pixel: 70 83 Blob 2 of 8, id: 0, sources: 4, size: 74x47, npix 2739, brick X: 171,245, Y: 0,47, one pixel: 181 0 Blob 3 of 8, id: 4, sources: 3, size: 54x62, npix 2176, brick X: 191,245, Y: 129,191, one pixel: 235 129 Blob 4 of 8, id: 5, sources: 2, size: 29x53, npix 1013, brick X: 84,113, Y: 183,236, one pixel: 98 183 Blob 5 of 8, id: 1, sources: 2, size: 45x32, npix 916, brick X: 5,50, Y: 53,85, one pixel: 21 53 Blob 6 of 8, id: 7, sources: 2, size: 31x48, npix 855, brick X: 142,173, Y: 194,242, one pixel: 161 194 Blob 7 of 8, id: 6, sources: 1, size: 19x19, npix 217, brick X: 12,31, Y: 187,206, one pixel: 20 187 Blob 8 of 8, id: 3, sources: 1, size: 19x20, npix 208, brick X: 186,205, Y: 92,112, one pixel: 195 92 Blob 8 finished, total: Wall: 0.17 s, CPU: 0.17 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149816 MB Blob 7 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 809 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14968 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (267.18941, 67.87040), pm (0.7, 1.2), parallax 0.383 with NanoMaggies: g=(flux -5.24), r=18.7, z=17.9 Reset brightness to NanoMaggies: g=20.7, r=19.3, z=18.4 Blob 3 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 117 MB, VmData: 161 MB, maxrss: 0.119388 MB Measuring 1 iterative sources Blob 6 finished, total: Wall: 0.78 s, CPU: 0.77 s, VmPeak: 810 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150532 MB Blob 4 finished, total: Wall: 0.92 s, CPU: 0.92 s, VmPeak: 806 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150292 MB Blob 5 finished, total: Wall: 1.14 s, CPU: 1.14 s, VmPeak: 810 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150552 MB Blob 2 finished, total: Wall: 2.49 s, CPU: 2.48 s, VmPeak: 669 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.095088 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.49381, ee1=-0.600078, ee2=-0.291232 Measuring 6 iterative sources Blob 1 finished, total: Wall: 7.64 s, CPU: 7.64 s, VmPeak: 804 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 183 MB, maxrss: 0.152704 MB Old catalog: 21 New catalog: 24 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/metrics/cus/blobs-custom-267215p67869.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/metrics/cus/all-models-custom-267215p67869.fits Stage fitblobs : Wall: 8.60 s, CPU: 1.03 s, VmPeak: 998 MB, VmSize: 984 MB, VmRSS: 210 MB, VmData: 236 MB, maxrss: 0.229336 MB Stage fitblobs finished: 2020-08-05T19:31:29.182990 Resources for stage fitblobs : 13.811 s worker CPU, 13.943 s worker Wall, Wall: 8.597 s, Cores in use: 1.73, Total efficiency (on 16 cores): 10.8 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T19:31:29.196611 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/tmp-legacysurvey-custom-267215p67869-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/tmp-legacysurvey-custom-267215p67869-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/tmp-legacysurvey-custom-267215p67869-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/tmp-legacysurvey-custom-267215p67869-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-resid.jpg Stage coadds : Wall: 3.76 s, CPU: 1.07 s, VmPeak: 998 MB, VmSize: 984 MB, VmRSS: 211 MB, VmData: 236 MB, maxrss: 0.229336 MB Stage coadds finished: 2020-08-05T19:31:32.951689 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 7.573 s worker CPU, 13.915 s worker Wall, Wall: 3.757 s, Cores in use: 2.30, Total efficiency (on 16 cores): 14.4 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T19:31:32.978511 Cut to 1 unWISE tiles Reading WISE tile 2690p681 band 3 Reading WISE tile 2690p681 band 2 Reading WISE tile 2690p681 band 1 Reading WISE tile 2690p681 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 810 MB, VmSize: 810 MB, VmRSS: 152 MB, VmData: 178 MB, maxrss: 0.19766 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 811 MB, VmSize: 799 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.2024 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 868 MB, VmSize: 868 MB, VmRSS: 208 MB, VmData: 235 MB, maxrss: 0.213108 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 809 MB, VmSize: 800 MB, VmRSS: 141 MB, VmData: 172 MB, maxrss: 0.203492 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/tmp-legacysurvey-custom-267215p67869-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/tmp-legacysurvey-custom-267215p67869-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.96 s, CPU: 1.00 s, VmPeak: 998 MB, VmSize: 984 MB, VmRSS: 211 MB, VmData: 236 MB, maxrss: 0.229336 MB Stage wise_forced finished: 2020-08-05T19:31:35.934587 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.938 s worker CPU, 5.965 s worker Wall, Wall: 2.957 s, Cores in use: 1.67, Total efficiency (on 16 cores): 10.4 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T19:31:35.947640 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/tractor-i/cus/tractor-custom-267215p67869.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/tractor/cus/tractor-custom-267215p67869.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/tractor/cus/brick-custom-267215p67869.sha256sum Stage writecat : Wall: 1.65 s, CPU: 0.94 s, VmPeak: 1117 MB, VmSize: 989 MB, VmRSS: 213 MB, VmData: 236 MB, maxrss: 0.349164 MB Stage writecat finished: 2020-08-05T19:31:37.596242 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.650 s, Cores in use: 0.57, Total efficiency (on 16 cores): 3.6 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-writecat.p All done: 34.688 s worker CPU, 111.250 s worker Wall, Wall: 55.282 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.1 % Finished galaxy PGC2707501 in 1.010 minutes. Started working on galaxy PGC2707501 at Wed Aug 5 20:29:20 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 267.21511499999997 67.869003 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T20:29:21.721077 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '267.21511499999997', '67.869003', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 267.21511499999997 67.869003 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 267.21511499999997 67.869003 Starting process 7171 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 7173 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 7175 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 7177 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 7179 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 7181 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 7184 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 7186 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 7188 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 7190 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 7192 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 7194 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 7196 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 7197 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 7200 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 7202 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 7206 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 7207 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 7208 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 7209 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 7210 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 7211 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 7212 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 7213 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 7214 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 7215 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 7217 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 7218 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 7219 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 7220 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 7222 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 7223 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T20:29:23.567643 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 13 CCDs: k4m_171121_020531_ooi_zd_ls9-CCD4 z expnum 147902 exptime 250.104 propid 2016A-0453 seeing 1.03 MJD 58078.087 object MzLS_708581_z mosaic/CP/V4.3/CP20171120/k4m_171121_020531_ooi_zd_ls9.fits.fz k4m_171001_044024_ooi_zd_ls9-CCD2 z expnum 141567 exptime 101.104 propid 2016A-0453 seeing 0.88 MJD 58027.195 object MzLS_708101_z mosaic/CP/V4.3/CP20170930/k4m_171001_044024_ooi_zd_ls9.fits.fz k4m_170605_105754_ooi_zd_ls9-CCD1 z expnum 131889 exptime 90.106 propid 2016A-0453 seeing 1.00 MJD 57909.457 object MzLS_709059_z mosaic/CP/V4.3/CP20170604/k4m_170605_105754_ooi_zd_ls9.fits.fz k4m_171001_044506_ooi_zd_ls9-CCD3 z expnum 141569 exptime 108.104 propid 2016A-0453 seeing 0.92 MJD 58027.198 object MzLS_709533_z mosaic/CP/V4.3/CP20170930/k4m_171001_044506_ooi_zd_ls9.fits.fz ksb_180521_092125_ooi_r_ls9-CCD3 r expnum 82590115 exptime 106.299 propid NOTBASS seeing 1.68 MJD 58259.390 object 44763 90prime/CP/V2.3/CP20180520/ksb_180521_092125_ooi_r_ls9.fits.fz ksb_180722_052222_ooi_g_ls9-CCD1 g expnum 83210061 exptime 250.0 propid NOTBASS seeing 1.48 MJD 58321.224 object 44753 90prime/CP/V2.3/CP20180721/ksb_180722_052222_ooi_g_ls9.fits.fz ksb_180722_051716_ooi_g_ls9-CCD1 g expnum 83210060 exptime 250.0 propid NOTBASS seeing 1.49 MJD 58321.220 object 44753 90prime/CP/V2.3/CP20180721/ksb_180722_051716_ooi_g_ls9.fits.fz ksb_180521_090209_ooi_r_ls9-CCD1 r expnum 82590107 exptime 102.701 propid NOTBASS seeing 1.54 MJD 58259.377 object 44753 90prime/CP/V2.3/CP20180520/ksb_180521_090209_ooi_r_ls9.fits.fz ksb_180508_094209_ooi_r_ls9-CCD2 r expnum 82460189 exptime 122.236 propid NOTBASS seeing 1.26 MJD 58246.404 object 44751 90prime/CP/V2.3/CP20180507/ksb_180508_094209_ooi_r_ls9.fits.fz ksb_180509_081711_ooi_g_ls9-CCD2 g expnum 82470132 exptime 127.1 propid NOTBASS seeing 1.56 MJD 58247.345 object 44751 90prime/CP/V2.3/CP20180508/ksb_180509_081711_ooi_g_ls9.fits.fz ksb_180522_085841_ooi_r_ls9-CCD2 r expnum 82600066 exptime 150.72 propid NOTBASS seeing 1.46 MJD 58260.374 object 44752 90prime/CP/V2.3/CP20180521/ksb_180522_085841_ooi_r_ls9.fits.fz ksb_180611_091606_ooi_g_ls9-CCD2 g expnum 82800125 exptime 130.231 propid NOTBASS seeing 2.02 MJD 58280.386 object 44752 90prime/CP/V2.3/CP20180610/ksb_180611_091606_ooi_g_ls9.fits.fz ksb_180416_100650_ooi_g_ls9-CCD3 g expnum 82240137 exptime 133.5 propid BASS seeing 1.50 MJD 58224.421 object 44763 90prime/CP/V2.3/CP20180415/ksb_180416_100650_ooi_g_ls9.fits.fz mosaic get_fwhm: self.fwhm = 3.53 Found 4 relevant rows in amp-corrections file. Found overlap: image x 222 474 and amp range 0 2005 and image y 7 115 and amp range 0 2039 Range in image: x 0 253 , y 0 109 (with image size 253 x 109) dzp 0.0014252509 -> scaling image by 1.0013135665633692 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82800125 Faked up EXPNUM 82800125 Faked up EXPNUM 82800125 90prime get_fwhm: self.fwhm = 4.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2884 3027 and amp range 2016 4031 and image y 4046 4080 and amp range 2048 4095 Range in image: x 0 144 , y 0 35 (with image size 144 x 35) dzp 0.013237011 -> scaling image by 1.012266359574015 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.87 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2933 3179 and amp range 2006 4053 and image y 2829 3075 and amp range 2040 4078 Range in image: x 0 247 , y 0 247 (with image size 247 x 247) dzp 0.012593497 -> scaling image by 1.0116665687010755 Faked up EXPNUM 83210061 Faked up EXPNUM 83210061 Faked up EXPNUM 83210061 90prime get_fwhm: self.fwhm = 3.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2919 3066 and amp range 2016 4031 and image y 78 225 and amp range 0 2047 Range in image: x 0 148 , y 0 148 (with image size 148 x 148) dzp -0.019046262 -> scaling image by 0.9826107140833663 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82470132 Faked up EXPNUM 82470132 Faked up EXPNUM 82470132 90prime get_fwhm: self.fwhm = 3.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 871 1016 and amp range 0 2015 and image y 2118 2264 and amp range 2048 4095 Range in image: x 0 146 , y 0 147 (with image size 146 x 147) dzp 0.0459271 -> scaling image by 1.0432078344950917 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82590107 Faked up EXPNUM 82590107 Faked up EXPNUM 82590107 90prime get_fwhm: self.fwhm = 3.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2979 3126 and amp range 2016 4031 and image y 104 251 and amp range 0 2047 Range in image: x 0 148 , y 0 148 (with image size 148 x 148) dzp -0.03177219 -> scaling image by 0.9711607558798585 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82240137 Faked up EXPNUM 82240137 Faked up EXPNUM 82240137 90prime get_fwhm: self.fwhm = 3.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3077 3221 and amp range 2016 4031 and image y 3581 3725 and amp range 2048 4095 Range in image: x 0 145 , y 0 145 (with image size 145 x 145) dzp -0.01723723 -> scaling image by 0.9842492857213068 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1381 1634 and amp range 0 2047 and image y 3077 3330 and amp range 2022 4060 Range in image: x 0 254 , y 0 254 (with image size 254 x 254) dzp -0.016192675 -> scaling image by 0.9851966584456431 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82460189 Faked up EXPNUM 82460189 Faked up EXPNUM 82460189 90prime get_fwhm: self.fwhm = 2.79 Found 4 relevant rows in amp-corrections file. Found overlap: image x 866 1011 and amp range 0 2015 and image y 2067 2213 and amp range 2048 4095 Range in image: x 0 146 , y 0 147 (with image size 146 x 147) dzp 0.0503617 -> scaling image by 1.047477444828492 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82590115 Faked up EXPNUM 82590115 Faked up EXPNUM 82590115 90prime get_fwhm: self.fwhm = 3.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3139 3282 and amp range 2016 4031 and image y 3589 3733 and amp range 2048 4095 Range in image: x 0 144 , y 0 145 (with image size 144 x 145) dzp -0.0072602304 -> scaling image by 0.9933353884052984 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 83210060 Faked up EXPNUM 83210060 Faked up EXPNUM 83210060 90prime get_fwhm: self.fwhm = 3.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2920 3067 and amp range 2016 4031 and image y 78 226 and amp range 0 2047 Range in image: x 0 148 , y 0 149 (with image size 148 x 149) dzp -0.019046262 -> scaling image by 0.9826107140833663 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82600066 Faked up EXPNUM 82600066 Faked up EXPNUM 82600066 90prime get_fwhm: self.fwhm = 3.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2878 3021 and amp range 2016 4031 and image y 4037 4080 and amp range 2048 4095 Range in image: x 0 144 , y 0 44 (with image size 144 x 44) dzp 0.019008487 -> scaling image by 1.0176616178968958 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 6.90 s, CPU: 2.14 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 175 MB, VmData: 207 MB, maxrss: 0.179104 MB Stage tims finished: 2020-08-05T20:29:30.468810 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 7.831 s worker CPU, 31.206 s worker Wall, Wall: 6.904 s, Cores in use: 1.45, Total efficiency (on 32 cores): 4.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T20:29:30.533458 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00464.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00527.fits Matched 20 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/metrics/cus/reference-custom-267215p67869.fits Stage refs : Wall: 12.65 s, CPU: 4.59 s, VmPeak: 993 MB, VmSize: 989 MB, VmRSS: 206 MB, VmData: 237 MB, maxrss: 0.211128 MB Stage refs finished: 2020-08-05T20:29:43.186479 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 12.656 s, Cores in use: 0.36, Total efficiency (on 32 cores): 1.1 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-refs.p Running stage outliers WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage outliers at 2020-08-05T20:29:43.215678 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/metrics/cus/outlier-mask-custom-267215p67869.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/metrics/cus/outliers-pre-custom-267215p67869.jpg Image ksb_180416_100650_ooi_g_ls9-CCD3 g : masking 165 positive outlier pixels and 0 negative outlier pixels Image ksb_180521_090209_ooi_r_ls9-CCD1 r : masking 75 positive outlier pixels and 0 negative outlier pixels Image k4m_170605_105754_ooi_zd_ls9-CCD1 z : masking 657 positive outlier pixels and 0 negative outlier pixels Image k4m_171121_020531_ooi_zd_ls9-CCD4 z : masking 265 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/metrics/cus/outlier-mask-custom-267215p67869.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/metrics/cus/outliers-post-custom-267215p67869.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/metrics/cus/outliers-masked-pos-custom-267215p67869.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/metrics/cus/outliers-masked-neg-custom-267215p67869.jpg Stage outliers : Wall: 1.65 s, CPU: 1.14 s, VmPeak: 998 MB, VmSize: 998 MB, VmRSS: 221 MB, VmData: 250 MB, maxrss: 0.226676 MB Stage outliers finished: 2020-08-05T20:29:44.869812 Resources for stage outliers : 0.904 s worker CPU, 1.281 s worker Wall, Wall: 1.656 s, Cores in use: 1.23, Total efficiency (on 32 cores): 3.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T20:29:44.905688 Stage halos : Wall: 1.04 s, CPU: 1.01 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 222 MB, VmData: 250 MB, maxrss: 0.227156 MB Stage halos finished: 2020-08-05T20:29:45.949874 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 1.046 s, Cores in use: 0.97, Total efficiency (on 32 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T20:29:46.093038 PSF sigmas in coadd pixels: ['2.41', '2.42', '2.54', '3.28', '2.44'] Using average PSF sigma 2.616436883383332 Gaussian PSF norm 0.10781639471810973 vs pixelized 0.08894044 average tim pixel scale / coadd scale: 1.7300446096537563 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.73', '2.50', '2.05', '2.38'] Using average PSF sigma 2.4150768013256316 Gaussian PSF norm 0.1168057229563204 vs pixelized 0.09062944 average tim pixel scale / coadd scale: 1.7303246396010783 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.67', '1.63', '1.49'] Using average PSF sigma 1.59822769303777 Gaussian PSF norm 0.17650475774055532 vs pixelized 0.14102073 average tim pixel scale / coadd scale: 0.9909836275019605 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.18 s, CPU: 0.15 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 223 MB, VmData: 250 MB, maxrss: 0.228756 MB Stage fit_on_coadds finished: 2020-08-05T20:29:46.271160 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.176 s worker CPU, 0.176 s worker Wall, Wall: 0.180 s, Cores in use: 1.84, Total efficiency (on 32 cores): 5.7 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T20:29:46.294457 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 9 potential peaks Of 9 potential peaks: 3 in veto map, 0 cut by saddle test, 0 cut by aper test, 6 kept SED z : 6 new peaks Found 17 potential peaks Of 17 potential peaks: 10 in veto map, 3 cut by saddle test, 0 cut by aper test, 4 kept SED r : 4 new peaks Found 11 potential peaks Of 11 potential peaks: 10 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 19 potential peaks Of 19 potential peaks: 14 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 23 potential peaks Of 23 potential peaks: 16 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept SED Red : 3 new peaks Adding 15 new sources Median coadd sky for g : 5.585275e-06 Median coadd sky for r : 9.225727e-05 Median coadd sky for z : -0.00024073533 Stage srcs : Wall: 1.14 s, CPU: 1.10 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 224 MB, VmData: 250 MB, maxrss: 0.229256 MB Stage srcs finished: 2020-08-05T20:29:47.435867 Resources for stage srcs : 0.091 s worker CPU, 0.091 s worker Wall, Wall: 1.144 s, Cores in use: 1.04, Total efficiency (on 32 cores): 3.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T20:29:47.633505 Blob 1 of 8, id: 2, sources: 5, size: 152x112, npix 9001, brick X: 38,190, Y: 83,195, one pixel: 70 83 Blob 2 of 8, id: 0, sources: 4, size: 74x47, npix 2739, brick X: 171,245, Y: 0,47, one pixel: 181 0 Blob 3 of 8, id: 4, sources: 3, size: 54x62, npix 2176, brick X: 191,245, Y: 129,191, one pixel: 235 129 Blob 4 of 8, id: 5, sources: 2, size: 29x53, npix 1013, brick X: 84,113, Y: 183,236, one pixel: 98 183 Blob 5 of 8, id: 1, sources: 2, size: 45x32, npix 916, brick X: 5,50, Y: 53,85, one pixel: 21 53 Blob 6 of 8, id: 7, sources: 2, size: 31x48, npix 855, brick X: 142,173, Y: 194,242, one pixel: 161 194 Blob 7 of 8, id: 6, sources: 1, size: 19x19, npix 217, brick X: 12,31, Y: 187,206, one pixel: 20 187 Blob 8 of 8, id: 3, sources: 1, size: 19x20, npix 208, brick X: 186,205, Y: 92,112, one pixel: 195 92 Blob 7 finished, total: Wall: 0.20 s, CPU: 0.19 s, VmPeak: 692 MB, VmSize: 692 MB, VmRSS: 117 MB, VmData: 161 MB, maxrss: 0.119456 MB Blob 8 finished, total: Wall: 0.21 s, CPU: 0.20 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.09374 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (267.18941, 67.87040), pm (0.7, 1.2), parallax 0.383 with NanoMaggies: g=(flux -5.24), r=18.7, z=17.9 Reset brightness to NanoMaggies: g=20.7, r=19.3, z=18.4 Blob 3 finished, total: Wall: 0.31 s, CPU: 0.30 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.092956 MB Measuring 1 iterative sources Blob 6 finished, total: Wall: 0.82 s, CPU: 0.81 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.093544 MB Blob 4 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 809 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150052 MB Blob 5 finished, total: Wall: 1.05 s, CPU: 1.04 s, VmPeak: 804 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149764 MB Blob 2 finished, total: Wall: 2.49 s, CPU: 2.48 s, VmPeak: 809 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149396 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.49381, ee1=-0.600078, ee2=-0.291232 Measuring 6 iterative sources Blob 1 finished, total: Wall: 8.10 s, CPU: 8.10 s, VmPeak: 683 MB, VmSize: 683 MB, VmRSS: 110 MB, VmData: 154 MB, maxrss: 0.112496 MB Old catalog: 21 New catalog: 24 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/metrics/cus/blobs-custom-267215p67869.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/metrics/cus/all-models-custom-267215p67869.fits Stage fitblobs : Wall: 8.82 s, CPU: 0.78 s, VmPeak: 999 MB, VmSize: 984 MB, VmRSS: 209 MB, VmData: 235 MB, maxrss: 0.229336 MB Stage fitblobs finished: 2020-08-05T20:29:56.452635 Resources for stage fitblobs : 14.093 s worker CPU, 14.242 s worker Wall, Wall: 8.821 s, Cores in use: 1.69, Total efficiency (on 32 cores): 5.3 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T20:29:56.468322 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/tmp-legacysurvey-custom-267215p67869-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/tmp-legacysurvey-custom-267215p67869-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/tmp-legacysurvey-custom-267215p67869-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/tmp-legacysurvey-custom-267215p67869-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-resid.jpg Stage coadds : Wall: 4.50 s, CPU: 1.10 s, VmPeak: 999 MB, VmSize: 984 MB, VmRSS: 210 MB, VmData: 235 MB, maxrss: 0.229336 MB Stage coadds finished: 2020-08-05T20:30:00.964600 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 22.816 s worker CPU, 41.697 s worker Wall, Wall: 4.499 s, Cores in use: 5.32, Total efficiency (on 32 cores): 16.6 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T20:30:00.996945 Cut to 1 unWISE tiles Reading WISE tile 2690p681 band 1 Reading WISE tile 2690p681 band 2 Reading WISE tile 2690p681 band 4 Reading WISE tile 2690p681 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 810 MB, VmSize: 803 MB, VmRSS: 146 MB, VmData: 175 MB, maxrss: 0.189164 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 811 MB, VmSize: 799 MB, VmRSS: 140 MB, VmData: 171 MB, maxrss: 0.202204 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 808 MB, VmSize: 806 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.211168 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 807 MB, VmSize: 807 MB, VmRSS: 146 MB, VmData: 179 MB, maxrss: 0.200292 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/tmp-legacysurvey-custom-267215p67869-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/tmp-legacysurvey-custom-267215p67869-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.59 s, CPU: 0.66 s, VmPeak: 999 MB, VmSize: 984 MB, VmRSS: 210 MB, VmData: 235 MB, maxrss: 0.229336 MB Stage wise_forced finished: 2020-08-05T20:30:03.583577 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.702 s worker CPU, 4.963 s worker Wall, Wall: 2.590 s, Cores in use: 1.68, Total efficiency (on 32 cores): 5.3 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T20:30:03.601514 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/coadd/cus/custom-267215p67869/legacysurvey-custom-267215p67869-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/tractor-i/cus/tractor-custom-267215p67869.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/tractor/cus/tractor-custom-267215p67869.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/tractor/cus/brick-custom-267215p67869.sha256sum Stage writecat : Wall: 1.88 s, CPU: 0.62 s, VmPeak: 1116 MB, VmSize: 988 MB, VmRSS: 212 MB, VmData: 235 MB, maxrss: 0.34842 MB Stage writecat finished: 2020-08-05T20:30:05.482465 Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 1.884 s, Cores in use: 0.33, Total efficiency (on 32 cores): 1.0 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC2707501/PGC2707501-largegalaxy-writecat.p All done: 49.621 s worker CPU, 93.664 s worker Wall, Wall: 41.947 s, Cores in use: 1.50, Total efficiency (on 32 cores): 4.7 % Finished galaxy PGC2707501 in 0.755 minutes. Started working on galaxy PGC2707501 at Fri Aug 7 09:20:28 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 267.2186040443205 67.86894243543068 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/PGC2707501-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/PGC2707501-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T09:20:29.264175 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '267.2186040443205', '67.86894243543068', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/PGC2707501-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/PGC2707501-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 267.2186040443205 67.86894243543068 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/PGC2707501-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/PGC2707501-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 267.2186040443205 67.86894243543068 Starting process 32350 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 32351 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 32352 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 32353 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 32354 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05948 MB Starting process 32355 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059428 MB Starting process 32356 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059428 MB Starting process 32357 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 32358 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 32359 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 32360 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 32361 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 32362 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 32363 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 32364 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 32365 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T09:20:29.733509 Keeping 13 CCDs: k4m_171121_020531_ooi_zd_ls9-CCD4 z expnum 147902 exptime 250.104 propid 2016A-0453 seeing 1.03 MJD 58078.087 object MzLS_708581_z mosaic/CP/V4.3/CP20171120/k4m_171121_020531_ooi_zd_ls9.fits.fz k4m_171001_044024_ooi_zd_ls9-CCD2 z expnum 141567 exptime 101.104 propid 2016A-0453 seeing 0.88 MJD 58027.195 object MzLS_708101_z mosaic/CP/V4.3/CP20170930/k4m_171001_044024_ooi_zd_ls9.fits.fz k4m_170605_105754_ooi_zd_ls9-CCD1 z expnum 131889 exptime 90.106 propid 2016A-0453 seeing 1.00 MJD 57909.457 object MzLS_709059_z mosaic/CP/V4.3/CP20170604/k4m_170605_105754_ooi_zd_ls9.fits.fz k4m_171001_044506_ooi_zd_ls9-CCD3 z expnum 141569 exptime 108.104 propid 2016A-0453 seeing 0.92 MJD 58027.198 object MzLS_709533_z mosaic/CP/V4.3/CP20170930/k4m_171001_044506_ooi_zd_ls9.fits.fz ksb_180521_092125_ooi_r_ls9-CCD3 r expnum 82590115 exptime 106.299 propid NOTBASS seeing 1.68 MJD 58259.390 object 44763 90prime/CP/V2.3/CP20180520/ksb_180521_092125_ooi_r_ls9.fits.fz ksb_180722_052222_ooi_g_ls9-CCD1 g expnum 83210061 exptime 250.0 propid NOTBASS seeing 1.48 MJD 58321.224 object 44753 90prime/CP/V2.3/CP20180721/ksb_180722_052222_ooi_g_ls9.fits.fz ksb_180722_051716_ooi_g_ls9-CCD1 g expnum 83210060 exptime 250.0 propid NOTBASS seeing 1.49 MJD 58321.220 object 44753 90prime/CP/V2.3/CP20180721/ksb_180722_051716_ooi_g_ls9.fits.fz ksb_180521_090209_ooi_r_ls9-CCD1 r expnum 82590107 exptime 102.701 propid NOTBASS seeing 1.54 MJD 58259.377 object 44753 90prime/CP/V2.3/CP20180520/ksb_180521_090209_ooi_r_ls9.fits.fz ksb_180508_094209_ooi_r_ls9-CCD2 r expnum 82460189 exptime 122.236 propid NOTBASS seeing 1.26 MJD 58246.404 object 44751 90prime/CP/V2.3/CP20180507/ksb_180508_094209_ooi_r_ls9.fits.fz ksb_180509_081711_ooi_g_ls9-CCD2 g expnum 82470132 exptime 127.1 propid NOTBASS seeing 1.56 MJD 58247.345 object 44751 90prime/CP/V2.3/CP20180508/ksb_180509_081711_ooi_g_ls9.fits.fz ksb_180522_085841_ooi_r_ls9-CCD2 r expnum 82600066 exptime 150.72 propid NOTBASS seeing 1.46 MJD 58260.374 object 44752 90prime/CP/V2.3/CP20180521/ksb_180522_085841_ooi_r_ls9.fits.fz ksb_180611_091606_ooi_g_ls9-CCD2 g expnum 82800125 exptime 130.231 propid NOTBASS seeing 2.02 MJD 58280.386 object 44752 90prime/CP/V2.3/CP20180610/ksb_180611_091606_ooi_g_ls9.fits.fz ksb_180416_100650_ooi_g_ls9-CCD3 g expnum 82240137 exptime 133.5 propid BASS seeing 1.50 MJD 58224.421 object 44763 90prime/CP/V2.3/CP20180415/ksb_180416_100650_ooi_g_ls9.fits.fz mosaic get_fwhm: self.fwhm = 3.87 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2932 3179 and amp range 2006 4053 and image y 2848 3093 and amp range 2040 4078 Range in image: x 0 248 , y 0 246 (with image size 248 x 246) dzp 0.012593497 -> scaling image by 1.0116665687010755 mosaic get_fwhm: self.fwhm = 3.53 Found 4 relevant rows in amp-corrections file. Found overlap: image x 221 473 and amp range 0 2005 and image y 7 134 and amp range 0 2039 Range in image: x 0 253 , y 0 128 (with image size 253 x 128) dzp 0.0014252509 -> scaling image by 1.0013135665633692 mosaic get_fwhm: self.fwhm = 3.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1380 1634 and amp range 0 2047 and image y 3095 3348 and amp range 2022 4060 Range in image: x 0 255 , y 0 254 (with image size 255 x 254) dzp -0.016192675 -> scaling image by 0.9851966584456431 Faked up EXPNUM 82800125 Faked up EXPNUM 82800125 Faked up EXPNUM 82800125 90prime get_fwhm: self.fwhm = 4.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2884 3028 and amp range 2016 4031 and image y 4036 4080 and amp range 2048 4095 Range in image: x 0 145 , y 0 45 (with image size 145 x 45) dzp 0.013237011 -> scaling image by 1.012266359574015 Faked up EXPNUM 83210061 Faked up EXPNUM 83210061 Faked up EXPNUM 83210061 90prime get_fwhm: self.fwhm = 3.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2919 3066 and amp range 2016 4031 and image y 67 215 and amp range 0 2047 Range in image: x 0 148 , y 0 149 (with image size 148 x 149) dzp -0.019046262 -> scaling image by 0.9826107140833663 Faked up EXPNUM 82600066 Faked up EXPNUM 82600066 Faked up EXPNUM 82600066 90prime get_fwhm: self.fwhm = 3.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2879 3022 and amp range 2016 4031 and image y 4026 4080 and amp range 2048 4095 Range in image: x 0 144 , y 0 55 (with image size 144 x 55) dzp 0.019008487 -> scaling image by 1.0176616178968958 Faked up EXPNUM 83210060 Faked up EXPNUM 83210060 Faked up EXPNUM 83210060 90prime get_fwhm: self.fwhm = 3.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2920 3067 and amp range 2016 4031 and image y 68 216 and amp range 0 2047 Range in image: x 0 148 , y 0 149 (with image size 148 x 149) dzp -0.019046262 -> scaling image by 0.9826107140833663 Faked up EXPNUM 82590107 Faked up EXPNUM 82590107 Faked up EXPNUM 82590107 90prime get_fwhm: self.fwhm = 3.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2979 3126 and amp range 2016 4031 and image y 93 241 and amp range 0 2047 Range in image: x 0 148 , y 0 149 (with image size 148 x 149) dzp -0.03177219 -> scaling image by 0.9711607558798585 Faked up EXPNUM 82470132 Faked up EXPNUM 82470132 Faked up EXPNUM 82470132 90prime get_fwhm: self.fwhm = 3.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 871 1016 and amp range 0 2015 and image y 2108 2253 and amp range 2048 4095 Range in image: x 0 146 , y 0 146 (with image size 146 x 146) dzp 0.0459271 -> scaling image by 1.0432078344950917 Faked up EXPNUM 82460189 Faked up EXPNUM 82460189 Faked up EXPNUM 82460189 90prime get_fwhm: self.fwhm = 2.79 Found 4 relevant rows in amp-corrections file. Found overlap: image x 866 1011 and amp range 0 2015 and image y 2057 2203 and amp range 2048 4095 Range in image: x 0 146 , y 0 147 (with image size 146 x 147) dzp 0.0503617 -> scaling image by 1.047477444828492 Faked up EXPNUM 82590115 Faked up EXPNUM 82590115 Faked up EXPNUM 82590115 90prime get_fwhm: self.fwhm = 3.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3139 3283 and amp range 2016 4031 and image y 3579 3723 and amp range 2048 4095 Range in image: x 0 145 , y 0 145 (with image size 145 x 145) dzp -0.0072602304 -> scaling image by 0.9933353884052984 Faked up EXPNUM 82240137 Faked up EXPNUM 82240137 Faked up EXPNUM 82240137 90prime get_fwhm: self.fwhm = 3.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3078 3222 and amp range 2016 4031 and image y 3571 3715 and amp range 2048 4095 Range in image: x 0 145 , y 0 145 (with image size 145 x 145) dzp -0.01723723 -> scaling image by 0.9842492857213068 Stage tims : Wall: 101.08 s, CPU: 0.95 s, VmPeak: 952 MB, VmSize: 952 MB, VmRSS: 173 MB, VmData: 207 MB, maxrss: 0.17716 MB Stage tims finished: 2020-08-07T09:22:10.811983 Resources for stage tims : 6.650 s worker CPU, 627.033 s worker Wall, Wall: 101.080 s, Cores in use: 0.08, Total efficiency (on 16 cores): 0.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/PGC2707501-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/PGC2707501-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T09:22:10.920416 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00464.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00527.fits Matched 20 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/metrics/cus/reference-custom-267218p67868.fits Stage refs : Wall: 20.74 s, CPU: 2.97 s, VmPeak: 986 MB, VmSize: 982 MB, VmRSS: 205 MB, VmData: 237 MB, maxrss: 0.20946 MB Stage refs finished: 2020-08-07T09:22:31.655523 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 20.737 s, Cores in use: 0.14, Total efficiency (on 16 cores): 0.9 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/PGC2707501-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/PGC2707501-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T09:22:32.733987 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/metrics/cus/outlier-mask-custom-267218p67868.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/metrics/cus/outliers-pre-custom-267218p67868.jpg Image ksb_180416_100650_ooi_g_ls9-CCD3 g : masking 94 positive outlier pixels and 0 negative outlier pixels Image ksb_180508_094209_ooi_r_ls9-CCD2 r : masking 66 positive outlier pixels and 0 negative outlier pixels Image ksb_180521_090209_ooi_r_ls9-CCD1 r : masking 90 positive outlier pixels and 0 negative outlier pixels Image k4m_171121_020531_ooi_zd_ls9-CCD4 z : masking 366 positive outlier pixels and 0 negative outlier pixels Image k4m_170605_105754_ooi_zd_ls9-CCD1 z : masking 626 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/metrics/cus/outlier-mask-custom-267218p67868.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/metrics/cus/outliers-post-custom-267218p67868.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/metrics/cus/outliers-masked-pos-custom-267218p67868.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/metrics/cus/outliers-masked-neg-custom-267218p67868.jpg Stage outliers : Wall: 0.87 s, CPU: 0.67 s, VmPeak: 992 MB, VmSize: 992 MB, VmRSS: 219 MB, VmData: 249 MB, maxrss: 0.224044 MB Stage outliers finished: 2020-08-07T09:22:33.602403 Resources for stage outliers : 0.808 s worker CPU, 0.867 s worker Wall, Wall: 0.870 s, Cores in use: 1.70, Total efficiency (on 16 cores): 10.6 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/PGC2707501-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/PGC2707501-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T09:22:33.685470 Stage halos : Wall: 0.30 s, CPU: 0.29 s, VmPeak: 992 MB, VmSize: 992 MB, VmRSS: 219 MB, VmData: 249 MB, maxrss: 0.224596 MB Stage halos finished: 2020-08-07T09:22:33.990252 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.306 s, Cores in use: 0.96, Total efficiency (on 16 cores): 6.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/PGC2707501-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/PGC2707501-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T09:22:34.029765 PSF sigmas in coadd pixels: ['2.41', '2.42', '2.54', '3.28', '2.44'] Using average PSF sigma 2.616436883383332 Gaussian PSF norm 0.10781639471810973 vs pixelized 0.08894231 average tim pixel scale / coadd scale: 1.7300446096537563 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.73', '2.50', '2.05', '2.38'] Using average PSF sigma 2.4150768013256316 Gaussian PSF norm 0.1168057229563204 vs pixelized 0.090633534 average tim pixel scale / coadd scale: 1.7303246396010783 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.67', '1.63', '1.49'] Using average PSF sigma 1.59822769303777 Gaussian PSF norm 0.17650475774055532 vs pixelized 0.14101878 average tim pixel scale / coadd scale: 0.9909836275019605 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.16 s, CPU: 0.16 s, VmPeak: 992 MB, VmSize: 992 MB, VmRSS: 222 MB, VmData: 250 MB, maxrss: 0.226932 MB Stage fit_on_coadds finished: 2020-08-07T09:22:34.188848 Resources for stage fit_on_coadds : 0.165 s worker CPU, 0.165 s worker Wall, Wall: 0.160 s, Cores in use: 2.01, Total efficiency (on 16 cores): 12.6 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/PGC2707501-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/PGC2707501-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T09:22:34.197752 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 14 potential peaks Of 14 potential peaks: 2 in veto map, 0 cut by saddle test, 0 cut by aper test, 12 kept SED z : 12 new peaks Found 14 potential peaks Of 14 potential peaks: 11 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 10 potential peaks Of 10 potential peaks: 9 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 23 potential peaks Of 23 potential peaks: 18 in veto map, 4 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 24 potential peaks Of 24 potential peaks: 20 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 16 new sources Median coadd sky for g : 1.07271335e-05 Median coadd sky for r : 6.231556e-05 Median coadd sky for z : -9.74875e-05 Stage srcs : Wall: 0.42 s, CPU: 0.39 s, VmPeak: 992 MB, VmSize: 992 MB, VmRSS: 222 MB, VmData: 250 MB, maxrss: 0.227364 MB Stage srcs finished: 2020-08-07T09:22:34.614827 Resources for stage srcs : 0.069 s worker CPU, 0.069 s worker Wall, Wall: 0.418 s, Cores in use: 1.09, Total efficiency (on 16 cores): 6.8 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/PGC2707501-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/PGC2707501-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T09:22:34.659050 Blob 1 of 8, id: 2, sources: 5, size: 152x112, npix 9000, brick X: 56,208, Y: 84,196, one pixel: 88 84 Blob 2 of 8, id: 0, sources: 4, size: 56x41, npix 1978, brick X: 189,245, Y: 0,41, one pixel: 199 0 Blob 3 of 8, id: 4, sources: 3, size: 36x52, npix 1060, brick X: 209,245, Y: 139,191, one pixel: 239 139 Blob 4 of 8, id: 5, sources: 2, size: 29x53, npix 1012, brick X: 102,131, Y: 184,237, one pixel: 116 184 Blob 5 of 8, id: 1, sources: 2, size: 45x33, npix 922, brick X: 23,68, Y: 53,86, one pixel: 41 53 Blob 6 of 8, id: 7, sources: 2, size: 32x49, npix 903, brick X: 160,192, Y: 194,243, one pixel: 179 194 Blob 7 of 8, id: 3, sources: 1, size: 20x20, npix 236, brick X: 204,224, Y: 93,113, one pixel: 212 93 Blob 8 of 8, id: 6, sources: 1, size: 20x20, npix 229, brick X: 30,50, Y: 187,207, one pixel: 39 187 Blob 7 finished, total: Wall: 0.17 s, CPU: 0.17 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145672 MB Blob 8 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146044 MB Measuring 1 iterative sources Blob 4 finished, total: Wall: 0.80 s, CPU: 0.79 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093364 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (267.19288, 67.87167), pm (-13.8, -2.0), parallax 0.706 with NanoMaggies: g=16.5, r=15.8, z=15.2 Reset brightness to NanoMaggies: g=16.9, r=16.2, z=15.9 Blob 3 finished, total: Wall: 0.98 s, CPU: 0.98 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.146976 MB Blob 5 finished, total: Wall: 1.09 s, CPU: 1.08 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147336 MB Blob 6 finished, total: Wall: 1.35 s, CPU: 1.34 s, VmPeak: 804 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.14674 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (267.19403, 67.86060), pm (0.6, -0.2), parallax 1.057 with NanoMaggies: g=15.3, r=14.8, z=14.5 Reset brightness to NanoMaggies: g=15.3, r=14.9, z=14.7 Blob 2 finished, total: Wall: 1.51 s, CPU: 1.50 s, VmPeak: 803 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.145952 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.1613, ee1=-0.536043, ee2=-0.265174 Measuring 4 iterative sources Blob 1 finished, total: Wall: 5.26 s, CPU: 5.26 s, VmPeak: 805 MB, VmSize: 728 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150416 MB Old catalog: 22 New catalog: 24 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/metrics/cus/blobs-custom-267218p67868.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/metrics/cus/all-models-custom-267218p67868.fits Stage fitblobs : Wall: 5.64 s, CPU: 0.43 s, VmPeak: 992 MB, VmSize: 977 MB, VmRSS: 207 MB, VmData: 235 MB, maxrss: 0.227464 MB Stage fitblobs finished: 2020-08-07T09:22:40.297039 Resources for stage fitblobs : 11.490 s worker CPU, 11.570 s worker Wall, Wall: 5.640 s, Cores in use: 2.11, Total efficiency (on 16 cores): 13.2 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/PGC2707501-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/PGC2707501-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T09:22:40.308137 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/tmp-legacysurvey-custom-267218p67868-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/tmp-legacysurvey-custom-267218p67868-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/tmp-legacysurvey-custom-267218p67868-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/tmp-legacysurvey-custom-267218p67868-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-resid.jpg Stage coadds : Wall: 1.66 s, CPU: 0.52 s, VmPeak: 992 MB, VmSize: 977 MB, VmRSS: 208 MB, VmData: 235 MB, maxrss: 0.227464 MB Stage coadds finished: 2020-08-07T09:22:41.970073 Resources for stage coadds : 7.187 s worker CPU, 7.516 s worker Wall, Wall: 1.663 s, Cores in use: 4.63, Total efficiency (on 16 cores): 29.0 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/PGC2707501-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/PGC2707501-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T09:22:41.994083 Cut to 1 unWISE tiles Reading WISE tile 2690p681 band 1 Reading WISE tile 2690p681 band 3 Reading WISE tile 2690p681 band 2 Reading WISE tile 2690p681 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 810 MB, VmSize: 792 MB, VmRSS: 136 MB, VmData: 170 MB, maxrss: 0.198664 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 809 MB, VmSize: 798 MB, VmRSS: 143 MB, VmData: 176 MB, maxrss: 0.18556 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 810 MB, VmSize: 797 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.203908 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/269/2690p681/unwise-2690p681-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 805 MB, VmSize: 801 MB, VmRSS: 144 MB, VmData: 172 MB, maxrss: 0.20802 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/tmp-legacysurvey-custom-267218p67868-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/tmp-legacysurvey-custom-267218p67868-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 24.99 s, CPU: 0.54 s, VmPeak: 992 MB, VmSize: 977 MB, VmRSS: 209 MB, VmData: 235 MB, maxrss: 0.227464 MB Stage wise_forced finished: 2020-08-07T09:23:06.982083 Resources for stage wise_forced : 3.026 s worker CPU, 30.712 s worker Wall, Wall: 24.989 s, Cores in use: 0.14, Total efficiency (on 16 cores): 0.9 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/PGC2707501-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/PGC2707501-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T09:23:07.004621 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/coadd/cus/custom-267218p67868/legacysurvey-custom-267218p67868-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/tractor-i/cus/tractor-custom-267218p67868.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/tractor/cus/tractor-custom-267218p67868.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/tractor/cus/brick-custom-267218p67868.sha256sum Stage writecat : Wall: 1.20 s, CPU: 0.52 s, VmPeak: 1110 MB, VmSize: 982 MB, VmRSS: 211 MB, VmData: 235 MB, maxrss: 0.346652 MB Stage writecat finished: 2020-08-07T09:23:08.205734 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.203 s, Cores in use: 0.43, Total efficiency (on 16 cores): 2.7 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/PGC2707501-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC2707501/PGC2707501-largegalaxy-writecat.p All done: 29.399 s worker CPU, 677.936 s worker Wall, Wall: 158.491 s, Cores in use: 0.23, Total efficiency (on 16 cores): 1.5 % Finished galaxy PGC2707501 in 2.675 minutes.