Started working on galaxy PGC2391449 at Wed Aug 5 20:00:02 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 98.5906665 51.278833299999995 --width 251 --height 251 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T20:00:05.487135 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '98.5906665', '51.278833299999995', '--width', '251', '--height', '251', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 98.5906665 51.278833299999995 --width 251 --height 251 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 98.5906665 51.278833299999995 Starting process 63438 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 63439 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 63440 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 63441 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 63442 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 63443 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 63444 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 63445 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 63446 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 63447 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 63448 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 63449 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 63451 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 63452 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 63450 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 63453 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T20:00:06.631231 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 11 CCDs: k4m_180206_033851_ooi_zd_ls9-CCD3 z expnum 160640 exptime 80.103 propid 2016A-0453 seeing 0.78 MJD 58155.152 object MzLS_655690_z mosaic/CP/V4.3/CP20180205/k4m_180206_033851_ooi_zd_ls9.fits.fz k4m_161016_100347_ooi_zd_ls9-CCD3 z expnum 399261 exptime 162.106 propid 2016A-0404 seeing 0.96 MJD 57677.419 object MzLS_655690_z mosaic/CP/V4.3/CP20161015/k4m_161016_100347_ooi_zd_ls9.fits.fz k4m_170222_024955_ooi_zd_ls9-CCD4 z expnum 109468 exptime 80.105 propid 2016A-0453 seeing 0.87 MJD 57806.118 object MzLS_654117_z mosaic/CP/V4.3/CP20170221/k4m_170222_024955_ooi_zd_ls9.fits.fz k4m_160211_030347_ooi_zd_ls9-CCD3 z expnum 67831 exptime 80.103 propid 2016A-0453 seeing 0.99 MJD 57429.128 object MzLS_654906_z mosaic/CP/V4.3/CP20160210/k4m_160211_030347_ooi_zd_ls9.fits.fz ksb_170128_074111_ooi_g_ls9-CCD3 g expnum 77810094 exptime 250.0 propid BASS seeing 2.26 MJD 57781.320 object 63432 90prime/CP/V2.3/CP20170127/ksb_170128_074111_ooi_g_ls9.fits.fz ksb_170129_075546_ooi_g_ls9-CCD3 g expnum 77820098 exptime 237.2 propid BASS seeing 2.01 MJD 57782.330 object 63432 90prime/CP/V2.3/CP20170128/ksb_170129_075546_ooi_g_ls9.fits.fz ksb_180321_051657_ooi_r_ls9-CCD3 r expnum 81980022 exptime 250.0 propid BASS seeing 1.26 MJD 58198.220 object 63432 90prime/CP/V2.3/CP20180320/ksb_180321_051657_ooi_r_ls9.fits.fz ksb_170214_024455_ooi_r_ls9-CCD4 r expnum 77980043 exptime 173.0 propid BASS seeing 1.37 MJD 57798.115 object 63603 90prime/CP/V2.3/CP20170213/ksb_170214_024455_ooi_r_ls9.fits.fz ksb_170119_053949_ooi_g_ls9-CCD4 g expnum 77720046 exptime 250.0 propid BASS seeing 1.80 MJD 57772.236 object 63603 90prime/CP/V2.3/CP20170118/ksb_170119_053949_ooi_g_ls9.fits.fz ksb_171127_065355_ooi_r_ls9-CCD1 r expnum 80850112 exptime 247.05 propid BASS seeing 1.22 MJD 58084.287 object 63431 90prime/CP/V2.3/CP20171126/ksb_171127_065355_ooi_r_ls9.fits.fz ksb_161106_114603_ooi_g_ls9-CCD1 g expnum 76980186 exptime 134.9 propid BASS seeing 1.10 MJD 57698.490 object 63431 90prime/CP/V2.3/CP20161105/ksb_161106_114603_ooi_g_ls9.fits.fz mosaic get_fwhm: self.fwhm = 3.01 Found 4 relevant rows in amp-corrections file. Found overlap: image x 574 832 and amp range 0 2005 and image y 1356 1612 and amp range 0 2039 Range in image: x 0 259 , y 0 257 (with image size 259 x 257) dzp 0.0014252509 -> scaling image by 1.0013135665633692 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 77980043 Faked up EXPNUM 77980043 Faked up EXPNUM 77980043 90prime get_fwhm: self.fwhm = 3.03 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3609 3755 and amp range 2016 4031 and image y 3226 3374 and amp range 2048 4095 Range in image: x 0 147 , y 0 149 (with image size 147 x 149) dzp 0.0004463038 -> scaling image by 1.0004111454932232 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 77810094 Faked up EXPNUM 77810094 Faked up EXPNUM 77810094 90prime get_fwhm: self.fwhm = 4.99 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3838 3983 and amp range 2016 4031 and image y 1452 1597 and amp range 0 2047 Range in image: x 0 146 , y 0 146 (with image size 146 x 146) dzp -3.875605e-05 -> scaling image by 0.9999643049955675 Faked up EXPNUM 80850112 Faked up EXPNUM 80850112 Faked up EXPNUM 80850112 90prime get_fwhm: self.fwhm = 2.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1828 1974 and amp range 0 2015 and image y 3891 4037 and amp range 2048 4095 Range in image: x 0 147 , y 0 147 (with image size 147 x 147) dzp -0.05213645 -> scaling image by 0.953115252660837 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 590 848 and amp range 0 2005 and image y 1394 1650 and amp range 0 2039 Range in image: x 0 259 , y 0 257 (with image size 259 x 257) dzp 0.0013971253 -> scaling image by 1.0012876282438632 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 81980022 Faked up EXPNUM 81980022 Faked up EXPNUM 81980022 90prime get_fwhm: self.fwhm = 2.79 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3821 3966 and amp range 2016 4031 and image y 1410 1555 and amp range 0 2047 Range in image: x 0 146 , y 0 146 (with image size 146 x 146) dzp 0.0057031885 -> scaling image by 1.00526665101287 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 77720046 Faked up EXPNUM 77720046 Faked up EXPNUM 77720046 90prime get_fwhm: self.fwhm = 3.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3607 3754 and amp range 2016 4031 and image y 3217 3365 and amp range 2048 4095 Range in image: x 0 148 , y 0 149 (with image size 148 x 149) dzp -0.0030897402 -> scaling image by 0.9971582894587289 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 76980186 Faked up EXPNUM 76980186 Faked up EXPNUM 76980186 90prime get_fwhm: self.fwhm = 2.43 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1810 1956 and amp range 0 2015 and image y 3896 4041 and amp range 2048 4095 Range in image: x 0 147 , y 0 146 (with image size 147 x 146) dzp -0.034377232 -> scaling image by 0.9688334104074875 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1736 1991 and amp range 0 2047 and image y 2370 2626 and amp range 2022 4060 Range in image: x 0 256 , y 0 257 (with image size 256 x 257) dzp -0.017482605 -> scaling image by 0.9840268712629925 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 77820098 Faked up EXPNUM 77820098 Faked up EXPNUM 77820098 90prime get_fwhm: self.fwhm = 4.43 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3826 3971 and amp range 2016 4031 and image y 1426 1571 and amp range 0 2047 Range in image: x 0 146 , y 0 146 (with image size 146 x 146) dzp -3.875605e-05 -> scaling image by 0.9999643049955675 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3296 3549 and amp range 2006 4053 and image y 2818 3074 and amp range 2040 4078 Range in image: x 0 254 , y 0 257 (with image size 254 x 257) dzp -0.0026360443 -> scaling image by 0.99757505842151 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 14.26 s, CPU: 1.79 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 176 MB, VmData: 208 MB, maxrss: 0.18016 MB Stage tims finished: 2020-08-05T20:00:20.886239 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 6.146 s worker CPU, 80.375 s worker Wall, Wall: 14.257 s, Cores in use: 0.56, Total efficiency (on 16 cores): 3.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T20:00:20.999341 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01328.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/metrics/cus/reference-custom-098590p51278.fits Stage refs : Wall: 23.40 s, CPU: 6.08 s, VmPeak: 1014 MB, VmSize: 1009 MB, VmRSS: 230 MB, VmData: 259 MB, maxrss: 0.235432 MB Stage refs finished: 2020-08-05T20:00:44.397228 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 23.399 s, Cores in use: 0.26, Total efficiency (on 16 cores): 1.6 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T20:00:44.490622 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/metrics/cus/outlier-mask-custom-098590p51278.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/metrics/cus/outliers-pre-custom-098590p51278.jpg Image ksb_170119_053949_ooi_g_ls9-CCD4 g : masking 292 positive outlier pixels and 0 negative outlier pixels Image ksb_170214_024455_ooi_r_ls9-CCD4 r : masking 96 positive outlier pixels and 0 negative outlier pixels Image k4m_160211_030347_ooi_zd_ls9-CCD3 z : masking 0 positive outlier pixels and 108 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/metrics/cus/outlier-mask-custom-098590p51278.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/metrics/cus/outliers-post-custom-098590p51278.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/metrics/cus/outliers-masked-pos-custom-098590p51278.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/metrics/cus/outliers-masked-neg-custom-098590p51278.jpg Stage outliers : Wall: 1.65 s, CPU: 1.40 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 245 MB, VmData: 272 MB, maxrss: 0.251176 MB Stage outliers finished: 2020-08-05T20:00:46.137329 Resources for stage outliers : 0.954 s worker CPU, 1.021 s worker Wall, Wall: 1.648 s, Cores in use: 1.43, Total efficiency (on 16 cores): 8.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T20:00:46.226324 Stage halos : Wall: 1.15 s, CPU: 1.13 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 246 MB, VmData: 272 MB, maxrss: 0.251428 MB Stage halos finished: 2020-08-05T20:00:47.373345 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 1.148 s, Cores in use: 0.98, Total efficiency (on 16 cores): 6.2 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T20:00:47.483340 PSF sigmas in coadd pixels: ['3.68', '3.26', '2.92', '1.79'] Using average PSF sigma 2.912130663300463 Gaussian PSF norm 0.09686886489295302 vs pixelized 0.08109644 average tim pixel scale / coadd scale: 1.7302082687125804 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.05', '2.23', '1.98'] Using average PSF sigma 2.088455003888787 Gaussian PSF norm 0.13507343526607293 vs pixelized 0.10879978 average tim pixel scale / coadd scale: 1.7301351869948036 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.27', '1.56', '1.42', '1.61'] Using average PSF sigma 1.463106551091717 Gaussian PSF norm 0.19280536442365684 vs pixelized 0.15312284 average tim pixel scale / coadd scale: 0.9908613997452913 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.23 s, CPU: 0.16 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 247 MB, VmData: 272 MB, maxrss: 0.252928 MB Stage fit_on_coadds finished: 2020-08-05T20:00:47.710767 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.248 s worker CPU, 0.248 s worker Wall, Wall: 0.229 s, Cores in use: 1.79, Total efficiency (on 16 cores): 11.2 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T20:00:47.720793 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 124 potential peaks Of 124 potential peaks: 89 in veto map, 6 cut by saddle test, 0 cut by aper test, 29 kept SED z : 29 new peaks Found 305 potential peaks Of 305 potential peaks: 301 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 174 potential peaks Of 174 potential peaks: 166 in veto map, 7 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 169 potential peaks Of 169 potential peaks: 161 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 194 potential peaks Of 194 potential peaks: 187 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 34 new sources Median coadd sky for g : 0.000274285 Median coadd sky for r : 0.000561886 Median coadd sky for z : -8.043025e-05 Stage srcs : Wall: 0.95 s, CPU: 0.91 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 247 MB, VmData: 272 MB, maxrss: 0.253428 MB Stage srcs finished: 2020-08-05T20:00:48.670985 Resources for stage srcs : 0.083 s worker CPU, 0.084 s worker Wall, Wall: 0.952 s, Cores in use: 1.05, Total efficiency (on 16 cores): 6.5 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T20:00:48.688202 Blob 1 of 6, id: 3, sources: 31, size: 220x233, npix 34510, brick X: 31,251, Y: 18,251, one pixel: 232 18 Blob 2 of 6, id: 1, sources: 6, size: 118x47, npix 3531, brick X: 51,169, Y: 1,48, one pixel: 126 1 Blob 3 of 6, id: 5, sources: 3, size: 52x40, npix 1518, brick X: 0,52, Y: 211,251, one pixel: 16 211 Blob 4 of 6, id: 2, sources: 2, size: 42x37, npix 913, brick X: 5,47, Y: 15,52, one pixel: 31 15 Blob 5 of 6, id: 4, sources: 1, size: 23x23, npix 329, brick X: 36,59, Y: 202,225, one pixel: 45 202 Blob 6 of 6, id: 0, sources: 2, size: 21x18, npix 284, brick X: 0,21, Y: 0,18, one pixel: 0 0 Blob 5 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 813 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149876 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (98.60853, 51.28764), pm (0.7, 0.8), parallax 0.383 with NanoMaggies: g=20.5, r=20.1, z=15.4 Reset brightness to NanoMaggies: g=20.5, r=20.1, z=19.9 Blob 3 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.093864 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (98.61084, 51.26542), pm (-4.9, -26.6), parallax 3.549 with NanoMaggies: g=19.5, r=18, z=16.2 Reset brightness to NanoMaggies: g=19.5, r=18, z=16.2 Blob 6 finished, total: Wall: 0.55 s, CPU: 0.54 s, VmPeak: 803 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150376 MB Blob 4 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 810 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14992 MB Blob 2 finished, total: Wall: 2.42 s, CPU: 2.41 s, VmPeak: 811 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.15112 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.20129, ee1=0.00900546, ee2=-0.224342 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (98.57420, 51.27883), pm (0.5, -5.2), parallax 1.280 with NanoMaggies: g=16.3, r=15.4, z=16.4 Reset brightness to NanoMaggies: g=19.6, r=18.2, z=17.2 Measuring 9 iterative sources Blob 1 finished, total: Wall: 21.45 s, CPU: 21.45 s, VmPeak: 706 MB, VmSize: 698 MB, VmRSS: 130 MB, VmData: 169 MB, maxrss: 0.139364 MB Old catalog: 49 New catalog: 50 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/metrics/cus/blobs-custom-098590p51278.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/metrics/cus/all-models-custom-098590p51278.fits Stage fitblobs : Wall: 23.07 s, CPU: 1.18 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 250 MB, VmData: 274 MB, maxrss: 0.2558 MB Stage fitblobs finished: 2020-08-05T20:01:11.756986 Resources for stage fitblobs : 25.792 s worker CPU, 26.009 s worker Wall, Wall: 23.070 s, Cores in use: 1.17, Total efficiency (on 16 cores): 7.3 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T20:01:11.778525 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/tmp-legacysurvey-custom-098590p51278-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/tmp-legacysurvey-custom-098590p51278-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/tmp-legacysurvey-custom-098590p51278-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/tmp-legacysurvey-custom-098590p51278-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-resid.jpg Stage coadds : Wall: 5.60 s, CPU: 2.73 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 250 MB, VmData: 274 MB, maxrss: 0.25612 MB Stage coadds finished: 2020-08-05T20:01:17.382213 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 8.355 s worker CPU, 15.222 s worker Wall, Wall: 5.605 s, Cores in use: 1.98, Total efficiency (on 16 cores): 12.4 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T20:01:17.408956 Cut to 1 unWISE tiles Reading WISE tile 0977p514 band 1 Reading WISE tile 0977p514 band 2 Reading WISE tile 0977p514 band 4 Reading WISE tile 0977p514 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 863 MB, VmSize: 863 MB, VmRSS: 204 MB, VmData: 235 MB, maxrss: 0.209212 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 809 MB, VmSize: 807 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.210308 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 807 MB, VmSize: 802 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.20774 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 812 MB, VmSize: 805 MB, VmRSS: 147 MB, VmData: 177 MB, maxrss: 0.187548 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/tmp-legacysurvey-custom-098590p51278-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/tmp-legacysurvey-custom-098590p51278-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 7.87 s, CPU: 1.72 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 251 MB, VmData: 274 MB, maxrss: 0.256636 MB Stage wise_forced finished: 2020-08-05T20:01:25.275488 Resources for stage wise_forced : 3.034 s worker CPU, 10.678 s worker Wall, Wall: 7.868 s, Cores in use: 0.60, Total efficiency (on 16 cores): 3.8 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T20:01:25.293972 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/tractor-i/cus/tractor-custom-098590p51278.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/tractor/cus/tractor-custom-098590p51278.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/tractor/cus/brick-custom-098590p51278.sha256sum Stage writecat : Wall: 1.27 s, CPU: 1.01 s, VmPeak: 1151 MB, VmSize: 1023 MB, VmRSS: 252 MB, VmData: 274 MB, maxrss: 0.389516 MB Stage writecat finished: 2020-08-05T20:01:26.568847 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.276 s, Cores in use: 0.79, Total efficiency (on 16 cores): 5.0 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-writecat.p All done: 44.616 s worker CPU, 133.642 s worker Wall, Wall: 79.960 s, Cores in use: 0.79, Total efficiency (on 16 cores): 4.9 % Finished galaxy PGC2391449 in 1.411 minutes. Started working on galaxy PGC2391449 at Wed Aug 5 21:03:07 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 98.5906665 51.278833299999995 --width 251 --height 251 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T21:03:07.929526 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '98.5906665', '51.278833299999995', '--width', '251', '--height', '251', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 98.5906665 51.278833299999995 --width 251 --height 251 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 98.5906665 51.278833299999995 Starting process 10774 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 10778 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 10780 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 10784 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 10787 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 10790 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 10793 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 10796 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 10799 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 10802 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 10805 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 10808 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 10810 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 10813 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 10816 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 10818 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 10827 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 10828 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 10829 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 10831 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 10830 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 10832 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 10833 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 10834 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 10835 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 10836 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 10838 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 10839 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 10840 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 10841 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 10842 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 10843 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T21:03:08.493076 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 11 CCDs: k4m_180206_033851_ooi_zd_ls9-CCD3 z expnum 160640 exptime 80.103 propid 2016A-0453 seeing 0.78 MJD 58155.152 object MzLS_655690_z mosaic/CP/V4.3/CP20180205/k4m_180206_033851_ooi_zd_ls9.fits.fz k4m_161016_100347_ooi_zd_ls9-CCD3 z expnum 399261 exptime 162.106 propid 2016A-0404 seeing 0.96 MJD 57677.419 object MzLS_655690_z mosaic/CP/V4.3/CP20161015/k4m_161016_100347_ooi_zd_ls9.fits.fz k4m_170222_024955_ooi_zd_ls9-CCD4 z expnum 109468 exptime 80.105 propid 2016A-0453 seeing 0.87 MJD 57806.118 object MzLS_654117_z mosaic/CP/V4.3/CP20170221/k4m_170222_024955_ooi_zd_ls9.fits.fz k4m_160211_030347_ooi_zd_ls9-CCD3 z expnum 67831 exptime 80.103 propid 2016A-0453 seeing 0.99 MJD 57429.128 object MzLS_654906_z mosaic/CP/V4.3/CP20160210/k4m_160211_030347_ooi_zd_ls9.fits.fz ksb_170128_074111_ooi_g_ls9-CCD3 g expnum 77810094 exptime 250.0 propid BASS seeing 2.26 MJD 57781.320 object 63432 90prime/CP/V2.3/CP20170127/ksb_170128_074111_ooi_g_ls9.fits.fz ksb_170129_075546_ooi_g_ls9-CCD3 g expnum 77820098 exptime 237.2 propid BASS seeing 2.01 MJD 57782.330 object 63432 90prime/CP/V2.3/CP20170128/ksb_170129_075546_ooi_g_ls9.fits.fz ksb_180321_051657_ooi_r_ls9-CCD3 r expnum 81980022 exptime 250.0 propid BASS seeing 1.26 MJD 58198.220 object 63432 90prime/CP/V2.3/CP20180320/ksb_180321_051657_ooi_r_ls9.fits.fz ksb_170214_024455_ooi_r_ls9-CCD4 r expnum 77980043 exptime 173.0 propid BASS seeing 1.37 MJD 57798.115 object 63603 90prime/CP/V2.3/CP20170213/ksb_170214_024455_ooi_r_ls9.fits.fz ksb_170119_053949_ooi_g_ls9-CCD4 g expnum 77720046 exptime 250.0 propid BASS seeing 1.80 MJD 57772.236 object 63603 90prime/CP/V2.3/CP20170118/ksb_170119_053949_ooi_g_ls9.fits.fz ksb_171127_065355_ooi_r_ls9-CCD1 r expnum 80850112 exptime 247.05 propid BASS seeing 1.22 MJD 58084.287 object 63431 90prime/CP/V2.3/CP20171126/ksb_171127_065355_ooi_r_ls9.fits.fz ksb_161106_114603_ooi_g_ls9-CCD1 g expnum 76980186 exptime 134.9 propid BASS seeing 1.10 MJD 57698.490 object 63431 90prime/CP/V2.3/CP20161105/ksb_161106_114603_ooi_g_ls9.fits.fz mosaic get_fwhm: self.fwhm = 3.01 Found 4 relevant rows in amp-corrections file. mosaic get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 574 832 and amp range 0 2005 and image y 1356 1612 and amp range 0 2039 Found overlap: image x 590 848 and amp range 0 2005 and image y 1394 1650 and amp range 0 2039 Range in image: x 0 259 , y 0 257 (with image size 259 x 257) Range in image: x 0 259 , y 0 257 (with image size 259 x 257) dzp 0.0014252509 -> scaling image by 1.0013135665633692 dzp 0.0013971253 -> scaling image by 1.0012876282438632 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 77810094 Faked up EXPNUM 77810094 Faked up EXPNUM 77810094 90prime get_fwhm: self.fwhm = 4.99 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3838 3983 and amp range 2016 4031 and image y 1452 1597 and amp range 0 2047 Range in image: x 0 146 , y 0 146 (with image size 146 x 146) dzp -3.875605e-05 -> scaling image by 0.9999643049955675 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 76980186 Faked up EXPNUM 76980186 Faked up EXPNUM 76980186 90prime get_fwhm: self.fwhm = 2.43 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1810 1956 and amp range 0 2015 and image y 3896 4041 and amp range 2048 4095 Range in image: x 0 147 , y 0 146 (with image size 147 x 146) dzp -0.034377232 -> scaling image by 0.9688334104074875 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 77820098 Faked up EXPNUM 77820098 Faked up EXPNUM 77820098 90prime get_fwhm: self.fwhm = 4.43 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3826 3971 and amp range 2016 4031 and image y 1426 1571 and amp range 0 2047 Range in image: x 0 146 , y 0 146 (with image size 146 x 146) dzp -3.875605e-05 -> scaling image by 0.9999643049955675 mosaic get_fwhm: self.fwhm = 3.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1736 1991 and amp range 0 2047 and image y 2370 2626 and amp range 2022 4060 Range in image: x 0 256 , y 0 257 (with image size 256 x 257) dzp -0.017482605 -> scaling image by 0.9840268712629925 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 77980043 Faked up EXPNUM 77980043 Faked up EXPNUM 77980043 90prime get_fwhm: self.fwhm = 3.03 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3609 3755 and amp range 2016 4031 and image y 3226 3374 and amp range 2048 4095 Range in image: x 0 147 , y 0 149 (with image size 147 x 149) dzp 0.0004463038 -> scaling image by 1.0004111454932232 Faked up EXPNUM 81980022 Faked up EXPNUM 81980022 Faked up EXPNUM 81980022 90prime get_fwhm: self.fwhm = 2.79 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3821 3966 and amp range 2016 4031 and image y 1410 1555 and amp range 0 2047 Range in image: x 0 146 , y 0 146 (with image size 146 x 146) dzp 0.0057031885 -> scaling image by 1.00526665101287 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 80850112 Faked up EXPNUM 80850112 Faked up EXPNUM 80850112 90prime get_fwhm: self.fwhm = 2.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1828 1974 and amp range 0 2015 and image y 3891 4037 and amp range 2048 4095 Range in image: x 0 147 , y 0 147 (with image size 147 x 147) dzp -0.05213645 -> scaling image by 0.953115252660837 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 77720046 Faked up EXPNUM 77720046 Faked up EXPNUM 77720046 90prime get_fwhm: self.fwhm = 3.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3607 3754 and amp range 2016 4031 and image y 3217 3365 and amp range 2048 4095 Range in image: x 0 148 , y 0 149 (with image size 148 x 149) dzp -0.0030897402 -> scaling image by 0.9971582894587289 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3296 3549 and amp range 2006 4053 and image y 2818 3074 and amp range 2040 4078 Range in image: x 0 254 , y 0 257 (with image size 254 x 257) dzp -0.0026360443 -> scaling image by 0.99757505842151 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 22.26 s, CPU: 1.74 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 176 MB, VmData: 208 MB, maxrss: 0.180376 MB Stage tims finished: 2020-08-05T21:03:30.756798 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 6.282 s worker CPU, 48.168 s worker Wall, Wall: 22.266 s, Cores in use: 0.36, Total efficiency (on 32 cores): 1.1 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T21:03:30.782863 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01328.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/metrics/cus/reference-custom-098590p51278.fits Stage refs : Wall: 17.09 s, CPU: 4.71 s, VmPeak: 1015 MB, VmSize: 1009 MB, VmRSS: 230 MB, VmData: 259 MB, maxrss: 0.2353 MB Stage refs finished: 2020-08-05T21:03:47.876869 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 17.096 s, Cores in use: 0.28, Total efficiency (on 32 cores): 0.9 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-refs.p Running stage outliers WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage outliers at 2020-08-05T21:03:48.009501 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/metrics/cus/outlier-mask-custom-098590p51278.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/metrics/cus/outliers-pre-custom-098590p51278.jpg Image ksb_170119_053949_ooi_g_ls9-CCD4 g : masking 292 positive outlier pixels and 0 negative outlier pixels Image ksb_170214_024455_ooi_r_ls9-CCD4 r : masking 96 positive outlier pixels and 0 negative outlier pixels Image k4m_160211_030347_ooi_zd_ls9-CCD3 z : masking 0 positive outlier pixels and 108 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/metrics/cus/outlier-mask-custom-098590p51278.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/metrics/cus/outliers-post-custom-098590p51278.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/metrics/cus/outliers-masked-pos-custom-098590p51278.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/metrics/cus/outliers-masked-neg-custom-098590p51278.jpg Stage outliers : Wall: 1.18 s, CPU: 0.84 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 245 MB, VmData: 271 MB, maxrss: 0.250488 MB Stage outliers finished: 2020-08-05T21:03:49.186208 Resources for stage outliers : 0.973 s worker CPU, 1.185 s worker Wall, Wall: 1.179 s, Cores in use: 1.54, Total efficiency (on 32 cores): 4.8 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T21:03:49.297210 Stage halos : Wall: 0.94 s, CPU: 0.92 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 245 MB, VmData: 271 MB, maxrss: 0.250488 MB Stage halos finished: 2020-08-05T21:03:50.236546 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.942 s, Cores in use: 0.98, Total efficiency (on 32 cores): 3.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T21:03:50.268205 PSF sigmas in coadd pixels: ['3.68', '3.26', '2.92', '1.79'] Using average PSF sigma 2.912130663300463 Gaussian PSF norm 0.09686886489295302 vs pixelized 0.08109644 average tim pixel scale / coadd scale: 1.7302082687125804 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.05', '2.23', '1.98'] Using average PSF sigma 2.088455003888787 Gaussian PSF norm 0.13507343526607293 vs pixelized 0.10879978 average tim pixel scale / coadd scale: 1.7301351869948036 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.27', '1.56', '1.42', '1.61'] Using average PSF sigma 1.463106551091717 Gaussian PSF norm 0.19280536442365684 vs pixelized 0.15312284 average tim pixel scale / coadd scale: 0.9908613997452913 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.21 s, CPU: 0.16 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 247 MB, VmData: 272 MB, maxrss: 0.252852 MB Stage fit_on_coadds finished: 2020-08-05T21:03:50.474980 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.194 s worker CPU, 0.194 s worker Wall, Wall: 0.209 s, Cores in use: 1.73, Total efficiency (on 32 cores): 5.4 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T21:03:50.492664 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 124 potential peaks Of 124 potential peaks: 89 in veto map, 6 cut by saddle test, 0 cut by aper test, 29 kept SED z : 29 new peaks Found 305 potential peaks Of 305 potential peaks: 301 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 174 potential peaks Of 174 potential peaks: 166 in veto map, 7 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 169 potential peaks Of 169 potential peaks: 161 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 194 potential peaks Of 194 potential peaks: 187 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 34 new sources Median coadd sky for g : 0.000274285 Median coadd sky for r : 0.000561886 Median coadd sky for z : -8.043025e-05 Stage srcs : Wall: 1.97 s, CPU: 1.87 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 247 MB, VmData: 272 MB, maxrss: 0.2534 MB Stage srcs finished: 2020-08-05T21:03:52.463494 Resources for stage srcs : 0.110 s worker CPU, 0.110 s worker Wall, Wall: 1.973 s, Cores in use: 1.01, Total efficiency (on 32 cores): 3.1 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T21:03:52.484151 Blob 1 of 6, id: 3, sources: 31, size: 220x233, npix 34510, brick X: 31,251, Y: 18,251, one pixel: 232 18 Blob 2 of 6, id: 1, sources: 6, size: 118x47, npix 3531, brick X: 51,169, Y: 1,48, one pixel: 126 1 Blob 3 of 6, id: 5, sources: 3, size: 52x40, npix 1518, brick X: 0,52, Y: 211,251, one pixel: 16 211 Blob 4 of 6, id: 2, sources: 2, size: 42x37, npix 913, brick X: 5,47, Y: 15,52, one pixel: 31 15 Blob 5 of 6, id: 4, sources: 1, size: 23x23, npix 329, brick X: 36,59, Y: 202,225, one pixel: 45 202 Blob 6 of 6, id: 0, sources: 2, size: 21x18, npix 284, brick X: 0,21, Y: 0,18, one pixel: 0 0 Blob 5 finished, total: Wall: 0.20 s, CPU: 0.18 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.094592 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (98.60853, 51.28764), pm (0.7, 0.8), parallax 0.383 with NanoMaggies: g=20.5, r=20.1, z=15.4 Reset brightness to NanoMaggies: g=20.5, r=20.1, z=19.9 Blob 3 finished, total: Wall: 0.49 s, CPU: 0.48 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.09308 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (98.61084, 51.26542), pm (-4.9, -26.6), parallax 3.549 with NanoMaggies: g=19.5, r=18, z=16.2 Reset brightness to NanoMaggies: g=19.5, r=18, z=16.2 Blob 6 finished, total: Wall: 0.60 s, CPU: 0.58 s, VmPeak: 814 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149808 MB Blob 4 finished, total: Wall: 0.67 s, CPU: 0.65 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.09292 MB Blob 2 finished, total: Wall: 2.57 s, CPU: 2.56 s, VmPeak: 672 MB, VmSize: 671 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.098144 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.20129, ee1=0.00900541, ee2=-0.224342 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (98.57420, 51.27883), pm (0.5, -5.2), parallax 1.280 with NanoMaggies: g=16.3, r=15.4, z=16.4 Reset brightness to NanoMaggies: g=19.6, r=18.2, z=17.2 Measuring 9 iterative sources Blob 1 finished, total: Wall: 22.01 s, CPU: 22.01 s, VmPeak: 706 MB, VmSize: 699 MB, VmRSS: 131 MB, VmData: 170 MB, maxrss: 0.139108 MB Old catalog: 49 New catalog: 50 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/metrics/cus/blobs-custom-098590p51278.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/metrics/cus/all-models-custom-098590p51278.fits Stage fitblobs : Wall: 24.03 s, CPU: 1.82 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 250 MB, VmData: 274 MB, maxrss: 0.255772 MB Stage fitblobs finished: 2020-08-05T21:04:16.511142 Resources for stage fitblobs : 26.557 s worker CPU, 26.762 s worker Wall, Wall: 24.029 s, Cores in use: 1.18, Total efficiency (on 32 cores): 3.7 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T21:04:16.533546 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/tmp-legacysurvey-custom-098590p51278-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/tmp-legacysurvey-custom-098590p51278-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/tmp-legacysurvey-custom-098590p51278-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/tmp-legacysurvey-custom-098590p51278-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-resid.jpg Stage coadds : Wall: 4.28 s, CPU: 1.27 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 250 MB, VmData: 274 MB, maxrss: 0.256096 MB Stage coadds finished: 2020-08-05T21:04:20.816798 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 24.582 s worker CPU, 44.123 s worker Wall, Wall: 4.286 s, Cores in use: 6.03, Total efficiency (on 32 cores): 18.9 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T21:04:21.491414 Cut to 1 unWISE tiles Reading WISE tile 0977p514 band 1 Reading WISE tile 0977p514 band 2 Reading WISE tile 0977p514 band 4 Reading WISE tile 0977p514 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 863 MB, VmSize: 863 MB, VmRSS: 204 MB, VmData: 235 MB, maxrss: 0.209116 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 810 MB, VmSize: 804 MB, VmRSS: 146 MB, VmData: 176 MB, maxrss: 0.186676 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 813 MB, VmSize: 799 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.202768 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 807 MB, VmSize: 805 MB, VmRSS: 143 MB, VmData: 172 MB, maxrss: 0.206252 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/tmp-legacysurvey-custom-098590p51278-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/tmp-legacysurvey-custom-098590p51278-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.35 s, CPU: 0.68 s, VmPeak: 1018 MB, VmSize: 1018 MB, VmRSS: 251 MB, VmData: 274 MB, maxrss: 0.256608 MB Stage wise_forced finished: 2020-08-05T21:04:23.845913 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.314 s worker CPU, 5.724 s worker Wall, Wall: 2.357 s, Cores in use: 1.69, Total efficiency (on 32 cores): 5.3 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-wise_forced.p Running stage writecat WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage writecat at 2020-08-05T21:04:23.862304 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/coadd/cus/custom-098590p51278/legacysurvey-custom-098590p51278-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/tractor-i/cus/tractor-custom-098590p51278.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/tractor/cus/tractor-custom-098590p51278.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/tractor/cus/brick-custom-098590p51278.sha256sum Stage writecat : Wall: 0.98 s, CPU: 0.64 s, VmPeak: 1151 MB, VmSize: 1023 MB, VmRSS: 252 MB, VmData: 274 MB, maxrss: 0.389472 MB Stage writecat finished: 2020-08-05T21:04:24.845847 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.986 s, Cores in use: 0.65, Total efficiency (on 32 cores): 2.0 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/098/PGC2391449/PGC2391449-largegalaxy-writecat.p All done: 62.019 s worker CPU, 126.274 s worker Wall, Wall: 76.382 s, Cores in use: 1.01, Total efficiency (on 32 cores): 3.1 % Finished galaxy PGC2391449 in 1.304 minutes. Started working on galaxy PGC2391449 at Fri Aug 7 09:27:37 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 98.58997594582587 51.27880495669933 --width 251 --height 251 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/PGC2391449-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/PGC2391449-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T09:27:38.069713 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '98.58997594582587', '51.27880495669933', '--width', '251', '--height', '251', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/PGC2391449-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/PGC2391449-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 98.58997594582587 51.27880495669933 --width 251 --height 251 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/PGC2391449-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/PGC2391449-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 98.58997594582587 51.27880495669933 Starting process 23394 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 23395 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 23396 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 23397 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 23398 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059416 MB Starting process 23399 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059424 MB Starting process 23400 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059424 MB Starting process 23401 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 23402 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 23403 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 23404 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 23405 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 23406 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 23408 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 23409 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 23407 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T09:27:38.510939 Keeping 11 CCDs: k4m_180206_033851_ooi_zd_ls9-CCD3 z expnum 160640 exptime 80.103 propid 2016A-0453 seeing 0.78 MJD 58155.152 object MzLS_655690_z mosaic/CP/V4.3/CP20180205/k4m_180206_033851_ooi_zd_ls9.fits.fz k4m_161016_100347_ooi_zd_ls9-CCD3 z expnum 399261 exptime 162.106 propid 2016A-0404 seeing 0.96 MJD 57677.419 object MzLS_655690_z mosaic/CP/V4.3/CP20161015/k4m_161016_100347_ooi_zd_ls9.fits.fz k4m_170222_024955_ooi_zd_ls9-CCD4 z expnum 109468 exptime 80.105 propid 2016A-0453 seeing 0.87 MJD 57806.118 object MzLS_654117_z mosaic/CP/V4.3/CP20170221/k4m_170222_024955_ooi_zd_ls9.fits.fz k4m_160211_030347_ooi_zd_ls9-CCD3 z expnum 67831 exptime 80.103 propid 2016A-0453 seeing 0.99 MJD 57429.128 object MzLS_654906_z mosaic/CP/V4.3/CP20160210/k4m_160211_030347_ooi_zd_ls9.fits.fz ksb_170128_074111_ooi_g_ls9-CCD3 g expnum 77810094 exptime 250.0 propid BASS seeing 2.26 MJD 57781.320 object 63432 90prime/CP/V2.3/CP20170127/ksb_170128_074111_ooi_g_ls9.fits.fz ksb_170129_075546_ooi_g_ls9-CCD3 g expnum 77820098 exptime 237.2 propid BASS seeing 2.01 MJD 57782.330 object 63432 90prime/CP/V2.3/CP20170128/ksb_170129_075546_ooi_g_ls9.fits.fz ksb_180321_051657_ooi_r_ls9-CCD3 r expnum 81980022 exptime 250.0 propid BASS seeing 1.26 MJD 58198.220 object 63432 90prime/CP/V2.3/CP20180320/ksb_180321_051657_ooi_r_ls9.fits.fz ksb_170214_024455_ooi_r_ls9-CCD4 r expnum 77980043 exptime 173.0 propid BASS seeing 1.37 MJD 57798.115 object 63603 90prime/CP/V2.3/CP20170213/ksb_170214_024455_ooi_r_ls9.fits.fz ksb_170119_053949_ooi_g_ls9-CCD4 g expnum 77720046 exptime 250.0 propid BASS seeing 1.80 MJD 57772.236 object 63603 90prime/CP/V2.3/CP20170118/ksb_170119_053949_ooi_g_ls9.fits.fz ksb_171127_065355_ooi_r_ls9-CCD1 r expnum 80850112 exptime 247.05 propid BASS seeing 1.22 MJD 58084.287 object 63431 90prime/CP/V2.3/CP20171126/ksb_171127_065355_ooi_r_ls9.fits.fz ksb_161106_114603_ooi_g_ls9-CCD1 g expnum 76980186 exptime 134.9 propid BASS seeing 1.10 MJD 57698.490 object 63431 90prime/CP/V2.3/CP20161105/ksb_161106_114603_ooi_g_ls9.fits.fz mosaic get_fwhm: self.fwhm = 3.01 Found 4 relevant rows in amp-corrections file. Found overlap: image x 573 832 and amp range 0 2005 and image y 1350 1606 and amp range 0 2039 Range in image: x 0 260 , y 0 257 (with image size 260 x 257) dzp 0.0014252509 -> scaling image by 1.0013135665633692 mosaic get_fwhm: self.fwhm = 3.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1736 1991 and amp range 0 2047 and image y 2364 2620 and amp range 2022 4060 Range in image: x 0 256 , y 0 257 (with image size 256 x 257) dzp -0.017482605 -> scaling image by 0.9840268712629925 mosaic get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 589 847 and amp range 0 2005 and image y 1388 1644 and amp range 0 2039 Range in image: x 0 259 , y 0 257 (with image size 259 x 257) dzp 0.0013971253 -> scaling image by 1.0012876282438632 mosaic get_fwhm: self.fwhm = 3.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3296 3548 and amp range 2006 4053 and image y 2812 3068 and amp range 2040 4078 Range in image: x 0 253 , y 0 257 (with image size 253 x 257) dzp -0.0026360443 -> scaling image by 0.99757505842151 Faked up EXPNUM 81980022 Faked up EXPNUM 81980022 Faked up EXPNUM 81980022 90prime get_fwhm: self.fwhm = 2.79 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3821 3966 and amp range 2016 4031 and image y 1413 1559 and amp range 0 2047 Range in image: x 0 146 , y 0 147 (with image size 146 x 147) dzp 0.0057031885 -> scaling image by 1.00526665101287 Faked up EXPNUM 80850112 Faked up EXPNUM 80850112 Faked up EXPNUM 80850112 90prime get_fwhm: self.fwhm = 2.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1828 1975 and amp range 0 2015 and image y 3895 4040 and amp range 2048 4095 Range in image: x 0 148 , y 0 146 (with image size 148 x 146) dzp -0.05213645 -> scaling image by 0.953115252660837 Faked up EXPNUM 77820098 Faked up EXPNUM 77820098 Faked up EXPNUM 77820098 90prime get_fwhm: self.fwhm = 4.43 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3826 3971 and amp range 2016 4031 and image y 1429 1575 and amp range 0 2047 Range in image: x 0 146 , y 0 147 (with image size 146 x 147) dzp -3.875605e-05 -> scaling image by 0.9999643049955675 Faked up EXPNUM 77720046 Faked up EXPNUM 77720046 Faked up EXPNUM 77720046 90prime get_fwhm: self.fwhm = 3.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3607 3754 and amp range 2016 4031 and image y 3220 3368 and amp range 2048 4095 Range in image: x 0 148 , y 0 149 (with image size 148 x 149) dzp -0.0030897402 -> scaling image by 0.9971582894587289 Faked up EXPNUM 77980043 Faked up EXPNUM 77980043 Faked up EXPNUM 77980043 90prime get_fwhm: self.fwhm = 3.03 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3609 3756 and amp range 2016 4031 and image y 3230 3378 and amp range 2048 4095 Range in image: x 0 148 , y 0 149 (with image size 148 x 149) dzp 0.0004463038 -> scaling image by 1.0004111454932232 Faked up EXPNUM 76980186 Faked up EXPNUM 76980186 Faked up EXPNUM 76980186 90prime get_fwhm: self.fwhm = 2.43 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1810 1956 and amp range 0 2015 and image y 3899 4045 and amp range 2048 4095 Range in image: x 0 147 , y 0 147 (with image size 147 x 147) dzp -0.034377232 -> scaling image by 0.9688334104074875 Faked up EXPNUM 77810094 Faked up EXPNUM 77810094 Faked up EXPNUM 77810094 90prime get_fwhm: self.fwhm = 4.99 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3838 3983 and amp range 2016 4031 and image y 1455 1601 and amp range 0 2047 Range in image: x 0 146 , y 0 147 (with image size 146 x 147) dzp -3.875605e-05 -> scaling image by 0.9999643049955675 Stage tims : Wall: 74.77 s, CPU: 0.93 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 174 MB, VmData: 207 MB, maxrss: 0.177976 MB Stage tims finished: 2020-08-07T09:28:53.283093 Resources for stage tims : 5.767 s worker CPU, 399.285 s worker Wall, Wall: 74.774 s, Cores in use: 0.09, Total efficiency (on 16 cores): 0.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/PGC2391449-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/PGC2391449-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T09:28:53.452785 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01328.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/metrics/cus/reference-custom-098589p51278.fits Stage refs : Wall: 8.07 s, CPU: 4.68 s, VmPeak: 1008 MB, VmSize: 1003 MB, VmRSS: 227 MB, VmData: 259 MB, maxrss: 0.232848 MB Stage refs finished: 2020-08-07T09:29:01.527479 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.076 s, Cores in use: 0.58, Total efficiency (on 16 cores): 3.6 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/PGC2391449-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/PGC2391449-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T09:29:03.837137 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/metrics/cus/outlier-mask-custom-098589p51278.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/metrics/cus/outliers-pre-custom-098589p51278.jpg Image ksb_170119_053949_ooi_g_ls9-CCD4 g : masking 411 positive outlier pixels and 0 negative outlier pixels Image ksb_170214_024455_ooi_r_ls9-CCD4 r : masking 224 positive outlier pixels and 0 negative outlier pixels Image k4m_160211_030347_ooi_zd_ls9-CCD3 z : masking 0 positive outlier pixels and 101 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/metrics/cus/outlier-mask-custom-098589p51278.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/metrics/cus/outliers-post-custom-098589p51278.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/metrics/cus/outliers-masked-pos-custom-098589p51278.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/metrics/cus/outliers-masked-neg-custom-098589p51278.jpg Stage outliers : Wall: 9.63 s, CPU: 0.69 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 243 MB, VmData: 271 MB, maxrss: 0.248448 MB Stage outliers finished: 2020-08-07T09:29:13.462319 Resources for stage outliers : 0.907 s worker CPU, 0.959 s worker Wall, Wall: 9.627 s, Cores in use: 0.17, Total efficiency (on 16 cores): 1.0 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/PGC2391449-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/PGC2391449-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T09:29:13.908541 Stage halos : Wall: 0.36 s, CPU: 0.35 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 243 MB, VmData: 271 MB, maxrss: 0.248736 MB Stage halos finished: 2020-08-07T09:29:14.271484 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.364 s, Cores in use: 0.96, Total efficiency (on 16 cores): 6.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/PGC2391449-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/PGC2391449-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T09:29:14.399225 PSF sigmas in coadd pixels: ['3.68', '3.26', '2.92', '1.79'] Using average PSF sigma 2.912130663300463 Gaussian PSF norm 0.09686886489295302 vs pixelized 0.08109187 average tim pixel scale / coadd scale: 1.7302082687125804 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.05', '2.23', '1.98'] Using average PSF sigma 2.088455003888787 Gaussian PSF norm 0.13507343526607293 vs pixelized 0.1087928 average tim pixel scale / coadd scale: 1.7301351869948036 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.27', '1.56', '1.42', '1.61'] Using average PSF sigma 1.463106551091717 Gaussian PSF norm 0.19280536442365684 vs pixelized 0.15313216 average tim pixel scale / coadd scale: 0.9908613997452913 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.25 s, CPU: 0.17 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 244 MB, VmData: 271 MB, maxrss: 0.250204 MB Stage fit_on_coadds finished: 2020-08-07T09:29:14.646806 Resources for stage fit_on_coadds : 0.232 s worker CPU, 0.232 s worker Wall, Wall: 0.249 s, Cores in use: 1.61, Total efficiency (on 16 cores): 10.1 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/PGC2391449-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/PGC2391449-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T09:29:14.669964 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 121 potential peaks Of 121 potential peaks: 88 in veto map, 6 cut by saddle test, 0 cut by aper test, 27 kept SED z : 27 new peaks Found 376 potential peaks Of 376 potential peaks: 370 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 175 potential peaks Of 175 potential peaks: 167 in veto map, 7 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 163 potential peaks Of 163 potential peaks: 155 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 207 potential peaks Of 207 potential peaks: 200 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 33 new sources Median coadd sky for g : 0.00029402383 Median coadd sky for r : 0.00058791274 Median coadd sky for z : -0.00016649812 Stage srcs : Wall: 0.58 s, CPU: 0.54 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 245 MB, VmData: 271 MB, maxrss: 0.250688 MB Stage srcs finished: 2020-08-07T09:29:15.246142 Resources for stage srcs : 0.084 s worker CPU, 0.084 s worker Wall, Wall: 0.578 s, Cores in use: 1.08, Total efficiency (on 16 cores): 6.8 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/PGC2391449-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/PGC2391449-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T09:29:15.311320 Blob 1 of 6, id: 3, sources: 30, size: 225x233, npix 35283, brick X: 26,251, Y: 18,251, one pixel: 227 18 Blob 2 of 6, id: 1, sources: 6, size: 118x48, npix 3528, brick X: 45,163, Y: 1,49, one pixel: 122 1 Blob 3 of 6, id: 5, sources: 2, size: 46x38, npix 1284, brick X: 0,46, Y: 213,251, one pixel: 7 213 Blob 4 of 6, id: 2, sources: 2, size: 41x37, npix 910, brick X: 0,41, Y: 16,53, one pixel: 24 16 Blob 5 of 6, id: 4, sources: 1, size: 23x24, npix 337, brick X: 30,53, Y: 202,226, one pixel: 40 202 Blob 6 of 6, id: 0, sources: 2, size: 15x16, npix 183, brick X: 0,15, Y: 0,16, one pixel: 0 0 Blob 5 finished, total: Wall: 0.20 s, CPU: 0.20 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145736 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (98.61084, 51.26542), pm (-4.9, -26.6), parallax 3.549 with NanoMaggies: g=19.5, r=18, z=16.2 Reset brightness to NanoMaggies: g=19.5, r=18, z=16.2 Blob 6 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146084 MB Blob 3 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.093004 MB Blob 4 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.09284 MB Blob 2 finished, total: Wall: 2.46 s, CPU: 2.45 s, VmPeak: 671 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097576 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.443385, ee1=0.0233791, ee2=-0.128809 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (98.57420, 51.27883), pm (0.5, -5.2), parallax 1.280 with NanoMaggies: g=18.1, r=16.6, z=16.1 Reset brightness to NanoMaggies: g=19.6, r=18.2, z=17.2 Measuring 10 iterative sources Blob 1 finished, total: Wall: 22.40 s, CPU: 22.40 s, VmPeak: 807 MB, VmSize: 743 MB, VmRSS: 167 MB, VmData: 198 MB, maxrss: 0.170936 MB Old catalog: 46 New catalog: 50 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/metrics/cus/blobs-custom-098589p51278.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/metrics/cus/all-models-custom-098589p51278.fits Stage fitblobs : Wall: 32.44 s, CPU: 0.37 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 247 MB, VmData: 273 MB, maxrss: 0.253148 MB Stage fitblobs finished: 2020-08-07T09:29:47.750686 Resources for stage fitblobs : 26.806 s worker CPU, 26.849 s worker Wall, Wall: 32.441 s, Cores in use: 0.84, Total efficiency (on 16 cores): 5.2 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/PGC2391449-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/PGC2391449-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T09:29:47.828046 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/tmp-legacysurvey-custom-098589p51278-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/tmp-legacysurvey-custom-098589p51278-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/tmp-legacysurvey-custom-098589p51278-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/tmp-legacysurvey-custom-098589p51278-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-resid.jpg Stage coadds : Wall: 2.35 s, CPU: 0.60 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 248 MB, VmData: 273 MB, maxrss: 0.2535 MB Stage coadds finished: 2020-08-07T09:29:50.177452 Resources for stage coadds : 8.388 s worker CPU, 8.649 s worker Wall, Wall: 2.351 s, Cores in use: 3.83, Total efficiency (on 16 cores): 23.9 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/PGC2391449-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/PGC2391449-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T09:29:50.211191 Cut to 1 unWISE tiles Reading WISE tile 0977p514 band 1 Reading WISE tile 0977p514 band 2 Reading WISE tile 0977p514 band 3 Reading WISE tile 0977p514 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 811 MB, VmSize: 801 MB, VmRSS: 145 MB, VmData: 175 MB, maxrss: 0.187904 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 806 MB, VmSize: 796 MB, VmRSS: 140 MB, VmData: 174 MB, maxrss: 0.202552 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 857 MB, VmSize: 857 MB, VmRSS: 202 MB, VmData: 235 MB, maxrss: 0.20666 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/097/0977p514/unwise-0977p514-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 794 MB, VmSize: 794 MB, VmRSS: 137 MB, VmData: 172 MB, maxrss: 0.195888 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/tmp-legacysurvey-custom-098589p51278-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/tmp-legacysurvey-custom-098589p51278-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 43.76 s, CPU: 0.55 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 248 MB, VmData: 273 MB, maxrss: 0.254012 MB Stage wise_forced finished: 2020-08-07T09:30:33.966985 Resources for stage wise_forced : 3.012 s worker CPU, 67.948 s worker Wall, Wall: 43.757 s, Cores in use: 0.08, Total efficiency (on 16 cores): 0.5 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/PGC2391449-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/PGC2391449-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T09:30:34.000473 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/coadd/cus/custom-098589p51278/legacysurvey-custom-098589p51278-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/tractor-i/cus/tractor-custom-098589p51278.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/tractor/cus/tractor-custom-098589p51278.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/tractor/cus/brick-custom-098589p51278.sha256sum Stage writecat : Wall: 2.18 s, CPU: 0.67 s, VmPeak: 1144 MB, VmSize: 1016 MB, VmRSS: 250 MB, VmData: 273 MB, maxrss: 0.386896 MB Stage writecat finished: 2020-08-07T09:30:36.183151 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.185 s, Cores in use: 0.31, Total efficiency (on 16 cores): 1.9 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/PGC2391449-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/098/PGC2391449/PGC2391449-largegalaxy-writecat.p All done: 45.199 s worker CPU, 504.010 s worker Wall, Wall: 177.708 s, Cores in use: 0.31, Total efficiency (on 16 cores): 1.9 % Finished galaxy PGC2391449 in 3.003 minutes.