Started working on galaxy PGC2193760 at Wed Aug 5 20:30:45 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.30361 42.176460299999995 --width 269 --height 269 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T20:30:46.540030 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.30361', '42.176460299999995', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.30361 42.176460299999995 --width 269 --height 269 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 272.30361 42.176460299999995 Starting process 42555 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 42556 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 42557 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 42558 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 42559 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB Starting process 42560 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB Starting process 42561 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB Starting process 42562 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 42563 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 42564 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 42565 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 42566 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 42567 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 42568 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 42569 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 42570 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T20:30:47.306185 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 11 CCDs: k4m_170527_111502_ooi_zd_ls9-CCD1 z expnum 130204 exptime 80.105 propid 2016A-0453 seeing 1.14 MJD 57900.469 object MzLS_615602_z mosaic/CP/V4.3/CP20170526/k4m_170527_111502_ooi_zd_ls9.fits.fz k4m_160425_110212_ooi_zd_ls9-CCD2 z expnum 84864 exptime 90.105 propid 2016A seeing 0.96 MJD 57503.460 object MzLS_613740_z mosaic/CP/V4.3/CP20160424/k4m_160425_110212_ooi_zd_ls9.fits.fz k4m_160508_100904_ooi_zd_ls9-CCD4 z expnum 87542 exptime 80.105 propid 2016A-0453 seeing 1.17 MJD 57516.423 object MzLS_614672_z mosaic/CP/V4.3/CP20160507/k4m_160508_100904_ooi_zd_ls9.fits.fz k4m_160428_104603_ooi_zd_ls9-CCD4 z expnum 85524 exptime 105.105 propid 2016A-0453 seeing 1.04 MJD 57506.449 object MzLS_613739_z mosaic/CP/V4.3/CP20160427/k4m_160428_104603_ooi_zd_ls9.fits.fz k4m_170524_111646_ooi_zd_ls9-CCD3 z expnum 129989 exptime 135.105 propid 2016A-0453 seeing 1.36 MJD 57897.470 object MzLS_615601_z mosaic/CP/V4.3/CP20170523/k4m_170524_111646_ooi_zd_ls9.fits.fz ksb_160704_080103_ooi_g_ls9-CCD4 g expnum 75730125 exptime 95.2 propid BASS seeing 1.74 MJD 57573.334 object 17462 90prime/CP/V2.3/CP20160703/ksb_160704_080103_ooi_g_ls9.fits.fz ksb_160531_104804_ooi_r_ls9-CCD4 r expnum 75390236 exptime 71.8 propid BASS seeing 1.01 MJD 57539.450 object 17462 90prime/CP/V2.3/CP20160530/ksb_160531_104804_ooi_r_ls9.fits.fz ksb_170621_055929_ooi_g_ls9-CCD1 g expnum 79250021 exptime 139.421 propid BASS seeing 1.34 MJD 57925.250 object 17463 90prime/CP/V2.3/CP20170620/ksb_170621_055929_ooi_g_ls9.fits.fz ksb_170430_111635_ooi_r_ls9-CCD1 r expnum 78730265 exptime 117.527 propid BASS seeing 1.46 MJD 57873.470 object 17463 90prime/CP/V2.3/CP20170429/ksb_170430_111635_ooi_r_ls9.fits.fz ksb_160531_083601_ooi_r_ls9-CCD3 r expnum 75390170 exptime 59.6 propid BASS seeing 1.09 MJD 57539.358 object 17461 90prime/CP/V2.3/CP20160530/ksb_160531_083601_ooi_r_ls9.fits.fz ksb_180516_081127_ooi_g_ls9-CCD3 g expnum 82540122 exptime 96.511 propid NOTBASS seeing 1.44 MJD 58254.341 object 17461 90prime/CP/V2.3/CP20180515/ksb_180516_081127_ooi_g_ls9.fits.fz Faked up EXPNUM 78730265 Faked up EXPNUM 78730265 Faked up EXPNUM 78730265 90prime get_fwhm: self.fwhm = 3.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 633 791 and amp range 0 2015 and image y 3047 3204 and amp range 2048 4095 Range in image: x 0 159 , y 0 158 (with image size 159 x 158) dzp -0.041613504 -> scaling image by 0.9623977484321999 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2905 3183 and amp range 2048 4095 and image y 7 150 and amp range 0 2039 Range in image: x 0 279 , y 0 144 (with image size 279 x 144) dzp 0.0072022504 -> scaling image by 1.0066555682883527 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75390170 Faked up EXPNUM 75390170 Faked up EXPNUM 75390170 90prime get_fwhm: self.fwhm = 2.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2651 2807 and amp range 2016 4031 and image y 593 749 and amp range 0 2047 Range in image: x 0 157 , y 0 157 (with image size 157 x 157) dzp 0.004245165 -> scaling image by 1.0039175950705865 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1730 2006 and amp range 0 2005 and image y 245 524 and amp range 0 2039 Range in image: x 0 276 , y 0 280 (with image size 277 x 280) dzp 0.007397243 -> scaling image by 1.006836374469654 Found overlap: image x 1730 2006 and amp range 2006 4053 and image y 245 524 and amp range 0 2039 Range in image: x 276 277 , y 0 280 (with image size 277 x 280) dzp 0.000620604 -> scaling image by 1.0005717608254892 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75730125 Faked up EXPNUM 75730125 Faked up EXPNUM 75730125 90prime get_fwhm: self.fwhm = 3.83 Found 4 relevant rows in amp-corrections file. Found overlap: image x 465 622 and amp range 0 2015 and image y 2559 2716 and amp range 2048 4095 Range in image: x 0 158 , y 0 158 (with image size 158 x 158) dzp 0.009255477 -> scaling image by 1.0085610475070432 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 79250021 Faked up EXPNUM 79250021 Faked up EXPNUM 79250021 90prime get_fwhm: self.fwhm = 2.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 609 767 and amp range 0 2015 and image y 3047 3204 and amp range 2048 4095 Range in image: x 0 159 , y 0 158 (with image size 159 x 158) dzp -0.034377232 -> scaling image by 0.9688334104074875 mosaic get_fwhm: self.fwhm = 3.99 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2931 3213 and amp range 2048 4095 and image y 3529 3809 and amp range 2022 4060 Range in image: x 0 283 , y 0 281 (with image size 283 x 281) dzp -0.0028835079 -> scaling image by 0.9973477146455455 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82540122 Faked up EXPNUM 82540122 Faked up EXPNUM 82540122 90prime get_fwhm: self.fwhm = 3.17 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2657 2814 and amp range 2016 4031 and image y 586 743 and amp range 0 2047 Range in image: x 0 158 , y 0 158 (with image size 158 x 158) dzp -0.0012233759 -> scaling image by 0.9988738637196966 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 205 477 and amp range 0 2047 and image y 2718 2992 and amp range 2022 4060 Range in image: x 0 273 , y 0 275 (with image size 273 x 275) dzp 0.0033053984 -> scaling image by 1.0030490232713904 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75390236 Faked up EXPNUM 75390236 Faked up EXPNUM 75390236 90prime get_fwhm: self.fwhm = 2.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 465 621 and amp range 0 2015 and image y 2571 2728 and amp range 2048 4095 Range in image: x 0 157 , y 0 158 (with image size 157 x 158) dzp 0.004205519 -> scaling image by 1.0038809374310762 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 5.25 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1704 1979 and amp range 0 2005 and image y 4028 4072 and amp range 2040 4078 Range in image: x 0 276 , y 0 45 (with image size 276 x 45) dzp 0.012956044 -> scaling image by 1.012004439021001 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 12.12 s, CPU: 1.11 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 176 MB, VmData: 208 MB, maxrss: 0.17988 MB Stage tims finished: 2020-08-05T20:30:59.425321 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 6.386 s worker CPU, 48.400 s worker Wall, Wall: 12.121 s, Cores in use: 0.62, Total efficiency (on 16 cores): 3.9 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T20:30:59.448640 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02080.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02081.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02209.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01953.fits Matched 2 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/metrics/cus/reference-custom-272303p42176.fits Stage refs : Wall: 9.29 s, CPU: 5.21 s, VmPeak: 1019 MB, VmSize: 1014 MB, VmRSS: 234 MB, VmData: 264 MB, maxrss: 0.239444 MB Stage refs finished: 2020-08-05T20:31:08.738355 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.291 s, Cores in use: 0.56, Total efficiency (on 16 cores): 3.5 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T20:31:08.761080 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/metrics/cus/outlier-mask-custom-272303p42176.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/metrics/cus/outliers-pre-custom-272303p42176.jpg Image k4m_160508_100904_ooi_zd_ls9-CCD4 z : masking 258 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/metrics/cus/outlier-mask-custom-272303p42176.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/metrics/cus/outliers-post-custom-272303p42176.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/metrics/cus/outliers-masked-pos-custom-272303p42176.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/metrics/cus/outliers-masked-neg-custom-272303p42176.jpg Stage outliers : Wall: 2.06 s, CPU: 1.52 s, VmPeak: 1023 MB, VmSize: 1023 MB, VmRSS: 250 MB, VmData: 277 MB, maxrss: 0.25586 MB Stage outliers finished: 2020-08-05T20:31:10.820700 Resources for stage outliers : 0.743 s worker CPU, 0.922 s worker Wall, Wall: 2.061 s, Cores in use: 1.10, Total efficiency (on 16 cores): 6.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T20:31:10.967517 Stage halos : Wall: 3.80 s, CPU: 3.69 s, VmPeak: 1024 MB, VmSize: 1024 MB, VmRSS: 250 MB, VmData: 277 MB, maxrss: 0.256364 MB Stage halos finished: 2020-08-05T20:31:14.771944 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 3.806 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T20:31:14.813674 PSF sigmas in coadd pixels: ['2.82', '2.18', '2.33'] Using average PSF sigma 2.445630814854877 Gaussian PSF norm 0.11534643334571233 vs pixelized 0.1021177 average tim pixel scale / coadd scale: 1.7293022620271294 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.64', '2.38', '1.77'] Using average PSF sigma 1.9306835356233323 Gaussian PSF norm 0.146111357231211 vs pixelized 0.122545585 average tim pixel scale / coadd scale: 1.729558064701846 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.86', '1.56', '1.90', '1.68', '2.21'] Using average PSF sigma 1.8443792369828862 Gaussian PSF norm 0.15294836664684036 vs pixelized 0.12367219 average tim pixel scale / coadd scale: 0.9909263285026239 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.26 s, CPU: 0.17 s, VmPeak: 1024 MB, VmSize: 1024 MB, VmRSS: 253 MB, VmData: 278 MB, maxrss: 0.258772 MB Stage fit_on_coadds finished: 2020-08-05T20:31:15.071634 Resources for stage fit_on_coadds : 0.167 s worker CPU, 0.167 s worker Wall, Wall: 0.259 s, Cores in use: 1.30, Total efficiency (on 16 cores): 8.1 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-fit_on_coadds.p Running stage srcs Warning: Stellar halo subtraction is only implemented for DECam Running stage srcs at 2020-08-05T20:31:15.117960 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 29 potential peaks Of 29 potential peaks: 11 in veto map, 3 cut by saddle test, 0 cut by aper test, 15 kept SED z : 15 new peaks Found 42 potential peaks Of 42 potential peaks: 38 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 23 potential peaks Of 23 potential peaks: 20 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 33 potential peaks Of 33 potential peaks: 28 in veto map, 4 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 44 potential peaks Of 44 potential peaks: 39 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 16 new sources Median coadd sky for g : 6.4826396e-05 Median coadd sky for r : 0.00048203804 Median coadd sky for z : 0.00010268438 Stage srcs : Wall: 3.05 s, CPU: 2.88 s, VmPeak: 1024 MB, VmSize: 1024 MB, VmRSS: 253 MB, VmData: 278 MB, maxrss: 0.25926 MB Stage srcs finished: 2020-08-05T20:31:18.171334 Resources for stage srcs : 0.096 s worker CPU, 0.096 s worker Wall, Wall: 3.055 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.1 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T20:31:18.195143 Blob 1 of 10, id: 3, sources: 8, size: 168x213, npix 20014, brick X: 51,219, Y: 43,256, one pixel: 156 43 Blob 2 of 10, id: 8, sources: 1, size: 55x44, npix 1745, brick X: 204,259, Y: 225,269, one pixel: 228 225 Blob 3 of 10, id: 5, sources: 2, size: 30x38, npix 783, brick X: 22,52, Y: 137,175, one pixel: 36 137 Blob 4 of 10, id: 1, sources: 1, size: 29x34, npix 639, brick X: 179,208, Y: 12,46, one pixel: 191 12 Blob 5 of 10, id: 6, sources: 1, size: 25x32, npix 597, brick X: 244,269, Y: 197,229, one pixel: 256 197 Blob 6 of 10, id: 7, sources: 1, size: 24x25, npix 385, brick X: 154,178, Y: 224,249, one pixel: 165 224 Blob 7 of 10, id: 4, sources: 1, size: 23x24, npix 339, brick X: 243,266, Y: 65,89, one pixel: 253 65 Blob 8 of 10, id: 2, sources: 1, size: 15x26, npix 285, brick X: 254,269, Y: 13,39, one pixel: 264 13 Blob 9 of 10, id: 0, sources: 1, size: 21x21, npix 248, brick X: 147,168, Y: 0,21, one pixel: 157 0 Blob 10 of 10, id: 9, sources: 1, size: 24x14, npix 217, brick X: 109,133, Y: 255,269, one pixel: 119 255 Blob 7 finished, total: Wall: 0.20 s, CPU: 0.18 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.096044 MB Blob 6 finished, total: Wall: 0.21 s, CPU: 0.20 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 93 MB, VmData: 141 MB, maxrss: 0.095072 MB Measuring 1 iterative sources Blob 9 finished, total: Wall: 0.27 s, CPU: 0.26 s, VmPeak: 793 MB, VmSize: 719 MB, VmRSS: 135 MB, VmData: 171 MB, maxrss: 0.13776 MB Measuring 1 iterative sources Blob 8 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 811 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151368 MB Blob 5 finished, total: Wall: 0.58 s, CPU: 0.57 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151236 MB Blob 10 finished, total: Wall: 0.61 s, CPU: 0.61 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.093252 MB Blob 4 finished, total: Wall: 0.71 s, CPU: 0.69 s, VmPeak: 790 MB, VmSize: 719 MB, VmRSS: 135 MB, VmData: 171 MB, maxrss: 0.137884 MB Blob 2 finished, total: Wall: 0.72 s, CPU: 0.70 s, VmPeak: 807 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151212 MB Blob 3 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 808 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151964 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.30743, ee1=0.303942, ee2=0.0245246 Measuring 9 iterative sources Blob 1 finished, total: Wall: 14.47 s, CPU: 14.45 s, VmPeak: 810 MB, VmSize: 734 MB, VmRSS: 157 MB, VmData: 186 MB, maxrss: 0.160748 MB Old catalog: 25 New catalog: 29 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/metrics/cus/blobs-custom-272303p42176.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/metrics/cus/all-models-custom-272303p42176.fits Stage fitblobs : Wall: 17.14 s, CPU: 1.74 s, VmPeak: 1024 MB, VmSize: 1024 MB, VmRSS: 254 MB, VmData: 278 MB, maxrss: 0.259616 MB Stage fitblobs finished: 2020-08-05T20:31:35.332180 Resources for stage fitblobs : 19.292 s worker CPU, 19.697 s worker Wall, Wall: 17.139 s, Cores in use: 1.23, Total efficiency (on 16 cores): 7.7 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T20:31:35.360092 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/tmp-legacysurvey-custom-272303p42176-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/tmp-legacysurvey-custom-272303p42176-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/tmp-legacysurvey-custom-272303p42176-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/tmp-legacysurvey-custom-272303p42176-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-resid.jpg Stage coadds : Wall: 3.23 s, CPU: 0.93 s, VmPeak: 1024 MB, VmSize: 1024 MB, VmRSS: 254 MB, VmData: 278 MB, maxrss: 0.25994 MB Stage coadds finished: 2020-08-05T20:31:38.594671 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 9.135 s worker CPU, 13.588 s worker Wall, Wall: 3.236 s, Cores in use: 3.11, Total efficiency (on 16 cores): 19.4 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T20:31:38.609194 Cut to 1 unWISE tiles Reading WISE tile 2730p424 band 1 Reading WISE tile 2730p424 band 2 Reading WISE tile 2730p424 band 4 Reading WISE tile 2730p424 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.05 s, VmPeak: 812 MB, VmSize: 812 MB, VmRSS: 154 MB, VmData: 180 MB, maxrss: 0.197112 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 811 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 171 MB, maxrss: 0.20942 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 809 MB, VmSize: 798 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.202384 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 811 MB, VmSize: 809 MB, VmRSS: 155 MB, VmData: 177 MB, maxrss: 0.219804 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/tmp-legacysurvey-custom-272303p42176-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/tmp-legacysurvey-custom-272303p42176-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.59 s, CPU: 1.09 s, VmPeak: 1024 MB, VmSize: 1024 MB, VmRSS: 254 MB, VmData: 278 MB, maxrss: 0.26058 MB Stage wise_forced finished: 2020-08-05T20:31:42.197553 Resources for stage wise_forced : 3.344 s worker CPU, 5.941 s worker Wall, Wall: 3.590 s, Cores in use: 1.24, Total efficiency (on 16 cores): 7.7 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T20:31:42.212417 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/tractor-i/cus/tractor-custom-272303p42176.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/tractor/cus/tractor-custom-272303p42176.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/tractor/cus/brick-custom-272303p42176.sha256sum Stage writecat : Wall: 1.70 s, CPU: 0.76 s, VmPeak: 1156 MB, VmSize: 1028 MB, VmRSS: 256 MB, VmData: 278 MB, maxrss: 0.393588 MB Stage writecat finished: 2020-08-05T20:31:43.911867 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.701 s, Cores in use: 0.45, Total efficiency (on 16 cores): 2.8 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-writecat.p All done: 39.167 s worker CPU, 88.816 s worker Wall, Wall: 56.630 s, Cores in use: 1.03, Total efficiency (on 16 cores): 6.4 % Finished galaxy PGC2193760 in 0.983 minutes. Started working on galaxy PGC2193760 at Wed Aug 5 21:56:30 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.30361 42.176460299999995 --width 269 --height 269 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T21:56:31.744212 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.30361', '42.176460299999995', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.30361 42.176460299999995 --width 269 --height 269 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 272.30361 42.176460299999995 Starting process 58765 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 58766 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 58767 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 58768 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 58769 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB Starting process 58770 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059484 MB Starting process 58771 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059484 MB Starting process 58772 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 58773 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 58774 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 58775 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 58776 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 58777 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 58778 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 58779 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 58780 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 58781 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 58782 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 58783 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 58784 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 58785 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 58786 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 58787 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 58788 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 58789 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 58790 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 58791 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 58792 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 58793 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 58794 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 58795 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 58796 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T21:56:32.348917 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 11 CCDs: k4m_170527_111502_ooi_zd_ls9-CCD1 z expnum 130204 exptime 80.105 propid 2016A-0453 seeing 1.14 MJD 57900.469 object MzLS_615602_z mosaic/CP/V4.3/CP20170526/k4m_170527_111502_ooi_zd_ls9.fits.fz k4m_160425_110212_ooi_zd_ls9-CCD2 z expnum 84864 exptime 90.105 propid 2016A seeing 0.96 MJD 57503.460 object MzLS_613740_z mosaic/CP/V4.3/CP20160424/k4m_160425_110212_ooi_zd_ls9.fits.fz k4m_160508_100904_ooi_zd_ls9-CCD4 z expnum 87542 exptime 80.105 propid 2016A-0453 seeing 1.17 MJD 57516.423 object MzLS_614672_z mosaic/CP/V4.3/CP20160507/k4m_160508_100904_ooi_zd_ls9.fits.fz k4m_160428_104603_ooi_zd_ls9-CCD4 z expnum 85524 exptime 105.105 propid 2016A-0453 seeing 1.04 MJD 57506.449 object MzLS_613739_z mosaic/CP/V4.3/CP20160427/k4m_160428_104603_ooi_zd_ls9.fits.fz k4m_170524_111646_ooi_zd_ls9-CCD3 z expnum 129989 exptime 135.105 propid 2016A-0453 seeing 1.36 MJD 57897.470 object MzLS_615601_z mosaic/CP/V4.3/CP20170523/k4m_170524_111646_ooi_zd_ls9.fits.fz ksb_160704_080103_ooi_g_ls9-CCD4 g expnum 75730125 exptime 95.2 propid BASS seeing 1.74 MJD 57573.334 object 17462 90prime/CP/V2.3/CP20160703/ksb_160704_080103_ooi_g_ls9.fits.fz ksb_160531_104804_ooi_r_ls9-CCD4 r expnum 75390236 exptime 71.8 propid BASS seeing 1.01 MJD 57539.450 object 17462 90prime/CP/V2.3/CP20160530/ksb_160531_104804_ooi_r_ls9.fits.fz ksb_170621_055929_ooi_g_ls9-CCD1 g expnum 79250021 exptime 139.421 propid BASS seeing 1.34 MJD 57925.250 object 17463 90prime/CP/V2.3/CP20170620/ksb_170621_055929_ooi_g_ls9.fits.fz ksb_170430_111635_ooi_r_ls9-CCD1 r expnum 78730265 exptime 117.527 propid BASS seeing 1.46 MJD 57873.470 object 17463 90prime/CP/V2.3/CP20170429/ksb_170430_111635_ooi_r_ls9.fits.fz ksb_160531_083601_ooi_r_ls9-CCD3 r expnum 75390170 exptime 59.6 propid BASS seeing 1.09 MJD 57539.358 object 17461 90prime/CP/V2.3/CP20160530/ksb_160531_083601_ooi_r_ls9.fits.fz ksb_180516_081127_ooi_g_ls9-CCD3 g expnum 82540122 exptime 96.511 propid NOTBASS seeing 1.44 MJD 58254.341 object 17461 90prime/CP/V2.3/CP20180515/ksb_180516_081127_ooi_g_ls9.fits.fz Faked up EXPNUM 78730265 Faked up EXPNUM 78730265 Faked up EXPNUM 78730265 90prime get_fwhm: self.fwhm = 3.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 633 791 and amp range 0 2015 and image y 3047 3204 and amp range 2048 4095 Range in image: x 0 159 , y 0 158 (with image size 159 x 158) dzp -0.041613504 -> scaling image by 0.9623977484321999 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82540122 Faked up EXPNUM 82540122 Faked up EXPNUM 82540122 90prime get_fwhm: self.fwhm = 3.17 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2657 2814 and amp range 2016 4031 and image y 586 743 and amp range 0 2047 Range in image: x 0 158 , y 0 158 (with image size 158 x 158) dzp -0.0012233759 -> scaling image by 0.9988738637196966 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 79250021 Faked up EXPNUM 79250021 Faked up EXPNUM 79250021 90prime get_fwhm: self.fwhm = 2.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 609 767 and amp range 0 2015 and image y 3047 3204 and amp range 2048 4095 Range in image: x 0 159 , y 0 158 (with image size 159 x 158) dzp -0.034377232 -> scaling image by 0.9688334104074875 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75730125 Faked up EXPNUM 75730125 Faked up EXPNUM 75730125 90prime get_fwhm: self.fwhm = 3.83 Found 4 relevant rows in amp-corrections file. Found overlap: image x 465 622 and amp range 0 2015 and image y 2559 2716 and amp range 2048 4095 Range in image: x 0 158 , y 0 158 (with image size 158 x 158) dzp 0.009255477 -> scaling image by 1.0085610475070432 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2905 3183 and amp range 2048 4095 and image y 7 150 and amp range 0 2039 Range in image: x 0 279 , y 0 144 (with image size 279 x 144) dzp 0.0072022504 -> scaling image by 1.0066555682883527 Faked up EXPNUM 75390170 Faked up EXPNUM 75390170 Faked up EXPNUM 75390170 90prime get_fwhm: self.fwhm = 2.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2651 2807 and amp range 2016 4031 and image y 593 749 and amp range 0 2047 Range in image: x 0 157 , y 0 157 (with image size 157 x 157) dzp 0.004245165 -> scaling image by 1.0039175950705865 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.41 Found 4 relevant rows in amp-corrections file. mosaic get_fwhm: self.fwhm = 4.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1730 2006 and amp range 0 2005 and image y 245 524 and amp range 0 2039 Range in image: x 0 276 , y 0 280 (with image size 277 x 280) dzp 0.007397243 -> scaling image by 1.006836374469654 Found overlap: image x 205 477 and amp range 0 2047 and image y 2718 2992 and amp range 2022 4060 Range in image: x 0 273 , y 0 275 (with image size 273 x 275) dzp 0.0033053984 -> scaling image by 1.0030490232713904 Found overlap: image x 1730 2006 and amp range 2006 4053 and image y 245 524 and amp range 0 2039 Range in image: x 276 277 , y 0 280 (with image size 277 x 280) dzp 0.000620604 -> scaling image by 1.0005717608254892 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75390236 Faked up EXPNUM 75390236 Faked up EXPNUM 75390236 90prime get_fwhm: self.fwhm = 2.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 465 621 and amp range 0 2015 and image y 2571 2728 and amp range 2048 4095 Range in image: x 0 157 , y 0 158 (with image size 157 x 158) dzp 0.004205519 -> scaling image by 1.0038809374310762 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.99 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2931 3213 and amp range 2048 4095 and image y 3529 3809 and amp range 2022 4060 Range in image: x 0 283 , y 0 281 (with image size 283 x 281) dzp -0.0028835079 -> scaling image by 0.9973477146455455 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 5.25 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1704 1979 and amp range 0 2005 and image y 4028 4072 and amp range 2040 4078 Range in image: x 0 276 , y 0 45 (with image size 276 x 45) dzp 0.012956044 -> scaling image by 1.012004439021001 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 16.52 s, CPU: 0.98 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 176 MB, VmData: 208 MB, maxrss: 0.180524 MB Stage tims finished: 2020-08-05T21:56:48.867666 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 6.241 s worker CPU, 41.763 s worker Wall, Wall: 16.521 s, Cores in use: 0.44, Total efficiency (on 32 cores): 1.4 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T21:56:51.311173 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02080.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02081.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02209.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01953.fits Matched 2 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/metrics/cus/reference-custom-272303p42176.fits Stage refs : Wall: 12.63 s, CPU: 5.16 s, VmPeak: 1019 MB, VmSize: 1014 MB, VmRSS: 235 MB, VmData: 264 MB, maxrss: 0.240208 MB Stage refs finished: 2020-08-05T21:57:03.944242 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 12.635 s, Cores in use: 0.41, Total efficiency (on 32 cores): 1.3 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T21:57:04.096956 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/metrics/cus/outlier-mask-custom-272303p42176.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/metrics/cus/outliers-pre-custom-272303p42176.jpg Image k4m_160508_100904_ooi_zd_ls9-CCD4 z : masking 258 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/metrics/cus/outlier-mask-custom-272303p42176.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/metrics/cus/outliers-post-custom-272303p42176.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/metrics/cus/outliers-masked-pos-custom-272303p42176.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/metrics/cus/outliers-masked-neg-custom-272303p42176.jpg Stage outliers : Wall: 1.17 s, CPU: 0.82 s, VmPeak: 1023 MB, VmSize: 1023 MB, VmRSS: 250 MB, VmData: 277 MB, maxrss: 0.256044 MB Stage outliers finished: 2020-08-05T21:57:05.262454 Resources for stage outliers : 0.925 s worker CPU, 1.353 s worker Wall, Wall: 1.168 s, Cores in use: 1.49, Total efficiency (on 32 cores): 4.7 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T21:57:05.391702 Stage halos : Wall: 0.44 s, CPU: 0.43 s, VmPeak: 1023 MB, VmSize: 1023 MB, VmRSS: 250 MB, VmData: 277 MB, maxrss: 0.256136 MB Stage halos finished: 2020-08-05T21:57:05.834364 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.445 s, Cores in use: 0.98, Total efficiency (on 32 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T21:57:05.921629 PSF sigmas in coadd pixels: ['2.82', '2.18', '2.33'] Using average PSF sigma 2.445630814854877 Gaussian PSF norm 0.11534643334571233 vs pixelized 0.1021177 average tim pixel scale / coadd scale: 1.7293022620271294 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.64', '2.38', '1.77'] Using average PSF sigma 1.9306835356233323 Gaussian PSF norm 0.146111357231211 vs pixelized 0.122545585 average tim pixel scale / coadd scale: 1.729558064701846 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.86', '1.56', '1.90', '1.68', '2.21'] Using average PSF sigma 1.8443792369828862 Gaussian PSF norm 0.15294836664684036 vs pixelized 0.123672195 average tim pixel scale / coadd scale: 0.9909263285026239 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.19 s, CPU: 0.18 s, VmPeak: 1023 MB, VmSize: 1023 MB, VmRSS: 252 MB, VmData: 277 MB, maxrss: 0.25774 MB Stage fit_on_coadds finished: 2020-08-05T21:57:06.113866 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.207 s worker CPU, 0.207 s worker Wall, Wall: 0.194 s, Cores in use: 2.03, Total efficiency (on 32 cores): 6.3 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-fit_on_coadds.p Running stage srcs Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage srcs at 2020-08-05T21:57:06.127085 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 29 potential peaks Of 29 potential peaks: 11 in veto map, 3 cut by saddle test, 0 cut by aper test, 15 kept SED z : 15 new peaks Found 42 potential peaks Of 42 potential peaks: 38 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 23 potential peaks Of 23 potential peaks: 20 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 33 potential peaks Of 33 potential peaks: 28 in veto map, 4 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 44 potential peaks Of 44 potential peaks: 39 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 16 new sources Median coadd sky for g : 6.4826396e-05 Median coadd sky for r : 0.00048203807 Median coadd sky for z : 0.00010268438 Stage srcs : Wall: 0.61 s, CPU: 0.56 s, VmPeak: 1023 MB, VmSize: 1023 MB, VmRSS: 252 MB, VmData: 277 MB, maxrss: 0.258116 MB Stage srcs finished: 2020-08-05T21:57:06.734151 Resources for stage srcs : 0.107 s worker CPU, 0.107 s worker Wall, Wall: 0.609 s, Cores in use: 1.10, Total efficiency (on 32 cores): 3.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T21:57:06.747970 Blob 1 of 10, id: 3, sources: 8, size: 168x213, npix 20014, brick X: 51,219, Y: 43,256, one pixel: 156 43 Blob 2 of 10, id: 8, sources: 1, size: 55x44, npix 1745, brick X: 204,259, Y: 225,269, one pixel: 228 225 Blob 3 of 10, id: 5, sources: 2, size: 30x38, npix 783, brick X: 22,52, Y: 137,175, one pixel: 36 137 Blob 4 of 10, id: 1, sources: 1, size: 29x34, npix 639, brick X: 179,208, Y: 12,46, one pixel: 191 12 Blob 5 of 10, id: 6, sources: 1, size: 25x32, npix 597, brick X: 244,269, Y: 197,229, one pixel: 256 197 Blob 6 of 10, id: 7, sources: 1, size: 24x25, npix 385, brick X: 154,178, Y: 224,249, one pixel: 165 224 Blob 7 of 10, id: 4, sources: 1, size: 23x24, npix 339, brick X: 243,266, Y: 65,89, one pixel: 253 65 Blob 8 of 10, id: 2, sources: 1, size: 15x26, npix 285, brick X: 254,269, Y: 13,39, one pixel: 264 13 Blob 9 of 10, id: 0, sources: 1, size: 21x21, npix 248, brick X: 147,168, Y: 0,21, one pixel: 157 0 Blob 10 of 10, id: 9, sources: 1, size: 24x14, npix 217, brick X: 109,133, Y: 255,269, one pixel: 119 255 Measuring 1 iterative sources Blob 6 finished, total: Wall: 0.16 s, CPU: 0.16 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.0944 MB Blob 9 finished, total: Wall: 0.17 s, CPU: 0.17 s, VmPeak: 812 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151116 MB Blob 7 finished, total: Wall: 0.19 s, CPU: 0.18 s, VmPeak: 809 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149436 MB Measuring 1 iterative sources Blob 5 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.091856 MB Blob 2 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.098416 MB Blob 10 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.151032 MB Blob 8 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 807 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151064 MB Blob 4 finished, total: Wall: 0.82 s, CPU: 0.81 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.092924 MB Blob 3 finished, total: Wall: 1.08 s, CPU: 1.08 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 94 MB, VmData: 139 MB, maxrss: 0.095936 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.30743, ee1=0.303941, ee2=0.0245245 Measuring 9 iterative sources Blob 1 finished, total: Wall: 15.30 s, CPU: 15.29 s, VmPeak: 697 MB, VmSize: 687 MB, VmRSS: 120 MB, VmData: 159 MB, maxrss: 0.131212 MB Old catalog: 25 New catalog: 29 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/metrics/cus/blobs-custom-272303p42176.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/metrics/cus/all-models-custom-272303p42176.fits Stage fitblobs : Wall: 15.73 s, CPU: 0.41 s, VmPeak: 1023 MB, VmSize: 1023 MB, VmRSS: 252 MB, VmData: 277 MB, maxrss: 0.258472 MB Stage fitblobs finished: 2020-08-05T21:57:22.475886 Resources for stage fitblobs : 20.275 s worker CPU, 20.355 s worker Wall, Wall: 15.730 s, Cores in use: 1.32, Total efficiency (on 32 cores): 4.1 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T21:57:22.490595 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/tmp-legacysurvey-custom-272303p42176-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/tmp-legacysurvey-custom-272303p42176-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/tmp-legacysurvey-custom-272303p42176-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/tmp-legacysurvey-custom-272303p42176-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-resid.jpg Stage coadds : Wall: 3.10 s, CPU: 0.66 s, VmPeak: 1023 MB, VmSize: 1023 MB, VmRSS: 253 MB, VmData: 277 MB, maxrss: 0.258796 MB Stage coadds finished: 2020-08-05T21:57:25.595470 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 24.998 s worker CPU, 41.614 s worker Wall, Wall: 3.107 s, Cores in use: 8.26, Total efficiency (on 32 cores): 25.8 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T21:57:25.611972 Cut to 1 unWISE tiles Reading WISE tile 2730p424 band 2 Reading WISE tile 2730p424 band 1 Reading WISE tile 2730p424 band 3 Reading WISE tile 2730p424 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 811 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 175 MB, maxrss: 0.186424 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 798 MB, VmSize: 798 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.201952 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 808 MB, VmSize: 799 MB, VmRSS: 140 MB, VmData: 171 MB, maxrss: 0.202304 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 812 MB, VmSize: 812 MB, VmRSS: 153 MB, VmData: 180 MB, maxrss: 0.209664 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/tmp-legacysurvey-custom-272303p42176-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/tmp-legacysurvey-custom-272303p42176-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.50 s, CPU: 0.95 s, VmPeak: 1023 MB, VmSize: 1023 MB, VmRSS: 253 MB, VmData: 277 MB, maxrss: 0.259436 MB Stage wise_forced finished: 2020-08-05T21:57:28.110856 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.204 s worker CPU, 4.438 s worker Wall, Wall: 2.502 s, Cores in use: 1.66, Total efficiency (on 32 cores): 5.2 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-wise_forced.p Running stage writecat WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage writecat at 2020-08-05T21:57:28.131052 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/tractor-i/cus/tractor-custom-272303p42176.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/tractor/cus/tractor-custom-272303p42176.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/tractor/cus/brick-custom-272303p42176.sha256sum Stage writecat : Wall: 1.06 s, CPU: 0.74 s, VmPeak: 1156 MB, VmSize: 1028 MB, VmRSS: 255 MB, VmData: 277 MB, maxrss: 0.392492 MB Stage writecat finished: 2020-08-05T21:57:29.191099 Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 1.062 s, Cores in use: 0.70, Total efficiency (on 32 cores): 2.2 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2193760/PGC2193760-largegalaxy-writecat.p All done: 55.963 s worker CPU, 109.846 s worker Wall, Wall: 56.865 s, Cores in use: 1.18, Total efficiency (on 32 cores): 3.7 % Finished galaxy PGC2193760 in 0.981 minutes. Started working on galaxy PGC2193760 at Fri Aug 7 09:32:48 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.30305883933937 42.17637550000269 --width 269 --height 269 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/PGC2193760-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/PGC2193760-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T09:32:50.168999 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.30305883933937', '42.17637550000269', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/PGC2193760-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/PGC2193760-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.30305883933937 42.17637550000269 --width 269 --height 269 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/PGC2193760-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/PGC2193760-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 272.30305883933937 42.17637550000269 Starting process 57436 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 57438 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 57441 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 57443 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 57444 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 57446 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB Starting process 57448 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB Starting process 57450 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 57453 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 57455 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 57457 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 57458 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 57460 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 57463 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 57466 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 57467 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T09:32:50.582343 Keeping 11 CCDs: k4m_170527_111502_ooi_zd_ls9-CCD1 z expnum 130204 exptime 80.105 propid 2016A-0453 seeing 1.14 MJD 57900.469 object MzLS_615602_z mosaic/CP/V4.3/CP20170526/k4m_170527_111502_ooi_zd_ls9.fits.fz k4m_160425_110212_ooi_zd_ls9-CCD2 z expnum 84864 exptime 90.105 propid 2016A seeing 0.96 MJD 57503.460 object MzLS_613740_z mosaic/CP/V4.3/CP20160424/k4m_160425_110212_ooi_zd_ls9.fits.fz k4m_160508_100904_ooi_zd_ls9-CCD4 z expnum 87542 exptime 80.105 propid 2016A-0453 seeing 1.17 MJD 57516.423 object MzLS_614672_z mosaic/CP/V4.3/CP20160507/k4m_160508_100904_ooi_zd_ls9.fits.fz k4m_160428_104603_ooi_zd_ls9-CCD4 z expnum 85524 exptime 105.105 propid 2016A-0453 seeing 1.04 MJD 57506.449 object MzLS_613739_z mosaic/CP/V4.3/CP20160427/k4m_160428_104603_ooi_zd_ls9.fits.fz k4m_170524_111646_ooi_zd_ls9-CCD3 z expnum 129989 exptime 135.105 propid 2016A-0453 seeing 1.36 MJD 57897.470 object MzLS_615601_z mosaic/CP/V4.3/CP20170523/k4m_170524_111646_ooi_zd_ls9.fits.fz ksb_160704_080103_ooi_g_ls9-CCD4 g expnum 75730125 exptime 95.2 propid BASS seeing 1.74 MJD 57573.334 object 17462 90prime/CP/V2.3/CP20160703/ksb_160704_080103_ooi_g_ls9.fits.fz ksb_160531_104804_ooi_r_ls9-CCD4 r expnum 75390236 exptime 71.8 propid BASS seeing 1.01 MJD 57539.450 object 17462 90prime/CP/V2.3/CP20160530/ksb_160531_104804_ooi_r_ls9.fits.fz ksb_170621_055929_ooi_g_ls9-CCD1 g expnum 79250021 exptime 139.421 propid BASS seeing 1.34 MJD 57925.250 object 17463 90prime/CP/V2.3/CP20170620/ksb_170621_055929_ooi_g_ls9.fits.fz ksb_170430_111635_ooi_r_ls9-CCD1 r expnum 78730265 exptime 117.527 propid BASS seeing 1.46 MJD 57873.470 object 17463 90prime/CP/V2.3/CP20170429/ksb_170430_111635_ooi_r_ls9.fits.fz ksb_160531_083601_ooi_r_ls9-CCD3 r expnum 75390170 exptime 59.6 propid BASS seeing 1.09 MJD 57539.358 object 17461 90prime/CP/V2.3/CP20160530/ksb_160531_083601_ooi_r_ls9.fits.fz ksb_180516_081127_ooi_g_ls9-CCD3 g expnum 82540122 exptime 96.511 propid NOTBASS seeing 1.44 MJD 58254.341 object 17461 90prime/CP/V2.3/CP20180515/ksb_180516_081127_ooi_g_ls9.fits.fz mosaic get_fwhm: self.fwhm = 4.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1728 2005 and amp range 0 2005 and image y 239 519 and amp range 0 2039 Range in image: x 0 278 , y 0 281 (with image size 278 x 281) dzp 0.007397243 -> scaling image by 1.006836374469654 mosaic get_fwhm: self.fwhm = 4.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 204 476 and amp range 0 2047 and image y 2712 2986 and amp range 2022 4060 Range in image: x 0 273 , y 0 275 (with image size 273 x 275) dzp 0.0033053984 -> scaling image by 1.0030490232713904 mosaic get_fwhm: self.fwhm = 3.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2903 3182 and amp range 2048 4095 and image y 7 144 and amp range 0 2039 Range in image: x 0 280 , y 0 138 (with image size 280 x 138) dzp 0.0072022504 -> scaling image by 1.0066555682883527 mosaic get_fwhm: self.fwhm = 3.99 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2930 3211 and amp range 2048 4095 and image y 3523 3803 and amp range 2022 4060 Range in image: x 0 282 , y 0 281 (with image size 282 x 281) dzp -0.0028835079 -> scaling image by 0.9973477146455455 mosaic get_fwhm: self.fwhm = 5.25 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1703 1978 and amp range 0 2005 and image y 4022 4072 and amp range 2040 4078 Range in image: x 0 276 , y 0 51 (with image size 276 x 51) dzp 0.012956044 -> scaling image by 1.012004439021001 Faked up EXPNUM 75390170 Faked up EXPNUM 75390170 Faked up EXPNUM 75390170 90prime get_fwhm: self.fwhm = 2.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2652 2808 and amp range 2016 4031 and image y 596 752 and amp range 0 2047 Range in image: x 0 157 , y 0 157 (with image size 157 x 157) dzp 0.004245165 -> scaling image by 1.0039175950705865 Faked up EXPNUM 78730265 Faked up EXPNUM 78730265 Faked up EXPNUM 78730265 90prime get_fwhm: self.fwhm = 3.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 633 792 and amp range 0 2015 and image y 3050 3207 and amp range 2048 4095 Range in image: x 0 160 , y 0 158 (with image size 160 x 158) dzp -0.041613504 -> scaling image by 0.9623977484321999 Faked up EXPNUM 82540122 Faked up EXPNUM 82540122 Faked up EXPNUM 82540122 90prime get_fwhm: self.fwhm = 3.17 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2658 2815 and amp range 2016 4031 and image y 590 746 and amp range 0 2047 Range in image: x 0 158 , y 0 157 (with image size 158 x 157) dzp -0.0012233759 -> scaling image by 0.9988738637196966 Faked up EXPNUM 79250021 Faked up EXPNUM 79250021 Faked up EXPNUM 79250021 90prime get_fwhm: self.fwhm = 2.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 609 768 and amp range 0 2015 and image y 3050 3207 and amp range 2048 4095 Range in image: x 0 160 , y 0 158 (with image size 160 x 158) dzp -0.034377232 -> scaling image by 0.9688334104074875 Faked up EXPNUM 75730125 Faked up EXPNUM 75730125 Faked up EXPNUM 75730125 90prime get_fwhm: self.fwhm = 3.83 Found 4 relevant rows in amp-corrections file. Found overlap: image x 466 622 and amp range 0 2015 and image y 2562 2719 and amp range 2048 4095 Range in image: x 0 157 , y 0 158 (with image size 157 x 158) dzp 0.009255477 -> scaling image by 1.0085610475070432 Faked up EXPNUM 75390236 Faked up EXPNUM 75390236 Faked up EXPNUM 75390236 90prime get_fwhm: self.fwhm = 2.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 466 622 and amp range 0 2015 and image y 2574 2731 and amp range 2048 4095 Range in image: x 0 157 , y 0 158 (with image size 157 x 158) dzp 0.004205519 -> scaling image by 1.0038809374310762 Stage tims : Wall: 211.01 s, CPU: 1.08 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.178244 MB Stage tims finished: 2020-08-07T09:36:21.588541 Resources for stage tims : 5.715 s worker CPU, 579.702 s worker Wall, Wall: 211.008 s, Cores in use: 0.03, Total efficiency (on 16 cores): 0.2 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/PGC2193760-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/PGC2193760-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T09:36:22.033527 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02080.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02081.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02209.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01953.fits Matched 2 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/metrics/cus/reference-custom-272303p42176.fits Stage refs : Wall: 7.95 s, CPU: 4.86 s, VmPeak: 1013 MB, VmSize: 1007 MB, VmRSS: 233 MB, VmData: 264 MB, maxrss: 0.238236 MB Stage refs finished: 2020-08-07T09:36:29.981744 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.950 s, Cores in use: 0.61, Total efficiency (on 16 cores): 3.8 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/PGC2193760-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/PGC2193760-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T09:36:30.022133 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/metrics/cus/outlier-mask-custom-272303p42176.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/metrics/cus/outliers-pre-custom-272303p42176.jpg Image k4m_160508_100904_ooi_zd_ls9-CCD4 z : masking 166 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/metrics/cus/outlier-mask-custom-272303p42176.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/metrics/cus/outliers-post-custom-272303p42176.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/metrics/cus/outliers-masked-pos-custom-272303p42176.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/metrics/cus/outliers-masked-neg-custom-272303p42176.jpg Stage outliers : Wall: 7.39 s, CPU: 0.64 s, VmPeak: 1017 MB, VmSize: 1017 MB, VmRSS: 248 MB, VmData: 277 MB, maxrss: 0.25436 MB Stage outliers finished: 2020-08-07T09:36:37.410058 Resources for stage outliers : 0.826 s worker CPU, 0.868 s worker Wall, Wall: 7.389 s, Cores in use: 0.20, Total efficiency (on 16 cores): 1.2 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/PGC2193760-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/PGC2193760-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T09:36:37.501482 Stage halos : Wall: 0.31 s, CPU: 0.30 s, VmPeak: 1017 MB, VmSize: 1017 MB, VmRSS: 249 MB, VmData: 277 MB, maxrss: 0.254832 MB Stage halos finished: 2020-08-07T09:36:37.809681 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.309 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/PGC2193760-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/PGC2193760-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T09:36:37.917394 PSF sigmas in coadd pixels: ['2.82', '2.18', '2.33'] Using average PSF sigma 2.445630814854877 Gaussian PSF norm 0.11534643334571233 vs pixelized 0.102116585 average tim pixel scale / coadd scale: 1.7293022620271294 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.64', '2.38', '1.77'] Using average PSF sigma 1.9306835356233323 Gaussian PSF norm 0.146111357231211 vs pixelized 0.122545384 average tim pixel scale / coadd scale: 1.729558064701846 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.86', '1.56', '1.90', '1.68', '2.21'] Using average PSF sigma 1.8443792369828862 Gaussian PSF norm 0.15294836664684036 vs pixelized 0.12367256 average tim pixel scale / coadd scale: 0.9909263285026239 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.24 s, CPU: 0.18 s, VmPeak: 1017 MB, VmSize: 1017 MB, VmRSS: 251 MB, VmData: 278 MB, maxrss: 0.257148 MB Stage fit_on_coadds finished: 2020-08-07T09:36:38.154965 Resources for stage fit_on_coadds : 0.174 s worker CPU, 0.174 s worker Wall, Wall: 0.239 s, Cores in use: 1.49, Total efficiency (on 16 cores): 9.3 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/PGC2193760-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/PGC2193760-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T09:36:38.201284 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 30 potential peaks Of 30 potential peaks: 13 in veto map, 3 cut by saddle test, 0 cut by aper test, 14 kept SED z : 14 new peaks Found 40 potential peaks Of 40 potential peaks: 37 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 23 potential peaks Of 23 potential peaks: 20 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 33 potential peaks Of 33 potential peaks: 27 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 44 potential peaks Of 44 potential peaks: 39 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 15 new sources Median coadd sky for g : 8.75026e-05 Median coadd sky for r : 0.0005056963 Median coadd sky for z : 0.00010901205 Stage srcs : Wall: 0.47 s, CPU: 0.44 s, VmPeak: 1017 MB, VmSize: 1017 MB, VmRSS: 252 MB, VmData: 278 MB, maxrss: 0.25756 MB Stage srcs finished: 2020-08-07T09:36:38.674409 Resources for stage srcs : 0.077 s worker CPU, 0.077 s worker Wall, Wall: 0.474 s, Cores in use: 1.09, Total efficiency (on 16 cores): 6.8 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/PGC2193760-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/PGC2193760-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T09:36:38.727837 Blob 1 of 10, id: 3, sources: 7, size: 168x213, npix 20011, brick X: 45,213, Y: 44,257, one pixel: 150 44 Blob 2 of 10, id: 8, sources: 1, size: 55x42, npix 1709, brick X: 198,253, Y: 227,269, one pixel: 220 227 Blob 3 of 10, id: 5, sources: 2, size: 31x38, npix 776, brick X: 16,47, Y: 139,177, one pixel: 28 139 Blob 4 of 10, id: 6, sources: 1, size: 31x33, npix 695, brick X: 238,269, Y: 198,231, one pixel: 251 198 Blob 5 of 10, id: 2, sources: 1, size: 28x34, npix 626, brick X: 174,202, Y: 13,47, one pixel: 186 13 Blob 6 of 10, id: 1, sources: 1, size: 21x31, npix 461, brick X: 248,269, Y: 12,43, one pixel: 260 12 Blob 7 of 10, id: 7, sources: 1, size: 25x24, npix 377, brick X: 148,173, Y: 226,250, one pixel: 158 226 Blob 8 of 10, id: 4, sources: 1, size: 23x24, npix 340, brick X: 237,260, Y: 66,90, one pixel: 247 66 Blob 9 of 10, id: 0, sources: 1, size: 21x20, npix 239, brick X: 141,162, Y: 2,22, one pixel: 150 2 Blob 10 of 10, id: 9, sources: 1, size: 20x12, npix 157, brick X: 105,125, Y: 257,269, one pixel: 114 257 Blob 10 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 790 MB, VmSize: 712 MB, VmRSS: 130 MB, VmData: 169 MB, maxrss: 0.132932 MB Measuring 1 iterative sources Blob 7 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147156 MB Blob 8 finished, total: Wall: 0.26 s, CPU: 0.25 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.093568 MB Blob 9 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147196 MB Measuring 1 iterative sources Blob 4 finished, total: Wall: 0.46 s, CPU: 0.45 s, VmPeak: 793 MB, VmSize: 711 MB, VmRSS: 130 MB, VmData: 169 MB, maxrss: 0.133404 MB Blob 6 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147076 MB Blob 5 finished, total: Wall: 0.63 s, CPU: 0.63 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.093028 MB Blob 2 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.1465 MB Blob 3 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147408 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.687266, ee1=0.261513, ee2=0.00246509 Measuring 6 iterative sources Blob 1 finished, total: Wall: 11.15 s, CPU: 11.15 s, VmPeak: 813 MB, VmSize: 729 MB, VmRSS: 152 MB, VmData: 184 MB, maxrss: 0.156072 MB Old catalog: 24 New catalog: 23 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/metrics/cus/blobs-custom-272303p42176.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/metrics/cus/all-models-custom-272303p42176.fits Stage fitblobs : Wall: 11.63 s, CPU: 0.37 s, VmPeak: 1017 MB, VmSize: 1017 MB, VmRSS: 252 MB, VmData: 278 MB, maxrss: 0.257916 MB Stage fitblobs finished: 2020-08-07T09:36:50.354944 Resources for stage fitblobs : 15.207 s worker CPU, 15.359 s worker Wall, Wall: 11.628 s, Cores in use: 1.34, Total efficiency (on 16 cores): 8.4 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/PGC2193760-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/PGC2193760-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T09:36:50.390235 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/tmp-legacysurvey-custom-272303p42176-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/tmp-legacysurvey-custom-272303p42176-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/tmp-legacysurvey-custom-272303p42176-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/tmp-legacysurvey-custom-272303p42176-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-resid.jpg Stage coadds : Wall: 3.11 s, CPU: 0.60 s, VmPeak: 1017 MB, VmSize: 1017 MB, VmRSS: 252 MB, VmData: 278 MB, maxrss: 0.258236 MB Stage coadds finished: 2020-08-07T09:36:53.499849 Resources for stage coadds : 7.822 s worker CPU, 8.469 s worker Wall, Wall: 3.111 s, Cores in use: 2.71, Total efficiency (on 16 cores): 16.9 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/PGC2193760-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/PGC2193760-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T09:36:53.511776 Cut to 1 unWISE tiles Reading WISE tile 2730p424 band 1 Reading WISE tile 2730p424 band 2 Reading WISE tile 2730p424 band 4 Reading WISE tile 2730p424 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 809 MB, VmSize: 792 MB, VmRSS: 137 MB, VmData: 170 MB, maxrss: 0.200664 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 811 MB, VmSize: 798 MB, VmRSS: 145 MB, VmData: 176 MB, maxrss: 0.185296 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 811 MB, VmSize: 796 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.203448 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/273/2730p424/unwise-2730p424-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 813 MB, VmSize: 805 MB, VmRSS: 154 MB, VmData: 176 MB, maxrss: 0.216396 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/tmp-legacysurvey-custom-272303p42176-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/tmp-legacysurvey-custom-272303p42176-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 54.38 s, CPU: 0.46 s, VmPeak: 1017 MB, VmSize: 1017 MB, VmRSS: 253 MB, VmData: 278 MB, maxrss: 0.258816 MB Stage wise_forced finished: 2020-08-07T09:37:47.889895 Resources for stage wise_forced : 2.841 s worker CPU, 126.667 s worker Wall, Wall: 54.380 s, Cores in use: 0.06, Total efficiency (on 16 cores): 0.4 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/PGC2193760-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/PGC2193760-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T09:37:47.914674 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/coadd/cus/custom-272303p42176/legacysurvey-custom-272303p42176-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/tractor-i/cus/tractor-custom-272303p42176.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/tractor/cus/tractor-custom-272303p42176.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/tractor/cus/brick-custom-272303p42176.sha256sum Stage writecat : Wall: 0.79 s, CPU: 0.55 s, VmPeak: 1150 MB, VmSize: 1022 MB, VmRSS: 255 MB, VmData: 278 MB, maxrss: 0.391828 MB Stage writecat finished: 2020-08-07T09:37:48.700086 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.787 s, Cores in use: 0.70, Total efficiency (on 16 cores): 4.3 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/PGC2193760-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2193760/PGC2193760-largegalaxy-writecat.p All done: 32.667 s worker CPU, 731.321 s worker Wall, Wall: 298.217 s, Cores in use: 0.14, Total efficiency (on 16 cores): 0.9 % Finished galaxy PGC2193760 in 5.027 minutes.