Started working on galaxy PGC2293204 at Wed Aug 5 22:14:14 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.7259915 47.1494026 --width 361 --height 361 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/PGC2293204-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/PGC2293204-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T22:14:15.789782 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '277.7259915', '47.1494026', '--width', '361', '--height', '361', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/PGC2293204-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/PGC2293204-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.7259915 47.1494026 --width 361 --height 361 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/PGC2293204-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/PGC2293204-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 277.7259915 47.1494026 Starting process 19012 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 19014 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 19017 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 19020 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 19023 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 19025 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 19028 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 19031 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 19034 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 19038 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 19041 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 19042 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19045 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 19049 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 19052 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 19055 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T22:14:16.169766 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 12 CCDs: k4m_160519_101923_ooi_zd_ls9-CCD1 z expnum 90261 exptime 80.105 propid 2016A-0453 seeing 0.87 MJD 57527.430 object MzLS_638737_z mosaic/CP/V4.3/CP20160518/k4m_160519_101923_ooi_zd_ls9.fits.fz k4m_170901_060303_ooi_zd_ls9-CCD4 z expnum 137619 exptime 103.103 propid 2016A-0453 seeing 0.86 MJD 57997.252 object MzLS_637030_z mosaic/CP/V4.3/CP20170831/k4m_170901_060303_ooi_zd_ls9.fits.fz k4m_160518_102334_ooi_zd_ls9-CCD2 z expnum 90012 exptime 80.103 propid 2016A-0453 seeing 1.04 MJD 57526.433 object MzLS_636173_z mosaic/CP/V4.3/CP20160517/k4m_160518_102334_ooi_zd_ls9.fits.fz k4m_160513_104112_ooi_zd_ls9-CCD3 z expnum 88835 exptime 80.103 propid 2016A-0453 seeing 0.96 MJD 57521.445 object MzLS_637886_z mosaic/CP/V4.3/CP20160512/k4m_160513_104112_ooi_zd_ls9.fits.fz k4m_160519_101923_ooi_zd_ls9-CCD3 z expnum 90261 exptime 80.105 propid 2016A-0453 seeing 0.86 MJD 57527.430 object MzLS_638737_z mosaic/CP/V4.3/CP20160518/k4m_160519_101923_ooi_zd_ls9.fits.fz k4m_170806_094544_ooi_zd_ls9-CCD2 z expnum 3135993 exptime 183.105 propid 2016A-0453 seeing 1.34 MJD 57971.407 object MzLS_637031_z mosaic/CP/V4.3/CP20170805/k4m_170806_094544_ooi_zd_ls9.fits.fz ksb_170604_110258_ooi_g_ls9-CCD1 g expnum 79080202 exptime 190.949 propid BASS seeing 1.42 MJD 57908.460 object 23681 90prime/CP/V2.3/CP20170603/ksb_170604_110258_ooi_g_ls9.fits.fz ksb_160611_103210_ooi_r_ls9-CCD1 r expnum 75500174 exptime 63.1 propid BASS seeing 1.08 MJD 57550.439 object 23681 90prime/CP/V2.3/CP20160610/ksb_160611_103210_ooi_r_ls9.fits.fz ksb_170624_102757_ooi_r_ls9-CCD3 r expnum 79280166 exptime 91.7 propid BASS seeing 1.68 MJD 57928.436 object 23693 90prime/CP/V2.3/CP20170623/ksb_170624_102757_ooi_r_ls9.fits.fz ksb_170621_072622_ooi_g_ls9-CCD3 g expnum 79250043 exptime 133.2 propid BASS seeing 1.34 MJD 57925.310 object 23693 90prime/CP/V2.3/CP20170620/ksb_170621_072622_ooi_g_ls9.fits.fz ksb_160704_090503_ooi_g_ls9-CCD2 g expnum 75730149 exptime 94.9 propid BASS seeing 1.26 MJD 57573.379 object 23682 90prime/CP/V2.3/CP20160703/ksb_160704_090503_ooi_g_ls9.fits.fz ksb_160605_101307_ooi_r_ls9-CCD2 r expnum 75440176 exptime 55.8 propid BASS seeing 1.04 MJD 57544.426 object 23682 90prime/CP/V2.3/CP20160604/ksb_160605_101307_ooi_r_ls9.fits.fz mosaic get_fwhm: self.fwhm = 3.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 200 570 and amp range 0 2005 and image y 7 137 and amp range 0 2039 Range in image: x 0 371 , y 0 131 (with image size 371 x 131) dzp -0.005856539 -> scaling image by 0.9946204500110131 mosaic get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2916 3279 and amp range 2006 4053 and image y 88 451 and amp range 0 2039 Range in image: x 0 364 , y 0 364 (with image size 364 x 364) dzp -0.00064781494 -> scaling image by 0.9994035183523652 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75440176 Faked up EXPNUM 75440176 Faked up EXPNUM 75440176 90prime get_fwhm: self.fwhm = 2.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 605 816 and amp range 0 2015 and image y 3088 3299 and amp range 2048 4095 Range in image: x 0 212 , y 0 212 (with image size 212 x 212) dzp 0.016961161 -> scaling image by 1.0157444649385616 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.01 Found 4 relevant rows in amp-corrections file. Found overlap: image x 4049 4095 and amp range 2048 4095 and image y 2623 2989 and amp range 2040 4078 Range in image: x 0 47 , y 0 367 (with image size 47 x 367) dzp -0.009154885 -> scaling image by 0.9916034885139223 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 5.17 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1308 1675 and amp range 0 2047 and image y 7 125 and amp range 0 2039 Range in image: x 0 368 , y 0 119 (with image size 368 x 119) dzp 0.007023884 -> scaling image by 1.0064902069278665 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75500174 Faked up EXPNUM 75500174 Faked up EXPNUM 75500174 90prime get_fwhm: self.fwhm = 2.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2769 2982 and amp range 2016 4031 and image y 1113 1326 and amp range 0 2047 Range in image: x 0 214 , y 0 214 (with image size 214 x 214) dzp -0.0041296566 -> scaling image by 0.9962036700684744 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 79080202 Faked up EXPNUM 79080202 Faked up EXPNUM 79080202 90prime get_fwhm: self.fwhm = 3.13 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2775 2987 and amp range 2016 4031 and image y 1112 1324 and amp range 0 2047 Range in image: x 0 213 , y 0 213 (with image size 213 x 213) dzp -0.011406615 -> scaling image by 0.9895491130016149 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75730149 Faked up EXPNUM 75730149 Faked up EXPNUM 75730149 90prime get_fwhm: self.fwhm = 2.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 616 826 and amp range 0 2015 and image y 3078 3289 and amp range 2048 4095 Range in image: x 0 211 , y 0 212 (with image size 211 x 212) dzp 0.01693853 -> scaling image by 1.015723292931903 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 79250043 Faked up EXPNUM 79250043 Faked up EXPNUM 79250043 90prime get_fwhm: self.fwhm = 2.95 Found 4 relevant rows in amp-corrections file. Found overlap: image x 843 1054 and amp range 0 2015 and image y 2663 2874 and amp range 2048 4095 Range in image: x 0 212 , y 0 212 (with image size 212 x 212) dzp -0.045992933 -> scaling image by 0.958523636456738 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 79280166 Faked up EXPNUM 79280166 Faked up EXPNUM 79280166 90prime get_fwhm: self.fwhm = 3.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 841 1053 and amp range 0 2015 and image y 2661 2872 and amp range 2048 4095 Range in image: x 0 213 , y 0 212 (with image size 213 x 212) dzp -0.07725406 -> scaling image by 0.9313188157188347 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1352 1724 and amp range 0 2047 and image y 3420 3791 and amp range 2022 4060 Range in image: x 0 373 , y 0 372 (with image size 373 x 372) dzp -0.016192675 -> scaling image by 0.9851966584456431 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 20.59 s, CPU: 0.91 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 179 MB, VmData: 211 MB, maxrss: 0.183448 MB Stage tims finished: 2020-08-05T22:14:36.761858 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] mosaic get_fwhm: self.fwhm = 3.35 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 6.729 s worker CPU, 51.385 s worker Wall, Wall: 20.594 s, Cores in use: 0.37, Total efficiency (on 16 cores): 2.3 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/PGC2293204-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/PGC2293204-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T22:14:45.178232 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01713.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01598.fits Matched 3 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/metrics/cus/reference-custom-277725p47149.fits Stage refs : Wall: 13.13 s, CPU: 5.63 s, VmPeak: 1027 MB, VmSize: 1021 MB, VmRSS: 245 MB, VmData: 275 MB, maxrss: 0.2511 MB Stage refs finished: 2020-08-05T22:14:58.313079 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 13.137 s, Cores in use: 0.43, Total efficiency (on 16 cores): 2.7 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/PGC2293204-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/PGC2293204-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T22:14:58.527866 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/metrics/cus/outlier-mask-custom-277725p47149.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/metrics/cus/outliers-pre-custom-277725p47149.jpg Image ksb_160704_090503_ooi_g_ls9-CCD2 g : masking 1613 positive outlier pixels and 0 negative outlier pixels Image ksb_160611_103210_ooi_r_ls9-CCD1 r : masking 85 positive outlier pixels and 0 negative outlier pixels Image ksb_170624_102757_ooi_r_ls9-CCD3 r : masking 82 positive outlier pixels and 0 negative outlier pixels Image ksb_160605_101307_ooi_r_ls9-CCD2 r : masking 413 positive outlier pixels and 0 negative outlier pixels Image k4m_160518_102334_ooi_zd_ls9-CCD2 z : masking 406 positive outlier pixels and 0 negative outlier pixels Image k4m_160519_101923_ooi_zd_ls9-CCD3 z : masking 913 positive outlier pixels and 0 negative outlier pixels Image k4m_170806_094544_ooi_zd_ls9-CCD2 z : masking 0 positive outlier pixels and 335 negative outlier pixels Image k4m_170901_060303_ooi_zd_ls9-CCD4 z : masking 2078 positive outlier pixels and 330 negative outlier pixels Image k4m_160513_104112_ooi_zd_ls9-CCD3 z : masking 422 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/metrics/cus/outlier-mask-custom-277725p47149.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/metrics/cus/outliers-post-custom-277725p47149.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/metrics/cus/outliers-masked-pos-custom-277725p47149.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/metrics/cus/outliers-masked-neg-custom-277725p47149.jpg Stage outliers : Wall: 1.11 s, CPU: 0.76 s, VmPeak: 1031 MB, VmSize: 1031 MB, VmRSS: 270 MB, VmData: 297 MB, maxrss: 0.276232 MB Stage outliers finished: 2020-08-05T22:14:59.640428 Resources for stage outliers : 1.464 s worker CPU, 1.609 s worker Wall, Wall: 1.114 s, Cores in use: 2.00, Total efficiency (on 16 cores): 12.5 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/PGC2293204-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/PGC2293204-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T22:14:59.814158 Stage halos : Wall: 0.26 s, CPU: 0.25 s, VmPeak: 1031 MB, VmSize: 1031 MB, VmRSS: 270 MB, VmData: 297 MB, maxrss: 0.276532 MB Stage halos finished: 2020-08-05T22:15:00.071117 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.258 s, Cores in use: 0.96, Total efficiency (on 16 cores): 6.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/PGC2293204-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/PGC2293204-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T22:15:00.196907 PSF sigmas in coadd pixels: ['2.30', '2.17', '2.04'] Using average PSF sigma 2.170200179916695 Gaussian PSF norm 0.12998560887812047 vs pixelized 0.104740955 average tim pixel scale / coadd scale: 1.7288183164249622 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.76', '2.73', '1.68'] Using average PSF sigma 2.057539452937632 Gaussian PSF norm 0.13710298063598247 vs pixelized 0.12102036 average tim pixel scale / coadd scale: 1.728919624414949 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.40', '1.69', '1.56', '1.40', '2.18'] Using average PSF sigma 1.647095145085403 Gaussian PSF norm 0.17126806099549965 vs pixelized 0.14151707 average tim pixel scale / coadd scale: 0.9909418646160882 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.26 s, CPU: 0.23 s, VmPeak: 1031 MB, VmSize: 1031 MB, VmRSS: 272 MB, VmData: 297 MB, maxrss: 0.278136 MB Stage fit_on_coadds finished: 2020-08-05T22:15:00.461759 Resources for stage fit_on_coadds : 0.384 s worker CPU, 0.384 s worker Wall, Wall: 0.267 s, Cores in use: 2.31, Total efficiency (on 16 cores): 14.4 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/PGC2293204-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/PGC2293204-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T22:15:00.474896 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 88 potential peaks Of 88 potential peaks: 48 in veto map, 6 cut by saddle test, 0 cut by aper test, 34 kept SED z : 34 new peaks Found 147 potential peaks Of 147 potential peaks: 133 in veto map, 8 cut by saddle test, 0 cut by aper test, 6 kept SED r : 6 new peaks Found 124 potential peaks Of 124 potential peaks: 109 in veto map, 13 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 161 potential peaks Of 161 potential peaks: 144 in veto map, 13 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 152 potential peaks Of 152 potential peaks: 140 in veto map, 10 cut by saddle test, 1 cut by aper test, 1 kept SED Red : 1 new peaks Adding 47 new sources Median coadd sky for g : 0.00064861705 Median coadd sky for r : 0.0014010842 Median coadd sky for z : 0.00013696481 Stage srcs : Wall: 0.92 s, CPU: 0.86 s, VmPeak: 1031 MB, VmSize: 1031 MB, VmRSS: 272 MB, VmData: 297 MB, maxrss: 0.278636 MB Stage srcs finished: 2020-08-05T22:15:01.392573 Resources for stage srcs : 0.160 s worker CPU, 0.160 s worker Wall, Wall: 0.919 s, Cores in use: 1.11, Total efficiency (on 16 cores): 6.9 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/PGC2293204-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/PGC2293204-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T22:15:01.571259 Blob 1 of 23, id: 7, sources: 30, size: 297x293, npix 51778, brick X: 33,330, Y: 50,343, one pixel: 184 50 Blob 2 of 23, id: 16, sources: 3, size: 87x63, npix 2703, brick X: 93,180, Y: 294,357, one pixel: 152 294 Blob 3 of 23, id: 5, sources: 2, size: 55x46, npix 1496, brick X: 122,177, Y: 25,71, one pixel: 141 25 Blob 4 of 23, id: 2, sources: 4, size: 70x26, npix 1147, brick X: 157,227, Y: 0,26, one pixel: 162 0 Blob 5 of 23, id: 15, sources: 2, size: 36x52, npix 1133, brick X: 0,36, Y: 270,322, one pixel: 5 270 Blob 6 of 23, id: 8, sources: 2, size: 32x53, npix 1059, brick X: 82,114, Y: 75,128, one pixel: 96 75 Blob 7 of 23, id: 13, sources: 3, size: 29x51, npix 931, brick X: 332,361, Y: 197,248, one pixel: 348 197 Blob 8 of 23, id: 10, sources: 1, size: 28x29, npix 521, brick X: 332,360, Y: 109,138, one pixel: 343 109 Blob 9 of 23, id: 20, sources: 2, size: 21x29, npix 469, brick X: 0,21, Y: 332,361, one pixel: 4 332 Blob 10 of 23, id: 11, sources: 1, size: 26x26, npix 465, brick X: 30,56, Y: 120,146, one pixel: 39 120 Blob 11 of 23, id: 3, sources: 1, size: 27x26, npix 453, brick X: 333,360, Y: 0,26, one pixel: 344 0 Blob 12 of 23, id: 12, sources: 1, size: 26x24, npix 373, brick X: 4,30, Y: 166,190, one pixel: 19 166 Blob 13 of 23, id: 6, sources: 1, size: 25x24, npix 367, brick X: 243,268, Y: 37,61, one pixel: 253 37 Blob 14 of 23, id: 4, sources: 1, size: 24x24, npix 364, brick X: 302,326, Y: 3,27, one pixel: 311 3 Blob 15 of 23, id: 9, sources: 1, size: 20x27, npix 357, brick X: 0,20, Y: 99,126, one pixel: 6 99 Blob 16 of 23, id: 17, sources: 1, size: 24x24, npix 352, brick X: 41,65, Y: 301,325, one pixel: 51 301 Blob 17 of 23, id: 19, sources: 1, size: 24x23, npix 339, brick X: 219,243, Y: 327,350, one pixel: 231 327 Blob 16 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 792 MB, VmSize: 719 MB, VmRSS: 135 MB, VmData: 171 MB, maxrss: 0.13856 MB Blob 18 of 23, id: 18, sources: 1, size: 19x25, npix 320, brick X: 342,361, Y: 319,344, one pixel: 352 319 Blob 19 of 23, id: 0, sources: 1, size: 20x18, npix 268, brick X: 0,20, Y: 0,18, one pixel: 1 0 Blob 12 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 805 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151856 MB Blob 20 of 23, id: 1, sources: 1, size: 24x15, npix 268, brick X: 111,135, Y: 0,15, one pixel: 112 0 Blob 10 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 806 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151048 MB Blob 21 of 23, id: 21, sources: 1, size: 22x19, npix 264, brick X: 262,284, Y: 342,361, one pixel: 272 342 Blob 15 finished, total: Wall: 0.65 s, CPU: 0.57 s, VmPeak: 807 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151524 MB Blob 22 of 23, id: 22, sources: 1, size: 22x15, npix 215, brick X: 108,130, Y: 346,361, one pixel: 117 346 Blob 8 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 790 MB, VmSize: 719 MB, VmRSS: 135 MB, VmData: 170 MB, maxrss: 0.138428 MB Blob 23 of 23, id: 14, sources: 1, size: 19x19, npix 199, brick X: 315,334, Y: 230,249, one pixel: 323 230 Blob 11 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 809 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.15168 MB Blob 13 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.09404 MB Blob 14 finished, total: Wall: 0.81 s, CPU: 0.72 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095224 MB Blob 17 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 792 MB, VmSize: 719 MB, VmRSS: 135 MB, VmData: 171 MB, maxrss: 0.13856 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.74918, 47.16357), pm (-3.1, -7.1), parallax 0.363 with NanoMaggies: g=20.2, r=19.5, z=19.2 Reset brightness to NanoMaggies: g=20.2, r=19.5, z=19.2 Blob 9 finished, total: Wall: 0.87 s, CPU: 0.87 s, VmPeak: 810 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151732 MB Blob 23 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.094112 MB Blob 18 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 805 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151856 MB Blob 3 finished, total: Wall: 1.01 s, CPU: 1.01 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095556 MB Blob 21 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 790 MB, VmSize: 719 MB, VmRSS: 136 MB, VmData: 171 MB, maxrss: 0.138756 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.72326, 47.13425), pm (-4.8, -19.8), parallax 1.584 with NanoMaggies: g=13.8, r=13.4, z=15.2 Reset brightness to NanoMaggies: g=13.8, r=13.4, z=13.2 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.72293, 47.13189), pm (-8.9, -12.1), parallax 0.957 with NanoMaggies: g=15, r=14.5, z=14.4 Reset brightness to NanoMaggies: g=15, r=14.5, z=14.4 Blob 4 finished, total: Wall: 1.13 s, CPU: 1.13 s, VmPeak: 811 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151892 MB Blob 19 finished, total: Wall: 0.48 s, CPU: 0.48 s, VmPeak: 806 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151048 MB Blob 22 finished, total: Wall: 0.47 s, CPU: 0.47 s, VmPeak: 809 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.15168 MB Blob 20 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 807 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151524 MB Blob 5 finished, total: Wall: 1.64 s, CPU: 1.60 s, VmPeak: 790 MB, VmSize: 706 MB, VmRSS: 125 MB, VmData: 164 MB, maxrss: 0.128048 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.70220, 47.15151), pm (-3.5, 0.0), parallax 0.572 with NanoMaggies: g=19.5, r=18.3, z=17.7 Reset brightness to NanoMaggies: g=19.5, r=18.3, z=17.7 Measuring 1 iterative sources Blob 7 finished, total: Wall: 1.71 s, CPU: 1.71 s, VmPeak: 808 MB, VmSize: 732 MB, VmRSS: 150 MB, VmData: 184 MB, maxrss: 0.153368 MB Measuring 1 iterative sources Blob 6 finished, total: Wall: 2.09 s, CPU: 2.09 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 96 MB, VmData: 140 MB, maxrss: 0.09788 MB Blob 2 finished, total: Wall: 2.56 s, CPU: 2.56 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 150 MB, VmData: 184 MB, maxrss: 0.153348 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.36467, ee1=-0.0354437, ee2=0.0271691 Measuring 16 iterative sources Blob 1 finished, total: Wall: 31.45 s, CPU: 31.44 s, VmPeak: 810 MB, VmSize: 776 MB, VmRSS: 202 MB, VmData: 228 MB, maxrss: 0.207256 MB Old catalog: 68 New catalog: 76 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/metrics/cus/blobs-custom-277725p47149.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/metrics/cus/all-models-custom-277725p47149.fits Stage fitblobs : Wall: 31.97 s, CPU: 0.51 s, VmPeak: 1031 MB, VmSize: 1031 MB, VmRSS: 273 MB, VmData: 297 MB, maxrss: 0.279232 MB Stage fitblobs finished: 2020-08-05T22:15:33.538905 Resources for stage fitblobs : 50.697 s worker CPU, 51.005 s worker Wall, Wall: 31.969 s, Cores in use: 1.60, Total efficiency (on 16 cores): 10.0 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/PGC2293204-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/PGC2293204-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T22:15:33.556429 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/tmp-legacysurvey-custom-277725p47149-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/tmp-legacysurvey-custom-277725p47149-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/tmp-legacysurvey-custom-277725p47149-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/tmp-legacysurvey-custom-277725p47149-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-resid.jpg Stage coadds : Wall: 2.89 s, CPU: 0.87 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 273 MB, VmData: 299 MB, maxrss: 0.279684 MB Stage coadds finished: 2020-08-05T22:15:36.449756 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 8.921 s worker CPU, 12.321 s worker Wall, Wall: 2.895 s, Cores in use: 3.38, Total efficiency (on 16 cores): 21.1 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/PGC2293204-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/PGC2293204-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T22:15:36.587263 Cut to 1 unWISE tiles Reading WISE tile 2770p469 band 1 Reading WISE tile 2770p469 band 2 Reading WISE tile 2770p469 band 3 Reading WISE tile 2770p469 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.16 s, CPU: 0.44 s, VmPeak: 1015 MB, VmSize: 1015 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.194656 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.12 s, CPU: 0.29 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 150 MB, VmData: 187 MB, maxrss: 0.211196 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.12 s, CPU: 0.27 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 151 MB, VmData: 188 MB, maxrss: 0.212752 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.13 s, CPU: 0.33 s, VmPeak: 1008 MB, VmSize: 1008 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.208448 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/tmp-legacysurvey-custom-277725p47149-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/tmp-legacysurvey-custom-277725p47149-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 4.47 s, CPU: 0.54 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 274 MB, VmData: 299 MB, maxrss: 0.280208 MB Stage wise_forced finished: 2020-08-05T22:15:41.052555 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 4.248 s worker CPU, 11.510 s worker Wall, Wall: 4.467 s, Cores in use: 1.07, Total efficiency (on 16 cores): 6.7 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/PGC2293204-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/PGC2293204-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T22:15:41.071990 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/tractor-i/cus/tractor-custom-277725p47149.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/tractor/cus/tractor-custom-277725p47149.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/tractor/cus/brick-custom-277725p47149.sha256sum Stage writecat : Wall: 1.19 s, CPU: 0.71 s, VmPeak: 1165 MB, VmSize: 1037 MB, VmRSS: 275 MB, VmData: 299 MB, maxrss: 0.413088 MB Stage writecat finished: 2020-08-05T22:15:42.262191 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.192 s, Cores in use: 0.59, Total efficiency (on 16 cores): 3.7 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/PGC2293204-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/277/PGC2293204/PGC2293204-largegalaxy-writecat.p All done: 72.606 s worker CPU, 128.380 s worker Wall, Wall: 86.115 s, Cores in use: 0.98, Total efficiency (on 16 cores): 6.1 % Finished galaxy PGC2293204 in 1.467 minutes. Started working on galaxy PGC2293204 at Fri Aug 7 10:09:12 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.7253025436744 47.14958533987893 --width 361 --height 361 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/PGC2293204-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/PGC2293204-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T10:09:13.296636 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '277.7253025436744', '47.14958533987893', '--width', '361', '--height', '361', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/PGC2293204-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/PGC2293204-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.7253025436744 47.14958533987893 --width 361 --height 361 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/PGC2293204-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/PGC2293204-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 277.7253025436744 47.14958533987893 Starting process 62897 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 62898 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 62899 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 62900 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 62901 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 62902 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059492 MB Starting process 62903 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059492 MB Starting process 62904 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 62905 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 62906 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 62907 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 62908 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 62909 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 62910 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 62911 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 62912 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T10:09:13.836146 Keeping 12 CCDs: k4m_160519_101923_ooi_zd_ls9-CCD1 z expnum 90261 exptime 80.105 propid 2016A-0453 seeing 0.87 MJD 57527.430 object MzLS_638737_z mosaic/CP/V4.3/CP20160518/k4m_160519_101923_ooi_zd_ls9.fits.fz k4m_170901_060303_ooi_zd_ls9-CCD4 z expnum 137619 exptime 103.103 propid 2016A-0453 seeing 0.86 MJD 57997.252 object MzLS_637030_z mosaic/CP/V4.3/CP20170831/k4m_170901_060303_ooi_zd_ls9.fits.fz k4m_160518_102334_ooi_zd_ls9-CCD2 z expnum 90012 exptime 80.103 propid 2016A-0453 seeing 1.04 MJD 57526.433 object MzLS_636173_z mosaic/CP/V4.3/CP20160517/k4m_160518_102334_ooi_zd_ls9.fits.fz k4m_160513_104112_ooi_zd_ls9-CCD3 z expnum 88835 exptime 80.103 propid 2016A-0453 seeing 0.96 MJD 57521.445 object MzLS_637886_z mosaic/CP/V4.3/CP20160512/k4m_160513_104112_ooi_zd_ls9.fits.fz k4m_160519_101923_ooi_zd_ls9-CCD3 z expnum 90261 exptime 80.105 propid 2016A-0453 seeing 0.86 MJD 57527.430 object MzLS_638737_z mosaic/CP/V4.3/CP20160518/k4m_160519_101923_ooi_zd_ls9.fits.fz k4m_170806_094544_ooi_zd_ls9-CCD2 z expnum 3135993 exptime 183.105 propid 2016A-0453 seeing 1.34 MJD 57971.407 object MzLS_637031_z mosaic/CP/V4.3/CP20170805/k4m_170806_094544_ooi_zd_ls9.fits.fz ksb_170604_110258_ooi_g_ls9-CCD1 g expnum 79080202 exptime 190.949 propid BASS seeing 1.42 MJD 57908.460 object 23681 90prime/CP/V2.3/CP20170603/ksb_170604_110258_ooi_g_ls9.fits.fz ksb_160611_103210_ooi_r_ls9-CCD1 r expnum 75500174 exptime 63.1 propid BASS seeing 1.08 MJD 57550.439 object 23681 90prime/CP/V2.3/CP20160610/ksb_160611_103210_ooi_r_ls9.fits.fz ksb_170624_102757_ooi_r_ls9-CCD3 r expnum 79280166 exptime 91.7 propid BASS seeing 1.68 MJD 57928.436 object 23693 90prime/CP/V2.3/CP20170623/ksb_170624_102757_ooi_r_ls9.fits.fz ksb_170621_072622_ooi_g_ls9-CCD3 g expnum 79250043 exptime 133.2 propid BASS seeing 1.34 MJD 57925.310 object 23693 90prime/CP/V2.3/CP20170620/ksb_170621_072622_ooi_g_ls9.fits.fz ksb_160704_090503_ooi_g_ls9-CCD2 g expnum 75730149 exptime 94.9 propid BASS seeing 1.26 MJD 57573.379 object 23682 90prime/CP/V2.3/CP20160703/ksb_160704_090503_ooi_g_ls9.fits.fz ksb_160605_101307_ooi_r_ls9-CCD2 r expnum 75440176 exptime 55.8 propid BASS seeing 1.04 MJD 57544.426 object 23682 90prime/CP/V2.3/CP20160604/ksb_160605_101307_ooi_r_ls9.fits.fz Faked up EXPNUM 79080202 Faked up EXPNUM 79080202 Faked up EXPNUM 79080202 90prime get_fwhm: self.fwhm = 3.13 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2773 2986 and amp range 2016 4031 and image y 1115 1328 and amp range 0 2047 Range in image: x 0 214 , y 0 214 (with image size 214 x 214) dzp -0.011406615 -> scaling image by 0.9895491130016149 Faked up EXPNUM 75440176 Faked up EXPNUM 75440176 Faked up EXPNUM 75440176 90prime get_fwhm: self.fwhm = 2.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 604 814 and amp range 0 2015 and image y 3092 3303 and amp range 2048 4095 Range in image: x 0 211 , y 0 212 (with image size 211 x 212) dzp 0.016961161 -> scaling image by 1.0157444649385616 mosaic get_fwhm: self.fwhm = 3.35 Found 4 relevant rows in amp-corrections file. mosaic get_fwhm: self.fwhm = 3.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 203 573 and amp range 0 2005 and image y 7 131 and amp range 0 2039 Range in image: x 0 371 , y 0 125 (with image size 371 x 125) Found overlap: image x 196 566 and amp range 0 2005 and image y 4058 4072 and amp range 2040 4078 dzp -0.005856539 -> scaling image by 0.9946204500110131 Range in image: x 0 371 , y 0 15 (with image size 371 x 15) dzp -0.005990375 -> scaling image by 0.994497853444703 Faked up EXPNUM 75730149 Faked up EXPNUM 75730149 Faked up EXPNUM 75730149 90prime get_fwhm: self.fwhm = 2.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 614 825 and amp range 0 2015 and image y 3082 3293 and amp range 2048 4095 Range in image: x 0 212 , y 0 212 (with image size 212 x 212) dzp 0.01693853 -> scaling image by 1.015723292931903 mosaic get_fwhm: self.fwhm = 4.01 Found 4 relevant rows in amp-corrections file. Found overlap: image x 4052 4095 and amp range 2048 4095 and image y 2616 2983 and amp range 2040 4078 Range in image: x 0 44 , y 0 368 (with image size 44 x 368) dzp -0.009154885 -> scaling image by 0.9916034885139223 mosaic get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2918 3281 and amp range 2006 4053 and image y 81 444 and amp range 0 2039 Range in image: x 0 364 , y 0 364 (with image size 364 x 364) dzp -0.00064781494 -> scaling image by 0.9994035183523652 Faked up EXPNUM 79280166 Faked up EXPNUM 79280166 Faked up EXPNUM 79280166 90prime get_fwhm: self.fwhm = 3.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 840 1051 and amp range 0 2015 and image y 2665 2876 and amp range 2048 4095 Range in image: x 0 212 , y 0 212 (with image size 212 x 212) dzp -0.07725406 -> scaling image by 0.9313188157188347 Faked up EXPNUM 79250043 Faked up EXPNUM 79250043 Faked up EXPNUM 79250043 90prime get_fwhm: self.fwhm = 2.95 Found 4 relevant rows in amp-corrections file. Found overlap: image x 841 1053 and amp range 0 2015 and image y 2667 2878 and amp range 2048 4095 Range in image: x 0 213 , y 0 212 (with image size 213 x 212) dzp -0.045992933 -> scaling image by 0.958523636456738 mosaic get_fwhm: self.fwhm = 5.17 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1311 1678 and amp range 0 2047 and image y 7 118 and amp range 0 2039 Range in image: x 0 368 , y 0 112 (with image size 368 x 112) dzp 0.007023884 -> scaling image by 1.0064902069278665 Faked up EXPNUM 75500174 Faked up EXPNUM 75500174 Faked up EXPNUM 75500174 90prime get_fwhm: self.fwhm = 2.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2768 2980 and amp range 2016 4031 and image y 1117 1330 and amp range 0 2047 Range in image: x 0 213 , y 0 214 (with image size 213 x 214) dzp -0.0041296566 -> scaling image by 0.9962036700684744 mosaic get_fwhm: self.fwhm = 3.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1355 1726 and amp range 0 2047 and image y 3414 3785 and amp range 2022 4060 Range in image: x 0 372 , y 0 372 (with image size 372 x 372) dzp -0.016192675 -> scaling image by 0.9851966584456431 Stage tims : Wall: 72.45 s, CPU: 1.03 s, VmPeak: 952 MB, VmSize: 952 MB, VmRSS: 178 MB, VmData: 212 MB, maxrss: 0.182284 MB Stage tims finished: 2020-08-07T10:10:26.289056 Resources for stage tims : 6.395 s worker CPU, 130.562 s worker Wall, Wall: 72.455 s, Cores in use: 0.10, Total efficiency (on 16 cores): 0.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/PGC2293204-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/PGC2293204-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T10:10:27.300122 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01713.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01598.fits Matched 3 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/metrics/cus/reference-custom-277725p47149.fits Stage refs : Wall: 36.49 s, CPU: 5.76 s, VmPeak: 1021 MB, VmSize: 1015 MB, VmRSS: 244 MB, VmData: 275 MB, maxrss: 0.249404 MB Stage refs finished: 2020-08-07T10:11:03.789884 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 36.491 s, Cores in use: 0.16, Total efficiency (on 16 cores): 1.0 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/PGC2293204-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/PGC2293204-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T10:11:03.831794 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/metrics/cus/outlier-mask-custom-277725p47149.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/metrics/cus/outliers-pre-custom-277725p47149.jpg Image ksb_160704_090503_ooi_g_ls9-CCD2 g : masking 1615 positive outlier pixels and 0 negative outlier pixels Image ksb_160611_103210_ooi_r_ls9-CCD1 r : masking 81 positive outlier pixels and 0 negative outlier pixels Image ksb_170624_102757_ooi_r_ls9-CCD3 r : masking 83 positive outlier pixels and 0 negative outlier pixels Image ksb_160605_101307_ooi_r_ls9-CCD2 r : masking 414 positive outlier pixels and 0 negative outlier pixels Image k4m_160519_101923_ooi_zd_ls9-CCD3 z : masking 847 positive outlier pixels and 0 negative outlier pixels Image k4m_170806_094544_ooi_zd_ls9-CCD2 z : masking 0 positive outlier pixels and 303 negative outlier pixels Image k4m_160518_102334_ooi_zd_ls9-CCD2 z : masking 386 positive outlier pixels and 0 negative outlier pixels Image k4m_170901_060303_ooi_zd_ls9-CCD4 z : masking 2041 positive outlier pixels and 0 negative outlier pixels Image k4m_160513_104112_ooi_zd_ls9-CCD3 z : masking 315 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/metrics/cus/outlier-mask-custom-277725p47149.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/metrics/cus/outliers-post-custom-277725p47149.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/metrics/cus/outliers-masked-pos-custom-277725p47149.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/metrics/cus/outliers-masked-neg-custom-277725p47149.jpg Stage outliers : Wall: 1.27 s, CPU: 0.85 s, VmPeak: 1025 MB, VmSize: 1025 MB, VmRSS: 266 MB, VmData: 295 MB, maxrss: 0.272676 MB Stage outliers finished: 2020-08-07T10:11:05.102398 Resources for stage outliers : 1.613 s worker CPU, 1.693 s worker Wall, Wall: 1.272 s, Cores in use: 1.94, Total efficiency (on 16 cores): 12.1 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/PGC2293204-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/PGC2293204-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T10:11:05.235584 Stage halos : Wall: 0.44 s, CPU: 0.41 s, VmPeak: 1025 MB, VmSize: 1025 MB, VmRSS: 267 MB, VmData: 295 MB, maxrss: 0.273032 MB Stage halos finished: 2020-08-07T10:11:05.674719 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.441 s, Cores in use: 0.93, Total efficiency (on 16 cores): 5.8 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/PGC2293204-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/PGC2293204-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T10:11:05.910239 PSF sigmas in coadd pixels: ['2.30', '2.17', '2.04'] Using average PSF sigma 2.170200179916695 Gaussian PSF norm 0.12998560887812047 vs pixelized 0.10473712 average tim pixel scale / coadd scale: 1.7288183164249622 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.76', '2.73', '1.68'] Using average PSF sigma 2.057539452937632 Gaussian PSF norm 0.13710298063598247 vs pixelized 0.121000506 average tim pixel scale / coadd scale: 1.728919624414949 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.41', '1.40', '1.69', '1.56', '1.40', '2.18'] Using average PSF sigma 1.6080174478710914 Gaussian PSF norm 0.1754301809021743 vs pixelized 0.14493763 average tim pixel scale / coadd scale: 0.9909430043309756 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.26 s, CPU: 0.24 s, VmPeak: 1025 MB, VmSize: 1025 MB, VmRSS: 270 MB, VmData: 297 MB, maxrss: 0.276364 MB Stage fit_on_coadds finished: 2020-08-07T10:11:06.168347 Resources for stage fit_on_coadds : 0.363 s worker CPU, 0.363 s worker Wall, Wall: 0.260 s, Cores in use: 2.34, Total efficiency (on 16 cores): 14.6 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/PGC2293204-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/PGC2293204-largegalaxy-fit_on_coadds.p Running stage srcs Warning: Stellar halo subtraction is only implemented for DECam Running stage srcs at 2020-08-07T10:11:06.237943 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 91 potential peaks Of 91 potential peaks: 51 in veto map, 6 cut by saddle test, 0 cut by aper test, 34 kept SED z : 34 new peaks Found 147 potential peaks Of 147 potential peaks: 135 in veto map, 7 cut by saddle test, 1 cut by aper test, 4 kept SED r : 4 new peaks Found 116 potential peaks Of 116 potential peaks: 101 in veto map, 13 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 162 potential peaks Of 162 potential peaks: 143 in veto map, 14 cut by saddle test, 0 cut by aper test, 5 kept SED Flat : 5 new peaks Found 160 potential peaks Of 160 potential peaks: 148 in veto map, 10 cut by saddle test, 1 cut by aper test, 1 kept SED Red : 1 new peaks Adding 46 new sources Median coadd sky for g : 0.00064591714 Median coadd sky for r : 0.0013831405 Median coadd sky for z : 0.000103530256 Stage srcs : Wall: 1.10 s, CPU: 0.98 s, VmPeak: 1025 MB, VmSize: 1025 MB, VmRSS: 270 MB, VmData: 297 MB, maxrss: 0.276924 MB Stage srcs finished: 2020-08-07T10:11:07.339711 Resources for stage srcs : 0.152 s worker CPU, 0.152 s worker Wall, Wall: 1.103 s, Cores in use: 1.02, Total efficiency (on 16 cores): 6.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/PGC2293204-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/PGC2293204-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T10:11:07.405935 Blob 1 of 22, id: 6, sources: 30, size: 298x294, npix 51747, brick X: 26,324, Y: 47,341, one pixel: 180 47 Blob 2 of 22, id: 14, sources: 3, size: 87x62, npix 2685, brick X: 87,174, Y: 292,354, one pixel: 145 292 Blob 3 of 22, id: 4, sources: 2, size: 55x45, npix 1492, brick X: 116,171, Y: 23,68, one pixel: 134 23 Blob 4 of 22, id: 11, sources: 2, size: 36x52, npix 1195, brick X: 325,361, Y: 194,246, one pixel: 344 194 Blob 5 of 22, id: 7, sources: 2, size: 32x53, npix 1055, brick X: 75,107, Y: 72,125, one pixel: 91 72 Blob 6 of 22, id: 13, sources: 3, size: 30x49, npix 885, brick X: 0,30, Y: 270,319, one pixel: 1 270 Blob 7 of 22, id: 1, sources: 3, size: 42x23, npix 659, brick X: 178,220, Y: 0,23, one pixel: 184 0 Blob 8 of 22, id: 8, sources: 1, size: 29x28, npix 516, brick X: 325,354, Y: 107,135, one pixel: 336 107 Blob 9 of 22, id: 9, sources: 1, size: 27x27, npix 470, brick X: 23,50, Y: 117,144, one pixel: 34 117 Blob 10 of 22, id: 3, sources: 1, size: 26x23, npix 423, brick X: 327,353, Y: 0,23, one pixel: 335 0 Blob 11 of 22, id: 16, sources: 1, size: 25x25, npix 412, brick X: 336,361, Y: 316,341, one pixel: 346 316 Blob 12 of 22, id: 2, sources: 1, size: 25x24, npix 366, brick X: 295,320, Y: 0,24, one pixel: 306 0 Blob 13 of 22, id: 5, sources: 1, size: 24x24, npix 365, brick X: 237,261, Y: 34,58, one pixel: 248 34 Blob 14 of 22, id: 15, sources: 1, size: 24x25, npix 354, brick X: 34,58, Y: 298,323, one pixel: 46 298 Blob 15 of 22, id: 10, sources: 1, size: 24x24, npix 347, brick X: 0,24, Y: 163,187, one pixel: 13 163 Blob 16 of 22, id: 17, sources: 1, size: 24x23, npix 341, brick X: 213,237, Y: 325,348, one pixel: 223 325 Blob 17 of 22, id: 19, sources: 1, size: 25x18, npix 303, brick X: 100,125, Y: 343,361, one pixel: 111 343 Blob 18 of 22, id: 18, sources: 1, size: 22x21, npix 296, brick X: 255,277, Y: 340,361, one pixel: 265 340 Blob 14 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148292 MB Blob 19 of 22, id: 20, sources: 1, size: 21x16, npix 211, brick X: 58,79, Y: 345,361, one pixel: 68 345 Blob 15 finished, total: Wall: 0.25 s, CPU: 0.24 s, VmPeak: 792 MB, VmSize: 712 MB, VmRSS: 130 MB, VmData: 170 MB, maxrss: 0.133588 MB Blob 20 of 22, id: 12, sources: 1, size: 20x20, npix 209, brick X: 308,328, Y: 227,247, one pixel: 317 227 Blob 18 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 792 MB, VmSize: 712 MB, VmRSS: 131 MB, VmData: 170 MB, maxrss: 0.134564 MB Blob 21 of 22, id: 0, sources: 1, size: 21x12, npix 160, brick X: 106,127, Y: 0,12, one pixel: 107 0 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.72293, 47.13189), pm (-8.9, -12.1), parallax 0.957 with NanoMaggies: g=15, r=14.5, z=14.4 Reset brightness to NanoMaggies: g=15, r=14.5, z=14.4 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.72326, 47.13425), pm (-4.8, -19.8), parallax 1.584 with NanoMaggies: g=13.8, r=13.4, z=(flux -7.29e+03) Reset brightness to NanoMaggies: g=13.8, r=13.4, z=13.2 Blob 7 finished, total: Wall: 0.54 s, CPU: 0.54 s, VmPeak: 789 MB, VmSize: 711 MB, VmRSS: 131 MB, VmData: 169 MB, maxrss: 0.133644 MB Blob 22 of 22, id: 21, sources: 3, size: 12x15, npix 133, brick X: 349,361, Y: 346,361, one pixel: 357 346 Blob 16 finished, total: Wall: 0.55 s, CPU: 0.54 s, VmPeak: 790 MB, VmSize: 712 MB, VmRSS: 131 MB, VmData: 170 MB, maxrss: 0.134068 MB Blob 20 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 789 MB, VmSize: 711 MB, VmRSS: 132 MB, VmData: 169 MB, maxrss: 0.134872 MB Blob 9 finished, total: Wall: 0.67 s, CPU: 0.65 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093692 MB Blob 8 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147764 MB Blob 21 finished, total: Wall: 0.11 s, CPU: 0.11 s, VmPeak: 790 MB, VmSize: 712 MB, VmRSS: 131 MB, VmData: 170 MB, maxrss: 0.134068 MB Blob 11 finished, total: Wall: 0.70 s, CPU: 0.67 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.147984 MB Blob 13 finished, total: Wall: 0.69 s, CPU: 0.68 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.1476 MB Blob 12 finished, total: Wall: 0.71 s, CPU: 0.69 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.09634 MB Blob 10 finished, total: Wall: 0.75 s, CPU: 0.74 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147924 MB Blob 17 finished, total: Wall: 0.63 s, CPU: 0.63 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148292 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.70571, 47.16244), pm (7.7, -5.5), parallax 1.015 with NanoMaggies: g=21.9, r=20.3, z=18.5 Reset brightness to NanoMaggies: g=21.3, r=19.9, z=19.1 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.70458, 47.16250), pm (-4.1, -2.8), parallax -0.494 with NanoMaggies: g=19.3, r=18, z=(flux -378) Reset brightness to NanoMaggies: g=21.3, r=20.6, z=20.3 Blob 22 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 789 MB, VmSize: 711 MB, VmRSS: 132 MB, VmData: 169 MB, maxrss: 0.134872 MB Measuring 1 iterative sources Blob 19 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 792 MB, VmSize: 712 MB, VmRSS: 131 MB, VmData: 170 MB, maxrss: 0.134564 MB Blob 6 finished, total: Wall: 1.57 s, CPU: 1.55 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148684 MB Measuring 1 iterative sources Measuring 1 iterative sources Blob 4 finished, total: Wall: 1.67 s, CPU: 1.62 s, VmPeak: 805 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148252 MB Blob 3 finished, total: Wall: 1.74 s, CPU: 1.69 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146568 MB Blob 5 finished, total: Wall: 1.98 s, CPU: 1.93 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 96 MB, VmData: 141 MB, maxrss: 0.098244 MB Blob 2 finished, total: Wall: 2.48 s, CPU: 2.45 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 98 MB, VmData: 142 MB, maxrss: 0.100004 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.987194, ee1=-0.0359299, ee2=0.0264685 Measuring 7 iterative sources Blob 1 finished, total: Wall: 30.33 s, CPU: 30.22 s, VmPeak: 790 MB, VmSize: 735 MB, VmRSS: 159 MB, VmData: 190 MB, maxrss: 0.196748 MB Old catalog: 66 New catalog: 62 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/metrics/cus/blobs-custom-277725p47149.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/metrics/cus/all-models-custom-277725p47149.fits Stage fitblobs : Wall: 30.99 s, CPU: 0.62 s, VmPeak: 1025 MB, VmSize: 1025 MB, VmRSS: 271 MB, VmData: 297 MB, maxrss: 0.277572 MB Stage fitblobs finished: 2020-08-07T10:11:38.397928 Resources for stage fitblobs : 47.416 s worker CPU, 47.939 s worker Wall, Wall: 30.993 s, Cores in use: 1.55, Total efficiency (on 16 cores): 9.7 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/PGC2293204-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/PGC2293204-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T10:11:38.492203 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/tmp-legacysurvey-custom-277725p47149-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/tmp-legacysurvey-custom-277725p47149-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/tmp-legacysurvey-custom-277725p47149-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/tmp-legacysurvey-custom-277725p47149-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-resid.jpg Stage coadds : Wall: 8.62 s, CPU: 0.80 s, VmPeak: 1026 MB, VmSize: 1026 MB, VmRSS: 272 MB, VmData: 298 MB, maxrss: 0.27884 MB Stage coadds finished: 2020-08-07T10:11:47.108562 Resources for stage coadds : 8.176 s worker CPU, 9.012 s worker Wall, Wall: 8.618 s, Cores in use: 1.04, Total efficiency (on 16 cores): 6.5 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/PGC2293204-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/PGC2293204-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T10:11:47.127621 Cut to 1 unWISE tiles Reading WISE tile 2770p469 band 1 Reading WISE tile 2770p469 band 2 Reading WISE tile 2770p469 band 3 Reading WISE tile 2770p469 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.12 s, CPU: 0.34 s, VmPeak: 1015 MB, VmSize: 1015 MB, VmRSS: 160 MB, VmData: 194 MB, maxrss: 0.207256 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.22 s, VmPeak: 1007 MB, VmSize: 1007 MB, VmRSS: 150 MB, VmData: 189 MB, maxrss: 0.212176 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.19 s, VmPeak: 1068 MB, VmSize: 1068 MB, VmRSS: 207 MB, VmData: 250 MB, maxrss: 0.2117 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p469/unwise-2770p469-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.25 s, VmPeak: 1071 MB, VmSize: 1007 MB, VmRSS: 150 MB, VmData: 189 MB, maxrss: 0.212112 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/tmp-legacysurvey-custom-277725p47149-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/tmp-legacysurvey-custom-277725p47149-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 15.47 s, CPU: 0.73 s, VmPeak: 1026 MB, VmSize: 1026 MB, VmRSS: 273 MB, VmData: 298 MB, maxrss: 0.27936 MB Stage wise_forced finished: 2020-08-07T10:12:02.596339 Resources for stage wise_forced : 3.851 s worker CPU, 18.813 s worker Wall, Wall: 15.470 s, Cores in use: 0.30, Total efficiency (on 16 cores): 1.9 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/PGC2293204-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/PGC2293204-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T10:12:02.614806 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/coadd/cus/custom-277725p47149/legacysurvey-custom-277725p47149-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/tractor-i/cus/tractor-custom-277725p47149.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/tractor/cus/tractor-custom-277725p47149.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/tractor/cus/brick-custom-277725p47149.sha256sum Stage writecat : Wall: 0.79 s, CPU: 0.67 s, VmPeak: 1158 MB, VmSize: 1030 MB, VmRSS: 275 MB, VmData: 298 MB, maxrss: 0.412244 MB Stage writecat finished: 2020-08-07T10:12:03.401449 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.788 s, Cores in use: 0.85, Total efficiency (on 16 cores): 5.3 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/PGC2293204-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2293204/PGC2293204-largegalaxy-writecat.p All done: 67.970 s worker CPU, 208.538 s worker Wall, Wall: 169.659 s, Cores in use: 0.47, Total efficiency (on 16 cores): 3.0 % Finished galaxy PGC2293204 in 2.860 minutes.