Started working on galaxy PGC2062544 at Wed Aug 5 21:48:33 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.629952 35.3080597 --width 295 --height 295 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/PGC2062544-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/PGC2062544-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T21:48:35.188280 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '273.629952', '35.3080597', '--width', '295', '--height', '295', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/PGC2062544-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/PGC2062544-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.629952 35.3080597 --width 295 --height 295 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/PGC2062544-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/PGC2062544-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 273.629952 35.3080597 Starting process 50711 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 50712 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 50713 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 50714 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 50715 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059412 MB Starting process 50716 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05936 MB Starting process 50717 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05936 MB Starting process 50718 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 50719 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 50720 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 50721 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 50722 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 50724 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 50725 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 50723 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 50726 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T21:48:36.109286 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 13 CCDs: k4m_160429_105249_ooi_zd_ls9-CCD2 z expnum 85804 exptime 80.103 propid 2016A-0453 seeing 1.34 MJD 57507.453 object MzLS_580436_z mosaic/CP/V4.3/CP20160428/k4m_160429_105249_ooi_zd_ls9.fits.fz k4m_160429_104852_ooi_zd_ls9-CCD4 z expnum 85802 exptime 80.103 propid 2016A-0453 seeing 1.24 MJD 57507.451 object MzLS_580435_z mosaic/CP/V4.3/CP20160428/k4m_160429_104852_ooi_zd_ls9.fits.fz k4m_160413_115010_ooi_zd_ls9-CCD1 z expnum 82024 exptime 80.102 propid 2016A-0453 seeing 0.85 MJD 57491.493 object MzLS_581458_z mosaic/CP/V4.3/CP20160412/k4m_160413_115010_ooi_zd_ls9.fits.fz k4m_160415_114504_ooi_zd_ls9-CCD4 z expnum 82530 exptime 110.105 propid 2016A-0453 seeing 0.95 MJD 57493.490 object MzLS_579411_z mosaic/CP/V4.3/CP20160414/k4m_160415_114504_ooi_zd_ls9.fits.fz k4m_160429_105249_ooi_zd_ls9-CCD1 z expnum 85804 exptime 80.103 propid 2016A-0453 seeing 1.23 MJD 57507.453 object MzLS_580436_z mosaic/CP/V4.3/CP20160428/k4m_160429_105249_ooi_zd_ls9.fits.fz ksb_160510_105612_ooi_r_ls9-CCD1 r expnum 75180252 exptime 58.3 propid BASS seeing 1.06 MJD 57518.456 object 08252 90prime/CP/V2.3/CP20160509/ksb_160510_105612_ooi_r_ls9.fits.fz ksb_160602_083908_ooi_g_ls9-CCD1 g expnum 75410134 exptime 111.9 propid BASS seeing 1.27 MJD 57541.361 object 08252 90prime/CP/V2.3/CP20160601/ksb_160602_083908_ooi_g_ls9.fits.fz ksb_160602_084446_ooi_g_ls9-CCD3 g expnum 75410136 exptime 113.4 propid BASS seeing 1.21 MJD 57541.364 object 08262 90prime/CP/V2.3/CP20160601/ksb_160602_084446_ooi_g_ls9.fits.fz ksb_160510_110205_ooi_r_ls9-CCD3 r expnum 75180255 exptime 58.8 propid BASS seeing 1.05 MJD 57518.460 object 08262 90prime/CP/V2.3/CP20160509/ksb_160510_110205_ooi_r_ls9.fits.fz ksb_160414_114341_ooi_r_ls9-CCD3 r expnum 74920208 exptime 50.7 propid BASS seeing 1.06 MJD 57492.489 object 08261 90prime/CP/V2.3/CP20160413/ksb_160414_114341_ooi_r_ls9.fits.fz ksb_160504_102503_ooi_g_ls9-CCD3 g expnum 75120198 exptime 96.4 propid BASS seeing 1.40 MJD 57512.434 object 08261 90prime/CP/V2.3/CP20160503/ksb_160504_102503_ooi_g_ls9.fits.fz ksb_160628_080419_ooi_r_ls9-CCD4 r expnum 75670116 exptime 157.1 propid BASS seeing 1.12 MJD 57567.336 object 09613 90prime/CP/V2.3/CP20160627/ksb_160628_080419_ooi_r_ls9.fits.fz ksb_160702_081312_ooi_g_ls9-CCD4 g expnum 75710099 exptime 125.7 propid BASS seeing 1.96 MJD 57571.343 object 09613 90prime/CP/V2.3/CP20160701/ksb_160702_081312_ooi_g_ls9.fits.fz mosaic get_fwhm: self.fwhm = 3.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1394 1694 and amp range 0 2005 and image y 3324 3621 and amp range 2040 4078 Range in image: x 0 301 , y 0 298 (with image size 301 x 298) dzp -0.005990375 -> scaling image by 0.994497853444703 Faked up EXPNUM 75180252 Faked up EXPNUM 75180252 Faked up EXPNUM 75180252 90prime get_fwhm: self.fwhm = 2.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3499 3672 and amp range 2016 4031 and image y 154 328 and amp range 0 2047 Range in image: x 0 174 , y 0 175 (with image size 174 x 175) dzp -0.0041296566 -> scaling image by 0.9962036700684744 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 74920208 Faked up EXPNUM 74920208 Faked up EXPNUM 74920208 90prime get_fwhm: self.fwhm = 2.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1598 1769 and amp range 0 2015 and image y 1723 1895 and amp range 0 2047 Range in image: x 0 172 , y 0 173 (with image size 172 x 173) dzp -0.024507914 -> scaling image by 0.9776802328037623 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75710099 Faked up EXPNUM 75710099 Faked up EXPNUM 75710099 90prime get_fwhm: self.fwhm = 4.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3370 3544 and amp range 2016 4031 and image y 1973 2144 and amp range 0 2047 Range in image: x 0 175 , y 0 75 (with image size 175 x 172) dzp 0.010226944 -> scaling image by 1.0094638657706572 Found overlap: image x 3370 3544 and amp range 2016 4031 and image y 1973 2144 and amp range 2048 4095 Range in image: x 0 175 , y 75 172 (with image size 175 x 172) dzp 0.0013913503 -> scaling image by 1.001282302423891 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75410136 Faked up EXPNUM 75410136 Faked up EXPNUM 75410136 90prime get_fwhm: self.fwhm = 2.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3573 3744 and amp range 2016 4031 and image y 3708 3880 and amp range 2048 4095 Faked up EXPNUM 75670116 Faked up EXPNUM 75670116 Faked up EXPNUM 75670116 90prime get_fwhm: self.fwhm = 2.47 Found 4 relevant rows in amp-corrections file. Range in image: x 0 172 , y 0 173 (with image size 172 x 173) dzp -0.0012536051 -> scaling image by 0.9988460533227724 Found overlap: image x 3385 3558 and amp range 2016 4031 and image y 1962 2134 and amp range 0 2047 Range in image: x 0 174 , y 0 86 (with image size 174 x 173) dzp 0.0047082007 -> scaling image by 1.0043458289369953 Found overlap: image x 3385 3558 and amp range 2016 4031 and image y 1962 2134 and amp range 2048 4095 Range in image: x 0 174 , y 86 173 (with image size 174 x 173) dzp -0.0036899033 -> scaling image by 0.9966072419211972 Faked up EXPNUM 75180255 Faked up EXPNUM 75180255 Faked up EXPNUM 75180255 90prime get_fwhm: self.fwhm = 2.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3575 3746 and amp range 2016 4031 and image y 3715 3887 and amp range 2048 4095 Range in image: x 0 172 , y 0 173 (with image size 172 x 173) dzp -0.0005558773 -> scaling image by 0.99948814914245 mosaic get_fwhm: self.fwhm = 5.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 7 77 and amp range 0 2047 and image y 7 23 and amp range 0 2039 Range in image: x 0 71 , y 0 17 (with image size 71 x 17) dzp -0.006320339 -> scaling image by 0.9941956631368829 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75120198 Faked up EXPNUM 75120198 Faked up EXPNUM 75120198 90prime get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1601 1773 and amp range 0 2015 and image y 1729 1901 and amp range 0 2047 Range in image: x 0 173 , y 0 173 (with image size 173 x 173) dzp -0.03470582 -> scaling image by 0.9685402452207784 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.79 Found 4 relevant rows in amp-corrections file. Found overlap: image x 7 109 and amp range 0 2047 and image y 3359 3662 and amp range 2022 4060 Range in image: x 0 103 , y 0 304 (with image size 103 x 304) dzp 0.0033053984 -> scaling image by 1.0030490232713904 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75410134 Faked up EXPNUM 75410134 Faked up EXPNUM 75410134 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3504 3677 and amp range 2016 4031 and image y 143 317 and amp range 0 2047 Range in image: x 0 174 , y 0 175 (with image size 174 x 175) dzp -0.0032519526 -> scaling image by 0.9970093219958882 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2525 2829 and amp range 2048 4095 and image y 2019 2319 and amp range 0 2021 Range in image: x 0 305 , y 0 3 (with image size 305 x 301) dzp -0.0006399284 -> scaling image by 0.9994107778325068 Found overlap: image x 2525 2829 and amp range 2048 4095 and image y 2019 2319 and amp range 2022 4060 Range in image: x 0 305 , y 3 301 (with image size 305 x 301) dzp -0.0028835079 -> scaling image by 0.9973477146455455 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 29.62 s, CPU: 1.44 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 178 MB, VmData: 209 MB, maxrss: 0.1818 MB Stage tims finished: 2020-08-05T21:49:05.733283 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 7.878 s worker CPU, 82.602 s worker Wall, Wall: 29.626 s, Cores in use: 0.31, Total efficiency (on 16 cores): 2.0 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/PGC2062544-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/PGC2062544-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T21:49:05.862377 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02593.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02721.fits Matched 7 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/metrics/cus/reference-custom-273629p35308.fits Stage refs : Wall: 15.93 s, CPU: 6.84 s, VmPeak: 1050 MB, VmSize: 1045 MB, VmRSS: 267 MB, VmData: 296 MB, maxrss: 0.273308 MB Stage refs finished: 2020-08-05T21:49:21.788811 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 15.928 s, Cores in use: 0.43, Total efficiency (on 16 cores): 2.7 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/PGC2062544-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/PGC2062544-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T21:49:21.820613 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/metrics/cus/outlier-mask-custom-273629p35308.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/metrics/cus/outliers-pre-custom-273629p35308.jpg Image ksb_160602_084446_ooi_g_ls9-CCD3 g : masking 124 positive outlier pixels and 0 negative outlier pixels Image ksb_160702_081312_ooi_g_ls9-CCD4 g : masking 48 positive outlier pixels and 0 negative outlier pixels Image ksb_160602_083908_ooi_g_ls9-CCD1 g : masking 127 positive outlier pixels and 0 negative outlier pixels Image ksb_160414_114341_ooi_r_ls9-CCD3 r : masking 10 positive outlier pixels and 9 negative outlier pixels Image k4m_160415_114504_ooi_zd_ls9-CCD4 z : masking 520 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/metrics/cus/outlier-mask-custom-273629p35308.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/metrics/cus/outliers-post-custom-273629p35308.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/metrics/cus/outliers-masked-pos-custom-273629p35308.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/metrics/cus/outliers-masked-neg-custom-273629p35308.jpg Stage outliers : Wall: 1.28 s, CPU: 0.94 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 285 MB, VmData: 312 MB, maxrss: 0.29158 MB Stage outliers finished: 2020-08-05T21:49:23.105566 Resources for stage outliers : 1.188 s worker CPU, 1.310 s worker Wall, Wall: 1.287 s, Cores in use: 1.66, Total efficiency (on 16 cores): 10.4 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/PGC2062544-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/PGC2062544-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T21:49:23.142068 Stage halos : Wall: 0.81 s, CPU: 0.80 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 285 MB, VmData: 312 MB, maxrss: 0.29192 MB Stage halos finished: 2020-08-05T21:49:23.949092 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.808 s, Cores in use: 0.99, Total efficiency (on 16 cores): 6.2 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/PGC2062544-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/PGC2062544-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T21:49:24.113293 PSF sigmas in coadd pixels: ['2.07', '1.96', '2.27', '3.19'] Using average PSF sigma 2.37336485901926 Gaussian PSF norm 0.1188585862396427 vs pixelized 0.09559615 average tim pixel scale / coadd scale: 1.72934363501054 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.73', '1.70', '1.71', '1.82'] Using average PSF sigma 1.740632078475024 Gaussian PSF norm 0.16206457140616573 vs pixelized 0.12506402 average tim pixel scale / coadd scale: 1.7295928726609056 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.17', '2.02', '1.39', '1.54'] Using average PSF sigma 1.7795655960364296 Gaussian PSF norm 0.1585189061882175 vs pixelized 0.13351592 average tim pixel scale / coadd scale: 0.9909879430890339 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.21 s, CPU: 0.21 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 287 MB, VmData: 312 MB, maxrss: 0.29346 MB Stage fit_on_coadds finished: 2020-08-05T21:49:24.327987 Resources for stage fit_on_coadds : 0.263 s worker CPU, 0.263 s worker Wall, Wall: 0.216 s, Cores in use: 2.19, Total efficiency (on 16 cores): 13.7 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/PGC2062544-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/PGC2062544-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T21:49:24.339752 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 38 potential peaks Of 38 potential peaks: 14 in veto map, 3 cut by saddle test, 0 cut by aper test, 21 kept SED z : 21 new peaks Found 223 potential peaks Of 223 potential peaks: 212 in veto map, 5 cut by saddle test, 0 cut by aper test, 6 kept SED r : 6 new peaks Found 63 potential peaks Of 63 potential peaks: 61 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 39 potential peaks Of 39 potential peaks: 33 in veto map, 3 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 44 potential peaks Of 44 potential peaks: 40 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 30 new sources Median coadd sky for g : 0.000121209116 Median coadd sky for r : 0.00027977594 Median coadd sky for z : -0.00016259699 Stage srcs : Wall: 0.57 s, CPU: 0.52 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 287 MB, VmData: 312 MB, maxrss: 0.29396 MB Stage srcs finished: 2020-08-05T21:49:24.904935 Resources for stage srcs : 0.106 s worker CPU, 0.106 s worker Wall, Wall: 0.566 s, Cores in use: 1.11, Total efficiency (on 16 cores): 6.9 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/PGC2062544-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/PGC2062544-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T21:49:24.977146 Blob 1 of 19, id: 4, sources: 15, size: 169x264, npix 18398, brick X: 43,212, Y: 31,295, one pixel: 116 31 Blob 2 of 19, id: 0, sources: 5, size: 61x46, npix 1618, brick X: 35,96, Y: 0,46, one pixel: 39 0 Blob 3 of 19, id: 9, sources: 1, size: 40x40, npix 1098, brick X: 22,62, Y: 105,145, one pixel: 39 105 Blob 4 of 19, id: 17, sources: 1, size: 26x32, npix 606, brick X: 0,26, Y: 247,279, one pixel: 6 247 Blob 5 of 19, id: 8, sources: 1, size: 24x30, npix 474, brick X: 216,240, Y: 94,124, one pixel: 226 94 Blob 6 of 19, id: 16, sources: 1, size: 27x26, npix 440, brick X: 38,65, Y: 225,251, one pixel: 51 225 Blob 7 of 19, id: 11, sources: 2, size: 33x24, npix 434, brick X: 0,33, Y: 148,172, one pixel: 22 148 Blob 8 of 19, id: 15, sources: 2, size: 33x24, npix 426, brick X: 71,104, Y: 216,240, one pixel: 92 216 Blob 9 of 19, id: 14, sources: 3, size: 17x34, npix 407, brick X: 0,17, Y: 179,213, one pixel: 1 179 Blob 10 of 19, id: 3, sources: 1, size: 19x28, npix 391, brick X: 0,19, Y: 24,52, one pixel: 5 24 Blob 11 of 19, id: 2, sources: 1, size: 25x24, npix 374, brick X: 205,230, Y: 15,39, one pixel: 214 15 Blob 12 of 19, id: 18, sources: 1, size: 24x24, npix 361, brick X: 61,85, Y: 268,292, one pixel: 72 268 Blob 13 of 19, id: 10, sources: 1, size: 24x24, npix 340, brick X: 239,263, Y: 115,139, one pixel: 249 115 Blob 14 of 19, id: 13, sources: 1, size: 23x23, npix 327, brick X: 69,92, Y: 174,197, one pixel: 80 174 Blob 15 of 19, id: 12, sources: 1, size: 21x21, npix 259, brick X: 234,255, Y: 156,177, one pixel: 244 156 Blob 16 of 19, id: 7, sources: 1, size: 21x20, npix 230, brick X: 200,221, Y: 86,106, one pixel: 209 86 Blob 17 of 19, id: 1, sources: 1, size: 20x20, npix 228, brick X: 237,257, Y: 8,28, one pixel: 245 8 Blob 18 of 19, id: 5, sources: 1, size: 17x20, npix 223, brick X: 278,295, Y: 53,73, one pixel: 286 53 Blob 12 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.151016 MB Blob 19 of 19, id: 6, sources: 1, size: 20x19, npix 218, brick X: 246,266, Y: 54,73, one pixel: 254 54 Blob 14 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 815 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150884 MB Blob 15 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 806 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150852 MB Blob 16 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 811 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.151024 MB Blob 17 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.151016 MB Blob 7 finished, total: Wall: 0.58 s, CPU: 0.58 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 118 MB, VmData: 161 MB, maxrss: 0.120984 MB Blob 18 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 815 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150884 MB Blob 8 finished, total: Wall: 0.63 s, CPU: 0.63 s, VmPeak: 792 MB, VmSize: 719 MB, VmRSS: 135 MB, VmData: 171 MB, maxrss: 0.138352 MB Blob 13 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095548 MB Blob 5 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151148 MB Blob 11 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 807 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150676 MB Blob 6 finished, total: Wall: 0.79 s, CPU: 0.78 s, VmPeak: 792 MB, VmSize: 719 MB, VmRSS: 134 MB, VmData: 170 MB, maxrss: 0.137576 MB Blob 19 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 806 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150852 MB Blob 10 finished, total: Wall: 0.92 s, CPU: 0.92 s, VmPeak: 811 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150952 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (273.64323, 35.31139), pm (-17.4, -24.1), parallax 0.089 with NanoMaggies: g=21.6, r=20.3, z=19.2 Reset brightness to NanoMaggies: g=21.3, r=20.2, z=19.7 Blob 9 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095224 MB Blob 4 finished, total: Wall: 1.13 s, CPU: 1.13 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 95 MB, VmData: 140 MB, maxrss: 0.09698 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 1.35 s, CPU: 1.35 s, VmPeak: 811 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150828 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (273.63773, 35.29708), pm (-4.1, -2.5), parallax 0.521 with NanoMaggies: g=17.9, r=17.5, z=17.4 Reset brightness to NanoMaggies: g=17.8, r=17.2, z=16.9 Blob 2 finished, total: Wall: 1.95 s, CPU: 1.95 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.15198 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (273.62882, 35.32258), pm (0.7, -3.0), parallax 0.385 with NanoMaggies: g=12.9, r=12.2, z=11.9 Reset brightness to NanoMaggies: g=12.9, r=12.2, z=11.9 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.48259, ee1=0.412922, ee2=-0.326485 Measuring 1 iterative sources Blob 1 finished, total: Wall: 15.99 s, CPU: 15.99 s, VmPeak: 811 MB, VmSize: 739 MB, VmRSS: 162 MB, VmData: 191 MB, maxrss: 0.165676 MB Old catalog: 52 New catalog: 38 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/metrics/cus/blobs-custom-273629p35308.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/metrics/cus/all-models-custom-273629p35308.fits Stage fitblobs : Wall: 17.65 s, CPU: 0.51 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 287 MB, VmData: 312 MB, maxrss: 0.294316 MB Stage fitblobs finished: 2020-08-05T21:49:42.628471 Resources for stage fitblobs : 28.837 s worker CPU, 29.046 s worker Wall, Wall: 17.653 s, Cores in use: 1.66, Total efficiency (on 16 cores): 10.4 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/PGC2062544-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/PGC2062544-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T21:49:42.647128 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/tmp-legacysurvey-custom-273629p35308-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/tmp-legacysurvey-custom-273629p35308-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/tmp-legacysurvey-custom-273629p35308-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/tmp-legacysurvey-custom-273629p35308-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-resid.jpg Stage coadds : Wall: 2.51 s, CPU: 0.75 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 288 MB, VmData: 312 MB, maxrss: 0.29464 MB Stage coadds finished: 2020-08-05T21:49:45.154542 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 8.171 s worker CPU, 11.799 s worker Wall, Wall: 2.509 s, Cores in use: 3.56, Total efficiency (on 16 cores): 22.2 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/PGC2062544-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/PGC2062544-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T21:49:45.173928 Cut to 1 unWISE tiles Reading WISE tile 2741p348 band 1 Reading WISE tile 2741p348 band 2 Reading WISE tile 2741p348 band 3 Reading WISE tile 2741p348 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 809 MB, VmSize: 809 MB, VmRSS: 150 MB, VmData: 176 MB, maxrss: 0.191428 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 815 MB, VmSize: 803 MB, VmRSS: 144 MB, VmData: 171 MB, maxrss: 0.207072 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 808 MB, VmSize: 806 MB, VmRSS: 145 MB, VmData: 173 MB, maxrss: 0.20874 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 812 MB, VmSize: 803 MB, VmRSS: 144 MB, VmData: 171 MB, maxrss: 0.208072 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/tmp-legacysurvey-custom-273629p35308-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/tmp-legacysurvey-custom-273629p35308-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 5.67 s, CPU: 0.73 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 288 MB, VmData: 312 MB, maxrss: 0.29516 MB Stage wise_forced finished: 2020-08-05T21:49:50.841875 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.285 s worker CPU, 10.742 s worker Wall, Wall: 5.670 s, Cores in use: 0.71, Total efficiency (on 16 cores): 4.4 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/PGC2062544-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/PGC2062544-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T21:49:50.910048 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/tractor-i/cus/tractor-custom-273629p35308.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/tractor/cus/tractor-custom-273629p35308.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/tractor/cus/brick-custom-273629p35308.sha256sum Stage writecat : Wall: 2.52 s, CPU: 1.57 s, VmPeak: 1187 MB, VmSize: 1059 MB, VmRSS: 290 MB, VmData: 312 MB, maxrss: 0.42804 MB Stage writecat finished: 2020-08-05T21:49:53.429888 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.522 s, Cores in use: 0.62, Total efficiency (on 16 cores): 3.9 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/PGC2062544-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2062544/PGC2062544-largegalaxy-writecat.p All done: 49.733 s worker CPU, 135.872 s worker Wall, Wall: 77.440 s, Cores in use: 0.83, Total efficiency (on 16 cores): 5.2 % Finished galaxy PGC2062544 in 1.353 minutes. Started working on galaxy PGC2062544 at Fri Aug 7 09:48:38 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.62963279679684 35.308025861580035 --width 295 --height 295 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/PGC2062544-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/PGC2062544-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T09:48:40.452582 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '273.62963279679684', '35.308025861580035', '--width', '295', '--height', '295', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/PGC2062544-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/PGC2062544-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.62963279679684 35.308025861580035 --width 295 --height 295 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/PGC2062544-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/PGC2062544-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 273.62963279679684 35.308025861580035 Starting process 4555 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 4556 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 4557 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 4558 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 4559 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB Starting process 4560 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 4561 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 4562 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 4563 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 4564 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 4565 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 4566 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 4568 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 4569 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 4567 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 4570 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T09:48:40.962854 Keeping 13 CCDs: k4m_160429_105249_ooi_zd_ls9-CCD2 z expnum 85804 exptime 80.103 propid 2016A-0453 seeing 1.34 MJD 57507.453 object MzLS_580436_z mosaic/CP/V4.3/CP20160428/k4m_160429_105249_ooi_zd_ls9.fits.fz k4m_160429_104852_ooi_zd_ls9-CCD4 z expnum 85802 exptime 80.103 propid 2016A-0453 seeing 1.24 MJD 57507.451 object MzLS_580435_z mosaic/CP/V4.3/CP20160428/k4m_160429_104852_ooi_zd_ls9.fits.fz k4m_160413_115010_ooi_zd_ls9-CCD1 z expnum 82024 exptime 80.102 propid 2016A-0453 seeing 0.85 MJD 57491.493 object MzLS_581458_z mosaic/CP/V4.3/CP20160412/k4m_160413_115010_ooi_zd_ls9.fits.fz k4m_160415_114504_ooi_zd_ls9-CCD4 z expnum 82530 exptime 110.105 propid 2016A-0453 seeing 0.95 MJD 57493.490 object MzLS_579411_z mosaic/CP/V4.3/CP20160414/k4m_160415_114504_ooi_zd_ls9.fits.fz k4m_160429_105249_ooi_zd_ls9-CCD1 z expnum 85804 exptime 80.103 propid 2016A-0453 seeing 1.23 MJD 57507.453 object MzLS_580436_z mosaic/CP/V4.3/CP20160428/k4m_160429_105249_ooi_zd_ls9.fits.fz ksb_160510_105612_ooi_r_ls9-CCD1 r expnum 75180252 exptime 58.3 propid BASS seeing 1.06 MJD 57518.456 object 08252 90prime/CP/V2.3/CP20160509/ksb_160510_105612_ooi_r_ls9.fits.fz ksb_160602_083908_ooi_g_ls9-CCD1 g expnum 75410134 exptime 111.9 propid BASS seeing 1.27 MJD 57541.361 object 08252 90prime/CP/V2.3/CP20160601/ksb_160602_083908_ooi_g_ls9.fits.fz ksb_160602_084446_ooi_g_ls9-CCD3 g expnum 75410136 exptime 113.4 propid BASS seeing 1.21 MJD 57541.364 object 08262 90prime/CP/V2.3/CP20160601/ksb_160602_084446_ooi_g_ls9.fits.fz ksb_160510_110205_ooi_r_ls9-CCD3 r expnum 75180255 exptime 58.8 propid BASS seeing 1.05 MJD 57518.460 object 08262 90prime/CP/V2.3/CP20160509/ksb_160510_110205_ooi_r_ls9.fits.fz ksb_160414_114341_ooi_r_ls9-CCD3 r expnum 74920208 exptime 50.7 propid BASS seeing 1.06 MJD 57492.489 object 08261 90prime/CP/V2.3/CP20160413/ksb_160414_114341_ooi_r_ls9.fits.fz ksb_160504_102503_ooi_g_ls9-CCD3 g expnum 75120198 exptime 96.4 propid BASS seeing 1.40 MJD 57512.434 object 08261 90prime/CP/V2.3/CP20160503/ksb_160504_102503_ooi_g_ls9.fits.fz ksb_160628_080419_ooi_r_ls9-CCD4 r expnum 75670116 exptime 157.1 propid BASS seeing 1.12 MJD 57567.336 object 09613 90prime/CP/V2.3/CP20160627/ksb_160628_080419_ooi_r_ls9.fits.fz ksb_160702_081312_ooi_g_ls9-CCD4 g expnum 75710099 exptime 125.7 propid BASS seeing 1.96 MJD 57571.343 object 09613 90prime/CP/V2.3/CP20160701/ksb_160702_081312_ooi_g_ls9.fits.fz Faked up EXPNUM 74920208 Faked up EXPNUM 74920208 Faked up EXPNUM 74920208 90prime get_fwhm: self.fwhm = 2.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1598 1770 and amp range 0 2015 and image y 1725 1897 and amp range 0 2047 Range in image: x 0 173 , y 0 173 (with image size 173 x 173) dzp -0.024507914 -> scaling image by 0.9776802328037623 Faked up EXPNUM 75710099 Faked up EXPNUM 75710099 Faked up EXPNUM 75710099 90prime get_fwhm: self.fwhm = 4.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3371 3544 and amp range 2016 4031 and image y 1975 2146 and amp range 0 2047 Range in image: x 0 174 , y 0 73 (with image size 174 x 172) dzp 0.010226944 -> scaling image by 1.0094638657706572 Found overlap: image x 3371 3544 and amp range 2016 4031 and image y 1975 2146 and amp range 2048 4095 Range in image: x 0 174 , y 73 172 (with image size 174 x 172) dzp 0.0013913503 -> scaling image by 1.001282302423891 mosaic get_fwhm: self.fwhm = 5.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 7 77 and amp range 0 2047 and image y 7 19 and amp range 0 2039 Range in image: x 0 71 , y 0 13 (with image size 71 x 13) dzp -0.006320339 -> scaling image by 0.9941956631368829 mosaic get_fwhm: self.fwhm = 3.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1394 1694 and amp range 0 2005 and image y 3321 3617 and amp range 2040 4078 Range in image: x 0 301 , y 0 297 (with image size 301 x 297) dzp -0.005990375 -> scaling image by 0.994497853444703 mosaic get_fwhm: self.fwhm = 4.79 Found 4 relevant rows in amp-corrections file. Found overlap: image x 7 108 and amp range 0 2047 and image y 3356 3658 and amp range 2022 4060 Range in image: x 0 102 , y 0 303 (with image size 102 x 303) dzp 0.0033053984 -> scaling image by 1.0030490232713904 Faked up EXPNUM 75180252 Faked up EXPNUM 75180252 Faked up EXPNUM 75180252 90prime get_fwhm: self.fwhm = 2.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3499 3673 and amp range 2016 4031 and image y 156 330 and amp range 0 2047 Range in image: x 0 175 , y 0 175 (with image size 175 x 175) dzp -0.0041296566 -> scaling image by 0.9962036700684744 Faked up EXPNUM 75410136 Faked up EXPNUM 75410136 Faked up EXPNUM 75410136 90prime get_fwhm: self.fwhm = 2.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3573 3745 and amp range 2016 4031 and image y 3710 3882 and amp range 2048 4095 Range in image: x 0 173 , y 0 173 (with image size 173 x 173) dzp -0.0012536051 -> scaling image by 0.9988460533227724 Faked up EXPNUM 75120198 Faked up EXPNUM 75120198 Faked up EXPNUM 75120198 90prime get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1601 1773 and amp range 0 2015 and image y 1731 1903 and amp range 0 2047 Range in image: x 0 173 , y 0 173 (with image size 173 x 173) dzp -0.03470582 -> scaling image by 0.9685402452207784 Faked up EXPNUM 75670116 Faked up EXPNUM 75670116 Faked up EXPNUM 75670116 90prime get_fwhm: self.fwhm = 2.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3385 3558 and amp range 2016 4031 and image y 1964 2136 and amp range 0 2047 Range in image: x 0 174 , y 0 84 (with image size 174 x 173) dzp 0.0047082007 -> scaling image by 1.0043458289369953 Found overlap: image x 3385 3558 and amp range 2016 4031 and image y 1964 2136 and amp range 2048 4095 Range in image: x 0 174 , y 84 173 (with image size 174 x 173) dzp -0.0036899033 -> scaling image by 0.9966072419211972 Faked up EXPNUM 75180255 Faked up EXPNUM 75180255 Faked up EXPNUM 75180255 90prime get_fwhm: self.fwhm = 2.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3576 3747 and amp range 2016 4031 and image y 3717 3889 and amp range 2048 4095 Range in image: x 0 172 , y 0 173 (with image size 172 x 173) dzp -0.0005558773 -> scaling image by 0.99948814914245 Faked up EXPNUM 75410134 Faked up EXPNUM 75410134 Faked up EXPNUM 75410134 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3504 3677 and amp range 2016 4031 and image y 145 319 and amp range 0 2047 Range in image: x 0 174 , y 0 175 (with image size 174 x 175) dzp -0.0032519526 -> scaling image by 0.9970093219958882 mosaic get_fwhm: self.fwhm = 3.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2525 2828 and amp range 2048 4095 and image y 2016 2316 and amp range 0 2021 Range in image: x 0 304 , y 0 6 (with image size 304 x 301) dzp -0.0006399284 -> scaling image by 0.9994107778325068 Found overlap: image x 2525 2828 and amp range 2048 4095 and image y 2016 2316 and amp range 2022 4060 Range in image: x 0 304 , y 6 301 (with image size 304 x 301) dzp -0.0028835079 -> scaling image by 0.9973477146455455 Stage tims : Wall: 66.87 s, CPU: 0.90 s, VmPeak: 952 MB, VmSize: 952 MB, VmRSS: 175 MB, VmData: 209 MB, maxrss: 0.17922 MB Stage tims finished: 2020-08-07T09:49:47.827995 Resources for stage tims : 6.787 s worker CPU, 168.954 s worker Wall, Wall: 66.867 s, Cores in use: 0.11, Total efficiency (on 16 cores): 0.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/PGC2062544-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/PGC2062544-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T09:49:47.960797 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02593.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02721.fits Matched 7 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/metrics/cus/reference-custom-273629p35308.fits Stage refs : Wall: 32.01 s, CPU: 6.56 s, VmPeak: 1044 MB, VmSize: 1038 MB, VmRSS: 264 MB, VmData: 296 MB, maxrss: 0.270608 MB Stage refs finished: 2020-08-07T09:50:19.971831 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 32.012 s, Cores in use: 0.20, Total efficiency (on 16 cores): 1.3 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/PGC2062544-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/PGC2062544-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T09:50:20.032854 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/metrics/cus/outlier-mask-custom-273629p35308.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/metrics/cus/outliers-pre-custom-273629p35308.jpg Image ksb_160702_081312_ooi_g_ls9-CCD4 g : masking 38 positive outlier pixels and 0 negative outlier pixels Image ksb_160602_083908_ooi_g_ls9-CCD1 g : masking 129 positive outlier pixels and 0 negative outlier pixels Image ksb_160414_114341_ooi_r_ls9-CCD3 r : masking 40 positive outlier pixels and 0 negative outlier pixels Image k4m_160415_114504_ooi_zd_ls9-CCD4 z : masking 603 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/metrics/cus/outlier-mask-custom-273629p35308.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/metrics/cus/outliers-post-custom-273629p35308.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/metrics/cus/outliers-masked-pos-custom-273629p35308.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/metrics/cus/outliers-masked-neg-custom-273629p35308.jpg Stage outliers : Wall: 1.26 s, CPU: 0.80 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 281 MB, VmData: 310 MB, maxrss: 0.288152 MB Stage outliers finished: 2020-08-07T09:50:21.292286 Resources for stage outliers : 1.159 s worker CPU, 1.233 s worker Wall, Wall: 1.261 s, Cores in use: 1.56, Total efficiency (on 16 cores): 9.7 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/PGC2062544-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/PGC2062544-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T09:50:21.317598 Stage halos : Wall: 0.32 s, CPU: 0.31 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 282 MB, VmData: 311 MB, maxrss: 0.288848 MB Stage halos finished: 2020-08-07T09:50:21.636134 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.320 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/PGC2062544-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/PGC2062544-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T09:50:21.694244 PSF sigmas in coadd pixels: ['2.07', '1.96', '2.27', '3.19'] Using average PSF sigma 2.37336485901926 Gaussian PSF norm 0.1188585862396427 vs pixelized 0.09559577 average tim pixel scale / coadd scale: 1.72934363501054 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.73', '1.70', '1.71', '1.82'] Using average PSF sigma 1.740632078475024 Gaussian PSF norm 0.16206457140616573 vs pixelized 0.12506117 average tim pixel scale / coadd scale: 1.7295928726609056 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.17', '2.02', '1.39', '1.54'] Using average PSF sigma 1.7795655960364296 Gaussian PSF norm 0.1585189061882175 vs pixelized 0.13351215 average tim pixel scale / coadd scale: 0.9909879430890339 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.28 s, CPU: 0.20 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 286 MB, VmData: 313 MB, maxrss: 0.292516 MB Stage fit_on_coadds finished: 2020-08-07T09:50:21.979117 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.280 s worker CPU, 0.280 s worker Wall, Wall: 0.286 s, Cores in use: 1.67, Total efficiency (on 16 cores): 10.4 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/PGC2062544-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/PGC2062544-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T09:50:22.054440 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 37 potential peaks Of 37 potential peaks: 14 in veto map, 2 cut by saddle test, 0 cut by aper test, 21 kept SED z : 21 new peaks Found 229 potential peaks Of 229 potential peaks: 218 in veto map, 5 cut by saddle test, 0 cut by aper test, 6 kept SED r : 6 new peaks Found 53 potential peaks Of 53 potential peaks: 51 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 38 potential peaks Of 38 potential peaks: 33 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 42 potential peaks Of 42 potential peaks: 38 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 30 new sources Median coadd sky for g : 0.00010936999 Median coadd sky for r : 0.0002788094 Median coadd sky for z : -0.00017185652 Stage srcs : Wall: 0.55 s, CPU: 0.51 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 286 MB, VmData: 313 MB, maxrss: 0.29318 MB Stage srcs finished: 2020-08-07T09:50:22.606291 Resources for stage srcs : 0.102 s worker CPU, 0.102 s worker Wall, Wall: 0.553 s, Cores in use: 1.10, Total efficiency (on 16 cores): 6.9 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/PGC2062544-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/PGC2062544-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T09:50:22.748083 Blob 1 of 21, id: 5, sources: 14, size: 169x264, npix 18349, brick X: 39,208, Y: 31,295, one pixel: 114 31 Blob 2 of 21, id: 0, sources: 5, size: 61x46, npix 1638, brick X: 31,92, Y: 0,46, one pixel: 36 0 Blob 3 of 21, id: 10, sources: 1, size: 40x39, npix 1100, brick X: 18,58, Y: 106,145, one pixel: 33 106 Blob 4 of 21, id: 18, sources: 1, size: 22x31, npix 494, brick X: 0,22, Y: 248,279, one pixel: 4 248 Blob 5 of 21, id: 9, sources: 1, size: 24x30, npix 474, brick X: 212,236, Y: 94,124, one pixel: 223 94 Blob 6 of 21, id: 17, sources: 1, size: 27x26, npix 449, brick X: 35,62, Y: 226,252, one pixel: 46 226 Blob 7 of 21, id: 16, sources: 2, size: 33x25, npix 426, brick X: 68,101, Y: 216,241, one pixel: 88 216 Blob 8 of 21, id: 3, sources: 1, size: 25x23, npix 371, brick X: 201,226, Y: 16,39, one pixel: 210 16 Blob 9 of 21, id: 20, sources: 1, size: 24x24, npix 362, brick X: 57,81, Y: 269,293, one pixel: 67 269 Blob 10 of 21, id: 11, sources: 1, size: 23x23, npix 338, brick X: 236,259, Y: 116,139, one pixel: 245 116 Blob 11 of 21, id: 14, sources: 1, size: 23x23, npix 328, brick X: 66,89, Y: 175,198, one pixel: 75 175 Blob 12 of 21, id: 6, sources: 1, size: 21x21, npix 277, brick X: 274,295, Y: 53,74, one pixel: 283 53 Blob 13 of 21, id: 4, sources: 1, size: 15x25, npix 269, brick X: 0,15, Y: 26,51, one pixel: 2 26 Blob 14 of 21, id: 13, sources: 1, size: 21x21, npix 261, brick X: 230,251, Y: 157,178, one pixel: 239 157 Blob 15 of 21, id: 12, sources: 1, size: 20x21, npix 249, brick X: 9,29, Y: 149,170, one pixel: 18 149 Blob 16 of 21, id: 8, sources: 1, size: 20x20, npix 228, brick X: 197,217, Y: 86,106, one pixel: 206 86 Blob 17 of 21, id: 7, sources: 1, size: 20x20, npix 220, brick X: 242,262, Y: 54,74, one pixel: 251 54 Blob 18 of 21, id: 2, sources: 1, size: 19x19, npix 217, brick X: 234,253, Y: 9,28, one pixel: 242 9 Blob 9 finished, total: Wall: 0.25 s, CPU: 0.23 s, VmPeak: 792 MB, VmSize: 711 MB, VmRSS: 130 MB, VmData: 169 MB, maxrss: 0.132848 MB Blob 19 of 21, id: 19, sources: 1, size: 13x21, npix 190, brick X: 282,295, Y: 258,279, one pixel: 291 258 Blob 14 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147164 MB Blob 20 of 21, id: 1, sources: 1, size: 18x14, npix 151, brick X: 139,157, Y: 0,14, one pixel: 143 0 Blob 15 finished, total: Wall: 0.28 s, CPU: 0.27 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 118 MB, VmData: 161 MB, maxrss: 0.120936 MB Blob 21 of 21, id: 15, sources: 1, size: 17x17, npix 145, brick X: 3,20, Y: 199,216, one pixel: 11 199 Blob 12 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14748 MB Blob 11 finished, total: Wall: 0.31 s, CPU: 0.30 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147144 MB Blob 16 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 792 MB, VmSize: 712 MB, VmRSS: 130 MB, VmData: 169 MB, maxrss: 0.13302 MB Blob 18 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147164 MB Blob 21 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147144 MB Blob 19 finished, total: Wall: 0.16 s, CPU: 0.16 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 118 MB, VmData: 161 MB, maxrss: 0.120936 MB Blob 10 finished, total: Wall: 0.56 s, CPU: 0.55 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147252 MB Blob 13 finished, total: Wall: 0.58 s, CPU: 0.58 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147616 MB Blob 7 finished, total: Wall: 0.63 s, CPU: 0.62 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095104 MB Blob 6 finished, total: Wall: 0.69 s, CPU: 0.68 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147244 MB Blob 5 finished, total: Wall: 0.69 s, CPU: 0.68 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095052 MB Blob 17 finished, total: Wall: 0.45 s, CPU: 0.45 s, VmPeak: 792 MB, VmSize: 711 MB, VmRSS: 130 MB, VmData: 169 MB, maxrss: 0.132848 MB Blob 8 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.146948 MB Blob 20 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14748 MB Measuring 1 iterative sources Blob 4 finished, total: Wall: 1.05 s, CPU: 1.05 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148024 MB Blob 3 finished, total: Wall: 1.62 s, CPU: 1.61 s, VmPeak: 815 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148112 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (273.63773, 35.29708), pm (-4.1, -2.5), parallax 0.521 with NanoMaggies: g=18, r=17.7, z=17.4 Reset brightness to NanoMaggies: g=17.8, r=17.2, z=16.9 Blob 2 finished, total: Wall: 1.87 s, CPU: 1.86 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148128 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (273.62882, 35.32258), pm (0.7, -3.0), parallax 0.385 with NanoMaggies: g=12.9, r=12.2, z=11.9 Reset brightness to NanoMaggies: g=12.9, r=12.2, z=11.9 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.06917, ee1=0.337809, ee2=-0.281389 Measuring 2 iterative sources Blob 1 finished, total: Wall: 13.51 s, CPU: 13.51 s, VmPeak: 703 MB, VmSize: 695 MB, VmRSS: 125 MB, VmData: 163 MB, maxrss: 0.135072 MB Old catalog: 52 New catalog: 34 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/metrics/cus/blobs-custom-273629p35308.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/metrics/cus/all-models-custom-273629p35308.fits Stage fitblobs : Wall: 14.04 s, CPU: 0.46 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 287 MB, VmData: 313 MB, maxrss: 0.293536 MB Stage fitblobs finished: 2020-08-07T09:50:36.787091 Resources for stage fitblobs : 25.116 s worker CPU, 25.695 s worker Wall, Wall: 14.041 s, Cores in use: 1.82, Total efficiency (on 16 cores): 11.4 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/PGC2062544-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/PGC2062544-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T09:50:36.868597 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/tmp-legacysurvey-custom-273629p35308-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/tmp-legacysurvey-custom-273629p35308-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/tmp-legacysurvey-custom-273629p35308-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/tmp-legacysurvey-custom-273629p35308-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-resid.jpg Stage coadds : Wall: 20.24 s, CPU: 0.66 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 287 MB, VmData: 313 MB, maxrss: 0.29386 MB Stage coadds finished: 2020-08-07T09:50:57.108844 Resources for stage coadds : 7.398 s worker CPU, 8.042 s worker Wall, Wall: 20.242 s, Cores in use: 0.40, Total efficiency (on 16 cores): 2.5 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/PGC2062544-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/PGC2062544-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T09:50:57.137215 Cut to 1 unWISE tiles Reading WISE tile 2741p348 band 2 Reading WISE tile 2741p348 band 3 Reading WISE tile 2741p348 band 1 Reading WISE tile 2741p348 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 801 MB, VmSize: 801 MB, VmRSS: 144 MB, VmData: 175 MB, maxrss: 0.186584 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 811 MB, VmSize: 797 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.203992 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 811 MB, VmSize: 799 MB, VmRSS: 143 MB, VmData: 173 MB, maxrss: 0.206696 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 812 MB, VmSize: 797 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.2038 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/tmp-legacysurvey-custom-273629p35308-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/tmp-legacysurvey-custom-273629p35308-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 10.04 s, CPU: 0.42 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 287 MB, VmData: 313 MB, maxrss: 0.29438 MB Stage wise_forced finished: 2020-08-07T09:51:07.173972 Resources for stage wise_forced : 3.000 s worker CPU, 18.539 s worker Wall, Wall: 10.038 s, Cores in use: 0.34, Total efficiency (on 16 cores): 2.1 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/PGC2062544-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/PGC2062544-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T09:51:07.189385 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/coadd/cus/custom-273629p35308/legacysurvey-custom-273629p35308-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/tractor-i/cus/tractor-custom-273629p35308.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/tractor/cus/tractor-custom-273629p35308.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/tractor/cus/brick-custom-273629p35308.sha256sum Stage writecat : Wall: 1.06 s, CPU: 0.62 s, VmPeak: 1181 MB, VmSize: 1053 MB, VmRSS: 289 MB, VmData: 313 MB, maxrss: 0.427264 MB Stage writecat finished: 2020-08-07T09:51:08.245820 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.058 s, Cores in use: 0.58, Total efficiency (on 16 cores): 3.7 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/PGC2062544-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2062544/PGC2062544-largegalaxy-writecat.p All done: 43.846 s worker CPU, 222.849 s worker Wall, Wall: 147.459 s, Cores in use: 0.38, Total efficiency (on 16 cores): 2.3 % Finished galaxy PGC2062544 in 2.515 minutes.