Started working on galaxy PGC214700 at Wed Aug 5 21:14:08 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 280.2039525 36.125465399999996 --width 275 --height 275 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/PGC214700-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/PGC214700-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T21:14:10.112823 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '280.2039525', '36.125465399999996', '--width', '275', '--height', '275', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/PGC214700-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/PGC214700-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 280.2039525 36.125465399999996 --width 275 --height 275 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/PGC214700-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/PGC214700-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 280.2039525 36.125465399999996 Starting process 8887 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 8888 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 8889 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 8890 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 8891 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 8892 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 8893 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 8894 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 8895 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 8896 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 8897 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 8898 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 8899 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 8900 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 8901 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 8902 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T21:14:11.326531 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 12 CCDs: k4m_180131_125937_ooi_zd_ls9-CCD2 z expnum 159337 exptime 119.103 propid 2016A-0453 seeing 0.90 MJD 58149.541 object MzLS_583504_z mosaic/CP/V4.3/CP20180130/k4m_180131_125937_ooi_zd_ls9.fits.fz k4m_170831_062409_ooi_zd_ls9-CCD2 z expnum 137462 exptime 248.104 propid 2016A-0453 seeing 1.37 MJD 57996.267 object MzLS_583504_z mosaic/CP/V4.3/CP20170830/k4m_170831_062409_ooi_zd_ls9.fits.fz k4m_160504_111948_ooi_zd_ls9-CCD1 z expnum 87092 exptime 80.105 propid 2016A-0453 seeing 1.06 MJD 57512.472 object MzLS_585532_z mosaic/CP/V4.3/CP20160503/k4m_160504_111948_ooi_zd_ls9.fits.fz k4m_160424_120017_ooi_zd_ls9-CCD4 z expnum 84601 exptime 115.103 propid 2016A seeing 0.92 MJD 57502.500 object MzLS_584519_z mosaic/CP/V4.3/CP20160423/k4m_160424_120017_ooi_zd_ls9.fits.fz ksb_160604_085356_ooi_r_ls9-CCD3 r expnum 75430157 exptime 65.2 propid BASS seeing 1.06 MJD 57543.371 object 61071 90prime/CP/V2.3/CP20160603/ksb_160604_085356_ooi_r_ls9.fits.fz ksb_160513_105947_ooi_r_ls9-CCD2 r expnum 75210222 exptime 64.099 propid BASS seeing 1.18 MJD 57521.458 object 61062 90prime/CP/V2.3/CP20160512/ksb_160513_105947_ooi_r_ls9.fits.fz ksb_160602_092003_ooi_g_ls9-CCD2 g expnum 75410147 exptime 138.3 propid BASS seeing 1.14 MJD 57541.389 object 61062 90prime/CP/V2.3/CP20160601/ksb_160602_092003_ooi_g_ls9.fits.fz ksb_160602_091627_ooi_g_ls9-CCD4 g expnum 75410146 exptime 160.6 propid BASS seeing 1.23 MJD 57541.386 object 61072 90prime/CP/V2.3/CP20160601/ksb_160602_091627_ooi_g_ls9.fits.fz ksb_160513_110147_ooi_r_ls9-CCD4 r expnum 75210223 exptime 71.1 propid BASS seeing 1.07 MJD 57521.460 object 61072 90prime/CP/V2.3/CP20160512/ksb_160513_110147_ooi_r_ls9.fits.fz ksb_160628_071246_ooi_g_ls9-CCD3 g expnum 75670103 exptime 119.6 propid BASS seeing 1.28 MJD 57567.301 object 61073 90prime/CP/V2.3/CP20160627/ksb_160628_071246_ooi_g_ls9.fits.fz ksb_180518_091601_ooi_r_ls9-CCD3 r expnum 82560169 exptime 180.206 propid NOTBASS seeing 1.58 MJD 58256.386 object 61073 90prime/CP/V2.3/CP20180517/ksb_180518_091601_ooi_r_ls9.fits.fz ksb_160603_093719_ooi_g_ls9-CCD3 g expnum 75420145 exptime 92.7 propid BASS seeing 1.36 MJD 57542.401 object 61071 90prime/CP/V2.3/CP20160602/ksb_160603_093719_ooi_g_ls9.fits.fz Faked up EXPNUM 75670103 Faked up EXPNUM 75670103 Faked up EXPNUM 75670103 90prime get_fwhm: self.fwhm = 2.83 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1053 1214 and amp range 0 2015 and image y 15 159 and amp range 0 2047 Faked up EXPNUM 75420145 Faked up EXPNUM 75420145 Faked up EXPNUM 75420145 90prime get_fwhm: self.fwhm = 3.01 Found 4 relevant rows in amp-corrections file. Range in image: x 0 162 , y 0 145 (with image size 162 x 145) dzp -0.03470582 -> scaling image by 0.9685402452207784 Found overlap: image x 3051 3211 and amp range 2016 4031 and image y 1980 2140 and amp range 0 2047 Range in image: x 0 161 , y 0 68 (with image size 161 x 161) dzp -0.0022715968 -> scaling image by 0.9979099691834846 Found overlap: image x 3051 3211 and amp range 2016 4031 and image y 1980 2140 and amp range 2048 4095 Range in image: x 0 161 , y 68 161 (with image size 161 x 161) dzp -0.0012536051 -> scaling image by 0.9988460533227724 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 5.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3007 3290 and amp range 2048 4095 and image y 1528 1811 and amp range 0 2039 Range in image: x 0 284 , y 0 284 (with image size 284 x 284) dzp -0.012875672 -> scaling image by 0.9882111074411305 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1880 2158 and amp range 0 2005 and image y 2722 3000 and amp range 2040 4078 Range in image: x 0 126 , y 0 279 (with image size 279 x 279) dzp -0.005990375 -> scaling image by 0.994497853444703 Found overlap: image x 1880 2158 and amp range 2006 4053 and image y 2722 3000 and amp range 2040 4078 Range in image: x 126 279 , y 0 279 (with image size 279 x 279) dzp -0.006092005 -> scaling image by 0.9944047680378836 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75430157 Faked up EXPNUM 75430157 Faked up EXPNUM 75430157 90prime get_fwhm: self.fwhm = 2.35 Found 4 relevant rows in amp-corrections file. Faked up EXPNUM 82560169 Faked up EXPNUM 82560169 Faked up EXPNUM 82560169 90prime get_fwhm: self.fwhm = 3.49 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1055 1216 and amp range 0 2015 and image y 15 168 and amp range 0 2047 Found overlap: image x 3070 3229 and amp range 2016 4031 and image y 1995 2155 and amp range 0 2047 Range in image: x 0 162 , y 0 154 (with image size 162 x 154) Range in image: x 0 160 , y 0 53 (with image size 160 x 161) dzp -0.039144866 -> scaling image by 0.9645884414840357 dzp 0.004245165 -> scaling image by 1.0039175950705865 Found overlap: image x 3070 3229 and amp range 2016 4031 and image y 1995 2155 and amp range 2048 4095 Range in image: x 0 160 , y 53 161 (with image size 160 x 161) dzp -0.0005558773 -> scaling image by 0.99948814914245 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75210222 Faked up EXPNUM 75210222 Faked up EXPNUM 75210222 90prime get_fwhm: self.fwhm = 2.61 Found 4 relevant rows in amp-corrections file. Found overlap: image x 786 948 and amp range 0 2015 and image y 403 566 and amp range 0 2047 Range in image: x 0 163 , y 0 164 (with image size 163 x 164) dzp -0.006045583 -> scaling image by 0.9944472857505693 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3023 3307 and amp range 2048 4095 and image y 1540 1822 and amp range 0 2039 Range in image: x 0 285 , y 0 283 (with image size 285 x 283) dzp -0.012875672 -> scaling image by 0.9882111074411305 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.53 Found 4 relevant rows in amp-corrections file. Found overlap: image x 304 580 and amp range 0 2047 and image y 64 340 and amp range 0 2021 Range in image: x 0 277 , y 0 277 (with image size 277 x 277) dzp 0.005139143 -> scaling image by 1.0047445456970268 Faked up EXPNUM 75210223 Faked up EXPNUM 75210223 Faked up EXPNUM 75210223 90prime get_fwhm: self.fwhm = 2.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 869 1029 and amp range 0 2015 and image y 3976 4080 and amp range 2048 4095 Range in image: x 0 161 , y 0 105 (with image size 161 x 105) dzp 0.004205519 -> scaling image by 1.0038809374310762 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75410146 Faked up EXPNUM 75410146 Faked up EXPNUM 75410146 90prime get_fwhm: self.fwhm = 2.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 864 1024 and amp range 0 2015 and image y 3969 4080 and amp range 2048 4095 Range in image: x 0 161 , y 0 112 (with image size 161 x 112) dzp 0.009255477 -> scaling image by 1.0085610475070432 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75410147 Faked up EXPNUM 75410147 Faked up EXPNUM 75410147 90prime get_fwhm: self.fwhm = 2.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 790 951 and amp range 0 2015 and image y 392 555 and amp range 0 2047 Range in image: x 0 162 , y 0 164 (with image size 162 x 164) dzp -0.008523628 -> scaling image by 0.992180183483648 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 16.94 s, CPU: 1.07 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 177 MB, VmData: 209 MB, maxrss: 0.18106 MB Stage tims finished: 2020-08-05T21:14:28.267562 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 7.037 s worker CPU, 43.586 s worker Wall, Wall: 16.943 s, Cores in use: 0.48, Total efficiency (on 16 cores): 3.0 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/PGC214700-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/PGC214700-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T21:14:28.362735 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02595.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02468.fits Matched 5 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/metrics/cus/reference-custom-280203p36125.fits Stage refs : Wall: 18.41 s, CPU: 10.41 s, VmPeak: 1081 MB, VmSize: 1075 MB, VmRSS: 297 MB, VmData: 326 MB, maxrss: 0.303664 MB Stage refs finished: 2020-08-05T21:14:46.769265 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 18.408 s, Cores in use: 0.57, Total efficiency (on 16 cores): 3.5 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/PGC214700-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/PGC214700-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T21:14:46.861129 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/metrics/cus/outlier-mask-custom-280203p36125.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/metrics/cus/outliers-pre-custom-280203p36125.jpg Image ksb_160602_091627_ooi_g_ls9-CCD4 g : masking 85 positive outlier pixels and 0 negative outlier pixels Image ksb_160602_092003_ooi_g_ls9-CCD2 g : masking 38 positive outlier pixels and 0 negative outlier pixels Image ksb_160603_093719_ooi_g_ls9-CCD3 g : masking 73 positive outlier pixels and 0 negative outlier pixels Image ksb_160604_085356_ooi_r_ls9-CCD3 r : masking 98 positive outlier pixels and 0 negative outlier pixels Image ksb_180518_091601_ooi_r_ls9-CCD3 r : masking 378 positive outlier pixels and 0 negative outlier pixels Image ksb_160513_105947_ooi_r_ls9-CCD2 r : masking 96 positive outlier pixels and 0 negative outlier pixels Image k4m_160424_120017_ooi_zd_ls9-CCD4 z : masking 3160 positive outlier pixels and 0 negative outlier pixels Image k4m_180131_125937_ooi_zd_ls9-CCD2 z : masking 883 positive outlier pixels and 0 negative outlier pixels Image k4m_170831_062409_ooi_zd_ls9-CCD2 z : masking 1386 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/metrics/cus/outlier-mask-custom-280203p36125.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/metrics/cus/outliers-post-custom-280203p36125.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/metrics/cus/outliers-masked-pos-custom-280203p36125.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/metrics/cus/outliers-masked-neg-custom-280203p36125.jpg Stage outliers : Wall: 2.36 s, CPU: 1.95 s, VmPeak: 1085 MB, VmSize: 1085 MB, VmRSS: 314 MB, VmData: 341 MB, maxrss: 0.321504 MB Stage outliers finished: 2020-08-05T21:14:49.225443 Resources for stage outliers : 1.160 s worker CPU, 1.206 s worker Wall, Wall: 2.366 s, Cores in use: 1.31, Total efficiency (on 16 cores): 8.2 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/PGC214700-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/PGC214700-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T21:14:49.320071 Stage halos : Wall: 1.29 s, CPU: 1.27 s, VmPeak: 1085 MB, VmSize: 1085 MB, VmRSS: 314 MB, VmData: 341 MB, maxrss: 0.321504 MB Stage halos finished: 2020-08-05T21:14:50.610799 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 1.292 s, Cores in use: 0.98, Total efficiency (on 16 cores): 6.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/PGC214700-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/PGC214700-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T21:14:50.759154 PSF sigmas in coadd pixels: ['1.85', '1.99', '2.08', '2.21'] Using average PSF sigma 2.034625128041 Gaussian PSF norm 0.13864705978810343 vs pixelized 0.1151047 average tim pixel scale / coadd scale: 1.7292643548433762 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.73', '1.92', '1.73', '2.57'] Using average PSF sigma 1.9873450567523387 Gaussian PSF norm 0.14194555234150896 vs pixelized 0.108467616 average tim pixel scale / coadd scale: 1.729653907392373 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.46', '2.23', '1.72', '1.49'] Using average PSF sigma 1.7267955896079994 Gaussian PSF norm 0.16336316439047463 vs pixelized 0.13153392 average tim pixel scale / coadd scale: 0.9909676481660398 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.22 s, CPU: 0.20 s, VmPeak: 1085 MB, VmSize: 1085 MB, VmRSS: 317 MB, VmData: 343 MB, maxrss: 0.324496 MB Stage fit_on_coadds finished: 2020-08-05T21:14:50.983732 Resources for stage fit_on_coadds : 0.248 s worker CPU, 0.248 s worker Wall, Wall: 0.226 s, Cores in use: 1.99, Total efficiency (on 16 cores): 12.4 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/PGC214700-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/PGC214700-largegalaxy-fit_on_coadds.p Running stage srcs Warning: Stellar halo subtraction is only implemented for DECam Running stage srcs at 2020-08-05T21:14:50.999285 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 47 potential peaks Of 47 potential peaks: 16 in veto map, 7 cut by saddle test, 0 cut by aper test, 24 kept SED z : 24 new peaks Found 50 potential peaks Of 50 potential peaks: 44 in veto map, 2 cut by saddle test, 0 cut by aper test, 4 kept SED r : 4 new peaks Found 43 potential peaks Of 43 potential peaks: 40 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 62 potential peaks Of 62 potential peaks: 56 in veto map, 3 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 56 potential peaks Of 56 potential peaks: 52 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 32 new sources Median coadd sky for g : 8.0681435e-05 Median coadd sky for r : 0.00011743774 Median coadd sky for z : -0.00015524175 Stage srcs : Wall: 1.26 s, CPU: 1.21 s, VmPeak: 1085 MB, VmSize: 1085 MB, VmRSS: 318 MB, VmData: 343 MB, maxrss: 0.325252 MB Stage srcs finished: 2020-08-05T21:14:52.256535 Resources for stage srcs : 0.086 s worker CPU, 0.086 s worker Wall, Wall: 1.259 s, Cores in use: 1.03, Total efficiency (on 16 cores): 6.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/PGC214700-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/PGC214700-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T21:14:52.272565 Blob 1 of 17, id: 2, sources: 21, size: 165x268, npix 23231, brick X: 76,241, Y: 7,275, one pixel: 177 7 Blob 2 of 17, id: 8, sources: 3, size: 71x49, npix 2258, brick X: 13,84, Y: 102,151, one pixel: 54 102 Blob 3 of 17, id: 13, sources: 5, size: 40x62, npix 1774, brick X: 235,275, Y: 196,258, one pixel: 250 196 Blob 4 of 17, id: 4, sources: 2, size: 44x49, npix 1662, brick X: 231,275, Y: 24,73, one pixel: 251 24 Blob 5 of 17, id: 11, sources: 3, size: 46x60, npix 1491, brick X: 57,103, Y: 158,218, one pixel: 90 158 Blob 6 of 17, id: 14, sources: 2, size: 41x45, npix 1228, brick X: 191,232, Y: 230,275, one pixel: 218 230 Blob 7 of 17, id: 7, sources: 2, size: 33x37, npix 783, brick X: 242,275, Y: 77,114, one pixel: 253 77 Blob 8 of 17, id: 10, sources: 1, size: 34x32, npix 724, brick X: 16,50, Y: 153,185, one pixel: 31 153 Blob 9 of 17, id: 1, sources: 1, size: 34x26, npix 674, brick X: 222,256, Y: 0,26, one pixel: 228 0 Blob 10 of 17, id: 12, sources: 2, size: 25x41, npix 669, brick X: 204,229, Y: 189,230, one pixel: 214 189 Blob 11 of 17, id: 6, sources: 1, size: 24x25, npix 367, brick X: 200,224, Y: 41,66, one pixel: 210 41 Blob 12 of 17, id: 16, sources: 1, size: 24x24, npix 340, brick X: 39,63, Y: 242,266, one pixel: 49 242 Blob 13 of 17, id: 0, sources: 3, size: 28x16, npix 316, brick X: 70,98, Y: 0,16, one pixel: 73 0 Blob 14 of 17, id: 3, sources: 1, size: 22x22, npix 291, brick X: 3,25, Y: 17,39, one pixel: 14 17 Blob 15 of 17, id: 5, sources: 1, size: 22x21, npix 291, brick X: 65,87, Y: 32,53, one pixel: 73 32 Blob 16 of 17, id: 15, sources: 1, size: 21x20, npix 239, brick X: 14,35, Y: 242,262, one pixel: 23 242 Blob 17 of 17, id: 9, sources: 1, size: 18x18, npix 171, brick X: 203,221, Y: 106,124, one pixel: 211 106 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (280.20897, 36.11471), pm (-2.9, -6.0), parallax 0.276 with NanoMaggies: g=18.2, r=17.4, z=18.2 Reset brightness to NanoMaggies: g=18.4, r=17.8, z=17.5 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (280.20867, 36.11507), pm (-3.8, -11.8), parallax 0.433 with NanoMaggies: g=20.2, r=18.9, z=18.3 Reset brightness to NanoMaggies: g=19.5, r=18.5, z=18 Blob 13 finished, total: Wall: 0.18 s, CPU: 0.17 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 90 MB, VmData: 140 MB, maxrss: 0.0918 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (280.19111, 36.11810), pm (-1.2, 1.9), parallax -0.363 with NanoMaggies: g=20.7, r=20.4, z=19.6 Reset brightness to NanoMaggies: g=20.9, r=20.6, z=20.5 Measuring 1 iterative sources Blob 14 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 814 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150972 MB Blob 17 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 90 MB, VmData: 140 MB, maxrss: 0.091932 MB Blob 15 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 810 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.151024 MB Blob 16 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 806 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.15062 MB Blob 11 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.09354 MB Blob 12 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.15118 MB Blob 9 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149416 MB Blob 4 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 95 MB, VmData: 140 MB, maxrss: 0.096828 MB Blob 10 finished, total: Wall: 0.90 s, CPU: 0.90 s, VmPeak: 808 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151056 MB Blob 8 finished, total: Wall: 1.02 s, CPU: 1.02 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151864 MB Blob 2 finished, total: Wall: 1.08 s, CPU: 1.08 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.094352 MB Measuring 1 iterative sources Blob 7 finished, total: Wall: 1.24 s, CPU: 1.23 s, VmPeak: 814 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151184 MB Measuring 1 iterative sources Blob 5 finished, total: Wall: 1.61 s, CPU: 1.61 s, VmPeak: 815 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.152004 MB Blob 6 finished, total: Wall: 1.61 s, CPU: 1.61 s, VmPeak: 814 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151808 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (280.19149, 36.13151), pm (0.7, -1.0), parallax 0.344 with NanoMaggies: g=18, r=17.3, z=16.8 Reset brightness to NanoMaggies: g=18, r=17.2, z=16.8 Blob 3 finished, total: Wall: 1.89 s, CPU: 1.89 s, VmPeak: 810 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.15098 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.61114, ee1=0.746243, ee2=-0.313312 Measuring 9 iterative sources Blob 1 finished, total: Wall: 24.13 s, CPU: 24.13 s, VmPeak: 819 MB, VmSize: 741 MB, VmRSS: 163 MB, VmData: 192 MB, maxrss: 0.167324 MB Old catalog: 64 New catalog: 58 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/metrics/cus/blobs-custom-280203p36125.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/metrics/cus/all-models-custom-280203p36125.fits Stage fitblobs : Wall: 25.18 s, CPU: 0.81 s, VmPeak: 1085 MB, VmSize: 1085 MB, VmRSS: 318 MB, VmData: 343 MB, maxrss: 0.325608 MB Stage fitblobs finished: 2020-08-05T21:15:17.453413 Resources for stage fitblobs : 37.510 s worker CPU, 37.638 s worker Wall, Wall: 25.182 s, Cores in use: 1.52, Total efficiency (on 16 cores): 9.5 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/PGC214700-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/PGC214700-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T21:15:17.549136 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/tmp-legacysurvey-custom-280203p36125-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/tmp-legacysurvey-custom-280203p36125-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/tmp-legacysurvey-custom-280203p36125-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/tmp-legacysurvey-custom-280203p36125-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-resid.jpg Stage coadds : Wall: 3.74 s, CPU: 1.37 s, VmPeak: 1085 MB, VmSize: 1085 MB, VmRSS: 318 MB, VmData: 343 MB, maxrss: 0.325932 MB Stage coadds finished: 2020-08-05T21:15:21.287185 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 8.231 s worker CPU, 12.339 s worker Wall, Wall: 3.739 s, Cores in use: 2.57, Total efficiency (on 16 cores): 16.0 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/PGC214700-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/PGC214700-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T21:15:21.307283 Cut to 1 unWISE tiles Reading WISE tile 2797p363 band 1 Reading WISE tile 2797p363 band 3 Reading WISE tile 2797p363 band 2 Reading WISE tile 2797p363 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 813 MB, VmSize: 804 MB, VmRSS: 144 MB, VmData: 171 MB, maxrss: 0.20816 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 813 MB, VmSize: 806 MB, VmRSS: 146 MB, VmData: 173 MB, maxrss: 0.209584 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 810 MB, VmSize: 804 MB, VmRSS: 144 MB, VmData: 171 MB, maxrss: 0.207664 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 813 MB, VmSize: 810 MB, VmRSS: 151 MB, VmData: 178 MB, maxrss: 0.192084 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/tmp-legacysurvey-custom-280203p36125-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/tmp-legacysurvey-custom-280203p36125-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 7.35 s, CPU: 0.76 s, VmPeak: 1085 MB, VmSize: 1085 MB, VmRSS: 319 MB, VmData: 343 MB, maxrss: 0.326444 MB Stage wise_forced finished: 2020-08-05T21:15:28.661448 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.248 s worker CPU, 10.077 s worker Wall, Wall: 7.356 s, Cores in use: 0.55, Total efficiency (on 16 cores): 3.4 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/PGC214700-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/PGC214700-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T21:15:28.679945 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/tractor-i/cus/tractor-custom-280203p36125.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/tractor/cus/tractor-custom-280203p36125.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/tractor/cus/brick-custom-280203p36125.sha256sum Stage writecat : Wall: 1.52 s, CPU: 0.77 s, VmPeak: 1217 MB, VmSize: 1089 MB, VmRSS: 321 MB, VmData: 343 MB, maxrss: 0.459324 MB Stage writecat finished: 2020-08-05T21:15:30.200287 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.522 s, Cores in use: 0.51, Total efficiency (on 16 cores): 3.2 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/PGC214700-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/280/PGC214700/PGC214700-largegalaxy-writecat.p All done: 57.524 s worker CPU, 105.185 s worker Wall, Wall: 78.897 s, Cores in use: 0.98, Total efficiency (on 16 cores): 6.1 % Finished galaxy PGC214700 in 1.380 minutes. Started working on galaxy PGC214700 at Fri Aug 7 09:51:07 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 280.2036232248382 36.12532354997579 --width 275 --height 275 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/PGC214700-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/PGC214700-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T09:51:08.323624 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '280.2036232248382', '36.12532354997579', '--width', '275', '--height', '275', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/PGC214700-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/PGC214700-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 280.2036232248382 36.12532354997579 --width 275 --height 275 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/PGC214700-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/PGC214700-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 280.2036232248382 36.12532354997579 Starting process 61482 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 61484 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 61486 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 61488 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 61490 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05934 MB Starting process 61491 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059348 MB Starting process 61493 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059348 MB Starting process 61495 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 61497 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 61499 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 61501 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 61503 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 61505 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 61507 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 61509 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 61513 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T09:51:08.941280 Keeping 12 CCDs: k4m_180131_125937_ooi_zd_ls9-CCD2 z expnum 159337 exptime 119.103 propid 2016A-0453 seeing 0.90 MJD 58149.541 object MzLS_583504_z mosaic/CP/V4.3/CP20180130/k4m_180131_125937_ooi_zd_ls9.fits.fz k4m_170831_062409_ooi_zd_ls9-CCD2 z expnum 137462 exptime 248.104 propid 2016A-0453 seeing 1.37 MJD 57996.267 object MzLS_583504_z mosaic/CP/V4.3/CP20170830/k4m_170831_062409_ooi_zd_ls9.fits.fz k4m_160504_111948_ooi_zd_ls9-CCD1 z expnum 87092 exptime 80.105 propid 2016A-0453 seeing 1.06 MJD 57512.472 object MzLS_585532_z mosaic/CP/V4.3/CP20160503/k4m_160504_111948_ooi_zd_ls9.fits.fz k4m_160424_120017_ooi_zd_ls9-CCD4 z expnum 84601 exptime 115.103 propid 2016A seeing 0.92 MJD 57502.500 object MzLS_584519_z mosaic/CP/V4.3/CP20160423/k4m_160424_120017_ooi_zd_ls9.fits.fz ksb_160604_085356_ooi_r_ls9-CCD3 r expnum 75430157 exptime 65.2 propid BASS seeing 1.06 MJD 57543.371 object 61071 90prime/CP/V2.3/CP20160603/ksb_160604_085356_ooi_r_ls9.fits.fz ksb_160513_105947_ooi_r_ls9-CCD2 r expnum 75210222 exptime 64.099 propid BASS seeing 1.18 MJD 57521.458 object 61062 90prime/CP/V2.3/CP20160512/ksb_160513_105947_ooi_r_ls9.fits.fz ksb_160602_092003_ooi_g_ls9-CCD2 g expnum 75410147 exptime 138.3 propid BASS seeing 1.14 MJD 57541.389 object 61062 90prime/CP/V2.3/CP20160601/ksb_160602_092003_ooi_g_ls9.fits.fz ksb_160602_091627_ooi_g_ls9-CCD4 g expnum 75410146 exptime 160.6 propid BASS seeing 1.23 MJD 57541.386 object 61072 90prime/CP/V2.3/CP20160601/ksb_160602_091627_ooi_g_ls9.fits.fz ksb_160513_110147_ooi_r_ls9-CCD4 r expnum 75210223 exptime 71.1 propid BASS seeing 1.07 MJD 57521.460 object 61072 90prime/CP/V2.3/CP20160512/ksb_160513_110147_ooi_r_ls9.fits.fz ksb_160628_071246_ooi_g_ls9-CCD3 g expnum 75670103 exptime 119.6 propid BASS seeing 1.28 MJD 57567.301 object 61073 90prime/CP/V2.3/CP20160627/ksb_160628_071246_ooi_g_ls9.fits.fz ksb_180518_091601_ooi_r_ls9-CCD3 r expnum 82560169 exptime 180.206 propid NOTBASS seeing 1.58 MJD 58256.386 object 61073 90prime/CP/V2.3/CP20180517/ksb_180518_091601_ooi_r_ls9.fits.fz ksb_160603_093719_ooi_g_ls9-CCD3 g expnum 75420145 exptime 92.7 propid BASS seeing 1.36 MJD 57542.401 object 61071 90prime/CP/V2.3/CP20160602/ksb_160603_093719_ooi_g_ls9.fits.fz Faked up EXPNUM 82560169 Faked up EXPNUM 82560169 Faked up EXPNUM 82560169 90prime get_fwhm: self.fwhm = 3.49 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1056 1217 and amp range 0 2015 and image y 15 170 and amp range 0 2047 Range in image: x 0 162 , y 0 156 (with image size 162 x 156) dzp -0.039144866 -> scaling image by 0.9645884414840357 Faked up EXPNUM 75670103 Faked up EXPNUM 75670103 Faked up EXPNUM 75670103 90prime get_fwhm: self.fwhm = 2.83 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1054 1215 and amp range 0 2015 and image y 15 161 and amp range 0 2047 Range in image: x 0 162 , y 0 147 (with image size 162 x 147) dzp -0.03470582 -> scaling image by 0.9685402452207784 Faked up EXPNUM 75420145 Faked up EXPNUM 75420145 Faked up EXPNUM 75420145 90prime get_fwhm: self.fwhm = 3.01 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3053 3212 and amp range 2016 4031 and image y 1982 2142 and amp range 0 2047 Range in image: x 0 160 , y 0 66 (with image size 160 x 161) dzp -0.0022715968 -> scaling image by 0.9979099691834846 Found overlap: image x 3053 3212 and amp range 2016 4031 and image y 1982 2142 and amp range 2048 4095 Range in image: x 0 160 , y 66 161 (with image size 160 x 161) dzp -0.0012536051 -> scaling image by 0.9988460533227724 Faked up EXPNUM 75430157 Faked up EXPNUM 75430157 Faked up EXPNUM 75430157 90prime get_fwhm: self.fwhm = 2.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3071 3230 and amp range 2016 4031 and image y 1997 2157 and amp range 0 2047 Range in image: x 0 160 , y 0 51 (with image size 160 x 161) dzp 0.004245165 -> scaling image by 1.0039175950705865 Found overlap: image x 3071 3230 and amp range 2016 4031 and image y 1997 2157 and amp range 2048 4095 Range in image: x 0 160 , y 51 161 (with image size 160 x 161) dzp -0.0005558773 -> scaling image by 0.99948814914245 Faked up EXPNUM 75210223 Faked up EXPNUM 75210223 Faked up EXPNUM 75210223 90prime get_fwhm: self.fwhm = 2.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 870 1030 and amp range 0 2015 and image y 3978 4080 and amp range 2048 4095 Range in image: x 0 161 , y 0 103 (with image size 161 x 103) dzp 0.004205519 -> scaling image by 1.0038809374310762 Faked up EXPNUM 75210222 Faked up EXPNUM 75210222 Faked up EXPNUM 75210222 90prime get_fwhm: self.fwhm = 2.61 Found 4 relevant rows in amp-corrections file. Found overlap: image x 788 949 and amp range 0 2015 and image y 405 568 and amp range 0 2047 Range in image: x 0 162 , y 0 164 (with image size 162 x 164) dzp -0.006045583 -> scaling image by 0.9944472857505693 mosaic get_fwhm: self.fwhm = 4.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1878 2156 and amp range 0 2005 and image y 2719 2996 and amp range 2040 4078 Range in image: x 0 128 , y 0 278 (with image size 279 x 278) dzp -0.005990375 -> scaling image by 0.994497853444703 Found overlap: image x 1878 2156 and amp range 2006 4053 and image y 2719 2996 and amp range 2040 4078 Range in image: x 128 279 , y 0 278 (with image size 279 x 278) dzp -0.006092005 -> scaling image by 0.9944047680378836 mosaic get_fwhm: self.fwhm = 5.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3005 3288 and amp range 2048 4095 and image y 1524 1807 and amp range 0 2039 Range in image: x 0 284 , y 0 284 (with image size 284 x 284) dzp -0.012875672 -> scaling image by 0.9882111074411305 mosaic get_fwhm: self.fwhm = 3.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3021 3305 and amp range 2048 4095 and image y 1536 1818 and amp range 0 2039 Range in image: x 0 285 , y 0 283 (with image size 285 x 283) dzp -0.012875672 -> scaling image by 0.9882111074411305 mosaic get_fwhm: self.fwhm = 3.53 Found 4 relevant rows in amp-corrections file. Found overlap: image x 302 578 and amp range 0 2047 and image y 61 336 and amp range 0 2021 Range in image: x 0 277 , y 0 276 (with image size 277 x 276) dzp 0.005139143 -> scaling image by 1.0047445456970268 Faked up EXPNUM 75410146 Faked up EXPNUM 75410146 Faked up EXPNUM 75410146 90prime get_fwhm: self.fwhm = 2.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 865 1025 and amp range 0 2015 and image y 3971 4080 and amp range 2048 4095 Range in image: x 0 161 , y 0 110 (with image size 161 x 110) dzp 0.009255477 -> scaling image by 1.0085610475070432 Faked up EXPNUM 75410147 Faked up EXPNUM 75410147 Faked up EXPNUM 75410147 90prime get_fwhm: self.fwhm = 2.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 791 953 and amp range 0 2015 and image y 394 557 and amp range 0 2047 Range in image: x 0 163 , y 0 164 (with image size 163 x 164) dzp -0.008523628 -> scaling image by 0.992180183483648 Stage tims : Wall: 50.56 s, CPU: 0.90 s, VmPeak: 952 MB, VmSize: 952 MB, VmRSS: 175 MB, VmData: 209 MB, maxrss: 0.17918 MB Stage tims finished: 2020-08-07T09:51:59.500584 Resources for stage tims : 6.404 s worker CPU, 98.540 s worker Wall, Wall: 50.561 s, Cores in use: 0.14, Total efficiency (on 16 cores): 0.9 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/PGC214700-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/PGC214700-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T09:52:05.479110 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02595.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02468.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/metrics/cus/reference-custom-280203p36125.fits Stage refs : Wall: 33.22 s, CPU: 10.17 s, VmPeak: 1075 MB, VmSize: 1069 MB, VmRSS: 295 MB, VmData: 326 MB, maxrss: 0.301744 MB Stage refs finished: 2020-08-07T09:52:38.694964 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 33.218 s, Cores in use: 0.31, Total efficiency (on 16 cores): 1.9 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/PGC214700-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/PGC214700-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T09:52:38.811477 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/metrics/cus/outlier-mask-custom-280203p36125.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/metrics/cus/outliers-pre-custom-280203p36125.jpg Image ksb_160602_092003_ooi_g_ls9-CCD2 g : masking 45 positive outlier pixels and 0 negative outlier pixels Image ksb_160628_071246_ooi_g_ls9-CCD3 g : masking 23 positive outlier pixels and 0 negative outlier pixels Image ksb_160602_091627_ooi_g_ls9-CCD4 g : masking 80 positive outlier pixels and 0 negative outlier pixels Image ksb_160603_093719_ooi_g_ls9-CCD3 g : masking 69 positive outlier pixels and 0 negative outlier pixels Image ksb_160604_085356_ooi_r_ls9-CCD3 r : masking 82 positive outlier pixels and 0 negative outlier pixels Image ksb_180518_091601_ooi_r_ls9-CCD3 r : masking 316 positive outlier pixels and 0 negative outlier pixels Image ksb_160513_105947_ooi_r_ls9-CCD2 r : masking 98 positive outlier pixels and 0 negative outlier pixels Image k4m_180131_125937_ooi_zd_ls9-CCD2 z : masking 930 positive outlier pixels and 0 negative outlier pixels Image k4m_170831_062409_ooi_zd_ls9-CCD2 z : masking 1642 positive outlier pixels and 0 negative outlier pixels Image k4m_160424_120017_ooi_zd_ls9-CCD4 z : masking 3192 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/metrics/cus/outlier-mask-custom-280203p36125.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/metrics/cus/outliers-post-custom-280203p36125.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/metrics/cus/outliers-masked-pos-custom-280203p36125.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/metrics/cus/outliers-masked-neg-custom-280203p36125.jpg Stage outliers : Wall: 1.02 s, CPU: 0.69 s, VmPeak: 1078 MB, VmSize: 1078 MB, VmRSS: 313 MB, VmData: 341 MB, maxrss: 0.32032 MB Stage outliers finished: 2020-08-07T09:52:39.828962 Resources for stage outliers : 1.122 s worker CPU, 1.186 s worker Wall, Wall: 1.019 s, Cores in use: 1.78, Total efficiency (on 16 cores): 11.1 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/PGC214700-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/PGC214700-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T09:52:39.864685 Stage halos : Wall: 0.38 s, CPU: 0.37 s, VmPeak: 1078 MB, VmSize: 1078 MB, VmRSS: 313 MB, VmData: 341 MB, maxrss: 0.320324 MB Stage halos finished: 2020-08-07T09:52:40.249777 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.386 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/PGC214700-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/PGC214700-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T09:52:40.380291 PSF sigmas in coadd pixels: ['1.85', '1.99', '2.08', '2.21'] Using average PSF sigma 2.034625128041 Gaussian PSF norm 0.13864705978810343 vs pixelized 0.11510273 average tim pixel scale / coadd scale: 1.7292643548433762 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.73', '1.92', '1.73', '2.57'] Using average PSF sigma 1.9873450567523387 Gaussian PSF norm 0.14194555234150896 vs pixelized 0.1084642 average tim pixel scale / coadd scale: 1.729653907392373 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.46', '2.23', '1.72', '1.49'] Using average PSF sigma 1.7267955896079994 Gaussian PSF norm 0.16336316439047463 vs pixelized 0.13153495 average tim pixel scale / coadd scale: 0.9909676481660398 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.29 s, CPU: 0.20 s, VmPeak: 1078 MB, VmSize: 1078 MB, VmRSS: 315 MB, VmData: 342 MB, maxrss: 0.322272 MB Stage fit_on_coadds finished: 2020-08-07T09:52:40.666143 Resources for stage fit_on_coadds : 0.243 s worker CPU, 0.243 s worker Wall, Wall: 0.287 s, Cores in use: 1.55, Total efficiency (on 16 cores): 9.7 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/PGC214700-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/PGC214700-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T09:52:40.677659 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 51 potential peaks Of 51 potential peaks: 18 in veto map, 6 cut by saddle test, 0 cut by aper test, 27 kept SED z : 27 new peaks Found 50 potential peaks Of 50 potential peaks: 45 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 45 potential peaks Of 45 potential peaks: 41 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 64 potential peaks Of 64 potential peaks: 57 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 59 potential peaks Of 59 potential peaks: 54 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 33 new sources Median coadd sky for g : 6.792149e-05 Median coadd sky for r : 0.00010205385 Median coadd sky for z : -0.00017238373 Stage srcs : Wall: 0.58 s, CPU: 0.54 s, VmPeak: 1078 MB, VmSize: 1078 MB, VmRSS: 315 MB, VmData: 342 MB, maxrss: 0.322756 MB Stage srcs finished: 2020-08-07T09:52:41.260300 Resources for stage srcs : 0.081 s worker CPU, 0.081 s worker Wall, Wall: 0.584 s, Cores in use: 1.07, Total efficiency (on 16 cores): 6.7 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/PGC214700-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/PGC214700-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T09:52:41.273731 Blob 1 of 17, id: 2, sources: 20, size: 166x266, npix 23190, brick X: 72,238, Y: 9,275, one pixel: 173 9 Blob 2 of 17, id: 8, sources: 3, size: 71x49, npix 2251, brick X: 9,80, Y: 104,153, one pixel: 50 104 Blob 3 of 17, id: 13, sources: 4, size: 44x62, npix 1965, brick X: 231,275, Y: 198,260, one pixel: 246 198 Blob 4 of 17, id: 4, sources: 3, size: 48x50, npix 1807, brick X: 227,275, Y: 25,75, one pixel: 270 25 Blob 5 of 17, id: 11, sources: 3, size: 46x60, npix 1499, brick X: 54,100, Y: 160,220, one pixel: 86 160 Blob 6 of 17, id: 14, sources: 2, size: 41x43, npix 1168, brick X: 187,228, Y: 232,275, one pixel: 214 232 Blob 7 of 17, id: 7, sources: 4, size: 36x57, npix 1080, brick X: 239,275, Y: 79,136, one pixel: 250 79 Blob 8 of 17, id: 1, sources: 2, size: 45x28, npix 832, brick X: 218,263, Y: 0,28, one pixel: 225 0 Blob 9 of 17, id: 10, sources: 1, size: 34x32, npix 725, brick X: 12,46, Y: 155,187, one pixel: 27 155 Blob 10 of 17, id: 12, sources: 2, size: 24x41, npix 668, brick X: 201,225, Y: 191,232, one pixel: 211 191 Blob 11 of 17, id: 0, sources: 3, size: 34x19, npix 443, brick X: 63,97, Y: 0,19, one pixel: 66 0 Blob 12 of 17, id: 6, sources: 1, size: 25x24, npix 367, brick X: 196,221, Y: 43,67, one pixel: 206 43 Blob 13 of 17, id: 16, sources: 1, size: 24x24, npix 342, brick X: 35,59, Y: 244,268, one pixel: 45 244 Blob 14 of 17, id: 3, sources: 1, size: 21x22, npix 288, brick X: 0,21, Y: 19,41, one pixel: 10 19 Blob 15 of 17, id: 5, sources: 1, size: 22x21, npix 281, brick X: 61,83, Y: 34,55, one pixel: 70 34 Blob 16 of 17, id: 15, sources: 1, size: 20x20, npix 238, brick X: 11,31, Y: 244,264, one pixel: 19 244 Blob 17 of 17, id: 9, sources: 1, size: 18x18, npix 180, brick X: 199,217, Y: 108,126, one pixel: 207 108 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (280.20897, 36.11471), pm (-2.9, -6.0), parallax 0.276 with NanoMaggies: g=18.4, r=17.5, z=18.3 Reset brightness to NanoMaggies: g=18.4, r=17.8, z=17.5 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (280.20867, 36.11507), pm (-3.8, -11.8), parallax 0.433 with NanoMaggies: g=19.7, r=18.8, z=18.1 Reset brightness to NanoMaggies: g=19.5, r=18.5, z=18 Blob 11 finished, total: Wall: 0.17 s, CPU: 0.17 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14648 MB Blob 14 finished, total: Wall: 0.25 s, CPU: 0.24 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14678 MB Blob 17 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14648 MB Blob 16 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095252 MB Blob 15 finished, total: Wall: 0.34 s, CPU: 0.28 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146832 MB Blob 12 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14706 MB Blob 13 finished, total: Wall: 0.52 s, CPU: 0.43 s, VmPeak: 819 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147412 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (280.19111, 36.11810), pm (-1.2, 1.9), parallax -0.363 with NanoMaggies: g=21.2, r=20.6, z=20.3 Reset brightness to NanoMaggies: g=20.9, r=20.6, z=20.5 Measuring 1 iterative sources Blob 10 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 815 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147636 MB Blob 9 finished, total: Wall: 1.03 s, CPU: 1.03 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147664 MB Blob 2 finished, total: Wall: 1.09 s, CPU: 1.09 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147524 MB Blob 4 finished, total: Wall: 1.18 s, CPU: 1.18 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095076 MB Measuring 1 iterative sources Measuring 1 iterative sources Blob 8 finished, total: Wall: 1.34 s, CPU: 1.34 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147284 MB Blob 5 finished, total: Wall: 1.45 s, CPU: 1.45 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.1477 MB Blob 3 finished, total: Wall: 1.63 s, CPU: 1.63 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147672 MB Blob 6 finished, total: Wall: 1.64 s, CPU: 1.64 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.094016 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (280.18861, 36.12459), pm (1.9, -3.3), parallax -0.337 with NanoMaggies: g=20.5, r=19.6, z=15.6 Reset brightness to NanoMaggies: g=20.5, r=19.6, z=19.2 Blob 7 finished, total: Wall: 1.84 s, CPU: 1.83 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095076 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.31545, ee1=0.67052, ee2=-0.279047 Measuring 11 iterative sources Blob 1 finished, total: Wall: 21.56 s, CPU: 21.55 s, VmPeak: 813 MB, VmSize: 735 MB, VmRSS: 159 MB, VmData: 190 MB, maxrss: 0.162492 MB Old catalog: 65 New catalog: 61 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/metrics/cus/blobs-custom-280203p36125.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/metrics/cus/all-models-custom-280203p36125.fits Stage fitblobs : Wall: 22.05 s, CPU: 0.46 s, VmPeak: 1078 MB, VmSize: 1078 MB, VmRSS: 316 MB, VmData: 342 MB, maxrss: 0.323112 MB Stage fitblobs finished: 2020-08-07T09:53:03.320083 Resources for stage fitblobs : 35.799 s worker CPU, 36.134 s worker Wall, Wall: 22.048 s, Cores in use: 1.64, Total efficiency (on 16 cores): 10.3 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/PGC214700-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/PGC214700-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T09:53:03.364578 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/tmp-legacysurvey-custom-280203p36125-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/tmp-legacysurvey-custom-280203p36125-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/tmp-legacysurvey-custom-280203p36125-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/tmp-legacysurvey-custom-280203p36125-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-resid.jpg Stage coadds : Wall: 17.43 s, CPU: 0.65 s, VmPeak: 1078 MB, VmSize: 1078 MB, VmRSS: 316 MB, VmData: 342 MB, maxrss: 0.323436 MB Stage coadds finished: 2020-08-07T09:53:20.798226 Resources for stage coadds : 8.041 s worker CPU, 8.504 s worker Wall, Wall: 17.435 s, Cores in use: 0.50, Total efficiency (on 16 cores): 3.1 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/PGC214700-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/PGC214700-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T09:53:20.814012 Cut to 1 unWISE tiles Reading WISE tile 2797p363 band 1 Reading WISE tile 2797p363 band 2 Reading WISE tile 2797p363 band 3 Reading WISE tile 2797p363 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.25 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.204336 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.19 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.204356 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.18 s, VmPeak: 1130 MB, VmSize: 1066 MB, VmRSS: 208 MB, VmData: 248 MB, maxrss: 0.212608 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/279/2797p363/unwise-2797p363-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.11 s, CPU: 0.29 s, VmPeak: 1007 MB, VmSize: 1007 MB, VmRSS: 150 MB, VmData: 190 MB, maxrss: 0.188892 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/tmp-legacysurvey-custom-280203p36125-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/tmp-legacysurvey-custom-280203p36125-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 8.27 s, CPU: 0.71 s, VmPeak: 1078 MB, VmSize: 1078 MB, VmRSS: 316 MB, VmData: 342 MB, maxrss: 0.323948 MB Stage wise_forced finished: 2020-08-07T09:53:29.088668 Resources for stage wise_forced : 3.805 s worker CPU, 10.596 s worker Wall, Wall: 8.276 s, Cores in use: 0.55, Total efficiency (on 16 cores): 3.4 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/PGC214700-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/PGC214700-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T09:53:29.184286 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/coadd/cus/custom-280203p36125/legacysurvey-custom-280203p36125-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/tractor-i/cus/tractor-custom-280203p36125.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/tractor/cus/tractor-custom-280203p36125.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/tractor/cus/brick-custom-280203p36125.sha256sum Stage writecat : Wall: 0.92 s, CPU: 0.76 s, VmPeak: 1211 MB, VmSize: 1083 MB, VmRSS: 318 MB, VmData: 342 MB, maxrss: 0.456832 MB Stage writecat finished: 2020-08-07T09:53:30.104291 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.922 s, Cores in use: 0.83, Total efficiency (on 16 cores): 5.2 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/PGC214700-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/280/PGC214700/PGC214700-largegalaxy-writecat.p All done: 55.500 s worker CPU, 155.288 s worker Wall, Wall: 141.251 s, Cores in use: 0.50, Total efficiency (on 16 cores): 3.1 % Finished galaxy PGC214700 in 2.398 minutes.