Started working on galaxy PGC2035456 at Wed Aug 5 21:26:44 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.5623315 33.6038857 --width 315 --height 315 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/PGC2035456-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/PGC2035456-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T21:26:45.666420 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.5623315', '33.6038857', '--width', '315', '--height', '315', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/PGC2035456-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/PGC2035456-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.5623315 33.6038857 --width 315 --height 315 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/PGC2035456-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/PGC2035456-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 272.5623315 33.6038857 Starting process 57737 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 57738 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 57739 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 57740 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 57741 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 57742 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 57743 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 57744 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 57745 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 57746 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 57747 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 57748 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 57749 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 57750 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 57751 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 57752 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T21:26:47.072567 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 9 CCDs: k4m_170524_113022_ooi_zd_ls9-CCD4 z expnum 129994 exptime 169.106 propid 2016A-0453 seeing 1.17 MJD 57897.479 object MzLS_571127_z mosaic/CP/V4.3/CP20170523/k4m_170524_113022_ooi_zd_ls9.fits.fz k4m_170528_112102_ooi_zd_ls9-CCD1 z expnum 130433 exptime 107.105 propid 2016A-0453 seeing 0.95 MJD 57901.473 object MzLS_572171_z mosaic/CP/V4.3/CP20170527/k4m_170528_112102_ooi_zd_ls9.fits.fz k4m_170528_105817_ooi_zd_ls9-CCD2 z expnum 130423 exptime 80.103 propid 2016A-0453 seeing 0.97 MJD 57901.457 object MzLS_570082_z mosaic/CP/V4.3/CP20170527/k4m_170528_105817_ooi_zd_ls9.fits.fz ksb_180518_072947_ooi_r_ls9-CCD2 r expnum 82560136 exptime 110.693 propid NOTBASS seeing 1.43 MJD 58256.312 object 06893 90prime/CP/V2.3/CP20180517/ksb_180518_072947_ooi_r_ls9.fits.fz ksb_160628_063810_ooi_g_ls9-CCD2 g expnum 75670091 exptime 107.5 propid BASS seeing 1.55 MJD 57567.277 object 06893 90prime/CP/V2.3/CP20160627/ksb_160628_063810_ooi_g_ls9.fits.fz ksb_180509_101911_ooi_r_ls9-CCD1 r expnum 82470177 exptime 96.714 propid NOTBASS seeing 1.16 MJD 58247.430 object 05522 90prime/CP/V2.3/CP20180508/ksb_180509_101911_ooi_r_ls9.fits.fz ksb_160711_083651_ooi_g_ls9-CCD1 g expnum 75800112 exptime 194.7 propid BASS seeing 1.49 MJD 57580.359 object 05522 90prime/CP/V2.3/CP20160710/ksb_160711_083651_ooi_g_ls9.fits.fz ksb_160502_105813_ooi_g_ls9-CCD2 g expnum 75100209 exptime 99.6 propid 2015A-0801 seeing 1.33 MJD 57510.457 object 06891 90prime/CP/V2.3/CP20160501/ksb_160502_105813_ooi_g_ls9.fits.fz ksb_160414_113444_ooi_r_ls9-CCD2 r expnum 74920203 exptime 53.6 propid BASS seeing 0.99 MJD 57492.482 object 06891 90prime/CP/V2.3/CP20160413/ksb_160414_113444_ooi_r_ls9.fits.fz Faked up EXPNUM 75670091 Faked up EXPNUM 75670091 Faked up EXPNUM 75670091 90prime get_fwhm: self.fwhm = 3.43 Found 4 relevant rows in amp-corrections file. Found overlap: image x 944 1129 and amp range 0 2015 and image y 967 1153 and amp range 0 2047 Range in image: x 0 186 , y 0 187 (with image size 186 x 187) dzp -0.008523628 -> scaling image by 0.992180183483648 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2130 2449 and amp range 2006 4053 and image y 3029 3346 and amp range 2040 4078 Range in image: x 0 320 , y 0 318 (with image size 320 x 318) dzp 0.012593497 -> scaling image by 1.0116665687010755 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82470177 Faked up EXPNUM 82470177 Faked up EXPNUM 82470177 90prime get_fwhm: self.fwhm = 2.57 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1181 1366 and amp range 0 2015 and image y 3140 3324 and amp range 2048 4095 Range in image: x 0 186 , y 0 185 (with image size 186 x 185) dzp -0.05213645 -> scaling image by 0.953115252660837 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75100209 Faked up EXPNUM 75100209 Faked up EXPNUM 75100209 90prime get_fwhm: self.fwhm = 2.93 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2968 3152 and amp range 2016 4031 and image y 2970 3154 and amp range 2048 4095 Range in image: x 0 185 , y 0 185 (with image size 185 x 185) dzp 0.0026774607 -> scaling image by 1.002469075566243 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 518 839 and amp range 0 2047 and image y 3413 3737 and amp range 2022 4060 Range in image: x 0 322 , y 0 325 (with image size 322 x 325) dzp -0.017482605 -> scaling image by 0.9840268712629925 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82560136 Faked up EXPNUM 82560136 Faked up EXPNUM 82560136 90prime get_fwhm: self.fwhm = 3.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 937 1122 and amp range 0 2015 and image y 985 1171 and amp range 0 2047 Range in image: x 0 186 , y 0 187 (with image size 186 x 187) dzp -0.003875085 -> scaling image by 0.9964372765054066 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 74920203 Faked up EXPNUM 74920203 Faked up EXPNUM 74920203 90prime get_fwhm: self.fwhm = 2.19 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2973 3157 and amp range 2016 4031 and image y 2978 3162 and amp range 2048 4095 Range in image: x 0 185 , y 0 185 (with image size 185 x 185) dzp 0.0002007609 -> scaling image by 1.0001849247187462 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75800112 Faked up EXPNUM 75800112 Faked up EXPNUM 75800112 90prime get_fwhm: self.fwhm = 3.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1182 1367 and amp range 0 2015 and image y 3133 3317 and amp range 2048 4095 Range in image: x 0 186 , y 0 185 (with image size 186 x 185) dzp -0.0051191514 -> scaling image by 0.9952961850385206 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.75 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3271 3597 and amp range 2048 4095 and image y 1194 1520 and amp range 0 2039 Range in image: x 0 327 , y 0 327 (with image size 327 x 327) dzp 0.0044767857 -> scaling image by 1.004131784351374 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 6.52 s, CPU: 1.29 s, VmPeak: 957 MB, VmSize: 957 MB, VmRSS: 177 MB, VmData: 209 MB, maxrss: 0.181 MB Stage tims finished: 2020-08-05T21:26:53.591784 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 5.459 s worker CPU, 25.616 s worker Wall, Wall: 6.521 s, Cores in use: 1.04, Total efficiency (on 16 cores): 6.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/PGC2035456-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/PGC2035456-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T21:26:53.659336 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02848.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02721.fits Matched 6 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/metrics/cus/reference-custom-272562p33603.fits Stage refs : Wall: 17.56 s, CPU: 9.42 s, VmPeak: 1051 MB, VmSize: 1045 MB, VmRSS: 268 MB, VmData: 297 MB, maxrss: 0.27394 MB Stage refs finished: 2020-08-05T21:27:11.224212 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 17.566 s, Cores in use: 0.54, Total efficiency (on 16 cores): 3.4 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/PGC2035456-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/PGC2035456-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T21:27:11.313454 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/metrics/cus/outlier-mask-custom-272562p33603.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/metrics/cus/outliers-pre-custom-272562p33603.jpg Image ksb_160502_105813_ooi_g_ls9-CCD2 g : masking 70 positive outlier pixels and 0 negative outlier pixels Image ksb_160711_083651_ooi_g_ls9-CCD1 g : masking 266 positive outlier pixels and 0 negative outlier pixels Image k4m_170528_105817_ooi_zd_ls9-CCD2 z : masking 1598 positive outlier pixels and 0 negative outlier pixels Image k4m_170524_113022_ooi_zd_ls9-CCD4 z : masking 152 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/metrics/cus/outlier-mask-custom-272562p33603.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/metrics/cus/outliers-post-custom-272562p33603.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/metrics/cus/outliers-masked-pos-custom-272562p33603.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/metrics/cus/outliers-masked-neg-custom-272562p33603.jpg Stage outliers : Wall: 3.00 s, CPU: 2.13 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 286 MB, VmData: 313 MB, maxrss: 0.29264 MB Stage outliers finished: 2020-08-05T21:27:14.311782 Resources for stage outliers : 1.026 s worker CPU, 1.152 s worker Wall, Wall: 3.000 s, Cores in use: 1.05, Total efficiency (on 16 cores): 6.6 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/PGC2035456-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/PGC2035456-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T21:27:14.338932 Stage halos : Wall: 1.12 s, CPU: 1.11 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 286 MB, VmData: 313 MB, maxrss: 0.29288 MB Stage halos finished: 2020-08-05T21:27:15.458338 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 1.121 s, Cores in use: 0.99, Total efficiency (on 16 cores): 6.2 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/PGC2035456-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/PGC2035456-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T21:27:15.482160 PSF sigmas in coadd pixels: ['2.52', '2.42', '2.16'] Using average PSF sigma 2.367002227322225 Gaussian PSF norm 0.11917808463281857 vs pixelized 0.09612687 average tim pixel scale / coadd scale: 1.729297529877597 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.32', '1.89', '1.61'] Using average PSF sigma 1.9412336527239489 Gaussian PSF norm 0.14531727872017947 vs pixelized 0.11576955 average tim pixel scale / coadd scale: 1.730137986294527 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.90', '1.55', '1.58'] Using average PSF sigma 1.6768050426721146 Gaussian PSF norm 0.16823350633794548 vs pixelized 0.1406626 average tim pixel scale / coadd scale: 0.9909042140348095 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.21 s, CPU: 0.20 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 288 MB, VmData: 313 MB, maxrss: 0.294512 MB Stage fit_on_coadds finished: 2020-08-05T21:27:15.696245 Resources for stage fit_on_coadds : 0.239 s worker CPU, 0.239 s worker Wall, Wall: 0.215 s, Cores in use: 2.05, Total efficiency (on 16 cores): 12.8 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/PGC2035456-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/PGC2035456-largegalaxy-fit_on_coadds.p Running stage srcs Warning: Stellar halo subtraction is only implemented for DECam Running stage srcs at 2020-08-05T21:27:15.707670 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 57 potential peaks Of 57 potential peaks: 11 in veto map, 9 cut by saddle test, 0 cut by aper test, 37 kept SED z : 37 new peaks Found 48 potential peaks Of 48 potential peaks: 39 in veto map, 8 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 40 potential peaks Of 40 potential peaks: 33 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 62 potential peaks Of 62 potential peaks: 49 in veto map, 10 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 65 potential peaks Of 65 potential peaks: 55 in veto map, 8 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 45 new sources Median coadd sky for g : 9.727685e-05 Median coadd sky for r : 0.00021157876 Median coadd sky for z : -5.9208607e-05 Stage srcs : Wall: 1.57 s, CPU: 1.52 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 288 MB, VmData: 313 MB, maxrss: 0.295016 MB Stage srcs finished: 2020-08-05T21:27:17.272725 Resources for stage srcs : 0.108 s worker CPU, 0.109 s worker Wall, Wall: 1.567 s, Cores in use: 1.04, Total efficiency (on 16 cores): 6.5 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/PGC2035456-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/PGC2035456-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T21:27:17.288660 Blob 1 of 28, id: 15, sources: 12, size: 149x172, npix 16923, brick X: 81,230, Y: 86,258, one pixel: 148 86 Blob 2 of 28, id: 22, sources: 3, size: 85x89, npix 4690, brick X: 219,304, Y: 221,310, one pixel: 257 221 Blob 3 of 28, id: 21, sources: 3, size: 67x78, npix 2875, brick X: 4,71, Y: 203,281, one pixel: 47 203 Blob 4 of 28, id: 16, sources: 6, size: 60x76, npix 2425, brick X: 2,62, Y: 104,180, one pixel: 45 104 Blob 5 of 28, id: 10, sources: 4, size: 58x59, npix 1979, brick X: 0,58, Y: 39,98, one pixel: 17 39 Blob 6 of 28, id: 13, sources: 2, size: 54x44, npix 1398, brick X: 209,263, Y: 77,121, one pixel: 242 77 Blob 7 of 28, id: 7, sources: 2, size: 32x49, npix 985, brick X: 165,197, Y: 31,80, one pixel: 179 31 Blob 8 of 28, id: 2, sources: 3, size: 57x24, npix 951, brick X: 226,283, Y: 0,24, one pixel: 231 0 Blob 9 of 28, id: 24, sources: 1, size: 36x31, npix 849, brick X: 55,91, Y: 284,315, one pixel: 67 284 Blob 10 of 28, id: 23, sources: 1, size: 32x33, npix 681, brick X: 42,74, Y: 242,275, one pixel: 58 242 Blob 11 of 28, id: 12, sources: 1, size: 30x35, npix 664, brick X: 260,290, Y: 66,101, one pixel: 276 66 Blob 12 of 28, id: 9, sources: 1, size: 34x30, npix 635, brick X: 51,85, Y: 37,67, one pixel: 65 37 Blob 13 of 28, id: 3, sources: 1, size: 29x30, npix 551, brick X: 85,114, Y: 9,39, one pixel: 97 9 Blob 14 of 28, id: 17, sources: 2, size: 34x27, npix 547, brick X: 281,315, Y: 104,131, one pixel: 307 104 Blob 15 of 28, id: 25, sources: 1, size: 29x25, npix 502, brick X: 112,141, Y: 290,315, one pixel: 124 290 Blob 16 of 28, id: 18, sources: 1, size: 27x27, npix 484, brick X: 3,30, Y: 182,209, one pixel: 13 182 Blob 17 of 28, id: 27, sources: 1, size: 26x19, npix 345, brick X: 289,315, Y: 296,315, one pixel: 300 296 Blob 18 of 28, id: 8, sources: 1, size: 24x23, npix 330, brick X: 272,296, Y: 36,59, one pixel: 282 36 Blob 13 finished, total: Wall: 0.70 s, CPU: 0.69 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 92 MB, VmData: 138 MB, maxrss: 0.094108 MB Measuring 1 iterative sources Blob 16 finished, total: Wall: 0.79 s, CPU: 0.76 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151188 MB Blob 19 of 28, id: 11, sources: 1, size: 24x23, npix 329, brick X: 140,164, Y: 44,67, one pixel: 150 44 Blob 14 finished, total: Wall: 0.78 s, CPU: 0.74 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095696 MB Blob 20 of 28, id: 26, sources: 1, size: 23x21, npix 323, brick X: 191,214, Y: 294,315, one pixel: 201 294 Blob 21 of 28, id: 1, sources: 1, size: 22x22, npix 303, brick X: 158,180, Y: 0,22, one pixel: 167 0 Measuring 1 iterative sources Measuring 1 iterative sources Blob 10 finished, total: Wall: 1.02 s, CPU: 1.02 s, VmPeak: 809 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151704 MB Blob 22 of 28, id: 6, sources: 1, size: 22x22, npix 282, brick X: 200,222, Y: 25,47, one pixel: 209 25 Blob 7 finished, total: Wall: 1.42 s, CPU: 1.41 s, VmPeak: 806 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151924 MB Blob 23 of 28, id: 4, sources: 1, size: 22x21, npix 280, brick X: 121,143, Y: 14,35, one pixel: 130 14 Blob 19 finished, total: Wall: 0.29 s, CPU: 0.28 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.095816 MB Blob 24 of 28, id: 14, sources: 1, size: 20x21, npix 240, brick X: 57,77, Y: 79,100, one pixel: 66 79 Blob 12 finished, total: Wall: 1.17 s, CPU: 1.17 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.151 MB Blob 25 of 28, id: 0, sources: 1, size: 22x15, npix 233, brick X: 19,41, Y: 0,15, one pixel: 23 0 Blob 15 finished, total: Wall: 1.20 s, CPU: 1.19 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 92 MB, VmData: 138 MB, maxrss: 0.094184 MB Blob 26 of 28, id: 20, sources: 1, size: 19x18, npix 189, brick X: 263,282, Y: 188,206, one pixel: 271 188 Blob 9 finished, total: Wall: 1.24 s, CPU: 1.21 s, VmPeak: 808 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151112 MB Blob 27 of 28, id: 19, sources: 1, size: 17x17, npix 145, brick X: 81,98, Y: 187,204, one pixel: 89 187 Measuring 1 iterative sources Blob 18 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151188 MB Blob 28 of 28, id: 5, sources: 1, size: 12x18, npix 138, brick X: 303,315, Y: 24,42, one pixel: 311 24 Blob 17 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.094316 MB Blob 23 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151632 MB Blob 26 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151188 MB Blob 27 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.094316 MB Blob 22 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.095824 MB Blob 11 finished, total: Wall: 1.50 s, CPU: 1.50 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 95 MB, VmData: 140 MB, maxrss: 0.096972 MB Blob 24 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 92 MB, VmData: 138 MB, maxrss: 0.094392 MB Blob 21 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 806 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151924 MB Blob 20 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 809 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151704 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.55444, 33.59143), pm (-0.4, -1.4), parallax 0.619 with NanoMaggies: g=16.1, r=15.3, z=15.1 Reset brightness to NanoMaggies: g=15.9, r=15.5, z=15.3 Blob 8 finished, total: Wall: 1.84 s, CPU: 1.81 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 94 MB, VmData: 139 MB, maxrss: 0.096236 MB Blob 25 finished, total: Wall: 0.63 s, CPU: 0.63 s, VmPeak: 808 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151932 MB Blob 28 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151632 MB Blob 6 finished, total: Wall: 2.44 s, CPU: 2.43 s, VmPeak: 814 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 184 MB, maxrss: 0.152408 MB Measuring 1 iterative sources Measuring 2 iterative sources Measuring 4 iterative sources Blob 5 finished, total: Wall: 2.45 s, CPU: 2.42 s, VmPeak: 814 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 184 MB, maxrss: 0.152352 MB Blob 3 finished, total: Wall: 2.90 s, CPU: 2.86 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 98 MB, VmData: 143 MB, maxrss: 0.100308 MB Measuring 1 iterative sources Blob 4 finished, total: Wall: 4.01 s, CPU: 4.00 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097604 MB Blob 2 finished, total: Wall: 5.05 s, CPU: 5.05 s, VmPeak: 810 MB, VmSize: 732 MB, VmRSS: 150 MB, VmData: 184 MB, maxrss: 0.153436 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.71142, ee1=0.140026, ee2=0.0108105 Measuring 2 iterative sources Blob 1 finished, total: Wall: 10.73 s, CPU: 10.69 s, VmPeak: 807 MB, VmSize: 732 MB, VmRSS: 151 MB, VmData: 184 MB, maxrss: 0.154372 MB Old catalog: 65 New catalog: 65 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/metrics/cus/blobs-custom-272562p33603.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/metrics/cus/all-models-custom-272562p33603.fits Stage fitblobs : Wall: 12.25 s, CPU: 1.54 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 288 MB, VmData: 313 MB, maxrss: 0.295372 MB Stage fitblobs finished: 2020-08-05T21:27:29.537976 Resources for stage fitblobs : 44.429 s worker CPU, 48.498 s worker Wall, Wall: 12.251 s, Cores in use: 3.75, Total efficiency (on 16 cores): 23.5 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/PGC2035456-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/PGC2035456-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T21:27:29.554684 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/tmp-legacysurvey-custom-272562p33603-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/tmp-legacysurvey-custom-272562p33603-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/tmp-legacysurvey-custom-272562p33603-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/tmp-legacysurvey-custom-272562p33603-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-resid.jpg Stage coadds : Wall: 6.38 s, CPU: 1.00 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 289 MB, VmData: 313 MB, maxrss: 0.295696 MB Stage coadds finished: 2020-08-05T21:27:35.933966 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 10.944 s worker CPU, 17.796 s worker Wall, Wall: 6.381 s, Cores in use: 1.87, Total efficiency (on 16 cores): 11.7 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/PGC2035456-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/PGC2035456-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T21:27:35.953446 Cut to 1 unWISE tiles Reading WISE tile 2717p333 band 2 Reading WISE tile 2717p333 band 3 Reading WISE tile 2717p333 band 4 Reading WISE tile 2717p333 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.23 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.209968 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.14 s, CPU: 0.40 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 153 MB, VmData: 190 MB, maxrss: 0.194724 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.20 s, VmPeak: 1007 MB, VmSize: 1007 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.204748 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.19 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 149 MB, VmData: 187 MB, maxrss: 0.211424 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/tmp-legacysurvey-custom-272562p33603-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/tmp-legacysurvey-custom-272562p33603-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 6.59 s, CPU: 1.54 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 289 MB, VmData: 313 MB, maxrss: 0.29628 MB Stage wise_forced finished: 2020-08-05T21:27:42.541199 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 4.180 s worker CPU, 8.340 s worker Wall, Wall: 6.589 s, Cores in use: 0.87, Total efficiency (on 16 cores): 5.4 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/PGC2035456-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/PGC2035456-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T21:27:42.562643 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/coadd/cus/custom-272562p33603/legacysurvey-custom-272562p33603-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/tractor-i/cus/tractor-custom-272562p33603.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/tractor/cus/tractor-custom-272562p33603.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/tractor/cus/brick-custom-272562p33603.sha256sum Stage writecat : Wall: 4.16 s, CPU: 2.43 s, VmPeak: 1187 MB, VmSize: 1059 MB, VmRSS: 291 MB, VmData: 313 MB, maxrss: 0.429224 MB Stage writecat finished: 2020-08-05T21:27:46.724115 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.163 s, Cores in use: 0.59, Total efficiency (on 16 cores): 3.7 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/PGC2035456-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2035456/PGC2035456-largegalaxy-writecat.p All done: 66.391 s worker CPU, 101.755 s worker Wall, Wall: 59.761 s, Cores in use: 1.48, Total efficiency (on 16 cores): 9.3 % Finished galaxy PGC2035456 in 1.063 minutes. Started working on galaxy PGC2035456 at Fri Aug 7 10:04:58 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.56214316330966 33.604198067921786 --width 315 --height 315 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/PGC2035456-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/PGC2035456-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T10:04:59.806914 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.56214316330966', '33.604198067921786', '--width', '315', '--height', '315', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/PGC2035456-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/PGC2035456-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.56214316330966 33.604198067921786 --width 315 --height 315 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/PGC2035456-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/PGC2035456-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 272.56214316330966 33.604198067921786 Starting process 34630 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 34631 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 34632 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 34633 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 34634 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB Starting process 34635 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 34636 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 34637 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 34638 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 34639 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 34640 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 34641 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 34642 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 34643 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 34645 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 34644 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T10:05:00.285558 Keeping 9 CCDs: k4m_170524_113022_ooi_zd_ls9-CCD4 z expnum 129994 exptime 169.106 propid 2016A-0453 seeing 1.17 MJD 57897.479 object MzLS_571127_z mosaic/CP/V4.3/CP20170523/k4m_170524_113022_ooi_zd_ls9.fits.fz k4m_170528_112102_ooi_zd_ls9-CCD1 z expnum 130433 exptime 107.105 propid 2016A-0453 seeing 0.95 MJD 57901.473 object MzLS_572171_z mosaic/CP/V4.3/CP20170527/k4m_170528_112102_ooi_zd_ls9.fits.fz k4m_170528_105817_ooi_zd_ls9-CCD2 z expnum 130423 exptime 80.103 propid 2016A-0453 seeing 0.97 MJD 57901.457 object MzLS_570082_z mosaic/CP/V4.3/CP20170527/k4m_170528_105817_ooi_zd_ls9.fits.fz ksb_180518_072947_ooi_r_ls9-CCD2 r expnum 82560136 exptime 110.693 propid NOTBASS seeing 1.43 MJD 58256.312 object 06893 90prime/CP/V2.3/CP20180517/ksb_180518_072947_ooi_r_ls9.fits.fz ksb_160628_063810_ooi_g_ls9-CCD2 g expnum 75670091 exptime 107.5 propid BASS seeing 1.55 MJD 57567.277 object 06893 90prime/CP/V2.3/CP20160627/ksb_160628_063810_ooi_g_ls9.fits.fz ksb_180509_101911_ooi_r_ls9-CCD1 r expnum 82470177 exptime 96.714 propid NOTBASS seeing 1.16 MJD 58247.430 object 05522 90prime/CP/V2.3/CP20180508/ksb_180509_101911_ooi_r_ls9.fits.fz ksb_160711_083651_ooi_g_ls9-CCD1 g expnum 75800112 exptime 194.7 propid BASS seeing 1.49 MJD 57580.359 object 05522 90prime/CP/V2.3/CP20160710/ksb_160711_083651_ooi_g_ls9.fits.fz ksb_160502_105813_ooi_g_ls9-CCD2 g expnum 75100209 exptime 99.6 propid 2015A-0801 seeing 1.33 MJD 57510.457 object 06891 90prime/CP/V2.3/CP20160501/ksb_160502_105813_ooi_g_ls9.fits.fz ksb_160414_113444_ooi_r_ls9-CCD2 r expnum 74920203 exptime 53.6 propid BASS seeing 0.99 MJD 57492.482 object 06891 90prime/CP/V2.3/CP20160413/ksb_160414_113444_ooi_r_ls9.fits.fz Faked up EXPNUM 75670091 Faked up EXPNUM 75670091 Faked up EXPNUM 75670091 90prime get_fwhm: self.fwhm = 3.43 Found 4 relevant rows in amp-corrections file. Found overlap: image x 942 1126 and amp range 0 2015 and image y 969 1154 and amp range 0 2047 Range in image: x 0 185 , y 0 186 (with image size 185 x 186) dzp -0.008523628 -> scaling image by 0.992180183483648 Faked up EXPNUM 82560136 Faked up EXPNUM 82560136 Faked up EXPNUM 82560136 90prime get_fwhm: self.fwhm = 3.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 935 1119 and amp range 0 2015 and image y 986 1172 and amp range 0 2047 Range in image: x 0 185 , y 0 187 (with image size 185 x 187) dzp -0.003875085 -> scaling image by 0.9964372765054066 Faked up EXPNUM 75100209 Faked up EXPNUM 75100209 Faked up EXPNUM 75100209 90prime get_fwhm: self.fwhm = 2.93 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2966 3150 and amp range 2016 4031 and image y 2971 3156 and amp range 2048 4095 Range in image: x 0 185 , y 0 186 (with image size 185 x 186) dzp 0.0026774607 -> scaling image by 1.002469075566243 Faked up EXPNUM 82470177 Faked up EXPNUM 82470177 Faked up EXPNUM 82470177 90prime get_fwhm: self.fwhm = 2.57 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1178 1364 and amp range 0 2015 and image y 3141 3325 and amp range 2048 4095 Range in image: x 0 187 , y 0 185 (with image size 187 x 185) dzp -0.05213645 -> scaling image by 0.953115252660837 Faked up EXPNUM 75800112 Faked up EXPNUM 75800112 Faked up EXPNUM 75800112 90prime get_fwhm: self.fwhm = 3.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1179 1364 and amp range 0 2015 and image y 3134 3318 and amp range 2048 4095 Range in image: x 0 186 , y 0 185 (with image size 186 x 185) dzp -0.0051191514 -> scaling image by 0.9952961850385206 mosaic get_fwhm: self.fwhm = 3.75 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3276 3602 and amp range 2048 4095 and image y 1192 1518 and amp range 0 2039 Range in image: x 0 327 , y 0 327 (with image size 327 x 327) dzp 0.0044767857 -> scaling image by 1.004131784351374 mosaic get_fwhm: self.fwhm = 4.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 522 844 and amp range 0 2047 and image y 3411 3734 and amp range 2022 4060 Range in image: x 0 323 , y 0 324 (with image size 323 x 324) dzp -0.017482605 -> scaling image by 0.9840268712629925 mosaic get_fwhm: self.fwhm = 3.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2135 2454 and amp range 2006 4053 and image y 3027 3344 and amp range 2040 4078 Range in image: x 0 320 , y 0 318 (with image size 320 x 318) dzp 0.012593497 -> scaling image by 1.0116665687010755 Faked up EXPNUM 74920203 Faked up EXPNUM 74920203 Faked up EXPNUM 74920203 90prime get_fwhm: self.fwhm = 2.19 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2971 3155 and amp range 2016 4031 and image y 2979 3164 and amp range 2048 4095 Range in image: x 0 185 , y 0 186 (with image size 185 x 186) dzp 0.0002007609 -> scaling image by 1.0001849247187462 Stage tims : Wall: 16.77 s, CPU: 0.85 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.178368 MB Stage tims finished: 2020-08-07T10:05:17.055675 Resources for stage tims : 4.387 s worker CPU, 47.109 s worker Wall, Wall: 16.772 s, Cores in use: 0.31, Total efficiency (on 16 cores): 2.0 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/PGC2035456-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/PGC2035456-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T10:05:17.143966 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02848.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02721.fits Matched 6 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/metrics/cus/reference-custom-272562p33604.fits Stage refs : Wall: 34.37 s, CPU: 7.17 s, VmPeak: 1044 MB, VmSize: 1039 MB, VmRSS: 265 MB, VmData: 296 MB, maxrss: 0.271084 MB Stage refs finished: 2020-08-07T10:05:51.511558 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 34.369 s, Cores in use: 0.21, Total efficiency (on 16 cores): 1.3 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/PGC2035456-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/PGC2035456-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T10:05:51.601626 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/metrics/cus/outlier-mask-custom-272562p33604.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/metrics/cus/outliers-pre-custom-272562p33604.jpg Image ksb_160711_083651_ooi_g_ls9-CCD1 g : masking 283 positive outlier pixels and 0 negative outlier pixels Image ksb_160502_105813_ooi_g_ls9-CCD2 g : masking 34 positive outlier pixels and 0 negative outlier pixels Image k4m_170528_105817_ooi_zd_ls9-CCD2 z : masking 1561 positive outlier pixels and 0 negative outlier pixels Image k4m_170524_113022_ooi_zd_ls9-CCD4 z : masking 151 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/metrics/cus/outlier-mask-custom-272562p33604.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/metrics/cus/outliers-post-custom-272562p33604.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/metrics/cus/outliers-masked-pos-custom-272562p33604.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/metrics/cus/outliers-masked-neg-custom-272562p33604.jpg Stage outliers : Wall: 13.75 s, CPU: 0.69 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 285 MB, VmData: 313 MB, maxrss: 0.29182 MB Stage outliers finished: 2020-08-07T10:06:05.354990 Resources for stage outliers : 0.995 s worker CPU, 1.114 s worker Wall, Wall: 13.755 s, Cores in use: 0.12, Total efficiency (on 16 cores): 0.8 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/PGC2035456-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/PGC2035456-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T10:06:05.382307 Stage halos : Wall: 0.35 s, CPU: 0.34 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 285 MB, VmData: 313 MB, maxrss: 0.29182 MB Stage halos finished: 2020-08-07T10:06:05.730783 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.350 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/PGC2035456-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/PGC2035456-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T10:06:08.638397 PSF sigmas in coadd pixels: ['2.52', '2.42', '2.16'] Using average PSF sigma 2.367002227322225 Gaussian PSF norm 0.11917808463281857 vs pixelized 0.096120566 average tim pixel scale / coadd scale: 1.729297529877597 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.32', '1.89', '1.61'] Using average PSF sigma 1.9412336527239489 Gaussian PSF norm 0.14531727872017947 vs pixelized 0.11577297 average tim pixel scale / coadd scale: 1.730137986294527 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.90', '1.55', '1.58'] Using average PSF sigma 1.6768050426721146 Gaussian PSF norm 0.16823350633794548 vs pixelized 0.1406658 average tim pixel scale / coadd scale: 0.9909042140348095 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.53 s, CPU: 0.20 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 286 MB, VmData: 313 MB, maxrss: 0.293324 MB Stage fit_on_coadds finished: 2020-08-07T10:06:09.164320 Resources for stage fit_on_coadds : 0.229 s worker CPU, 0.229 s worker Wall, Wall: 0.527 s, Cores in use: 0.81, Total efficiency (on 16 cores): 5.1 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/PGC2035456-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/PGC2035456-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T10:06:09.208926 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 56 potential peaks Of 56 potential peaks: 12 in veto map, 9 cut by saddle test, 0 cut by aper test, 35 kept SED z : 35 new peaks Found 49 potential peaks Of 49 potential peaks: 40 in veto map, 7 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 41 potential peaks Of 41 potential peaks: 34 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 60 potential peaks Of 60 potential peaks: 49 in veto map, 9 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 64 potential peaks Of 64 potential peaks: 54 in veto map, 9 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 42 new sources Median coadd sky for g : 0.00010932421 Median coadd sky for r : 0.00023361348 Median coadd sky for z : -0.000115970994 Stage srcs : Wall: 0.84 s, CPU: 0.78 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 287 MB, VmData: 313 MB, maxrss: 0.293812 MB Stage srcs finished: 2020-08-07T10:06:10.044055 Resources for stage srcs : 0.108 s worker CPU, 0.108 s worker Wall, Wall: 0.836 s, Cores in use: 1.07, Total efficiency (on 16 cores): 6.7 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/PGC2035456-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/PGC2035456-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T10:06:10.123709 Blob 1 of 26, id: 14, sources: 11, size: 148x172, npix 16927, brick X: 79,227, Y: 81,253, one pixel: 145 81 Blob 2 of 26, id: 20, sources: 3, size: 85x89, npix 4691, brick X: 217,302, Y: 217,306, one pixel: 253 217 Blob 3 of 26, id: 19, sources: 3, size: 67x78, npix 2873, brick X: 2,69, Y: 199,277, one pixel: 43 199 Blob 4 of 26, id: 16, sources: 6, size: 56x75, npix 2350, brick X: 3,59, Y: 100,175, one pixel: 42 100 Blob 5 of 26, id: 9, sources: 4, size: 56x60, npix 1898, brick X: 0,56, Y: 34,94, one pixel: 16 34 Blob 6 of 26, id: 12, sources: 2, size: 55x43, npix 1420, brick X: 206,261, Y: 73,116, one pixel: 239 73 Blob 7 of 26, id: 6, sources: 2, size: 33x49, npix 984, brick X: 162,195, Y: 27,76, one pixel: 176 27 Blob 8 of 26, id: 22, sources: 1, size: 36x36, npix 941, brick X: 52,88, Y: 279,315, one pixel: 68 279 Blob 9 of 26, id: 21, sources: 1, size: 32x33, npix 694, brick X: 40,72, Y: 238,271, one pixel: 55 238 Blob 10 of 26, id: 11, sources: 1, size: 30x35, npix 664, brick X: 258,288, Y: 61,96, one pixel: 275 61 Blob 11 of 26, id: 8, sources: 1, size: 34x30, npix 644, brick X: 49,83, Y: 33,63, one pixel: 61 33 Blob 12 of 26, id: 1, sources: 3, size: 47x20, npix 620, brick X: 233,280, Y: 0,20, one pixel: 237 0 Blob 13 of 26, id: 15, sources: 2, size: 36x28, npix 577, brick X: 279,315, Y: 99,127, one pixel: 305 99 Blob 14 of 26, id: 2, sources: 1, size: 28x30, npix 555, brick X: 83,111, Y: 5,35, one pixel: 95 5 Blob 15 of 26, id: 23, sources: 1, size: 28x29, npix 546, brick X: 110,138, Y: 286,315, one pixel: 122 286 Blob 16 of 26, id: 17, sources: 1, size: 27x28, npix 493, brick X: 1,28, Y: 177,205, one pixel: 13 177 Blob 17 of 26, id: 25, sources: 1, size: 28x23, npix 459, brick X: 286,314, Y: 292,315, one pixel: 297 292 Blob 14 finished, total: Wall: 0.68 s, CPU: 0.67 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147448 MB Blob 18 of 26, id: 24, sources: 1, size: 23x24, npix 370, brick X: 189,212, Y: 290,314, one pixel: 198 290 Measuring 1 iterative sources Blob 13 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095312 MB Blob 19 of 26, id: 7, sources: 1, size: 24x23, npix 328, brick X: 270,294, Y: 32,55, one pixel: 279 32 Blob 16 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147224 MB Blob 20 of 26, id: 10, sources: 1, size: 24x22, npix 318, brick X: 138,162, Y: 40,62, one pixel: 148 40 Measuring 1 iterative sources Measuring 1 iterative sources Blob 9 finished, total: Wall: 1.05 s, CPU: 1.05 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147784 MB Blob 21 of 26, id: 3, sources: 1, size: 22x21, npix 280, brick X: 118,140, Y: 10,31, one pixel: 127 10 Blob 22 of 26, id: 5, sources: 1, size: 22x22, npix 274, brick X: 198,220, Y: 21,43, one pixel: 207 21 Blob 11 finished, total: Wall: 1.09 s, CPU: 1.09 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14762 MB Blob 23 of 26, id: 4, sources: 1, size: 15x24, npix 264, brick X: 300,315, Y: 17,41, one pixel: 309 17 Blob 15 finished, total: Wall: 1.11 s, CPU: 1.11 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.094692 MB Blob 24 of 26, id: 13, sources: 1, size: 21x21, npix 260, brick X: 54,75, Y: 75,96, one pixel: 63 75 Measuring 1 iterative sources Blob 19 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147224 MB Blob 25 of 26, id: 0, sources: 1, size: 22x18, npix 253, brick X: 156,178, Y: 0,18, one pixel: 162 0 Blob 20 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147784 MB Blob 26 of 26, id: 18, sources: 1, size: 18x19, npix 189, brick X: 261,279, Y: 183,202, one pixel: 270 183 Blob 21 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14762 MB Blob 10 finished, total: Wall: 1.38 s, CPU: 1.38 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 94 MB, VmData: 139 MB, maxrss: 0.095864 MB Blob 22 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.09482 MB Blob 26 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 94 MB, VmData: 139 MB, maxrss: 0.09614 MB Blob 8 finished, total: Wall: 1.49 s, CPU: 1.49 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.1476 MB Blob 18 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.0955 MB Blob 17 finished, total: Wall: 0.86 s, CPU: 0.85 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148244 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.55444, 33.59143), pm (-0.4, -1.4), parallax 0.619 with NanoMaggies: g=16, r=14.9, z=15.5 Reset brightness to NanoMaggies: g=15.9, r=15.5, z=15.3 Blob 12 finished, total: Wall: 1.68 s, CPU: 1.68 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147168 MB Blob 7 finished, total: Wall: 1.75 s, CPU: 1.75 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 97 MB, VmData: 143 MB, maxrss: 0.099532 MB Measuring 1 iterative sources Blob 25 finished, total: Wall: 0.49 s, CPU: 0.49 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14762 MB Blob 24 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147784 MB Blob 23 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147224 MB Measuring 1 iterative sources Blob 6 finished, total: Wall: 2.33 s, CPU: 2.33 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148724 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 2.48 s, CPU: 2.47 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 98 MB, VmData: 143 MB, maxrss: 0.100348 MB Measuring 4 iterative sources Blob 5 finished, total: Wall: 2.64 s, CPU: 2.64 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 96 MB, VmData: 141 MB, maxrss: 0.097908 MB Measuring 1 iterative sources Blob 4 finished, total: Wall: 3.84 s, CPU: 3.84 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148216 MB Blob 2 finished, total: Wall: 4.59 s, CPU: 4.59 s, VmPeak: 813 MB, VmSize: 726 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149812 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.11701, ee1=0.0210874, ee2=0.00959554 Measuring 2 iterative sources Blob 1 finished, total: Wall: 14.96 s, CPU: 14.95 s, VmPeak: 695 MB, VmSize: 688 MB, VmRSS: 114 MB, VmData: 156 MB, maxrss: 0.123756 MB Old catalog: 62 New catalog: 61 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/metrics/cus/blobs-custom-272562p33604.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/metrics/cus/all-models-custom-272562p33604.fits Stage fitblobs : Wall: 15.45 s, CPU: 0.55 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 287 MB, VmData: 313 MB, maxrss: 0.294168 MB Stage fitblobs finished: 2020-08-07T10:06:25.571240 Resources for stage fitblobs : 47.454 s worker CPU, 47.560 s worker Wall, Wall: 15.449 s, Cores in use: 3.11, Total efficiency (on 16 cores): 19.4 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/PGC2035456-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/PGC2035456-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T10:06:25.586724 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/tmp-legacysurvey-custom-272562p33604-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/tmp-legacysurvey-custom-272562p33604-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/tmp-legacysurvey-custom-272562p33604-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/tmp-legacysurvey-custom-272562p33604-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-resid.jpg Stage coadds : Wall: 1.93 s, CPU: 0.70 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 288 MB, VmData: 313 MB, maxrss: 0.294488 MB Stage coadds finished: 2020-08-07T10:06:27.519668 Resources for stage coadds : 9.981 s worker CPU, 10.323 s worker Wall, Wall: 1.934 s, Cores in use: 5.53, Total efficiency (on 16 cores): 34.5 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/PGC2035456-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/PGC2035456-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T10:06:27.541474 Cut to 1 unWISE tiles Reading WISE tile 2717p333 band 1 Reading WISE tile 2717p333 band 2 Reading WISE tile 2717p333 band 3 Reading WISE tile 2717p333 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.13 s, CPU: 0.36 s, VmPeak: 1072 MB, VmSize: 1008 MB, VmRSS: 149 MB, VmData: 190 MB, maxrss: 0.187812 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.21 s, VmPeak: 1002 MB, VmSize: 1002 MB, VmRSS: 144 MB, VmData: 184 MB, maxrss: 0.205448 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.18 s, VmPeak: 1002 MB, VmSize: 1002 MB, VmRSS: 143 MB, VmData: 184 MB, maxrss: 0.204988 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p333/unwise-2717p333-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.21 s, VmPeak: 1003 MB, VmSize: 1003 MB, VmRSS: 144 MB, VmData: 185 MB, maxrss: 0.205416 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/tmp-legacysurvey-custom-272562p33604-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/tmp-legacysurvey-custom-272562p33604-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 19.91 s, CPU: 0.57 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 288 MB, VmData: 313 MB, maxrss: 0.295076 MB Stage wise_forced finished: 2020-08-07T10:06:47.454164 Resources for stage wise_forced : 3.820 s worker CPU, 15.527 s worker Wall, Wall: 19.914 s, Cores in use: 0.22, Total efficiency (on 16 cores): 1.4 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/PGC2035456-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/PGC2035456-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T10:06:47.509303 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/coadd/cus/custom-272562p33604/legacysurvey-custom-272562p33604-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/tractor-i/cus/tractor-custom-272562p33604.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/tractor/cus/tractor-custom-272562p33604.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/tractor/cus/brick-custom-272562p33604.sha256sum Stage writecat : Wall: 1.02 s, CPU: 0.72 s, VmPeak: 1180 MB, VmSize: 1052 MB, VmRSS: 290 MB, VmData: 313 MB, maxrss: 0.428024 MB Stage writecat finished: 2020-08-07T10:06:48.533758 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.026 s, Cores in use: 0.70, Total efficiency (on 16 cores): 4.4 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/PGC2035456-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2035456/PGC2035456-largegalaxy-writecat.p All done: 66.978 s worker CPU, 121.972 s worker Wall, Wall: 108.352 s, Cores in use: 0.74, Total efficiency (on 16 cores): 4.6 % Finished galaxy PGC2035456 in 1.839 minutes.