Started working on galaxy PGC2349545 at Wed Aug 5 19:14:26 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 283.617582 49.657974200000005 --width 239 --height 239 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T19:14:29.324332 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '283.617582', '49.657974200000005', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 283.617582 49.657974200000005 --width 239 --height 239 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 283.617582 49.657974200000005 Starting process 21284 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 21285 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 21286 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 21287 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 21288 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 21289 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 21290 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 21291 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 21292 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 21293 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 21294 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 21295 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 21296 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 21297 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 21298 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 21299 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T19:14:30.836412 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 10 CCDs: k4m_160519_110151_ooi_zd_ls9-CCD1 z expnum 90283 exptime 80.103 propid 2016A-0453 seeing 0.80 MJD 57527.460 object MzLS_648718_z mosaic/CP/V4.3/CP20160518/k4m_160519_110151_ooi_zd_ls9.fits.fz k4m_160516_111312_ooi_zd_ls9-CCD2 z expnum 89326 exptime 80.103 propid 2016A-0453 seeing 0.94 MJD 57524.467 object MzLS_647904_z mosaic/CP/V4.3/CP20160515/k4m_160516_111312_ooi_zd_ls9.fits.fz k4m_170807_101013_ooi_zd_ls9-CCD4 z expnum 136201 exptime 129.104 propid 2016A-0453 seeing 1.10 MJD 57972.424 object MzLS_647086_z mosaic/CP/V4.3/CP20170806/k4m_170807_101013_ooi_zd_ls9.fits.fz k4m_170807_102008_ooi_zd_ls9-CCD1 z expnum 136204 exptime 158.103 propid 2016A-0453 seeing 1.32 MJD 57972.431 object MzLS_649528_z mosaic/CP/V4.3/CP20170806/k4m_170807_102008_ooi_zd_ls9.fits.fz ksb_160605_104627_ooi_r_ls9-CCD1 r expnum 75440189 exptime 250.6 propid BASS seeing 1.82 MJD 57544.449 object 26092 90prime/CP/V2.3/CP20160604/ksb_160605_104627_ooi_r_ls9.fits.fz ksb_160703_092312_ooi_g_ls9-CCD1 g expnum 75720095 exptime 97.8 propid BASS seeing 1.64 MJD 57572.391 object 26092 90prime/CP/V2.3/CP20160702/ksb_160703_092312_ooi_g_ls9.fits.fz ksb_180516_093904_ooi_g_ls9-CCD4 g expnum 82540158 exptime 92.209 propid NOTBASS seeing 1.24 MJD 58254.402 object 63293 90prime/CP/V2.3/CP20180515/ksb_180516_093904_ooi_g_ls9.fits.fz ksb_170624_074431_ooi_r_ls9-CCD4 r expnum 79280111 exptime 94.395 propid BASS seeing 1.03 MJD 57928.323 object 63293 90prime/CP/V2.3/CP20170623/ksb_170624_074431_ooi_r_ls9.fits.fz ksb_180510_094058_ooi_g_ls9-CCD2 g expnum 82480162 exptime 107.619 propid NOTBASS seeing 1.29 MJD 58248.403 object 27251 90prime/CP/V2.3/CP20180509/ksb_180510_094058_ooi_g_ls9.fits.fz ksb_170405_121011_ooi_r_ls9-CCD2 r expnum 78480199 exptime 205.035 propid BASS seeing 1.26 MJD 57848.507 object 27251 90prime/CP/V2.3/CP20170404/ksb_170405_121011_ooi_r_ls9.fits.fz Faked up EXPNUM 75720095 Faked up EXPNUM 75720095 Faked up EXPNUM 75720095 90prime get_fwhm: self.fwhm = 3.61 Found 4 relevant rows in amp-corrections file. Found overlap: image x 772 914 and amp range 0 2015 and image y 2033 2174 and amp range 0 2047 Range in image: x 0 143 , y 0 15 (with image size 143 x 142) dzp -0.011813398 -> scaling image by 0.989178436928226 Found overlap: image x 772 914 and amp range 0 2015 and image y 2033 2174 and amp range 2048 4095 Range in image: x 0 143 , y 15 142 (with image size 143 x 142) dzp -0.0051191514 -> scaling image by 0.9952961850385206 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75440189 Faked up EXPNUM 75440189 Faked up EXPNUM 75440189 90prime get_fwhm: self.fwhm = 4.01 WARNING: image median 0.019005131 is more than 1 sigma away from zero! Found 4 relevant rows in amp-corrections file. Found overlap: image x 766 908 and amp range 0 2015 and image y 2028 2168 and amp range 0 2047 Range in image: x 0 143 , y 0 20 (with image size 143 x 141) dzp -0.01149955 -> scaling image by 0.9894644150522871 Found overlap: image x 766 908 and amp range 0 2015 and image y 2028 2168 and amp range 2048 4095 Range in image: x 0 143 , y 20 141 (with image size 143 x 141) dzp -0.00015519658 -> scaling image by 0.9998570688798908 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 78480199 Faked up EXPNUM 78480199 Faked up EXPNUM 78480199 90prime get_fwhm: self.fwhm = 2.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2524 2665 and amp range 2016 4031 and image y 935 1077 and amp range 0 2047 Range in image: x 0 142 , y 0 143 (with image size 142 x 143) dzp 0.032776505 -> scaling image by 1.0306485625912574 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82540158 Faked up EXPNUM 82540158 Faked up EXPNUM 82540158 90prime get_fwhm: self.fwhm = 2.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 634 773 and amp range 0 2015 and image y 2534 2673 and amp range 2048 4095 Range in image: x 0 140 , y 0 140 (with image size 140 x 140) dzp 0.027550658 -> scaling image by 1.0256997821704772 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 79280111 Faked up EXPNUM 79280111 Faked up EXPNUM 79280111 90prime get_fwhm: self.fwhm = 2.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 615 754 and amp range 0 2015 and image y 2532 2671 and amp range 2048 4095 Range in image: x 0 140 , y 0 140 (with image size 140 x 140) dzp 0.01103811 -> scaling image by 1.0102183288830229 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2517 2758 and amp range 2006 4053 and image y 2917 3157 and amp range 2040 4078 Range in image: x 0 242 , y 0 241 (with image size 242 x 241) dzp -0.006092005 -> scaling image by 0.9944047680378836 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.63 Found 4 relevant rows in amp-corrections file. Found overlap: image x 923 1164 and amp range 0 2047 and image y 1717 1959 and amp range 0 2039 Range in image: x 0 242 , y 0 243 (with image size 242 x 243) dzp -0.006320339 -> scaling image by 0.9941956631368829 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.25 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3691 3942 and amp range 2048 4095 and image y 2011 2254 and amp range 0 2021 Range in image: x 0 252 , y 0 11 (with image size 252 x 244) dzp -0.029506588 -> scaling image by 0.9731893881648719 Found overlap: image x 3691 3942 and amp range 2048 4095 and image y 2011 2254 and amp range 2022 4060 Range in image: x 0 252 , y 11 244 (with image size 252 x 244) dzp -0.019603321 -> scaling image by 0.9821066946375949 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82480162 Faked up EXPNUM 82480162 Faked up EXPNUM 82480162 90prime get_fwhm: self.fwhm = 2.85 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2526 2667 and amp range 2016 4031 and image y 925 1067 and amp range 0 2047 Range in image: x 0 142 , y 0 143 (with image size 142 x 143) dzp 0.009189803 -> scaling image by 1.0085000434534261 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 31.47 s, CPU: 1.40 s, VmPeak: 957 MB, VmSize: 957 MB, VmRSS: 174 MB, VmData: 206 MB, maxrss: 0.177752 MB Stage tims finished: 2020-08-05T19:15:02.304435 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 5.464 s worker CPU, 51.655 s worker Wall, Wall: 31.470 s, Cores in use: 0.22, Total efficiency (on 16 cores): 1.4 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T19:15:02.328362 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01600.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01489.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01381.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01488.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/metrics/cus/reference-custom-283617p49657.fits Stage refs : Wall: 18.56 s, CPU: 7.49 s, VmPeak: 1038 MB, VmSize: 1033 MB, VmRSS: 252 MB, VmData: 281 MB, maxrss: 0.25754 MB Stage refs finished: 2020-08-05T19:15:20.889640 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 18.563 s, Cores in use: 0.40, Total efficiency (on 16 cores): 2.5 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T19:15:20.921302 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/metrics/cus/outlier-mask-custom-283617p49657.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/metrics/cus/outliers-pre-custom-283617p49657.jpg Image ksb_160703_092312_ooi_g_ls9-CCD1 g : masking 77 positive outlier pixels and 0 negative outlier pixels Image ksb_160605_104627_ooi_r_ls9-CCD1 r : masking 3083 positive outlier pixels and 0 negative outlier pixels Image k4m_160516_111312_ooi_zd_ls9-CCD2 z : masking 1651 positive outlier pixels and 0 negative outlier pixels Image k4m_170807_101013_ooi_zd_ls9-CCD4 z : masking 391 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/metrics/cus/outlier-mask-custom-283617p49657.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/metrics/cus/outliers-post-custom-283617p49657.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/metrics/cus/outliers-masked-pos-custom-283617p49657.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/metrics/cus/outliers-masked-neg-custom-283617p49657.jpg Stage outliers : Wall: 2.56 s, CPU: 2.00 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 265 MB, VmData: 292 MB, maxrss: 0.271028 MB Stage outliers finished: 2020-08-05T19:15:23.482032 Resources for stage outliers : 0.693 s worker CPU, 0.746 s worker Wall, Wall: 2.562 s, Cores in use: 1.05, Total efficiency (on 16 cores): 6.6 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T19:15:23.511025 Stage halos : Wall: 0.81 s, CPU: 0.80 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 265 MB, VmData: 292 MB, maxrss: 0.271264 MB Stage halos finished: 2020-08-05T19:15:24.325031 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.816 s, Cores in use: 0.98, Total efficiency (on 16 cores): 6.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T19:15:24.414899 PSF sigmas in coadd pixels: ['2.66', '2.01', '2.10'] Using average PSF sigma 2.254952495217227 Gaussian PSF norm 0.1251001040475148 vs pixelized 0.10977296 average tim pixel scale / coadd scale: 1.7299796259101792 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.95', '1.67', '2.04'] Using average PSF sigma 2.2197627342400907 Gaussian PSF norm 0.1270833082394502 vs pixelized 0.09309031 average tim pixel scale / coadd scale: 1.729353115972103 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.30', '1.53', '1.79'] Using average PSF sigma 1.542037962274532 Gaussian PSF norm 0.18293634701300324 vs pixelized 0.15275265 average tim pixel scale / coadd scale: 0.9910023561501093 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.14 s, CPU: 0.13 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 266 MB, VmData: 292 MB, maxrss: 0.272836 MB Stage fit_on_coadds finished: 2020-08-05T19:15:24.557234 Resources for stage fit_on_coadds : 0.182 s worker CPU, 0.182 s worker Wall, Wall: 0.144 s, Cores in use: 2.17, Total efficiency (on 16 cores): 13.5 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T19:15:24.568031 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 79 potential peaks Of 79 potential peaks: 44 in veto map, 8 cut by saddle test, 0 cut by aper test, 27 kept SED z : 27 new peaks Found 275 potential peaks Of 275 potential peaks: 266 in veto map, 7 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 59 potential peaks Of 59 potential peaks: 52 in veto map, 7 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 87 potential peaks Of 87 potential peaks: 74 in veto map, 9 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 115 potential peaks Of 115 potential peaks: 104 in veto map, 11 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 33 new sources Median coadd sky for g : 0.00043673033 Median coadd sky for r : 0.0012779988 Median coadd sky for z : -0.0006118902 Stage srcs : Wall: 0.65 s, CPU: 0.61 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 267 MB, VmData: 292 MB, maxrss: 0.273336 MB Stage srcs finished: 2020-08-05T19:15:25.217353 Resources for stage srcs : 0.073 s worker CPU, 0.073 s worker Wall, Wall: 0.651 s, Cores in use: 1.06, Total efficiency (on 16 cores): 6.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T19:15:25.234215 Blob 1 of 7, id: 0, sources: 34, size: 239x226, npix 35888, brick X: 0,239, Y: 0,226, one pixel: 55 0 Blob 2 of 7, id: 3, sources: 1, size: 33x34, npix 740, brick X: 143,176, Y: 201,235, one pixel: 155 201 Blob 3 of 7, id: 6, sources: 2, size: 43x22, npix 692, brick X: 166,209, Y: 217,239, one pixel: 192 217 Blob 4 of 7, id: 4, sources: 1, size: 26x31, npix 575, brick X: 15,41, Y: 208,239, one pixel: 26 208 Blob 5 of 7, id: 5, sources: 2, size: 28x24, npix 493, brick X: 211,239, Y: 215,239, one pixel: 225 215 Blob 6 of 7, id: 2, sources: 1, size: 19x34, npix 446, brick X: 0,19, Y: 179,213, one pixel: 4 179 Blob 7 of 7, id: 1, sources: 1, size: 27x25, npix 408, brick X: 209,236, Y: 174,199, one pixel: 223 174 Measuring 1 iterative sources Blob 7 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 812 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14988 MB Blob 4 finished, total: Wall: 0.57 s, CPU: 0.56 s, VmPeak: 809 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149664 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (283.55706, 49.66612), pm (-5.1, -17.0), parallax 4.247 with NanoMaggies: g=12.5, r=12, z=11.8 Reset brightness to NanoMaggies: g=12.5, r=12, z=11.8 Measuring 1 iterative sources Blob 6 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 94 MB, VmData: 141 MB, maxrss: 0.095908 MB Blob 2 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 814 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149636 MB Blob 5 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.094716 MB Blob 3 finished, total: Wall: 1.44 s, CPU: 1.44 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092512 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (283.66604, 49.65938), pm (-2.9, -9.5), parallax 0.659 with NanoMaggies: g=11.4, r=10.4, z=9.88 Reset brightness to NanoMaggies: g=11.4, r=10.4, z=9.88 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (283.64265, 49.65791), pm (1.3, -3.0), parallax 0.551 with NanoMaggies: g=16.2, r=15.7, z=15.6 Reset brightness to NanoMaggies: g=16.2, r=15.7, z=15.6 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.74644, ee1=-0.228498, ee2=0.00315729 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (283.60406, 49.65753), pm (-3.0, -9.4), parallax -0.320 with NanoMaggies: g=24.2, r=21.7, z=21.2 Reset brightness to NanoMaggies: g=21.5, r=20.5, z=20 Measuring 9 iterative sources Blob 1 finished, total: Wall: 28.41 s, CPU: 28.40 s, VmPeak: 721 MB, VmSize: 721 MB, VmRSS: 155 MB, VmData: 189 MB, maxrss: 0.158716 MB Old catalog: 56 New catalog: 52 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/metrics/cus/blobs-custom-283617p49657.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/metrics/cus/all-models-custom-283617p49657.fits Stage fitblobs : Wall: 28.80 s, CPU: 0.36 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 270 MB, VmData: 294 MB, maxrss: 0.2762 MB Stage fitblobs finished: 2020-08-05T19:15:54.030369 Resources for stage fitblobs : 33.430 s worker CPU, 33.475 s worker Wall, Wall: 28.798 s, Cores in use: 1.17, Total efficiency (on 16 cores): 7.3 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T19:15:54.044589 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/tmp-legacysurvey-custom-283617p49657-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/tmp-legacysurvey-custom-283617p49657-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/tmp-legacysurvey-custom-283617p49657-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/tmp-legacysurvey-custom-283617p49657-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-resid.jpg Stage coadds : Wall: 5.31 s, CPU: 0.68 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 270 MB, VmData: 294 MB, maxrss: 0.276524 MB Stage coadds finished: 2020-08-05T19:15:59.356626 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 10.314 s worker CPU, 16.149 s worker Wall, Wall: 5.313 s, Cores in use: 2.07, Total efficiency (on 16 cores): 12.9 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T19:15:59.373712 Cut to 1 unWISE tiles Reading WISE tile 2833p499 band 2 Reading WISE tile 2833p499 band 1 Reading WISE tile 2833p499 band 4 Reading WISE tile 2833p499 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 813 MB, VmSize: 799 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.202868 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 806 MB, VmSize: 804 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.192708 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 809 MB, VmSize: 806 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.212564 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 812 MB, VmSize: 805 MB, VmRSS: 146 MB, VmData: 173 MB, maxrss: 0.209184 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/tmp-legacysurvey-custom-283617p49657-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/tmp-legacysurvey-custom-283617p49657-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.38 s, CPU: 1.13 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 271 MB, VmData: 294 MB, maxrss: 0.277036 MB Stage wise_forced finished: 2020-08-05T19:16:02.752856 Resources for stage wise_forced : 3.254 s worker CPU, 6.025 s worker Wall, Wall: 3.381 s, Cores in use: 1.30, Total efficiency (on 16 cores): 8.1 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T19:16:02.777307 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/tractor-i/cus/tractor-custom-283617p49657.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/tractor/cus/tractor-custom-283617p49657.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/tractor/cus/brick-custom-283617p49657.sha256sum Stage writecat : Wall: 5.59 s, CPU: 2.23 s, VmPeak: 1175 MB, VmSize: 1047 MB, VmRSS: 272 MB, VmData: 294 MB, maxrss: 0.409916 MB Stage writecat finished: 2020-08-05T19:16:08.370677 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.595 s, Cores in use: 0.40, Total efficiency (on 16 cores): 2.5 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-writecat.p All done: 53.414 s worker CPU, 108.309 s worker Wall, Wall: 97.556 s, Cores in use: 0.72, Total efficiency (on 16 cores): 4.5 % Finished galaxy PGC2349545 in 1.700 minutes. Started working on galaxy PGC2349545 at Wed Aug 5 19:50:01 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 283.617582 49.657974200000005 --width 239 --height 239 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T19:50:02.837957 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '283.617582', '49.657974200000005', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 283.617582 49.657974200000005 --width 239 --height 239 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 283.617582 49.657974200000005 Starting process 28767 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 28768 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 28769 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 28770 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 28771 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 28772 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 28773 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 28774 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 28775 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 28776 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 28777 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 28778 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 28779 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 28780 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 28781 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 28782 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 28783 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 28784 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 28785 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 28786 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 28787 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 28788 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 28789 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 28790 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 28791 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 28792 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 28793 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 28794 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 28795 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 28796 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 28797 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 28798 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T19:50:03.371338 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 10 CCDs: k4m_160519_110151_ooi_zd_ls9-CCD1 z expnum 90283 exptime 80.103 propid 2016A-0453 seeing 0.80 MJD 57527.460 object MzLS_648718_z mosaic/CP/V4.3/CP20160518/k4m_160519_110151_ooi_zd_ls9.fits.fz k4m_160516_111312_ooi_zd_ls9-CCD2 z expnum 89326 exptime 80.103 propid 2016A-0453 seeing 0.94 MJD 57524.467 object MzLS_647904_z mosaic/CP/V4.3/CP20160515/k4m_160516_111312_ooi_zd_ls9.fits.fz k4m_170807_101013_ooi_zd_ls9-CCD4 z expnum 136201 exptime 129.104 propid 2016A-0453 seeing 1.10 MJD 57972.424 object MzLS_647086_z mosaic/CP/V4.3/CP20170806/k4m_170807_101013_ooi_zd_ls9.fits.fz k4m_170807_102008_ooi_zd_ls9-CCD1 z expnum 136204 exptime 158.103 propid 2016A-0453 seeing 1.32 MJD 57972.431 object MzLS_649528_z mosaic/CP/V4.3/CP20170806/k4m_170807_102008_ooi_zd_ls9.fits.fz ksb_160605_104627_ooi_r_ls9-CCD1 r expnum 75440189 exptime 250.6 propid BASS seeing 1.82 MJD 57544.449 object 26092 90prime/CP/V2.3/CP20160604/ksb_160605_104627_ooi_r_ls9.fits.fz ksb_160703_092312_ooi_g_ls9-CCD1 g expnum 75720095 exptime 97.8 propid BASS seeing 1.64 MJD 57572.391 object 26092 90prime/CP/V2.3/CP20160702/ksb_160703_092312_ooi_g_ls9.fits.fz ksb_180516_093904_ooi_g_ls9-CCD4 g expnum 82540158 exptime 92.209 propid NOTBASS seeing 1.24 MJD 58254.402 object 63293 90prime/CP/V2.3/CP20180515/ksb_180516_093904_ooi_g_ls9.fits.fz ksb_170624_074431_ooi_r_ls9-CCD4 r expnum 79280111 exptime 94.395 propid BASS seeing 1.03 MJD 57928.323 object 63293 90prime/CP/V2.3/CP20170623/ksb_170624_074431_ooi_r_ls9.fits.fz ksb_180510_094058_ooi_g_ls9-CCD2 g expnum 82480162 exptime 107.619 propid NOTBASS seeing 1.29 MJD 58248.403 object 27251 90prime/CP/V2.3/CP20180509/ksb_180510_094058_ooi_g_ls9.fits.fz ksb_170405_121011_ooi_r_ls9-CCD2 r expnum 78480199 exptime 205.035 propid BASS seeing 1.26 MJD 57848.507 object 27251 90prime/CP/V2.3/CP20170404/ksb_170405_121011_ooi_r_ls9.fits.fz Faked up EXPNUM 75720095 Faked up EXPNUM 75720095 Faked up EXPNUM 75720095 90prime get_fwhm: self.fwhm = 3.61 Found 4 relevant rows in amp-corrections file. Found overlap: image x 772 914 and amp range 0 2015 and image y 2033 2174 and amp range 0 2047 Range in image: x 0 143 , y 0 15 (with image size 143 x 142) dzp -0.011813398 -> scaling image by 0.989178436928226 Found overlap: image x 772 914 and amp range 0 2015 and image y 2033 2174 and amp range 2048 4095 Range in image: x 0 143 , y 15 142 (with image size 143 x 142) dzp -0.0051191514 -> scaling image by 0.9952961850385206 Faked up EXPNUM 82540158 Faked up EXPNUM 82540158 Faked up EXPNUM 82540158 90prime get_fwhm: self.fwhm = 2.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 634 773 and amp range 0 2015 and image y 2534 2673 and amp range 2048 4095 Range in image: x 0 140 , y 0 140 (with image size 140 x 140) dzp 0.027550658 -> scaling image by 1.0256997821704772 Faked up EXPNUM 78480199 Faked up EXPNUM 78480199 Faked up EXPNUM 78480199 90prime get_fwhm: self.fwhm = 2.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2524 2665 and amp range 2016 4031 and image y 935 1077 and amp range 0 2047 Range in image: x 0 142 , y 0 143 (with image size 142 x 143) dzp 0.032776505 -> scaling image by 1.0306485625912574 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75440189 Faked up EXPNUM 75440189 Faked up EXPNUM 75440189 90prime get_fwhm: self.fwhm = 4.01 WARNING: image median 0.019005131 is more than 1 sigma away from zero! Found 4 relevant rows in amp-corrections file. Found overlap: image x 766 908 and amp range 0 2015 and image y 2028 2168 and amp range 0 2047 Range in image: x 0 143 , y 0 20 (with image size 143 x 141) dzp -0.01149955 -> scaling image by 0.9894644150522871 Found overlap: image x 766 908 and amp range 0 2015 and image y 2028 2168 and amp range 2048 4095 Range in image: x 0 143 , y 20 141 (with image size 143 x 141) dzp -0.00015519658 -> scaling image by 0.9998570688798908 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.63 Found 4 relevant rows in amp-corrections file. Found overlap: image x 923 1164 and amp range 0 2047 and image y 1717 1959 and amp range 0 2039 Range in image: x 0 242 , y 0 243 (with image size 242 x 243) dzp -0.006320339 -> scaling image by 0.9941956631368829 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 79280111 Faked up EXPNUM 79280111 Faked up EXPNUM 79280111 90prime get_fwhm: self.fwhm = 2.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 615 754 and amp range 0 2015 and image y 2532 2671 and amp range 2048 4095 Range in image: x 0 140 , y 0 140 (with image size 140 x 140) dzp 0.01103811 -> scaling image by 1.0102183288830229 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.25 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3691 3942 and amp range 2048 4095 and image y 2011 2254 and amp range 0 2021 Range in image: x 0 252 , y 0 11 (with image size 252 x 244) dzp -0.029506588 -> scaling image by 0.9731893881648719 Found overlap: image x 3691 3942 and amp range 2048 4095 and image y 2011 2254 and amp range 2022 4060 Range in image: x 0 252 , y 11 244 (with image size 252 x 244) dzp -0.019603321 -> scaling image by 0.9821066946375949 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2517 2758 and amp range 2006 4053 and image y 2917 3157 and amp range 2040 4078 Range in image: x 0 242 , y 0 241 (with image size 242 x 241) dzp -0.006092005 -> scaling image by 0.9944047680378836 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82480162 Faked up EXPNUM 82480162 Faked up EXPNUM 82480162 90prime get_fwhm: self.fwhm = 2.85 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2526 2667 and amp range 2016 4031 and image y 925 1067 and amp range 0 2047 Range in image: x 0 142 , y 0 143 (with image size 142 x 143) dzp 0.009189803 -> scaling image by 1.0085000434534261 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 14.96 s, CPU: 0.94 s, VmPeak: 957 MB, VmSize: 957 MB, VmRSS: 174 MB, VmData: 206 MB, maxrss: 0.177964 MB Stage tims finished: 2020-08-05T19:50:18.334424 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 4.892 s worker CPU, 36.362 s worker Wall, Wall: 14.966 s, Cores in use: 0.39, Total efficiency (on 32 cores): 1.2 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T19:50:18.374289 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01600.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01489.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01381.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01488.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/metrics/cus/reference-custom-283617p49657.fits Stage refs : Wall: 16.93 s, CPU: 7.37 s, VmPeak: 1038 MB, VmSize: 1033 MB, VmRSS: 252 MB, VmData: 282 MB, maxrss: 0.257748 MB Stage refs finished: 2020-08-05T19:50:35.304706 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 16.933 s, Cores in use: 0.44, Total efficiency (on 32 cores): 1.4 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T19:50:35.375659 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/metrics/cus/outlier-mask-custom-283617p49657.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/metrics/cus/outliers-pre-custom-283617p49657.jpg Image ksb_160703_092312_ooi_g_ls9-CCD1 g : masking 77 positive outlier pixels and 0 negative outlier pixels Image ksb_160605_104627_ooi_r_ls9-CCD1 r : masking 3083 positive outlier pixels and 0 negative outlier pixels Image k4m_160516_111312_ooi_zd_ls9-CCD2 z : masking 1651 positive outlier pixels and 0 negative outlier pixels Image k4m_170807_101013_ooi_zd_ls9-CCD4 z : masking 391 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/metrics/cus/outlier-mask-custom-283617p49657.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/metrics/cus/outliers-post-custom-283617p49657.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/metrics/cus/outliers-masked-pos-custom-283617p49657.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/metrics/cus/outliers-masked-neg-custom-283617p49657.jpg Stage outliers : Wall: 3.58 s, CPU: 2.86 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 265 MB, VmData: 292 MB, maxrss: 0.271768 MB Stage outliers finished: 2020-08-05T19:50:38.960278 Resources for stage outliers : 0.839 s worker CPU, 1.164 s worker Wall, Wall: 3.587 s, Cores in use: 1.03, Total efficiency (on 32 cores): 3.2 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T19:50:38.986155 Stage halos : Wall: 0.93 s, CPU: 0.90 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 266 MB, VmData: 293 MB, maxrss: 0.272016 MB Stage halos finished: 2020-08-05T19:50:39.912061 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.928 s, Cores in use: 0.98, Total efficiency (on 32 cores): 3.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T19:50:40.020300 PSF sigmas in coadd pixels: ['2.66', '2.01', '2.10'] Using average PSF sigma 2.254952495217227 Gaussian PSF norm 0.1251001040475148 vs pixelized 0.10977296 average tim pixel scale / coadd scale: 1.7299796259101792 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.95', '1.67', '2.04'] Using average PSF sigma 2.2197627342400907 Gaussian PSF norm 0.1270833082394502 vs pixelized 0.09309031 average tim pixel scale / coadd scale: 1.729353115972103 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.30', '1.53', '1.79'] Using average PSF sigma 1.542037962274532 Gaussian PSF norm 0.18293634701300324 vs pixelized 0.15275265 average tim pixel scale / coadd scale: 0.9910023561501093 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.17 s, CPU: 0.13 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 267 MB, VmData: 293 MB, maxrss: 0.273648 MB Stage fit_on_coadds finished: 2020-08-05T19:50:40.193995 Resources for stage fit_on_coadds : 0.152 s worker CPU, 0.152 s worker Wall, Wall: 0.176 s, Cores in use: 1.64, Total efficiency (on 32 cores): 5.1 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-fit_on_coadds.p Running stage srcs Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage srcs at 2020-08-05T19:50:40.211002 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 79 potential peaks Of 79 potential peaks: 44 in veto map, 8 cut by saddle test, 0 cut by aper test, 27 kept SED z : 27 new peaks Found 275 potential peaks Of 275 potential peaks: 266 in veto map, 7 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 59 potential peaks Of 59 potential peaks: 52 in veto map, 7 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 87 potential peaks Of 87 potential peaks: 74 in veto map, 9 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 115 potential peaks Of 115 potential peaks: 104 in veto map, 11 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 33 new sources Median coadd sky for g : 0.00043673033 Median coadd sky for r : 0.0012779988 Median coadd sky for z : -0.0006118902 Stage srcs : Wall: 1.06 s, CPU: 1.01 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 268 MB, VmData: 293 MB, maxrss: 0.274148 MB Stage srcs finished: 2020-08-05T19:50:41.267064 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage srcs : 0.082 s worker CPU, 0.082 s worker Wall, Wall: 1.058 s, Cores in use: 1.03, Total efficiency (on 32 cores): 3.2 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T19:50:41.281929 Blob 1 of 7, id: 0, sources: 34, size: 239x226, npix 35888, brick X: 0,239, Y: 0,226, one pixel: 55 0 Blob 2 of 7, id: 3, sources: 1, size: 33x34, npix 740, brick X: 143,176, Y: 201,235, one pixel: 155 201 Blob 3 of 7, id: 6, sources: 2, size: 43x22, npix 692, brick X: 166,209, Y: 217,239, one pixel: 192 217 Blob 4 of 7, id: 4, sources: 1, size: 26x31, npix 575, brick X: 15,41, Y: 208,239, one pixel: 26 208 Blob 5 of 7, id: 5, sources: 2, size: 28x24, npix 493, brick X: 211,239, Y: 215,239, one pixel: 225 215 Blob 6 of 7, id: 2, sources: 1, size: 19x34, npix 446, brick X: 0,19, Y: 179,213, one pixel: 4 179 Blob 7 of 7, id: 1, sources: 1, size: 27x25, npix 408, brick X: 209,236, Y: 174,199, one pixel: 223 174 Measuring 1 iterative sources Blob 4 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 824 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150028 MB Blob 7 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092428 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (283.55706, 49.66612), pm (-5.1, -17.0), parallax 4.247 with NanoMaggies: g=12.5, r=12, z=11.8 Reset brightness to NanoMaggies: g=12.5, r=12, z=11.8 Measuring 1 iterative sources Blob 6 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.09498 MB Blob 2 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095132 MB Blob 5 finished, total: Wall: 0.83 s, CPU: 0.83 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.151028 MB Blob 3 finished, total: Wall: 1.40 s, CPU: 1.40 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092444 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (283.66604, 49.65938), pm (-2.9, -9.5), parallax 0.659 with NanoMaggies: g=11.4, r=10.4, z=9.88 Reset brightness to NanoMaggies: g=11.4, r=10.4, z=9.88 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (283.64265, 49.65791), pm (1.3, -3.0), parallax 0.551 with NanoMaggies: g=16.2, r=15.7, z=15.6 Reset brightness to NanoMaggies: g=16.2, r=15.7, z=15.6 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.74644, ee1=-0.228498, ee2=0.00315729 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (283.60406, 49.65753), pm (-3.0, -9.4), parallax -0.320 with NanoMaggies: g=24.2, r=21.7, z=21.2 Reset brightness to NanoMaggies: g=21.5, r=20.5, z=20 Measuring 9 iterative sources Blob 1 finished, total: Wall: 27.98 s, CPU: 27.94 s, VmPeak: 709 MB, VmSize: 692 MB, VmRSS: 124 MB, VmData: 163 MB, maxrss: 0.143756 MB Old catalog: 56 New catalog: 52 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/metrics/cus/blobs-custom-283617p49657.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/metrics/cus/all-models-custom-283617p49657.fits Stage fitblobs : Wall: 28.48 s, CPU: 0.40 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 270 MB, VmData: 295 MB, maxrss: 0.276908 MB Stage fitblobs finished: 2020-08-05T19:51:09.763004 Resources for stage fitblobs : 32.979 s worker CPU, 33.097 s worker Wall, Wall: 28.483 s, Cores in use: 1.17, Total efficiency (on 32 cores): 3.7 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T19:51:09.789926 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/tmp-legacysurvey-custom-283617p49657-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/tmp-legacysurvey-custom-283617p49657-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/tmp-legacysurvey-custom-283617p49657-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/tmp-legacysurvey-custom-283617p49657-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-resid.jpg Stage coadds : Wall: 5.51 s, CPU: 2.09 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 271 MB, VmData: 295 MB, maxrss: 0.277336 MB Stage coadds finished: 2020-08-05T19:51:15.298162 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 26.320 s worker CPU, 60.694 s worker Wall, Wall: 5.511 s, Cores in use: 5.16, Total efficiency (on 32 cores): 16.1 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T19:51:15.317738 Cut to 1 unWISE tiles Reading WISE tile 2833p499 band 2 Reading WISE tile 2833p499 band 1 Reading WISE tile 2833p499 band 4 Reading WISE tile 2833p499 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 807 MB, VmSize: 804 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.190364 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 798 MB, VmSize: 798 MB, VmRSS: 137 MB, VmData: 170 MB, maxrss: 0.1972 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 824 MB, VmSize: 803 MB, VmRSS: 144 MB, VmData: 171 MB, maxrss: 0.207172 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 799 MB, VmSize: 799 MB, VmRSS: 138 MB, VmData: 171 MB, maxrss: 0.198432 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/tmp-legacysurvey-custom-283617p49657-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/tmp-legacysurvey-custom-283617p49657-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.55 s, CPU: 0.93 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 271 MB, VmData: 295 MB, maxrss: 0.277848 MB Stage wise_forced finished: 2020-08-05T19:51:17.869832 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.359 s worker CPU, 4.921 s worker Wall, Wall: 2.554 s, Cores in use: 1.68, Total efficiency (on 32 cores): 5.2 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-wise_forced.p Running stage writecat WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage writecat at 2020-08-05T19:51:17.890692 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/coadd/cus/custom-283617p49657/legacysurvey-custom-283617p49657-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/tractor-i/cus/tractor-custom-283617p49657.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/tractor/cus/tractor-custom-283617p49657.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/tractor/cus/brick-custom-283617p49657.sha256sum Stage writecat : Wall: 2.41 s, CPU: 1.24 s, VmPeak: 1175 MB, VmSize: 1047 MB, VmRSS: 273 MB, VmData: 295 MB, maxrss: 0.410728 MB Stage writecat finished: 2020-08-05T19:51:20.304365 Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 2.417 s, Cores in use: 0.52, Total efficiency (on 32 cores): 1.6 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/283/PGC2349545/PGC2349545-largegalaxy-writecat.p All done: 68.631 s worker CPU, 136.480 s worker Wall, Wall: 76.965 s, Cores in use: 1.13, Total efficiency (on 32 cores): 3.5 % WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Finished galaxy PGC2349545 in 1.330 minutes. Started working on galaxy PGC2349545 at Fri Aug 7 09:22:43 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 283.617507725709 49.65810362227109 --width 239 --height 239 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/PGC2349545-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/PGC2349545-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T09:22:44.256038 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '283.617507725709', '49.65810362227109', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/PGC2349545-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/PGC2349545-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 283.617507725709 49.65810362227109 --width 239 --height 239 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/PGC2349545-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/PGC2349545-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 283.617507725709 49.65810362227109 Starting process 32932 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 32933 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 32934 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 32935 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 32936 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 32937 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 32938 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 32939 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 32940 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 32941 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 32942 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 32943 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 32944 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 32945 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 32946 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 32947 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T09:22:44.768088 Keeping 10 CCDs: k4m_160519_110151_ooi_zd_ls9-CCD1 z expnum 90283 exptime 80.103 propid 2016A-0453 seeing 0.80 MJD 57527.460 object MzLS_648718_z mosaic/CP/V4.3/CP20160518/k4m_160519_110151_ooi_zd_ls9.fits.fz k4m_160516_111312_ooi_zd_ls9-CCD2 z expnum 89326 exptime 80.103 propid 2016A-0453 seeing 0.94 MJD 57524.467 object MzLS_647904_z mosaic/CP/V4.3/CP20160515/k4m_160516_111312_ooi_zd_ls9.fits.fz k4m_170807_101013_ooi_zd_ls9-CCD4 z expnum 136201 exptime 129.104 propid 2016A-0453 seeing 1.10 MJD 57972.424 object MzLS_647086_z mosaic/CP/V4.3/CP20170806/k4m_170807_101013_ooi_zd_ls9.fits.fz k4m_170807_102008_ooi_zd_ls9-CCD1 z expnum 136204 exptime 158.103 propid 2016A-0453 seeing 1.32 MJD 57972.431 object MzLS_649528_z mosaic/CP/V4.3/CP20170806/k4m_170807_102008_ooi_zd_ls9.fits.fz ksb_160605_104627_ooi_r_ls9-CCD1 r expnum 75440189 exptime 250.6 propid BASS seeing 1.82 MJD 57544.449 object 26092 90prime/CP/V2.3/CP20160604/ksb_160605_104627_ooi_r_ls9.fits.fz ksb_160703_092312_ooi_g_ls9-CCD1 g expnum 75720095 exptime 97.8 propid BASS seeing 1.64 MJD 57572.391 object 26092 90prime/CP/V2.3/CP20160702/ksb_160703_092312_ooi_g_ls9.fits.fz ksb_180516_093904_ooi_g_ls9-CCD4 g expnum 82540158 exptime 92.209 propid NOTBASS seeing 1.24 MJD 58254.402 object 63293 90prime/CP/V2.3/CP20180515/ksb_180516_093904_ooi_g_ls9.fits.fz ksb_170624_074431_ooi_r_ls9-CCD4 r expnum 79280111 exptime 94.395 propid BASS seeing 1.03 MJD 57928.323 object 63293 90prime/CP/V2.3/CP20170623/ksb_170624_074431_ooi_r_ls9.fits.fz ksb_180510_094058_ooi_g_ls9-CCD2 g expnum 82480162 exptime 107.619 propid NOTBASS seeing 1.29 MJD 58248.403 object 27251 90prime/CP/V2.3/CP20180509/ksb_180510_094058_ooi_g_ls9.fits.fz ksb_170405_121011_ooi_r_ls9-CCD2 r expnum 78480199 exptime 205.035 propid BASS seeing 1.26 MJD 57848.507 object 27251 90prime/CP/V2.3/CP20170404/ksb_170405_121011_ooi_r_ls9.fits.fz mosaic get_fwhm: self.fwhm = 3.63 Found 4 relevant rows in amp-corrections file. Found overlap: image x 925 1166 and amp range 0 2047 and image y 1716 1958 and amp range 0 2039 Range in image: x 0 242 , y 0 243 (with image size 242 x 243) dzp -0.006320339 -> scaling image by 0.9941956631368829 mosaic get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2519 2759 and amp range 2006 4053 and image y 2916 3157 and amp range 2040 4078 Range in image: x 0 241 , y 0 242 (with image size 241 x 242) dzp -0.006092005 -> scaling image by 0.9944047680378836 mosaic get_fwhm: self.fwhm = 4.25 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3693 3944 and amp range 2048 4095 and image y 2010 2254 and amp range 0 2021 Range in image: x 0 252 , y 0 12 (with image size 252 x 245) dzp -0.029506588 -> scaling image by 0.9731893881648719 Found overlap: image x 3693 3944 and amp range 2048 4095 and image y 2010 2254 and amp range 2022 4060 Range in image: x 0 252 , y 12 245 (with image size 252 x 245) dzp -0.019603321 -> scaling image by 0.9821066946375949 Faked up EXPNUM 75440189 Faked up EXPNUM 75440189 Faked up EXPNUM 75440189 90prime get_fwhm: self.fwhm = 4.01 WARNING: image median 0.018965324 is more than 1 sigma away from zero! Found 4 relevant rows in amp-corrections file. Found overlap: image x 765 907 and amp range 0 2015 and image y 2028 2169 and amp range 0 2047 Range in image: x 0 143 , y 0 20 (with image size 143 x 142) dzp -0.01149955 -> scaling image by 0.9894644150522871 Found overlap: image x 765 907 and amp range 0 2015 and image y 2028 2169 and amp range 2048 4095 Range in image: x 0 143 , y 20 142 (with image size 143 x 142) dzp -0.00015519658 -> scaling image by 0.9998570688798908 Faked up EXPNUM 75720095 Faked up EXPNUM 75720095 Faked up EXPNUM 75720095 90prime get_fwhm: self.fwhm = 3.61 Found 4 relevant rows in amp-corrections file. Found overlap: image x 771 913 and amp range 0 2015 and image y 2034 2174 and amp range 0 2047 Range in image: x 0 143 , y 0 14 (with image size 143 x 141) dzp -0.011813398 -> scaling image by 0.989178436928226 Found overlap: image x 771 913 and amp range 0 2015 and image y 2034 2174 and amp range 2048 4095 Range in image: x 0 143 , y 14 141 (with image size 143 x 141) dzp -0.0051191514 -> scaling image by 0.9952961850385206 Faked up EXPNUM 82540158 Faked up EXPNUM 82540158 Faked up EXPNUM 82540158 90prime get_fwhm: self.fwhm = 2.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 633 772 and amp range 0 2015 and image y 2534 2673 and amp range 2048 4095 Range in image: x 0 140 , y 0 140 (with image size 140 x 140) dzp 0.027550658 -> scaling image by 1.0256997821704772 Faked up EXPNUM 79280111 Faked up EXPNUM 79280111 Faked up EXPNUM 79280111 90prime get_fwhm: self.fwhm = 2.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 614 753 and amp range 0 2015 and image y 2532 2671 and amp range 2048 4095 Range in image: x 0 140 , y 0 140 (with image size 140 x 140) dzp 0.01103811 -> scaling image by 1.0102183288830229 Faked up EXPNUM 78480199 Faked up EXPNUM 78480199 Faked up EXPNUM 78480199 90prime get_fwhm: self.fwhm = 2.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2523 2664 and amp range 2016 4031 and image y 936 1078 and amp range 0 2047 Range in image: x 0 142 , y 0 143 (with image size 142 x 143) dzp 0.032776505 -> scaling image by 1.0306485625912574 Faked up EXPNUM 82480162 Faked up EXPNUM 82480162 Faked up EXPNUM 82480162 90prime get_fwhm: self.fwhm = 2.85 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2525 2666 and amp range 2016 4031 and image y 925 1068 and amp range 0 2047 Range in image: x 0 142 , y 0 144 (with image size 142 x 144) dzp 0.009189803 -> scaling image by 1.0085000434534261 Stage tims : Wall: 45.84 s, CPU: 0.96 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 172 MB, VmData: 206 MB, maxrss: 0.176048 MB Stage tims finished: 2020-08-07T09:23:30.604159 Resources for stage tims : 4.715 s worker CPU, 236.721 s worker Wall, Wall: 45.838 s, Cores in use: 0.12, Total efficiency (on 16 cores): 0.8 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/PGC2349545-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/PGC2349545-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T09:23:31.011176 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01600.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01489.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01381.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01488.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/metrics/cus/reference-custom-283617p49658.fits Stage refs : Wall: 8.49 s, CPU: 6.60 s, VmPeak: 1032 MB, VmSize: 1026 MB, VmRSS: 250 MB, VmData: 281 MB, maxrss: 0.255928 MB Stage refs finished: 2020-08-07T09:23:39.504319 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.495 s, Cores in use: 0.78, Total efficiency (on 16 cores): 4.9 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/PGC2349545-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/PGC2349545-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T09:23:39.690428 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/metrics/cus/outlier-mask-custom-283617p49658.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/metrics/cus/outliers-pre-custom-283617p49658.jpg Image ksb_160703_092312_ooi_g_ls9-CCD1 g : masking 111 positive outlier pixels and 0 negative outlier pixels Image ksb_160605_104627_ooi_r_ls9-CCD1 r : masking 3116 positive outlier pixels and 0 negative outlier pixels Image k4m_160516_111312_ooi_zd_ls9-CCD2 z : masking 1606 positive outlier pixels and 0 negative outlier pixels Image k4m_170807_101013_ooi_zd_ls9-CCD4 z : masking 347 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/metrics/cus/outlier-mask-custom-283617p49658.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/metrics/cus/outliers-post-custom-283617p49658.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/metrics/cus/outliers-masked-pos-custom-283617p49658.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/metrics/cus/outliers-masked-neg-custom-283617p49658.jpg Stage outliers : Wall: 0.83 s, CPU: 0.59 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 263 MB, VmData: 291 MB, maxrss: 0.268992 MB Stage outliers finished: 2020-08-07T09:23:40.521121 Resources for stage outliers : 0.734 s worker CPU, 0.823 s worker Wall, Wall: 0.832 s, Cores in use: 1.59, Total efficiency (on 16 cores): 9.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/PGC2349545-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/PGC2349545-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T09:23:40.607754 Stage halos : Wall: 0.36 s, CPU: 0.30 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 263 MB, VmData: 291 MB, maxrss: 0.269352 MB Stage halos finished: 2020-08-07T09:23:40.971331 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.365 s, Cores in use: 0.84, Total efficiency (on 16 cores): 5.2 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/PGC2349545-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/PGC2349545-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T09:23:41.014004 PSF sigmas in coadd pixels: ['2.66', '2.01', '2.10'] Using average PSF sigma 2.254952495217227 Gaussian PSF norm 0.1251001040475148 vs pixelized 0.10977258 average tim pixel scale / coadd scale: 1.7299796259101792 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.95', '1.67', '2.04'] Using average PSF sigma 2.2197627342400907 Gaussian PSF norm 0.1270833082394502 vs pixelized 0.0930913 average tim pixel scale / coadd scale: 1.729353115972103 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.30', '1.53', '1.79'] Using average PSF sigma 1.542037962274532 Gaussian PSF norm 0.18293634701300324 vs pixelized 0.15275083 average tim pixel scale / coadd scale: 0.9910023561501093 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.14 s, CPU: 0.13 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 264 MB, VmData: 291 MB, maxrss: 0.270824 MB Stage fit_on_coadds finished: 2020-08-07T09:23:41.152808 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.180 s worker CPU, 0.180 s worker Wall, Wall: 0.140 s, Cores in use: 2.22, Total efficiency (on 16 cores): 13.9 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/PGC2349545-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/PGC2349545-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T09:23:41.162803 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 75 potential peaks Of 75 potential peaks: 39 in veto map, 9 cut by saddle test, 0 cut by aper test, 27 kept SED z : 27 new peaks Found 290 potential peaks Of 290 potential peaks: 281 in veto map, 8 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 58 potential peaks Of 58 potential peaks: 51 in veto map, 7 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 85 potential peaks Of 85 potential peaks: 73 in veto map, 8 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 112 potential peaks Of 112 potential peaks: 100 in veto map, 12 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 32 new sources Median coadd sky for g : 0.0004231337 Median coadd sky for r : 0.0013259887 Median coadd sky for z : -0.00065725396 Stage srcs : Wall: 0.67 s, CPU: 0.64 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 265 MB, VmData: 291 MB, maxrss: 0.271308 MB Stage srcs finished: 2020-08-07T09:23:41.833499 Resources for stage srcs : 0.072 s worker CPU, 0.072 s worker Wall, Wall: 0.672 s, Cores in use: 1.06, Total efficiency (on 16 cores): 6.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/PGC2349545-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/PGC2349545-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T09:23:41.956308 Blob 1 of 6, id: 0, sources: 33, size: 239x224, npix 35759, brick X: 0,239, Y: 0,224, one pixel: 52 0 Blob 2 of 6, id: 3, sources: 2, size: 67x40, npix 1615, brick X: 142,209, Y: 199,239, one pixel: 155 199 Blob 3 of 6, id: 4, sources: 2, size: 27x32, npix 604, brick X: 14,41, Y: 207,239, one pixel: 23 207 Blob 4 of 6, id: 5, sources: 2, size: 29x26, npix 556, brick X: 210,239, Y: 213,239, one pixel: 225 213 Blob 5 of 6, id: 2, sources: 1, size: 18x32, npix 412, brick X: 0,18, Y: 179,211, one pixel: 4 179 Blob 6 of 6, id: 1, sources: 1, size: 26x25, npix 406, brick X: 209,235, Y: 172,197, one pixel: 223 172 Blob 6 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145644 MB Blob 3 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.09286 MB Blob 5 finished, total: Wall: 0.63 s, CPU: 0.63 s, VmPeak: 806 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.14644 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (283.55706, 49.66612), pm (-5.1, -17.0), parallax 4.247 with NanoMaggies: g=12.5, r=12, z=11.8 Reset brightness to NanoMaggies: g=12.5, r=12, z=11.8 Measuring 1 iterative sources Blob 4 finished, total: Wall: 0.88 s, CPU: 0.87 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.094288 MB Measuring 1 iterative sources Blob 2 finished, total: Wall: 1.49 s, CPU: 1.49 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146028 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (283.66604, 49.65938), pm (-2.9, -9.5), parallax 0.659 with NanoMaggies: g=11.4, r=10.4, z=9.88 Reset brightness to NanoMaggies: g=11.4, r=10.4, z=9.88 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (283.64265, 49.65791), pm (1.3, -3.0), parallax 0.551 with NanoMaggies: g=16.2, r=15.7, z=15.6 Reset brightness to NanoMaggies: g=16.2, r=15.7, z=15.6 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.23721, ee1=-0.19211, ee2=0.00696194 Measuring 10 iterative sources Blob 1 finished, total: Wall: 25.42 s, CPU: 25.41 s, VmPeak: 812 MB, VmSize: 734 MB, VmRSS: 157 MB, VmData: 189 MB, maxrss: 0.161176 MB Old catalog: 55 New catalog: 49 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/metrics/cus/blobs-custom-283617p49658.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/metrics/cus/all-models-custom-283617p49658.fits Stage fitblobs : Wall: 27.58 s, CPU: 0.49 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 268 MB, VmData: 294 MB, maxrss: 0.274024 MB Stage fitblobs finished: 2020-08-07T09:24:09.532413 Resources for stage fitblobs : 29.433 s worker CPU, 29.549 s worker Wall, Wall: 27.578 s, Cores in use: 1.09, Total efficiency (on 16 cores): 6.8 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/PGC2349545-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/PGC2349545-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T09:24:09.608945 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/tmp-legacysurvey-custom-283617p49658-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/tmp-legacysurvey-custom-283617p49658-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/tmp-legacysurvey-custom-283617p49658-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/tmp-legacysurvey-custom-283617p49658-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-resid.jpg Stage coadds : Wall: 2.80 s, CPU: 0.62 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 268 MB, VmData: 294 MB, maxrss: 0.274472 MB Stage coadds finished: 2020-08-07T09:24:12.407210 Resources for stage coadds : 9.767 s worker CPU, 10.127 s worker Wall, Wall: 2.800 s, Cores in use: 3.71, Total efficiency (on 16 cores): 23.2 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/PGC2349545-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/PGC2349545-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T09:24:12.455220 Cut to 1 unWISE tiles Reading WISE tile 2833p499 band 1 Reading WISE tile 2833p499 band 2 Reading WISE tile 2833p499 band 3 Reading WISE tile 2833p499 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 812 MB, VmSize: 798 MB, VmRSS: 143 MB, VmData: 176 MB, maxrss: 0.183276 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 811 MB, VmSize: 792 MB, VmRSS: 137 MB, VmData: 170 MB, maxrss: 0.199424 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 814 MB, VmSize: 812 MB, VmRSS: 159 MB, VmData: 183 MB, maxrss: 0.223504 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2833p499/unwise-2833p499-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 809 MB, VmSize: 796 MB, VmRSS: 140 MB, VmData: 174 MB, maxrss: 0.203756 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/tmp-legacysurvey-custom-283617p49658-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/tmp-legacysurvey-custom-283617p49658-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 4.39 s, CPU: 0.54 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 269 MB, VmData: 294 MB, maxrss: 0.274984 MB Stage wise_forced finished: 2020-08-07T09:24:16.842118 Resources for stage wise_forced : 3.042 s worker CPU, 11.800 s worker Wall, Wall: 4.388 s, Cores in use: 0.82, Total efficiency (on 16 cores): 5.1 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/PGC2349545-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/PGC2349545-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T09:24:16.895588 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/coadd/cus/custom-283617p49658/legacysurvey-custom-283617p49658-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/tractor-i/cus/tractor-custom-283617p49658.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/tractor/cus/tractor-custom-283617p49658.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/tractor/cus/brick-custom-283617p49658.sha256sum Stage writecat : Wall: 1.14 s, CPU: 0.66 s, VmPeak: 1168 MB, VmSize: 1040 MB, VmRSS: 270 MB, VmData: 294 MB, maxrss: 0.407672 MB Stage writecat finished: 2020-08-07T09:24:18.030845 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.137 s, Cores in use: 0.59, Total efficiency (on 16 cores): 3.7 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/PGC2349545-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2349545/PGC2349545-largegalaxy-writecat.p All done: 47.947 s worker CPU, 289.276 s worker Wall, Wall: 93.310 s, Cores in use: 0.64, Total efficiency (on 16 cores): 4.0 % Finished galaxy PGC2349545 in 1.596 minutes.