Started working on galaxy PGC2240533 at Wed Aug 5 19:55:12 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 282.4522875 44.272831 --width 251 --height 251 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T19:55:15.756324 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '282.4522875', '44.272831', '--width', '251', '--height', '251', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 282.4522875 44.272831 --width 251 --height 251 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 282.4522875 44.272831 Starting process 16754 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 16755 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 16756 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 16757 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 16758 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB Starting process 16759 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05956 MB Starting process 16760 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05956 MB Starting process 16761 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 16762 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 16763 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16765 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 16766 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 16764 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16767 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 16769 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 16768 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T19:55:17.751413 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 11 CCDs: k4m_170806_091429_ooi_zd_ls9-CCD2 z expnum 3135984 exptime 188.103 propid 2016A-0453 seeing 1.36 MJD 57971.385 object MzLS_623848_z mosaic/CP/V4.3/CP20170805/k4m_170806_091429_ooi_zd_ls9.fits.fz k4m_160511_112608_ooi_zd_ls9-CCD1 z expnum 88405 exptime 80.103 propid 2016A-0453 seeing 0.87 MJD 57519.476 object MzLS_625646_z mosaic/CP/V4.3/CP20160510/k4m_160511_112608_ooi_zd_ls9.fits.fz k4m_160504_114120_ooi_zd_ls9-CCD3 z expnum 87103 exptime 80.106 propid 2016A-0453 seeing 1.06 MJD 57512.487 object MzLS_624749_z mosaic/CP/V4.3/CP20160503/k4m_160504_114120_ooi_zd_ls9.fits.fz ksb_160602_102834_ooi_g_ls9-CCD3 g expnum 75410167 exptime 105.9 propid BASS seeing 1.32 MJD 57541.437 object 62342 90prime/CP/V2.3/CP20160601/ksb_160602_102834_ooi_g_ls9.fits.fz ksb_160516_103908_ooi_r_ls9-CCD3 r expnum 75240164 exptime 86.4 propid BASS seeing 1.66 MJD 57524.444 object 62342 90prime/CP/V2.3/CP20160515/ksb_160516_103908_ooi_r_ls9.fits.fz ksb_170624_084036_ooi_r_ls9-CCD1 r expnum 79280129 exptime 250.0 propid BASS seeing 1.63 MJD 57928.362 object 62343 90prime/CP/V2.3/CP20170623/ksb_170624_084036_ooi_r_ls9.fits.fz ksb_160702_094329_ooi_g_ls9-CCD1 g expnum 75710128 exptime 181.7 propid BASS seeing 1.91 MJD 57571.405 object 62343 90prime/CP/V2.3/CP20160701/ksb_160702_094329_ooi_g_ls9.fits.fz ksb_170624_083753_ooi_r_ls9-CCD2 r expnum 79280128 exptime 126.0 propid BASS seeing 1.23 MJD 57928.360 object 62493 90prime/CP/V2.3/CP20170623/ksb_170624_083753_ooi_r_ls9.fits.fz ksb_160702_101419_ooi_g_ls9-CCD2 g expnum 75710137 exptime 120.3 propid BASS seeing 1.52 MJD 57571.427 object 62493 90prime/CP/V2.3/CP20160701/ksb_160702_101419_ooi_g_ls9.fits.fz ksb_160603_102840_ooi_g_ls9-CCD3 g expnum 75420164 exptime 84.1 propid BASS seeing 1.32 MJD 57542.437 object 62341 90prime/CP/V2.3/CP20160602/ksb_160603_102840_ooi_g_ls9.fits.fz ksb_160604_093807_ooi_r_ls9-CCD3 r expnum 75430179 exptime 62.8 propid BASS seeing 1.31 MJD 57543.401 object 62341 90prime/CP/V2.3/CP20160603/ksb_160604_093807_ooi_r_ls9.fits.fz Faked up EXPNUM 75430179 Faked up EXPNUM 75430179 Faked up EXPNUM 75430179 90prime get_fwhm: self.fwhm = 2.89 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1883 2028 and amp range 0 2015 and image y 1243 1389 and amp range 0 2047 Range in image: x 0 133 , y 0 147 (with image size 146 x 147) dzp -0.024507914 -> scaling image by 0.9776802328037623 Found overlap: image x 1883 2028 and amp range 2016 4031 and image y 1243 1389 and amp range 0 2047 Range in image: x 133 146 , y 0 147 (with image size 146 x 147) dzp 0.004245165 -> scaling image by 1.0039175950705865 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 999 1259 and amp range 0 2005 and image y 446 708 and amp range 0 2039 Range in image: x 0 261 , y 0 263 (with image size 261 x 263) dzp -0.011066288 -> scaling image by 0.989859339076806 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 79280128 Faked up EXPNUM 79280128 Faked up EXPNUM 79280128 90prime get_fwhm: self.fwhm = 2.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3616 3764 and amp range 2016 4031 and image y 585 734 and amp range 0 2047 Range in image: x 0 149 , y 0 150 (with image size 149 x 150) dzp 0.032776505 -> scaling image by 1.0306485625912574 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.07 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3734 3985 and amp range 2006 4053 and image y 7 186 and amp range 0 2039 Range in image: x 0 252 , y 0 180 (with image size 252 x 180) dzp -0.00064781494 -> scaling image by 0.9994035183523652 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75420164 Faked up EXPNUM 75420164 Faked up EXPNUM 75420164 90prime get_fwhm: self.fwhm = 2.91 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1894 2040 and amp range 0 2015 and image y 1225 1371 and amp range 0 2047 Range in image: x 0 122 , y 0 147 (with image size 147 x 147) dzp -0.03470582 -> scaling image by 0.9685402452207784 Found overlap: image x 1894 2040 and amp range 2016 4031 and image y 1225 1371 and amp range 0 2047 Range in image: x 122 147 , y 0 147 (with image size 147 x 147) dzp -0.0022715968 -> scaling image by 0.9979099691834846 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75240164 Faked up EXPNUM 75240164 Faked up EXPNUM 75240164 90prime get_fwhm: self.fwhm = 3.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3873 4016 and amp range 2016 4031 and image y 3226 3373 and amp range 2048 4095 Range in image: x 0 144 , y 0 148 (with image size 144 x 148) dzp -0.0005558773 -> scaling image by 0.99948814914245 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 5.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2133 2387 and amp range 2048 4095 and image y 2892 3146 and amp range 2040 4078 Range in image: x 0 255 , y 0 255 (with image size 255 x 255) dzp -0.036442947 -> scaling image by 0.9669918668439786 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75410167 Faked up EXPNUM 75410167 Faked up EXPNUM 75410167 90prime get_fwhm: self.fwhm = 2.91 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3864 4010 and amp range 2016 4031 and image y 3220 3366 and amp range 2048 4095 Range in image: x 0 147 , y 0 147 (with image size 147 x 147) dzp -0.0012536051 -> scaling image by 0.9988460533227724 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75710137 Faked up EXPNUM 75710137 Faked up EXPNUM 75710137 90prime get_fwhm: self.fwhm = 3.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3603 3751 and amp range 2016 4031 and image y 594 743 and amp range 0 2047 Range in image: x 0 149 , y 0 150 (with image size 149 x 150) dzp -0.008960029 -> scaling image by 0.9917814665476246 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 21.93 s, CPU: 1.82 s, VmPeak: 957 MB, VmSize: 957 MB, VmRSS: 174 MB, VmData: 206 MB, maxrss: 0.178064 MB Stage tims finished: 2020-08-05T19:55:39.682558 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Faked up EXPNUM 75710128 Faked up EXPNUM 75710128 Faked up EXPNUM 75710128 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 6.270 s worker CPU, 59.110 s worker Wall, Wall: 21.933 s, Cores in use: 0.37, Total efficiency (on 16 cores): 2.3 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-tims.p Running stage refs Faked up EXPNUM 79280129 Faked up EXPNUM 79280129 Faked up EXPNUM 79280129 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T19:55:40.042373 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01833.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01834.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01957.fits Matched 1 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/metrics/cus/reference-custom-282452p44272.fits Stage refs : Wall: 28.03 s, CPU: 9.05 s, VmPeak: 1053 MB, VmSize: 1048 MB, VmRSS: 267 MB, VmData: 296 MB, maxrss: 0.272996 MB Stage refs finished: 2020-08-05T19:56:08.076169 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 28.035 s, Cores in use: 0.32, Total efficiency (on 16 cores): 2.0 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T19:56:08.096962 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/metrics/cus/outlier-mask-custom-282452p44272.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/metrics/cus/outliers-pre-custom-282452p44272.jpg Image ksb_160603_102840_ooi_g_ls9-CCD3 g : masking 595 positive outlier pixels and 0 negative outlier pixels Image ksb_160516_103908_ooi_r_ls9-CCD3 r : masking 2024 positive outlier pixels and 71 negative outlier pixels Image ksb_160604_093807_ooi_r_ls9-CCD3 r : masking 1559 positive outlier pixels and 0 negative outlier pixels Image k4m_170806_091429_ooi_zd_ls9-CCD2 z : masking 1643 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/metrics/cus/outlier-mask-custom-282452p44272.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/metrics/cus/outliers-post-custom-282452p44272.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/metrics/cus/outliers-masked-pos-custom-282452p44272.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/metrics/cus/outliers-masked-neg-custom-282452p44272.jpg Stage outliers : Wall: 1.32 s, CPU: 1.01 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 281 MB, VmData: 308 MB, maxrss: 0.287564 MB Stage outliers finished: 2020-08-05T19:56:09.418657 Resources for stage outliers : 0.704 s worker CPU, 0.949 s worker Wall, Wall: 1.323 s, Cores in use: 1.30, Total efficiency (on 16 cores): 8.1 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T19:56:09.520127 Stage halos : Wall: 0.78 s, CPU: 0.77 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 281 MB, VmData: 308 MB, maxrss: 0.28776 MB Stage halos finished: 2020-08-05T19:56:10.301910 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.783 s, Cores in use: 0.98, Total efficiency (on 16 cores): 6.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T19:56:10.322132 PSF sigmas in coadd pixels: ['2.14', '2.47', '2.14'] Using average PSF sigma 2.249300404379929 Gaussian PSF norm 0.1254144583020444 vs pixelized 0.11059846 average tim pixel scale / coadd scale: 1.7292776015295668 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.70', '1.99', '2.13'] Using average PSF sigma 2.273699944733744 Gaussian PSF norm 0.12406861003240785 vs pixelized 0.10353832 average tim pixel scale / coadd scale: 1.7291522995419515 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.21', '1.42', '1.72'] Using average PSF sigma 1.7809120025550318 Gaussian PSF norm 0.15839906259779457 vs pixelized 0.13299385 average tim pixel scale / coadd scale: 0.9909528352050039 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.15 s, CPU: 0.14 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 282 MB, VmData: 308 MB, maxrss: 0.289224 MB Stage fit_on_coadds finished: 2020-08-05T19:56:10.475753 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.169 s worker CPU, 0.169 s worker Wall, Wall: 0.155 s, Cores in use: 1.97, Total efficiency (on 16 cores): 12.3 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T19:56:10.487792 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 43 potential peaks Of 43 potential peaks: 19 in veto map, 3 cut by saddle test, 0 cut by aper test, 21 kept SED z : 21 new peaks Found 56 potential peaks Of 56 potential peaks: 54 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 34 potential peaks Of 34 potential peaks: 31 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 45 potential peaks Of 45 potential peaks: 42 in veto map, 2 cut by saddle test, 1 cut by aper test, 0 kept SED Flat : 0 new peaks Found 40 potential peaks Of 40 potential peaks: 37 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 22 new sources Median coadd sky for g : 0.00030679954 Median coadd sky for r : 0.00027357944 Median coadd sky for z : -3.547886e-05 Stage srcs : Wall: 0.49 s, CPU: 0.46 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 283 MB, VmData: 308 MB, maxrss: 0.289724 MB Stage srcs finished: 2020-08-05T19:56:10.982459 Resources for stage srcs : 0.080 s worker CPU, 0.080 s worker Wall, Wall: 0.496 s, Cores in use: 1.10, Total efficiency (on 16 cores): 6.8 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T19:56:11.021583 Blob 1 of 9, id: 3, sources: 17, size: 188x181, npix 18484, brick X: 63,251, Y: 49,230, one pixel: 104 49 Blob 2 of 9, id: 0, sources: 2, size: 68x53, npix 2572, brick X: 58,126, Y: 0,53, one pixel: 71 0 Blob 3 of 9, id: 6, sources: 3, size: 57x51, npix 1428, brick X: 58,115, Y: 200,251, one pixel: 84 200 Blob 4 of 9, id: 5, sources: 2, size: 48x45, npix 1116, brick X: 99,147, Y: 185,230, one pixel: 109 185 Blob 5 of 9, id: 7, sources: 3, size: 34x44, npix 961, brick X: 0,34, Y: 204,248, one pixel: 9 204 Blob 6 of 9, id: 8, sources: 1, size: 27x24, npix 458, brick X: 129,156, Y: 227,251, one pixel: 141 227 Blob 7 of 9, id: 4, sources: 1, size: 25x24, npix 398, brick X: 32,57, Y: 183,207, one pixel: 41 183 Blob 8 of 9, id: 1, sources: 1, size: 23x23, npix 336, brick X: 146,169, Y: 2,25, one pixel: 156 2 Blob 9 of 9, id: 2, sources: 1, size: 19x19, npix 199, brick X: 191,210, Y: 35,54, one pixel: 199 35 Blob 9 finished, total: Wall: 0.15 s, CPU: 0.15 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.09308 MB Blob 8 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 117 MB, VmData: 161 MB, maxrss: 0.119688 MB Blob 7 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 813 MB, VmSize: 731 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149876 MB Blob 6 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 814 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.15012 MB Blob 2 finished, total: Wall: 0.49 s, CPU: 0.49 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149808 MB Blob 4 finished, total: Wall: 1.00 s, CPU: 1.00 s, VmPeak: 793 MB, VmSize: 719 MB, VmRSS: 135 MB, VmData: 171 MB, maxrss: 0.137948 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (282.47272, 44.27988), pm (-2.2, -10.4), parallax 0.354 with NanoMaggies: g=17, r=16.5, z=16.3 Reset brightness to NanoMaggies: g=17, r=16.5, z=16.3 Blob 5 finished, total: Wall: 1.09 s, CPU: 1.08 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093388 MB Blob 3 finished, total: Wall: 1.24 s, CPU: 1.23 s, VmPeak: 815 MB, VmSize: 725 MB, VmRSS: 140 MB, VmData: 182 MB, maxrss: 0.143504 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.3411, ee1=0.283965, ee2=0.190531 Measuring 4 iterative sources Blob 1 finished, total: Wall: 12.54 s, CPU: 12.54 s, VmPeak: 814 MB, VmSize: 734 MB, VmRSS: 157 MB, VmData: 185 MB, maxrss: 0.160368 MB Old catalog: 39 New catalog: 35 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/metrics/cus/blobs-custom-282452p44272.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/metrics/cus/all-models-custom-282452p44272.fits Stage fitblobs : Wall: 13.02 s, CPU: 0.46 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 283 MB, VmData: 308 MB, maxrss: 0.290296 MB Stage fitblobs finished: 2020-08-05T19:56:24.037227 Resources for stage fitblobs : 17.537 s worker CPU, 17.585 s worker Wall, Wall: 13.017 s, Cores in use: 1.38, Total efficiency (on 16 cores): 8.6 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T19:56:24.152176 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/tmp-legacysurvey-custom-282452p44272-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/tmp-legacysurvey-custom-282452p44272-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/tmp-legacysurvey-custom-282452p44272-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/tmp-legacysurvey-custom-282452p44272-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-resid.jpg Stage coadds : Wall: 2.52 s, CPU: 0.56 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 284 MB, VmData: 308 MB, maxrss: 0.29062 MB Stage coadds finished: 2020-08-05T19:56:26.672655 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 8.666 s worker CPU, 14.163 s worker Wall, Wall: 2.522 s, Cores in use: 3.66, Total efficiency (on 16 cores): 22.9 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T19:56:26.696912 Cut to 1 unWISE tiles Reading WISE tile 2830p439 band 3 Reading WISE tile 2830p439 band 4 Reading WISE tile 2830p439 band 1 Reading WISE tile 2830p439 band 2 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 814 MB, VmSize: 812 MB, VmRSS: 154 MB, VmData: 180 MB, maxrss: 0.196224 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 814 MB, VmSize: 810 MB, VmRSS: 157 MB, VmData: 178 MB, maxrss: 0.221524 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 813 MB, VmSize: 804 MB, VmRSS: 145 MB, VmData: 172 MB, maxrss: 0.208528 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 806 MB, VmSize: 804 MB, VmRSS: 145 MB, VmData: 171 MB, maxrss: 0.208636 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/tmp-legacysurvey-custom-282452p44272-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/tmp-legacysurvey-custom-282452p44272-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.16 s, CPU: 1.04 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 284 MB, VmData: 308 MB, maxrss: 0.291132 MB Stage wise_forced finished: 2020-08-05T19:56:29.853914 Resources for stage wise_forced : 3.081 s worker CPU, 6.269 s worker Wall, Wall: 3.158 s, Cores in use: 1.31, Total efficiency (on 16 cores): 8.2 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T19:56:29.868142 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/tractor-i/cus/tractor-custom-282452p44272.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/tractor/cus/tractor-custom-282452p44272.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/tractor/cus/brick-custom-282452p44272.sha256sum Stage writecat : Wall: 0.67 s, CPU: 0.54 s, VmPeak: 1189 MB, VmSize: 1061 MB, VmRSS: 286 MB, VmData: 308 MB, maxrss: 0.424012 MB Stage writecat finished: 2020-08-05T19:56:30.537893 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.671 s, Cores in use: 0.81, Total efficiency (on 16 cores): 5.1 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-writecat.p All done: 36.510 s worker CPU, 98.329 s worker Wall, Wall: 72.811 s, Cores in use: 0.72, Total efficiency (on 16 cores): 4.5 % Finished galaxy PGC2240533 in 1.313 minutes. Started working on galaxy PGC2240533 at Wed Aug 5 20:50:18 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 282.4522875 44.272831 --width 251 --height 251 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T20:50:20.288919 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '282.4522875', '44.272831', '--width', '251', '--height', '251', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 282.4522875 44.272831 --width 251 --height 251 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 282.4522875 44.272831 Starting process 28504 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 28506 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 28508 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 28510 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 28512 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB Starting process 28514 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05956 MB Starting process 28516 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05956 MB Starting process 28518 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 28520 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 28522 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 28524 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 28526 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 28528 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 28530 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 28532 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 28536 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 28539 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 28540 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 28541 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 28542 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 28543 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 28545 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 28544 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 28546 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 28547 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 28548 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 28549 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 28551 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 28552 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB Starting process 28553 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB Starting process 28554 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB Starting process 28555 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05932 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T20:50:22.818056 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 11 CCDs: k4m_170806_091429_ooi_zd_ls9-CCD2 z expnum 3135984 exptime 188.103 propid 2016A-0453 seeing 1.36 MJD 57971.385 object MzLS_623848_z mosaic/CP/V4.3/CP20170805/k4m_170806_091429_ooi_zd_ls9.fits.fz k4m_160511_112608_ooi_zd_ls9-CCD1 z expnum 88405 exptime 80.103 propid 2016A-0453 seeing 0.87 MJD 57519.476 object MzLS_625646_z mosaic/CP/V4.3/CP20160510/k4m_160511_112608_ooi_zd_ls9.fits.fz k4m_160504_114120_ooi_zd_ls9-CCD3 z expnum 87103 exptime 80.106 propid 2016A-0453 seeing 1.06 MJD 57512.487 object MzLS_624749_z mosaic/CP/V4.3/CP20160503/k4m_160504_114120_ooi_zd_ls9.fits.fz ksb_160602_102834_ooi_g_ls9-CCD3 g expnum 75410167 exptime 105.9 propid BASS seeing 1.32 MJD 57541.437 object 62342 90prime/CP/V2.3/CP20160601/ksb_160602_102834_ooi_g_ls9.fits.fz ksb_160516_103908_ooi_r_ls9-CCD3 r expnum 75240164 exptime 86.4 propid BASS seeing 1.66 MJD 57524.444 object 62342 90prime/CP/V2.3/CP20160515/ksb_160516_103908_ooi_r_ls9.fits.fz ksb_170624_084036_ooi_r_ls9-CCD1 r expnum 79280129 exptime 250.0 propid BASS seeing 1.63 MJD 57928.362 object 62343 90prime/CP/V2.3/CP20170623/ksb_170624_084036_ooi_r_ls9.fits.fz ksb_160702_094329_ooi_g_ls9-CCD1 g expnum 75710128 exptime 181.7 propid BASS seeing 1.91 MJD 57571.405 object 62343 90prime/CP/V2.3/CP20160701/ksb_160702_094329_ooi_g_ls9.fits.fz ksb_170624_083753_ooi_r_ls9-CCD2 r expnum 79280128 exptime 126.0 propid BASS seeing 1.23 MJD 57928.360 object 62493 90prime/CP/V2.3/CP20170623/ksb_170624_083753_ooi_r_ls9.fits.fz ksb_160702_101419_ooi_g_ls9-CCD2 g expnum 75710137 exptime 120.3 propid BASS seeing 1.52 MJD 57571.427 object 62493 90prime/CP/V2.3/CP20160701/ksb_160702_101419_ooi_g_ls9.fits.fz ksb_160603_102840_ooi_g_ls9-CCD3 g expnum 75420164 exptime 84.1 propid BASS seeing 1.32 MJD 57542.437 object 62341 90prime/CP/V2.3/CP20160602/ksb_160603_102840_ooi_g_ls9.fits.fz ksb_160604_093807_ooi_r_ls9-CCD3 r expnum 75430179 exptime 62.8 propid BASS seeing 1.31 MJD 57543.401 object 62341 90prime/CP/V2.3/CP20160603/ksb_160604_093807_ooi_r_ls9.fits.fz mosaic get_fwhm: self.fwhm = 4.07 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3734 3985 and amp range 2006 4053 and image y 7 186 and amp range 0 2039 Range in image: x 0 252 , y 0 180 (with image size 252 x 180) dzp -0.00064781494 -> scaling image by 0.9994035183523652 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 79280128 Faked up EXPNUM 79280128 Faked up EXPNUM 79280128 90prime get_fwhm: self.fwhm = 2.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3616 3764 and amp range 2016 4031 and image y 585 734 and amp range 0 2047 Range in image: x 0 149 , y 0 150 (with image size 149 x 150) dzp 0.032776505 -> scaling image by 1.0306485625912574 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75240164 Faked up EXPNUM 75240164 Faked up EXPNUM 75240164 90prime get_fwhm: self.fwhm = 3.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3873 4016 and amp range 2016 4031 and image y 3226 3373 and amp range 2048 4095 Range in image: x 0 144 , y 0 148 (with image size 144 x 148) dzp -0.0005558773 -> scaling image by 0.99948814914245 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75420164 Faked up EXPNUM 75420164 Faked up EXPNUM 75420164 90prime get_fwhm: self.fwhm = 2.91 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1894 2040 and amp range 0 2015 and image y 1225 1371 and amp range 0 2047 Range in image: x 0 122 , y 0 147 (with image size 147 x 147) dzp -0.03470582 -> scaling image by 0.9685402452207784 Found overlap: image x 1894 2040 and amp range 2016 4031 and image y 1225 1371 and amp range 0 2047 Range in image: x 122 147 , y 0 147 (with image size 147 x 147) dzp -0.0022715968 -> scaling image by 0.9979099691834846 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 999 1259 and amp range 0 2005 and image y 446 708 and amp range 0 2039 Range in image: x 0 261 , y 0 263 (with image size 261 x 263) dzp -0.011066288 -> scaling image by 0.989859339076806 mosaic get_fwhm: self.fwhm = 5.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2133 2387 and amp range 2048 4095 and image y 2892 3146 and amp range 2040 4078 Range in image: x 0 255 , y 0 255 (with image size 255 x 255) dzp -0.036442947 -> scaling image by 0.9669918668439786 Faked up EXPNUM 75410167 Faked up EXPNUM 75410167 Faked up EXPNUM 75410167 90prime get_fwhm: self.fwhm = 2.91 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3864 4010 and amp range 2016 4031 and image y 3220 3366 and amp range 2048 4095 Range in image: x 0 147 , y 0 147 (with image size 147 x 147) dzp -0.0012536051 -> scaling image by 0.9988460533227724 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75430179 Faked up EXPNUM 75430179 Faked up EXPNUM 75430179 90prime get_fwhm: self.fwhm = 2.89 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1883 2028 and amp range 0 2015 and image y 1243 1389 and amp range 0 2047 Range in image: x 0 133 , y 0 147 (with image size 146 x 147) dzp -0.024507914 -> scaling image by 0.9776802328037623 Found overlap: image x 1883 2028 and amp range 2016 4031 and image y 1243 1389 and amp range 0 2047 Range in image: x 133 146 , y 0 147 (with image size 146 x 147) dzp 0.004245165 -> scaling image by 1.0039175950705865 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75710137 Faked up EXPNUM 75710137 Faked up EXPNUM 75710137 90prime get_fwhm: self.fwhm = 3.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3603 3751 and amp range 2016 4031 and image y 594 743 and amp range 0 2047 Range in image: x 0 149 , y 0 150 (with image size 149 x 150) dzp -0.008960029 -> scaling image by 0.9917814665476246 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 15.87 s, CPU: 2.58 s, VmPeak: 957 MB, VmSize: 957 MB, VmRSS: 174 MB, VmData: 206 MB, maxrss: 0.17792 MB Stage tims finished: 2020-08-05T20:50:38.688643 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Faked up EXPNUM 79280129 Faked up EXPNUM 79280129 Faked up EXPNUM 79280129 Faked up EXPNUM 75710128 Faked up EXPNUM 75710128 Faked up EXPNUM 75710128 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 5.371 s worker CPU, 34.723 s worker Wall, Wall: 15.874 s, Cores in use: 0.50, Total efficiency (on 32 cores): 1.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T20:50:38.735345 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01833.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01834.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01957.fits Matched 1 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/metrics/cus/reference-custom-282452p44272.fits Stage refs : Wall: 20.03 s, CPU: 7.92 s, VmPeak: 1053 MB, VmSize: 1048 MB, VmRSS: 267 MB, VmData: 296 MB, maxrss: 0.272932 MB Stage refs finished: 2020-08-05T20:50:58.764451 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 20.031 s, Cores in use: 0.40, Total efficiency (on 32 cores): 1.2 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T20:50:58.791091 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/metrics/cus/outlier-mask-custom-282452p44272.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/metrics/cus/outliers-pre-custom-282452p44272.jpg Image ksb_160603_102840_ooi_g_ls9-CCD3 g : masking 595 positive outlier pixels and 0 negative outlier pixels Image ksb_160516_103908_ooi_r_ls9-CCD3 r : masking 2024 positive outlier pixels and 71 negative outlier pixels Image ksb_160604_093807_ooi_r_ls9-CCD3 r : masking 1559 positive outlier pixels and 0 negative outlier pixels Image k4m_170806_091429_ooi_zd_ls9-CCD2 z : masking 1643 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/metrics/cus/outlier-mask-custom-282452p44272.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/metrics/cus/outliers-post-custom-282452p44272.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/metrics/cus/outliers-masked-pos-custom-282452p44272.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/metrics/cus/outliers-masked-neg-custom-282452p44272.jpg Stage outliers : Wall: 2.76 s, CPU: 2.15 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 280 MB, VmData: 307 MB, maxrss: 0.286768 MB Stage outliers finished: 2020-08-05T20:51:01.547056 Resources for stage outliers : 0.866 s worker CPU, 1.110 s worker Wall, Wall: 2.758 s, Cores in use: 1.10, Total efficiency (on 32 cores): 3.4 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T20:51:01.623616 Stage halos : Wall: 1.05 s, CPU: 1.03 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 280 MB, VmData: 307 MB, maxrss: 0.286876 MB Stage halos finished: 2020-08-05T20:51:02.669032 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 1.047 s, Cores in use: 0.98, Total efficiency (on 32 cores): 3.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T20:51:02.697540 PSF sigmas in coadd pixels: ['2.14', '2.47', '2.14'] Using average PSF sigma 2.249300404379929 Gaussian PSF norm 0.1254144583020444 vs pixelized 0.11059846 average tim pixel scale / coadd scale: 1.7292776015295668 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.70', '1.99', '2.13'] Using average PSF sigma 2.273699944733744 Gaussian PSF norm 0.12406861003240785 vs pixelized 0.10353832 average tim pixel scale / coadd scale: 1.7291522995419515 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.21', '1.42', '1.72'] Using average PSF sigma 1.7809120025550318 Gaussian PSF norm 0.15839906259779457 vs pixelized 0.13299385 average tim pixel scale / coadd scale: 0.9909528352050039 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.18 s, CPU: 0.14 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 282 MB, VmData: 307 MB, maxrss: 0.289072 MB Stage fit_on_coadds finished: 2020-08-05T20:51:02.875759 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.198 s worker CPU, 0.198 s worker Wall, Wall: 0.180 s, Cores in use: 1.88, Total efficiency (on 32 cores): 5.9 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T20:51:02.894764 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 43 potential peaks Of 43 potential peaks: 19 in veto map, 3 cut by saddle test, 0 cut by aper test, 21 kept SED z : 21 new peaks Found 56 potential peaks Of 56 potential peaks: 54 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 34 potential peaks Of 34 potential peaks: 31 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 45 potential peaks Of 45 potential peaks: 42 in veto map, 2 cut by saddle test, 1 cut by aper test, 0 kept SED Flat : 0 new peaks Found 40 potential peaks Of 40 potential peaks: 37 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 22 new sources Median coadd sky for g : 0.00030679954 Median coadd sky for r : 0.00027357944 Median coadd sky for z : -3.547886e-05 Stage srcs : Wall: 1.23 s, CPU: 1.09 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 283 MB, VmData: 307 MB, maxrss: 0.289748 MB Stage srcs finished: 2020-08-05T20:51:04.129370 Resources for stage srcs : 0.094 s worker CPU, 0.094 s worker Wall, Wall: 1.237 s, Cores in use: 0.96, Total efficiency (on 32 cores): 3.0 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T20:51:04.146748 Blob 1 of 9, id: 3, sources: 17, size: 188x181, npix 18484, brick X: 63,251, Y: 49,230, one pixel: 104 49 Blob 2 of 9, id: 0, sources: 2, size: 68x53, npix 2572, brick X: 58,126, Y: 0,53, one pixel: 71 0 Blob 3 of 9, id: 6, sources: 3, size: 57x51, npix 1428, brick X: 58,115, Y: 200,251, one pixel: 84 200 Blob 4 of 9, id: 5, sources: 2, size: 48x45, npix 1116, brick X: 99,147, Y: 185,230, one pixel: 109 185 Blob 5 of 9, id: 7, sources: 3, size: 34x44, npix 961, brick X: 0,34, Y: 204,248, one pixel: 9 204 Blob 6 of 9, id: 8, sources: 1, size: 27x24, npix 458, brick X: 129,156, Y: 227,251, one pixel: 141 227 Blob 7 of 9, id: 4, sources: 1, size: 25x24, npix 398, brick X: 32,57, Y: 183,207, one pixel: 41 183 Blob 8 of 9, id: 1, sources: 1, size: 23x23, npix 336, brick X: 146,169, Y: 2,25, one pixel: 156 2 Blob 9 of 9, id: 2, sources: 1, size: 19x19, npix 199, brick X: 191,210, Y: 35,54, one pixel: 199 35 Blob 9 finished, total: Wall: 0.17 s, CPU: 0.16 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.091944 MB Blob 8 finished, total: Wall: 0.21 s, CPU: 0.20 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 89 MB, VmData: 137 MB, maxrss: 0.091644 MB Blob 7 finished, total: Wall: 0.37 s, CPU: 0.36 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093272 MB Blob 6 finished, total: Wall: 0.40 s, CPU: 0.39 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.093756 MB Blob 2 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 814 MB, VmSize: 731 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148748 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (282.47272, 44.27988), pm (-2.2, -10.4), parallax 0.354 with NanoMaggies: g=17, r=16.5, z=16.3 Reset brightness to NanoMaggies: g=17, r=16.5, z=16.3 Blob 5 finished, total: Wall: 1.02 s, CPU: 1.02 s, VmPeak: 819 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150028 MB Blob 4 finished, total: Wall: 1.03 s, CPU: 1.02 s, VmPeak: 814 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150436 MB Blob 3 finished, total: Wall: 1.34 s, CPU: 1.34 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093264 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.3411, ee1=0.283965, ee2=0.190531 Measuring 4 iterative sources Blob 1 finished, total: Wall: 13.08 s, CPU: 13.08 s, VmPeak: 696 MB, VmSize: 688 MB, VmRSS: 120 MB, VmData: 159 MB, maxrss: 0.128204 MB Old catalog: 39 New catalog: 35 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/metrics/cus/blobs-custom-282452p44272.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/metrics/cus/all-models-custom-282452p44272.fits Stage fitblobs : Wall: 14.30 s, CPU: 1.14 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 284 MB, VmData: 308 MB, maxrss: 0.29032 MB Stage fitblobs finished: 2020-08-05T20:51:18.448572 Resources for stage fitblobs : 18.119 s worker CPU, 18.520 s worker Wall, Wall: 14.304 s, Cores in use: 1.35, Total efficiency (on 32 cores): 4.2 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T20:51:18.462575 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/tmp-legacysurvey-custom-282452p44272-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/tmp-legacysurvey-custom-282452p44272-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/tmp-legacysurvey-custom-282452p44272-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/tmp-legacysurvey-custom-282452p44272-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-resid.jpg Stage coadds : Wall: 4.12 s, CPU: 0.60 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 284 MB, VmData: 308 MB, maxrss: 0.290644 MB Stage coadds finished: 2020-08-05T20:51:22.587097 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 25.086 s worker CPU, 72.069 s worker Wall, Wall: 4.127 s, Cores in use: 6.23, Total efficiency (on 32 cores): 19.5 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T20:51:22.604361 Cut to 1 unWISE tiles Reading WISE tile 2830p439 band 1 Reading WISE tile 2830p439 band 2 Reading WISE tile 2830p439 band 3 Reading WISE tile 2830p439 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 804 MB, VmSize: 804 MB, VmRSS: 146 MB, VmData: 176 MB, maxrss: 0.186684 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 862 MB, VmSize: 862 MB, VmRSS: 204 MB, VmData: 234 MB, maxrss: 0.20868 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 813 MB, VmSize: 799 MB, VmRSS: 140 MB, VmData: 171 MB, maxrss: 0.202608 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 812 MB, VmSize: 812 MB, VmRSS: 152 MB, VmData: 180 MB, maxrss: 0.20998 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/tmp-legacysurvey-custom-282452p44272-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/tmp-legacysurvey-custom-282452p44272-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.74 s, CPU: 0.96 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 284 MB, VmData: 308 MB, maxrss: 0.291156 MB Stage wise_forced finished: 2020-08-05T20:51:25.345509 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.286 s worker CPU, 4.983 s worker Wall, Wall: 2.743 s, Cores in use: 1.55, Total efficiency (on 32 cores): 4.8 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-wise_forced.p Running stage writecat WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage writecat at 2020-08-05T20:51:25.362744 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/coadd/cus/custom-282452p44272/legacysurvey-custom-282452p44272-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/tractor-i/cus/tractor-custom-282452p44272.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/tractor/cus/tractor-custom-282452p44272.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/tractor/cus/brick-custom-282452p44272.sha256sum Stage writecat : Wall: 0.77 s, CPU: 0.61 s, VmPeak: 1189 MB, VmSize: 1061 MB, VmRSS: 286 MB, VmData: 308 MB, maxrss: 0.424036 MB Stage writecat finished: 2020-08-05T20:51:26.127906 Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.768 s, Cores in use: 0.80, Total efficiency (on 32 cores): 2.5 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/282/PGC2240533/PGC2240533-largegalaxy-writecat.p All done: 53.027 s worker CPU, 131.705 s worker Wall, Wall: 63.337 s, Cores in use: 1.13, Total efficiency (on 32 cores): 3.5 % Finished galaxy PGC2240533 in 1.141 minutes. Started working on galaxy PGC2240533 at Fri Aug 7 09:17:19 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 282.4515966247727 44.272789577779136 --width 251 --height 251 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/PGC2240533-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/PGC2240533-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T09:17:21.524573 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '282.4515966247727', '44.272789577779136', '--width', '251', '--height', '251', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/PGC2240533-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/PGC2240533-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 282.4515966247727 44.272789577779136 --width 251 --height 251 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/PGC2240533-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/PGC2240533-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 282.4515966247727 44.272789577779136 Starting process 16560 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 16562 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16564 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16566 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16568 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 16570 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 16572 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 16574 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 16576 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 16578 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 16581 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 16583 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 16585 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16586 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16588 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16593 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T09:17:32.636478 Keeping 11 CCDs: k4m_170806_091429_ooi_zd_ls9-CCD2 z expnum 3135984 exptime 188.103 propid 2016A-0453 seeing 1.36 MJD 57971.385 object MzLS_623848_z mosaic/CP/V4.3/CP20170805/k4m_170806_091429_ooi_zd_ls9.fits.fz k4m_160511_112608_ooi_zd_ls9-CCD1 z expnum 88405 exptime 80.103 propid 2016A-0453 seeing 0.87 MJD 57519.476 object MzLS_625646_z mosaic/CP/V4.3/CP20160510/k4m_160511_112608_ooi_zd_ls9.fits.fz k4m_160504_114120_ooi_zd_ls9-CCD3 z expnum 87103 exptime 80.106 propid 2016A-0453 seeing 1.06 MJD 57512.487 object MzLS_624749_z mosaic/CP/V4.3/CP20160503/k4m_160504_114120_ooi_zd_ls9.fits.fz ksb_160602_102834_ooi_g_ls9-CCD3 g expnum 75410167 exptime 105.9 propid BASS seeing 1.32 MJD 57541.437 object 62342 90prime/CP/V2.3/CP20160601/ksb_160602_102834_ooi_g_ls9.fits.fz ksb_160516_103908_ooi_r_ls9-CCD3 r expnum 75240164 exptime 86.4 propid BASS seeing 1.66 MJD 57524.444 object 62342 90prime/CP/V2.3/CP20160515/ksb_160516_103908_ooi_r_ls9.fits.fz ksb_170624_084036_ooi_r_ls9-CCD1 r expnum 79280129 exptime 250.0 propid BASS seeing 1.63 MJD 57928.362 object 62343 90prime/CP/V2.3/CP20170623/ksb_170624_084036_ooi_r_ls9.fits.fz ksb_160702_094329_ooi_g_ls9-CCD1 g expnum 75710128 exptime 181.7 propid BASS seeing 1.91 MJD 57571.405 object 62343 90prime/CP/V2.3/CP20160701/ksb_160702_094329_ooi_g_ls9.fits.fz ksb_170624_083753_ooi_r_ls9-CCD2 r expnum 79280128 exptime 126.0 propid BASS seeing 1.23 MJD 57928.360 object 62493 90prime/CP/V2.3/CP20170623/ksb_170624_083753_ooi_r_ls9.fits.fz ksb_160702_101419_ooi_g_ls9-CCD2 g expnum 75710137 exptime 120.3 propid BASS seeing 1.52 MJD 57571.427 object 62493 90prime/CP/V2.3/CP20160701/ksb_160702_101419_ooi_g_ls9.fits.fz ksb_160603_102840_ooi_g_ls9-CCD3 g expnum 75420164 exptime 84.1 propid BASS seeing 1.32 MJD 57542.437 object 62341 90prime/CP/V2.3/CP20160602/ksb_160603_102840_ooi_g_ls9.fits.fz ksb_160604_093807_ooi_r_ls9-CCD3 r expnum 75430179 exptime 62.8 propid BASS seeing 1.31 MJD 57543.401 object 62341 90prime/CP/V2.3/CP20160603/ksb_160604_093807_ooi_r_ls9.fits.fz mosaic get_fwhm: self.fwhm = 3.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 998 1258 and amp range 0 2005 and image y 439 701 and amp range 0 2039 Range in image: x 0 261 , y 0 263 (with image size 261 x 263) dzp -0.011066288 -> scaling image by 0.989859339076806 Faked up EXPNUM 75430179 Faked up EXPNUM 75430179 Faked up EXPNUM 75430179 90prime get_fwhm: self.fwhm = 2.89 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1883 2029 and amp range 0 2015 and image y 1247 1393 and amp range 0 2047 Range in image: x 0 133 , y 0 147 (with image size 147 x 147) dzp -0.024507914 -> scaling image by 0.9776802328037623 Found overlap: image x 1883 2029 and amp range 2016 4031 and image y 1247 1393 and amp range 0 2047 Range in image: x 133 147 , y 0 147 (with image size 147 x 147) dzp 0.004245165 -> scaling image by 1.0039175950705865 Faked up EXPNUM 75410167 Faked up EXPNUM 75410167 Faked up EXPNUM 75410167 90prime get_fwhm: self.fwhm = 2.91 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3864 4010 and amp range 2016 4031 and image y 3224 3370 and amp range 2048 4095 Range in image: x 0 147 , y 0 147 (with image size 147 x 147) dzp -0.0012536051 -> scaling image by 0.9988460533227724 Faked up EXPNUM 75240164 Faked up EXPNUM 75240164 Faked up EXPNUM 75240164 90prime get_fwhm: self.fwhm = 3.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3873 4016 and amp range 2016 4031 and image y 3230 3377 and amp range 2048 4095 Range in image: x 0 144 , y 0 148 (with image size 144 x 148) dzp -0.0005558773 -> scaling image by 0.99948814914245 Faked up EXPNUM 75710137 Faked up EXPNUM 75710137 Faked up EXPNUM 75710137 90prime get_fwhm: self.fwhm = 3.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3604 3752 and amp range 2016 4031 and image y 598 747 and amp range 0 2047 Range in image: x 0 149 , y 0 150 (with image size 149 x 150) dzp -0.008960029 -> scaling image by 0.9917814665476246 Faked up EXPNUM 79280128 Faked up EXPNUM 79280128 Faked up EXPNUM 79280128 90prime get_fwhm: self.fwhm = 2.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3617 3765 and amp range 2016 4031 and image y 589 738 and amp range 0 2047 Range in image: x 0 149 , y 0 150 (with image size 149 x 150) dzp 0.032776505 -> scaling image by 1.0306485625912574 mosaic get_fwhm: self.fwhm = 4.07 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3733 3985 and amp range 2006 4053 and image y 7 180 and amp range 0 2039 Range in image: x 0 253 , y 0 174 (with image size 253 x 174) dzp -0.00064781494 -> scaling image by 0.9994035183523652 Faked up EXPNUM 75420164 Faked up EXPNUM 75420164 Faked up EXPNUM 75420164 90prime get_fwhm: self.fwhm = 2.91 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1895 2040 and amp range 0 2015 and image y 1229 1375 and amp range 0 2047 Range in image: x 0 121 , y 0 147 (with image size 146 x 147) dzp -0.03470582 -> scaling image by 0.9685402452207784 Found overlap: image x 1895 2040 and amp range 2016 4031 and image y 1229 1375 and amp range 0 2047 Range in image: x 121 146 , y 0 147 (with image size 146 x 147) dzp -0.0022715968 -> scaling image by 0.9979099691834846 mosaic get_fwhm: self.fwhm = 5.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2132 2386 and amp range 2048 4095 and image y 2885 3140 and amp range 2040 4078 Range in image: x 0 255 , y 0 256 (with image size 255 x 256) dzp -0.036442947 -> scaling image by 0.9669918668439786 Stage tims : Wall: 116.72 s, CPU: 5.86 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 172 MB, VmData: 206 MB, maxrss: 0.176616 MB Stage tims finished: 2020-08-07T09:19:29.358908 Faked up EXPNUM 75710128 Faked up EXPNUM 75710128 Faked up EXPNUM 75710128 Resources for stage tims : 5.390 s worker CPU, 510.169 s worker Wall, Wall: 116.724 s, Cores in use: 0.10, Total efficiency (on 16 cores): 0.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/PGC2240533-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/PGC2240533-largegalaxy-tims.p Running stage refs Faked up EXPNUM 79280129 Faked up EXPNUM 79280129 Faked up EXPNUM 79280129 Running stage refs at 2020-08-07T09:19:32.025029 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01833.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01834.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01957.fits Matched 1 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/metrics/cus/reference-custom-282451p44272.fits Stage refs : Wall: 8.76 s, CPU: 7.62 s, VmPeak: 1047 MB, VmSize: 1041 MB, VmRSS: 265 MB, VmData: 296 MB, maxrss: 0.271772 MB Stage refs finished: 2020-08-07T09:19:40.782058 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.759 s, Cores in use: 0.87, Total efficiency (on 16 cores): 5.4 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/PGC2240533-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/PGC2240533-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T09:19:40.814126 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/metrics/cus/outlier-mask-custom-282451p44272.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/metrics/cus/outliers-pre-custom-282451p44272.jpg Image ksb_160603_102840_ooi_g_ls9-CCD3 g : masking 617 positive outlier pixels and 0 negative outlier pixels Image ksb_160516_103908_ooi_r_ls9-CCD3 r : masking 2014 positive outlier pixels and 0 negative outlier pixels Image ksb_160604_093807_ooi_r_ls9-CCD3 r : masking 1552 positive outlier pixels and 0 negative outlier pixels Image k4m_170806_091429_ooi_zd_ls9-CCD2 z : masking 1575 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/metrics/cus/outlier-mask-custom-282451p44272.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/metrics/cus/outliers-post-custom-282451p44272.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/metrics/cus/outliers-masked-pos-custom-282451p44272.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/metrics/cus/outliers-masked-neg-custom-282451p44272.jpg Stage outliers : Wall: 1.01 s, CPU: 0.71 s, VmPeak: 1050 MB, VmSize: 1050 MB, VmRSS: 278 MB, VmData: 307 MB, maxrss: 0.284932 MB Stage outliers finished: 2020-08-07T09:19:41.819679 Resources for stage outliers : 0.735 s worker CPU, 0.897 s worker Wall, Wall: 1.007 s, Cores in use: 1.44, Total efficiency (on 16 cores): 9.0 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/PGC2240533-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/PGC2240533-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T09:19:41.840929 Stage halos : Wall: 0.28 s, CPU: 0.27 s, VmPeak: 1050 MB, VmSize: 1050 MB, VmRSS: 278 MB, VmData: 307 MB, maxrss: 0.285164 MB Stage halos finished: 2020-08-07T09:19:42.123126 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.283 s, Cores in use: 0.96, Total efficiency (on 16 cores): 6.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/PGC2240533-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/PGC2240533-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T09:19:42.200203 PSF sigmas in coadd pixels: ['2.14', '2.47', '2.14'] Using average PSF sigma 2.249300404379929 Gaussian PSF norm 0.1254144583020444 vs pixelized 0.11059294 average tim pixel scale / coadd scale: 1.7292776015295668 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.70', '1.99', '2.13'] Using average PSF sigma 2.273699944733744 Gaussian PSF norm 0.12406861003240785 vs pixelized 0.1035394 average tim pixel scale / coadd scale: 1.7291522995419515 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.21', '1.42', '1.72'] Using average PSF sigma 1.7809120025550318 Gaussian PSF norm 0.15839906259779457 vs pixelized 0.13298756 average tim pixel scale / coadd scale: 0.9909528352050039 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.18 s, CPU: 0.13 s, VmPeak: 1050 MB, VmSize: 1050 MB, VmRSS: 280 MB, VmData: 307 MB, maxrss: 0.286628 MB Stage fit_on_coadds finished: 2020-08-07T09:19:42.376169 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.190 s worker CPU, 0.190 s worker Wall, Wall: 0.177 s, Cores in use: 1.83, Total efficiency (on 16 cores): 11.5 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/PGC2240533-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/PGC2240533-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T09:19:42.386308 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 51 potential peaks Of 51 potential peaks: 27 in veto map, 3 cut by saddle test, 0 cut by aper test, 21 kept SED z : 21 new peaks Found 54 potential peaks Of 54 potential peaks: 52 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 38 potential peaks Of 38 potential peaks: 35 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 52 potential peaks Of 52 potential peaks: 48 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 52 potential peaks Of 52 potential peaks: 49 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 24 new sources Median coadd sky for g : 0.00029663165 Median coadd sky for r : 0.00023662973 Median coadd sky for z : -0.00010967019 Stage srcs : Wall: 0.75 s, CPU: 0.72 s, VmPeak: 1050 MB, VmSize: 1050 MB, VmRSS: 280 MB, VmData: 307 MB, maxrss: 0.287112 MB Stage srcs finished: 2020-08-07T09:19:43.137199 Resources for stage srcs : 0.079 s worker CPU, 0.079 s worker Wall, Wall: 0.752 s, Cores in use: 1.06, Total efficiency (on 16 cores): 6.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/PGC2240533-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/PGC2240533-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T09:19:43.156828 Blob 1 of 11, id: 0, sources: 18, size: 199x231, npix 21246, brick X: 51,250, Y: 0,231, one pixel: 65 0 Blob 2 of 11, id: 7, sources: 3, size: 57x51, npix 1442, brick X: 51,108, Y: 200,251, one pixel: 79 200 Blob 3 of 11, id: 6, sources: 2, size: 48x44, npix 1110, brick X: 92,140, Y: 186,230, one pixel: 102 186 Blob 4 of 11, id: 8, sources: 3, size: 27x43, npix 786, brick X: 0,27, Y: 205,248, one pixel: 5 205 Blob 5 of 11, id: 9, sources: 1, size: 27x23, npix 448, brick X: 122,149, Y: 228,251, one pixel: 133 228 Blob 6 of 11, id: 5, sources: 1, size: 25x25, npix 400, brick X: 25,50, Y: 183,208, one pixel: 36 183 Blob 7 of 11, id: 4, sources: 1, size: 23x24, npix 338, brick X: 20,43, Y: 62,86, one pixel: 30 62 Blob 8 of 11, id: 1, sources: 1, size: 23x22, npix 316, brick X: 139,162, Y: 3,25, one pixel: 148 3 Blob 9 of 11, id: 2, sources: 1, size: 20x20, npix 238, brick X: 231,251, Y: 35,55, one pixel: 240 35 Blob 10 of 11, id: 10, sources: 1, size: 15x19, npix 202, brick X: 236,251, Y: 232,251, one pixel: 246 232 Blob 11 of 11, id: 3, sources: 1, size: 19x18, npix 198, brick X: 184,203, Y: 36,54, one pixel: 192 36 Blob 7 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 692 MB, VmSize: 692 MB, VmRSS: 112 MB, VmData: 161 MB, maxrss: 0.11462 MB Blob 11 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 86 MB, VmData: 138 MB, maxrss: 0.088404 MB Blob 8 finished, total: Wall: 0.18 s, CPU: 0.17 s, VmPeak: 793 MB, VmSize: 712 MB, VmRSS: 129 MB, VmData: 170 MB, maxrss: 0.132436 MB Blob 9 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 808 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.14648 MB Blob 5 finished, total: Wall: 0.42 s, CPU: 0.41 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.093704 MB Blob 6 finished, total: Wall: 0.43 s, CPU: 0.42 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145632 MB Blob 10 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.093796 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (282.47272, 44.27988), pm (-2.2, -10.4), parallax 0.354 with NanoMaggies: g=17, r=16.5, z=16.3 Reset brightness to NanoMaggies: g=17, r=16.5, z=16.3 Blob 4 finished, total: Wall: 0.99 s, CPU: 0.98 s, VmPeak: 814 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145296 MB Blob 3 finished, total: Wall: 1.04 s, CPU: 1.04 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147324 MB Blob 2 finished, total: Wall: 1.41 s, CPU: 1.40 s, VmPeak: 815 MB, VmSize: 725 MB, VmRSS: 140 MB, VmData: 182 MB, maxrss: 0.143492 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.427989, ee1=0.146513, ee2=0.128646 Measuring 5 iterative sources Blob 1 finished, total: Wall: 15.21 s, CPU: 15.21 s, VmPeak: 702 MB, VmSize: 693 MB, VmRSS: 124 MB, VmData: 162 MB, maxrss: 0.134456 MB Old catalog: 41 New catalog: 36 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/metrics/cus/blobs-custom-282451p44272.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/metrics/cus/all-models-custom-282451p44272.fits Stage fitblobs : Wall: 15.63 s, CPU: 0.40 s, VmPeak: 1050 MB, VmSize: 1050 MB, VmRSS: 281 MB, VmData: 307 MB, maxrss: 0.287276 MB Stage fitblobs finished: 2020-08-07T09:19:58.790070 Resources for stage fitblobs : 20.759 s worker CPU, 20.819 s worker Wall, Wall: 15.635 s, Cores in use: 1.35, Total efficiency (on 16 cores): 8.5 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/PGC2240533-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/PGC2240533-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T09:19:58.803632 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/tmp-legacysurvey-custom-282451p44272-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/tmp-legacysurvey-custom-282451p44272-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/tmp-legacysurvey-custom-282451p44272-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/tmp-legacysurvey-custom-282451p44272-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-resid.jpg Stage coadds : Wall: 17.05 s, CPU: 0.60 s, VmPeak: 1050 MB, VmSize: 1050 MB, VmRSS: 281 MB, VmData: 307 MB, maxrss: 0.2876 MB Stage coadds finished: 2020-08-07T09:20:15.855029 Resources for stage coadds : 8.681 s worker CPU, 9.304 s worker Wall, Wall: 17.053 s, Cores in use: 0.54, Total efficiency (on 16 cores): 3.4 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/PGC2240533-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/PGC2240533-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T09:20:15.869763 Cut to 1 unWISE tiles Reading WISE tile 2830p439 band 1 Reading WISE tile 2830p439 band 3 Reading WISE tile 2830p439 band 2 Reading WISE tile 2830p439 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 813 MB, VmSize: 797 MB, VmRSS: 143 MB, VmData: 176 MB, maxrss: 0.189652 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 812 MB, VmSize: 797 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.204592 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 819 MB, VmSize: 794 MB, VmRSS: 138 MB, VmData: 172 MB, maxrss: 0.200544 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2830p439/unwise-2830p439-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 814 MB, VmSize: 800 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.206792 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/tmp-legacysurvey-custom-282451p44272-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/tmp-legacysurvey-custom-282451p44272-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 7.52 s, CPU: 0.55 s, VmPeak: 1050 MB, VmSize: 1050 MB, VmRSS: 281 MB, VmData: 307 MB, maxrss: 0.288112 MB Stage wise_forced finished: 2020-08-07T09:20:23.385590 Resources for stage wise_forced : 2.946 s worker CPU, 17.707 s worker Wall, Wall: 7.517 s, Cores in use: 0.47, Total efficiency (on 16 cores): 2.9 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/PGC2240533-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/PGC2240533-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T09:20:23.405909 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/coadd/cus/custom-282451p44272/legacysurvey-custom-282451p44272-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/tractor-i/cus/tractor-custom-282451p44272.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/tractor/cus/tractor-custom-282451p44272.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/tractor/cus/brick-custom-282451p44272.sha256sum Stage writecat : Wall: 0.73 s, CPU: 0.57 s, VmPeak: 1183 MB, VmSize: 1055 MB, VmRSS: 283 MB, VmData: 307 MB, maxrss: 0.421036 MB Stage writecat finished: 2020-08-07T09:20:24.137452 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.733 s, Cores in use: 0.79, Total efficiency (on 16 cores): 4.9 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/PGC2240533-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2240533/PGC2240533-largegalaxy-writecat.p All done: 38.784 s worker CPU, 559.170 s worker Wall, Wall: 171.520 s, Cores in use: 0.33, Total efficiency (on 16 cores): 2.1 % Finished galaxy PGC2240533 in 3.083 minutes.