Started working on galaxy PGC2722838 at Wed Aug 5 19:34:47 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 228.43575 68.720802 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T19:34:50.808516 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '228.43575', '68.720802', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 228.43575 68.720802 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 228.43575 68.720802 Starting process 22835 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 22836 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 22837 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 22838 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 22839 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059404 MB Starting process 22840 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059412 MB Starting process 22842 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 22841 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059412 MB Starting process 22843 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 22844 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 22845 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 22846 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 22847 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 22848 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 22849 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 22850 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T19:34:53.343426 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 10 CCDs: k4m_170421_093702_ooi_zd_ls9-CCD2 z expnum 123724 exptime 85.104 propid 2016A-0453 seeing 1.39 MJD 57864.401 object MzLS_710443_z mosaic/CP/V4.3/CP20170420/k4m_170421_093702_ooi_zd_ls9.fits.fz k4m_171002_024810_ooi_zd_ls9-CCD1 z expnum 141765 exptime 98.104 propid 2016A-0453 seeing 0.92 MJD 58028.117 object MzLS_710905_z mosaic/CP/V4.3/CP20171001/k4m_171002_024810_ooi_zd_ls9.fits.fz k4m_170420_090657_ooi_zd_ls9-CCD4 z expnum 123514 exptime 121.105 propid 2016A-0453 seeing 1.44 MJD 57863.380 object MzLS_710442_z mosaic/CP/V4.3/CP20170419/k4m_170420_090657_ooi_zd_ls9.fits.fz k4m_171220_115719_ooi_zd_ls9-CCD1 z expnum 152099 exptime 119.104 propid 2016A-0453 seeing 0.95 MJD 58107.498 object MzLS_711362_z mosaic/CP/V4.3/CP20171219/k4m_171220_115719_ooi_zd_ls9.fits.fz ksb_180414_102039_ooi_g_ls9-CCD2 g expnum 82220135 exptime 126.731 propid BASS seeing 1.56 MJD 58222.431 object 45383 90prime/CP/V2.3/CP20180413/ksb_180414_102039_ooi_g_ls9.fits.fz ksb_180409_100254_ooi_r_ls9-CCD2 r expnum 82170165 exptime 139.44 propid BASS seeing 1.07 MJD 58217.419 object 45383 90prime/CP/V2.3/CP20180408/ksb_180409_100254_ooi_r_ls9.fits.fz ksb_180419_091052_ooi_r_ls9-CCD1 r expnum 82270146 exptime 116.098 propid BASS seeing 1.54 MJD 58227.383 object 44602 90prime/CP/V2.3/CP20180418/ksb_180419_091052_ooi_r_ls9.fits.fz ksb_170527_053201_ooi_g_ls9-CCD1 g expnum 79000057 exptime 163.493 propid 2015A-0801 seeing 1.84 MJD 57900.231 object 44602 90prime/CP/V2.3/CP20170526/ksb_170527_053201_ooi_g_ls9.fits.fz ksb_170623_070957_ooi_r_ls9-CCD4 r expnum 79270092 exptime 129.679 propid BASS seeing 1.35 MJD 57927.299 object 45381 90prime/CP/V2.3/CP20170622/ksb_170623_070957_ooi_r_ls9.fits.fz ksb_180415_081733_ooi_g_ls9-CCD4 g expnum 82230117 exptime 113.7 propid BASS seeing 1.53 MJD 58223.346 object 45381 90prime/CP/V2.3/CP20180414/ksb_180415_081733_ooi_g_ls9.fits.fz Faked up EXPNUM 82270146 Faked up EXPNUM 82270146 Faked up EXPNUM 82270146 90prime get_fwhm: self.fwhm = 3.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 222 370 and amp range 0 2015 and image y 1065 1211 and amp range 0 2047 Range in image: x 0 149 , y 0 147 (with image size 149 x 147) dzp -0.04811793 -> scaling image by 0.9566494556405901 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 79000057 Faked up EXPNUM 79000057 Faked up EXPNUM 79000057 90prime get_fwhm: self.fwhm = 4.07 Found 4 relevant rows in amp-corrections file. Found overlap: image x 230 378 and amp range 0 2015 and image y 1057 1203 and amp range 0 2047 Range in image: x 0 149 , y 0 147 (with image size 149 x 147) dzp -0.023075538 -> scaling image by 0.9789709052881876 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 79270092 Faked up EXPNUM 79270092 Faked up EXPNUM 79270092 90prime get_fwhm: self.fwhm = 2.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2105 2248 and amp range 2016 4031 and image y 828 970 and amp range 0 2047 Range in image: x 0 144 , y 0 143 (with image size 144 x 143) dzp 0.02499258 -> scaling image by 1.0232859986636875 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82220135 Faked up EXPNUM 82220135 Faked up EXPNUM 82220135 90prime get_fwhm: self.fwhm = 3.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 73 217 and amp range 0 2015 and image y 3310 3454 and amp range 2048 4095 Range in image: x 0 145 , y 0 145 (with image size 145 x 145) dzp 0.0459271 -> scaling image by 1.0432078344950917 Faked up EXPNUM 82170165 Faked up EXPNUM 82170165 Faked up EXPNUM 82170165 90prime get_fwhm: self.fwhm = 2.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 80 224 and amp range 0 2015 and image y 3318 3462 and amp range 2048 4095 Range in image: x 0 145 , y 0 145 (with image size 145 x 145) dzp 0.0503617 -> scaling image by 1.047477444828492 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82230117 Faked up EXPNUM 82230117 Faked up EXPNUM 82230117 90prime get_fwhm: self.fwhm = 3.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2107 2250 and amp range 2016 4031 and image y 821 963 and amp range 0 2047 Range in image: x 0 144 , y 0 143 (with image size 144 x 143) dzp 0.023266561 -> scaling image by 1.0216605511853067 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.53 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3905 4046 and amp range 2006 4053 and image y 3476 3721 and amp range 2040 4078 Range in image: x 0 142 , y 0 246 (with image size 142 x 246) dzp 0.0036595785 -> scaling image by 1.003376283213225 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 5.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2366 2621 and amp range 2048 4095 and image y 377 630 and amp range 0 2039 Range in image: x 0 256 , y 0 254 (with image size 256 x 254) dzp 0.0044767857 -> scaling image by 1.004131784351374 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1166 1416 and amp range 0 2005 and image y 3074 3322 and amp range 2040 4078 Range in image: x 0 251 , y 0 249 (with image size 251 x 249) dzp 0.014419514 -> scaling image by 1.0133694453441033 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 5.55 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2390 2644 and amp range 2048 4095 and image y 3909 4054 and amp range 2022 4060 Range in image: x 0 255 , y 0 146 (with image size 255 x 146) dzp -0.02499645 -> scaling image by 0.9772404160512723 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 35.11 s, CPU: 1.19 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 175 MB, VmData: 207 MB, maxrss: 0.178952 MB Stage tims finished: 2020-08-05T19:35:28.455852 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 5.619 s worker CPU, 65.832 s worker Wall, Wall: 35.114 s, Cores in use: 0.19, Total efficiency (on 16 cores): 1.2 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T19:35:28.483212 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00457.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00458.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00399.fits Matched 3 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/metrics/cus/reference-custom-228435p68720.fits Stage refs : Wall: 8.26 s, CPU: 2.08 s, VmPeak: 988 MB, VmSize: 975 MB, VmRSS: 193 MB, VmData: 224 MB, maxrss: 0.197636 MB Stage refs finished: 2020-08-05T19:35:36.742318 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.261 s, Cores in use: 0.25, Total efficiency (on 16 cores): 1.6 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T19:35:36.769555 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/metrics/cus/outlier-mask-custom-228435p68720.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/metrics/cus/outliers-pre-custom-228435p68720.jpg Image ksb_180414_102039_ooi_g_ls9-CCD2 g : masking 466 positive outlier pixels and 0 negative outlier pixels Image ksb_170527_053201_ooi_g_ls9-CCD1 g : masking 663 positive outlier pixels and 0 negative outlier pixels Image ksb_180415_081733_ooi_g_ls9-CCD4 g : masking 820 positive outlier pixels and 0 negative outlier pixels Image k4m_170421_093702_ooi_zd_ls9-CCD2 z : masking 594 positive outlier pixels and 0 negative outlier pixels Image k4m_171002_024810_ooi_zd_ls9-CCD1 z : masking 84 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/metrics/cus/outlier-mask-custom-228435p68720.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/metrics/cus/outliers-post-custom-228435p68720.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/metrics/cus/outliers-masked-pos-custom-228435p68720.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/metrics/cus/outliers-masked-neg-custom-228435p68720.jpg Stage outliers : Wall: 1.86 s, CPU: 1.58 s, VmPeak: 988 MB, VmSize: 984 MB, VmRSS: 207 MB, VmData: 235 MB, maxrss: 0.211628 MB Stage outliers finished: 2020-08-05T19:35:38.625231 Resources for stage outliers : 0.800 s worker CPU, 0.853 s worker Wall, Wall: 1.857 s, Cores in use: 1.28, Total efficiency (on 16 cores): 8.0 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T19:35:39.317427 Stage halos : Wall: 0.81 s, CPU: 0.78 s, VmPeak: 988 MB, VmSize: 985 MB, VmRSS: 207 MB, VmData: 236 MB, maxrss: 0.211932 MB Stage halos finished: 2020-08-05T19:35:40.123224 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.807 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T19:35:40.150931 PSF sigmas in coadd pixels: ['2.54', '2.99', '2.48'] Using average PSF sigma 2.6729262705873986 Gaussian PSF norm 0.10553781257568522 vs pixelized 0.08351579 average tim pixel scale / coadd scale: 1.730505361058216 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.75', '2.50', '2.19'] Using average PSF sigma 2.1423060628566613 Gaussian PSF norm 0.13167809990591095 vs pixelized 0.10237765 average tim pixel scale / coadd scale: 1.7300764683506074 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.26', '1.49', '2.34', '1.54'] Using average PSF sigma 1.906128656684468 Gaussian PSF norm 0.14799357366808366 vs pixelized 0.12415971 average tim pixel scale / coadd scale: 0.9910346314094193 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.17 s, CPU: 0.15 s, VmPeak: 988 MB, VmSize: 985 MB, VmRSS: 209 MB, VmData: 236 MB, maxrss: 0.214256 MB Stage fit_on_coadds finished: 2020-08-05T19:35:40.324125 Resources for stage fit_on_coadds : 0.165 s worker CPU, 0.165 s worker Wall, Wall: 0.175 s, Cores in use: 1.80, Total efficiency (on 16 cores): 11.3 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-fit_on_coadds.p Running stage srcs Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage srcs at 2020-08-05T19:35:40.339205 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 12 potential peaks Of 12 potential peaks: 2 in veto map, 2 cut by saddle test, 0 cut by aper test, 8 kept SED z : 8 new peaks Found 25 potential peaks Of 25 potential peaks: 20 in veto map, 3 cut by saddle test, 1 cut by aper test, 1 kept SED r : 1 new peaks Found 27 potential peaks Of 27 potential peaks: 20 in veto map, 7 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 44 potential peaks Of 44 potential peaks: 37 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 35 potential peaks Of 35 potential peaks: 28 in veto map, 7 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 10 new sources Median coadd sky for g : 0.0004785512 Median coadd sky for r : 0.0007947658 Median coadd sky for z : -0.0003831681 Stage srcs : Wall: 1.07 s, CPU: 1.02 s, VmPeak: 988 MB, VmSize: 985 MB, VmRSS: 210 MB, VmData: 236 MB, maxrss: 0.214776 MB Stage srcs finished: 2020-08-05T19:35:41.406174 Resources for stage srcs : 0.074 s worker CPU, 0.074 s worker Wall, Wall: 1.068 s, Cores in use: 1.02, Total efficiency (on 16 cores): 6.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T19:35:41.420330 Blob 1 of 5, id: 4, sources: 7, size: 239x164, npix 19997, brick X: 6,245, Y: 52,216, one pixel: 152 52 Blob 2 of 5, id: 1, sources: 3, size: 58x99, npix 3557, brick X: 187,245, Y: 0,99, one pixel: 205 0 Blob 3 of 5, id: 0, sources: 1, size: 38x26, npix 702, brick X: 109,147, Y: 0,26, one pixel: 115 0 Blob 4 of 5, id: 3, sources: 1, size: 28x27, npix 505, brick X: 23,51, Y: 47,74, one pixel: 36 47 Blob 5 of 5, id: 2, sources: 1, size: 14x23, npix 220, brick X: 0,14, Y: 38,61, one pixel: 3 38 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (228.40372, 68.71042), pm (-24.3, 4.3), parallax 3.332 with NanoMaggies: g=11.9, r=11.5, z=11.4 Reset brightness to NanoMaggies: g=11.9, r=11.5, z=11.4 Blob 2 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 670 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.09586 MB Blob 4 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 90 MB, VmData: 137 MB, maxrss: 0.091716 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 0.45 s, CPU: 0.45 s, VmPeak: 808 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149804 MB Blob 5 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 808 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149972 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.47705, ee1=0.362815, ee2=0.402621 Measuring 6 iterative sources Blob 1 finished, total: Wall: 12.44 s, CPU: 12.44 s, VmPeak: 695 MB, VmSize: 691 MB, VmRSS: 123 MB, VmData: 162 MB, maxrss: 0.127924 MB Old catalog: 15 New catalog: 17 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/metrics/cus/blobs-custom-228435p68720.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/metrics/cus/all-models-custom-228435p68720.fits Stage fitblobs : Wall: 13.40 s, CPU: 0.57 s, VmPeak: 988 MB, VmSize: 983 MB, VmRSS: 208 MB, VmData: 235 MB, maxrss: 0.21494 MB Stage fitblobs finished: 2020-08-05T19:35:54.818154 Resources for stage fitblobs : 14.235 s worker CPU, 14.303 s worker Wall, Wall: 13.399 s, Cores in use: 1.11, Total efficiency (on 16 cores): 6.9 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T19:35:54.832639 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/tmp-legacysurvey-custom-228435p68720-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/tmp-legacysurvey-custom-228435p68720-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/tmp-legacysurvey-custom-228435p68720-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/tmp-legacysurvey-custom-228435p68720-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-resid.jpg Stage coadds : Wall: 2.90 s, CPU: 0.92 s, VmPeak: 988 MB, VmSize: 983 MB, VmRSS: 209 MB, VmData: 235 MB, maxrss: 0.21494 MB Stage coadds finished: 2020-08-05T19:35:57.737366 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 8.695 s worker CPU, 12.909 s worker Wall, Wall: 2.906 s, Cores in use: 3.31, Total efficiency (on 16 cores): 20.7 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T19:35:57.764192 Cut to 1 unWISE tiles Reading WISE tile 2294p681 band 2 Reading WISE tile 2294p681 band 1 Reading WISE tile 2294p681 band 4 Reading WISE tile 2294p681 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 804 MB, VmSize: 804 MB, VmRSS: 146 MB, VmData: 176 MB, maxrss: 0.186572 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 803 MB, VmSize: 802 MB, VmRSS: 143 MB, VmData: 174 MB, maxrss: 0.205668 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 864 MB, VmSize: 864 MB, VmRSS: 206 MB, VmData: 236 MB, maxrss: 0.211092 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 812 MB, VmSize: 812 MB, VmRSS: 153 MB, VmData: 180 MB, maxrss: 0.209508 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/tmp-legacysurvey-custom-228435p68720-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/tmp-legacysurvey-custom-228435p68720-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 4.18 s, CPU: 1.93 s, VmPeak: 988 MB, VmSize: 983 MB, VmRSS: 209 MB, VmData: 234 MB, maxrss: 0.21494 MB Stage wise_forced finished: 2020-08-05T19:36:01.940671 Resources for stage wise_forced : 3.313 s worker CPU, 6.575 s worker Wall, Wall: 4.178 s, Cores in use: 1.25, Total efficiency (on 16 cores): 7.8 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T19:36:01.959363 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/tractor-i/cus/tractor-custom-228435p68720.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/tractor/cus/tractor-custom-228435p68720.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/tractor/cus/brick-custom-228435p68720.sha256sum Stage writecat : Wall: 2.24 s, CPU: 1.40 s, VmPeak: 1115 MB, VmSize: 987 MB, VmRSS: 211 MB, VmData: 234 MB, maxrss: 0.346992 MB Stage writecat finished: 2020-08-05T19:36:04.200754 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.243 s, Cores in use: 0.62, Total efficiency (on 16 cores): 3.9 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-writecat.p All done: 32.905 s worker CPU, 100.716 s worker Wall, Wall: 71.418 s, Cores in use: 0.63, Total efficiency (on 16 cores): 3.9 % Finished galaxy PGC2722838 in 1.306 minutes. Started working on galaxy PGC2722838 at Wed Aug 5 20:01:37 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 228.43575 68.720802 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T20:01:38.815448 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '228.43575', '68.720802', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 228.43575 68.720802 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 228.43575 68.720802 Starting process 28415 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 28416 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 28417 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 28418 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 28419 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB Starting process 28420 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 28421 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 28422 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 28423 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 28424 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 28425 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 28426 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 28427 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 28428 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 28429 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 28430 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 28431 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 28432 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 28433 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 28434 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 28435 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 28436 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 28437 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 28438 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 28439 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 28440 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 28441 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 28442 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 28443 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 28444 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 28445 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 28446 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T20:01:39.309294 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 10 CCDs: k4m_170421_093702_ooi_zd_ls9-CCD2 z expnum 123724 exptime 85.104 propid 2016A-0453 seeing 1.39 MJD 57864.401 object MzLS_710443_z mosaic/CP/V4.3/CP20170420/k4m_170421_093702_ooi_zd_ls9.fits.fz k4m_171002_024810_ooi_zd_ls9-CCD1 z expnum 141765 exptime 98.104 propid 2016A-0453 seeing 0.92 MJD 58028.117 object MzLS_710905_z mosaic/CP/V4.3/CP20171001/k4m_171002_024810_ooi_zd_ls9.fits.fz k4m_170420_090657_ooi_zd_ls9-CCD4 z expnum 123514 exptime 121.105 propid 2016A-0453 seeing 1.44 MJD 57863.380 object MzLS_710442_z mosaic/CP/V4.3/CP20170419/k4m_170420_090657_ooi_zd_ls9.fits.fz k4m_171220_115719_ooi_zd_ls9-CCD1 z expnum 152099 exptime 119.104 propid 2016A-0453 seeing 0.95 MJD 58107.498 object MzLS_711362_z mosaic/CP/V4.3/CP20171219/k4m_171220_115719_ooi_zd_ls9.fits.fz ksb_180414_102039_ooi_g_ls9-CCD2 g expnum 82220135 exptime 126.731 propid BASS seeing 1.56 MJD 58222.431 object 45383 90prime/CP/V2.3/CP20180413/ksb_180414_102039_ooi_g_ls9.fits.fz ksb_180409_100254_ooi_r_ls9-CCD2 r expnum 82170165 exptime 139.44 propid BASS seeing 1.07 MJD 58217.419 object 45383 90prime/CP/V2.3/CP20180408/ksb_180409_100254_ooi_r_ls9.fits.fz ksb_180419_091052_ooi_r_ls9-CCD1 r expnum 82270146 exptime 116.098 propid BASS seeing 1.54 MJD 58227.383 object 44602 90prime/CP/V2.3/CP20180418/ksb_180419_091052_ooi_r_ls9.fits.fz ksb_170527_053201_ooi_g_ls9-CCD1 g expnum 79000057 exptime 163.493 propid 2015A-0801 seeing 1.84 MJD 57900.231 object 44602 90prime/CP/V2.3/CP20170526/ksb_170527_053201_ooi_g_ls9.fits.fz ksb_170623_070957_ooi_r_ls9-CCD4 r expnum 79270092 exptime 129.679 propid BASS seeing 1.35 MJD 57927.299 object 45381 90prime/CP/V2.3/CP20170622/ksb_170623_070957_ooi_r_ls9.fits.fz ksb_180415_081733_ooi_g_ls9-CCD4 g expnum 82230117 exptime 113.7 propid BASS seeing 1.53 MJD 58223.346 object 45381 90prime/CP/V2.3/CP20180414/ksb_180415_081733_ooi_g_ls9.fits.fz Faked up EXPNUM 82270146 Faked up EXPNUM 82270146 Faked up EXPNUM 82270146 90prime get_fwhm: self.fwhm = 3.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 222 370 and amp range 0 2015 and image y 1065 1211 and amp range 0 2047 Range in image: x 0 149 , y 0 147 (with image size 149 x 147) dzp -0.04811793 -> scaling image by 0.9566494556405901 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 79000057 Faked up EXPNUM 79000057 Faked up EXPNUM 79000057 90prime get_fwhm: self.fwhm = 4.07 Found 4 relevant rows in amp-corrections file. Found overlap: image x 230 378 and amp range 0 2015 and image y 1057 1203 and amp range 0 2047 Range in image: x 0 149 , y 0 147 (with image size 149 x 147) dzp -0.023075538 -> scaling image by 0.9789709052881876 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.53 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3905 4046 and amp range 2006 4053 and image y 3476 3721 and amp range 2040 4078 Range in image: x 0 142 , y 0 246 (with image size 142 x 246) dzp 0.0036595785 -> scaling image by 1.003376283213225 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82170165 Faked up EXPNUM 82170165 Faked up EXPNUM 82170165 90prime get_fwhm: self.fwhm = 2.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 80 224 and amp range 0 2015 and image y 3318 3462 and amp range 2048 4095 Range in image: x 0 145 , y 0 145 (with image size 145 x 145) dzp 0.0503617 -> scaling image by 1.047477444828492 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82230117 Faked up EXPNUM 82230117 Faked up EXPNUM 82230117 90prime get_fwhm: self.fwhm = 3.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2107 2250 and amp range 2016 4031 and image y 821 963 and amp range 0 2047 Range in image: x 0 144 , y 0 143 (with image size 144 x 143) dzp 0.023266561 -> scaling image by 1.0216605511853067 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 82220135 Faked up EXPNUM 82220135 Faked up EXPNUM 82220135 90prime get_fwhm: self.fwhm = 3.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 73 217 and amp range 0 2015 and image y 3310 3454 and amp range 2048 4095 Range in image: x 0 145 , y 0 145 (with image size 145 x 145) dzp 0.0459271 -> scaling image by 1.0432078344950917 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 5.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2366 2621 and amp range 2048 4095 and image y 377 630 and amp range 0 2039 Range in image: x 0 256 , y 0 254 (with image size 256 x 254) dzp 0.0044767857 -> scaling image by 1.004131784351374 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1166 1416 and amp range 0 2005 and image y 3074 3322 and amp range 2040 4078 Range in image: x 0 251 , y 0 249 (with image size 251 x 249) dzp 0.014419514 -> scaling image by 1.0133694453441033 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 79270092 Faked up EXPNUM 79270092 Faked up EXPNUM 79270092 90prime get_fwhm: self.fwhm = 2.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2105 2248 and amp range 2016 4031 and image y 828 970 and amp range 0 2047 Range in image: x 0 144 , y 0 143 (with image size 144 x 143) dzp 0.02499258 -> scaling image by 1.0232859986636875 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 5.55 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2390 2644 and amp range 2048 4095 and image y 3909 4054 and amp range 2022 4060 Range in image: x 0 255 , y 0 146 (with image size 255 x 146) dzp -0.02499645 -> scaling image by 0.9772404160512723 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 17.14 s, CPU: 1.06 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 175 MB, VmData: 207 MB, maxrss: 0.179012 MB Stage tims finished: 2020-08-05T20:01:56.452046 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 5.317 s worker CPU, 88.481 s worker Wall, Wall: 17.145 s, Cores in use: 0.37, Total efficiency (on 32 cores): 1.2 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T20:01:56.542314 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00457.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00458.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00399.fits Matched 3 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/metrics/cus/reference-custom-228435p68720.fits Stage refs : Wall: 11.35 s, CPU: 3.70 s, VmPeak: 988 MB, VmSize: 975 MB, VmRSS: 193 MB, VmData: 224 MB, maxrss: 0.19752 MB Stage refs finished: 2020-08-05T20:02:07.894375 Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 11.355 s, Cores in use: 0.33, Total efficiency (on 32 cores): 1.0 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T20:02:07.918405 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/metrics/cus/outlier-mask-custom-228435p68720.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/metrics/cus/outliers-pre-custom-228435p68720.jpg Image ksb_170527_053201_ooi_g_ls9-CCD1 g : masking 663 positive outlier pixels and 0 negative outlier pixels Image ksb_180414_102039_ooi_g_ls9-CCD2 g : masking 466 positive outlier pixels and 0 negative outlier pixels Image ksb_180415_081733_ooi_g_ls9-CCD4 g : masking 820 positive outlier pixels and 0 negative outlier pixels Image k4m_171002_024810_ooi_zd_ls9-CCD1 z : masking 84 positive outlier pixels and 0 negative outlier pixels Image k4m_170421_093702_ooi_zd_ls9-CCD2 z : masking 594 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/metrics/cus/outlier-mask-custom-228435p68720.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/metrics/cus/outliers-post-custom-228435p68720.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/metrics/cus/outliers-masked-pos-custom-228435p68720.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/metrics/cus/outliers-masked-neg-custom-228435p68720.jpg Stage outliers : Wall: 1.04 s, CPU: 0.63 s, VmPeak: 988 MB, VmSize: 985 MB, VmRSS: 207 MB, VmData: 236 MB, maxrss: 0.211532 MB Stage outliers finished: 2020-08-05T20:02:08.957125 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage outliers : 0.861 s worker CPU, 1.352 s worker Wall, Wall: 1.041 s, Cores in use: 1.44, Total efficiency (on 32 cores): 4.5 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T20:02:08.979214 Stage halos : Wall: 0.25 s, CPU: 0.24 s, VmPeak: 988 MB, VmSize: 985 MB, VmRSS: 207 MB, VmData: 236 MB, maxrss: 0.212036 MB Stage halos finished: 2020-08-05T20:02:09.233315 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.257 s, Cores in use: 0.97, Total efficiency (on 32 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T20:02:09.257820 PSF sigmas in coadd pixels: ['2.54', '2.99', '2.48'] Using average PSF sigma 2.6729262705873986 Gaussian PSF norm 0.10553781257568522 vs pixelized 0.08351579 average tim pixel scale / coadd scale: 1.730505361058216 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.75', '2.50', '2.19'] Using average PSF sigma 2.1423060628566613 Gaussian PSF norm 0.13167809990591095 vs pixelized 0.10237765 average tim pixel scale / coadd scale: 1.7300764683506074 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.26', '1.49', '2.34', '1.54'] Using average PSF sigma 1.906128656684468 Gaussian PSF norm 0.14799357366808366 vs pixelized 0.12415971 average tim pixel scale / coadd scale: 0.9910346314094193 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.15 s, CPU: 0.14 s, VmPeak: 988 MB, VmSize: 985 MB, VmRSS: 209 MB, VmData: 237 MB, maxrss: 0.214216 MB Stage fit_on_coadds finished: 2020-08-05T20:02:09.407694 Resources for stage fit_on_coadds : 0.165 s worker CPU, 0.165 s worker Wall, Wall: 0.152 s, Cores in use: 2.00, Total efficiency (on 32 cores): 6.3 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T20:02:09.418741 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 12 potential peaks Of 12 potential peaks: 2 in veto map, 2 cut by saddle test, 0 cut by aper test, 8 kept SED z : 8 new peaks Found 25 potential peaks Of 25 potential peaks: 20 in veto map, 3 cut by saddle test, 1 cut by aper test, 1 kept SED r : 1 new peaks Found 27 potential peaks Of 27 potential peaks: 20 in veto map, 7 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 44 potential peaks Of 44 potential peaks: 37 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 35 potential peaks Of 35 potential peaks: 28 in veto map, 7 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 10 new sources Median coadd sky for g : 0.0004785512 Median coadd sky for r : 0.0007947658 Median coadd sky for z : -0.00038316814 Stage srcs : Wall: 0.52 s, CPU: 0.49 s, VmPeak: 988 MB, VmSize: 985 MB, VmRSS: 210 MB, VmData: 237 MB, maxrss: 0.214816 MB Stage srcs finished: 2020-08-05T20:02:09.941189 Resources for stage srcs : 0.085 s worker CPU, 0.085 s worker Wall, Wall: 0.524 s, Cores in use: 1.10, Total efficiency (on 32 cores): 3.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T20:02:09.954071 Blob 1 of 5, id: 4, sources: 7, size: 239x164, npix 19997, brick X: 6,245, Y: 52,216, one pixel: 152 52 Blob 2 of 5, id: 1, sources: 3, size: 58x99, npix 3557, brick X: 187,245, Y: 0,99, one pixel: 205 0 Blob 3 of 5, id: 0, sources: 1, size: 38x26, npix 702, brick X: 109,147, Y: 0,26, one pixel: 115 0 Blob 4 of 5, id: 3, sources: 1, size: 28x27, npix 505, brick X: 23,51, Y: 47,74, one pixel: 36 47 Blob 5 of 5, id: 2, sources: 1, size: 14x23, npix 220, brick X: 0,14, Y: 38,61, one pixel: 3 38 Blob 4 finished, total: Wall: 0.37 s, CPU: 0.35 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.094388 MB Measuring 1 iterative sources Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (228.40372, 68.71042), pm (-24.3, 4.3), parallax 3.332 with NanoMaggies: g=11.9, r=11.5, z=11.4 Reset brightness to NanoMaggies: g=11.9, r=11.5, z=11.4 Blob 2 finished, total: Wall: 0.40 s, CPU: 0.37 s, VmPeak: 670 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.095304 MB Blob 3 finished, total: Wall: 0.47 s, CPU: 0.43 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093428 MB Blob 5 finished, total: Wall: 0.56 s, CPU: 0.53 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093148 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.47705, ee1=0.362815, ee2=0.40262 Measuring 6 iterative sources Blob 1 finished, total: Wall: 12.63 s, CPU: 12.63 s, VmPeak: 695 MB, VmSize: 690 MB, VmRSS: 123 MB, VmData: 161 MB, maxrss: 0.127828 MB Old catalog: 15 New catalog: 17 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/metrics/cus/blobs-custom-228435p68720.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/metrics/cus/all-models-custom-228435p68720.fits Stage fitblobs : Wall: 13.62 s, CPU: 0.84 s, VmPeak: 988 MB, VmSize: 983 MB, VmRSS: 208 MB, VmData: 235 MB, maxrss: 0.21496 MB Stage fitblobs finished: 2020-08-05T20:02:23.573189 Resources for stage fitblobs : 14.385 s worker CPU, 15.329 s worker Wall, Wall: 13.621 s, Cores in use: 1.12, Total efficiency (on 32 cores): 3.5 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T20:02:23.590466 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/tmp-legacysurvey-custom-228435p68720-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/tmp-legacysurvey-custom-228435p68720-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/tmp-legacysurvey-custom-228435p68720-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/tmp-legacysurvey-custom-228435p68720-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-resid.jpg Stage coadds : Wall: 4.22 s, CPU: 1.02 s, VmPeak: 988 MB, VmSize: 983 MB, VmRSS: 209 MB, VmData: 235 MB, maxrss: 0.21496 MB Stage coadds finished: 2020-08-05T20:02:27.809513 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 24.029 s worker CPU, 47.180 s worker Wall, Wall: 4.221 s, Cores in use: 5.94, Total efficiency (on 32 cores): 18.5 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T20:02:27.830981 Cut to 1 unWISE tiles Reading WISE tile 2294p681 band 2 Reading WISE tile 2294p681 band 3 Reading WISE tile 2294p681 band 4 Reading WISE tile 2294p681 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 807 MB, VmSize: 807 MB, VmRSS: 146 MB, VmData: 179 MB, maxrss: 0.184888 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 805 MB, VmSize: 799 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.204444 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 808 MB, VmSize: 798 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.201748 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 807 MB, VmSize: 807 MB, VmRSS: 146 MB, VmData: 179 MB, maxrss: 0.199552 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/tmp-legacysurvey-custom-228435p68720-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/tmp-legacysurvey-custom-228435p68720-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.65 s, CPU: 1.67 s, VmPeak: 988 MB, VmSize: 983 MB, VmRSS: 210 MB, VmData: 235 MB, maxrss: 0.21496 MB Stage wise_forced finished: 2020-08-05T20:02:31.480796 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.245 s worker CPU, 5.660 s worker Wall, Wall: 3.652 s, Cores in use: 1.35, Total efficiency (on 32 cores): 4.2 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T20:02:31.494707 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/coadd/cus/custom-228435p68720/legacysurvey-custom-228435p68720-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/tractor-i/cus/tractor-custom-228435p68720.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/tractor/cus/tractor-custom-228435p68720.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/tractor/cus/brick-custom-228435p68720.sha256sum Stage writecat : Wall: 0.69 s, CPU: 0.49 s, VmPeak: 1116 MB, VmSize: 988 MB, VmRSS: 212 MB, VmData: 235 MB, maxrss: 0.347544 MB Stage writecat finished: 2020-08-05T20:02:32.185037 Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.693 s, Cores in use: 0.71, Total efficiency (on 32 cores): 2.2 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/228/PGC2722838/PGC2722838-largegalaxy-writecat.p All done: 48.094 s worker CPU, 158.261 s worker Wall, Wall: 53.048 s, Cores in use: 1.10, Total efficiency (on 32 cores): 3.4 % Finished galaxy PGC2722838 in 0.917 minutes. Started working on galaxy PGC2722838 at Fri Aug 7 09:39:57 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 228.43572938928688 68.72106361349063 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/PGC2722838-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/PGC2722838-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T09:39:59.224433 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '228.43572938928688', '68.72106361349063', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/PGC2722838-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/PGC2722838-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 228.43572938928688 68.72106361349063 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/PGC2722838-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/PGC2722838-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 228.43572938928688 68.72106361349063 Starting process 11192 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 11193 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 11194 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 11195 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 11196 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB Starting process 11197 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059484 MB Starting process 11198 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059484 MB Starting process 11200 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 11201 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 11202 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 11203 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 11204 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 11205 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 11207 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 11209 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 11206 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T09:39:59.679333 Keeping 10 CCDs: k4m_170421_093702_ooi_zd_ls9-CCD2 z expnum 123724 exptime 85.104 propid 2016A-0453 seeing 1.39 MJD 57864.401 object MzLS_710443_z mosaic/CP/V4.3/CP20170420/k4m_170421_093702_ooi_zd_ls9.fits.fz k4m_171002_024810_ooi_zd_ls9-CCD1 z expnum 141765 exptime 98.104 propid 2016A-0453 seeing 0.92 MJD 58028.117 object MzLS_710905_z mosaic/CP/V4.3/CP20171001/k4m_171002_024810_ooi_zd_ls9.fits.fz k4m_170420_090657_ooi_zd_ls9-CCD4 z expnum 123514 exptime 121.105 propid 2016A-0453 seeing 1.44 MJD 57863.380 object MzLS_710442_z mosaic/CP/V4.3/CP20170419/k4m_170420_090657_ooi_zd_ls9.fits.fz k4m_171220_115719_ooi_zd_ls9-CCD1 z expnum 152099 exptime 119.104 propid 2016A-0453 seeing 0.95 MJD 58107.498 object MzLS_711362_z mosaic/CP/V4.3/CP20171219/k4m_171220_115719_ooi_zd_ls9.fits.fz ksb_180414_102039_ooi_g_ls9-CCD2 g expnum 82220135 exptime 126.731 propid BASS seeing 1.56 MJD 58222.431 object 45383 90prime/CP/V2.3/CP20180413/ksb_180414_102039_ooi_g_ls9.fits.fz ksb_180409_100254_ooi_r_ls9-CCD2 r expnum 82170165 exptime 139.44 propid BASS seeing 1.07 MJD 58217.419 object 45383 90prime/CP/V2.3/CP20180408/ksb_180409_100254_ooi_r_ls9.fits.fz ksb_180419_091052_ooi_r_ls9-CCD1 r expnum 82270146 exptime 116.098 propid BASS seeing 1.54 MJD 58227.383 object 44602 90prime/CP/V2.3/CP20180418/ksb_180419_091052_ooi_r_ls9.fits.fz ksb_170527_053201_ooi_g_ls9-CCD1 g expnum 79000057 exptime 163.493 propid 2015A-0801 seeing 1.84 MJD 57900.231 object 44602 90prime/CP/V2.3/CP20170526/ksb_170527_053201_ooi_g_ls9.fits.fz ksb_170623_070957_ooi_r_ls9-CCD4 r expnum 79270092 exptime 129.679 propid BASS seeing 1.35 MJD 57927.299 object 45381 90prime/CP/V2.3/CP20170622/ksb_170623_070957_ooi_r_ls9.fits.fz ksb_180415_081733_ooi_g_ls9-CCD4 g expnum 82230117 exptime 113.7 propid BASS seeing 1.53 MJD 58223.346 object 45381 90prime/CP/V2.3/CP20180414/ksb_180415_081733_ooi_g_ls9.fits.fz mosaic get_fwhm: self.fwhm = 5.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2370 2624 and amp range 2048 4095 and image y 377 629 and amp range 0 2039 Range in image: x 0 255 , y 0 253 (with image size 255 x 253) dzp 0.0044767857 -> scaling image by 1.004131784351374 mosaic get_fwhm: self.fwhm = 3.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1170 1419 and amp range 0 2005 and image y 3074 3321 and amp range 2040 4078 Range in image: x 0 250 , y 0 248 (with image size 250 x 248) dzp 0.014419514 -> scaling image by 1.0133694453441033 mosaic get_fwhm: self.fwhm = 3.53 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3909 4046 and amp range 2006 4053 and image y 3475 3721 and amp range 2040 4078 Range in image: x 0 138 , y 0 247 (with image size 138 x 247) dzp 0.0036595785 -> scaling image by 1.003376283213225 Faked up EXPNUM 82270146 Faked up EXPNUM 82270146 Faked up EXPNUM 82270146 90prime get_fwhm: self.fwhm = 3.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 220 368 and amp range 0 2015 and image y 1065 1211 and amp range 0 2047 Range in image: x 0 149 , y 0 147 (with image size 149 x 147) dzp -0.04811793 -> scaling image by 0.9566494556405901 Faked up EXPNUM 79000057 Faked up EXPNUM 79000057 Faked up EXPNUM 79000057 90prime get_fwhm: self.fwhm = 4.07 Found 4 relevant rows in amp-corrections file. Found overlap: image x 228 375 and amp range 0 2015 and image y 1057 1203 and amp range 0 2047 Range in image: x 0 148 , y 0 147 (with image size 148 x 147) dzp -0.023075538 -> scaling image by 0.9789709052881876 Faked up EXPNUM 79270092 Faked up EXPNUM 79270092 Faked up EXPNUM 79270092 90prime get_fwhm: self.fwhm = 2.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2103 2245 and amp range 2016 4031 and image y 828 970 and amp range 0 2047 Range in image: x 0 143 , y 0 143 (with image size 143 x 143) dzp 0.02499258 -> scaling image by 1.0232859986636875 Faked up EXPNUM 82170165 Faked up EXPNUM 82170165 Faked up EXPNUM 82170165 90prime get_fwhm: self.fwhm = 2.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 78 222 and amp range 0 2015 and image y 3318 3462 and amp range 2048 4095 Range in image: x 0 145 , y 0 145 (with image size 145 x 145) dzp 0.0503617 -> scaling image by 1.047477444828492 Faked up EXPNUM 82220135 Faked up EXPNUM 82220135 Faked up EXPNUM 82220135 90prime get_fwhm: self.fwhm = 3.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 71 215 and amp range 0 2015 and image y 3310 3454 and amp range 2048 4095 Range in image: x 0 145 , y 0 145 (with image size 145 x 145) dzp 0.0459271 -> scaling image by 1.0432078344950917 mosaic get_fwhm: self.fwhm = 5.55 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2394 2648 and amp range 2048 4095 and image y 3908 4054 and amp range 2022 4060 Range in image: x 0 255 , y 0 147 (with image size 255 x 147) dzp -0.02499645 -> scaling image by 0.9772404160512723 Faked up EXPNUM 82230117 Faked up EXPNUM 82230117 Faked up EXPNUM 82230117 90prime get_fwhm: self.fwhm = 3.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2105 2248 and amp range 2016 4031 and image y 821 963 and amp range 0 2047 Range in image: x 0 144 , y 0 143 (with image size 144 x 143) dzp 0.023266561 -> scaling image by 1.0216605511853067 Stage tims : Wall: 190.94 s, CPU: 1.02 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 173 MB, VmData: 206 MB, maxrss: 0.176764 MB Stage tims finished: 2020-08-07T09:43:10.614739 Resources for stage tims : 4.989 s worker CPU, 628.258 s worker Wall, Wall: 190.937 s, Cores in use: 0.03, Total efficiency (on 16 cores): 0.2 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/PGC2722838-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/PGC2722838-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T09:43:11.014426 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00457.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00458.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00399.fits Matched 3 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/metrics/cus/reference-custom-228435p68721.fits Stage refs : Wall: 9.98 s, CPU: 1.69 s, VmPeak: 982 MB, VmSize: 968 MB, VmRSS: 191 MB, VmData: 224 MB, maxrss: 0.1952 MB Stage refs finished: 2020-08-07T09:43:20.993892 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.981 s, Cores in use: 0.17, Total efficiency (on 16 cores): 1.1 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/PGC2722838-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/PGC2722838-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T09:43:21.048339 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/metrics/cus/outlier-mask-custom-228435p68721.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/metrics/cus/outliers-pre-custom-228435p68721.jpg Image ksb_170527_053201_ooi_g_ls9-CCD1 g : masking 675 positive outlier pixels and 0 negative outlier pixels Image ksb_180414_102039_ooi_g_ls9-CCD2 g : masking 482 positive outlier pixels and 0 negative outlier pixels Image ksb_180415_081733_ooi_g_ls9-CCD4 g : masking 814 positive outlier pixels and 0 negative outlier pixels Image k4m_170421_093702_ooi_zd_ls9-CCD2 z : masking 568 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/metrics/cus/outlier-mask-custom-228435p68721.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/metrics/cus/outliers-post-custom-228435p68721.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/metrics/cus/outliers-masked-pos-custom-228435p68721.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/metrics/cus/outliers-masked-neg-custom-228435p68721.jpg Stage outliers : Wall: 0.97 s, CPU: 0.69 s, VmPeak: 982 MB, VmSize: 978 MB, VmRSS: 205 MB, VmData: 235 MB, maxrss: 0.209704 MB Stage outliers finished: 2020-08-07T09:43:22.019984 Resources for stage outliers : 0.709 s worker CPU, 0.785 s worker Wall, Wall: 0.973 s, Cores in use: 1.44, Total efficiency (on 16 cores): 9.0 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/PGC2722838-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/PGC2722838-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T09:43:22.039932 Stage halos : Wall: 0.33 s, CPU: 0.32 s, VmPeak: 982 MB, VmSize: 978 MB, VmRSS: 205 MB, VmData: 235 MB, maxrss: 0.210024 MB Stage halos finished: 2020-08-07T09:43:22.371984 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.333 s, Cores in use: 0.98, Total efficiency (on 16 cores): 6.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/PGC2722838-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/PGC2722838-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-07T09:43:22.396310 PSF sigmas in coadd pixels: ['2.54', '2.99', '2.48'] Using average PSF sigma 2.6729262705873986 Gaussian PSF norm 0.10553781257568522 vs pixelized 0.08351557 average tim pixel scale / coadd scale: 1.730505361058216 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.75', '2.50', '2.19'] Using average PSF sigma 2.1423060628566613 Gaussian PSF norm 0.13167809990591095 vs pixelized 0.102383204 average tim pixel scale / coadd scale: 1.7300764683506074 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.26', '1.49', '2.34', '1.54'] Using average PSF sigma 1.906128656684468 Gaussian PSF norm 0.14799357366808366 vs pixelized 0.124153726 average tim pixel scale / coadd scale: 0.9910346314094193 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.16 s, CPU: 0.13 s, VmPeak: 982 MB, VmSize: 978 MB, VmRSS: 207 MB, VmData: 236 MB, maxrss: 0.212384 MB Stage fit_on_coadds finished: 2020-08-07T09:43:22.553848 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.172 s worker CPU, 0.172 s worker Wall, Wall: 0.159 s, Cores in use: 1.93, Total efficiency (on 16 cores): 12.1 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/PGC2722838-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/PGC2722838-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T09:43:22.562991 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 12 potential peaks Of 12 potential peaks: 3 in veto map, 2 cut by saddle test, 0 cut by aper test, 7 kept SED z : 7 new peaks Found 25 potential peaks Of 25 potential peaks: 21 in veto map, 2 cut by saddle test, 1 cut by aper test, 1 kept SED r : 1 new peaks Found 29 potential peaks Of 29 potential peaks: 23 in veto map, 6 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 41 potential peaks Of 41 potential peaks: 34 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 33 potential peaks Of 33 potential peaks: 28 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 9 new sources Median coadd sky for g : 0.00048121158 Median coadd sky for r : 0.00076073554 Median coadd sky for z : -0.00036996795 Stage srcs : Wall: 0.51 s, CPU: 0.47 s, VmPeak: 982 MB, VmSize: 978 MB, VmRSS: 208 MB, VmData: 236 MB, maxrss: 0.212804 MB Stage srcs finished: 2020-08-07T09:43:23.077795 Resources for stage srcs : 0.103 s worker CPU, 0.103 s worker Wall, Wall: 0.516 s, Cores in use: 1.12, Total efficiency (on 16 cores): 7.0 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/PGC2722838-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/PGC2722838-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T09:43:23.103423 Blob 1 of 5, id: 4, sources: 6, size: 239x164, npix 19969, brick X: 6,245, Y: 48,212, one pixel: 152 48 Blob 2 of 5, id: 1, sources: 3, size: 58x95, npix 3370, brick X: 187,245, Y: 0,95, one pixel: 207 0 Blob 3 of 5, id: 0, sources: 1, size: 32x22, npix 517, brick X: 115,147, Y: 0,22, one pixel: 120 0 Blob 4 of 5, id: 3, sources: 1, size: 28x26, npix 494, brick X: 23,51, Y: 44,70, one pixel: 34 44 Blob 5 of 5, id: 2, sources: 1, size: 14x23, npix 221, brick X: 0,14, Y: 35,58, one pixel: 2 35 Blob 4 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145728 MB Blob 3 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145916 MB Blob 5 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.145948 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (228.40372, 68.71042), pm (-24.3, 4.3), parallax 3.332 with NanoMaggies: g=11.9, r=11.5, z=11.4 Reset brightness to NanoMaggies: g=11.9, r=11.5, z=11.4 Blob 2 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 803 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.14524 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.943464, ee1=0.35632, ee2=0.354075 Measuring 6 iterative sources Blob 1 finished, total: Wall: 12.72 s, CPU: 12.71 s, VmPeak: 695 MB, VmSize: 690 MB, VmRSS: 120 MB, VmData: 158 MB, maxrss: 0.125648 MB Old catalog: 14 New catalog: 16 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/metrics/cus/blobs-custom-228435p68721.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/metrics/cus/all-models-custom-228435p68721.fits Stage fitblobs : Wall: 21.00 s, CPU: 0.34 s, VmPeak: 982 MB, VmSize: 976 MB, VmRSS: 206 MB, VmData: 234 MB, maxrss: 0.212968 MB Stage fitblobs finished: 2020-08-07T09:43:44.098463 Resources for stage fitblobs : 14.894 s worker CPU, 15.039 s worker Wall, Wall: 20.997 s, Cores in use: 0.73, Total efficiency (on 16 cores): 4.5 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/PGC2722838-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/PGC2722838-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T09:43:44.116713 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/tmp-legacysurvey-custom-228435p68721-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/tmp-legacysurvey-custom-228435p68721-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/tmp-legacysurvey-custom-228435p68721-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/tmp-legacysurvey-custom-228435p68721-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-resid.jpg Stage coadds : Wall: 4.53 s, CPU: 0.85 s, VmPeak: 982 MB, VmSize: 976 MB, VmRSS: 206 MB, VmData: 234 MB, maxrss: 0.212968 MB Stage coadds finished: 2020-08-07T09:43:48.642607 Resources for stage coadds : 8.341 s worker CPU, 8.877 s worker Wall, Wall: 4.527 s, Cores in use: 2.03, Total efficiency (on 16 cores): 12.7 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/PGC2722838-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/PGC2722838-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T09:43:48.698079 Cut to 1 unWISE tiles Reading WISE tile 2294p681 band 2 Reading WISE tile 2294p681 band 1 Reading WISE tile 2294p681 band 3 Reading WISE tile 2294p681 band 4 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 808 MB, VmSize: 797 MB, VmRSS: 140 MB, VmData: 171 MB, maxrss: 0.203432 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 805 MB, VmSize: 792 MB, VmRSS: 138 MB, VmData: 170 MB, maxrss: 0.19828 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 798 MB, VmSize: 798 MB, VmRSS: 143 MB, VmData: 176 MB, maxrss: 0.18462 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2294p681/unwise-2294p681-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 793 MB, VmSize: 793 MB, VmRSS: 137 MB, VmData: 171 MB, maxrss: 0.195616 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/tmp-legacysurvey-custom-228435p68721-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/tmp-legacysurvey-custom-228435p68721-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 44.67 s, CPU: 0.65 s, VmPeak: 982 MB, VmSize: 976 MB, VmRSS: 207 MB, VmData: 234 MB, maxrss: 0.212968 MB Stage wise_forced finished: 2020-08-07T09:44:33.368103 Resources for stage wise_forced : 2.902 s worker CPU, 83.609 s worker Wall, Wall: 44.672 s, Cores in use: 0.08, Total efficiency (on 16 cores): 0.5 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/PGC2722838-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/PGC2722838-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T09:44:33.401146 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/coadd/cus/custom-228435p68721/legacysurvey-custom-228435p68721-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/tractor-i/cus/tractor-custom-228435p68721.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/tractor/cus/tractor-custom-228435p68721.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/tractor/cus/brick-custom-228435p68721.sha256sum Stage writecat : Wall: 0.82 s, CPU: 0.52 s, VmPeak: 1109 MB, VmSize: 981 MB, VmRSS: 209 MB, VmData: 234 MB, maxrss: 0.345152 MB Stage writecat finished: 2020-08-07T09:44:34.224868 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.825 s, Cores in use: 0.63, Total efficiency (on 16 cores): 3.9 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/PGC2722838-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC2722838/PGC2722838-largegalaxy-writecat.p All done: 32.114 s worker CPU, 736.847 s worker Wall, Wall: 274.577 s, Cores in use: 0.14, Total efficiency (on 16 cores): 0.9 % Finished galaxy PGC2722838 in 4.620 minutes.