Started working on galaxy PGC1235329 at Wed Aug 5 20:22:47 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 253.463058 2.710222 --width 257 --height 257 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T20:22:48.329117 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '253.463058', '2.710222', '--width', '257', '--height', '257', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 253.463058 2.710222 --width 257 --height 257 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 253.463058 2.710222 Starting process 2977 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 3001 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 3003 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 3005 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 3007 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059484 MB Starting process 3009 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059432 MB Starting process 3010 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059432 MB Starting process 3013 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 3014 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 3016 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 3018 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 3020 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 3022 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 3024 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 3026 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 3028 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T20:22:50.067806 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 10 CCDs: c4d_180514_084552_ooi_g_ls9-N3 g expnum 746156 exptime 200.0 propid 2014B-0404 seeing 1.40 MJD 58252.365 object DECaLS_46861_g decam/CP/V4.8.2a/CP20180513/c4d_180514_084552_ooi_g_ls9.fits.fz c4d_190307_093135_ooi_z_ls9-N3 z expnum 830783 exptime 244.0 propid 2014B-0404 seeing 1.18 MJD 58549.397 object DECaLS_46861_z decam/CP/V4.8.2a/CP20190306/c4d_190307_093135_ooi_z_ls9.fits.fz c4d_170725_230721_ooi_z_ls9-N3 z expnum 662169 exptime 80.0 propid 2014B-0404 seeing 1.03 MJD 57959.962 object DECaLS_46861_z decam/CP/V4.8.2/CP20170725/c4d_170725_230721_ooi_z_ls9.fits.fz c4d_170721_021307_ooi_r_ls9-N3 r expnum 660393 exptime 125.0 propid 2014B-0404 seeing 1.01 MJD 57955.090 object DECaLS_46861_r decam/CP/V4.8.2/CP20170720/c4d_170721_021307_ooi_r_ls9.fits.fz c4d_160409_095740_ooi_z_ls9-N4 z expnum 535720 exptime 158.0 propid 2014B-0404 seeing 1.01 MJD 57487.413 object DECaLS_30989_z decam/CP/V4.8.2a/CP20160408/c4d_160409_095740_ooi_z_ls9.fits.fz c4d_160409_081123_ooi_r_ls9-N4 r expnum 535675 exptime 101.0 propid 2014B-0404 seeing 1.25 MJD 57487.339 object DECaLS_30989_r decam/CP/V4.8.2a/CP20160408/c4d_160409_081123_ooi_r_ls9.fits.fz c4d_160410_075204_ooi_g_ls9-N4 g expnum 536089 exptime 104.0 propid 2014B-0404 seeing 1.10 MJD 57488.326 object DECaLS_30989_g decam/CP/V4.8.2a/CP20160409/c4d_160410_075204_ooi_g_ls9.fits.fz c4d_160803_012647_ooi_g_ls9-N5 g expnum 558464 exptime 64.0 propid 2014B-0404 seeing 1.06 MJD 57603.059 object DECaLS_15117_g decam/CP/V4.8.2a/CP20160802/c4d_160803_012647_ooi_g_ls9.fits.fz c4d_160803_013435_ooi_r_ls9-N5 r expnum 558468 exptime 55.0 propid 2014B-0404 seeing 0.98 MJD 57603.064 object DECaLS_15117_r decam/CP/V4.8.2a/CP20160802/c4d_160803_013435_ooi_r_ls9.fits.fz c4d_160227_084801_ooi_z_ls9-N5 z expnum 520632 exptime 90.0 propid 2014B-0404 seeing 1.11 MJD 57445.365 object DECaLS_15117_z decam/CP/V4.8.2a/CP20160226/c4d_160227_084801_ooi_z_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95675e1-g-20160410T074926_oi[N4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9568098-r-20160803T013249_oi[N5,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170721T021008_oi[N3,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d4d0-z-20160409T095412_oi[N4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95b90ac-g-20160803T012452_oi[N5,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9519cdc-z-20170725T230507_oi[N3,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535707-z-20190307T093135_oi[N3,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95503fa-z-20160227T084539_oi[N5,noinherit][2046,4094][real]: DECaLS_1 Clipping 50 pixels with anomalously large oow values: max 0.0440191 vs median 0.00182517 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956e596-r-20160409T080846_oi[N4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f4fa-g-20180514T084552_oi[N3,noinherit][2046,4094][real]: DECaLS_4 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 24.91 s, CPU: 1.74 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 179 MB, VmData: 211 MB, maxrss: 0.18284 MB Stage tims finished: 2020-08-05T20:23:14.979490 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9568098-r-20160803T013249_oi[N5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d4d0-z-20160409T095412_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9519cdc-z-20170725T230507_oi[N3,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f4fa-g-20180514T084552_oi[N3,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95b90ac-g-20160803T012452_oi[N5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535707-z-20190307T093135_oi[N3,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 6.155 s worker CPU, 191.101 s worker Wall, Wall: 24.913 s, Cores in use: 0.32, Total efficiency (on 16 cores): 2.0 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95675e1-g-20160410T074926_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170721T021008_oi[N3,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95503fa-z-20160227T084539_oi[N5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956e596-r-20160409T080846_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T20:23:15.214311 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05913.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05914.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05786.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06042.fits Matched 5 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/metrics/cus/reference-custom-253463p02710.fits Stage refs : Wall: 10.49 s, CPU: 7.31 s, VmPeak: 1105 MB, VmSize: 1099 MB, VmRSS: 269 MB, VmData: 299 MB, maxrss: 0.275864 MB Stage refs finished: 2020-08-05T20:23:25.703337 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 10.490 s, Cores in use: 0.70, Total efficiency (on 16 cores): 4.4 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T20:23:25.864994 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/metrics/cus/outlier-mask-custom-253463p02710.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/metrics/cus/outliers-pre-custom-253463p02710.jpg Image c4d_160803_012647_ooi_g_ls9-N5 g : masking 417 positive outlier pixels and 0 negative outlier pixels Image c4d_170721_021307_ooi_r_ls9-N3 r : masking 393 positive outlier pixels and 0 negative outlier pixels Image c4d_170725_230721_ooi_z_ls9-N3 z : masking 100 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/metrics/cus/outlier-mask-custom-253463p02710.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/metrics/cus/outliers-post-custom-253463p02710.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/metrics/cus/outliers-masked-pos-custom-253463p02710.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/metrics/cus/outliers-masked-neg-custom-253463p02710.jpg Stage outliers : Wall: 2.02 s, CPU: 1.64 s, VmPeak: 1109 MB, VmSize: 1109 MB, VmRSS: 283 MB, VmData: 310 MB, maxrss: 0.290012 MB Stage outliers finished: 2020-08-05T20:23:27.883899 Resources for stage outliers : 0.818 s worker CPU, 0.898 s worker Wall, Wall: 2.020 s, Cores in use: 1.22, Total efficiency (on 16 cores): 7.6 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T20:23:28.044449 Stage halos : Wall: 1.24 s, CPU: 0.89 s, VmPeak: 1109 MB, VmSize: 1109 MB, VmRSS: 283 MB, VmData: 310 MB, maxrss: 0.290288 MB Stage halos finished: 2020-08-05T20:23:29.279965 Resources for stage halos : 0.947 s worker CPU, 1.918 s worker Wall, Wall: 1.237 s, Cores in use: 1.48, Total efficiency (on 16 cores): 9.3 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T20:23:29.317293 PSF sigmas in coadd pixels: ['2.27', '1.79', '1.72'] Using average PSF sigma 1.9250801098756554 Gaussian PSF norm 0.1465366507745484 vs pixelized 0.119098395 average tim pixel scale / coadd scale: 1.0011405199730612 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.64', '2.03', '1.60'] Using average PSF sigma 1.7545606205960944 Gaussian PSF norm 0.1607780252574227 vs pixelized 0.12949151 average tim pixel scale / coadd scale: 1.0010894327531106 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.92', '1.68', '1.64', '1.81'] Using average PSF sigma 1.7611878746284026 Gaussian PSF norm 0.16017302630668975 vs pixelized 0.12653051 average tim pixel scale / coadd scale: 1.0011328802175663 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.22 s, CPU: 0.16 s, VmPeak: 1109 MB, VmSize: 1109 MB, VmRSS: 286 MB, VmData: 311 MB, maxrss: 0.292412 MB Stage fit_on_coadds finished: 2020-08-05T20:23:29.535197 Resources for stage fit_on_coadds : 0.178 s worker CPU, 0.178 s worker Wall, Wall: 0.219 s, Cores in use: 1.53, Total efficiency (on 16 cores): 9.6 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T20:23:29.578500 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 76 potential peaks Of 76 potential peaks: 43 in veto map, 8 cut by saddle test, 0 cut by aper test, 25 kept SED z : 25 new peaks Found 84 potential peaks Of 84 potential peaks: 73 in veto map, 10 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 71 potential peaks Of 71 potential peaks: 62 in veto map, 7 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 85 potential peaks Of 85 potential peaks: 72 in veto map, 9 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 99 potential peaks Of 99 potential peaks: 86 in veto map, 11 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 34 new sources Median coadd sky for g : 3.625091e-05 Median coadd sky for r : 0.00013389745 Median coadd sky for z : 0.0009334696 Stage srcs : Wall: 1.17 s, CPU: 1.13 s, VmPeak: 1109 MB, VmSize: 1109 MB, VmRSS: 286 MB, VmData: 311 MB, maxrss: 0.293188 MB Stage srcs finished: 2020-08-05T20:23:30.744769 Resources for stage srcs : 0.069 s worker CPU, 0.069 s worker Wall, Wall: 1.168 s, Cores in use: 1.02, Total efficiency (on 16 cores): 6.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T20:23:30.759040 Blob 1 of 11, id: 1, sources: 28, size: 224x257, npix 32087, brick X: 13,237, Y: 0,257, one pixel: 90 0 Blob 2 of 11, id: 0, sources: 4, size: 37x48, npix 1131, brick X: 0,37, Y: 0,48, one pixel: 0 0 Blob 3 of 11, id: 5, sources: 3, size: 41x42, npix 1041, brick X: 216,257, Y: 128,170, one pixel: 227 128 Blob 4 of 11, id: 9, sources: 2, size: 34x36, npix 774, brick X: 14,48, Y: 221,257, one pixel: 23 221 Blob 5 of 11, id: 7, sources: 1, size: 31x31, npix 648, brick X: 185,216, Y: 193,224, one pixel: 197 193 Blob 6 of 11, id: 3, sources: 2, size: 36x29, npix 646, brick X: 221,257, Y: 0,29, one pixel: 246 0 Blob 7 of 11, id: 2, sources: 1, size: 33x29, npix 622, brick X: 166,199, Y: 0,29, one pixel: 176 0 Blob 8 of 11, id: 8, sources: 1, size: 25x24, npix 337, brick X: 170,195, Y: 216,240, one pixel: 183 216 Blob 9 of 11, id: 6, sources: 1, size: 22x22, npix 304, brick X: 208,230, Y: 176,198, one pixel: 217 176 Blob 10 of 11, id: 4, sources: 1, size: 19x19, npix 217, brick X: 11,30, Y: 93,112, one pixel: 19 93 Blob 11 of 11, id: 10, sources: 1, size: 18x15, npix 162, brick X: 228,246, Y: 242,257, one pixel: 236 242 Blob 9 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.11454 MB Measuring 1 iterative sources Blob 8 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 959 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.14994 MB Blob 10 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 113 MB, VmData: 166 MB, maxrss: 0.115224 MB Blob 11 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 957 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147596 MB Blob 5 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 963 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148448 MB Blob 6 finished, total: Wall: 0.95 s, CPU: 0.95 s, VmPeak: 962 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147596 MB Blob 7 finished, total: Wall: 1.06 s, CPU: 1.06 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 113 MB, VmData: 166 MB, maxrss: 0.115252 MB Blob 4 finished, total: Wall: 1.12 s, CPU: 1.12 s, VmPeak: 952 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149844 MB Blob 3 finished, total: Wall: 2.17 s, CPU: 2.17 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148964 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (253.47402, 2.70251), pm (5.8, -0.9), parallax 1.059 with NanoMaggies: g=15.8, r=14.9, z=14.8 Reset brightness to NanoMaggies: g=15.8, r=15.1, z=14.8 Measuring 1 iterative sources Blob 2 finished, total: Wall: 2.97 s, CPU: 2.96 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 95 MB, VmData: 140 MB, maxrss: 0.096808 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.57684, ee1=0.0513914, ee2=0.106064 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (253.46643, 2.72446), pm (0.9, -4.7), parallax 0.207 with NanoMaggies: g=17.8, r=17.3, z=17.2 Reset brightness to NanoMaggies: g=17.8, r=17.3, z=17.2 Measuring 5 iterative sources Blob 1 finished, total: Wall: 24.75 s, CPU: 24.75 s, VmPeak: 716 MB, VmSize: 692 MB, VmRSS: 127 MB, VmData: 163 MB, maxrss: 0.15508 MB Old catalog: 54 New catalog: 48 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/metrics/cus/blobs-custom-253463p02710.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/metrics/cus/all-models-custom-253463p02710.fits Stage fitblobs : Wall: 25.52 s, CPU: 0.69 s, VmPeak: 1109 MB, VmSize: 1109 MB, VmRSS: 288 MB, VmData: 313 MB, maxrss: 0.294408 MB Stage fitblobs finished: 2020-08-05T20:23:56.280437 Resources for stage fitblobs : 35.530 s worker CPU, 35.671 s worker Wall, Wall: 25.523 s, Cores in use: 1.42, Total efficiency (on 16 cores): 8.9 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T20:23:56.306882 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/tmp-legacysurvey-custom-253463p02710-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/tmp-legacysurvey-custom-253463p02710-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/tmp-legacysurvey-custom-253463p02710-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/tmp-legacysurvey-custom-253463p02710-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-resid.jpg Stage coadds : Wall: 4.24 s, CPU: 2.04 s, VmPeak: 1109 MB, VmSize: 1109 MB, VmRSS: 288 MB, VmData: 313 MB, maxrss: 0.294736 MB Stage coadds finished: 2020-08-05T20:24:00.544088 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 10.693 s worker CPU, 17.449 s worker Wall, Wall: 4.239 s, Cores in use: 3.00, Total efficiency (on 16 cores): 18.8 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T20:24:00.563558 Cut to 1 unWISE tiles Reading WISE tile 2541p030 band 2 Reading WISE tile 2541p030 band 3 Reading WISE tile 2541p030 band 1 Reading WISE tile 2541p030 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 959 MB, VmSize: 809 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.211628 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 950 MB, VmSize: 805 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.206556 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 810 MB, VmSize: 810 MB, VmRSS: 155 MB, VmData: 178 MB, maxrss: 0.199412 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 956 MB, VmSize: 805 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.20718 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/tmp-legacysurvey-custom-253463p02710-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/tmp-legacysurvey-custom-253463p02710-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 4.21 s, CPU: 1.17 s, VmPeak: 1109 MB, VmSize: 1109 MB, VmRSS: 288 MB, VmData: 313 MB, maxrss: 0.295248 MB Stage wise_forced finished: 2020-08-05T20:24:04.769307 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.305 s worker CPU, 7.588 s worker Wall, Wall: 4.207 s, Cores in use: 1.06, Total efficiency (on 16 cores): 6.6 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T20:24:04.784921 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/tractor-i/cus/tractor-custom-253463p02710.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/tractor/cus/tractor-custom-253463p02710.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/tractor/cus/brick-custom-253463p02710.sha256sum Stage writecat : Wall: 2.07 s, CPU: 1.20 s, VmPeak: 1241 MB, VmSize: 1113 MB, VmRSS: 290 MB, VmData: 313 MB, maxrss: 0.428124 MB Stage writecat finished: 2020-08-05T20:24:06.859567 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.076 s, Cores in use: 0.58, Total efficiency (on 16 cores): 3.6 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-writecat.p All done: 57.698 s worker CPU, 254.874 s worker Wall, Wall: 76.815 s, Cores in use: 0.99, Total efficiency (on 16 cores): 6.2 % Finished galaxy PGC1235329 in 1.338 minutes. Started working on galaxy PGC1235329 at Wed Aug 5 21:30:15 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 253.463058 2.710222 --width 257 --height 257 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T21:30:16.305165 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '253.463058', '2.710222', '--width', '257', '--height', '257', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 253.463058 2.710222 --width 257 --height 257 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 253.463058 2.710222 Starting process 15590 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 15591 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 15592 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 15593 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 15594 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059488 MB Starting process 15595 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059496 MB Starting process 15596 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059496 MB Starting process 15597 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 15598 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 15599 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 15600 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 15601 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 15602 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 15603 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 15604 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 15605 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 15606 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 15607 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 15608 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 15609 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 15610 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 15611 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 15612 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 15613 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 15614 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 15615 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 15616 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 15617 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 15618 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB Starting process 15619 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB Starting process 15620 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB Starting process 15621 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05932 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T21:30:18.301778 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 10 CCDs: c4d_180514_084552_ooi_g_ls9-N3 g expnum 746156 exptime 200.0 propid 2014B-0404 seeing 1.40 MJD 58252.365 object DECaLS_46861_g decam/CP/V4.8.2a/CP20180513/c4d_180514_084552_ooi_g_ls9.fits.fz c4d_190307_093135_ooi_z_ls9-N3 z expnum 830783 exptime 244.0 propid 2014B-0404 seeing 1.18 MJD 58549.397 object DECaLS_46861_z decam/CP/V4.8.2a/CP20190306/c4d_190307_093135_ooi_z_ls9.fits.fz c4d_170725_230721_ooi_z_ls9-N3 z expnum 662169 exptime 80.0 propid 2014B-0404 seeing 1.03 MJD 57959.962 object DECaLS_46861_z decam/CP/V4.8.2/CP20170725/c4d_170725_230721_ooi_z_ls9.fits.fz c4d_170721_021307_ooi_r_ls9-N3 r expnum 660393 exptime 125.0 propid 2014B-0404 seeing 1.01 MJD 57955.090 object DECaLS_46861_r decam/CP/V4.8.2/CP20170720/c4d_170721_021307_ooi_r_ls9.fits.fz c4d_160409_095740_ooi_z_ls9-N4 z expnum 535720 exptime 158.0 propid 2014B-0404 seeing 1.01 MJD 57487.413 object DECaLS_30989_z decam/CP/V4.8.2a/CP20160408/c4d_160409_095740_ooi_z_ls9.fits.fz c4d_160409_081123_ooi_r_ls9-N4 r expnum 535675 exptime 101.0 propid 2014B-0404 seeing 1.25 MJD 57487.339 object DECaLS_30989_r decam/CP/V4.8.2a/CP20160408/c4d_160409_081123_ooi_r_ls9.fits.fz c4d_160410_075204_ooi_g_ls9-N4 g expnum 536089 exptime 104.0 propid 2014B-0404 seeing 1.10 MJD 57488.326 object DECaLS_30989_g decam/CP/V4.8.2a/CP20160409/c4d_160410_075204_ooi_g_ls9.fits.fz c4d_160803_012647_ooi_g_ls9-N5 g expnum 558464 exptime 64.0 propid 2014B-0404 seeing 1.06 MJD 57603.059 object DECaLS_15117_g decam/CP/V4.8.2a/CP20160802/c4d_160803_012647_ooi_g_ls9.fits.fz c4d_160803_013435_ooi_r_ls9-N5 r expnum 558468 exptime 55.0 propid 2014B-0404 seeing 0.98 MJD 57603.064 object DECaLS_15117_r decam/CP/V4.8.2a/CP20160802/c4d_160803_013435_ooi_r_ls9.fits.fz c4d_160227_084801_ooi_z_ls9-N5 z expnum 520632 exptime 90.0 propid 2014B-0404 seeing 1.11 MJD 57445.365 object DECaLS_15117_z decam/CP/V4.8.2a/CP20160226/c4d_160227_084801_ooi_z_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9519cdc-z-20170725T230507_oi[N3,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95503fa-z-20160227T084539_oi[N5,noinherit][2046,4094][real]: DECaLS_1 Clipping 50 pixels with anomalously large oow values: max 0.0440191 vs median 0.00182517 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95675e1-g-20160410T074926_oi[N4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d4d0-z-20160409T095412_oi[N4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956e596-r-20160409T080846_oi[N4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535707-z-20190307T093135_oi[N3,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f4fa-g-20180514T084552_oi[N3,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9568098-r-20160803T013249_oi[N5,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170721T021008_oi[N3,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95b90ac-g-20160803T012452_oi[N5,noinherit][2046,4094][real]: DECaLS_1 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 68.80 s, CPU: 2.57 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 179 MB, VmData: 211 MB, maxrss: 0.182956 MB Stage tims finished: 2020-08-05T21:31:27.102801 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95503fa-z-20160227T084539_oi[N5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9519cdc-z-20170725T230507_oi[N3,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f4fa-g-20180514T084552_oi[N3,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d4d0-z-20160409T095412_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9568098-r-20160803T013249_oi[N5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95675e1-g-20160410T074926_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170721T021008_oi[N3,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956e596-r-20160409T080846_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95b90ac-g-20160803T012452_oi[N5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 5.914 s worker CPU, 615.225 s worker Wall, Wall: 68.804 s, Cores in use: 0.12, Total efficiency (on 32 cores): 0.4 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535707-z-20190307T093135_oi[N3,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T21:31:27.281807 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05913.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05914.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05786.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06042.fits Matched 5 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/metrics/cus/reference-custom-253463p02710.fits Stage refs : Wall: 17.92 s, CPU: 8.43 s, VmPeak: 1105 MB, VmSize: 1099 MB, VmRSS: 270 MB, VmData: 299 MB, maxrss: 0.276368 MB Stage refs finished: 2020-08-05T21:31:45.202616 Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 17.923 s, Cores in use: 0.47, Total efficiency (on 32 cores): 1.5 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T21:31:45.341152 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/metrics/cus/outlier-mask-custom-253463p02710.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/metrics/cus/outliers-pre-custom-253463p02710.jpg Image c4d_160803_012647_ooi_g_ls9-N5 g : masking 417 positive outlier pixels and 0 negative outlier pixels Image c4d_170721_021307_ooi_r_ls9-N3 r : masking 393 positive outlier pixels and 0 negative outlier pixels Image c4d_170725_230721_ooi_z_ls9-N3 z : masking 100 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/metrics/cus/outlier-mask-custom-253463p02710.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/metrics/cus/outliers-post-custom-253463p02710.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/metrics/cus/outliers-masked-pos-custom-253463p02710.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/metrics/cus/outliers-masked-neg-custom-253463p02710.jpg Stage outliers : Wall: 3.44 s, CPU: 2.29 s, VmPeak: 1109 MB, VmSize: 1109 MB, VmRSS: 282 MB, VmData: 309 MB, maxrss: 0.289212 MB Stage outliers finished: 2020-08-05T21:31:48.781781 Resources for stage outliers : 0.914 s worker CPU, 1.106 s worker Wall, Wall: 3.443 s, Cores in use: 0.93, Total efficiency (on 32 cores): 2.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T21:31:48.808438 Stage halos : Wall: 2.26 s, CPU: 2.00 s, VmPeak: 1109 MB, VmSize: 1109 MB, VmRSS: 283 MB, VmData: 309 MB, maxrss: 0.289312 MB Stage halos finished: 2020-08-05T21:31:51.072213 Resources for stage halos : 1.025 s worker CPU, 1.722 s worker Wall, Wall: 2.266 s, Cores in use: 1.34, Total efficiency (on 32 cores): 4.2 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T21:31:51.978287 PSF sigmas in coadd pixels: ['2.27', '1.79', '1.72'] Using average PSF sigma 1.9250801098756554 Gaussian PSF norm 0.1465366507745484 vs pixelized 0.119098395 average tim pixel scale / coadd scale: 1.0011405199730612 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.64', '2.03', '1.60'] Using average PSF sigma 1.7545606205960944 Gaussian PSF norm 0.1607780252574227 vs pixelized 0.12949151 average tim pixel scale / coadd scale: 1.0010894327531106 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.92', '1.68', '1.64', '1.81'] Using average PSF sigma 1.7611878746284026 Gaussian PSF norm 0.16017302630668975 vs pixelized 0.12653051 average tim pixel scale / coadd scale: 1.0011328802175663 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.17 s, CPU: 0.16 s, VmPeak: 1109 MB, VmSize: 1109 MB, VmRSS: 285 MB, VmData: 310 MB, maxrss: 0.29164 MB Stage fit_on_coadds finished: 2020-08-05T21:31:52.147933 Resources for stage fit_on_coadds : 0.193 s worker CPU, 0.193 s worker Wall, Wall: 0.172 s, Cores in use: 2.09, Total efficiency (on 32 cores): 6.5 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T21:31:52.159593 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 76 potential peaks Of 76 potential peaks: 43 in veto map, 8 cut by saddle test, 0 cut by aper test, 25 kept SED z : 25 new peaks Found 84 potential peaks Of 84 potential peaks: 73 in veto map, 10 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 71 potential peaks Of 71 potential peaks: 62 in veto map, 7 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 85 potential peaks Of 85 potential peaks: 72 in veto map, 9 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 99 potential peaks Of 99 potential peaks: 86 in veto map, 11 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 34 new sources Median coadd sky for g : 3.625091e-05 Median coadd sky for r : 0.00013389745 Median coadd sky for z : 0.0009334696 Stage srcs : Wall: 1.39 s, CPU: 1.36 s, VmPeak: 1109 MB, VmSize: 1109 MB, VmRSS: 285 MB, VmData: 310 MB, maxrss: 0.292212 MB Stage srcs finished: 2020-08-05T21:31:53.550774 Resources for stage srcs : 0.080 s worker CPU, 0.080 s worker Wall, Wall: 1.393 s, Cores in use: 1.03, Total efficiency (on 32 cores): 3.2 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T21:31:53.566653 Blob 1 of 11, id: 1, sources: 28, size: 224x257, npix 32087, brick X: 13,237, Y: 0,257, one pixel: 90 0 Blob 2 of 11, id: 0, sources: 4, size: 37x48, npix 1131, brick X: 0,37, Y: 0,48, one pixel: 0 0 Blob 3 of 11, id: 5, sources: 3, size: 41x42, npix 1041, brick X: 216,257, Y: 128,170, one pixel: 227 128 Blob 4 of 11, id: 9, sources: 2, size: 34x36, npix 774, brick X: 14,48, Y: 221,257, one pixel: 23 221 Blob 5 of 11, id: 7, sources: 1, size: 31x31, npix 648, brick X: 185,216, Y: 193,224, one pixel: 197 193 Blob 6 of 11, id: 3, sources: 2, size: 36x29, npix 646, brick X: 221,257, Y: 0,29, one pixel: 246 0 Blob 7 of 11, id: 2, sources: 1, size: 33x29, npix 622, brick X: 166,199, Y: 0,29, one pixel: 176 0 Blob 8 of 11, id: 8, sources: 1, size: 25x24, npix 337, brick X: 170,195, Y: 216,240, one pixel: 183 216 Blob 9 of 11, id: 6, sources: 1, size: 22x22, npix 304, brick X: 208,230, Y: 176,198, one pixel: 217 176 Blob 10 of 11, id: 4, sources: 1, size: 19x19, npix 217, brick X: 11,30, Y: 93,112, one pixel: 19 93 Blob 11 of 11, id: 10, sources: 1, size: 18x15, npix 162, brick X: 228,246, Y: 242,257, one pixel: 236 242 Blob 10 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 959 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150052 MB Blob 9 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.096812 MB Measuring 1 iterative sources Blob 8 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 112 MB, VmData: 166 MB, maxrss: 0.115084 MB Blob 11 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 952 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147564 MB Blob 5 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 954 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147672 MB Blob 6 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 950 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149148 MB Blob 7 finished, total: Wall: 0.88 s, CPU: 0.88 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 93 MB, VmData: 141 MB, maxrss: 0.094968 MB Blob 4 finished, total: Wall: 1.13 s, CPU: 1.13 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.1148 MB Blob 3 finished, total: Wall: 2.07 s, CPU: 2.07 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 93 MB, VmData: 141 MB, maxrss: 0.095156 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (253.47402, 2.70251), pm (5.8, -0.9), parallax 1.059 with NanoMaggies: g=15.8, r=14.9, z=14.8 Reset brightness to NanoMaggies: g=15.8, r=15.1, z=14.8 Measuring 1 iterative sources Blob 2 finished, total: Wall: 2.97 s, CPU: 2.95 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 94 MB, VmData: 139 MB, maxrss: 0.096284 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.57684, ee1=0.0513913, ee2=0.106064 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (253.46643, 2.72446), pm (0.9, -4.7), parallax 0.207 with NanoMaggies: g=17.8, r=17.3, z=17.2 Reset brightness to NanoMaggies: g=17.8, r=17.3, z=17.2 Measuring 5 iterative sources Blob 1 finished, total: Wall: 25.86 s, CPU: 25.85 s, VmPeak: 717 MB, VmSize: 692 MB, VmRSS: 125 MB, VmData: 164 MB, maxrss: 0.151756 MB Old catalog: 54 New catalog: 48 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/metrics/cus/blobs-custom-253463p02710.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/metrics/cus/all-models-custom-253463p02710.fits Stage fitblobs : Wall: 28.24 s, CPU: 2.13 s, VmPeak: 1109 MB, VmSize: 1109 MB, VmRSS: 287 MB, VmData: 312 MB, maxrss: 0.293432 MB Stage fitblobs finished: 2020-08-05T21:32:21.808371 Resources for stage fitblobs : 35.960 s worker CPU, 36.820 s worker Wall, Wall: 28.244 s, Cores in use: 1.35, Total efficiency (on 32 cores): 4.2 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T21:32:21.825233 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/tmp-legacysurvey-custom-253463p02710-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/tmp-legacysurvey-custom-253463p02710-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/tmp-legacysurvey-custom-253463p02710-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/tmp-legacysurvey-custom-253463p02710-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-resid.jpg Stage coadds : Wall: 3.38 s, CPU: 1.04 s, VmPeak: 1109 MB, VmSize: 1109 MB, VmRSS: 287 MB, VmData: 312 MB, maxrss: 0.29376 MB Stage coadds finished: 2020-08-05T21:32:25.203469 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 28.003 s worker CPU, 47.190 s worker Wall, Wall: 3.381 s, Cores in use: 8.59, Total efficiency (on 32 cores): 26.8 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T21:32:25.220413 Cut to 1 unWISE tiles Reading WISE tile 2541p030 band 1 Reading WISE tile 2541p030 band 2 Reading WISE tile 2541p030 band 3 Reading WISE tile 2541p030 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 957 MB, VmSize: 805 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.206784 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 957 MB, VmSize: 805 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.206808 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 959 MB, VmSize: 809 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.211576 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 952 MB, VmSize: 812 MB, VmRSS: 151 MB, VmData: 177 MB, maxrss: 0.1976 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/tmp-legacysurvey-custom-253463p02710-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/tmp-legacysurvey-custom-253463p02710-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 5.86 s, CPU: 1.22 s, VmPeak: 1109 MB, VmSize: 1109 MB, VmRSS: 287 MB, VmData: 312 MB, maxrss: 0.294272 MB Stage wise_forced finished: 2020-08-05T21:32:31.080097 Resources for stage wise_forced : 3.006 s worker CPU, 10.213 s worker Wall, Wall: 5.862 s, Cores in use: 0.72, Total efficiency (on 32 cores): 2.3 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T21:32:31.096633 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/coadd/cus/custom-253463p02710/legacysurvey-custom-253463p02710-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/tractor-i/cus/tractor-custom-253463p02710.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/tractor/cus/tractor-custom-253463p02710.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/tractor/cus/brick-custom-253463p02710.sha256sum Stage writecat : Wall: 1.50 s, CPU: 1.34 s, VmPeak: 1241 MB, VmSize: 1113 MB, VmRSS: 289 MB, VmData: 312 MB, maxrss: 0.427148 MB Stage writecat finished: 2020-08-05T21:32:32.594899 Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 1.501 s, Cores in use: 0.89, Total efficiency (on 32 cores): 2.8 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC1235329/PGC1235329-largegalaxy-writecat.p All done: 75.101 s worker CPU, 712.556 s worker Wall, Wall: 134.321 s, Cores in use: 0.73, Total efficiency (on 32 cores): 2.3 % Finished galaxy PGC1235329 in 2.298 minutes. Started working on galaxy PGC1235329 at Mon Aug 10 08:42:31 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 253.46281257869296 2.710217946552633 --width 257 --height 257 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/PGC1235329-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/PGC1235329-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-10T08:42:32.068413 legacypipe git version: DR9.5.11-watershed-6-g6a2880fc Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '253.46281257869296', '2.710217946552633', '--width', '257', '--height', '257', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/PGC1235329-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/PGC1235329-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 253.46281257869296 2.710217946552633 --width 257 --height 257 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/PGC1235329-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/PGC1235329-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 253.46281257869296 2.710217946552633 Starting process 54237 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB Starting process 54238 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 54239 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 54240 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 54241 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059392 MB Starting process 54242 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05934 MB Starting process 54243 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05934 MB Starting process 54244 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-10T08:42:32.562859 Keeping 10 CCDs: c4d_180514_084552_ooi_g_ls9-N3 g expnum 746156 exptime 200.0 propid 2014B-0404 seeing 1.40 MJD 58252.365 object DECaLS_46861_g decam/CP/V4.8.2a/CP20180513/c4d_180514_084552_ooi_g_ls9.fits.fz c4d_190307_093135_ooi_z_ls9-N3 z expnum 830783 exptime 244.0 propid 2014B-0404 seeing 1.18 MJD 58549.397 object DECaLS_46861_z decam/CP/V4.8.2a/CP20190306/c4d_190307_093135_ooi_z_ls9.fits.fz c4d_170725_230721_ooi_z_ls9-N3 z expnum 662169 exptime 80.0 propid 2014B-0404 seeing 1.03 MJD 57959.962 object DECaLS_46861_z decam/CP/V4.8.2/CP20170725/c4d_170725_230721_ooi_z_ls9.fits.fz c4d_170721_021307_ooi_r_ls9-N3 r expnum 660393 exptime 125.0 propid 2014B-0404 seeing 1.01 MJD 57955.090 object DECaLS_46861_r decam/CP/V4.8.2/CP20170720/c4d_170721_021307_ooi_r_ls9.fits.fz c4d_160409_095740_ooi_z_ls9-N4 z expnum 535720 exptime 158.0 propid 2014B-0404 seeing 1.01 MJD 57487.413 object DECaLS_30989_z decam/CP/V4.8.2a/CP20160408/c4d_160409_095740_ooi_z_ls9.fits.fz c4d_160409_081123_ooi_r_ls9-N4 r expnum 535675 exptime 101.0 propid 2014B-0404 seeing 1.25 MJD 57487.339 object DECaLS_30989_r decam/CP/V4.8.2a/CP20160408/c4d_160409_081123_ooi_r_ls9.fits.fz c4d_160410_075204_ooi_g_ls9-N4 g expnum 536089 exptime 104.0 propid 2014B-0404 seeing 1.10 MJD 57488.326 object DECaLS_30989_g decam/CP/V4.8.2a/CP20160409/c4d_160410_075204_ooi_g_ls9.fits.fz c4d_160803_012647_ooi_g_ls9-N5 g expnum 558464 exptime 64.0 propid 2014B-0404 seeing 1.06 MJD 57603.059 object DECaLS_15117_g decam/CP/V4.8.2a/CP20160802/c4d_160803_012647_ooi_g_ls9.fits.fz c4d_160803_013435_ooi_r_ls9-N5 r expnum 558468 exptime 55.0 propid 2014B-0404 seeing 0.98 MJD 57603.064 object DECaLS_15117_r decam/CP/V4.8.2a/CP20160802/c4d_160803_013435_ooi_r_ls9.fits.fz c4d_160227_084801_ooi_z_ls9-N5 z expnum 520632 exptime 90.0 propid 2014B-0404 seeing 1.11 MJD 57445.365 object DECaLS_15117_z decam/CP/V4.8.2a/CP20160226/c4d_160227_084801_ooi_z_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956e596-r-20160409T080846_oi[N4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95b90ac-g-20160803T012452_oi[N5,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95675e1-g-20160410T074926_oi[N4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f4fa-g-20180514T084552_oi[N3,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d4d0-z-20160409T095412_oi[N4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170721T021008_oi[N3,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9519cdc-z-20170725T230507_oi[N3,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535707-z-20190307T093135_oi[N3,noinherit][2046,4094][real]: DECaLS_4 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9568098-r-20160803T013249_oi[N5,noinherit][2046,4094][real]: DECaLS_1 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95503fa-z-20160227T084539_oi[N5,noinherit][2046,4094][real]: DECaLS_1 Clipping 52 pixels with anomalously large oow values: max 0.0440191 vs median 0.00182517 Stage tims : Wall: 42.28 s, CPU: 0.97 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 176 MB, VmData: 210 MB, maxrss: 0.180688 MB Stage tims finished: 2020-08-10T08:43:14.847427 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f4fa-g-20180514T084552_oi[N3,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956e596-r-20160409T080846_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d4d0-z-20160409T095412_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170721T021008_oi[N3,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535707-z-20190307T093135_oi[N3,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9519cdc-z-20170725T230507_oi[N3,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95675e1-g-20160410T074926_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9568098-r-20160803T013249_oi[N5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95b90ac-g-20160803T012452_oi[N5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95503fa-z-20160227T084539_oi[N5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] Resources for stage tims : 5.413 s worker CPU, 243.133 s worker Wall, Wall: 42.286 s, Cores in use: 0.15, Total efficiency (on 8 cores): 1.9 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/PGC1235329-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/PGC1235329-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-10T08:43:14.877824 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05913.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05914.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05786.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06042.fits Matched 5 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/metrics/cus/reference-custom-253462p02710.fits Stage refs : Wall: 16.52 s, CPU: 8.67 s, VmPeak: 1099 MB, VmSize: 1093 MB, VmRSS: 268 MB, VmData: 298 MB, maxrss: 0.274068 MB Stage refs finished: 2020-08-10T08:43:31.397548 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 16.521 s, Cores in use: 0.52, Total efficiency (on 8 cores): 6.6 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/PGC1235329-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/PGC1235329-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-10T08:43:31.519200 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/metrics/cus/outlier-mask-custom-253462p02710.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/metrics/cus/outliers-pre-custom-253462p02710.jpg Image c4d_160803_012647_ooi_g_ls9-N5 g : masking 426 positive outlier pixels and 0 negative outlier pixels Image c4d_170721_021307_ooi_r_ls9-N3 r : masking 402 positive outlier pixels and 0 negative outlier pixels Image c4d_170725_230721_ooi_z_ls9-N3 z : masking 110 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/metrics/cus/outlier-mask-custom-253462p02710.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/metrics/cus/outliers-post-custom-253462p02710.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/metrics/cus/outliers-masked-pos-custom-253462p02710.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/metrics/cus/outliers-masked-neg-custom-253462p02710.jpg Stage outliers : Wall: 0.87 s, CPU: 0.67 s, VmPeak: 1102 MB, VmSize: 1102 MB, VmRSS: 281 MB, VmData: 310 MB, maxrss: 0.2882 MB Stage outliers finished: 2020-08-10T08:43:32.390899 Resources for stage outliers : 0.768 s worker CPU, 0.774 s worker Wall, Wall: 0.873 s, Cores in use: 1.65, Total efficiency (on 8 cores): 20.7 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/PGC1235329-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/PGC1235329-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-10T08:43:32.415418 Stage halos : Wall: 0.53 s, CPU: 0.31 s, VmPeak: 1103 MB, VmSize: 1103 MB, VmRSS: 282 MB, VmData: 310 MB, maxrss: 0.288584 MB Stage halos finished: 2020-08-10T08:43:32.949745 Resources for stage halos : 0.948 s worker CPU, 1.320 s worker Wall, Wall: 0.535 s, Cores in use: 2.35, Total efficiency (on 8 cores): 29.4 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/PGC1235329-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/PGC1235329-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-10T08:43:32.980811 PSF sigmas in coadd pixels: ['2.27', '1.79', '1.72'] Using average PSF sigma 1.9250801098756554 Gaussian PSF norm 0.1465366507745484 vs pixelized 0.11909833 average tim pixel scale / coadd scale: 1.0011405199730612 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.64', '2.03', '1.60'] Using average PSF sigma 1.7545606205960944 Gaussian PSF norm 0.1607780252574227 vs pixelized 0.12949221 average tim pixel scale / coadd scale: 1.0010894327531106 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.92', '1.68', '1.64', '1.81'] Using average PSF sigma 1.7611878746284026 Gaussian PSF norm 0.16017302630668975 vs pixelized 0.12653026 average tim pixel scale / coadd scale: 1.0011328802175663 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.31 s, CPU: 0.17 s, VmPeak: 1103 MB, VmSize: 1103 MB, VmRSS: 283 MB, VmData: 310 MB, maxrss: 0.290052 MB Stage fit_on_coadds finished: 2020-08-10T08:43:33.292001 Resources for stage fit_on_coadds : 0.194 s worker CPU, 0.201 s worker Wall, Wall: 0.312 s, Cores in use: 1.16, Total efficiency (on 8 cores): 14.5 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/PGC1235329-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/PGC1235329-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-10T08:43:33.302997 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 82 potential peaks Of 82 potential peaks: 49 in veto map, 8 cut by saddle test, 0 cut by aper test, 25 kept SED z : 25 new peaks Found 85 potential peaks Of 85 potential peaks: 73 in veto map, 11 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 70 potential peaks Of 70 potential peaks: 61 in veto map, 7 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 84 potential peaks Of 84 potential peaks: 70 in veto map, 10 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 99 potential peaks Of 99 potential peaks: 86 in veto map, 11 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 34 new sources Median coadd sky for g : 3.9580456e-05 Median coadd sky for r : 0.00013595073 Median coadd sky for z : 0.0008475408 Stage srcs : Wall: 0.85 s, CPU: 0.80 s, VmPeak: 1103 MB, VmSize: 1103 MB, VmRSS: 284 MB, VmData: 310 MB, maxrss: 0.290568 MB Stage srcs finished: 2020-08-10T08:43:34.151075 Resources for stage srcs : 0.100 s worker CPU, 0.100 s worker Wall, Wall: 0.849 s, Cores in use: 1.06, Total efficiency (on 8 cores): 13.2 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/PGC1235329-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/PGC1235329-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-10T08:43:34.164334 Blob 1 of 11, id: 1, sources: 27, size: 225x257, npix 32108, brick X: 9,234, Y: 0,257, one pixel: 86 0 Blob 2 of 11, id: 5, sources: 3, size: 44x43, npix 1129, brick X: 213,257, Y: 128,171, one pixel: 224 128 Blob 3 of 11, id: 0, sources: 5, size: 34x49, npix 995, brick X: 0,34, Y: 0,49, one pixel: 0 0 Blob 4 of 11, id: 9, sources: 2, size: 33x36, npix 781, brick X: 11,44, Y: 221,257, one pixel: 20 221 Blob 5 of 11, id: 3, sources: 2, size: 38x29, npix 666, brick X: 217,255, Y: 0,29, one pixel: 242 0 Blob 6 of 11, id: 7, sources: 1, size: 32x31, npix 658, brick X: 181,213, Y: 193,224, one pixel: 194 193 Blob 7 of 11, id: 2, sources: 1, size: 33x30, npix 638, brick X: 163,196, Y: 0,30, one pixel: 172 0 Blob 8 of 11, id: 8, sources: 1, size: 25x24, npix 344, brick X: 166,191, Y: 216,240, one pixel: 180 216 Blob 9 of 11, id: 6, sources: 1, size: 23x22, npix 314, brick X: 204,227, Y: 176,198, one pixel: 214 176 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (253.47402, 2.70251), pm (5.8, -0.9), parallax 1.059 with NanoMaggies: g=14.5, r=13.8, z=13.8 Reset brightness to NanoMaggies: g=15.8, r=15.1, z=14.8 Measuring 1 iterative sources Blob 8 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 969 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145828 MB Blob 10 of 11, id: 4, sources: 1, size: 19x19, npix 199, brick X: 8,27, Y: 93,112, one pixel: 16 93 Blob 9 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 969 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145828 MB Blob 11 of 11, id: 10, sources: 1, size: 17x15, npix 141, brick X: 225,242, Y: 242,257, one pixel: 233 242 Blob 6 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 964 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145528 MB Blob 10 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 969 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145828 MB Blob 7 finished, total: Wall: 1.27 s, CPU: 1.26 s, VmPeak: 955 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145364 MB Blob 5 finished, total: Wall: 1.35 s, CPU: 1.35 s, VmPeak: 963 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145324 MB Blob 11 finished, total: Wall: 0.61 s, CPU: 0.61 s, VmPeak: 964 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145528 MB Blob 4 finished, total: Wall: 1.61 s, CPU: 1.61 s, VmPeak: 959 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145364 MB Blob 2 finished, total: Wall: 2.50 s, CPU: 2.50 s, VmPeak: 957 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145092 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 3.96 s, CPU: 3.96 s, VmPeak: 957 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.14766 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.42353, ee1=0.029642, ee2=0.107185 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (253.46643, 2.72446), pm (0.9, -4.7), parallax 0.207 with NanoMaggies: g=17.8, r=17.3, z=17.2 Reset brightness to NanoMaggies: g=17.8, r=17.3, z=17.2 Measuring 4 iterative sources Blob 1 finished, total: Wall: 27.72 s, CPU: 27.71 s, VmPeak: 962 MB, VmSize: 763 MB, VmRSS: 191 MB, VmData: 218 MB, maxrss: 0.195232 MB Old catalog: 54 New catalog: 46 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/metrics/cus/blobs-custom-253462p02710.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/metrics/cus/all-models-custom-253462p02710.fits Stage fitblobs : Wall: 28.21 s, CPU: 0.42 s, VmPeak: 1103 MB, VmSize: 1103 MB, VmRSS: 285 MB, VmData: 312 MB, maxrss: 0.291816 MB Stage fitblobs finished: 2020-08-10T08:44:02.374688 Resources for stage fitblobs : 41.215 s worker CPU, 41.318 s worker Wall, Wall: 28.211 s, Cores in use: 1.48, Total efficiency (on 8 cores): 18.5 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/PGC1235329-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/PGC1235329-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-10T08:44:02.404569 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/tmp-legacysurvey-custom-253462p02710-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/tmp-legacysurvey-custom-253462p02710-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/tmp-legacysurvey-custom-253462p02710-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/tmp-legacysurvey-custom-253462p02710-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-resid.jpg Stage coadds : Wall: 1.83 s, CPU: 0.80 s, VmPeak: 1103 MB, VmSize: 1103 MB, VmRSS: 285 MB, VmData: 312 MB, maxrss: 0.29214 MB Stage coadds finished: 2020-08-10T08:44:04.231177 Resources for stage coadds : 4.744 s worker CPU, 5.161 s worker Wall, Wall: 1.828 s, Cores in use: 3.03, Total efficiency (on 8 cores): 37.9 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/PGC1235329-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/PGC1235329-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-10T08:44:04.247754 Cut to 1 unWISE tiles Reading WISE tile 2541p030 band 1 Reading WISE tile 2541p030 band 2 Reading WISE tile 2541p030 band 4 Reading WISE tile 2541p030 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 962 MB, VmSize: 820 MB, VmRSS: 171 MB, VmData: 191 MB, maxrss: 0.229016 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 955 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.208588 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 964 MB, VmSize: 868 MB, VmRSS: 214 MB, VmData: 239 MB, maxrss: 0.21898 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/254/2541p030/unwise-2541p030-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 957 MB, VmSize: 806 MB, VmRSS: 149 MB, VmData: 177 MB, maxrss: 0.19372 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/tmp-legacysurvey-custom-253462p02710-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/tmp-legacysurvey-custom-253462p02710-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 7.98 s, CPU: 0.60 s, VmPeak: 1103 MB, VmSize: 1103 MB, VmRSS: 286 MB, VmData: 312 MB, maxrss: 0.292652 MB Stage wise_forced finished: 2020-08-10T08:44:12.224120 Resources for stage wise_forced : 3.360 s worker CPU, 14.594 s worker Wall, Wall: 7.978 s, Cores in use: 0.50, Total efficiency (on 8 cores): 6.2 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/PGC1235329-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/PGC1235329-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-10T08:44:12.239352 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/coadd/cus/custom-253462p02710/legacysurvey-custom-253462p02710-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/tractor-i/cus/tractor-custom-253462p02710.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/tractor/cus/tractor-custom-253462p02710.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/tractor/cus/brick-custom-253462p02710.sha256sum Stage writecat : Wall: 0.84 s, CPU: 0.66 s, VmPeak: 1235 MB, VmSize: 1107 MB, VmRSS: 288 MB, VmData: 312 MB, maxrss: 0.425508 MB Stage writecat finished: 2020-08-10T08:44:13.083871 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.846 s, Cores in use: 0.78, Total efficiency (on 8 cores): 9.7 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/PGC1235329-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC1235329/PGC1235329-largegalaxy-writecat.p All done: 56.744 s worker CPU, 306.603 s worker Wall, Wall: 100.543 s, Cores in use: 0.71, Total efficiency (on 8 cores): 8.8 % Finished galaxy PGC1235329 in 1.707 minutes.