Started working on galaxy PGC601405 at Wed Aug 5 20:34:13 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 326.87518500000004 -39.1418 --width 269 --height 269 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T20:34:15.056447 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '326.87518500000004', '-39.1418', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 326.87518500000004 -39.1418 --width 269 --height 269 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 326.87518500000004 -39.1418 Starting process 44171 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB Starting process 44172 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 44173 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 44174 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 44175 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 44176 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 44177 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 44178 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 44179 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 44180 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 44181 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 44182 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 44183 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 44184 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 44185 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 44186 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T20:34:18.157784 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 4 CCDs: c4d_170912_024149_ooi_r_v1-S31 r expnum 676778 exptime 90.0 propid 2012B-0001 seeing 1.42 MJD 58008.112 object DES survey hex -332-400 tiling 8 decam/CP/V4.1/CP20170911/c4d_170912_024149_ooi_r_v1.fits.fz c4d_170912_023950_ooi_g_v1-S31 g expnum 676777 exptime 90.0 propid 2012B-0001 seeing 1.56 MJD 58008.111 object DES survey hex -332-400 tiling 8 decam/CP/V4.1/CP20170911/c4d_170912_023950_ooi_g_v1.fits.fz c4d_170703_081833_ooi_g_ls9-S2 g expnum 658555 exptime 90.0 propid 2017A-0260 seeing 1.92 MJD 57937.345 object BLISS field: 5544-01-g decam/CP/V4.8.2/CP20170702/c4d_170703_081833_ooi_g_ls9.fits.fz c4d_170806_051608_ooi_z_ls9-S2 z expnum 665907 exptime 90.0 propid 2017A-0260 seeing 1.34 MJD 57971.218 object BLISS field: 5544-01-z decam/CP/V4.8.2/CP20170805/c4d_170806_051608_ooi_z_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-r-20170912T024149_oi[S31,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-g-20170912T023950_oi[S31,noinherit][2046,4094][real]: DE Zeroing out 0 weight-map pixels below quantization error (= median 0.00029) Clipping 24 pixels with anomalously large oow values: max 0.0585968 vs median 0.041183 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951b5c2-z-20170806T051345_oi[S2,noinherit][2046,4094][real]: BLISS fi The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951add9-g-20170703T081610_oi[S2,noinherit][2046,4094][real]: BLISS fi CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 270 weight-map pixels below quantization error (= median 7.55e-05) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 15.46 s, CPU: 1.94 s, VmPeak: 1010 MB, VmSize: 1010 MB, VmRSS: 171 MB, VmData: 203 MB, maxrss: 0.175388 MB Stage tims finished: 2020-08-05T20:34:33.614373 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-g-20170912T023950_oi[S31,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-r-20170912T024149_oi[S31,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951add9-g-20170703T081610_oi[S2,noinherit][2046,4094][real]: BLISS fi [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 2.188 s worker CPU, 41.057 s worker Wall, Wall: 15.459 s, Cores in use: 0.27, Total efficiency (on 16 cores): 1.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-05T20:34:33.632564 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10164.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10036.fits Matched 6 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/metrics/cus/reference-custom-326875m39141.fits Stage refs : Wall: 12.41 s, CPU: 3.32 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 200 MB, VmData: 230 MB, maxrss: 0.204308 MB Stage refs finished: 2020-08-05T20:34:46.043915 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951b5c2-z-20170806T051345_oi[S2,noinherit][2046,4094][real]: BLISS fi [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 12.413 s, Cores in use: 0.27, Total efficiency (on 16 cores): 1.7 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T20:34:46.061480 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/metrics/cus/outlier-mask-custom-326875m39141.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/metrics/cus/outliers-pre-custom-326875m39141.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/metrics/cus/outlier-mask-custom-326875m39141.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/metrics/cus/outliers-post-custom-326875m39141.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/metrics/cus/outliers-masked-pos-custom-326875m39141.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/metrics/cus/outliers-masked-neg-custom-326875m39141.jpg Stage outliers : Wall: 1.81 s, CPU: 1.42 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 209 MB, VmData: 237 MB, maxrss: 0.21434 MB Stage outliers finished: 2020-08-05T20:34:47.875154 Resources for stage outliers : 0.285 s worker CPU, 0.546 s worker Wall, Wall: 1.815 s, Cores in use: 0.94, Total efficiency (on 16 cores): 5.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T20:34:47.902920 Stage halos : Wall: 3.78 s, CPU: 0.95 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 209 MB, VmData: 237 MB, maxrss: 0.21434 MB Stage halos finished: 2020-08-05T20:34:51.681488 Resources for stage halos : 0.191 s worker CPU, 3.102 s worker Wall, Wall: 3.780 s, Cores in use: 0.30, Total efficiency (on 16 cores): 1.9 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T20:34:51.699236 PSF sigmas in coadd pixels: ['2.53', '3.12'] Using average PSF sigma 2.8289745465856955 Gaussian PSF norm 0.09971627072938492 vs pixelized 0.08234051 average tim pixel scale / coadd scale: 1.001052075431803 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.30'] Using average PSF sigma 2.299523806602378 Gaussian PSF norm 0.12267530823726608 vs pixelized 0.100088425 average tim pixel scale / coadd scale: 1.001029381109046 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.18'] Using average PSF sigma 2.1759811543637895 Gaussian PSF norm 0.1296402734040942 vs pixelized 0.10552833 average tim pixel scale / coadd scale: 1.0010178839851824 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.10 s, CPU: 0.07 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 211 MB, VmData: 237 MB, maxrss: 0.215932 MB Stage fit_on_coadds finished: 2020-08-05T20:34:51.803675 Resources for stage fit_on_coadds : 0.041 s worker CPU, 0.041 s worker Wall, Wall: 0.106 s, Cores in use: 1.09, Total efficiency (on 16 cores): 6.8 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T20:34:51.818073 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 44526 potential peaks Of 44526 potential peaks: 44523 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED z : 2 new peaks Found 23 potential peaks Of 23 potential peaks: 6 in veto map, 3 cut by saddle test, 0 cut by aper test, 14 kept SED r : 14 new peaks Found 17 potential peaks Of 17 potential peaks: 13 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 261 potential peaks Of 261 potential peaks: 258 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 306 potential peaks Of 306 potential peaks: 305 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 19 new sources Median coadd sky for g : -9.054211e-05 Median coadd sky for r : 9.000492e-06 Median coadd sky for z : 0.00013935956 Stage srcs : Wall: 2.31 s, CPU: 0.95 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 211 MB, VmData: 237 MB, maxrss: 0.216464 MB Stage srcs finished: 2020-08-05T20:34:54.131453 Resources for stage srcs : 1.414 s worker CPU, 1.414 s worker Wall, Wall: 2.315 s, Cores in use: 1.02, Total efficiency (on 16 cores): 6.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T20:34:54.220517 Blob 1 of 4, id: 0, sources: 23, size: 269x241, npix 57589, brick X: 0,269, Y: 0,241, one pixel: 0 0 Blob 2 of 4, id: 3, sources: 1, size: 37x39, npix 1072, brick X: 50,87, Y: 230,269, one pixel: 60 230 Blob 3 of 4, id: 2, sources: 2, size: 39x31, npix 619, brick X: 97,136, Y: 223,254, one pixel: 124 223 Blob 4 of 4, id: 1, sources: 1, size: 19x22, npix 247, brick X: 22,41, Y: 220,242, one pixel: 31 220 Blob 4 finished, total: Wall: 0.06 s, CPU: 0.05 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 89 MB, VmData: 140 MB, maxrss: 0.090844 MB Blob 3 finished, total: Wall: 0.30 s, CPU: 0.29 s, VmPeak: 1010 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149348 MB Blob 2 finished, total: Wall: 0.71 s, CPU: 0.70 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092172 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.58983, ee1=0.359249, ee2=0.749083 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (326.88758, -39.15391), pm (24.5, -12.3), parallax 0.410 with NanoMaggies: g=19, r=18.1, z=17.8 Reset brightness to NanoMaggies: g=19, r=18.1, z=17.8 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (326.88804, -39.13524), pm (-1.4, -4.0), parallax -0.430 with NanoMaggies: g=21.6, r=20.5, z=20 Reset brightness to NanoMaggies: g=19.8, r=19.3, z=19.1 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (326.87955, -39.15318), pm (5.9, -2.0), parallax 0.544 with NanoMaggies: g=18.5, r=(flux -114), z=19.9 Reset brightness to NanoMaggies: g=20.6, r=20.1, z=19.9 Blob 1 finished, total: Wall: 12.99 s, CPU: 12.99 s, VmPeak: 1011 MB, VmSize: 739 MB, VmRSS: 160 MB, VmData: 188 MB, maxrss: 0.1751 MB Old catalog: 31 New catalog: 25 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/metrics/cus/blobs-custom-326875m39141.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/metrics/cus/all-models-custom-326875m39141.fits Stage fitblobs : Wall: 14.25 s, CPU: 1.16 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 213 MB, VmData: 239 MB, maxrss: 0.218064 MB Stage fitblobs finished: 2020-08-05T20:35:08.475185 Resources for stage fitblobs : 14.095 s worker CPU, 14.260 s worker Wall, Wall: 14.256 s, Cores in use: 1.07, Total efficiency (on 16 cores): 6.7 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T20:35:08.491596 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/tmp-legacysurvey-custom-326875m39141-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/tmp-legacysurvey-custom-326875m39141-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/tmp-legacysurvey-custom-326875m39141-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/tmp-legacysurvey-custom-326875m39141-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-resid.jpg Stage coadds : Wall: 4.62 s, CPU: 1.23 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 216 MB, VmData: 241 MB, maxrss: 0.221216 MB Stage coadds finished: 2020-08-05T20:35:13.108670 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 16.408 s worker CPU, 25.500 s worker Wall, Wall: 4.619 s, Cores in use: 3.82, Total efficiency (on 16 cores): 23.9 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T20:35:13.130185 Cut to 1 unWISE tiles Reading WISE tile 3270m394 band 2 Reading WISE tile 3270m394 band 1 Reading WISE tile 3270m394 band 4 Reading WISE tile 3270m394 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 803 MB, VmSize: 803 MB, VmRSS: 142 MB, VmData: 175 MB, maxrss: 0.181936 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 805 MB, VmSize: 803 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.202376 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 939 MB, VmSize: 806 MB, VmRSS: 145 MB, VmData: 175 MB, maxrss: 0.20788 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 944 MB, VmSize: 806 MB, VmRSS: 146 MB, VmData: 175 MB, maxrss: 0.20818 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/tmp-legacysurvey-custom-326875m39141-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/tmp-legacysurvey-custom-326875m39141-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.87 s, CPU: 1.04 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 217 MB, VmData: 241 MB, maxrss: 0.221952 MB Stage wise_forced finished: 2020-08-05T20:35:16.002900 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.206 s worker CPU, 5.009 s worker Wall, Wall: 2.874 s, Cores in use: 1.48, Total efficiency (on 16 cores): 9.2 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T20:35:16.021338 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/tractor-i/cus/tractor-custom-326875m39141.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/tractor/cus/tractor-custom-326875m39141.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/tractor/cus/brick-custom-326875m39141.sha256sum Stage writecat : Wall: 1.95 s, CPU: 1.21 s, VmPeak: 1179 MB, VmSize: 1051 MB, VmRSS: 219 MB, VmData: 241 MB, maxrss: 0.354828 MB Stage writecat finished: 2020-08-05T20:35:17.975230 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.956 s, Cores in use: 0.62, Total efficiency (on 16 cores): 3.9 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-writecat.p All done: 37.831 s worker CPU, 90.931 s worker Wall, Wall: 59.864 s, Cores in use: 0.86, Total efficiency (on 16 cores): 5.3 % Finished galaxy PGC601405 in 1.082 minutes. Started working on galaxy PGC601405 at Wed Aug 5 22:09:19 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 326.87518500000004 -39.1418 --width 269 --height 269 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T22:09:20.382495 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '326.87518500000004', '-39.1418', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 326.87518500000004 -39.1418 --width 269 --height 269 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 326.87518500000004 -39.1418 Starting process 63168 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 63169 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 63170 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 63171 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 63172 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059528 MB Starting process 63173 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059476 MB Starting process 63174 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059476 MB Starting process 63175 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 63176 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 63177 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 63178 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 63179 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 63180 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 63181 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 63182 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 63183 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 63184 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 63185 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 63186 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 63187 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 63188 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 63189 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 63190 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 63191 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 63192 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 63193 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 63194 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 63196 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 63195 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 63198 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 63197 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 63199 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T22:09:21.257134 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 4 CCDs: c4d_170912_024149_ooi_r_v1-S31 r expnum 676778 exptime 90.0 propid 2012B-0001 seeing 1.42 MJD 58008.112 object DES survey hex -332-400 tiling 8 decam/CP/V4.1/CP20170911/c4d_170912_024149_ooi_r_v1.fits.fz c4d_170912_023950_ooi_g_v1-S31 g expnum 676777 exptime 90.0 propid 2012B-0001 seeing 1.56 MJD 58008.111 object DES survey hex -332-400 tiling 8 decam/CP/V4.1/CP20170911/c4d_170912_023950_ooi_g_v1.fits.fz c4d_170703_081833_ooi_g_ls9-S2 g expnum 658555 exptime 90.0 propid 2017A-0260 seeing 1.92 MJD 57937.345 object BLISS field: 5544-01-g decam/CP/V4.8.2/CP20170702/c4d_170703_081833_ooi_g_ls9.fits.fz c4d_170806_051608_ooi_z_ls9-S2 z expnum 665907 exptime 90.0 propid 2017A-0260 seeing 1.34 MJD 57971.218 object BLISS field: 5544-01-z decam/CP/V4.8.2/CP20170805/c4d_170806_051608_ooi_z_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-r-20170912T024149_oi[S31,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-g-20170912T023950_oi[S31,noinherit][2046,4094][real]: DE Zeroing out 0 weight-map pixels below quantization error (= median 0.00029) Clipping 24 pixels with anomalously large oow values: max 0.0585968 vs median 0.041183 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951add9-g-20170703T081610_oi[S2,noinherit][2046,4094][real]: BLISS fi The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951b5c2-z-20170806T051345_oi[S2,noinherit][2046,4094][real]: BLISS fi CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 270 weight-map pixels below quantization error (= median 7.55e-05) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 15.68 s, CPU: 1.13 s, VmPeak: 1010 MB, VmSize: 1010 MB, VmRSS: 171 MB, VmData: 203 MB, maxrss: 0.175392 MB Stage tims finished: 2020-08-05T22:09:36.932679 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-g-20170912T023950_oi[S31,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951b5c2-z-20170806T051345_oi[S2,noinherit][2046,4094][real]: BLISS fi [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 2.204 s worker CPU, 48.205 s worker Wall, Wall: 15.679 s, Cores in use: 0.21, Total efficiency (on 32 cores): 0.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-r-20170912T024149_oi[S31,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T22:09:39.849523 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10164.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10036.fits Matched 6 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/metrics/cus/reference-custom-326875m39141.fits Stage refs : Wall: 13.13 s, CPU: 2.99 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 200 MB, VmData: 230 MB, maxrss: 0.203948 MB Stage refs finished: 2020-08-05T22:09:52.979825 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 13.132 s, Cores in use: 0.23, Total efficiency (on 32 cores): 0.7 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-refs.p Running stage outliers WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951add9-g-20170703T081610_oi[S2,noinherit][2046,4094][real]: BLISS fi [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage outliers at 2020-08-05T22:09:53.058093 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/metrics/cus/outlier-mask-custom-326875m39141.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/metrics/cus/outliers-pre-custom-326875m39141.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/metrics/cus/outlier-mask-custom-326875m39141.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/metrics/cus/outliers-post-custom-326875m39141.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/metrics/cus/outliers-masked-pos-custom-326875m39141.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/metrics/cus/outliers-masked-neg-custom-326875m39141.jpg Stage outliers : Wall: 1.15 s, CPU: 0.69 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 209 MB, VmData: 237 MB, maxrss: 0.214416 MB Stage outliers finished: 2020-08-05T22:09:54.210636 Resources for stage outliers : 0.304 s worker CPU, 0.627 s worker Wall, Wall: 1.155 s, Cores in use: 0.86, Total efficiency (on 32 cores): 2.7 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T22:09:54.227875 Stage halos : Wall: 2.00 s, CPU: 0.58 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 209 MB, VmData: 237 MB, maxrss: 0.21444 MB Stage halos finished: 2020-08-05T22:09:56.229708 Resources for stage halos : 0.196 s worker CPU, 1.750 s worker Wall, Wall: 2.004 s, Cores in use: 0.39, Total efficiency (on 32 cores): 1.2 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T22:09:56.246733 PSF sigmas in coadd pixels: ['2.53', '3.12'] Using average PSF sigma 2.8289745465856955 Gaussian PSF norm 0.09971627072938492 vs pixelized 0.08234051 average tim pixel scale / coadd scale: 1.001052075431803 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.30'] Using average PSF sigma 2.299523806602378 Gaussian PSF norm 0.12267530823726608 vs pixelized 0.100088425 average tim pixel scale / coadd scale: 1.001029381109046 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.18'] Using average PSF sigma 2.1759811543637895 Gaussian PSF norm 0.1296402734040942 vs pixelized 0.10552833 average tim pixel scale / coadd scale: 1.0010178839851824 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.08 s, CPU: 0.07 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 211 MB, VmData: 237 MB, maxrss: 0.216032 MB Stage fit_on_coadds finished: 2020-08-05T22:09:56.330539 Resources for stage fit_on_coadds : 0.044 s worker CPU, 0.061 s worker Wall, Wall: 0.086 s, Cores in use: 1.34, Total efficiency (on 32 cores): 4.2 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T22:09:56.341919 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 44526 potential peaks Of 44526 potential peaks: 44523 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED z : 2 new peaks Found 23 potential peaks Of 23 potential peaks: 6 in veto map, 3 cut by saddle test, 0 cut by aper test, 14 kept SED r : 14 new peaks Found 17 potential peaks Of 17 potential peaks: 13 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 261 potential peaks Of 261 potential peaks: 258 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 306 potential peaks Of 306 potential peaks: 305 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 19 new sources Median coadd sky for g : -9.054211e-05 Median coadd sky for r : 9.000492e-06 Median coadd sky for z : 0.00013935956 Stage srcs : Wall: 1.75 s, CPU: 0.47 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 211 MB, VmData: 237 MB, maxrss: 0.216564 MB Stage srcs finished: 2020-08-05T22:09:58.087890 Resources for stage srcs : 1.351 s worker CPU, 1.387 s worker Wall, Wall: 1.748 s, Cores in use: 1.04, Total efficiency (on 32 cores): 3.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T22:09:58.117557 Blob 1 of 4, id: 0, sources: 23, size: 269x241, npix 57589, brick X: 0,269, Y: 0,241, one pixel: 0 0 Blob 2 of 4, id: 3, sources: 1, size: 37x39, npix 1072, brick X: 50,87, Y: 230,269, one pixel: 60 230 Blob 3 of 4, id: 2, sources: 2, size: 39x31, npix 619, brick X: 97,136, Y: 223,254, one pixel: 124 223 Blob 4 of 4, id: 1, sources: 1, size: 19x22, npix 247, brick X: 22,41, Y: 220,242, one pixel: 31 220 Blob 4 finished, total: Wall: 0.06 s, CPU: 0.05 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 86 MB, VmData: 139 MB, maxrss: 0.088476 MB Blob 3 finished, total: Wall: 0.36 s, CPU: 0.31 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 88 MB, VmData: 138 MB, maxrss: 0.090584 MB Blob 2 finished, total: Wall: 0.71 s, CPU: 0.70 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092256 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.58983, ee1=0.359249, ee2=0.749083 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (326.88758, -39.15391), pm (24.5, -12.3), parallax 0.410 with NanoMaggies: g=19, r=18.1, z=17.8 Reset brightness to NanoMaggies: g=19, r=18.1, z=17.8 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (326.88804, -39.13524), pm (-1.4, -4.0), parallax -0.430 with NanoMaggies: g=21.6, r=20.5, z=20 Reset brightness to NanoMaggies: g=19.8, r=19.3, z=19.1 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (326.87955, -39.15318), pm (5.9, -2.0), parallax 0.544 with NanoMaggies: g=18.5, r=(flux -114), z=19.9 Reset brightness to NanoMaggies: g=20.6, r=20.1, z=19.9 Blob 1 finished, total: Wall: 12.09 s, CPU: 12.09 s, VmPeak: 716 MB, VmSize: 701 MB, VmRSS: 133 MB, VmData: 172 MB, maxrss: 0.147824 MB Old catalog: 31 New catalog: 25 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/metrics/cus/blobs-custom-326875m39141.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/metrics/cus/all-models-custom-326875m39141.fits Stage fitblobs : Wall: 12.53 s, CPU: 0.32 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 213 MB, VmData: 239 MB, maxrss: 0.2181 MB Stage fitblobs finished: 2020-08-05T22:10:10.651615 Resources for stage fitblobs : 13.224 s worker CPU, 13.312 s worker Wall, Wall: 12.536 s, Cores in use: 1.08, Total efficiency (on 32 cores): 3.4 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T22:10:10.671737 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/tmp-legacysurvey-custom-326875m39141-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/tmp-legacysurvey-custom-326875m39141-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/tmp-legacysurvey-custom-326875m39141-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/tmp-legacysurvey-custom-326875m39141-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-resid.jpg Stage coadds : Wall: 21.56 s, CPU: 1.86 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 216 MB, VmData: 241 MB, maxrss: 0.22124 MB Stage coadds finished: 2020-08-05T22:10:32.231931 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 33.782 s worker CPU, 67.992 s worker Wall, Wall: 21.563 s, Cores in use: 1.65, Total efficiency (on 32 cores): 5.2 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T22:10:32.257778 Cut to 1 unWISE tiles Reading WISE tile 3270m394 band 1 Reading WISE tile 3270m394 band 3 Reading WISE tile 3270m394 band 4 Reading WISE tile 3270m394 band 2 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 809 MB, VmSize: 809 MB, VmRSS: 154 MB, VmData: 177 MB, maxrss: 0.20008 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 798 MB, VmSize: 798 MB, VmRSS: 138 MB, VmData: 170 MB, maxrss: 0.200332 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 944 MB, VmSize: 806 MB, VmRSS: 146 MB, VmData: 175 MB, maxrss: 0.208248 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 806 MB, VmSize: 804 MB, VmRSS: 142 MB, VmData: 172 MB, maxrss: 0.205428 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/tmp-legacysurvey-custom-326875m39141-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/tmp-legacysurvey-custom-326875m39141-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 1.96 s, CPU: 0.45 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 217 MB, VmData: 241 MB, maxrss: 0.221944 MB Stage wise_forced finished: 2020-08-05T22:10:34.221469 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.475 s worker CPU, 4.762 s worker Wall, Wall: 1.966 s, Cores in use: 2.00, Total efficiency (on 32 cores): 6.2 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T22:10:34.236868 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/tractor-i/cus/tractor-custom-326875m39141.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/tractor/cus/tractor-custom-326875m39141.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/tractor/cus/brick-custom-326875m39141.sha256sum Stage writecat : Wall: 0.53 s, CPU: 0.40 s, VmPeak: 1179 MB, VmSize: 1051 MB, VmRSS: 218 MB, VmData: 241 MB, maxrss: 0.35482 MB Stage writecat finished: 2020-08-05T22:10:34.769685 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.535 s, Cores in use: 0.76, Total efficiency (on 32 cores): 2.4 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC601405/PGC601405-largegalaxy-writecat.p All done: 54.585 s worker CPU, 138.101 s worker Wall, Wall: 73.534 s, Cores in use: 0.87, Total efficiency (on 32 cores): 2.7 % Finished galaxy PGC601405 in 1.264 minutes. Started working on galaxy PGC601405 at Mon Aug 10 09:23:41 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 326.875264005579 -39.14179866790868 --width 269 --height 269 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/PGC601405-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/PGC601405-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-10T09:23:43.219233 legacypipe git version: DR9.5.11-watershed-6-g6a2880fc Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '326.875264005579', '-39.14179866790868', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/PGC601405-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/PGC601405-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 326.875264005579 -39.14179866790868 --width 269 --height 269 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/PGC601405-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/PGC601405-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 326.875264005579 -39.14179866790868 Starting process 43721 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB Starting process 43723 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 43725 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 43727 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 43729 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059528 MB Starting process 43731 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 43733 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 43738 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-10T09:23:44.019295 Keeping 4 CCDs: c4d_170912_024149_ooi_r_v1-S31 r expnum 676778 exptime 90.0 propid 2012B-0001 seeing 1.42 MJD 58008.112 object DES survey hex -332-400 tiling 8 decam/CP/V4.1/CP20170911/c4d_170912_024149_ooi_r_v1.fits.fz c4d_170912_023950_ooi_g_v1-S31 g expnum 676777 exptime 90.0 propid 2012B-0001 seeing 1.56 MJD 58008.111 object DES survey hex -332-400 tiling 8 decam/CP/V4.1/CP20170911/c4d_170912_023950_ooi_g_v1.fits.fz c4d_170703_081833_ooi_g_ls9-S2 g expnum 658555 exptime 90.0 propid 2017A-0260 seeing 1.92 MJD 57937.345 object BLISS field: 5544-01-g decam/CP/V4.8.2/CP20170702/c4d_170703_081833_ooi_g_ls9.fits.fz c4d_170806_051608_ooi_z_ls9-S2 z expnum 665907 exptime 90.0 propid 2017A-0260 seeing 1.34 MJD 57971.218 object BLISS field: 5544-01-z decam/CP/V4.8.2/CP20170805/c4d_170806_051608_ooi_z_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-g-20170912T023950_oi[S31,noinherit][2046,4094][real]: DE Zeroing out 0 weight-map pixels below quantization error (= median 0.000291) Clipping 25 pixels with anomalously large oow values: max 0.0585968 vs median 0.041183 The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-r-20170912T024149_oi[S31,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951b5c2-z-20170806T051345_oi[S2,noinherit][2046,4094][real]: BLISS fi The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951add9-g-20170703T081610_oi[S2,noinherit][2046,4094][real]: BLISS fi Stage tims : Wall: 22.25 s, CPU: 1.04 s, VmPeak: 1003 MB, VmSize: 1003 MB, VmRSS: 170 MB, VmData: 204 MB, maxrss: 0.174152 MB Stage tims finished: 2020-08-10T09:24:06.267234 Warning: splinesky does not have sky-template version/run/scale values Zeroing out 270 weight-map pixels below quantization error (= median 7.55e-05) WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951add9-g-20170703T081610_oi[S2,noinherit][2046,4094][real]: BLISS fi [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-r-20170912T024149_oi[S31,noinherit][2046,4094][real]: DE [astropy.io.fits.card] Resources for stage tims : 2.038 s worker CPU, 70.286 s worker Wall, Wall: 22.249 s, Cores in use: 0.14, Total efficiency (on 8 cores): 1.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/PGC601405-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/PGC601405-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951b5c2-z-20170806T051345_oi[S2,noinherit][2046,4094][real]: BLISS fi [astropy.io.fits.card] Running stage refs at 2020-08-10T09:24:06.281348 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10164.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10036.fits Matched 6 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/metrics/cus/reference-custom-326875m39141.fits Stage refs : Wall: 17.98 s, CPU: 2.73 s, VmPeak: 1036 MB, VmSize: 1030 MB, VmRSS: 198 MB, VmData: 231 MB, maxrss: 0.202732 MB Stage refs finished: 2020-08-10T09:24:24.257491 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-g-20170912T023950_oi[S31,noinherit][2046,4094][real]: DE [astropy.io.fits.card] Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 17.977 s, Cores in use: 0.15, Total efficiency (on 8 cores): 1.9 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/PGC601405-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/PGC601405-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-10T09:24:24.375788 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/metrics/cus/outlier-mask-custom-326875m39141.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/metrics/cus/outliers-pre-custom-326875m39141.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/metrics/cus/outlier-mask-custom-326875m39141.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/metrics/cus/outliers-post-custom-326875m39141.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/metrics/cus/outliers-masked-pos-custom-326875m39141.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/metrics/cus/outliers-masked-neg-custom-326875m39141.jpg Stage outliers : Wall: 0.95 s, CPU: 0.69 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 208 MB, VmData: 237 MB, maxrss: 0.212536 MB Stage outliers finished: 2020-08-10T09:24:25.325636 Resources for stage outliers : 0.208 s worker CPU, 0.237 s worker Wall, Wall: 0.951 s, Cores in use: 0.94, Total efficiency (on 8 cores): 11.8 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/PGC601405-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/PGC601405-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-10T09:24:25.342868 Stage halos : Wall: 4.69 s, CPU: 0.50 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 208 MB, VmData: 237 MB, maxrss: 0.21274 MB Stage halos finished: 2020-08-10T09:24:30.029645 Resources for stage halos : 0.155 s worker CPU, 4.415 s worker Wall, Wall: 4.688 s, Cores in use: 0.14, Total efficiency (on 8 cores): 1.8 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/PGC601405-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/PGC601405-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-10T09:24:31.082063 PSF sigmas in coadd pixels: ['2.53', '3.12'] Using average PSF sigma 2.8289745465856955 Gaussian PSF norm 0.09971627072938492 vs pixelized 0.08234052 average tim pixel scale / coadd scale: 1.001052075431803 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.30'] Using average PSF sigma 2.299523806602378 Gaussian PSF norm 0.12267530823726608 vs pixelized 0.10008851 average tim pixel scale / coadd scale: 1.001029381109046 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.18'] Using average PSF sigma 2.1759811543637895 Gaussian PSF norm 0.1296402734040942 vs pixelized 0.10552822 average tim pixel scale / coadd scale: 1.0010178839851824 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.09 s, CPU: 0.07 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 209 MB, VmData: 237 MB, maxrss: 0.214332 MB Stage fit_on_coadds finished: 2020-08-10T09:24:31.173909 Resources for stage fit_on_coadds : 0.049 s worker CPU, 0.049 s worker Wall, Wall: 0.093 s, Cores in use: 1.33, Total efficiency (on 8 cores): 16.6 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/PGC601405-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/PGC601405-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-10T09:24:31.183699 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 44522 potential peaks Of 44522 potential peaks: 44519 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED z : 2 new peaks Found 23 potential peaks Of 23 potential peaks: 7 in veto map, 2 cut by saddle test, 0 cut by aper test, 14 kept SED r : 14 new peaks Found 17 potential peaks Of 17 potential peaks: 13 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 266 potential peaks Of 266 potential peaks: 263 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 300 potential peaks Of 300 potential peaks: 299 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 19 new sources Median coadd sky for g : -9.827374e-05 Median coadd sky for r : -1.5061834e-05 Median coadd sky for z : 0.00022165326 Stage srcs : Wall: 1.97 s, CPU: 0.66 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 210 MB, VmData: 237 MB, maxrss: 0.214852 MB Stage srcs finished: 2020-08-10T09:24:33.149020 Resources for stage srcs : 1.379 s worker CPU, 1.379 s worker Wall, Wall: 1.966 s, Cores in use: 1.04, Total efficiency (on 8 cores): 13.0 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/PGC601405-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/PGC601405-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-10T09:24:33.159710 Blob 1 of 4, id: 0, sources: 23, size: 269x242, npix 57630, brick X: 0,269, Y: 0,242, one pixel: 0 0 Blob 2 of 4, id: 3, sources: 1, size: 37x39, npix 1075, brick X: 51,88, Y: 230,269, one pixel: 61 230 Blob 3 of 4, id: 2, sources: 2, size: 38x31, npix 609, brick X: 98,136, Y: 223,254, one pixel: 125 223 Blob 4 of 4, id: 1, sources: 1, size: 19x22, npix 247, brick X: 23,42, Y: 220,242, one pixel: 32 220 Blob 4 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 1010 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.144924 MB Blob 3 finished, total: Wall: 0.54 s, CPU: 0.54 s, VmPeak: 939 MB, VmSize: 727 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145576 MB Blob 2 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.114952 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.61805, ee1=0.35697, ee2=0.728221 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (326.88758, -39.15391), pm (24.5, -12.3), parallax 0.410 with NanoMaggies: g=19, r=18.1, z=17.8 Reset brightness to NanoMaggies: g=19, r=18.1, z=17.8 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (326.88804, -39.13524), pm (-1.4, -4.0), parallax -0.430 with NanoMaggies: g=21.9, r=20.8, z=20.1 Reset brightness to NanoMaggies: g=19.8, r=19.3, z=19.1 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (326.87955, -39.15318), pm (5.9, -2.0), parallax 0.544 with NanoMaggies: g=18.6, r=(flux -96.5), z=19.9 Reset brightness to NanoMaggies: g=20.6, r=20.1, z=19.9 Measuring 7 iterative sources Blob 1 finished, total: Wall: 16.92 s, CPU: 16.92 s, VmPeak: 944 MB, VmSize: 736 MB, VmRSS: 160 MB, VmData: 191 MB, maxrss: 0.163948 MB Old catalog: 31 New catalog: 32 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/metrics/cus/blobs-custom-326875m39141.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/metrics/cus/all-models-custom-326875m39141.fits Stage fitblobs : Wall: 17.39 s, CPU: 0.42 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 211 MB, VmData: 238 MB, maxrss: 0.21656 MB Stage fitblobs finished: 2020-08-10T09:24:50.554317 Resources for stage fitblobs : 18.370 s worker CPU, 18.394 s worker Wall, Wall: 17.396 s, Cores in use: 1.08, Total efficiency (on 8 cores): 13.5 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/PGC601405-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/PGC601405-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-10T09:24:50.566882 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/tmp-legacysurvey-custom-326875m39141-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/tmp-legacysurvey-custom-326875m39141-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/tmp-legacysurvey-custom-326875m39141-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/tmp-legacysurvey-custom-326875m39141-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-resid.jpg Stage coadds : Wall: 2.94 s, CPU: 0.70 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 213 MB, VmData: 239 MB, maxrss: 0.218032 MB Stage coadds finished: 2020-08-10T09:24:53.509738 Resources for stage coadds : 7.198 s worker CPU, 7.601 s worker Wall, Wall: 2.944 s, Cores in use: 2.68, Total efficiency (on 8 cores): 33.5 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/PGC601405-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/PGC601405-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-10T09:24:53.521791 Cut to 1 unWISE tiles Reading WISE tile 3270m394 band 1 Reading WISE tile 3270m394 band 3 Reading WISE tile 3270m394 band 2 Reading WISE tile 3270m394 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 792 MB, VmSize: 792 MB, VmRSS: 135 MB, VmData: 170 MB, maxrss: 0.193628 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 939 MB, VmSize: 806 MB, VmRSS: 149 MB, VmData: 178 MB, maxrss: 0.19568 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 856 MB, VmSize: 856 MB, VmRSS: 199 MB, VmData: 234 MB, maxrss: 0.20422 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/327/3270m394/unwise-3270m394-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 944 MB, VmSize: 808 MB, VmRSS: 156 MB, VmData: 179 MB, maxrss: 0.220536 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/tmp-legacysurvey-custom-326875m39141-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/tmp-legacysurvey-custom-326875m39141-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.04 s, CPU: 0.62 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 214 MB, VmData: 239 MB, maxrss: 0.218736 MB Stage wise_forced finished: 2020-08-10T09:24:55.556951 Resources for stage wise_forced : 3.361 s worker CPU, 4.590 s worker Wall, Wall: 2.036 s, Cores in use: 1.96, Total efficiency (on 8 cores): 24.5 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/PGC601405-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/PGC601405-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-10T09:24:55.590758 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/coadd/cus/custom-326875m39141/legacysurvey-custom-326875m39141-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/tractor-i/cus/tractor-custom-326875m39141.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/tractor/cus/tractor-custom-326875m39141.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/tractor/cus/brick-custom-326875m39141.sha256sum Stage writecat : Wall: 0.70 s, CPU: 0.54 s, VmPeak: 1172 MB, VmSize: 1044 MB, VmRSS: 215 MB, VmData: 239 MB, maxrss: 0.351592 MB Stage writecat finished: 2020-08-10T09:24:56.289969 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.700 s, Cores in use: 0.77, Total efficiency (on 8 cores): 9.7 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/PGC601405-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/326/PGC601405/PGC601405-largegalaxy-writecat.p All done: 32.759 s worker CPU, 106.954 s worker Wall, Wall: 72.295 s, Cores in use: 0.56, Total efficiency (on 8 cores): 7.1 % Finished galaxy PGC601405 in 1.266 minutes.