Started working on galaxy PGC160977 at Wed Aug 5 21:45:06 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 253.22774400000003 -0.167277 --width 337 --height 337 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/PGC160977-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/PGC160977-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T21:45:08.602303 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '253.22774400000003', '-0.167277', '--width', '337', '--height', '337', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/PGC160977-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/PGC160977-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 253.22774400000003 -0.167277 --width 337 --height 337 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/PGC160977-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/PGC160977-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 253.22774400000003 -0.167277 Starting process 10912 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB Starting process 10913 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 10914 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 10915 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 10916 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 10917 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 10925 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 10926 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 10927 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 10928 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 10929 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 10930 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 10931 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 10932 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 10933 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 10934 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T21:45:09.963004 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 3 CCDs: c4d_170720_021415_ooi_g_ls9-N6 g expnum 660150 exptime 200.0 propid 2014B-0404 seeing 1.24 MJD 57954.090 object DECaLS_46841_g decam/CP/V4.8.2/CP20170719/c4d_170720_021415_ooi_g_ls9.fits.fz c4d_180514_082753_ooi_r_ls9-N6 r expnum 746151 exptime 175.0 propid 2014B-0404 seeing 1.43 MJD 58252.353 object DECaLS_46841_r decam/CP/V4.8.2a/CP20180513/c4d_180514_082753_ooi_r_ls9.fits.fz c4d_170520_093148_ooi_z_ls9-N6 z expnum 649553 exptime 250.0 propid 2014B-0404 seeing 1.56 MJD 57893.394 object DECaLS_46841_z decam/CP/V4.8.2/CP20170519/c4d_170520_093148_ooi_z_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170720T021002_oi[N6,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9517988-z-20170520T092645_oi[N6,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955fb7b-r-20180514T082753_oi[N6,noinherit][2046,4094][real]: DECaLS_4 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 51.48 s, CPU: 1.56 s, VmPeak: 1010 MB, VmSize: 1010 MB, VmRSS: 173 MB, VmData: 206 MB, maxrss: 0.177544 MB Stage tims finished: 2020-08-05T21:46:01.442604 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955fb7b-r-20180514T082753_oi[N6,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9517988-z-20170520T092645_oi[N6,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170720T021002_oi[N6,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 1.658 s worker CPU, 145.779 s worker Wall, Wall: 51.481 s, Cores in use: 0.06, Total efficiency (on 16 cores): 0.4 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/PGC160977-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/PGC160977-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-05T21:46:01.456140 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06169.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06298.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06170.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06042.fits Matched 5 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/metrics/cus/reference-custom-253227m00167.fits Stage refs : Wall: 18.84 s, CPU: 7.41 s, VmPeak: 1102 MB, VmSize: 1096 MB, VmRSS: 263 MB, VmData: 292 MB, maxrss: 0.26952 MB Stage refs finished: 2020-08-05T21:46:20.292878 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 18.838 s, Cores in use: 0.39, Total efficiency (on 16 cores): 2.5 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/PGC160977-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/PGC160977-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T21:46:20.384635 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/metrics/cus/outlier-mask-custom-253227m00167.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/metrics/cus/outliers-pre-custom-253227m00167.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/metrics/cus/outlier-mask-custom-253227m00167.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/metrics/cus/outliers-post-custom-253227m00167.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/metrics/cus/outliers-masked-pos-custom-253227m00167.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/metrics/cus/outliers-masked-neg-custom-253227m00167.jpg Stage outliers : Wall: 1.16 s, CPU: 0.45 s, VmPeak: 1106 MB, VmSize: 1106 MB, VmRSS: 276 MB, VmData: 302 MB, maxrss: 0.28216 MB Stage outliers finished: 2020-08-05T21:46:21.549405 Resources for stage outliers : 0.403 s worker CPU, 0.616 s worker Wall, Wall: 1.166 s, Cores in use: 0.73, Total efficiency (on 16 cores): 4.6 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/PGC160977-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/PGC160977-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T21:46:21.618782 Stage halos : Wall: 0.36 s, CPU: 0.25 s, VmPeak: 1106 MB, VmSize: 1106 MB, VmRSS: 276 MB, VmData: 302 MB, maxrss: 0.282304 MB Stage halos finished: 2020-08-05T21:46:21.981809 Resources for stage halos : 0.239 s worker CPU, 0.308 s worker Wall, Wall: 0.365 s, Cores in use: 1.34, Total efficiency (on 16 cores): 8.4 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/PGC160977-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/PGC160977-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T21:46:22.047708 PSF sigmas in coadd pixels: ['2.01'] Using average PSF sigma 2.006109739885114 Gaussian PSF norm 0.1406178267147206 vs pixelized 0.114409186 average tim pixel scale / coadd scale: 1.0010195835600144 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.33'] Using average PSF sigma 2.3266654486191847 Gaussian PSF norm 0.12124424331882097 vs pixelized 0.0980965 average tim pixel scale / coadd scale: 1.001203037666882 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.54'] Using average PSF sigma 2.540474952084729 Gaussian PSF norm 0.11104017835026851 vs pixelized 0.0839642 average tim pixel scale / coadd scale: 1.0013678964255874 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.38 s, CPU: 0.10 s, VmPeak: 1106 MB, VmSize: 1106 MB, VmRSS: 277 MB, VmData: 302 MB, maxrss: 0.283772 MB Stage fit_on_coadds finished: 2020-08-05T21:46:22.426195 Resources for stage fit_on_coadds : 0.077 s worker CPU, 0.077 s worker Wall, Wall: 0.380 s, Cores in use: 0.48, Total efficiency (on 16 cores): 3.0 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/PGC160977-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/PGC160977-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T21:46:22.506456 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 171 potential peaks Of 171 potential peaks: 138 in veto map, 10 cut by saddle test, 0 cut by aper test, 23 kept SED z : 23 new peaks Found 158 potential peaks Of 158 potential peaks: 140 in veto map, 13 cut by saddle test, 0 cut by aper test, 5 kept SED r : 5 new peaks Found 176 potential peaks Of 176 potential peaks: 163 in veto map, 9 cut by saddle test, 0 cut by aper test, 4 kept SED g : 4 new peaks Found 240 potential peaks Of 240 potential peaks: 226 in veto map, 13 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 228 potential peaks Of 228 potential peaks: 215 in veto map, 11 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 35 new sources Median coadd sky for g : 0.00046630733 Median coadd sky for r : 0.00084568554 Median coadd sky for z : 0.0032203984 Stage srcs : Wall: 1.34 s, CPU: 1.21 s, VmPeak: 1106 MB, VmSize: 1106 MB, VmRSS: 278 MB, VmData: 302 MB, maxrss: 0.284276 MB Stage srcs finished: 2020-08-05T21:46:23.845321 Resources for stage srcs : 0.150 s worker CPU, 0.213 s worker Wall, Wall: 1.340 s, Cores in use: 1.02, Total efficiency (on 16 cores): 6.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/PGC160977-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/PGC160977-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T21:46:24.699728 Blob 1 of 9, id: 2, sources: 40, size: 337x331, npix 73824, brick X: 0,337, Y: 6,337, one pixel: 143 6 Blob 2 of 9, id: 0, sources: 1, size: 46x40, npix 1375, brick X: 285,331, Y: 0,40, one pixel: 292 0 Blob 3 of 9, id: 5, sources: 2, size: 32x67, npix 1263, brick X: 0,32, Y: 251,318, one pixel: 17 251 Blob 4 of 9, id: 8, sources: 2, size: 33x28, npix 722, brick X: 237,270, Y: 309,337, one pixel: 249 309 Blob 5 of 9, id: 4, sources: 1, size: 21x28, npix 406, brick X: 0,21, Y: 224,252, one pixel: 6 224 Blob 6 of 9, id: 6, sources: 1, size: 25x26, npix 396, brick X: 255,280, Y: 274,300, one pixel: 264 274 Blob 7 of 9, id: 1, sources: 1, size: 24x24, npix 338, brick X: 236,260, Y: 5,29, one pixel: 248 5 Blob 8 of 9, id: 7, sources: 1, size: 19x21, npix 219, brick X: 293,312, Y: 302,323, one pixel: 302 302 Blob 9 of 9, id: 3, sources: 1, size: 19x19, npix 199, brick X: 315,334, Y: 61,80, one pixel: 323 61 Blob 8 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 94 MB, VmData: 144 MB, maxrss: 0.095772 MB Blob 9 finished, total: Wall: 0.09 s, CPU: 0.08 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 108 MB, VmData: 165 MB, maxrss: 0.110336 MB Blob 7 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095588 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (253.22152, -0.15493), pm (1.8, -8.5), parallax 1.839 with NanoMaggies: g=22.2, r=20.5, z=18.9 Reset brightness to NanoMaggies: g=21.7, r=20.3, z=19.3 Blob 4 finished, total: Wall: 0.42 s, CPU: 0.42 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 99 MB, VmData: 144 MB, maxrss: 0.10142 MB Blob 3 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.093972 MB Blob 5 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095624 MB Blob 6 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 963 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149052 MB Measuring 1 iterative sources Blob 2 finished, total: Wall: 1.35 s, CPU: 1.34 s, VmPeak: 959 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 187 MB, maxrss: 0.155984 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (253.23359, -0.14347), pm (-0.8, -10.5), parallax 2.016 with NanoMaggies: g=10.8, r=9.59, z=8.97 Reset brightness to NanoMaggies: g=10.8, r=9.59, z=8.97 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.69946, ee1=0.0577578, ee2=-0.00609119 Measuring 12 iterative sources Blob 1 finished, total: Wall: 38.54 s, CPU: 38.51 s, VmPeak: 742 MB, VmSize: 742 MB, VmRSS: 177 MB, VmData: 213 MB, maxrss: 0.18158 MB Old catalog: 57 New catalog: 58 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/metrics/cus/blobs-custom-253227m00167.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/metrics/cus/all-models-custom-253227m00167.fits Stage fitblobs : Wall: 39.51 s, CPU: 0.89 s, VmPeak: 1106 MB, VmSize: 1106 MB, VmRSS: 281 MB, VmData: 307 MB, maxrss: 0.2874 MB Stage fitblobs finished: 2020-08-05T21:47:04.212850 Resources for stage fitblobs : 42.772 s worker CPU, 42.916 s worker Wall, Wall: 39.515 s, Cores in use: 1.11, Total efficiency (on 16 cores): 6.9 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/PGC160977-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/PGC160977-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T21:47:04.243763 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/tmp-legacysurvey-custom-253227m00167-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/tmp-legacysurvey-custom-253227m00167-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/tmp-legacysurvey-custom-253227m00167-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/tmp-legacysurvey-custom-253227m00167-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-resid.jpg Stage coadds : Wall: 4.82 s, CPU: 1.17 s, VmPeak: 1106 MB, VmSize: 1106 MB, VmRSS: 284 MB, VmData: 310 MB, maxrss: 0.290428 MB Stage coadds finished: 2020-08-05T21:47:09.058916 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 18.565 s worker CPU, 28.321 s worker Wall, Wall: 4.817 s, Cores in use: 4.10, Total efficiency (on 16 cores): 25.6 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/PGC160977-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/PGC160977-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T21:47:09.154402 Cut to 1 unWISE tiles Reading WISE tile 2526p000 band 1 Reading WISE tile 2526p000 band 2 Reading WISE tile 2526p000 band 3 Reading WISE tile 2526p000 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.14 s, CPU: 0.14 s, VmPeak: 805 MB, VmSize: 805 MB, VmRSS: 147 MB, VmData: 177 MB, maxrss: 0.183144 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.12 s, CPU: 0.12 s, VmPeak: 963 MB, VmSize: 807 MB, VmRSS: 146 MB, VmData: 172 MB, maxrss: 0.209492 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 805 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 171 MB, maxrss: 0.205724 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 802 MB, VmSize: 802 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.209352 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/tmp-legacysurvey-custom-253227m00167-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/tmp-legacysurvey-custom-253227m00167-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 6.01 s, CPU: 0.62 s, VmPeak: 1106 MB, VmSize: 1106 MB, VmRSS: 284 MB, VmData: 310 MB, maxrss: 0.291012 MB Stage wise_forced finished: 2020-08-05T21:47:15.161821 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.686 s worker CPU, 8.544 s worker Wall, Wall: 6.009 s, Cores in use: 0.72, Total efficiency (on 16 cores): 4.5 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/PGC160977-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/PGC160977-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T21:47:15.183499 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/tractor-i/cus/tractor-custom-253227m00167.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/tractor/cus/tractor-custom-253227m00167.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/tractor/cus/brick-custom-253227m00167.sha256sum Stage writecat : Wall: 2.30 s, CPU: 0.99 s, VmPeak: 1239 MB, VmSize: 1110 MB, VmRSS: 286 MB, VmData: 310 MB, maxrss: 0.423952 MB Stage writecat finished: 2020-08-05T21:47:17.485110 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.303 s, Cores in use: 0.43, Total efficiency (on 16 cores): 2.7 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/PGC160977-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/253/PGC160977/PGC160977-largegalaxy-writecat.p All done: 67.554 s worker CPU, 226.778 s worker Wall, Wall: 127.588 s, Cores in use: 0.65, Total efficiency (on 16 cores): 4.0 % Finished galaxy PGC160977 in 2.198 minutes. Started working on galaxy PGC160977 at Mon Aug 10 11:48:08 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 253.22752109632472 -0.16774916079468122 --width 337 --height 337 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/PGC160977-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/PGC160977-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-10T11:48:09.394478 legacypipe git version: DR9.5.11-watershed-6-g6a2880fc Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '253.22752109632472', '-0.16774916079468122', '--width', '337', '--height', '337', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/PGC160977-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/PGC160977-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 253.22752109632472 -0.16774916079468122 --width 337 --height 337 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/PGC160977-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/PGC160977-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 253.22752109632472 -0.16774916079468122 Starting process 16361 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB Starting process 16363 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 16365 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 16367 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 16369 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059524 MB Starting process 16371 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059472 MB Starting process 16373 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059472 MB Starting process 16375 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 16377 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 16379 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 16381 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 16383 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 16385 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 16387 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 16389 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 16390 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-10T11:48:10.061681 Keeping 3 CCDs: c4d_170720_021415_ooi_g_ls9-N6 g expnum 660150 exptime 200.0 propid 2014B-0404 seeing 1.24 MJD 57954.090 object DECaLS_46841_g decam/CP/V4.8.2/CP20170719/c4d_170720_021415_ooi_g_ls9.fits.fz c4d_180514_082753_ooi_r_ls9-N6 r expnum 746151 exptime 175.0 propid 2014B-0404 seeing 1.43 MJD 58252.353 object DECaLS_46841_r decam/CP/V4.8.2a/CP20180513/c4d_180514_082753_ooi_r_ls9.fits.fz c4d_170520_093148_ooi_z_ls9-N6 z expnum 649553 exptime 250.0 propid 2014B-0404 seeing 1.56 MJD 57893.394 object DECaLS_46841_z decam/CP/V4.8.2/CP20170519/c4d_170520_093148_ooi_z_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9517988-z-20170520T092645_oi[N6,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955fb7b-r-20180514T082753_oi[N6,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170720T021002_oi[N6,noinherit][2046,4094][real]: DECaLS_4 Stage tims : Wall: 14.73 s, CPU: 1.34 s, VmPeak: 1003 MB, VmSize: 1003 MB, VmRSS: 172 MB, VmData: 205 MB, maxrss: 0.175676 MB Stage tims finished: 2020-08-10T11:48:24.792743 Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9517988-z-20170520T092645_oi[N6,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170720T021002_oi[N6,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Resources for stage tims : 1.599 s worker CPU, 32.663 s worker Wall, Wall: 14.733 s, Cores in use: 0.20, Total efficiency (on 16 cores): 1.2 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/PGC160977-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/PGC160977-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955fb7b-r-20180514T082753_oi[N6,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Running stage refs at 2020-08-10T11:48:24.807917 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06169.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06298.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06170.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06042.fits Matched 5 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/metrics/cus/reference-custom-253227m00167.fits Stage refs : Wall: 8.15 s, CPU: 7.59 s, VmPeak: 1096 MB, VmSize: 1090 MB, VmRSS: 262 MB, VmData: 292 MB, maxrss: 0.267548 MB Stage refs finished: 2020-08-10T11:48:32.962265 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.156 s, Cores in use: 0.93, Total efficiency (on 16 cores): 5.8 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/PGC160977-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/PGC160977-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-10T11:48:32.977435 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/metrics/cus/outlier-mask-custom-253227m00167.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/metrics/cus/outliers-pre-custom-253227m00167.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/metrics/cus/outlier-mask-custom-253227m00167.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/metrics/cus/outliers-post-custom-253227m00167.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/metrics/cus/outliers-masked-pos-custom-253227m00167.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/metrics/cus/outliers-masked-neg-custom-253227m00167.jpg Stage outliers : Wall: 0.92 s, CPU: 0.38 s, VmPeak: 1099 MB, VmSize: 1099 MB, VmRSS: 273 MB, VmData: 302 MB, maxrss: 0.279944 MB Stage outliers finished: 2020-08-10T11:48:33.893563 Resources for stage outliers : 0.410 s worker CPU, 0.657 s worker Wall, Wall: 0.917 s, Cores in use: 0.87, Total efficiency (on 16 cores): 5.4 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/PGC160977-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/PGC160977-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-10T11:48:33.960235 Stage halos : Wall: 0.65 s, CPU: 0.44 s, VmPeak: 1099 MB, VmSize: 1099 MB, VmRSS: 274 MB, VmData: 302 MB, maxrss: 0.280088 MB Stage halos finished: 2020-08-10T11:48:34.610527 Resources for stage halos : 0.243 s worker CPU, 0.482 s worker Wall, Wall: 0.652 s, Cores in use: 1.04, Total efficiency (on 16 cores): 6.5 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/PGC160977-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/PGC160977-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-10T11:48:34.632382 PSF sigmas in coadd pixels: ['2.01'] Using average PSF sigma 2.006109739885114 Gaussian PSF norm 0.1406178267147206 vs pixelized 0.114410095 average tim pixel scale / coadd scale: 1.0010195835600144 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.33'] Using average PSF sigma 2.3266654486191847 Gaussian PSF norm 0.12124424331882097 vs pixelized 0.09809337 average tim pixel scale / coadd scale: 1.001203037666882 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.54'] Using average PSF sigma 2.540474952084729 Gaussian PSF norm 0.11104017835026851 vs pixelized 0.08397009 average tim pixel scale / coadd scale: 1.0013678964255874 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.13 s, CPU: 0.10 s, VmPeak: 1099 MB, VmSize: 1099 MB, VmRSS: 275 MB, VmData: 302 MB, maxrss: 0.281552 MB Stage fit_on_coadds finished: 2020-08-10T11:48:34.764471 Resources for stage fit_on_coadds : 0.078 s worker CPU, 0.078 s worker Wall, Wall: 0.134 s, Cores in use: 1.32, Total efficiency (on 16 cores): 8.3 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/PGC160977-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/PGC160977-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-10T11:48:34.779630 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 167 potential peaks Of 167 potential peaks: 135 in veto map, 9 cut by saddle test, 0 cut by aper test, 23 kept SED z : 23 new peaks Found 163 potential peaks Of 163 potential peaks: 145 in veto map, 11 cut by saddle test, 0 cut by aper test, 7 kept SED r : 7 new peaks Found 171 potential peaks Of 171 potential peaks: 159 in veto map, 8 cut by saddle test, 0 cut by aper test, 4 kept SED g : 4 new peaks Found 245 potential peaks Of 245 potential peaks: 229 in veto map, 15 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 239 potential peaks Of 239 potential peaks: 223 in veto map, 15 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 36 new sources Median coadd sky for g : 0.00046102807 Median coadd sky for r : 0.00084805733 Median coadd sky for z : 0.003060894 Stage srcs : Wall: 1.31 s, CPU: 1.20 s, VmPeak: 1099 MB, VmSize: 1099 MB, VmRSS: 275 MB, VmData: 302 MB, maxrss: 0.282076 MB Stage srcs finished: 2020-08-10T11:48:36.085062 Resources for stage srcs : 0.174 s worker CPU, 0.197 s worker Wall, Wall: 1.307 s, Cores in use: 1.05, Total efficiency (on 16 cores): 6.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/PGC160977-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/PGC160977-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-10T11:48:36.100335 Blob 1 of 10, id: 2, sources: 40, size: 337x324, npix 72657, brick X: 0,337, Y: 13,337, one pixel: 139 13 Blob 2 of 10, id: 0, sources: 1, size: 46x47, npix 1555, brick X: 282,328, Y: 0,47, one pixel: 296 0 Blob 3 of 10, id: 5, sources: 2, size: 29x68, npix 1176, brick X: 0,29, Y: 257,325, one pixel: 15 257 Blob 4 of 10, id: 3, sources: 2, size: 25x36, npix 557, brick X: 312,337, Y: 65,101, one pixel: 331 65 Blob 5 of 10, id: 9, sources: 2, size: 31x21, npix 454, brick X: 234,265, Y: 316,337, one pixel: 245 316 Blob 6 of 10, id: 7, sources: 1, size: 25x26, npix 389, brick X: 252,277, Y: 280,306, one pixel: 262 280 Blob 7 of 10, id: 6, sources: 1, size: 17x28, npix 341, brick X: 320,337, Y: 271,299, one pixel: 330 271 Blob 8 of 10, id: 4, sources: 1, size: 18x26, npix 325, brick X: 0,18, Y: 232,258, one pixel: 4 232 Blob 9 of 10, id: 1, sources: 1, size: 24x23, npix 320, brick X: 233,257, Y: 12,35, one pixel: 244 12 Blob 10 of 10, id: 8, sources: 1, size: 20x20, npix 228, brick X: 289,309, Y: 309,329, one pixel: 298 309 Blob 10 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 90 MB, VmData: 141 MB, maxrss: 0.091964 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (253.22152, -0.15493), pm (1.8, -8.5), parallax 1.839 with NanoMaggies: g=20, r=19.6, z=18.4 Reset brightness to NanoMaggies: g=21.7, r=20.3, z=19.3 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (253.21454, -0.17386), pm (-2.0, 0.3), parallax 0.174 with NanoMaggies: g=17.8, r=16.9, z=16.6 Reset brightness to NanoMaggies: g=17.6, r=16.9, z=16.5 Blob 9 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097628 MB Blob 5 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 957 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145004 MB Blob 4 finished, total: Wall: 0.47 s, CPU: 0.47 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.093844 MB Blob 3 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 113 MB, VmData: 165 MB, maxrss: 0.115788 MB Blob 6 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.09556 MB Blob 7 finished, total: Wall: 0.63 s, CPU: 0.63 s, VmPeak: 959 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144676 MB Blob 8 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.114916 MB Measuring 1 iterative sources Blob 2 finished, total: Wall: 1.35 s, CPU: 1.35 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097144 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (253.23359, -0.14347), pm (-0.8, -10.5), parallax 2.016 with NanoMaggies: g=10.8, r=9.59, z=8.97 Reset brightness to NanoMaggies: g=10.8, r=9.59, z=8.97 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (253.23012, -0.15586), pm (-23.8, 0.9), parallax 1.417 with NanoMaggies: g=14.7, r=13.7, z=13.1 Reset brightness to NanoMaggies: g=14.3, r=13.3, z=12.9 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.44336, ee1=0.0580785, ee2=-0.00374298 Measuring 12 iterative sources Blob 1 finished, total: Wall: 43.06 s, CPU: 43.01 s, VmPeak: 745 MB, VmSize: 736 MB, VmRSS: 170 MB, VmData: 205 MB, maxrss: 0.182984 MB Old catalog: 58 New catalog: 57 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/metrics/cus/blobs-custom-253227m00167.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/metrics/cus/all-models-custom-253227m00167.fits Stage fitblobs : Wall: 43.95 s, CPU: 0.33 s, VmPeak: 1099 MB, VmSize: 1099 MB, VmRSS: 278 MB, VmData: 306 MB, maxrss: 0.284988 MB Stage fitblobs finished: 2020-08-10T11:49:20.049566 Resources for stage fitblobs : 48.197 s worker CPU, 48.292 s worker Wall, Wall: 43.951 s, Cores in use: 1.10, Total efficiency (on 16 cores): 6.9 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/PGC160977-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/PGC160977-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-10T11:49:20.070561 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/tmp-legacysurvey-custom-253227m00167-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/tmp-legacysurvey-custom-253227m00167-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/tmp-legacysurvey-custom-253227m00167-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/tmp-legacysurvey-custom-253227m00167-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-resid.jpg Stage coadds : Wall: 3.37 s, CPU: 1.34 s, VmPeak: 1099 MB, VmSize: 1099 MB, VmRSS: 282 MB, VmData: 309 MB, maxrss: 0.288304 MB Stage coadds finished: 2020-08-10T11:49:23.444737 Resources for stage coadds : 16.550 s worker CPU, 20.364 s worker Wall, Wall: 3.376 s, Cores in use: 5.30, Total efficiency (on 16 cores): 33.1 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/PGC160977-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/PGC160977-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-10T11:49:23.466577 Cut to 1 unWISE tiles Reading WISE tile 2526p000 band 1 Reading WISE tile 2526p000 band 2 Reading WISE tile 2526p000 band 3 Reading WISE tile 2526p000 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.12 s, CPU: 0.12 s, VmPeak: 799 MB, VmSize: 799 MB, VmRSS: 142 MB, VmData: 177 MB, maxrss: 0.179 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 957 MB, VmSize: 801 MB, VmRSS: 142 MB, VmData: 172 MB, maxrss: 0.20526 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 963 MB, VmSize: 859 MB, VmRSS: 208 MB, VmData: 235 MB, maxrss: 0.212536 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/252/2526p000/unwise-2526p000-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 959 MB, VmSize: 804 MB, VmRSS: 145 MB, VmData: 175 MB, maxrss: 0.208268 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/tmp-legacysurvey-custom-253227m00167-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/tmp-legacysurvey-custom-253227m00167-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.33 s, CPU: 1.24 s, VmPeak: 1099 MB, VmSize: 1099 MB, VmRSS: 282 MB, VmData: 309 MB, maxrss: 0.288816 MB Stage wise_forced finished: 2020-08-10T11:49:26.796928 Resources for stage wise_forced : 3.258 s worker CPU, 5.578 s worker Wall, Wall: 3.332 s, Cores in use: 1.35, Total efficiency (on 16 cores): 8.4 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/PGC160977-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/PGC160977-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-10T11:49:26.830977 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/coadd/cus/custom-253227m00167/legacysurvey-custom-253227m00167-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/tractor-i/cus/tractor-custom-253227m00167.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/tractor/cus/tractor-custom-253227m00167.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/tractor/cus/brick-custom-253227m00167.sha256sum Stage writecat : Wall: 2.49 s, CPU: 1.95 s, VmPeak: 1231 MB, VmSize: 1103 MB, VmRSS: 284 MB, VmData: 309 MB, maxrss: 0.421676 MB Stage writecat finished: 2020-08-10T11:49:29.325317 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.496 s, Cores in use: 0.78, Total efficiency (on 16 cores): 4.9 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/PGC160977-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC160977/PGC160977-largegalaxy-writecat.p All done: 70.513 s worker CPU, 108.314 s worker Wall, Wall: 79.294 s, Cores in use: 1.09, Total efficiency (on 16 cores): 6.8 % Finished galaxy PGC160977 in 1.357 minutes.