Started working on galaxy PGC1390638 at Wed Aug 5 21:29:20 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.37210300000004 11.2316656 --width 307 --height 307 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/PGC1390638-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/PGC1390638-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T21:29:23.373650 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '347.37210300000004', '11.2316656', '--width', '307', '--height', '307', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/PGC1390638-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/PGC1390638-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.37210300000004 11.2316656 --width 307 --height 307 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/PGC1390638-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/PGC1390638-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 347.37210300000004 11.2316656 Starting process 40828 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 40829 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 40830 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 40831 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 40832 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059408 MB Starting process 40833 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059416 MB Starting process 40834 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059416 MB Starting process 40835 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 40836 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 40837 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 40838 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 40839 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 40840 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 40841 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 40842 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 40843 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T21:29:24.992725 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 11 CCDs: c4d_170721_064746_ooi_g_ls9-S30 g expnum 660491 exptime 131.0 propid 2014B-0404 seeing 1.49 MJD 57955.281 object DECaLS_39628_g decam/CP/V4.8.2/CP20170720/c4d_170721_064746_ooi_g_ls9.fits.fz c4d_170719_073302_ooi_r_ls9-S30 r expnum 660043 exptime 114.0 propid 2014B-0404 seeing 2.18 MJD 57953.313 object DECaLS_39628_r decam/CP/V4.8.2/CP20170718/c4d_170719_073302_ooi_r_ls9.fits.fz c4d_180910_023807_ooi_r_ls9-S30 r expnum 771443 exptime 46.0 propid 2014B-0404 seeing 1.41 MJD 58371.110 object DECaLS_39628_r decam/CP/V4.8.2a/CP20180909/c4d_180910_023807_ooi_r_ls9.fits.fz c4d_170916_044805_ooi_g_ls9-S30 g expnum 678025 exptime 127.0 propid 2014B-0404 seeing 1.54 MJD 58012.200 object DECaLS_23756_g decam/CP/V4.8.2a/CP20170915/c4d_170916_044805_ooi_g_ls9.fits.fz c4d_180619_084616_ooi_r_ls9-S30 r expnum 754111 exptime 90.0 propid 2014B-0404 seeing 1.51 MJD 58288.365 object DECaLS_23756_r decam/CP/V4.8.2a/CP20180618/c4d_180619_084616_ooi_r_ls9.fits.fz c4d_180809_052757_ooi_r_ls9-N15 r expnum 763310 exptime 43.0 propid 2014B-0404 seeing 1.32 MJD 58339.228 object DECaLS_7862_r decam/CP/V4.8.2a/CP20180808/c4d_180809_052757_ooi_r_ls9.fits.fz c4d_170922_023436_ooi_g_ls9-N15 g expnum 680112 exptime 169.0 propid 2014B-0404 seeing 1.45 MJD 58018.107 object DECaLS_7862_g decam/CP/V4.8.2a/CP20170921/c4d_170922_023436_ooi_g_ls9.fits.fz c4d_180916_030258_ooi_z_ls9-N15 z expnum 774200 exptime 80.0 propid 2014B-0404 seeing 1.28 MJD 58377.127 object DECaLS_7862_z decam/CP/V4.8.2a/CP20180915/c4d_180916_030258_ooi_z_ls9.fits.fz c4d_160813_055508_ooi_z_ls9-N14 z expnum 563589 exptime 93.0 propid 2014B-0404 seeing 1.02 MJD 57613.245 object DECaLS_23734_z decam/CP/V4.8.2a/CP20160812/c4d_160813_055508_ooi_z_ls9.fits.fz c4d_180903_035649_ooi_r_ls9-N14 r expnum 768333 exptime 40.0 propid 2014B-0404 seeing 1.30 MJD 58364.164 object DECaLS_23734_r decam/CP/V4.8.2a/CP20180902/c4d_180903_035649_ooi_r_ls9.fits.fz c4d_180812_053549_ooi_g_ls9-N14 g expnum 764666 exptime 84.0 propid 2014B-0404 seeing 1.30 MJD 58342.233 object DECaLS_23734_g decam/CP/V4.8.2a/CP20180811/c4d_180812_053549_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180910T023807_oi[S30,noinherit][2046,4094][real]: DECaLS_3962 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170719T073015_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170721T064442_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952528e-g-20170922T023436_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952e572-z-20180916T030258_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530fec-r-20180809T052757_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533374-g-20180812T053549_oi[N14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T084616_oi[S30,noinherit][2046,4094][real]: DECaLS_ Clipping 1917 pixels with anomalously large oow values: max 0.0115455 vs median 0.00639551 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180903T035649_oi[N14,noinherit][2046,4094][real]: DECaLS_2373 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T055245_oi[N14,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952307c-g-20170916T044805_oi[S30,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 40.73 s, CPU: 2.08 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 183 MB, VmData: 215 MB, maxrss: 0.186936 MB Stage tims finished: 2020-08-05T21:30:05.722308 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180910T023807_oi[S30,noinherit][2046,4094][real]: DECaLS_3962 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170719T073015_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952e572-z-20180916T030258_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T084616_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530fec-r-20180809T052757_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180903T035649_oi[N14,noinherit][2046,4094][real]: DECaLS_2373 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T055245_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952307c-g-20170916T044805_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952528e-g-20170922T023436_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 6.694 s worker CPU, 192.013 s worker Wall, Wall: 40.731 s, Cores in use: 0.22, Total efficiency (on 16 cores): 1.3 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/PGC1390638-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/PGC1390638-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170721T064442_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533374-g-20180812T053549_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T21:30:05.747829 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04923.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05179.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05052.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05051.fits Matched 8 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/metrics/cus/reference-custom-347372p11231.fits Stage refs : Wall: 6.20 s, CPU: 2.41 s, VmPeak: 1042 MB, VmSize: 1030 MB, VmRSS: 202 MB, VmData: 233 MB, maxrss: 0.207328 MB Stage refs finished: 2020-08-05T21:30:11.950576 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.204 s, Cores in use: 0.39, Total efficiency (on 16 cores): 2.4 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/PGC1390638-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/PGC1390638-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T21:30:11.977488 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/metrics/cus/outlier-mask-custom-347372p11231.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/metrics/cus/outliers-pre-custom-347372p11231.jpg Image c4d_180903_035649_ooi_r_ls9-N14 r : masking 189 positive outlier pixels and 0 negative outlier pixels Image c4d_180910_023807_ooi_r_ls9-S30 r : masking 136 positive outlier pixels and 0 negative outlier pixels Image c4d_180619_084616_ooi_r_ls9-S30 r : masking 339 positive outlier pixels and 0 negative outlier pixels Image c4d_170719_073302_ooi_r_ls9-S30 r : masking 409 positive outlier pixels and 0 negative outlier pixels Image c4d_180809_052757_ooi_r_ls9-N15 r : masking 491 positive outlier pixels and 0 negative outlier pixels Image c4d_180916_030258_ooi_z_ls9-N15 z : masking 0 positive outlier pixels and 74 negative outlier pixels Image c4d_160813_055508_ooi_z_ls9-N14 z : masking 76 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/metrics/cus/outlier-mask-custom-347372p11231.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/metrics/cus/outliers-post-custom-347372p11231.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/metrics/cus/outliers-masked-pos-custom-347372p11231.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/metrics/cus/outliers-masked-neg-custom-347372p11231.jpg Stage outliers : Wall: 1.76 s, CPU: 1.42 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 221 MB, VmData: 249 MB, maxrss: 0.226044 MB Stage outliers finished: 2020-08-05T21:30:13.738587 Resources for stage outliers : 1.398 s worker CPU, 1.494 s worker Wall, Wall: 1.762 s, Cores in use: 1.60, Total efficiency (on 16 cores): 10.0 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/PGC1390638-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/PGC1390638-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T21:30:13.767892 Stage halos : Wall: 2.14 s, CPU: 1.77 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 221 MB, VmData: 250 MB, maxrss: 0.226348 MB Stage halos finished: 2020-08-05T21:30:15.909822 Resources for stage halos : 0.247 s worker CPU, 1.263 s worker Wall, Wall: 2.143 s, Cores in use: 0.94, Total efficiency (on 16 cores): 5.9 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/PGC1390638-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/PGC1390638-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T21:30:16.114655 PSF sigmas in coadd pixels: ['2.42', '2.50', '2.36', '2.12'] Using average PSF sigma 2.3475038009167863 Gaussian PSF norm 0.12016798084148353 vs pixelized 0.10409149 average tim pixel scale / coadd scale: 1.001173495057302 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-copsf-g.fits.fz PSF sigmas in coadd pixels: ['3.54', '2.29', '2.45', '2.15', '2.11'] Using average PSF sigma 2.5085449175685612 Gaussian PSF norm 0.11245355416928396 vs pixelized 0.08927789 average tim pixel scale / coadd scale: 1.0012163743305638 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.07', '1.65'] Using average PSF sigma 1.8609499972219012 Gaussian PSF norm 0.15158644358795254 vs pixelized 0.123885855 average tim pixel scale / coadd scale: 1.0011226077873316 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.31 s, CPU: 0.22 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 224 MB, VmData: 251 MB, maxrss: 0.229016 MB Stage fit_on_coadds finished: 2020-08-05T21:30:16.420919 Resources for stage fit_on_coadds : 0.286 s worker CPU, 0.286 s worker Wall, Wall: 0.308 s, Cores in use: 1.64, Total efficiency (on 16 cores): 10.3 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/PGC1390638-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/PGC1390638-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T21:30:16.432005 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 41 potential peaks Of 41 potential peaks: 22 in veto map, 5 cut by saddle test, 0 cut by aper test, 14 kept SED z : 14 new peaks Found 35 potential peaks Of 35 potential peaks: 23 in veto map, 5 cut by saddle test, 0 cut by aper test, 7 kept SED r : 7 new peaks Found 43 potential peaks Of 43 potential peaks: 34 in veto map, 5 cut by saddle test, 0 cut by aper test, 4 kept SED g : 4 new peaks Found 44 potential peaks Of 44 potential peaks: 36 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 49 potential peaks Of 49 potential peaks: 43 in veto map, 6 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 27 new sources Median coadd sky for g : 2.3602026e-05 Median coadd sky for r : 7.0862684e-06 Median coadd sky for z : 0.00047822343 Stage srcs : Wall: 1.36 s, CPU: 1.33 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 224 MB, VmData: 251 MB, maxrss: 0.229688 MB Stage srcs finished: 2020-08-05T21:30:17.796837 Resources for stage srcs : 0.103 s worker CPU, 0.103 s worker Wall, Wall: 1.366 s, Cores in use: 1.05, Total efficiency (on 16 cores): 6.5 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/PGC1390638-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/PGC1390638-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T21:30:17.810940 Blob 1 of 19, id: 6, sources: 10, size: 259x199, npix 29373, brick X: 2,261, Y: 46,245, one pixel: 122 46 Blob 2 of 19, id: 8, sources: 4, size: 45x86, npix 2602, brick X: 262,307, Y: 79,165, one pixel: 289 79 Blob 3 of 19, id: 0, sources: 1, size: 71x47, npix 2500, brick X: 104,175, Y: 0,47, one pixel: 110 0 Blob 4 of 19, id: 14, sources: 2, size: 42x61, npix 1456, brick X: 263,305, Y: 232,293, one pixel: 279 232 Blob 5 of 19, id: 1, sources: 1, size: 33x35, npix 769, brick X: 61,94, Y: 6,41, one pixel: 75 6 Blob 6 of 19, id: 12, sources: 1, size: 28x31, npix 620, brick X: 0,28, Y: 206,237, one pixel: 12 206 Blob 7 of 19, id: 16, sources: 1, size: 28x28, npix 510, brick X: 177,205, Y: 264,292, one pixel: 191 264 Blob 8 of 19, id: 18, sources: 1, size: 33x20, npix 490, brick X: 235,268, Y: 287,307, one pixel: 247 287 Blob 9 of 19, id: 3, sources: 1, size: 26x26, npix 429, brick X: 236,262, Y: 28,54, one pixel: 247 28 Blob 10 of 19, id: 17, sources: 1, size: 26x25, npix 402, brick X: 85,111, Y: 271,296, one pixel: 96 271 Blob 11 of 19, id: 13, sources: 1, size: 23x23, npix 327, brick X: 251,274, Y: 217,240, one pixel: 260 217 Blob 12 of 19, id: 5, sources: 1, size: 22x22, npix 284, brick X: 279,301, Y: 39,61, one pixel: 288 39 Blob 13 of 19, id: 9, sources: 1, size: 17x22, npix 246, brick X: 0,17, Y: 157,179, one pixel: 6 157 Blob 14 of 19, id: 15, sources: 1, size: 19x21, npix 246, brick X: 120,139, Y: 244,265, one pixel: 128 244 Blob 15 of 19, id: 2, sources: 1, size: 21x20, npix 240, brick X: 14,35, Y: 8,28, one pixel: 23 8 Blob 16 of 19, id: 11, sources: 1, size: 18x19, npix 212, brick X: 0,18, Y: 187,206, one pixel: 7 187 Blob 17 of 19, id: 10, sources: 1, size: 14x23, npix 205, brick X: 293,307, Y: 166,189, one pixel: 302 166 Blob 3 finished, total: Wall: 0.26 s, CPU: 0.25 s, VmPeak: 959 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149504 MB Blob 18 of 19, id: 4, sources: 1, size: 19x20, npix 200, brick X: 32,51, Y: 29,49, one pixel: 41 29 Blob 10 finished, total: Wall: 0.43 s, CPU: 0.42 s, VmPeak: 949 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 186 MB, maxrss: 0.155356 MB Blob 19 of 19, id: 7, sources: 1, size: 19x18, npix 189, brick X: 37,56, Y: 51,69, one pixel: 45 51 Blob 11 finished, total: Wall: 0.45 s, CPU: 0.44 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093004 MB Blob 9 finished, total: Wall: 0.47 s, CPU: 0.47 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.09522 MB Blob 13 finished, total: Wall: 0.45 s, CPU: 0.44 s, VmPeak: 955 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 186 MB, maxrss: 0.155708 MB Blob 18 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 949 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 186 MB, maxrss: 0.155356 MB Blob 15 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 114 MB, VmData: 167 MB, maxrss: 0.116312 MB Blob 16 finished, total: Wall: 0.46 s, CPU: 0.42 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149444 MB Blob 12 finished, total: Wall: 0.47 s, CPU: 0.38 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148952 MB Blob 6 finished, total: Wall: 0.70 s, CPU: 0.67 s, VmPeak: 957 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.14958 MB Blob 19 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 668 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093232 MB Blob 7 finished, total: Wall: 0.91 s, CPU: 0.91 s, VmPeak: 955 MB, VmSize: 737 MB, VmRSS: 152 MB, VmData: 186 MB, maxrss: 0.155476 MB Blob 14 finished, total: Wall: 0.86 s, CPU: 0.84 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149548 MB Blob 8 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 953 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150108 MB Blob 17 finished, total: Wall: 0.61 s, CPU: 0.61 s, VmPeak: 959 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149504 MB Blob 5 finished, total: Wall: 0.96 s, CPU: 0.87 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 113 MB, VmData: 167 MB, maxrss: 0.115976 MB Blob 4 finished, total: Wall: 1.79 s, CPU: 1.78 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149616 MB Blob 2 finished, total: Wall: 3.01 s, CPU: 3.00 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 115 MB, VmData: 168 MB, maxrss: 0.117464 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.69813, ee1=-0.00017302, ee2=0.10507 Measuring 11 iterative sources Blob 1 finished, total: Wall: 25.38 s, CPU: 25.36 s, VmPeak: 953 MB, VmSize: 746 MB, VmRSS: 166 MB, VmData: 195 MB, maxrss: 0.170144 MB Old catalog: 33 New catalog: 40 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/metrics/cus/blobs-custom-347372p11231.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/metrics/cus/all-models-custom-347372p11231.fits Stage fitblobs : Wall: 27.78 s, CPU: 2.19 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 225 MB, VmData: 251 MB, maxrss: 0.230108 MB Stage fitblobs finished: 2020-08-05T21:30:45.590362 Resources for stage fitblobs : 39.043 s worker CPU, 42.061 s worker Wall, Wall: 27.781 s, Cores in use: 1.48, Total efficiency (on 16 cores): 9.3 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/PGC1390638-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/PGC1390638-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T21:30:45.609401 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/tmp-legacysurvey-custom-347372p11231-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/tmp-legacysurvey-custom-347372p11231-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/tmp-legacysurvey-custom-347372p11231-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/tmp-legacysurvey-custom-347372p11231-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-resid.jpg Stage coadds : Wall: 3.57 s, CPU: 1.52 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 225 MB, VmData: 251 MB, maxrss: 0.23056 MB Stage coadds finished: 2020-08-05T21:30:49.174440 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 10.614 s worker CPU, 16.466 s worker Wall, Wall: 3.567 s, Cores in use: 3.40, Total efficiency (on 16 cores): 21.3 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/PGC1390638-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/PGC1390638-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T21:30:49.315809 Cut to 1 unWISE tiles Reading WISE tile 3476p106 band 3 Reading WISE tile 3476p106 band 1 Reading WISE tile 3476p106 band 4 Reading WISE tile 3476p106 band 2 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 949 MB, VmSize: 810 MB, VmRSS: 149 MB, VmData: 175 MB, maxrss: 0.211732 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 955 MB, VmSize: 811 MB, VmRSS: 153 MB, VmData: 176 MB, maxrss: 0.19614 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 955 MB, VmSize: 808 MB, VmRSS: 148 MB, VmData: 173 MB, maxrss: 0.212516 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 805 MB, VmSize: 803 MB, VmRSS: 143 MB, VmData: 171 MB, maxrss: 0.206936 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/tmp-legacysurvey-custom-347372p11231-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/tmp-legacysurvey-custom-347372p11231-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.28 s, CPU: 1.20 s, VmPeak: 1042 MB, VmSize: 1040 MB, VmRSS: 226 MB, VmData: 251 MB, maxrss: 0.231264 MB Stage wise_forced finished: 2020-08-05T21:30:52.593755 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.410 s worker CPU, 4.640 s worker Wall, Wall: 3.280 s, Cores in use: 1.41, Total efficiency (on 16 cores): 8.8 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/PGC1390638-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/PGC1390638-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T21:30:52.609088 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/coadd/cus/custom-347372p11231/legacysurvey-custom-347372p11231-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/tractor-i/cus/tractor-custom-347372p11231.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/tractor/cus/tractor-custom-347372p11231.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/tractor/cus/brick-custom-347372p11231.sha256sum Stage writecat : Wall: 1.08 s, CPU: 0.92 s, VmPeak: 1172 MB, VmSize: 1044 MB, VmRSS: 228 MB, VmData: 251 MB, maxrss: 0.36414 MB Stage writecat finished: 2020-08-05T21:30:53.685629 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.078 s, Cores in use: 0.85, Total efficiency (on 16 cores): 5.3 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/PGC1390638-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1390638/PGC1390638-largegalaxy-writecat.p All done: 61.799 s worker CPU, 258.328 s worker Wall, Wall: 88.712 s, Cores in use: 0.87, Total efficiency (on 16 cores): 5.4 % Finished galaxy PGC1390638 in 1.552 minutes. Started working on galaxy PGC1390638 at Mon Aug 10 10:34:49 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.3720563105683 11.232075613866357 --width 307 --height 307 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/PGC1390638-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/PGC1390638-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-10T10:34:50.616831 legacypipe git version: DR9.5.11-watershed-6-g6a2880fc Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '347.3720563105683', '11.232075613866357', '--width', '307', '--height', '307', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/PGC1390638-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/PGC1390638-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.3720563105683 11.232075613866357 --width 307 --height 307 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/PGC1390638-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/PGC1390638-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 347.3720563105683 11.232075613866357 Starting process 12908 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 12909 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 12910 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 12911 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 12912 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB Starting process 12913 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 12915 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 12914 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-10T10:34:51.025885 Keeping 11 CCDs: c4d_170721_064746_ooi_g_ls9-S30 g expnum 660491 exptime 131.0 propid 2014B-0404 seeing 1.49 MJD 57955.281 object DECaLS_39628_g decam/CP/V4.8.2/CP20170720/c4d_170721_064746_ooi_g_ls9.fits.fz c4d_170719_073302_ooi_r_ls9-S30 r expnum 660043 exptime 114.0 propid 2014B-0404 seeing 2.18 MJD 57953.313 object DECaLS_39628_r decam/CP/V4.8.2/CP20170718/c4d_170719_073302_ooi_r_ls9.fits.fz c4d_180910_023807_ooi_r_ls9-S30 r expnum 771443 exptime 46.0 propid 2014B-0404 seeing 1.41 MJD 58371.110 object DECaLS_39628_r decam/CP/V4.8.2a/CP20180909/c4d_180910_023807_ooi_r_ls9.fits.fz c4d_170916_044805_ooi_g_ls9-S30 g expnum 678025 exptime 127.0 propid 2014B-0404 seeing 1.54 MJD 58012.200 object DECaLS_23756_g decam/CP/V4.8.2a/CP20170915/c4d_170916_044805_ooi_g_ls9.fits.fz c4d_180619_084616_ooi_r_ls9-S30 r expnum 754111 exptime 90.0 propid 2014B-0404 seeing 1.51 MJD 58288.365 object DECaLS_23756_r decam/CP/V4.8.2a/CP20180618/c4d_180619_084616_ooi_r_ls9.fits.fz c4d_180809_052757_ooi_r_ls9-N15 r expnum 763310 exptime 43.0 propid 2014B-0404 seeing 1.32 MJD 58339.228 object DECaLS_7862_r decam/CP/V4.8.2a/CP20180808/c4d_180809_052757_ooi_r_ls9.fits.fz c4d_170922_023436_ooi_g_ls9-N15 g expnum 680112 exptime 169.0 propid 2014B-0404 seeing 1.45 MJD 58018.107 object DECaLS_7862_g decam/CP/V4.8.2a/CP20170921/c4d_170922_023436_ooi_g_ls9.fits.fz c4d_180916_030258_ooi_z_ls9-N15 z expnum 774200 exptime 80.0 propid 2014B-0404 seeing 1.28 MJD 58377.127 object DECaLS_7862_z decam/CP/V4.8.2a/CP20180915/c4d_180916_030258_ooi_z_ls9.fits.fz c4d_160813_055508_ooi_z_ls9-N14 z expnum 563589 exptime 93.0 propid 2014B-0404 seeing 1.02 MJD 57613.245 object DECaLS_23734_z decam/CP/V4.8.2a/CP20160812/c4d_160813_055508_ooi_z_ls9.fits.fz c4d_180903_035649_ooi_r_ls9-N14 r expnum 768333 exptime 40.0 propid 2014B-0404 seeing 1.30 MJD 58364.164 object DECaLS_23734_r decam/CP/V4.8.2a/CP20180902/c4d_180903_035649_ooi_r_ls9.fits.fz c4d_180812_053549_ooi_g_ls9-N14 g expnum 764666 exptime 84.0 propid 2014B-0404 seeing 1.30 MJD 58342.233 object DECaLS_23734_g decam/CP/V4.8.2a/CP20180811/c4d_180812_053549_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170719T073015_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180910T023807_oi[S30,noinherit][2046,4094][real]: DECaLS_3962 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170721T064442_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952528e-g-20170922T023436_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T084616_oi[S30,noinherit][2046,4094][real]: DECaLS_ Clipping 1947 pixels with anomalously large oow values: max 0.0115455 vs median 0.00639551 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952e572-z-20180916T030258_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530fec-r-20180809T052757_oi[N15,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180903T035649_oi[N14,noinherit][2046,4094][real]: DECaLS_2373 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T055245_oi[N14,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533374-g-20180812T053549_oi[N14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952307c-g-20170916T044805_oi[S30,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 83.07 s, CPU: 0.85 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 181 MB, VmData: 214 MB, maxrss: 0.185072 MB Stage tims finished: 2020-08-10T10:36:14.092682 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T084616_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170721T064442_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530fec-r-20180809T052757_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180910T023807_oi[S30,noinherit][2046,4094][real]: DECaLS_3962 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180903T035649_oi[N14,noinherit][2046,4094][real]: DECaLS_2373 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952e572-z-20180916T030258_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T055245_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170719T073015_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533374-g-20180812T053549_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952307c-g-20170916T044805_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952528e-g-20170922T023436_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 5.585 s worker CPU, 387.840 s worker Wall, Wall: 83.068 s, Cores in use: 0.08, Total efficiency (on 8 cores): 1.0 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/PGC1390638-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/PGC1390638-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-10T10:36:14.453980 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04923.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05179.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05052.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05051.fits Matched 8 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/metrics/cus/reference-custom-347372p11232.fits Stage refs : Wall: 8.04 s, CPU: 2.10 s, VmPeak: 1036 MB, VmSize: 1024 MB, VmRSS: 200 MB, VmData: 233 MB, maxrss: 0.204948 MB Stage refs finished: 2020-08-10T10:36:22.490508 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.038 s, Cores in use: 0.26, Total efficiency (on 8 cores): 3.3 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/PGC1390638-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/PGC1390638-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-10T10:36:22.696088 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/metrics/cus/outlier-mask-custom-347372p11232.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/metrics/cus/outliers-pre-custom-347372p11232.jpg Image c4d_180619_084616_ooi_r_ls9-S30 r : masking 356 positive outlier pixels and 250 negative outlier pixels Image c4d_180809_052757_ooi_r_ls9-N15 r : masking 627 positive outlier pixels and 0 negative outlier pixels Image c4d_170719_073302_ooi_r_ls9-S30 r : masking 411 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/metrics/cus/outlier-mask-custom-347372p11232.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/metrics/cus/outliers-post-custom-347372p11232.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/metrics/cus/outliers-masked-pos-custom-347372p11232.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/metrics/cus/outliers-masked-neg-custom-347372p11232.jpg Stage outliers : Wall: 0.89 s, CPU: 0.67 s, VmPeak: 1036 MB, VmSize: 1033 MB, VmRSS: 218 MB, VmData: 249 MB, maxrss: 0.22374 MB Stage outliers finished: 2020-08-10T10:36:23.588564 Resources for stage outliers : 1.127 s worker CPU, 1.135 s worker Wall, Wall: 0.894 s, Cores in use: 2.01, Total efficiency (on 8 cores): 25.1 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/PGC1390638-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/PGC1390638-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-10T10:36:23.616597 Stage halos : Wall: 0.40 s, CPU: 0.28 s, VmPeak: 1036 MB, VmSize: 1033 MB, VmRSS: 219 MB, VmData: 249 MB, maxrss: 0.224152 MB Stage halos finished: 2020-08-10T10:36:24.015379 Resources for stage halos : 0.230 s worker CPU, 0.627 s worker Wall, Wall: 0.400 s, Cores in use: 1.28, Total efficiency (on 8 cores): 16.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/PGC1390638-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/PGC1390638-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-10T10:36:24.050773 PSF sigmas in coadd pixels: ['2.42', '2.50', '2.36', '2.12'] Using average PSF sigma 2.3475038009167863 Gaussian PSF norm 0.12016798084148353 vs pixelized 0.10408877 average tim pixel scale / coadd scale: 1.001173495057302 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-copsf-g.fits.fz PSF sigmas in coadd pixels: ['3.54', '2.29', '2.45', '2.15', '2.11'] Using average PSF sigma 2.5085449175685612 Gaussian PSF norm 0.11245355416928396 vs pixelized 0.0892766 average tim pixel scale / coadd scale: 1.0012163743305638 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.07', '1.65'] Using average PSF sigma 1.8609499972219012 Gaussian PSF norm 0.15158644358795254 vs pixelized 0.12389056 average tim pixel scale / coadd scale: 1.0011226077873316 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.23 s, CPU: 0.22 s, VmPeak: 1036 MB, VmSize: 1033 MB, VmRSS: 221 MB, VmData: 249 MB, maxrss: 0.226044 MB Stage fit_on_coadds finished: 2020-08-10T10:36:24.282907 Resources for stage fit_on_coadds : 0.285 s worker CPU, 0.292 s worker Wall, Wall: 0.233 s, Cores in use: 2.16, Total efficiency (on 8 cores): 26.9 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/PGC1390638-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/PGC1390638-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-10T10:36:24.294248 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 42 potential peaks Of 42 potential peaks: 24 in veto map, 5 cut by saddle test, 0 cut by aper test, 13 kept SED z : 13 new peaks Found 35 potential peaks Of 35 potential peaks: 25 in veto map, 4 cut by saddle test, 0 cut by aper test, 6 kept SED r : 6 new peaks Found 41 potential peaks Of 41 potential peaks: 33 in veto map, 5 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 42 potential peaks Of 42 potential peaks: 32 in veto map, 6 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 49 potential peaks Of 49 potential peaks: 42 in veto map, 7 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 26 new sources Median coadd sky for g : 1.6002154e-05 Median coadd sky for r : -3.7211082e-06 Median coadd sky for z : 0.00035867206 Stage srcs : Wall: 0.67 s, CPU: 0.60 s, VmPeak: 1036 MB, VmSize: 1033 MB, VmRSS: 221 MB, VmData: 249 MB, maxrss: 0.2266 MB Stage srcs finished: 2020-08-10T10:36:24.964930 Resources for stage srcs : 0.151 s worker CPU, 0.151 s worker Wall, Wall: 0.672 s, Cores in use: 1.12, Total efficiency (on 8 cores): 14.1 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/PGC1390638-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/PGC1390638-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-10T10:36:24.979483 Blob 1 of 18, id: 6, sources: 10, size: 255x200, npix 29358, brick X: 5,260, Y: 40,240, one pixel: 122 40 Blob 2 of 18, id: 7, sources: 4, size: 45x86, npix 2644, brick X: 262,307, Y: 73,159, one pixel: 289 73 Blob 3 of 18, id: 1, sources: 1, size: 69x41, npix 2086, brick X: 104,173, Y: 0,41, one pixel: 110 0 Blob 4 of 18, id: 13, sources: 2, size: 41x61, npix 1446, brick X: 263,304, Y: 226,287, one pixel: 279 226 Blob 5 of 18, id: 0, sources: 1, size: 33x35, npix 760, brick X: 60,93, Y: 0,35, one pixel: 76 0 Blob 6 of 18, id: 17, sources: 1, size: 36x26, npix 686, brick X: 232,268, Y: 281,307, one pixel: 248 281 Blob 7 of 18, id: 11, sources: 1, size: 27x30, npix 604, brick X: 0,27, Y: 201,231, one pixel: 10 201 Blob 8 of 18, id: 15, sources: 1, size: 29x27, npix 509, brick X: 176,205, Y: 259,286, one pixel: 189 259 Blob 9 of 18, id: 3, sources: 1, size: 26x25, npix 426, brick X: 235,261, Y: 23,48, one pixel: 245 23 Blob 3 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 949 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146032 MB Blob 10 of 18, id: 16, sources: 1, size: 25x24, npix 390, brick X: 85,110, Y: 266,290, one pixel: 95 266 Blob 7 finished, total: Wall: 0.84 s, CPU: 0.83 s, VmPeak: 965 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.144912 MB Blob 11 of 18, id: 9, sources: 1, size: 16x32, npix 357, brick X: 291,307, Y: 154,186, one pixel: 299 154 Blob 9 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 949 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146032 MB Blob 12 of 18, id: 12, sources: 1, size: 23x23, npix 325, brick X: 250,273, Y: 211,234, one pixel: 260 211 Blob 5 finished, total: Wall: 1.08 s, CPU: 1.08 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.14486 MB Blob 13 of 18, id: 5, sources: 1, size: 22x21, npix 271, brick X: 278,300, Y: 34,55, one pixel: 287 34 Blob 8 finished, total: Wall: 1.17 s, CPU: 1.17 s, VmPeak: 969 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145432 MB Blob 14 of 18, id: 2, sources: 1, size: 20x21, npix 239, brick X: 14,34, Y: 2,23, one pixel: 23 2 Blob 10 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 965 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.144912 MB Blob 15 of 18, id: 14, sources: 1, size: 19x21, npix 236, brick X: 119,138, Y: 239,260, one pixel: 127 239 Blob 11 finished, total: Wall: 0.20 s, CPU: 0.20 s, VmPeak: 949 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146032 MB Blob 16 of 18, id: 8, sources: 1, size: 16x21, npix 216, brick X: 0,16, Y: 152,173, one pixel: 5 152 Blob 13 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 969 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145432 MB Blob 17 of 18, id: 4, sources: 1, size: 19x19, npix 208, brick X: 31,50, Y: 24,43, one pixel: 39 24 Blob 12 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.14486 MB Blob 18 of 18, id: 10, sources: 1, size: 17x20, npix 203, brick X: 0,17, Y: 181,201, one pixel: 7 181 Blob 17 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.14486 MB Blob 6 finished, total: Wall: 1.61 s, CPU: 1.61 s, VmPeak: 955 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14574 MB Blob 14 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 965 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.144912 MB Blob 16 finished, total: Wall: 0.43 s, CPU: 0.42 s, VmPeak: 969 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145432 MB Blob 18 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.14486 MB Blob 15 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 949 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146696 MB Measuring 1 iterative sources Blob 4 finished, total: Wall: 2.38 s, CPU: 2.38 s, VmPeak: 955 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.14678 MB Blob 2 finished, total: Wall: 3.47 s, CPU: 3.46 s, VmPeak: 967 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145256 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.24735, ee1=0.0106657, ee2=0.0287494 Measuring 6 iterative sources Blob 1 finished, total: Wall: 33.68 s, CPU: 33.68 s, VmPeak: 955 MB, VmSize: 735 MB, VmRSS: 159 MB, VmData: 190 MB, maxrss: 0.162896 MB Old catalog: 32 New catalog: 33 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/metrics/cus/blobs-custom-347372p11232.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/metrics/cus/all-models-custom-347372p11232.fits Stage fitblobs : Wall: 34.04 s, CPU: 0.37 s, VmPeak: 1036 MB, VmSize: 1033 MB, VmRSS: 222 MB, VmData: 249 MB, maxrss: 0.22702 MB Stage fitblobs finished: 2020-08-10T10:36:59.016853 Resources for stage fitblobs : 48.791 s worker CPU, 48.834 s worker Wall, Wall: 34.038 s, Cores in use: 1.44, Total efficiency (on 8 cores): 18.1 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/PGC1390638-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/PGC1390638-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-10T10:36:59.102691 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/tmp-legacysurvey-custom-347372p11232-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/tmp-legacysurvey-custom-347372p11232-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/tmp-legacysurvey-custom-347372p11232-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/tmp-legacysurvey-custom-347372p11232-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-resid.jpg Stage coadds : Wall: 1.26 s, CPU: 0.54 s, VmPeak: 1036 MB, VmSize: 1033 MB, VmRSS: 222 MB, VmData: 249 MB, maxrss: 0.227472 MB Stage coadds finished: 2020-08-10T10:37:00.359369 Resources for stage coadds : 3.934 s worker CPU, 4.175 s worker Wall, Wall: 1.258 s, Cores in use: 3.56, Total efficiency (on 8 cores): 44.5 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/PGC1390638-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/PGC1390638-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-10T10:37:00.372386 Cut to 1 unWISE tiles Reading WISE tile 3476p106 band 1 Reading WISE tile 3476p106 band 2 Reading WISE tile 3476p106 band 4 Reading WISE tile 3476p106 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 967 MB, VmSize: 806 MB, VmRSS: 149 MB, VmData: 178 MB, maxrss: 0.190488 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 949 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.208656 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 955 MB, VmSize: 805 MB, VmRSS: 152 MB, VmData: 176 MB, maxrss: 0.21662 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 956 MB, VmSize: 802 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.207548 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/tmp-legacysurvey-custom-347372p11232-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/tmp-legacysurvey-custom-347372p11232-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.36 s, CPU: 0.46 s, VmPeak: 1036 MB, VmSize: 1033 MB, VmRSS: 223 MB, VmData: 249 MB, maxrss: 0.228176 MB Stage wise_forced finished: 2020-08-10T10:37:02.737132 Resources for stage wise_forced : 3.245 s worker CPU, 3.639 s worker Wall, Wall: 2.366 s, Cores in use: 1.57, Total efficiency (on 8 cores): 19.6 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/PGC1390638-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/PGC1390638-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-10T10:37:03.013171 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/coadd/cus/custom-347372p11232/legacysurvey-custom-347372p11232-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/tractor-i/cus/tractor-custom-347372p11232.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/tractor/cus/tractor-custom-347372p11232.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/tractor/cus/brick-custom-347372p11232.sha256sum Stage writecat : Wall: 2.48 s, CPU: 0.63 s, VmPeak: 1166 MB, VmSize: 1038 MB, VmRSS: 225 MB, VmData: 249 MB, maxrss: 0.361048 MB Stage writecat finished: 2020-08-10T10:37:05.495924 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.484 s, Cores in use: 0.25, Total efficiency (on 8 cores): 3.2 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/PGC1390638-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1390638/PGC1390638-largegalaxy-writecat.p All done: 63.351 s worker CPU, 446.694 s worker Wall, Wall: 134.491 s, Cores in use: 0.52, Total efficiency (on 8 cores): 6.5 % Finished galaxy PGC1390638 in 2.268 minutes.