Started working on galaxy PGC1383089 at Wed Aug 5 21:37:46 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.9525475 10.6873837 --width 315 --height 315 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/PGC1383089-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/PGC1383089-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T21:37:47.966230 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '347.9525475', '10.6873837', '--width', '315', '--height', '315', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/PGC1383089-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/PGC1383089-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.9525475 10.6873837 --width 315 --height 315 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/PGC1383089-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/PGC1383089-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 347.9525475 10.6873837 Starting process 24654 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 24655 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 24656 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 24657 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 24658 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059472 MB Starting process 24659 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05942 MB Starting process 24660 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05942 MB Starting process 24661 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 24662 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 24663 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 24664 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 24666 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 24669 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 24670 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 24671 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 24672 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T21:37:49.434027 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 8 CCDs: c4d_140815_075529_ooi_z_ls9-S18 z expnum 348047 exptime 138.0 propid 2014B-0404 seeing 0.94 MJD 56884.328 object DECaLS_39628_z decam/CP/V4.8.2a/CP20140814/c4d_140815_075529_ooi_z_ls9.fits.fz c4d_180910_023807_ooi_r_ls9-S18 r expnum 771443 exptime 46.0 propid 2014B-0404 seeing 1.36 MJD 58371.110 object DECaLS_39628_r decam/CP/V4.8.2a/CP20180909/c4d_180910_023807_ooi_r_ls9.fits.fz c4d_160813_055306_ooi_z_ls9-S19 z expnum 563588 exptime 90.0 propid 2014B-0404 seeing 0.95 MJD 57613.244 object DECaLS_23756_z decam/CP/V4.8.2a/CP20160812/c4d_160813_055306_ooi_z_ls9.fits.fz c4d_170916_044805_ooi_g_ls9-S19 g expnum 678025 exptime 127.0 propid 2014B-0404 seeing 1.52 MJD 58012.200 object DECaLS_23756_g decam/CP/V4.8.2a/CP20170915/c4d_170916_044805_ooi_g_ls9.fits.fz c4d_180619_084616_ooi_r_ls9-S19 r expnum 754111 exptime 90.0 propid 2014B-0404 seeing 1.48 MJD 58288.365 object DECaLS_23756_r decam/CP/V4.8.2a/CP20180618/c4d_180619_084616_ooi_r_ls9.fits.fz c4d_180809_052757_ooi_r_ls9-N31 r expnum 763310 exptime 43.0 propid 2014B-0404 seeing 1.30 MJD 58339.228 object DECaLS_7862_r decam/CP/V4.8.2a/CP20180808/c4d_180809_052757_ooi_r_ls9.fits.fz c4d_170721_064746_ooi_g_ls9-S18 g expnum 660491 exptime 131.0 propid 2014B-0404 seeing 1.39 MJD 57955.281 object DECaLS_39628_g decam/CP/V4.8.2/CP20170720/c4d_170721_064746_ooi_g_ls9.fits.fz c4d_170719_073302_ooi_r_ls9-S18 r expnum 660043 exptime 114.0 propid 2014B-0404 seeing 2.28 MJD 57953.313 object DECaLS_39628_r decam/CP/V4.8.2/CP20170718/c4d_170719_073302_ooi_r_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T084616_oi[S19,noinherit][2046,4094][real]: DECaLS_ Clipping 2831 pixels with anomalously large oow values: max 0.0104382 vs median 0.00585005 Masking 0 additional saturated pixels in DECam expnum 754111 S19 CCD, decam/CP/V4.8.2a/CP20180618/c4d_180619_084616_ooi_r_ls9.fits.fz slice (slice(1065, 1381, None), slice(925, 1241, None)) The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170719T073015_oi[S18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180910T023807_oi[S18,noinherit][2046,4094][real]: DECaLS_3962 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170721T064442_oi[S18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T055045_oi[S19,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954cb27-z-20140815T075216_oi[S18,noinherit][2046,4094][real]: DECaLS_ Masking 10 additional saturated pixels in DECam expnum 563588 S19 CCD, decam/CP/V4.8.2a/CP20160812/c4d_160813_055306_ooi_z_ls9.fits.fz slice (slice(1091, 1407, None), slice(874, 1191, None)) Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952307c-g-20170916T044805_oi[S19,noinherit][2046,4094][real]: DECaLS_ Masking 2 additional saturated pixels in DECam expnum 678025 S19 CCD, decam/CP/V4.8.2a/CP20170915/c4d_170916_044805_ooi_g_ls9.fits.fz slice (slice(1050, 1366, None), slice(922, 1238, None)) Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 72.01 s, CPU: 1.68 s, VmPeak: 1010 MB, VmSize: 1010 MB, VmRSS: 178 MB, VmData: 210 MB, maxrss: 0.219472 MB Stage tims finished: 2020-08-05T21:39:01.441255 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954cb27-z-20140815T075216_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170719T073015_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T055045_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170721T064442_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952307c-g-20170916T044805_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 4.416 s worker CPU, 342.941 s worker Wall, Wall: 72.009 s, Cores in use: 0.08, Total efficiency (on 16 cores): 0.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/PGC1383089-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/PGC1383089-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180910T023807_oi[S18,noinherit][2046,4094][real]: DECaLS_3962 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T21:39:01.464893 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04923.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05179.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05052.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/metrics/cus/reference-custom-347952p10687.fits Stage refs : Wall: 11.55 s, CPU: 3.12 s, VmPeak: 1041 MB, VmSize: 1029 MB, VmRSS: 198 MB, VmData: 229 MB, maxrss: 0.219472 MB Stage refs finished: 2020-08-05T21:39:13.019645 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T084616_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 11.556 s, Cores in use: 0.27, Total efficiency (on 16 cores): 1.7 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/PGC1383089-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/PGC1383089-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T21:39:13.047630 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/metrics/cus/outlier-mask-custom-347952p10687.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/metrics/cus/outliers-pre-custom-347952p10687.jpg Image c4d_170719_073302_ooi_r_ls9-S18 r : masking 0 positive outlier pixels and 145 negative outlier pixels Image c4d_180619_084616_ooi_r_ls9-S19 r : masking 14095 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/metrics/cus/outlier-mask-custom-347952p10687.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/metrics/cus/outliers-post-custom-347952p10687.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/metrics/cus/outliers-masked-pos-custom-347952p10687.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/metrics/cus/outliers-masked-neg-custom-347952p10687.jpg Stage outliers : Wall: 4.07 s, CPU: 3.17 s, VmPeak: 1041 MB, VmSize: 1039 MB, VmRSS: 215 MB, VmData: 243 MB, maxrss: 0.220336 MB Stage outliers finished: 2020-08-05T21:39:17.114527 Resources for stage outliers : 0.814 s worker CPU, 0.891 s worker Wall, Wall: 4.068 s, Cores in use: 0.98, Total efficiency (on 16 cores): 6.1 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/PGC1383089-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/PGC1383089-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T21:39:17.219747 Stage halos : Wall: 1.58 s, CPU: 1.50 s, VmPeak: 1041 MB, VmSize: 1039 MB, VmRSS: 216 MB, VmData: 243 MB, maxrss: 0.220768 MB Stage halos finished: 2020-08-05T21:39:18.798136 Resources for stage halos : 0.317 s worker CPU, 0.464 s worker Wall, Wall: 1.580 s, Cores in use: 1.15, Total efficiency (on 16 cores): 7.2 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/PGC1383089-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/PGC1383089-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T21:39:19.136753 PSF sigmas in coadd pixels: ['2.46', '2.26'] Using average PSF sigma 2.3622412724554827 Gaussian PSF norm 0.11941828087723175 vs pixelized 0.099362835 average tim pixel scale / coadd scale: 1.001179393581719 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.21', '2.41', '3.70'] Using average PSF sigma 2.7739798726943636 Gaussian PSF norm 0.10169316459382952 vs pixelized 0.081644624 average tim pixel scale / coadd scale: 1.0012241990397903 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.53', '1.55'] Using average PSF sigma 1.537922115153582 Gaussian PSF norm 0.18342592839671026 vs pixelized 0.15708683 average tim pixel scale / coadd scale: 1.0011561993840115 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.18 s, CPU: 0.17 s, VmPeak: 1041 MB, VmSize: 1039 MB, VmRSS: 217 MB, VmData: 243 MB, maxrss: 0.22236 MB Stage fit_on_coadds finished: 2020-08-05T21:39:19.320097 Resources for stage fit_on_coadds : 0.223 s worker CPU, 0.223 s worker Wall, Wall: 0.185 s, Cores in use: 2.11, Total efficiency (on 16 cores): 13.2 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/PGC1383089-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/PGC1383089-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T21:39:19.330925 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 117 potential peaks Of 117 potential peaks: 80 in veto map, 7 cut by saddle test, 0 cut by aper test, 30 kept SED z : 30 new peaks Found 82 potential peaks Of 82 potential peaks: 73 in veto map, 8 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 74 potential peaks Of 74 potential peaks: 64 in veto map, 7 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 130 potential peaks Of 130 potential peaks: 115 in veto map, 10 cut by saddle test, 0 cut by aper test, 5 kept SED Flat : 5 new peaks Found 215 potential peaks Of 215 potential peaks: 204 in veto map, 11 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 39 new sources Median coadd sky for g : 0.0002624414 Median coadd sky for r : 0.000434626 Median coadd sky for z : 0.0012118099 Stage srcs : Wall: 2.13 s, CPU: 2.07 s, VmPeak: 1041 MB, VmSize: 1039 MB, VmRSS: 218 MB, VmData: 243 MB, maxrss: 0.222892 MB Stage srcs finished: 2020-08-05T21:39:21.462749 Resources for stage srcs : 0.127 s worker CPU, 0.127 s worker Wall, Wall: 2.133 s, Cores in use: 1.03, Total efficiency (on 16 cores): 6.5 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/PGC1383089-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/PGC1383089-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T21:39:21.537364 Blob 1 of 11, id: 0, sources: 30, size: 300x315, npix 51197, brick X: 8,308, Y: 0,315, one pixel: 148 0 Blob 2 of 11, id: 5, sources: 1, size: 42x41, npix 1231, brick X: 2,44, Y: 58,99, one pixel: 16 58 Blob 3 of 11, id: 8, sources: 1, size: 39x35, npix 992, brick X: 19,58, Y: 280,315, one pixel: 41 280 Blob 4 of 11, id: 6, sources: 2, size: 43x30, npix 757, brick X: 0,43, Y: 201,231, one pixel: 31 201 Blob 5 of 11, id: 4, sources: 2, size: 35x35, npix 733, brick X: 43,78, Y: 33,68, one pixel: 53 33 Blob 6 of 11, id: 2, sources: 1, size: 29x34, npix 631, brick X: 6,35, Y: 17,51, one pixel: 17 17 Blob 7 of 11, id: 9, sources: 2, size: 40x28, npix 596, brick X: 126,166, Y: 286,314, one pixel: 153 286 Blob 8 of 11, id: 3, sources: 1, size: 29x29, npix 579, brick X: 276,305, Y: 26,55, one pixel: 289 26 Blob 9 of 11, id: 1, sources: 1, size: 21x22, npix 270, brick X: 50,71, Y: 5,27, one pixel: 60 5 Blob 10 of 11, id: 10, sources: 1, size: 22x20, npix 258, brick X: 76,98, Y: 293,313, one pixel: 85 293 Blob 11 of 11, id: 7, sources: 1, size: 19x19, npix 199, brick X: 30,49, Y: 254,273, one pixel: 38 254 Blob 11 finished, total: Wall: 0.10 s, CPU: 0.08 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 85 MB, VmData: 138 MB, maxrss: 0.087408 MB Blob 10 finished, total: Wall: 0.08 s, CPU: 0.06 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148896 MB Blob 9 finished, total: Wall: 0.25 s, CPU: 0.23 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.096636 MB Blob 7 finished, total: Wall: 0.47 s, CPU: 0.46 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 98 MB, VmData: 145 MB, maxrss: 0.099996 MB Measuring 1 iterative sources Blob 8 finished, total: Wall: 0.62 s, CPU: 0.60 s, VmPeak: 950 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149576 MB Blob 4 finished, total: Wall: 0.66 s, CPU: 0.65 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 114 MB, VmData: 167 MB, maxrss: 0.11716 MB Blob 2 finished, total: Wall: 0.90 s, CPU: 0.90 s, VmPeak: 957 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 186 MB, maxrss: 0.155352 MB Measuring 1 iterative sources Measuring 1 iterative sources Blob 6 finished, total: Wall: 1.25 s, CPU: 1.24 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 115 MB, VmData: 167 MB, maxrss: 0.117356 MB Blob 5 finished, total: Wall: 1.51 s, CPU: 1.50 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150152 MB Blob 3 finished, total: Wall: 1.99 s, CPU: 1.97 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 115 MB, VmData: 168 MB, maxrss: 0.11754 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.48375, ee1=-0.095979, ee2=0.143169 Measuring 20 iterative sources Blob 1 finished, total: Wall: 45.75 s, CPU: 45.75 s, VmPeak: 956 MB, VmSize: 772 MB, VmRSS: 196 MB, VmData: 221 MB, maxrss: 0.205088 MB Old catalog: 47 New catalog: 60 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/metrics/cus/blobs-custom-347952p10687.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/metrics/cus/all-models-custom-347952p10687.fits Stage fitblobs : Wall: 47.89 s, CPU: 1.58 s, VmPeak: 1041 MB, VmSize: 1039 MB, VmRSS: 220 MB, VmData: 245 MB, maxrss: 0.225356 MB Stage fitblobs finished: 2020-08-05T21:40:09.425447 Resources for stage fitblobs : 53.635 s worker CPU, 58.602 s worker Wall, Wall: 47.890 s, Cores in use: 1.15, Total efficiency (on 16 cores): 7.2 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/PGC1383089-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/PGC1383089-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T21:40:09.453712 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/tmp-legacysurvey-custom-347952p10687-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/tmp-legacysurvey-custom-347952p10687-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/tmp-legacysurvey-custom-347952p10687-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/tmp-legacysurvey-custom-347952p10687-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-resid.jpg Stage coadds : Wall: 5.25 s, CPU: 2.72 s, VmPeak: 1041 MB, VmSize: 1039 MB, VmRSS: 221 MB, VmData: 245 MB, maxrss: 0.22592 MB Stage coadds finished: 2020-08-05T21:40:14.701410 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 13.336 s worker CPU, 21.427 s worker Wall, Wall: 5.249 s, Cores in use: 3.06, Total efficiency (on 16 cores): 19.1 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/PGC1383089-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/PGC1383089-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T21:40:14.717896 Cut to 1 unWISE tiles Reading WISE tile 3476p106 band 1 Reading WISE tile 3476p106 band 2 Reading WISE tile 3476p106 band 3 Reading WISE tile 3476p106 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 953 MB, VmSize: 803 MB, VmRSS: 149 MB, VmData: 172 MB, maxrss: 0.210004 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.14 s, CPU: 0.14 s, VmPeak: 950 MB, VmSize: 812 MB, VmRSS: 154 MB, VmData: 177 MB, maxrss: 0.193916 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 957 MB, VmSize: 806 MB, VmRSS: 147 MB, VmData: 171 MB, maxrss: 0.208456 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 808 MB, VmSize: 808 MB, VmRSS: 153 MB, VmData: 180 MB, maxrss: 0.216184 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/tmp-legacysurvey-custom-347952p10687-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/tmp-legacysurvey-custom-347952p10687-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.63 s, CPU: 1.74 s, VmPeak: 1041 MB, VmSize: 1039 MB, VmRSS: 221 MB, VmData: 245 MB, maxrss: 0.226628 MB Stage wise_forced finished: 2020-08-05T21:40:18.349002 Resources for stage wise_forced : 3.727 s worker CPU, 5.754 s worker Wall, Wall: 3.633 s, Cores in use: 1.50, Total efficiency (on 16 cores): 9.4 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/PGC1383089-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/PGC1383089-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T21:40:18.368682 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/tractor-i/cus/tractor-custom-347952p10687.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/tractor/cus/tractor-custom-347952p10687.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/tractor/cus/brick-custom-347952p10687.sha256sum Stage writecat : Wall: 2.53 s, CPU: 2.04 s, VmPeak: 1171 MB, VmSize: 1043 MB, VmRSS: 223 MB, VmData: 245 MB, maxrss: 0.359504 MB Stage writecat finished: 2020-08-05T21:40:20.894121 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.527 s, Cores in use: 0.81, Total efficiency (on 16 cores): 5.0 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/PGC1383089-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1383089/PGC1383089-largegalaxy-writecat.p All done: 76.599 s worker CPU, 430.431 s worker Wall, Wall: 151.489 s, Cores in use: 0.64, Total efficiency (on 16 cores): 4.0 % Finished galaxy PGC1383089 in 2.578 minutes. Started working on galaxy PGC1383089 at Mon Aug 10 10:25:07 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.95219136827 10.687497251935255 --width 315 --height 315 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/PGC1383089-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/PGC1383089-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-10T10:25:07.941407 legacypipe git version: DR9.5.11-watershed-6-g6a2880fc Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '347.95219136827', '10.687497251935255', '--width', '315', '--height', '315', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/PGC1383089-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/PGC1383089-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.95219136827 10.687497251935255 --width 315 --height 315 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/PGC1383089-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/PGC1383089-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 347.95219136827 10.687497251935255 Starting process 53938 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 53939 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 53940 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 53941 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 53942 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059528 MB Starting process 53943 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 53944 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 53945 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-10T10:25:08.402793 Keeping 8 CCDs: c4d_140815_075529_ooi_z_ls9-S18 z expnum 348047 exptime 138.0 propid 2014B-0404 seeing 0.94 MJD 56884.328 object DECaLS_39628_z decam/CP/V4.8.2a/CP20140814/c4d_140815_075529_ooi_z_ls9.fits.fz c4d_180910_023807_ooi_r_ls9-S18 r expnum 771443 exptime 46.0 propid 2014B-0404 seeing 1.36 MJD 58371.110 object DECaLS_39628_r decam/CP/V4.8.2a/CP20180909/c4d_180910_023807_ooi_r_ls9.fits.fz c4d_160813_055306_ooi_z_ls9-S19 z expnum 563588 exptime 90.0 propid 2014B-0404 seeing 0.95 MJD 57613.244 object DECaLS_23756_z decam/CP/V4.8.2a/CP20160812/c4d_160813_055306_ooi_z_ls9.fits.fz c4d_170916_044805_ooi_g_ls9-S19 g expnum 678025 exptime 127.0 propid 2014B-0404 seeing 1.52 MJD 58012.200 object DECaLS_23756_g decam/CP/V4.8.2a/CP20170915/c4d_170916_044805_ooi_g_ls9.fits.fz c4d_180619_084616_ooi_r_ls9-S19 r expnum 754111 exptime 90.0 propid 2014B-0404 seeing 1.48 MJD 58288.365 object DECaLS_23756_r decam/CP/V4.8.2a/CP20180618/c4d_180619_084616_ooi_r_ls9.fits.fz c4d_180809_052757_ooi_r_ls9-N31 r expnum 763310 exptime 43.0 propid 2014B-0404 seeing 1.30 MJD 58339.228 object DECaLS_7862_r decam/CP/V4.8.2a/CP20180808/c4d_180809_052757_ooi_r_ls9.fits.fz c4d_170721_064746_ooi_g_ls9-S18 g expnum 660491 exptime 131.0 propid 2014B-0404 seeing 1.39 MJD 57955.281 object DECaLS_39628_g decam/CP/V4.8.2/CP20170720/c4d_170721_064746_ooi_g_ls9.fits.fz c4d_170719_073302_ooi_r_ls9-S18 r expnum 660043 exptime 114.0 propid 2014B-0404 seeing 2.28 MJD 57953.313 object DECaLS_39628_r decam/CP/V4.8.2/CP20170718/c4d_170719_073302_ooi_r_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T084616_oi[S19,noinherit][2046,4094][real]: DECaLS_ Clipping 2853 pixels with anomalously large oow values: max 0.0104382 vs median 0.00585005 Masking 0 additional saturated pixels in DECam expnum 754111 S19 CCD, decam/CP/V4.8.2a/CP20180618/c4d_180619_084616_ooi_r_ls9.fits.fz slice (slice(1060, 1376, None), slice(923, 1240, None)) The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170721T064442_oi[S18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170719T073015_oi[S18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180910T023807_oi[S18,noinherit][2046,4094][real]: DECaLS_3962 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T055045_oi[S19,noinherit][2046,4094][real]: DECaLS_ Masking 10 additional saturated pixels in DECam expnum 563588 S19 CCD, decam/CP/V4.8.2a/CP20160812/c4d_160813_055306_ooi_z_ls9.fits.fz slice (slice(1086, 1402, None), slice(873, 1189, None)) The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954cb27-z-20140815T075216_oi[S18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952307c-g-20170916T044805_oi[S19,noinherit][2046,4094][real]: DECaLS_ Masking 2 additional saturated pixels in DECam expnum 678025 S19 CCD, decam/CP/V4.8.2a/CP20170915/c4d_170916_044805_ooi_g_ls9.fits.fz slice (slice(1045, 1361, None), slice(920, 1236, None)) Stage tims : Wall: 48.74 s, CPU: 0.91 s, VmPeak: 1004 MB, VmSize: 1004 MB, VmRSS: 176 MB, VmData: 210 MB, maxrss: 0.233372 MB Stage tims finished: 2020-08-10T10:25:57.145586 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T084616_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180910T023807_oi[S18,noinherit][2046,4094][real]: DECaLS_3962 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ccd4-g-20170721T064442_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954cb27-z-20140815T075216_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T055045_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 4.632 s worker CPU, 154.116 s worker Wall, Wall: 48.744 s, Cores in use: 0.11, Total efficiency (on 8 cores): 1.4 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/PGC1383089-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/PGC1383089-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170719T073015_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952307c-g-20170916T044805_oi[S19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-08-10T10:25:57.174789 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04923.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05179.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05052.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/metrics/cus/reference-custom-347952p10687.fits Stage refs : Wall: 9.02 s, CPU: 1.86 s, VmPeak: 1035 MB, VmSize: 1023 MB, VmRSS: 196 MB, VmData: 229 MB, maxrss: 0.233372 MB Stage refs finished: 2020-08-10T10:26:06.190932 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.017 s, Cores in use: 0.21, Total efficiency (on 8 cores): 2.6 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/PGC1383089-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/PGC1383089-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-10T10:26:06.212336 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/metrics/cus/outlier-mask-custom-347952p10687.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/metrics/cus/outliers-pre-custom-347952p10687.jpg Image c4d_170916_044805_ooi_g_ls9-S19 g : masking 0 positive outlier pixels and 26 negative outlier pixels Image c4d_170721_064746_ooi_g_ls9-S18 g : masking 32 positive outlier pixels and 0 negative outlier pixels Image c4d_180619_084616_ooi_r_ls9-S19 r : masking 13067 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/metrics/cus/outlier-mask-custom-347952p10687.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/metrics/cus/outliers-post-custom-347952p10687.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/metrics/cus/outliers-masked-pos-custom-347952p10687.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/metrics/cus/outliers-masked-neg-custom-347952p10687.jpg Stage outliers : Wall: 0.98 s, CPU: 0.66 s, VmPeak: 1035 MB, VmSize: 1032 MB, VmRSS: 213 MB, VmData: 243 MB, maxrss: 0.233372 MB Stage outliers finished: 2020-08-10T10:26:07.190785 Resources for stage outliers : 0.870 s worker CPU, 0.894 s worker Wall, Wall: 0.979 s, Cores in use: 1.56, Total efficiency (on 8 cores): 19.5 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/PGC1383089-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/PGC1383089-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-10T10:26:07.210695 Stage halos : Wall: 0.30 s, CPU: 0.21 s, VmPeak: 1035 MB, VmSize: 1033 MB, VmRSS: 214 MB, VmData: 243 MB, maxrss: 0.233372 MB Stage halos finished: 2020-08-10T10:26:07.512978 Resources for stage halos : 0.234 s worker CPU, 0.447 s worker Wall, Wall: 0.303 s, Cores in use: 1.47, Total efficiency (on 8 cores): 18.4 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/PGC1383089-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/PGC1383089-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-10T10:26:07.709326 PSF sigmas in coadd pixels: ['2.46', '2.26'] Using average PSF sigma 2.3622412724554827 Gaussian PSF norm 0.11941828087723175 vs pixelized 0.09936396 average tim pixel scale / coadd scale: 1.001179393581719 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.21', '2.41', '3.70'] Using average PSF sigma 2.7739798726943636 Gaussian PSF norm 0.10169316459382952 vs pixelized 0.08164633 average tim pixel scale / coadd scale: 1.0012241990397903 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.53', '1.55'] Using average PSF sigma 1.537922115153582 Gaussian PSF norm 0.18342592839671026 vs pixelized 0.15708505 average tim pixel scale / coadd scale: 1.0011561993840115 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.23 s, CPU: 0.19 s, VmPeak: 1035 MB, VmSize: 1033 MB, VmRSS: 216 MB, VmData: 243 MB, maxrss: 0.233372 MB Stage fit_on_coadds finished: 2020-08-10T10:26:07.936673 Resources for stage fit_on_coadds : 0.244 s worker CPU, 0.244 s worker Wall, Wall: 0.228 s, Cores in use: 1.88, Total efficiency (on 8 cores): 23.5 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/PGC1383089-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/PGC1383089-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-10T10:26:07.946759 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 112 potential peaks Of 112 potential peaks: 77 in veto map, 7 cut by saddle test, 0 cut by aper test, 28 kept SED z : 28 new peaks Found 86 potential peaks Of 86 potential peaks: 76 in veto map, 8 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 75 potential peaks Of 75 potential peaks: 65 in veto map, 7 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 132 potential peaks Of 132 potential peaks: 118 in veto map, 9 cut by saddle test, 0 cut by aper test, 5 kept SED Flat : 5 new peaks Found 217 potential peaks Of 217 potential peaks: 206 in veto map, 11 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 38 new sources Median coadd sky for g : 0.00027748532 Median coadd sky for r : 0.00041363927 Median coadd sky for z : 0.0012952671 Stage srcs : Wall: 0.81 s, CPU: 0.76 s, VmPeak: 1035 MB, VmSize: 1033 MB, VmRSS: 216 MB, VmData: 243 MB, maxrss: 0.233372 MB Stage srcs finished: 2020-08-10T10:26:08.758640 Resources for stage srcs : 0.113 s worker CPU, 0.113 s worker Wall, Wall: 0.813 s, Cores in use: 1.08, Total efficiency (on 8 cores): 13.5 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/PGC1383089-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/PGC1383089-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-10T10:26:08.771250 Blob 1 of 11, id: 0, sources: 29, size: 301x315, npix 51312, brick X: 3,304, Y: 0,315, one pixel: 142 0 Blob 2 of 11, id: 5, sources: 1, size: 39x42, npix 1208, brick X: 0,39, Y: 56,98, one pixel: 13 56 Blob 3 of 11, id: 8, sources: 1, size: 39x36, npix 1023, brick X: 14,53, Y: 279,315, one pixel: 34 279 Blob 4 of 11, id: 4, sources: 2, size: 36x35, npix 758, brick X: 38,74, Y: 31,66, one pixel: 49 31 Blob 5 of 11, id: 6, sources: 2, size: 38x30, npix 652, brick X: 0,38, Y: 199,229, one pixel: 27 199 Blob 6 of 11, id: 2, sources: 1, size: 30x33, npix 638, brick X: 1,31, Y: 16,49, one pixel: 11 16 Blob 7 of 11, id: 9, sources: 2, size: 39x29, npix 594, brick X: 122,161, Y: 284,313, one pixel: 149 284 Blob 8 of 11, id: 3, sources: 1, size: 30x28, npix 578, brick X: 271,301, Y: 25,53, one pixel: 283 25 Blob 9 of 11, id: 1, sources: 1, size: 20x22, npix 277, brick X: 46,66, Y: 4,26, one pixel: 54 4 Blob 7 finished, total: Wall: 0.70 s, CPU: 0.69 s, VmPeak: 953 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146676 MB Blob 10 of 11, id: 10, sources: 1, size: 21x20, npix 249, brick X: 72,93, Y: 291,311, one pixel: 81 291 Blob 5 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 950 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147204 MB Blob 11 of 11, id: 7, sources: 1, size: 19x19, npix 189, brick X: 25,44, Y: 252,271, one pixel: 33 252 Blob 10 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 950 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147204 MB Blob 11 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 950 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147204 MB Blob 8 finished, total: Wall: 0.96 s, CPU: 0.95 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 118 MB, VmData: 161 MB, maxrss: 0.121168 MB Measuring 1 iterative sources Blob 2 finished, total: Wall: 1.21 s, CPU: 1.21 s, VmPeak: 957 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145456 MB Blob 9 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 953 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146676 MB Blob 6 finished, total: Wall: 1.46 s, CPU: 1.45 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147088 MB Blob 4 finished, total: Wall: 1.67 s, CPU: 1.66 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.1469 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 1.94 s, CPU: 1.93 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148296 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.02878, ee1=-0.0530141, ee2=0.127775 Measuring 6 iterative sources Blob 1 finished, total: Wall: 45.53 s, CPU: 45.53 s, VmPeak: 957 MB, VmSize: 761 MB, VmRSS: 189 MB, VmData: 216 MB, maxrss: 0.19746 MB Old catalog: 46 New catalog: 42 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/metrics/cus/blobs-custom-347952p10687.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/metrics/cus/all-models-custom-347952p10687.fits Stage fitblobs : Wall: 46.01 s, CPU: 0.42 s, VmPeak: 1035 MB, VmSize: 1033 MB, VmRSS: 219 MB, VmData: 245 MB, maxrss: 0.233372 MB Stage fitblobs finished: 2020-08-10T10:26:54.779109 Resources for stage fitblobs : 55.239 s worker CPU, 55.325 s worker Wall, Wall: 46.009 s, Cores in use: 1.21, Total efficiency (on 8 cores): 15.1 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/PGC1383089-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/PGC1383089-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-10T10:26:54.797348 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/tmp-legacysurvey-custom-347952p10687-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/tmp-legacysurvey-custom-347952p10687-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/tmp-legacysurvey-custom-347952p10687-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/tmp-legacysurvey-custom-347952p10687-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-resid.jpg Stage coadds : Wall: 1.89 s, CPU: 0.75 s, VmPeak: 1035 MB, VmSize: 1033 MB, VmRSS: 219 MB, VmData: 245 MB, maxrss: 0.233372 MB Stage coadds finished: 2020-08-10T10:26:56.690617 Resources for stage coadds : 4.822 s worker CPU, 5.785 s worker Wall, Wall: 1.894 s, Cores in use: 2.94, Total efficiency (on 8 cores): 36.8 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/PGC1383089-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/PGC1383089-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-10T10:26:56.784557 Cut to 1 unWISE tiles Reading WISE tile 3476p106 band 1 Reading WISE tile 3476p106 band 3 Reading WISE tile 3476p106 band 2 Reading WISE tile 3476p106 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 802 MB, VmSize: 802 MB, VmRSS: 150 MB, VmData: 176 MB, maxrss: 0.192172 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 957 MB, VmSize: 813 MB, VmRSS: 163 MB, VmData: 184 MB, maxrss: 0.228 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 956 MB, VmSize: 801 MB, VmRSS: 143 MB, VmData: 172 MB, maxrss: 0.206772 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 953 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.207996 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/tmp-legacysurvey-custom-347952p10687-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/tmp-legacysurvey-custom-347952p10687-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.07 s, CPU: 0.64 s, VmPeak: 1035 MB, VmSize: 1033 MB, VmRSS: 220 MB, VmData: 245 MB, maxrss: 0.233372 MB Stage wise_forced finished: 2020-08-10T10:26:58.856596 Resources for stage wise_forced : 3.284 s worker CPU, 4.343 s worker Wall, Wall: 2.073 s, Cores in use: 1.89, Total efficiency (on 8 cores): 23.7 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/PGC1383089-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/PGC1383089-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-10T10:26:58.871865 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/coadd/cus/custom-347952p10687/legacysurvey-custom-347952p10687-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/tractor-i/cus/tractor-custom-347952p10687.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/tractor/cus/tractor-custom-347952p10687.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/tractor/cus/brick-custom-347952p10687.sha256sum Stage writecat : Wall: 0.78 s, CPU: 0.60 s, VmPeak: 1165 MB, VmSize: 1037 MB, VmRSS: 221 MB, VmData: 245 MB, maxrss: 0.357848 MB Stage writecat finished: 2020-08-10T10:26:59.648558 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.778 s, Cores in use: 0.77, Total efficiency (on 8 cores): 9.6 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/PGC1383089-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1383089/PGC1383089-largegalaxy-writecat.p All done: 69.440 s worker CPU, 221.269 s worker Wall, Wall: 111.322 s, Cores in use: 0.69, Total efficiency (on 8 cores): 8.6 % Finished galaxy PGC1383089 in 1.884 minutes.