Started working on galaxy PGC1481665 at Wed Aug 5 18:29:09 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 263.6778255 15.327400199999998 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T18:29:10.173933 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '263.6778255', '15.327400199999998', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 263.6778255 15.327400199999998 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 263.6778255 15.327400199999998 Starting process 10580 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 10581 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 10582 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 10583 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 10584 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB Starting process 10585 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 10586 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 10587 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 10588 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 10589 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 10590 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 10591 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 10592 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 10593 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 10595 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 10594 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T18:29:10.567085 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 11 CCDs: c4d_180911_001449_ooi_z_ls9-N10 z expnum 771797 exptime 99.0 propid 2014B-0404 seeing 1.08 MJD 58372.010 object DECaLS_49325_z decam/CP/V4.8.2a/CP20180910/c4d_180911_001449_ooi_z_ls9.fits.fz c4d_180811_024209_ooi_g_ls9-N10 g expnum 764083 exptime 82.0 propid 2014B-0404 seeing 1.07 MJD 58341.113 object DECaLS_49325_g decam/CP/V4.8.2a/CP20180810/c4d_180811_024209_ooi_g_ls9.fits.fz c4d_180812_014943_ooi_r_ls9-N10 r expnum 764525 exptime 40.0 propid 2014B-0404 seeing 0.95 MJD 58342.076 object DECaLS_49325_r decam/CP/V4.8.2a/CP20180811/c4d_180812_014943_ooi_r_ls9.fits.fz c4d_170726_025154_ooi_g_ls9-N8 g expnum 662224 exptime 134.0 propid 2014B-0404 seeing 1.45 MJD 57960.117 object DECaLS_47053_g decam/CP/V4.8.2a/CP20170725/c4d_170726_025154_ooi_g_ls9.fits.fz c4d_170726_024913_ooi_r_ls9-N8 r expnum 662223 exptime 59.0 propid 2014B-0404 seeing 1.24 MJD 57960.116 object DECaLS_47053_r decam/CP/V4.8.2a/CP20170725/c4d_170726_024913_ooi_r_ls9.fits.fz c4d_160724_044938_ooi_z_ls9-N9 z expnum 554168 exptime 91.0 propid 2016A-0190 seeing 1.49 MJD 57593.200 object DECaLS_31181_z decam/CP/V4.8.2a/CP20160723/c4d_160724_044938_ooi_z_ls9.fits.fz c4d_170725_025444_ooi_g_ls9-N9 g expnum 661883 exptime 200.0 propid 2014B-0404 seeing 1.66 MJD 57959.118 object DECaLS_31181_g decam/CP/V4.8.2a/CP20170724/c4d_170725_025444_ooi_g_ls9.fits.fz c4d_180619_064711_ooi_r_ls9-N9 r expnum 754073 exptime 105.0 propid 2014B-0404 seeing 1.41 MJD 58288.283 object DECaLS_31181_r decam/CP/V4.8.2a/CP20180618/c4d_180619_064711_ooi_r_ls9.fits.fz c4d_170521_090536_ooi_z_ls9-N10 z expnum 649893 exptime 140.0 propid 2014B-0404 seeing 1.11 MJD 57894.377 object DECaLS_15309_z decam/CP/V4.8.2/CP20170520/c4d_170521_090536_ooi_z_ls9.fits.fz c4d_170722_024916_ooi_r_ls9-N10 r expnum 660835 exptime 51.0 propid 2014B-0404 seeing 1.11 MJD 57956.116 object DECaLS_15309_r decam/CP/V4.8.2a/CP20170721/c4d_170722_024916_ooi_r_ls9.fits.fz c4d_170822_004115_ooi_g_ls9-N10 g expnum 670232 exptime 104.0 propid 2014B-0404 seeing 1.07 MJD 57987.029 object DECaLS_15309_g decam/CP/V4.8.2a/CP20170821/c4d_170822_004115_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951dcf7-r-20170722T024733_oi[N10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953255f-r-20180812T014943_oi[N10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T064711_oi[N9,noinherit][2046,4094][real]: DECaLS_3 Clipping 922 pixels with anomalously large oow values: max 0.0125401 vs median 0.00732078 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180911T001449_oi[N10,noinherit][2046,4094][real]: DECaLS_4932 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95328e1-g-20180811T024209_oi[N10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95220ee-g-20170822T004115_oi[N10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9517988-z-20170521T090220_oi[N10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b419-z-20160724T044717_oi[N9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ff0f-g-20170725T025031_oi[N9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95203e2-g-20170726T024849_oi[N8,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ffb4-r-20170726T024721_oi[N8,noinherit][2046,4094][real]: DECaLS_4 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 356.29 s, CPU: 1.12 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 178 MB, VmData: 210 MB, maxrss: 0.182232 MB Stage tims finished: 2020-08-05T18:35:06.853607 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9517988-z-20170521T090220_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951dcf7-r-20170722T024733_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ff0f-g-20170725T025031_oi[N9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180911T001449_oi[N10,noinherit][2046,4094][real]: DECaLS_4932 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953255f-r-20180812T014943_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95328e1-g-20180811T024209_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 6.854 s worker CPU, 2721.874 s worker Wall, Wall: 356.288 s, Cores in use: 0.02, Total efficiency (on 16 cores): 0.1 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95220ee-g-20170822T004115_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95203e2-g-20170726T024849_oi[N8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ffb4-r-20170726T024721_oi[N8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T064711_oi[N9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b419-z-20160724T044717_oi[N9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T18:35:06.879631 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04637.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04510.fits Matched 8 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/metrics/cus/reference-custom-263677p15327.fits Stage refs : Wall: 56.24 s, CPU: 8.54 s, VmPeak: 1134 MB, VmSize: 1128 MB, VmRSS: 297 MB, VmData: 327 MB, maxrss: 0.30428 MB Stage refs finished: 2020-08-05T18:36:03.124232 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 56.246 s, Cores in use: 0.15, Total efficiency (on 16 cores): 0.9 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T18:36:03.155528 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/metrics/cus/outlier-mask-custom-263677p15327.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/metrics/cus/outliers-pre-custom-263677p15327.jpg Image c4d_180619_064711_ooi_r_ls9-N9 r : masking 382 positive outlier pixels and 0 negative outlier pixels Image c4d_180911_001449_ooi_z_ls9-N10 z : masking 453 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/metrics/cus/outlier-mask-custom-263677p15327.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/metrics/cus/outliers-post-custom-263677p15327.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/metrics/cus/outliers-masked-pos-custom-263677p15327.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/metrics/cus/outliers-masked-neg-custom-263677p15327.jpg Stage outliers : Wall: 0.84 s, CPU: 0.62 s, VmPeak: 1138 MB, VmSize: 1138 MB, VmRSS: 311 MB, VmData: 337 MB, maxrss: 0.318016 MB Stage outliers finished: 2020-08-05T18:36:03.998637 Resources for stage outliers : 0.733 s worker CPU, 0.792 s worker Wall, Wall: 0.844 s, Cores in use: 1.60, Total efficiency (on 16 cores): 10.0 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T18:36:04.036806 Stage halos : Wall: 11.93 s, CPU: 0.23 s, VmPeak: 1138 MB, VmSize: 1138 MB, VmRSS: 311 MB, VmData: 338 MB, maxrss: 0.31846 MB Stage halos finished: 2020-08-05T18:36:15.969637 Resources for stage halos : 0.746 s worker CPU, 12.950 s worker Wall, Wall: 11.934 s, Cores in use: 0.08, Total efficiency (on 16 cores): 0.5 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T18:36:15.997083 PSF sigmas in coadd pixels: ['1.74', '2.36', '2.69', '1.74'] Using average PSF sigma 2.132316113681951 Gaussian PSF norm 0.13229501477938674 vs pixelized 0.107727155 average tim pixel scale / coadd scale: 1.0011179589502912 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.54', '2.01', '2.29', '1.80'] Using average PSF sigma 1.910606008641924 Gaussian PSF norm 0.14764676259674997 vs pixelized 0.12626848 average tim pixel scale / coadd scale: 1.0011680964078356 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.76', '2.42', '1.80'] Using average PSF sigma 1.9929718212440803 Gaussian PSF norm 0.1415447969544221 vs pixelized 0.11347674 average tim pixel scale / coadd scale: 1.001219166965288 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.19 s, CPU: 0.16 s, VmPeak: 1138 MB, VmSize: 1138 MB, VmRSS: 313 MB, VmData: 339 MB, maxrss: 0.320416 MB Stage fit_on_coadds finished: 2020-08-05T18:36:16.189469 Resources for stage fit_on_coadds : 0.153 s worker CPU, 0.153 s worker Wall, Wall: 0.194 s, Cores in use: 1.62, Total efficiency (on 16 cores): 10.1 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T18:36:16.200969 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 50 potential peaks Of 50 potential peaks: 30 in veto map, 4 cut by saddle test, 0 cut by aper test, 16 kept SED z : 16 new peaks Found 78 potential peaks Of 78 potential peaks: 72 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 77 potential peaks Of 77 potential peaks: 70 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 90 potential peaks Of 90 potential peaks: 83 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 104 potential peaks Of 104 potential peaks: 96 in veto map, 7 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 22 new sources Median coadd sky for g : 0.00023119594 Median coadd sky for r : 0.000510792 Median coadd sky for z : 0.0013704313 Stage srcs : Wall: 0.54 s, CPU: 0.51 s, VmPeak: 1138 MB, VmSize: 1138 MB, VmRSS: 314 MB, VmData: 339 MB, maxrss: 0.321228 MB Stage srcs finished: 2020-08-05T18:36:16.738452 Resources for stage srcs : 0.060 s worker CPU, 0.060 s worker Wall, Wall: 0.539 s, Cores in use: 1.06, Total efficiency (on 16 cores): 6.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T18:36:16.749287 Blob 1 of 8, id: 3, sources: 20, size: 225x225, npix 29830, brick X: 8,233, Y: 8,233, one pixel: 102 8 Blob 2 of 8, id: 5, sources: 3, size: 41x49, npix 1349, brick X: 0,41, Y: 38,87, one pixel: 5 38 Blob 3 of 8, id: 0, sources: 2, size: 54x40, npix 1325, brick X: 9,63, Y: 0,40, one pixel: 33 0 Blob 4 of 8, id: 2, sources: 2, size: 51x34, npix 1267, brick X: 163,214, Y: 0,34, one pixel: 173 0 Blob 5 of 8, id: 1, sources: 1, size: 34x30, npix 737, brick X: 123,157, Y: 0,30, one pixel: 130 0 Blob 6 of 8, id: 6, sources: 1, size: 25x24, npix 367, brick X: 107,132, Y: 200,224, one pixel: 117 200 Blob 7 of 8, id: 4, sources: 1, size: 16x33, npix 335, brick X: 217,233, Y: 21,54, one pixel: 226 21 Blob 8 of 8, id: 7, sources: 1, size: 20x22, npix 269, brick X: 46,66, Y: 207,229, one pixel: 55 207 Blob 6 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 941 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150352 MB Measuring 1 iterative sources Blob 8 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149536 MB Blob 5 finished, total: Wall: 0.88 s, CPU: 0.88 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.115076 MB Blob 7 finished, total: Wall: 1.07 s, CPU: 1.07 s, VmPeak: 963 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148372 MB Blob 3 finished, total: Wall: 1.37 s, CPU: 1.37 s, VmPeak: 939 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.15014 MB Blob 2 finished, total: Wall: 1.73 s, CPU: 1.72 s, VmPeak: 935 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.14814 MB Blob 4 finished, total: Wall: 1.84 s, CPU: 1.84 s, VmPeak: 940 MB, VmSize: 733 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.151236 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.35974, ee1=-0.03809, ee2=-0.356007 Measuring 17 iterative sources Blob 1 finished, total: Wall: 27.80 s, CPU: 27.79 s, VmPeak: 941 MB, VmSize: 744 MB, VmRSS: 164 MB, VmData: 193 MB, maxrss: 0.16802 MB Old catalog: 43 New catalog: 45 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/metrics/cus/blobs-custom-263677p15327.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/metrics/cus/all-models-custom-263677p15327.fits Stage fitblobs : Wall: 28.17 s, CPU: 0.32 s, VmPeak: 1138 MB, VmSize: 1138 MB, VmRSS: 315 MB, VmData: 340 MB, maxrss: 0.322412 MB Stage fitblobs finished: 2020-08-05T18:36:44.920417 Resources for stage fitblobs : 35.290 s worker CPU, 35.356 s worker Wall, Wall: 28.173 s, Cores in use: 1.26, Total efficiency (on 16 cores): 7.9 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T18:36:44.951160 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/tmp-legacysurvey-custom-263677p15327-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/tmp-legacysurvey-custom-263677p15327-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/tmp-legacysurvey-custom-263677p15327-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/tmp-legacysurvey-custom-263677p15327-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-resid.jpg Stage coadds : Wall: 2.31 s, CPU: 0.50 s, VmPeak: 1138 MB, VmSize: 1138 MB, VmRSS: 315 MB, VmData: 340 MB, maxrss: 0.322736 MB Stage coadds finished: 2020-08-05T18:36:47.260840 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 10.406 s worker CPU, 13.878 s worker Wall, Wall: 2.311 s, Cores in use: 4.72, Total efficiency (on 16 cores): 29.5 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T18:36:47.275619 Cut to 1 unWISE tiles Reading WISE tile 2629p151 band 1 Reading WISE tile 2629p151 band 3 Reading WISE tile 2629p151 band 4 Reading WISE tile 2629p151 band 2 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 940 MB, VmSize: 871 MB, VmRSS: 210 MB, VmData: 236 MB, maxrss: 0.214888 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 963 MB, VmSize: 810 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.211576 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 942 MB, VmSize: 802 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.2038 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 956 MB, VmSize: 811 MB, VmRSS: 150 MB, VmData: 175 MB, maxrss: 0.196336 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/tmp-legacysurvey-custom-263677p15327-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/tmp-legacysurvey-custom-263677p15327-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 37.08 s, CPU: 0.75 s, VmPeak: 1138 MB, VmSize: 1138 MB, VmRSS: 316 MB, VmData: 340 MB, maxrss: 0.323248 MB Stage wise_forced finished: 2020-08-05T18:37:24.357412 Resources for stage wise_forced : 3.035 s worker CPU, 39.399 s worker Wall, Wall: 37.083 s, Cores in use: 0.10, Total efficiency (on 16 cores): 0.6 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T18:37:24.432055 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/tractor-i/cus/tractor-custom-263677p15327.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/tractor/cus/tractor-custom-263677p15327.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/tractor/cus/brick-custom-263677p15327.sha256sum Stage writecat : Wall: 0.74 s, CPU: 0.53 s, VmPeak: 1271 MB, VmSize: 1143 MB, VmRSS: 317 MB, VmData: 340 MB, maxrss: 0.456124 MB Stage writecat finished: 2020-08-05T18:37:25.172593 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.742 s, Cores in use: 0.71, Total efficiency (on 16 cores): 4.5 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-writecat.p All done: 57.280 s worker CPU, 2824.466 s worker Wall, Wall: 494.623 s, Cores in use: 0.14, Total efficiency (on 16 cores): 0.9 % Finished galaxy PGC1481665 in 8.272 minutes. Started working on galaxy PGC1481665 at Wed Aug 5 18:51:37 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 263.6778255 15.327400199999998 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T18:51:38.298244 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '263.6778255', '15.327400199999998', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 263.6778255 15.327400199999998 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 263.6778255 15.327400199999998 Starting process 13214 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 13215 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 13216 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 13217 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 13218 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05934 MB Starting process 13219 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059348 MB Starting process 13220 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059348 MB Starting process 13221 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 13222 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 13223 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 13224 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 13225 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 13226 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 13227 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 13228 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 13229 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 13230 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 13231 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 13232 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 13233 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 13234 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 13235 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 13236 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 13237 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 13238 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 13240 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 13241 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 13242 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 13239 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 13243 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 13244 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 13245 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T18:51:39.164780 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 11 CCDs: c4d_180911_001449_ooi_z_ls9-N10 z expnum 771797 exptime 99.0 propid 2014B-0404 seeing 1.08 MJD 58372.010 object DECaLS_49325_z decam/CP/V4.8.2a/CP20180910/c4d_180911_001449_ooi_z_ls9.fits.fz c4d_180811_024209_ooi_g_ls9-N10 g expnum 764083 exptime 82.0 propid 2014B-0404 seeing 1.07 MJD 58341.113 object DECaLS_49325_g decam/CP/V4.8.2a/CP20180810/c4d_180811_024209_ooi_g_ls9.fits.fz c4d_180812_014943_ooi_r_ls9-N10 r expnum 764525 exptime 40.0 propid 2014B-0404 seeing 0.95 MJD 58342.076 object DECaLS_49325_r decam/CP/V4.8.2a/CP20180811/c4d_180812_014943_ooi_r_ls9.fits.fz c4d_170726_025154_ooi_g_ls9-N8 g expnum 662224 exptime 134.0 propid 2014B-0404 seeing 1.45 MJD 57960.117 object DECaLS_47053_g decam/CP/V4.8.2a/CP20170725/c4d_170726_025154_ooi_g_ls9.fits.fz c4d_170726_024913_ooi_r_ls9-N8 r expnum 662223 exptime 59.0 propid 2014B-0404 seeing 1.24 MJD 57960.116 object DECaLS_47053_r decam/CP/V4.8.2a/CP20170725/c4d_170726_024913_ooi_r_ls9.fits.fz c4d_160724_044938_ooi_z_ls9-N9 z expnum 554168 exptime 91.0 propid 2016A-0190 seeing 1.49 MJD 57593.200 object DECaLS_31181_z decam/CP/V4.8.2a/CP20160723/c4d_160724_044938_ooi_z_ls9.fits.fz c4d_170725_025444_ooi_g_ls9-N9 g expnum 661883 exptime 200.0 propid 2014B-0404 seeing 1.66 MJD 57959.118 object DECaLS_31181_g decam/CP/V4.8.2a/CP20170724/c4d_170725_025444_ooi_g_ls9.fits.fz c4d_180619_064711_ooi_r_ls9-N9 r expnum 754073 exptime 105.0 propid 2014B-0404 seeing 1.41 MJD 58288.283 object DECaLS_31181_r decam/CP/V4.8.2a/CP20180618/c4d_180619_064711_ooi_r_ls9.fits.fz c4d_170521_090536_ooi_z_ls9-N10 z expnum 649893 exptime 140.0 propid 2014B-0404 seeing 1.11 MJD 57894.377 object DECaLS_15309_z decam/CP/V4.8.2/CP20170520/c4d_170521_090536_ooi_z_ls9.fits.fz c4d_170722_024916_ooi_r_ls9-N10 r expnum 660835 exptime 51.0 propid 2014B-0404 seeing 1.11 MJD 57956.116 object DECaLS_15309_r decam/CP/V4.8.2a/CP20170721/c4d_170722_024916_ooi_r_ls9.fits.fz c4d_170822_004115_ooi_g_ls9-N10 g expnum 670232 exptime 104.0 propid 2014B-0404 seeing 1.07 MJD 57987.029 object DECaLS_15309_g decam/CP/V4.8.2a/CP20170821/c4d_170822_004115_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T064711_oi[N9,noinherit][2046,4094][real]: DECaLS_3 Clipping 922 pixels with anomalously large oow values: max 0.0125401 vs median 0.00732078 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95220ee-g-20170822T004115_oi[N10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180911T001449_oi[N10,noinherit][2046,4094][real]: DECaLS_4932 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95328e1-g-20180811T024209_oi[N10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953255f-r-20180812T014943_oi[N10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ff0f-g-20170725T025031_oi[N9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9517988-z-20170521T090220_oi[N10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b419-z-20160724T044717_oi[N9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951dcf7-r-20170722T024733_oi[N10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ffb4-r-20170726T024721_oi[N8,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95203e2-g-20170726T024849_oi[N8,noinherit][2046,4094][real]: DECaLS_4 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 92.41 s, CPU: 1.11 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 178 MB, VmData: 210 MB, maxrss: 0.182388 MB Stage tims finished: 2020-08-05T18:53:11.578278 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180911T001449_oi[N10,noinherit][2046,4094][real]: DECaLS_4932 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T064711_oi[N9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95220ee-g-20170822T004115_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95328e1-g-20180811T024209_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951dcf7-r-20170722T024733_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95203e2-g-20170726T024849_oi[N8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953255f-r-20180812T014943_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ff0f-g-20170725T025031_oi[N9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 6.281 s worker CPU, 742.849 s worker Wall, Wall: 92.417 s, Cores in use: 0.08, Total efficiency (on 32 cores): 0.3 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9517988-z-20170521T090220_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T18:53:11.622122 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04637.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04510.fits Matched 8 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/metrics/cus/reference-custom-263677p15327.fits Stage refs : Wall: 14.46 s, CPU: 9.23 s, VmPeak: 1134 MB, VmSize: 1128 MB, VmRSS: 297 MB, VmData: 327 MB, maxrss: 0.304288 MB Stage refs finished: 2020-08-05T18:53:26.079431 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ffb4-r-20170726T024721_oi[N8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b419-z-20160724T044717_oi[N9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 14.459 s, Cores in use: 0.64, Total efficiency (on 32 cores): 2.0 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T18:53:26.270224 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/metrics/cus/outlier-mask-custom-263677p15327.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/metrics/cus/outliers-pre-custom-263677p15327.jpg Image c4d_180619_064711_ooi_r_ls9-N9 r : masking 382 positive outlier pixels and 0 negative outlier pixels Image c4d_180911_001449_ooi_z_ls9-N10 z : masking 453 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/metrics/cus/outlier-mask-custom-263677p15327.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/metrics/cus/outliers-post-custom-263677p15327.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/metrics/cus/outliers-masked-pos-custom-263677p15327.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/metrics/cus/outliers-masked-neg-custom-263677p15327.jpg Stage outliers : Wall: 1.16 s, CPU: 0.85 s, VmPeak: 1138 MB, VmSize: 1138 MB, VmRSS: 311 MB, VmData: 337 MB, maxrss: 0.318132 MB Stage outliers finished: 2020-08-05T18:53:27.431908 Resources for stage outliers : 0.808 s worker CPU, 1.054 s worker Wall, Wall: 1.164 s, Cores in use: 1.43, Total efficiency (on 32 cores): 4.5 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T18:53:27.460011 Stage halos : Wall: 1.62 s, CPU: 0.31 s, VmPeak: 1138 MB, VmSize: 1138 MB, VmRSS: 311 MB, VmData: 338 MB, maxrss: 0.318484 MB Stage halos finished: 2020-08-05T18:53:29.075426 Resources for stage halos : 0.785 s worker CPU, 2.478 s worker Wall, Wall: 1.618 s, Cores in use: 0.68, Total efficiency (on 32 cores): 2.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T18:53:29.180571 PSF sigmas in coadd pixels: ['1.74', '2.36', '2.69', '1.74'] Using average PSF sigma 2.132316113681951 Gaussian PSF norm 0.13229501477938674 vs pixelized 0.107727155 average tim pixel scale / coadd scale: 1.0011179589502912 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.54', '2.01', '2.29', '1.80'] Using average PSF sigma 1.910606008641924 Gaussian PSF norm 0.14764676259674997 vs pixelized 0.12626848 average tim pixel scale / coadd scale: 1.0011680964078356 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.76', '2.42', '1.80'] Using average PSF sigma 1.9929718212440803 Gaussian PSF norm 0.1415447969544221 vs pixelized 0.11347674 average tim pixel scale / coadd scale: 1.001219166965288 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.16 s, CPU: 0.15 s, VmPeak: 1138 MB, VmSize: 1138 MB, VmRSS: 313 MB, VmData: 339 MB, maxrss: 0.320764 MB Stage fit_on_coadds finished: 2020-08-05T18:53:29.342850 Resources for stage fit_on_coadds : 0.144 s worker CPU, 0.144 s worker Wall, Wall: 0.164 s, Cores in use: 1.79, Total efficiency (on 32 cores): 5.6 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T18:53:29.355577 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 50 potential peaks Of 50 potential peaks: 30 in veto map, 4 cut by saddle test, 0 cut by aper test, 16 kept SED z : 16 new peaks Found 78 potential peaks Of 78 potential peaks: 72 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 77 potential peaks Of 77 potential peaks: 70 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 90 potential peaks Of 90 potential peaks: 83 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 104 potential peaks Of 104 potential peaks: 96 in veto map, 7 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 22 new sources Median coadd sky for g : 0.00023119582 Median coadd sky for r : 0.000510792 Median coadd sky for z : 0.0013704313 Stage srcs : Wall: 0.56 s, CPU: 0.53 s, VmPeak: 1138 MB, VmSize: 1138 MB, VmRSS: 314 MB, VmData: 339 MB, maxrss: 0.321472 MB Stage srcs finished: 2020-08-05T18:53:29.918985 Resources for stage srcs : 0.069 s worker CPU, 0.069 s worker Wall, Wall: 0.566 s, Cores in use: 1.07, Total efficiency (on 32 cores): 3.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T18:53:29.933243 Blob 1 of 8, id: 3, sources: 20, size: 225x225, npix 29830, brick X: 8,233, Y: 8,233, one pixel: 102 8 Blob 2 of 8, id: 5, sources: 3, size: 41x49, npix 1349, brick X: 0,41, Y: 38,87, one pixel: 5 38 Blob 3 of 8, id: 0, sources: 2, size: 54x40, npix 1325, brick X: 9,63, Y: 0,40, one pixel: 33 0 Blob 4 of 8, id: 2, sources: 2, size: 51x34, npix 1267, brick X: 163,214, Y: 0,34, one pixel: 173 0 Blob 5 of 8, id: 1, sources: 1, size: 34x30, npix 737, brick X: 123,157, Y: 0,30, one pixel: 130 0 Blob 6 of 8, id: 6, sources: 1, size: 25x24, npix 367, brick X: 107,132, Y: 200,224, one pixel: 117 200 Blob 7 of 8, id: 4, sources: 1, size: 16x33, npix 335, brick X: 217,233, Y: 21,54, one pixel: 226 21 Blob 8 of 8, id: 7, sources: 1, size: 20x22, npix 269, brick X: 46,66, Y: 207,229, one pixel: 55 207 Blob 6 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.114596 MB Blob 8 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.11434 MB Measuring 1 iterative sources Blob 5 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.094428 MB Blob 7 finished, total: Wall: 1.11 s, CPU: 1.11 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092408 MB Blob 3 finished, total: Wall: 1.36 s, CPU: 1.36 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.114828 MB Blob 2 finished, total: Wall: 1.78 s, CPU: 1.78 s, VmPeak: 944 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148088 MB Blob 4 finished, total: Wall: 1.93 s, CPU: 1.93 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.093896 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.35974, ee1=-0.0380901, ee2=-0.356007 Measuring 17 iterative sources Blob 1 finished, total: Wall: 28.92 s, CPU: 28.91 s, VmPeak: 706 MB, VmSize: 692 MB, VmRSS: 124 MB, VmData: 163 MB, maxrss: 0.140272 MB Old catalog: 43 New catalog: 45 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/metrics/cus/blobs-custom-263677p15327.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/metrics/cus/all-models-custom-263677p15327.fits Stage fitblobs : Wall: 29.34 s, CPU: 0.37 s, VmPeak: 1138 MB, VmSize: 1138 MB, VmRSS: 315 MB, VmData: 340 MB, maxrss: 0.322656 MB Stage fitblobs finished: 2020-08-05T18:53:59.272880 Resources for stage fitblobs : 36.515 s worker CPU, 36.565 s worker Wall, Wall: 29.342 s, Cores in use: 1.26, Total efficiency (on 32 cores): 3.9 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T18:53:59.288744 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/tmp-legacysurvey-custom-263677p15327-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/tmp-legacysurvey-custom-263677p15327-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/tmp-legacysurvey-custom-263677p15327-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/tmp-legacysurvey-custom-263677p15327-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-resid.jpg Stage coadds : Wall: 4.45 s, CPU: 0.86 s, VmPeak: 1138 MB, VmSize: 1138 MB, VmRSS: 315 MB, VmData: 340 MB, maxrss: 0.32298 MB Stage coadds finished: 2020-08-05T18:54:03.737865 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 30.163 s worker CPU, 63.291 s worker Wall, Wall: 4.452 s, Cores in use: 6.97, Total efficiency (on 32 cores): 21.8 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T18:54:03.754961 Cut to 1 unWISE tiles Reading WISE tile 2629p151 band 1 Reading WISE tile 2629p151 band 2 Reading WISE tile 2629p151 band 3 Reading WISE tile 2629p151 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 956 MB, VmSize: 805 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.206656 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 939 MB, VmSize: 802 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.203536 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 957 MB, VmSize: 805 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.20666 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 956 MB, VmSize: 807 MB, VmRSS: 148 MB, VmData: 176 MB, maxrss: 0.193424 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/tmp-legacysurvey-custom-263677p15327-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/tmp-legacysurvey-custom-263677p15327-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 8.78 s, CPU: 0.73 s, VmPeak: 1138 MB, VmSize: 1138 MB, VmRSS: 316 MB, VmData: 340 MB, maxrss: 0.323492 MB Stage wise_forced finished: 2020-08-05T18:54:12.536810 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.355 s worker CPU, 11.416 s worker Wall, Wall: 8.785 s, Cores in use: 0.47, Total efficiency (on 32 cores): 1.5 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T18:54:12.552693 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/tractor-i/cus/tractor-custom-263677p15327.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/tractor/cus/tractor-custom-263677p15327.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/tractor/cus/brick-custom-263677p15327.sha256sum Stage writecat : Wall: 1.67 s, CPU: 0.72 s, VmPeak: 1271 MB, VmSize: 1143 MB, VmRSS: 318 MB, VmData: 340 MB, maxrss: 0.456368 MB Stage writecat finished: 2020-08-05T18:54:14.224813 Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 1.675 s, Cores in use: 0.43, Total efficiency (on 32 cores): 1.4 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/263/PGC1481665/PGC1481665-largegalaxy-writecat.p All done: 78.126 s worker CPU, 857.872 s worker Wall, Wall: 155.090 s, Cores in use: 0.60, Total efficiency (on 32 cores): 1.9 % Finished galaxy PGC1481665 in 2.621 minutes. Started working on galaxy PGC1481665 at Mon Aug 10 07:41:20 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 263.677467885514 15.32738184154749 --width 233 --height 233 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/PGC1481665-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/PGC1481665-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-10T07:41:21.649302 legacypipe git version: DR9.5.11-watershed-6-g6a2880fc Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '263.677467885514', '15.32738184154749', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/PGC1481665-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/PGC1481665-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 263.677467885514 15.32738184154749 --width 233 --height 233 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/PGC1481665-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/PGC1481665-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 263.677467885514 15.32738184154749 Starting process 21984 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 21986 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 21988 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 21990 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 21992 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0594 MB Starting process 21996 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059408 MB Starting process 21999 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 21994 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059408 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-10T07:41:22.072782 Keeping 11 CCDs: c4d_180911_001449_ooi_z_ls9-N10 z expnum 771797 exptime 99.0 propid 2014B-0404 seeing 1.08 MJD 58372.010 object DECaLS_49325_z decam/CP/V4.8.2a/CP20180910/c4d_180911_001449_ooi_z_ls9.fits.fz c4d_180811_024209_ooi_g_ls9-N10 g expnum 764083 exptime 82.0 propid 2014B-0404 seeing 1.07 MJD 58341.113 object DECaLS_49325_g decam/CP/V4.8.2a/CP20180810/c4d_180811_024209_ooi_g_ls9.fits.fz c4d_180812_014943_ooi_r_ls9-N10 r expnum 764525 exptime 40.0 propid 2014B-0404 seeing 0.95 MJD 58342.076 object DECaLS_49325_r decam/CP/V4.8.2a/CP20180811/c4d_180812_014943_ooi_r_ls9.fits.fz c4d_170726_025154_ooi_g_ls9-N8 g expnum 662224 exptime 134.0 propid 2014B-0404 seeing 1.45 MJD 57960.117 object DECaLS_47053_g decam/CP/V4.8.2a/CP20170725/c4d_170726_025154_ooi_g_ls9.fits.fz c4d_170726_024913_ooi_r_ls9-N8 r expnum 662223 exptime 59.0 propid 2014B-0404 seeing 1.24 MJD 57960.116 object DECaLS_47053_r decam/CP/V4.8.2a/CP20170725/c4d_170726_024913_ooi_r_ls9.fits.fz c4d_160724_044938_ooi_z_ls9-N9 z expnum 554168 exptime 91.0 propid 2016A-0190 seeing 1.49 MJD 57593.200 object DECaLS_31181_z decam/CP/V4.8.2a/CP20160723/c4d_160724_044938_ooi_z_ls9.fits.fz c4d_170725_025444_ooi_g_ls9-N9 g expnum 661883 exptime 200.0 propid 2014B-0404 seeing 1.66 MJD 57959.118 object DECaLS_31181_g decam/CP/V4.8.2a/CP20170724/c4d_170725_025444_ooi_g_ls9.fits.fz c4d_180619_064711_ooi_r_ls9-N9 r expnum 754073 exptime 105.0 propid 2014B-0404 seeing 1.41 MJD 58288.283 object DECaLS_31181_r decam/CP/V4.8.2a/CP20180618/c4d_180619_064711_ooi_r_ls9.fits.fz c4d_170521_090536_ooi_z_ls9-N10 z expnum 649893 exptime 140.0 propid 2014B-0404 seeing 1.11 MJD 57894.377 object DECaLS_15309_z decam/CP/V4.8.2/CP20170520/c4d_170521_090536_ooi_z_ls9.fits.fz c4d_170722_024916_ooi_r_ls9-N10 r expnum 660835 exptime 51.0 propid 2014B-0404 seeing 1.11 MJD 57956.116 object DECaLS_15309_r decam/CP/V4.8.2a/CP20170721/c4d_170722_024916_ooi_r_ls9.fits.fz c4d_170822_004115_ooi_g_ls9-N10 g expnum 670232 exptime 104.0 propid 2014B-0404 seeing 1.07 MJD 57987.029 object DECaLS_15309_g decam/CP/V4.8.2a/CP20170821/c4d_170822_004115_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ff0f-g-20170725T025031_oi[N9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95328e1-g-20180811T024209_oi[N10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b419-z-20160724T044717_oi[N9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953255f-r-20180812T014943_oi[N10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T064711_oi[N9,noinherit][2046,4094][real]: DECaLS_3 Clipping 939 pixels with anomalously large oow values: max 0.0125401 vs median 0.00732078 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180911T001449_oi[N10,noinherit][2046,4094][real]: DECaLS_4932 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95203e2-g-20170726T024849_oi[N8,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ffb4-r-20170726T024721_oi[N8,noinherit][2046,4094][real]: DECaLS_4 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9517988-z-20170521T090220_oi[N10,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95220ee-g-20170822T004115_oi[N10,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951dcf7-r-20170722T024733_oi[N10,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 76.61 s, CPU: 0.96 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 176 MB, VmData: 210 MB, maxrss: 0.180568 MB Stage tims finished: 2020-08-10T07:42:38.679951 Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95203e2-g-20170726T024849_oi[N8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95328e1-g-20180811T024209_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T064711_oi[N9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ffb4-r-20170726T024721_oi[N8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ff0f-g-20170725T025031_oi[N9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9517988-z-20170521T090220_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180911T001449_oi[N10,noinherit][2046,4094][real]: DECaLS_4932 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95220ee-g-20170822T004115_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953255f-r-20180812T014943_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 5.998 s worker CPU, 365.674 s worker Wall, Wall: 76.608 s, Cores in use: 0.09, Total efficiency (on 8 cores): 1.1 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/PGC1481665-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/PGC1481665-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b419-z-20160724T044717_oi[N9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951dcf7-r-20170722T024733_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-08-10T07:42:38.727898 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04637.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04510.fits Matched 8 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/metrics/cus/reference-custom-263677p15327.fits Stage refs : Wall: 15.36 s, CPU: 9.36 s, VmPeak: 1128 MB, VmSize: 1122 MB, VmRSS: 296 MB, VmData: 327 MB, maxrss: 0.302276 MB Stage refs finished: 2020-08-10T07:42:54.092598 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 15.366 s, Cores in use: 0.61, Total efficiency (on 8 cores): 7.6 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/PGC1481665-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/PGC1481665-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-10T07:42:54.119458 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/metrics/cus/outlier-mask-custom-263677p15327.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/metrics/cus/outliers-pre-custom-263677p15327.jpg Image c4d_180619_064711_ooi_r_ls9-N9 r : masking 305 positive outlier pixels and 0 negative outlier pixels Image c4d_180911_001449_ooi_z_ls9-N10 z : masking 459 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/metrics/cus/outlier-mask-custom-263677p15327.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/metrics/cus/outliers-post-custom-263677p15327.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/metrics/cus/outliers-masked-pos-custom-263677p15327.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/metrics/cus/outliers-masked-neg-custom-263677p15327.jpg Stage outliers : Wall: 0.83 s, CPU: 0.65 s, VmPeak: 1132 MB, VmSize: 1132 MB, VmRSS: 309 MB, VmData: 337 MB, maxrss: 0.316076 MB Stage outliers finished: 2020-08-10T07:42:54.951678 Resources for stage outliers : 0.694 s worker CPU, 0.695 s worker Wall, Wall: 0.833 s, Cores in use: 1.62, Total efficiency (on 8 cores): 20.2 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/PGC1481665-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/PGC1481665-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-10T07:42:54.978760 Stage halos : Wall: 0.71 s, CPU: 0.47 s, VmPeak: 1132 MB, VmSize: 1132 MB, VmRSS: 309 MB, VmData: 338 MB, maxrss: 0.316592 MB Stage halos finished: 2020-08-10T07:42:55.688025 Resources for stage halos : 0.694 s worker CPU, 1.415 s worker Wall, Wall: 0.710 s, Cores in use: 1.64, Total efficiency (on 8 cores): 20.5 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/PGC1481665-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/PGC1481665-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-10T07:42:55.980811 PSF sigmas in coadd pixels: ['1.74', '2.36', '2.69', '1.74'] Using average PSF sigma 2.132316113681951 Gaussian PSF norm 0.13229501477938674 vs pixelized 0.10772464 average tim pixel scale / coadd scale: 1.0011179589502912 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.54', '2.01', '2.29', '1.80'] Using average PSF sigma 1.910606008641924 Gaussian PSF norm 0.14764676259674997 vs pixelized 0.12626761 average tim pixel scale / coadd scale: 1.0011680964078356 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.76', '2.42', '1.80'] Using average PSF sigma 1.9929718212440803 Gaussian PSF norm 0.1415447969544221 vs pixelized 0.11347744 average tim pixel scale / coadd scale: 1.001219166965288 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.19 s, CPU: 0.16 s, VmPeak: 1132 MB, VmSize: 1132 MB, VmRSS: 311 MB, VmData: 338 MB, maxrss: 0.318064 MB Stage fit_on_coadds finished: 2020-08-10T07:42:56.166859 Resources for stage fit_on_coadds : 0.197 s worker CPU, 0.197 s worker Wall, Wall: 0.187 s, Cores in use: 1.93, Total efficiency (on 8 cores): 24.1 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/PGC1481665-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/PGC1481665-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-10T07:42:56.199697 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 52 potential peaks Of 52 potential peaks: 31 in veto map, 5 cut by saddle test, 0 cut by aper test, 16 kept SED z : 16 new peaks Found 78 potential peaks Of 78 potential peaks: 71 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 76 potential peaks Of 76 potential peaks: 70 in veto map, 3 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 94 potential peaks Of 94 potential peaks: 87 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 109 potential peaks Of 109 potential peaks: 102 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 24 new sources Median coadd sky for g : 0.00025010027 Median coadd sky for r : 0.00045560693 Median coadd sky for z : 0.001365625 Stage srcs : Wall: 0.93 s, CPU: 0.89 s, VmPeak: 1132 MB, VmSize: 1132 MB, VmRSS: 311 MB, VmData: 338 MB, maxrss: 0.318624 MB Stage srcs finished: 2020-08-10T07:42:57.132426 Resources for stage srcs : 0.060 s worker CPU, 0.060 s worker Wall, Wall: 0.934 s, Cores in use: 1.02, Total efficiency (on 8 cores): 12.7 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/PGC1481665-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/PGC1481665-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-10T07:42:57.145974 Blob 1 of 9, id: 3, sources: 20, size: 230x225, npix 30223, brick X: 3,233, Y: 8,233, one pixel: 98 8 Blob 2 of 9, id: 0, sources: 2, size: 53x40, npix 1329, brick X: 5,58, Y: 0,40, one pixel: 29 0 Blob 3 of 9, id: 2, sources: 2, size: 51x34, npix 1269, brick X: 158,209, Y: 0,34, one pixel: 168 0 Blob 4 of 9, id: 5, sources: 3, size: 37x45, npix 1141, brick X: 0,37, Y: 42,87, one pixel: 2 42 Blob 5 of 9, id: 1, sources: 1, size: 34x30, npix 740, brick X: 118,152, Y: 0,30, one pixel: 126 0 Blob 6 of 9, id: 4, sources: 2, size: 21x36, npix 528, brick X: 212,233, Y: 19,55, one pixel: 222 19 Blob 7 of 9, id: 6, sources: 1, size: 25x24, npix 377, brick X: 102,127, Y: 200,224, one pixel: 113 200 Blob 8 of 9, id: 7, sources: 1, size: 21x22, npix 279, brick X: 41,62, Y: 207,229, one pixel: 50 207 Blob 9 of 9, id: 8, sources: 1, size: 15x18, npix 208, brick X: 218,233, Y: 215,233, one pixel: 226 215 Blob 8 finished, total: Wall: 0.31 s, CPU: 0.30 s, VmPeak: 968 MB, VmSize: 727 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.14786 MB Blob 7 finished, total: Wall: 0.32 s, CPU: 0.31 s, VmPeak: 940 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145216 MB Blob 9 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 968 MB, VmSize: 727 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.14786 MB Blob 5 finished, total: Wall: 1.31 s, CPU: 1.30 s, VmPeak: 941 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145312 MB Blob 6 finished, total: Wall: 1.45 s, CPU: 1.45 s, VmPeak: 935 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145888 MB Blob 4 finished, total: Wall: 1.76 s, CPU: 1.75 s, VmPeak: 968 MB, VmSize: 728 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147484 MB Blob 2 finished, total: Wall: 1.77 s, CPU: 1.77 s, VmPeak: 939 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145684 MB Blob 3 finished, total: Wall: 2.10 s, CPU: 2.09 s, VmPeak: 976 MB, VmSize: 727 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148032 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.661779, ee1=-0.000719592, ee2=-0.316786 Measuring 8 iterative sources Blob 1 finished, total: Wall: 25.32 s, CPU: 25.32 s, VmPeak: 941 MB, VmSize: 728 MB, VmRSS: 153 MB, VmData: 183 MB, maxrss: 0.156332 MB Old catalog: 45 New catalog: 39 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/metrics/cus/blobs-custom-263677p15327.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/metrics/cus/all-models-custom-263677p15327.fits Stage fitblobs : Wall: 26.08 s, CPU: 0.65 s, VmPeak: 1132 MB, VmSize: 1132 MB, VmRSS: 312 MB, VmData: 339 MB, maxrss: 0.31988 MB Stage fitblobs finished: 2020-08-10T07:43:23.230781 Resources for stage fitblobs : 35.188 s worker CPU, 35.343 s worker Wall, Wall: 26.086 s, Cores in use: 1.37, Total efficiency (on 8 cores): 17.2 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/PGC1481665-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/PGC1481665-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-10T07:43:23.407213 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/tmp-legacysurvey-custom-263677p15327-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/tmp-legacysurvey-custom-263677p15327-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/tmp-legacysurvey-custom-263677p15327-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/tmp-legacysurvey-custom-263677p15327-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-resid.jpg Stage coadds : Wall: 1.32 s, CPU: 0.59 s, VmPeak: 1132 MB, VmSize: 1132 MB, VmRSS: 313 MB, VmData: 339 MB, maxrss: 0.320204 MB Stage coadds finished: 2020-08-10T07:43:24.730434 Resources for stage coadds : 4.129 s worker CPU, 4.542 s worker Wall, Wall: 1.324 s, Cores in use: 3.57, Total efficiency (on 8 cores): 44.6 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/PGC1481665-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/PGC1481665-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-10T07:43:24.745230 Cut to 1 unWISE tiles Reading WISE tile 2629p151 band 1 Reading WISE tile 2629p151 band 2 Reading WISE tile 2629p151 band 3 Reading WISE tile 2629p151 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 940 MB, VmSize: 800 MB, VmRSS: 143 MB, VmData: 171 MB, maxrss: 0.207004 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 976 MB, VmSize: 800 MB, VmRSS: 143 MB, VmData: 171 MB, maxrss: 0.206216 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 968 MB, VmSize: 801 MB, VmRSS: 144 MB, VmData: 172 MB, maxrss: 0.208636 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/262/2629p151/unwise-2629p151-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 968 MB, VmSize: 806 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.18946 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/tmp-legacysurvey-custom-263677p15327-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/tmp-legacysurvey-custom-263677p15327-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.01 s, CPU: 0.64 s, VmPeak: 1132 MB, VmSize: 1132 MB, VmRSS: 313 MB, VmData: 339 MB, maxrss: 0.320716 MB Stage wise_forced finished: 2020-08-10T07:43:27.755969 Resources for stage wise_forced : 3.322 s worker CPU, 6.119 s worker Wall, Wall: 3.012 s, Cores in use: 1.32, Total efficiency (on 8 cores): 16.4 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/PGC1481665-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/PGC1481665-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-10T07:43:27.770285 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/coadd/cus/custom-263677p15327/legacysurvey-custom-263677p15327-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/tractor-i/cus/tractor-custom-263677p15327.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/tractor/cus/tractor-custom-263677p15327.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/tractor/cus/brick-custom-263677p15327.sha256sum Stage writecat : Wall: 0.76 s, CPU: 0.59 s, VmPeak: 1264 MB, VmSize: 1136 MB, VmRSS: 315 MB, VmData: 339 MB, maxrss: 0.453588 MB Stage writecat finished: 2020-08-10T07:43:28.532694 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.764 s, Cores in use: 0.77, Total efficiency (on 8 cores): 9.6 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/PGC1481665-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC1481665/PGC1481665-largegalaxy-writecat.p All done: 50.283 s worker CPU, 414.047 s worker Wall, Wall: 126.478 s, Cores in use: 0.52, Total efficiency (on 8 cores): 6.5 % Finished galaxy PGC1481665 in 2.139 minutes.