Started working on galaxy PGC1062054 at Wed Aug 5 21:02:04 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 353.465535 -4.1584 --width 287 --height 287 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/PGC1062054-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/PGC1062054-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T21:02:05.442443 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '353.465535', '-4.1584', '--width', '287', '--height', '287', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/PGC1062054-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/PGC1062054-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 353.465535 -4.1584 --width 287 --height 287 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/PGC1062054-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/PGC1062054-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 353.465535 -4.1584 Starting process 58778 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 58780 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 58782 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 58784 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 58786 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB Starting process 58789 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05956 MB Starting process 58791 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05956 MB Starting process 58793 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 58795 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 58797 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 58799 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 58801 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 58802 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 58805 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 58807 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 58810 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T21:02:06.022130 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 14 CCDs: c4d_180918_014341_ooi_z_ls9-N5 z expnum 775021 exptime 91.0 propid 2014B-0404 seeing 1.13 MJD 58379.072 object DECaLS_45650_z decam/CP/V4.8.2a/CP20180917/c4d_180918_014341_ooi_z_ls9.fits.fz c4d_170726_062517_ooi_r_ls9-S1 r expnum 662327 exptime 40.0 propid 2014B-0404 seeing 1.20 MJD 57960.266 object DECaLS_13885_r decam/CP/V4.8.2a/CP20170725/c4d_170726_062517_ooi_r_ls9.fits.fz c4d_170722_053503_ooi_g_ls9-S1 g expnum 660914 exptime 91.0 propid 2014B-0404 seeing 1.14 MJD 57956.231 object DECaLS_13885_g decam/CP/V4.8.2a/CP20170721/c4d_170722_053503_ooi_g_ls9.fits.fz c4d_180903_060413_ooi_z_ls9-S6 z expnum 768380 exptime 80.0 propid 2014B-0404 seeing 1.21 MJD 58364.253 object DECaLS_29778_z decam/CP/V4.8.2a/CP20180902/c4d_180903_060413_ooi_z_ls9.fits.fz c4d_170718_092044_ooi_z_ls9-S6 z expnum 659704 exptime 80.0 propid 2014B-0404 seeing 1.89 MJD 57952.388 object DECaLS_29778_z decam/CP/V4.8.2/CP20170717/c4d_170718_092044_ooi_z_ls9.fits.fz c4d_180725_070615_ooi_z_ls9-S1 z expnum 758885 exptime 95.0 propid 2014B-0404 seeing 1.14 MJD 58324.296 object DECaLS_13885_z decam/CP/V4.8.2a/CP20180724/c4d_180725_070615_ooi_z_ls9.fits.fz c4d_170726_062406_ooi_r_ls9-S7 r expnum 662326 exptime 41.0 propid 2014B-0404 seeing 1.10 MJD 57960.266 object DECaLS_13906_r decam/CP/V4.8.2a/CP20170725/c4d_170726_062406_ooi_r_ls9.fits.fz c4d_170718_080457_ooi_z_ls9-S7 z expnum 659674 exptime 80.0 propid 2014B-0404 seeing 1.32 MJD 57952.335 object DECaLS_13906_z decam/CP/V4.8.2/CP20170717/c4d_170718_080457_ooi_z_ls9.fits.fz c4d_160812_062518_ooi_g_ls9-S7 g expnum 563198 exptime 56.0 propid 2014B-0404 seeing 1.27 MJD 57612.266 object DECaLS_13906_g decam/CP/V4.8.2a/CP20160811/c4d_160812_062518_ooi_g_ls9.fits.fz c4d_180905_053307_ooi_g_ls9-N1 g expnum 769129 exptime 56.0 propid 2014B-0404 seeing 1.07 MJD 58366.231 object DECaLS_57164_g decam/CP/V4.8.2a/CP20180904/c4d_180905_053307_ooi_g_ls9.fits.fz c4d_180905_051647_ooi_g_ls9-N7 g expnum 769119 exptime 56.0 propid 2014B-0404 seeing 1.03 MJD 58366.220 object DECaLS_57163_g decam/CP/V4.8.2a/CP20180904/c4d_180905_051647_ooi_g_ls9.fits.fz c4d_180912_030142_ooi_r_ls9-N5 r expnum 772283 exptime 47.0 propid 2014B-0404 seeing 1.02 MJD 58373.126 object DECaLS_45650_r decam/CP/V4.8.2a/CP20180911/c4d_180912_030142_ooi_r_ls9.fits.fz c4d_170820_044211_ooi_r_ls9-S6 r expnum 669464 exptime 73.0 propid 2014B-0404 seeing 1.53 MJD 57985.196 object DECaLS_29778_r decam/CP/V4.8.2a/CP20170819/c4d_170820_044211_ooi_r_ls9.fits.fz c4d_170725_062534_ooi_g_ls9-S6 g expnum 661952 exptime 163.0 propid 2014B-0404 seeing 1.39 MJD 57959.265 object DECaLS_29778_g decam/CP/V4.8.2a/CP20170724/c4d_170725_062534_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e554-g-20170722T053239_oi[S1,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9518ea9-z-20170718T091830_oi[S6,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95624c3-g-20160812T062331_oi[S7,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953495f-g-20180905T051647_oi[N7,noinherit][2046,4094][real]: DECaLS_5 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ff0f-g-20170725T062158_oi[S6,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953495f-g-20180905T053307_oi[N1,noinherit][2046,4094][real]: DECaLS_5 Clipping 9 pixels with anomalously large oow values: max 0.0713421 vs median 0.0515535 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180912T030142_oi[N5,noinherit][2046,4094][real]: DECaLS_45650 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520746-r-20170726T062233_oi[S7,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955eab7-z-20180725T070615_oi[S1,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520746-r-20170726T062343_oi[S1,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520d19-r-20170820T044211_oi[S6,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180903T060413_oi[S6,noinherit][2046,4094][real]: DECaLS_29778 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951822a-z-20170718T080242_oi[S7,noinherit][2046,4094][real]: DECaLS_1 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f17b-z-20180918T014341_oi[N5,noinherit][2046,4094][real]: DECaLS_4 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 93.92 s, CPU: 1.03 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 182 MB, VmData: 215 MB, maxrss: 0.186656 MB Stage tims finished: 2020-08-05T21:03:39.946197 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520746-r-20170726T062343_oi[S1,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520746-r-20170726T062233_oi[S7,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95624c3-g-20160812T062331_oi[S7,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953495f-g-20180905T053307_oi[N1,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9518ea9-z-20170718T091830_oi[S6,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953495f-g-20180905T051647_oi[N7,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520d19-r-20170820T044211_oi[S6,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f17b-z-20180918T014341_oi[N5,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 9.977 s worker CPU, 824.952 s worker Wall, Wall: 93.926 s, Cores in use: 0.12, Total efficiency (on 16 cores): 0.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/PGC1062054-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/PGC1062054-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955eab7-z-20180725T070615_oi[S1,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ff0f-g-20170725T062158_oi[S6,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e554-g-20170722T053239_oi[S1,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180912T030142_oi[N5,noinherit][2046,4094][real]: DECaLS_45650 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180903T060413_oi[S6,noinherit][2046,4094][real]: DECaLS_29778 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951822a-z-20170718T080242_oi[S7,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T21:03:39.977653 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06717.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06590.fits Matched 3 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/metrics/cus/reference-custom-353465m04158.fits Stage refs : Wall: 5.98 s, CPU: 1.57 s, VmPeak: 1043 MB, VmSize: 1025 MB, VmRSS: 197 MB, VmData: 227 MB, maxrss: 0.20124 MB Stage refs finished: 2020-08-05T21:03:45.958692 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.982 s, Cores in use: 0.26, Total efficiency (on 16 cores): 1.6 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/PGC1062054-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/PGC1062054-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T21:03:46.151587 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/metrics/cus/outlier-mask-custom-353465m04158.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/metrics/cus/outliers-pre-custom-353465m04158.jpg Image c4d_170725_062534_ooi_g_ls9-S6 g : masking 45 positive outlier pixels and 0 negative outlier pixels Image c4d_170722_053503_ooi_g_ls9-S1 g : masking 326 positive outlier pixels and 0 negative outlier pixels Image c4d_180912_030142_ooi_r_ls9-N5 r : masking 174 positive outlier pixels and 0 negative outlier pixels Image c4d_180903_060413_ooi_z_ls9-S6 z : masking 122 positive outlier pixels and 0 negative outlier pixels Image c4d_180725_070615_ooi_z_ls9-S1 z : masking 687 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/metrics/cus/outlier-mask-custom-353465m04158.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/metrics/cus/outliers-post-custom-353465m04158.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/metrics/cus/outliers-masked-pos-custom-353465m04158.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/metrics/cus/outliers-masked-neg-custom-353465m04158.jpg Stage outliers : Wall: 1.24 s, CPU: 0.96 s, VmPeak: 1043 MB, VmSize: 1034 MB, VmRSS: 215 MB, VmData: 243 MB, maxrss: 0.220664 MB Stage outliers finished: 2020-08-05T21:03:47.395124 Resources for stage outliers : 1.154 s worker CPU, 1.258 s worker Wall, Wall: 1.245 s, Cores in use: 1.70, Total efficiency (on 16 cores): 10.6 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/PGC1062054-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/PGC1062054-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T21:03:47.431548 Stage halos : Wall: 0.89 s, CPU: 0.54 s, VmPeak: 1043 MB, VmSize: 1034 MB, VmRSS: 216 MB, VmData: 243 MB, maxrss: 0.220836 MB Stage halos finished: 2020-08-05T21:03:48.318357 Resources for stage halos : 0.220 s worker CPU, 1.305 s worker Wall, Wall: 0.888 s, Cores in use: 0.86, Total efficiency (on 16 cores): 5.4 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/PGC1062054-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/PGC1062054-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T21:03:48.356595 PSF sigmas in coadd pixels: ['1.85', '2.06', '1.74', '1.67', '2.26'] Using average PSF sigma 1.9151461457426897 Gaussian PSF norm 0.14729674411582955 vs pixelized 0.124937944 average tim pixel scale / coadd scale: 1.0011396735181448 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.95', '1.79', '1.66', '2.49'] Using average PSF sigma 1.9729385965598634 Gaussian PSF norm 0.14298204326569308 vs pixelized 0.121617384 average tim pixel scale / coadd scale: 1.0011728952073613 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.84', '1.96', '3.07', '1.85', '2.14'] Using average PSF sigma 2.169243331118441 Gaussian PSF norm 0.13004294526443597 vs pixelized 0.106589034 average tim pixel scale / coadd scale: 1.001109481071129 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.24 s, CPU: 0.22 s, VmPeak: 1043 MB, VmSize: 1034 MB, VmRSS: 218 MB, VmData: 244 MB, maxrss: 0.2234 MB Stage fit_on_coadds finished: 2020-08-05T21:03:48.600077 Resources for stage fit_on_coadds : 0.239 s worker CPU, 0.239 s worker Wall, Wall: 0.245 s, Cores in use: 1.89, Total efficiency (on 16 cores): 11.8 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/PGC1062054-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/PGC1062054-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T21:03:48.615026 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 18 potential peaks Of 18 potential peaks: 1 in veto map, 2 cut by saddle test, 0 cut by aper test, 15 kept SED z : 15 new peaks Found 15 potential peaks Of 15 potential peaks: 12 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 17 potential peaks Of 17 potential peaks: 11 in veto map, 0 cut by saddle test, 0 cut by aper test, 6 kept SED g : 6 new peaks Found 24 potential peaks Of 24 potential peaks: 22 in veto map, 0 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 29 potential peaks Of 29 potential peaks: 26 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 27 new sources Median coadd sky for g : -0.00013888498 Median coadd sky for r : -9.0955145e-05 Median coadd sky for z : 0.00013080389 Stage srcs : Wall: 1.27 s, CPU: 1.19 s, VmPeak: 1043 MB, VmSize: 1034 MB, VmRSS: 219 MB, VmData: 244 MB, maxrss: 0.223808 MB Stage srcs finished: 2020-08-05T21:03:49.886914 Resources for stage srcs : 0.090 s worker CPU, 0.090 s worker Wall, Wall: 1.273 s, Cores in use: 1.01, Total efficiency (on 16 cores): 6.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/PGC1062054-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/PGC1062054-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T21:03:49.903729 Blob 1 of 25, id: 11, sources: 4, size: 118x67, npix 4918, brick X: 83,201, Y: 97,164, one pixel: 139 97 Blob 2 of 25, id: 3, sources: 2, size: 41x51, npix 1135, brick X: 10,51, Y: 25,76, one pixel: 20 25 Blob 3 of 25, id: 16, sources: 1, size: 30x29, npix 583, brick X: 160,190, Y: 164,193, one pixel: 172 164 Blob 4 of 25, id: 9, sources: 1, size: 31x29, npix 577, brick X: 205,236, Y: 80,109, one pixel: 219 80 Blob 5 of 25, id: 13, sources: 1, size: 27x31, npix 575, brick X: 47,74, Y: 122,153, one pixel: 57 122 Blob 6 of 25, id: 8, sources: 1, size: 28x27, npix 483, brick X: 103,131, Y: 53,80, one pixel: 116 53 Blob 7 of 25, id: 19, sources: 1, size: 32x24, npix 452, brick X: 37,69, Y: 217,241, one pixel: 46 217 Blob 8 of 25, id: 5, sources: 1, size: 25x24, npix 379, brick X: 45,70, Y: 30,54, one pixel: 56 30 Blob 9 of 25, id: 1, sources: 1, size: 25x23, npix 361, brick X: 103,128, Y: 12,35, one pixel: 113 12 Blob 10 of 25, id: 23, sources: 1, size: 23x23, npix 327, brick X: 61,84, Y: 252,275, one pixel: 71 252 Blob 11 of 25, id: 20, sources: 1, size: 23x23, npix 318, brick X: 152,175, Y: 230,253, one pixel: 162 230 Blob 12 of 25, id: 14, sources: 1, size: 22x22, npix 292, brick X: 203,225, Y: 136,158, one pixel: 213 136 Blob 13 of 25, id: 4, sources: 1, size: 22x22, npix 291, brick X: 187,209, Y: 27,49, one pixel: 196 27 Blob 14 of 25, id: 17, sources: 1, size: 22x21, npix 280, brick X: 188,210, Y: 200,221, one pixel: 197 200 Blob 15 of 25, id: 0, sources: 1, size: 26x15, npix 276, brick X: 186,212, Y: 0,15, one pixel: 187 0 Blob 16 of 25, id: 21, sources: 1, size: 21x22, npix 272, brick X: 107,128, Y: 241,263, one pixel: 117 241 Blob 17 of 25, id: 18, sources: 1, size: 21x21, npix 269, brick X: 67,88, Y: 208,229, one pixel: 76 208 Blob 14 finished, total: Wall: 0.34 s, CPU: 0.32 s, VmPeak: 922 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149612 MB Blob 18 of 25, id: 7, sources: 1, size: 21x21, npix 260, brick X: 62,83, Y: 46,67, one pixel: 71 46 Blob 8 finished, total: Wall: 0.49 s, CPU: 0.47 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 113 MB, VmData: 167 MB, maxrss: 0.115828 MB Blob 19 of 25, id: 22, sources: 1, size: 21x21, npix 260, brick X: 204,225, Y: 244,265, one pixel: 213 244 Blob 12 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 941 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148428 MB Blob 20 of 25, id: 24, sources: 1, size: 22x20, npix 259, brick X: 194,216, Y: 264,284, one pixel: 203 264 Blob 17 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 922 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149824 MB Blob 21 of 25, id: 12, sources: 1, size: 21x21, npix 250, brick X: 177,198, Y: 97,118, one pixel: 186 97 Blob 10 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 941 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149992 MB Blob 22 of 25, id: 15, sources: 1, size: 18x20, npix 215, brick X: 269,287, Y: 163,183, one pixel: 278 163 Measuring 1 iterative sources Blob 13 finished, total: Wall: 0.87 s, CPU: 0.85 s, VmPeak: 960 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148316 MB Blob 23 of 25, id: 10, sources: 1, size: 19x18, npix 189, brick X: 161,180, Y: 87,105, one pixel: 169 87 Blob 20 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 922 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149824 MB Blob 7 finished, total: Wall: 0.96 s, CPU: 0.93 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 113 MB, VmData: 166 MB, maxrss: 0.115356 MB Blob 24 of 25, id: 2, sources: 1, size: 13x21, npix 181, brick X: 274,287, Y: 14,35, one pixel: 283 14 Blob 25 of 25, id: 6, sources: 1, size: 17x18, npix 162, brick X: 149,166, Y: 36,54, one pixel: 157 36 Blob 16 finished, total: Wall: 0.96 s, CPU: 0.94 s, VmPeak: 944 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.15002 MB Blob 15 finished, total: Wall: 0.98 s, CPU: 0.97 s, VmPeak: 959 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 187 MB, maxrss: 0.15632 MB Blob 23 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 922 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149824 MB Blob 25 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 944 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.15042 MB Blob 9 finished, total: Wall: 1.09 s, CPU: 1.07 s, VmPeak: 950 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149156 MB Blob 6 finished, total: Wall: 1.12 s, CPU: 1.09 s, VmPeak: 960 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149648 MB Blob 11 finished, total: Wall: 1.11 s, CPU: 1.11 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149648 MB Blob 22 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 960 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148316 MB Blob 3 finished, total: Wall: 1.24 s, CPU: 1.22 s, VmPeak: 922 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 186 MB, maxrss: 0.155288 MB Blob 21 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 941 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150372 MB Blob 18 finished, total: Wall: 0.87 s, CPU: 0.87 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 113 MB, VmData: 167 MB, maxrss: 0.116064 MB Blob 19 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 941 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150396 MB Blob 4 finished, total: Wall: 1.46 s, CPU: 1.43 s, VmPeak: 953 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149764 MB Blob 5 finished, total: Wall: 1.54 s, CPU: 1.51 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150024 MB Blob 24 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 113 MB, VmData: 166 MB, maxrss: 0.115532 MB Blob 2 finished, total: Wall: 1.88 s, CPU: 1.87 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149724 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.80137, ee1=-1.16871, ee2=-0.0449091 Blob 1 finished, total: Wall: 6.29 s, CPU: 6.27 s, VmPeak: 941 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.151276 MB Old catalog: 30 New catalog: 27 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/metrics/cus/blobs-custom-353465m04158.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/metrics/cus/all-models-custom-353465m04158.fits Stage fitblobs : Wall: 7.54 s, CPU: 1.25 s, VmPeak: 1043 MB, VmSize: 1034 MB, VmRSS: 219 MB, VmData: 244 MB, maxrss: 0.224228 MB Stage fitblobs finished: 2020-08-05T21:03:57.441889 Resources for stage fitblobs : 25.559 s worker CPU, 26.133 s worker Wall, Wall: 7.540 s, Cores in use: 3.56, Total efficiency (on 16 cores): 22.2 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/PGC1062054-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/PGC1062054-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T21:03:57.461850 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/tmp-legacysurvey-custom-353465m04158-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/tmp-legacysurvey-custom-353465m04158-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/tmp-legacysurvey-custom-353465m04158-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/tmp-legacysurvey-custom-353465m04158-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-resid.jpg Stage coadds : Wall: 2.84 s, CPU: 1.00 s, VmPeak: 1043 MB, VmSize: 1034 MB, VmRSS: 219 MB, VmData: 244 MB, maxrss: 0.22468 MB Stage coadds finished: 2020-08-05T21:04:00.306677 Resources for stage coadds : 8.607 s worker CPU, 11.774 s worker Wall, Wall: 2.846 s, Cores in use: 3.38, Total efficiency (on 16 cores): 21.1 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/PGC1062054-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/PGC1062054-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T21:04:00.733210 Cut to 1 unWISE tiles Reading WISE tile 3539m046 band 1 Reading WISE tile 3539m046 band 2 Reading WISE tile 3539m046 band 3 Reading WISE tile 3539m046 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 956 MB, VmSize: 806 MB, VmRSS: 145 MB, VmData: 171 MB, maxrss: 0.208908 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 955 MB, VmSize: 809 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.212624 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 959 MB, VmSize: 809 MB, VmRSS: 149 MB, VmData: 174 MB, maxrss: 0.212476 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 941 MB, VmSize: 812 MB, VmRSS: 152 MB, VmData: 177 MB, maxrss: 0.194108 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/tmp-legacysurvey-custom-353465m04158-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/tmp-legacysurvey-custom-353465m04158-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 4.28 s, CPU: 0.61 s, VmPeak: 1043 MB, VmSize: 1034 MB, VmRSS: 220 MB, VmData: 244 MB, maxrss: 0.225384 MB Stage wise_forced finished: 2020-08-05T21:04:05.011730 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.021 s worker CPU, 7.729 s worker Wall, Wall: 4.280 s, Cores in use: 0.85, Total efficiency (on 16 cores): 5.3 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/PGC1062054-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/PGC1062054-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T21:04:05.105508 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/tractor-i/cus/tractor-custom-353465m04158.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/tractor/cus/tractor-custom-353465m04158.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/tractor/cus/brick-custom-353465m04158.sha256sum Stage writecat : Wall: 1.57 s, CPU: 1.23 s, VmPeak: 1167 MB, VmSize: 1039 MB, VmRSS: 222 MB, VmData: 244 MB, maxrss: 0.358388 MB Stage writecat finished: 2020-08-05T21:04:06.674117 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.570 s, Cores in use: 0.78, Total efficiency (on 16 cores): 4.9 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/PGC1062054-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/353/PGC1062054/PGC1062054-largegalaxy-writecat.p All done: 48.870 s worker CPU, 873.483 s worker Wall, Wall: 120.672 s, Cores in use: 0.49, Total efficiency (on 16 cores): 3.0 % Finished galaxy PGC1062054 in 2.048 minutes. Started working on galaxy PGC1062054 at Mon Aug 10 10:55:35 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 353.46555515921864 -4.158573331126899 --width 287 --height 287 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/PGC1062054-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/PGC1062054-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-10T10:55:36.318978 legacypipe git version: DR9.5.11-watershed-6-g6a2880fc Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '353.46555515921864', '-4.158573331126899', '--width', '287', '--height', '287', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/PGC1062054-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/PGC1062054-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 353.46555515921864 -4.158573331126899 --width 287 --height 287 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/PGC1062054-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/PGC1062054-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 353.46555515921864 -4.158573331126899 Starting process 54840 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 54841 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 54842 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 54843 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 54844 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059404 MB Starting process 54845 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059412 MB Starting process 54846 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059412 MB Starting process 54847 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-10T10:55:37.320202 Keeping 14 CCDs: c4d_180918_014341_ooi_z_ls9-N5 z expnum 775021 exptime 91.0 propid 2014B-0404 seeing 1.13 MJD 58379.072 object DECaLS_45650_z decam/CP/V4.8.2a/CP20180917/c4d_180918_014341_ooi_z_ls9.fits.fz c4d_170726_062517_ooi_r_ls9-S1 r expnum 662327 exptime 40.0 propid 2014B-0404 seeing 1.20 MJD 57960.266 object DECaLS_13885_r decam/CP/V4.8.2a/CP20170725/c4d_170726_062517_ooi_r_ls9.fits.fz c4d_170722_053503_ooi_g_ls9-S1 g expnum 660914 exptime 91.0 propid 2014B-0404 seeing 1.14 MJD 57956.231 object DECaLS_13885_g decam/CP/V4.8.2a/CP20170721/c4d_170722_053503_ooi_g_ls9.fits.fz c4d_180903_060413_ooi_z_ls9-S6 z expnum 768380 exptime 80.0 propid 2014B-0404 seeing 1.21 MJD 58364.253 object DECaLS_29778_z decam/CP/V4.8.2a/CP20180902/c4d_180903_060413_ooi_z_ls9.fits.fz c4d_170718_092044_ooi_z_ls9-S6 z expnum 659704 exptime 80.0 propid 2014B-0404 seeing 1.89 MJD 57952.388 object DECaLS_29778_z decam/CP/V4.8.2/CP20170717/c4d_170718_092044_ooi_z_ls9.fits.fz c4d_180725_070615_ooi_z_ls9-S1 z expnum 758885 exptime 95.0 propid 2014B-0404 seeing 1.14 MJD 58324.296 object DECaLS_13885_z decam/CP/V4.8.2a/CP20180724/c4d_180725_070615_ooi_z_ls9.fits.fz c4d_170726_062406_ooi_r_ls9-S7 r expnum 662326 exptime 41.0 propid 2014B-0404 seeing 1.10 MJD 57960.266 object DECaLS_13906_r decam/CP/V4.8.2a/CP20170725/c4d_170726_062406_ooi_r_ls9.fits.fz c4d_170718_080457_ooi_z_ls9-S7 z expnum 659674 exptime 80.0 propid 2014B-0404 seeing 1.32 MJD 57952.335 object DECaLS_13906_z decam/CP/V4.8.2/CP20170717/c4d_170718_080457_ooi_z_ls9.fits.fz c4d_160812_062518_ooi_g_ls9-S7 g expnum 563198 exptime 56.0 propid 2014B-0404 seeing 1.27 MJD 57612.266 object DECaLS_13906_g decam/CP/V4.8.2a/CP20160811/c4d_160812_062518_ooi_g_ls9.fits.fz c4d_180905_053307_ooi_g_ls9-N1 g expnum 769129 exptime 56.0 propid 2014B-0404 seeing 1.07 MJD 58366.231 object DECaLS_57164_g decam/CP/V4.8.2a/CP20180904/c4d_180905_053307_ooi_g_ls9.fits.fz c4d_180905_051647_ooi_g_ls9-N7 g expnum 769119 exptime 56.0 propid 2014B-0404 seeing 1.03 MJD 58366.220 object DECaLS_57163_g decam/CP/V4.8.2a/CP20180904/c4d_180905_051647_ooi_g_ls9.fits.fz c4d_180912_030142_ooi_r_ls9-N5 r expnum 772283 exptime 47.0 propid 2014B-0404 seeing 1.02 MJD 58373.126 object DECaLS_45650_r decam/CP/V4.8.2a/CP20180911/c4d_180912_030142_ooi_r_ls9.fits.fz c4d_170820_044211_ooi_r_ls9-S6 r expnum 669464 exptime 73.0 propid 2014B-0404 seeing 1.53 MJD 57985.196 object DECaLS_29778_r decam/CP/V4.8.2a/CP20170819/c4d_170820_044211_ooi_r_ls9.fits.fz c4d_170725_062534_ooi_g_ls9-S6 g expnum 661952 exptime 163.0 propid 2014B-0404 seeing 1.39 MJD 57959.265 object DECaLS_29778_g decam/CP/V4.8.2a/CP20170724/c4d_170725_062534_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9518ea9-z-20170718T091830_oi[S6,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e554-g-20170722T053239_oi[S1,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955eab7-z-20180725T070615_oi[S1,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520746-r-20170726T062233_oi[S7,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520746-r-20170726T062343_oi[S1,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180903T060413_oi[S6,noinherit][2046,4094][real]: DECaLS_29778 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95624c3-g-20160812T062331_oi[S7,noinherit][2046,4094][real]: DECaLS_1 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953495f-g-20180905T053307_oi[N1,noinherit][2046,4094][real]: DECaLS_5 Clipping 9 pixels with anomalously large oow values: max 0.0713421 vs median 0.0515535 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953495f-g-20180905T051647_oi[N7,noinherit][2046,4094][real]: DECaLS_5 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180912T030142_oi[N5,noinherit][2046,4094][real]: DECaLS_45650 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ff0f-g-20170725T062158_oi[S6,noinherit][2046,4094][real]: DECaLS_2 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520d19-r-20170820T044211_oi[S6,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951822a-z-20170718T080242_oi[S7,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f17b-z-20180918T014341_oi[N5,noinherit][2046,4094][real]: DECaLS_4 Stage tims : Wall: 90.68 s, CPU: 0.95 s, VmPeak: 1006 MB, VmSize: 1006 MB, VmRSS: 180 MB, VmData: 214 MB, maxrss: 0.184676 MB Stage tims finished: 2020-08-10T10:57:07.998583 Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9518ea9-z-20170718T091830_oi[S6,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95624c3-g-20160812T062331_oi[S7,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955eab7-z-20180725T070615_oi[S1,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953495f-g-20180905T053307_oi[N1,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520746-r-20170726T062343_oi[S1,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953495f-g-20180905T051647_oi[N7,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520746-r-20170726T062233_oi[S7,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180912T030142_oi[N5,noinherit][2046,4094][real]: DECaLS_45650 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180903T060413_oi[S6,noinherit][2046,4094][real]: DECaLS_29778 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ff0f-g-20170725T062158_oi[S6,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e554-g-20170722T053239_oi[S1,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520d19-r-20170820T044211_oi[S6,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] Resources for stage tims : 6.559 s worker CPU, 528.041 s worker Wall, Wall: 90.680 s, Cores in use: 0.08, Total efficiency (on 8 cores): 1.0 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/PGC1062054-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/PGC1062054-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951822a-z-20170718T080242_oi[S7,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f17b-z-20180918T014341_oi[N5,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Running stage refs at 2020-08-10T10:57:10.098132 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06717.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06590.fits Matched 3 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/metrics/cus/reference-custom-353465m04158.fits Stage refs : Wall: 8.51 s, CPU: 1.49 s, VmPeak: 1036 MB, VmSize: 1019 MB, VmRSS: 194 MB, VmData: 227 MB, maxrss: 0.19892 MB Stage refs finished: 2020-08-10T10:57:18.608164 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.511 s, Cores in use: 0.18, Total efficiency (on 8 cores): 2.2 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/PGC1062054-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/PGC1062054-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-10T10:57:18.639405 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/metrics/cus/outlier-mask-custom-353465m04158.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/metrics/cus/outliers-pre-custom-353465m04158.jpg Image c4d_170725_062534_ooi_g_ls9-S6 g : masking 45 positive outlier pixels and 0 negative outlier pixels Image c4d_170722_053503_ooi_g_ls9-S1 g : masking 320 positive outlier pixels and 0 negative outlier pixels Image c4d_180905_051647_ooi_g_ls9-N7 g : masking 138 positive outlier pixels and 61 negative outlier pixels Image c4d_180912_030142_ooi_r_ls9-N5 r : masking 157 positive outlier pixels and 0 negative outlier pixels Image c4d_180903_060413_ooi_z_ls9-S6 z : masking 129 positive outlier pixels and 0 negative outlier pixels Image c4d_180725_070615_ooi_z_ls9-S1 z : masking 686 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/metrics/cus/outlier-mask-custom-353465m04158.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/metrics/cus/outliers-post-custom-353465m04158.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/metrics/cus/outliers-masked-pos-custom-353465m04158.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/metrics/cus/outliers-masked-neg-custom-353465m04158.jpg Stage outliers : Wall: 1.04 s, CPU: 0.76 s, VmPeak: 1036 MB, VmSize: 1028 MB, VmRSS: 213 MB, VmData: 242 MB, maxrss: 0.217868 MB Stage outliers finished: 2020-08-10T10:57:19.677789 Resources for stage outliers : 1.207 s worker CPU, 1.208 s worker Wall, Wall: 1.039 s, Cores in use: 1.90, Total efficiency (on 8 cores): 23.7 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/PGC1062054-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/PGC1062054-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-10T10:57:19.867409 Stage halos : Wall: 1.50 s, CPU: 0.37 s, VmPeak: 1036 MB, VmSize: 1028 MB, VmRSS: 213 MB, VmData: 242 MB, maxrss: 0.21792 MB Stage halos finished: 2020-08-10T10:57:21.370893 Resources for stage halos : 0.206 s worker CPU, 2.596 s worker Wall, Wall: 1.505 s, Cores in use: 0.38, Total efficiency (on 8 cores): 4.8 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/PGC1062054-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/PGC1062054-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-10T10:57:21.672216 PSF sigmas in coadd pixels: ['1.85', '2.06', '1.74', '1.67', '2.26'] Using average PSF sigma 1.9151461457426897 Gaussian PSF norm 0.14729674411582955 vs pixelized 0.124937266 average tim pixel scale / coadd scale: 1.0011396735181448 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.95', '1.79', '1.66', '2.49'] Using average PSF sigma 1.9729385965598634 Gaussian PSF norm 0.14298204326569308 vs pixelized 0.12161879 average tim pixel scale / coadd scale: 1.0011728952073613 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.84', '1.96', '3.07', '1.85', '2.14'] Using average PSF sigma 2.169243331118441 Gaussian PSF norm 0.13004294526443597 vs pixelized 0.10658875 average tim pixel scale / coadd scale: 1.001109481071129 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.24 s, CPU: 0.23 s, VmPeak: 1036 MB, VmSize: 1028 MB, VmRSS: 215 MB, VmData: 242 MB, maxrss: 0.219996 MB Stage fit_on_coadds finished: 2020-08-10T10:57:21.915622 Resources for stage fit_on_coadds : 0.277 s worker CPU, 0.279 s worker Wall, Wall: 0.244 s, Cores in use: 2.08, Total efficiency (on 8 cores): 26.0 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/PGC1062054-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/PGC1062054-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-10T10:57:21.928817 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 18 potential peaks Of 18 potential peaks: 1 in veto map, 3 cut by saddle test, 0 cut by aper test, 14 kept SED z : 14 new peaks Found 15 potential peaks Of 15 potential peaks: 11 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 18 potential peaks Of 18 potential peaks: 11 in veto map, 1 cut by saddle test, 0 cut by aper test, 6 kept SED g : 6 new peaks Found 24 potential peaks Of 24 potential peaks: 21 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 29 potential peaks Of 29 potential peaks: 25 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 26 new sources Median coadd sky for g : -0.00012439744 Median coadd sky for r : -9.169345e-05 Median coadd sky for z : 0.00016439172 Stage srcs : Wall: 0.62 s, CPU: 0.57 s, VmPeak: 1036 MB, VmSize: 1028 MB, VmRSS: 215 MB, VmData: 242 MB, maxrss: 0.220392 MB Stage srcs finished: 2020-08-10T10:57:22.546580 Resources for stage srcs : 0.088 s worker CPU, 0.088 s worker Wall, Wall: 0.619 s, Cores in use: 1.07, Total efficiency (on 8 cores): 13.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/PGC1062054-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/PGC1062054-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-10T10:57:22.559183 Blob 1 of 25, id: 11, sources: 3, size: 119x68, npix 4934, brick X: 83,202, Y: 99,167, one pixel: 140 99 Blob 2 of 25, id: 3, sources: 2, size: 41x51, npix 1136, brick X: 10,51, Y: 27,78, one pixel: 21 27 Blob 3 of 25, id: 9, sources: 1, size: 31x30, npix 601, brick X: 205,236, Y: 82,112, one pixel: 220 82 Blob 4 of 25, id: 16, sources: 1, size: 29x29, npix 581, brick X: 161,190, Y: 166,195, one pixel: 174 166 Blob 5 of 25, id: 13, sources: 1, size: 27x32, npix 575, brick X: 47,74, Y: 124,156, one pixel: 58 124 Blob 6 of 25, id: 8, sources: 1, size: 28x27, npix 473, brick X: 103,131, Y: 56,83, one pixel: 115 56 Blob 7 of 25, id: 19, sources: 1, size: 32x24, npix 449, brick X: 37,69, Y: 219,243, one pixel: 47 219 Blob 8 of 25, id: 5, sources: 1, size: 25x24, npix 387, brick X: 45,70, Y: 33,57, one pixel: 55 33 Blob 9 of 25, id: 0, sources: 1, size: 28x18, npix 360, brick X: 185,213, Y: 0,18, one pixel: 187 0 Blob 8 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 959 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14492 MB Blob 10 of 25, id: 1, sources: 1, size: 26x24, npix 352, brick X: 103,129, Y: 14,38, one pixel: 115 14 Measuring 1 iterative sources Blob 7 finished, total: Wall: 0.83 s, CPU: 0.82 s, VmPeak: 960 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146436 MB Blob 11 of 25, id: 23, sources: 1, size: 23x23, npix 327, brick X: 61,84, Y: 254,277, one pixel: 72 254 Blob 6 finished, total: Wall: 0.97 s, CPU: 0.97 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144724 MB Blob 12 of 25, id: 20, sources: 1, size: 23x23, npix 325, brick X: 152,175, Y: 232,255, one pixel: 163 232 Blob 4 finished, total: Wall: 1.08 s, CPU: 1.08 s, VmPeak: 965 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145184 MB Blob 13 of 25, id: 4, sources: 1, size: 23x22, npix 294, brick X: 187,210, Y: 29,51, one pixel: 197 29 Blob 3 finished, total: Wall: 1.42 s, CPU: 1.42 s, VmPeak: 963 MB, VmSize: 724 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144344 MB Blob 14 of 25, id: 14, sources: 1, size: 22x22, npix 283, brick X: 203,225, Y: 139,161, one pixel: 212 139 Blob 9 finished, total: Wall: 1.11 s, CPU: 1.11 s, VmPeak: 959 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14492 MB Blob 15 of 25, id: 17, sources: 1, size: 21x22, npix 282, brick X: 189,210, Y: 202,224, one pixel: 198 202 Blob 5 finished, total: Wall: 1.55 s, CPU: 1.55 s, VmPeak: 955 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.144984 MB Blob 16 of 25, id: 18, sources: 1, size: 21x22, npix 280, brick X: 67,88, Y: 210,232, one pixel: 76 210 Blob 11 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144724 MB Blob 17 of 25, id: 21, sources: 1, size: 21x23, npix 280, brick X: 107,128, Y: 243,266, one pixel: 118 243 Blob 10 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 960 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146436 MB Blob 18 of 25, id: 22, sources: 1, size: 21x21, npix 268, brick X: 205,226, Y: 246,267, one pixel: 213 246 Blob 15 finished, total: Wall: 0.31 s, CPU: 0.30 s, VmPeak: 955 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.144984 MB Blob 19 of 25, id: 7, sources: 1, size: 20x21, npix 258, brick X: 63,83, Y: 48,69, one pixel: 72 48 Blob 16 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144724 MB Blob 20 of 25, id: 12, sources: 1, size: 20x21, npix 249, brick X: 178,198, Y: 99,120, one pixel: 187 99 Blob 14 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 959 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14492 MB Blob 21 of 25, id: 24, sources: 1, size: 21x20, npix 249, brick X: 195,216, Y: 266,286, one pixel: 204 266 Blob 12 finished, total: Wall: 1.04 s, CPU: 1.04 s, VmPeak: 965 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.1468 MB Blob 22 of 25, id: 15, sources: 1, size: 18x20, npix 222, brick X: 269,287, Y: 165,185, one pixel: 278 165 Blob 18 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 955 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.144984 MB Blob 23 of 25, id: 10, sources: 1, size: 18x19, npix 198, brick X: 162,180, Y: 89,108, one pixel: 170 89 Blob 2 finished, total: Wall: 2.23 s, CPU: 2.23 s, VmPeak: 968 MB, VmSize: 723 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142392 MB Blob 13 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 963 MB, VmSize: 724 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144344 MB Blob 24 of 25, id: 2, sources: 1, size: 12x21, npix 167, brick X: 275,287, Y: 16,37, one pixel: 284 16 Blob 25 of 25, id: 6, sources: 1, size: 18x17, npix 162, brick X: 149,167, Y: 39,56, one pixel: 157 39 Blob 23 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 963 MB, VmSize: 724 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144344 MB Blob 19 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144724 MB Blob 25 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 963 MB, VmSize: 724 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144344 MB Blob 21 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 965 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.1468 MB Blob 22 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 955 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.144984 MB Blob 20 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 959 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14492 MB Blob 17 finished, total: Wall: 0.91 s, CPU: 0.91 s, VmPeak: 960 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146436 MB Blob 24 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 968 MB, VmSize: 723 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142392 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.7815, ee1=-1.06, ee2=-0.0472905 Blob 1 finished, total: Wall: 4.92 s, CPU: 4.91 s, VmPeak: 960 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148172 MB Old catalog: 29 New catalog: 26 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/metrics/cus/blobs-custom-353465m04158.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/metrics/cus/all-models-custom-353465m04158.fits Stage fitblobs : Wall: 5.34 s, CPU: 0.43 s, VmPeak: 1036 MB, VmSize: 1028 MB, VmRSS: 216 MB, VmData: 242 MB, maxrss: 0.220812 MB Stage fitblobs finished: 2020-08-10T10:57:27.898715 Resources for stage fitblobs : 22.649 s worker CPU, 22.736 s worker Wall, Wall: 5.341 s, Cores in use: 4.32, Total efficiency (on 8 cores): 54.0 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/PGC1062054-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/PGC1062054-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-10T10:57:27.910298 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/tmp-legacysurvey-custom-353465m04158-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/tmp-legacysurvey-custom-353465m04158-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/tmp-legacysurvey-custom-353465m04158-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/tmp-legacysurvey-custom-353465m04158-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-resid.jpg Stage coadds : Wall: 1.58 s, CPU: 0.66 s, VmPeak: 1036 MB, VmSize: 1028 MB, VmRSS: 216 MB, VmData: 242 MB, maxrss: 0.22126 MB Stage coadds finished: 2020-08-10T10:57:29.487681 Resources for stage coadds : 3.825 s worker CPU, 4.534 s worker Wall, Wall: 1.578 s, Cores in use: 2.84, Total efficiency (on 8 cores): 35.6 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/PGC1062054-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/PGC1062054-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-10T10:57:29.562068 Cut to 1 unWISE tiles Reading WISE tile 3539m046 band 1 Reading WISE tile 3539m046 band 2 Reading WISE tile 3539m046 band 3 Reading WISE tile 3539m046 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 963 MB, VmSize: 809 MB, VmRSS: 152 MB, VmData: 180 MB, maxrss: 0.210336 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 960 MB, VmSize: 802 MB, VmRSS: 145 MB, VmData: 173 MB, maxrss: 0.20862 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 955 MB, VmSize: 800 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.205948 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3539m046/unwise-3539m046-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 968 MB, VmSize: 804 MB, VmRSS: 147 MB, VmData: 175 MB, maxrss: 0.189252 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/tmp-legacysurvey-custom-353465m04158-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/tmp-legacysurvey-custom-353465m04158-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.92 s, CPU: 0.66 s, VmPeak: 1036 MB, VmSize: 1028 MB, VmRSS: 217 MB, VmData: 242 MB, maxrss: 0.221968 MB Stage wise_forced finished: 2020-08-10T10:57:33.479590 Resources for stage wise_forced : 3.022 s worker CPU, 6.714 s worker Wall, Wall: 3.919 s, Cores in use: 0.94, Total efficiency (on 8 cores): 11.7 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/PGC1062054-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/PGC1062054-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-10T10:57:33.493415 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/coadd/cus/custom-353465m04158/legacysurvey-custom-353465m04158-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/tractor-i/cus/tractor-custom-353465m04158.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/tractor/cus/tractor-custom-353465m04158.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/tractor/cus/brick-custom-353465m04158.sha256sum Stage writecat : Wall: 0.71 s, CPU: 0.53 s, VmPeak: 1160 MB, VmSize: 1032 MB, VmRSS: 219 MB, VmData: 242 MB, maxrss: 0.354828 MB Stage writecat finished: 2020-08-10T10:57:34.201997 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.710 s, Cores in use: 0.75, Total efficiency (on 8 cores): 9.4 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/PGC1062054-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1062054/PGC1062054-largegalaxy-writecat.p All done: 37.834 s worker CPU, 566.198 s worker Wall, Wall: 116.994 s, Cores in use: 0.38, Total efficiency (on 8 cores): 4.8 % Finished galaxy PGC1062054 in 1.991 minutes.