Started working on galaxy PGC1217238 at Wed Aug 5 21:42:28 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 243.3325605 2.1412207999999997 --width 301 --height 301 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/PGC1217238-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/PGC1217238-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T21:42:29.642860 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '243.3325605', '2.1412207999999997', '--width', '301', '--height', '301', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/PGC1217238-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/PGC1217238-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 243.3325605 2.1412207999999997 --width 301 --height 301 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/PGC1217238-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/PGC1217238-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 243.3325605 2.1412207999999997 Starting process 3440 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 3441 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 3442 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 3443 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 3444 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 3445 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 3446 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 3447 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 3448 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 3449 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 3450 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 3451 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 3452 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 3453 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 3454 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 3455 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T21:42:30.826516 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 15 CCDs: c4d_160803_230529_ooi_z_ls9-N24 z expnum 559018 exptime 80.0 propid 2014B-0404 seeing 1.16 MJD 57603.961 object DECaLS_46833_z decam/CP/V4.8.2a/CP20160803/c4d_160803_230529_ooi_z_ls9.fits.fz c4d_150327_084324_ooi_r_ls9-N24 r expnum 425128 exptime 125.0 propid 2014B-0404 seeing 1.82 MJD 57108.361 object DECaLS_46833_r decam/CP/V4.8.2a/CP20150326/c4d_150327_084324_ooi_r_ls9.fits.fz c4d_160803_230929_ooi_z_ls9-N24 z expnum 559020 exptime 103.0 propid 2014B-0404 seeing 1.14 MJD 57603.963 object DECaLS_46833_z decam/CP/V4.8.2a/CP20160803/c4d_160803_230929_ooi_z_ls9.fits.fz c4d_150327_084047_ooi_g_ls9-N24 g expnum 425127 exptime 125.0 propid 2014B-0404 seeing 1.89 MJD 57108.360 object DECaLS_46833_g decam/CP/V4.8.2a/CP20150326/c4d_150327_084047_ooi_g_ls9.fits.fz c4d_170725_012301_ooi_g_ls9-S9 g expnum 661850 exptime 170.0 propid 2014B-0404 seeing 1.52 MJD 57959.055 object DECaLS_30960_g decam/CP/V4.8.2a/CP20170724/c4d_170725_012301_ooi_g_ls9.fits.fz c4d_160227_075631_ooi_z_ls9-S9 z expnum 520610 exptime 144.0 propid 2014B-0404 seeing 0.95 MJD 57445.329 object DECaLS_30960_z decam/CP/V4.8.2a/CP20160226/c4d_160227_075631_ooi_z_ls9.fits.fz c4d_160410_071906_ooi_r_ls9-S9 r expnum 536075 exptime 104.0 propid 2014B-0404 seeing 1.26 MJD 57488.303 object DECaLS_30960_r decam/CP/V4.8.2a/CP20160409/c4d_160410_071906_ooi_r_ls9.fits.fz c4d_180516_081702_ooi_r_ls9-S10 r expnum 746790 exptime 95.0 propid 2014B-0404 seeing 1.02 MJD 58254.345 object DECaLS_15088_r decam/CP/V4.8.2a/CP20180515/c4d_180516_081702_ooi_r_ls9.fits.fz c4d_160410_072316_ooi_g_ls9-S10 g expnum 536077 exptime 102.0 propid 2014B-0404 seeing 1.36 MJD 57488.306 object DECaLS_15088_g decam/CP/V4.8.2a/CP20160409/c4d_160410_072316_ooi_g_ls9.fits.fz c4d_160410_100348_ooi_z_ls9-S10 z expnum 536144 exptime 122.0 propid 2014B-0404 seeing 0.96 MJD 57488.417 object DECaLS_15088_z decam/CP/V4.8.2a/CP20160409/c4d_160410_100348_ooi_z_ls9.fits.fz c4d_180808_023756_ooi_r_ls9-S14 r expnum 762840 exptime 174.0 propid 2014B-0404 seeing 1.29 MJD 58338.110 object DECaLS_46832_r decam/CP/V4.8.2a/CP20180807/c4d_180808_023756_ooi_r_ls9.fits.fz c4d_170521_084928_ooi_z_ls9-S14 z expnum 649888 exptime 192.0 propid 2014B-0404 seeing 1.20 MJD 57894.365 object DECaLS_46832_z decam/CP/V4.8.2/CP20170520/c4d_170521_084928_ooi_z_ls9.fits.fz c4d_180812_010716_ooi_g_ls9-S14 g expnum 764496 exptime 70.0 propid 2014B-0404 seeing 1.05 MJD 58342.047 object DECaLS_46832_g decam/CP/V4.8.2a/CP20180811/c4d_180812_010716_ooi_g_ls9.fits.fz c4d_170725_012301_ooi_g_ls9-S15 g expnum 661850 exptime 170.0 propid 2014B-0404 seeing 1.54 MJD 57959.055 object DECaLS_30960_g decam/CP/V4.8.2a/CP20170724/c4d_170725_012301_ooi_g_ls9.fits.fz c4d_160227_075631_ooi_z_ls9-S15 z expnum 520610 exptime 144.0 propid 2014B-0404 seeing 0.94 MJD 57445.329 object DECaLS_30960_z decam/CP/V4.8.2a/CP20160226/c4d_160227_075631_ooi_z_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95536a2-r-20150327T084021_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95503fa-z-20160227T075317_oi[S9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95503fa-z-20160227T075317_oi[S15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532e22-g-20180812T010716_oi[S14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95675e1-g-20160410T072041_oi[S10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956cfb1-r-20160410T071633_oi[S9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d4d0-z-20160410T100056_oi[S10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9517988-z-20170521T084523_oi[S14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ff0f-g-20170725T011917_oi[S15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ff0f-g-20170725T011917_oi[S9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b0ee-z-20160803T230319_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9556f51-g-20150327T083747_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b0ee-z-20160803T230656_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560631-r-20180516T081702_oi[S10,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180808T023756_oi[S14,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 61.29 s, CPU: 2.05 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 183 MB, VmData: 215 MB, maxrss: 0.187172 MB Stage tims finished: 2020-08-05T21:43:32.120182 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95503fa-z-20160227T075317_oi[S15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95503fa-z-20160227T075317_oi[S9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956cfb1-r-20160410T071633_oi[S9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532e22-g-20180812T010716_oi[S14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d4d0-z-20160410T100056_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ff0f-g-20170725T011917_oi[S15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b0ee-z-20160803T230656_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ff0f-g-20170725T011917_oi[S9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560631-r-20180516T081702_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 9.634 s worker CPU, 456.121 s worker Wall, Wall: 61.295 s, Cores in use: 0.19, Total efficiency (on 16 cores): 1.2 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/PGC1217238-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/PGC1217238-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95675e1-g-20160410T072041_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9517988-z-20170521T084523_oi[S14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95536a2-r-20150327T084021_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9556f51-g-20150327T083747_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180808T023756_oi[S14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T21:43:32.544082 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05910.fits Matched 3 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/metrics/cus/reference-custom-243332p02141.fits Stage refs : Wall: 12.93 s, CPU: 4.48 s, VmPeak: 1067 MB, VmSize: 1062 MB, VmRSS: 235 MB, VmData: 265 MB, maxrss: 0.240936 MB Stage refs finished: 2020-08-05T21:43:45.475124 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b0ee-z-20160803T230319_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 12.933 s, Cores in use: 0.35, Total efficiency (on 16 cores): 2.2 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/PGC1217238-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/PGC1217238-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T21:43:45.509771 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/metrics/cus/outlier-mask-custom-243332p02141.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/metrics/cus/outliers-pre-custom-243332p02141.jpg Image c4d_180812_010716_ooi_g_ls9-S14 g : masking 1220 positive outlier pixels and 0 negative outlier pixels Image c4d_150327_084324_ooi_r_ls9-N24 r : masking 302 positive outlier pixels and 0 negative outlier pixels Image c4d_180808_023756_ooi_r_ls9-S14 r : masking 1365 positive outlier pixels and 0 negative outlier pixels Image c4d_180516_081702_ooi_r_ls9-S10 r : masking 122 positive outlier pixels and 0 negative outlier pixels Image c4d_160227_075631_ooi_z_ls9-S9 z : masking 109 positive outlier pixels and 0 negative outlier pixels Image c4d_160803_230929_ooi_z_ls9-N24 z : masking 114 positive outlier pixels and 0 negative outlier pixels Image c4d_160803_230529_ooi_z_ls9-N24 z : masking 1516 positive outlier pixels and 0 negative outlier pixels Image c4d_170521_084928_ooi_z_ls9-S14 z : masking 206 positive outlier pixels and 0 negative outlier pixels Image c4d_160410_100348_ooi_z_ls9-S10 z : masking 341 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/metrics/cus/outlier-mask-custom-243332p02141.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/metrics/cus/outliers-post-custom-243332p02141.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/metrics/cus/outliers-masked-pos-custom-243332p02141.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/metrics/cus/outliers-masked-neg-custom-243332p02141.jpg Stage outliers : Wall: 1.12 s, CPU: 0.85 s, VmPeak: 1071 MB, VmSize: 1071 MB, VmRSS: 254 MB, VmData: 281 MB, maxrss: 0.260468 MB Stage outliers finished: 2020-08-05T21:43:46.634312 Resources for stage outliers : 1.295 s worker CPU, 1.348 s worker Wall, Wall: 1.126 s, Cores in use: 1.90, Total efficiency (on 16 cores): 11.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/PGC1217238-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/PGC1217238-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T21:43:46.816575 Stage halos : Wall: 1.87 s, CPU: 0.33 s, VmPeak: 1071 MB, VmSize: 1071 MB, VmRSS: 255 MB, VmData: 281 MB, maxrss: 0.260636 MB Stage halos finished: 2020-08-05T21:43:48.687060 Resources for stage halos : 0.185 s worker CPU, 2.464 s worker Wall, Wall: 1.872 s, Cores in use: 0.28, Total efficiency (on 16 cores): 1.7 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/PGC1217238-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/PGC1217238-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T21:43:49.059095 PSF sigmas in coadd pixels: ['3.07', '2.46', '2.21', '1.70'] Using average PSF sigma 2.3617559322435935 Gaussian PSF norm 0.11944282130198655 vs pixelized 0.100915655 average tim pixel scale / coadd scale: 1.0010986637771981 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.95', '2.04', '1.66', '2.10'] Using average PSF sigma 2.18928910572352 Gaussian PSF norm 0.12885223383078545 vs pixelized 0.08914997 average tim pixel scale / coadd scale: 1.0011862668622895 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.88', '1.86', '1.54', '1.55', '1.95'] Using average PSF sigma 1.7577788272903745 Gaussian PSF norm 0.1604836668835799 vs pixelized 0.12992439 average tim pixel scale / coadd scale: 1.0011445522976627 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.23 s, CPU: 0.23 s, VmPeak: 1071 MB, VmSize: 1071 MB, VmRSS: 256 MB, VmData: 281 MB, maxrss: 0.26226 MB Stage fit_on_coadds finished: 2020-08-05T21:43:49.292454 Resources for stage fit_on_coadds : 0.325 s worker CPU, 0.325 s worker Wall, Wall: 0.235 s, Cores in use: 2.39, Total efficiency (on 16 cores): 14.9 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/PGC1217238-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/PGC1217238-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T21:43:49.304673 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 31 potential peaks Of 31 potential peaks: 4 in veto map, 4 cut by saddle test, 0 cut by aper test, 23 kept SED z : 23 new peaks Found 30 potential peaks Of 30 potential peaks: 24 in veto map, 2 cut by saddle test, 0 cut by aper test, 4 kept SED r : 4 new peaks Found 23 potential peaks Of 23 potential peaks: 19 in veto map, 1 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 41 potential peaks Of 41 potential peaks: 32 in veto map, 5 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 42 potential peaks Of 42 potential peaks: 36 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 36 new sources Median coadd sky for g : -0.00010723666 Median coadd sky for r : -5.390375e-05 Median coadd sky for z : 0.00016215906 Stage srcs : Wall: 0.58 s, CPU: 0.53 s, VmPeak: 1071 MB, VmSize: 1071 MB, VmRSS: 257 MB, VmData: 281 MB, maxrss: 0.262736 MB Stage srcs finished: 2020-08-05T21:43:49.882751 Resources for stage srcs : 0.116 s worker CPU, 0.116 s worker Wall, Wall: 0.579 s, Cores in use: 1.12, Total efficiency (on 16 cores): 7.0 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/PGC1217238-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/PGC1217238-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T21:43:49.894711 Blob 1 of 24, id: 7, sources: 7, size: 138x130, npix 11983, brick X: 73,211, Y: 81,211, one pixel: 86 81 Blob 2 of 24, id: 17, sources: 5, size: 125x72, npix 3528, brick X: 67,192, Y: 218,290, one pixel: 177 218 Blob 3 of 24, id: 15, sources: 3, size: 57x37, npix 1342, brick X: 18,75, Y: 197,234, one pixel: 30 197 Blob 4 of 24, id: 14, sources: 1, size: 39x39, npix 1070, brick X: 196,235, Y: 193,232, one pixel: 210 193 Blob 5 of 24, id: 2, sources: 1, size: 33x37, npix 896, brick X: 0,33, Y: 16,53, one pixel: 9 16 Blob 6 of 24, id: 11, sources: 2, size: 30x43, npix 798, brick X: 271,301, Y: 137,180, one pixel: 294 137 Blob 7 of 24, id: 12, sources: 2, size: 27x39, npix 704, brick X: 242,269, Y: 167,206, one pixel: 252 167 Blob 8 of 24, id: 10, sources: 1, size: 30x31, npix 511, brick X: 27,57, Y: 120,151, one pixel: 36 120 Blob 9 of 24, id: 20, sources: 1, size: 26x29, npix 509, brick X: 210,236, Y: 256,285, one pixel: 220 256 Blob 10 of 24, id: 8, sources: 1, size: 24x28, npix 495, brick X: 277,301, Y: 88,116, one pixel: 287 88 Blob 11 of 24, id: 16, sources: 1, size: 28x28, npix 479, brick X: 76,104, Y: 206,234, one pixel: 89 206 Blob 12 of 24, id: 21, sources: 2, size: 31x31, npix 459, brick X: 159,190, Y: 263,294, one pixel: 169 263 Blob 13 of 24, id: 5, sources: 1, size: 19x32, npix 450, brick X: 282,301, Y: 47,79, one pixel: 295 47 Blob 14 of 24, id: 19, sources: 1, size: 25x26, npix 436, brick X: 251,276, Y: 242,268, one pixel: 260 242 Blob 15 of 24, id: 3, sources: 1, size: 24x26, npix 424, brick X: 81,105, Y: 19,45, one pixel: 91 19 Blob 16 of 24, id: 13, sources: 1, size: 27x25, npix 415, brick X: 7,34, Y: 169,194, one pixel: 18 169 Blob 17 of 24, id: 6, sources: 1, size: 25x25, npix 409, brick X: 86,111, Y: 56,81, one pixel: 97 56 Blob 12 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 952 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150172 MB Blob 18 of 24, id: 23, sources: 2, size: 38x20, npix 398, brick X: 249,287, Y: 269,289, one pixel: 258 269 Measuring 1 iterative sources Blob 16 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 954 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149512 MB Blob 19 of 24, id: 9, sources: 1, size: 21x22, npix 260, brick X: 228,249, Y: 106,128, one pixel: 238 106 Blob 13 finished, total: Wall: 0.84 s, CPU: 0.79 s, VmPeak: 953 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149732 MB Blob 4 finished, total: Wall: 0.88 s, CPU: 0.86 s, VmPeak: 958 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148796 MB Blob 17 finished, total: Wall: 0.44 s, CPU: 0.44 s, VmPeak: 952 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150356 MB Blob 20 of 24, id: 0, sources: 1, size: 23x16, npix 254, brick X: 71,94, Y: 0,16, one pixel: 72 0 Blob 21 of 24, id: 1, sources: 1, size: 20x20, npix 238, brick X: 212,232, Y: 8,28, one pixel: 220 8 Blob 22 of 24, id: 4, sources: 1, size: 19x20, npix 209, brick X: 150,169, Y: 39,59, one pixel: 159 39 Blob 14 finished, total: Wall: 0.88 s, CPU: 0.80 s, VmPeak: 940 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146176 MB Blob 23 of 24, id: 22, sources: 1, size: 18x18, npix 171, brick X: 184,202, Y: 265,283, one pixel: 192 265 Blob 15 finished, total: Wall: 0.95 s, CPU: 0.95 s, VmPeak: 958 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150332 MB Blob 24 of 24, id: 18, sources: 1, size: 17x17, npix 145, brick X: 123,140, Y: 219,236, one pixel: 131 219 Blob 10 finished, total: Wall: 0.98 s, CPU: 0.98 s, VmPeak: 942 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.143996 MB Blob 5 finished, total: Wall: 1.04 s, CPU: 1.04 s, VmPeak: 957 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150068 MB Blob 24 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 942 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145072 MB Blob 8 finished, total: Wall: 1.19 s, CPU: 1.19 s, VmPeak: 958 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 186 MB, maxrss: 0.155876 MB Blob 7 finished, total: Wall: 1.22 s, CPU: 1.22 s, VmPeak: 962 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150064 MB Blob 9 finished, total: Wall: 1.25 s, CPU: 1.25 s, VmPeak: 943 MB, VmSize: 739 MB, VmRSS: 154 MB, VmData: 188 MB, maxrss: 0.157496 MB Blob 11 finished, total: Wall: 1.27 s, CPU: 1.27 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 113 MB, VmData: 167 MB, maxrss: 0.11598 MB Blob 19 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 952 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150356 MB Blob 23 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 958 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150684 MB Blob 21 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 958 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149456 MB Blob 22 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 940 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146176 MB Blob 6 finished, total: Wall: 1.65 s, CPU: 1.65 s, VmPeak: 940 MB, VmSize: 734 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150816 MB Blob 18 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 954 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149944 MB Blob 20 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 953 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150032 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 3.14 s, CPU: 3.14 s, VmPeak: 958 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.151336 MB Measuring 2 iterative sources Blob 2 finished, total: Wall: 4.45 s, CPU: 4.44 s, VmPeak: 938 MB, VmSize: 733 MB, VmRSS: 148 MB, VmData: 182 MB, maxrss: 0.15178 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.10371, ee1=-0.027804, ee2=0.563037 Measuring 2 iterative sources Blob 1 finished, total: Wall: 7.69 s, CPU: 7.68 s, VmPeak: 951 MB, VmSize: 738 MB, VmRSS: 155 MB, VmData: 187 MB, maxrss: 0.158892 MB Old catalog: 43 New catalog: 40 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/metrics/cus/blobs-custom-243332p02141.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/metrics/cus/all-models-custom-243332p02141.fits Stage fitblobs : Wall: 8.02 s, CPU: 0.39 s, VmPeak: 1071 MB, VmSize: 1071 MB, VmRSS: 257 MB, VmData: 281 MB, maxrss: 0.263092 MB Stage fitblobs finished: 2020-08-05T21:43:57.917606 Resources for stage fitblobs : 33.115 s worker CPU, 33.349 s worker Wall, Wall: 8.024 s, Cores in use: 4.18, Total efficiency (on 16 cores): 26.1 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/PGC1217238-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/PGC1217238-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T21:43:57.934171 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/tmp-legacysurvey-custom-243332p02141-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/tmp-legacysurvey-custom-243332p02141-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/tmp-legacysurvey-custom-243332p02141-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/tmp-legacysurvey-custom-243332p02141-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-resid.jpg Stage coadds : Wall: 2.37 s, CPU: 0.69 s, VmPeak: 1071 MB, VmSize: 1071 MB, VmRSS: 257 MB, VmData: 281 MB, maxrss: 0.26342 MB Stage coadds finished: 2020-08-05T21:44:00.309108 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 7.833 s worker CPU, 10.415 s worker Wall, Wall: 2.376 s, Cores in use: 3.59, Total efficiency (on 16 cores): 22.4 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/PGC1217238-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/PGC1217238-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T21:44:00.322582 Cut to 1 unWISE tiles Reading WISE tile 2435p015 band 1 Reading WISE tile 2435p015 band 2 Reading WISE tile 2435p015 band 3 Reading WISE tile 2435p015 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 938 MB, VmSize: 811 MB, VmRSS: 151 MB, VmData: 176 MB, maxrss: 0.1942 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 943 MB, VmSize: 811 MB, VmRSS: 149 MB, VmData: 176 MB, maxrss: 0.2132 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 958 MB, VmSize: 807 MB, VmRSS: 145 MB, VmData: 171 MB, maxrss: 0.209012 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 957 MB, VmSize: 809 MB, VmRSS: 151 MB, VmData: 174 MB, maxrss: 0.215624 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/tmp-legacysurvey-custom-243332p02141-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/tmp-legacysurvey-custom-243332p02141-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.00 s, CPU: 0.76 s, VmPeak: 1071 MB, VmSize: 1071 MB, VmRSS: 258 MB, VmData: 281 MB, maxrss: 0.263932 MB Stage wise_forced finished: 2020-08-05T21:44:03.321237 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 2.997 s worker CPU, 6.003 s worker Wall, Wall: 3.000 s, Cores in use: 1.25, Total efficiency (on 16 cores): 7.8 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/PGC1217238-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/PGC1217238-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T21:44:03.336444 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/coadd/cus/custom-243332p02141/legacysurvey-custom-243332p02141-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/tractor-i/cus/tractor-custom-243332p02141.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/tractor/cus/tractor-custom-243332p02141.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/tractor/cus/brick-custom-243332p02141.sha256sum Stage writecat : Wall: 1.31 s, CPU: 0.63 s, VmPeak: 1203 MB, VmSize: 1075 MB, VmRSS: 259 MB, VmData: 281 MB, maxrss: 0.396616 MB Stage writecat finished: 2020-08-05T21:44:04.644018 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.309 s, Cores in use: 0.48, Total efficiency (on 16 cores): 3.0 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/PGC1217238-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1217238/PGC1217238-largegalaxy-writecat.p All done: 55.504 s worker CPU, 510.144 s worker Wall, Wall: 93.843 s, Cores in use: 0.71, Total efficiency (on 16 cores): 4.4 % Finished galaxy PGC1217238 in 1.613 minutes. Started working on galaxy PGC1217238 at Mon Aug 10 10:33:26 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 243.3330649365232 2.1413221551048607 --width 301 --height 301 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/PGC1217238-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/PGC1217238-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-10T10:33:27.384563 legacypipe git version: DR9.5.11-watershed-6-g6a2880fc Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '243.3330649365232', '2.1413221551048607', '--width', '301', '--height', '301', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/PGC1217238-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/PGC1217238-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 243.3330649365232 2.1413221551048607 --width 301 --height 301 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/PGC1217238-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/PGC1217238-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 243.3330649365232 2.1413221551048607 Starting process 13128 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 13129 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 13130 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 13131 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 13132 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB Starting process 13133 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 13134 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 13135 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-10T10:33:28.250083 Keeping 15 CCDs: c4d_160803_230529_ooi_z_ls9-N24 z expnum 559018 exptime 80.0 propid 2014B-0404 seeing 1.16 MJD 57603.961 object DECaLS_46833_z decam/CP/V4.8.2a/CP20160803/c4d_160803_230529_ooi_z_ls9.fits.fz c4d_150327_084324_ooi_r_ls9-N24 r expnum 425128 exptime 125.0 propid 2014B-0404 seeing 1.82 MJD 57108.361 object DECaLS_46833_r decam/CP/V4.8.2a/CP20150326/c4d_150327_084324_ooi_r_ls9.fits.fz c4d_160803_230929_ooi_z_ls9-N24 z expnum 559020 exptime 103.0 propid 2014B-0404 seeing 1.14 MJD 57603.963 object DECaLS_46833_z decam/CP/V4.8.2a/CP20160803/c4d_160803_230929_ooi_z_ls9.fits.fz c4d_150327_084047_ooi_g_ls9-N24 g expnum 425127 exptime 125.0 propid 2014B-0404 seeing 1.89 MJD 57108.360 object DECaLS_46833_g decam/CP/V4.8.2a/CP20150326/c4d_150327_084047_ooi_g_ls9.fits.fz c4d_170725_012301_ooi_g_ls9-S9 g expnum 661850 exptime 170.0 propid 2014B-0404 seeing 1.52 MJD 57959.055 object DECaLS_30960_g decam/CP/V4.8.2a/CP20170724/c4d_170725_012301_ooi_g_ls9.fits.fz c4d_160227_075631_ooi_z_ls9-S9 z expnum 520610 exptime 144.0 propid 2014B-0404 seeing 0.95 MJD 57445.329 object DECaLS_30960_z decam/CP/V4.8.2a/CP20160226/c4d_160227_075631_ooi_z_ls9.fits.fz c4d_160410_071906_ooi_r_ls9-S9 r expnum 536075 exptime 104.0 propid 2014B-0404 seeing 1.26 MJD 57488.303 object DECaLS_30960_r decam/CP/V4.8.2a/CP20160409/c4d_160410_071906_ooi_r_ls9.fits.fz c4d_180516_081702_ooi_r_ls9-S10 r expnum 746790 exptime 95.0 propid 2014B-0404 seeing 1.02 MJD 58254.345 object DECaLS_15088_r decam/CP/V4.8.2a/CP20180515/c4d_180516_081702_ooi_r_ls9.fits.fz c4d_160410_072316_ooi_g_ls9-S10 g expnum 536077 exptime 102.0 propid 2014B-0404 seeing 1.36 MJD 57488.306 object DECaLS_15088_g decam/CP/V4.8.2a/CP20160409/c4d_160410_072316_ooi_g_ls9.fits.fz c4d_160410_100348_ooi_z_ls9-S10 z expnum 536144 exptime 122.0 propid 2014B-0404 seeing 0.96 MJD 57488.417 object DECaLS_15088_z decam/CP/V4.8.2a/CP20160409/c4d_160410_100348_ooi_z_ls9.fits.fz c4d_180808_023756_ooi_r_ls9-S14 r expnum 762840 exptime 174.0 propid 2014B-0404 seeing 1.29 MJD 58338.110 object DECaLS_46832_r decam/CP/V4.8.2a/CP20180807/c4d_180808_023756_ooi_r_ls9.fits.fz c4d_170521_084928_ooi_z_ls9-S14 z expnum 649888 exptime 192.0 propid 2014B-0404 seeing 1.20 MJD 57894.365 object DECaLS_46832_z decam/CP/V4.8.2/CP20170520/c4d_170521_084928_ooi_z_ls9.fits.fz c4d_180812_010716_ooi_g_ls9-S14 g expnum 764496 exptime 70.0 propid 2014B-0404 seeing 1.05 MJD 58342.047 object DECaLS_46832_g decam/CP/V4.8.2a/CP20180811/c4d_180812_010716_ooi_g_ls9.fits.fz c4d_170725_012301_ooi_g_ls9-S15 g expnum 661850 exptime 170.0 propid 2014B-0404 seeing 1.54 MJD 57959.055 object DECaLS_30960_g decam/CP/V4.8.2a/CP20170724/c4d_170725_012301_ooi_g_ls9.fits.fz c4d_160227_075631_ooi_z_ls9-S15 z expnum 520610 exptime 144.0 propid 2014B-0404 seeing 0.94 MJD 57445.329 object DECaLS_30960_z decam/CP/V4.8.2a/CP20160226/c4d_160227_075631_ooi_z_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95503fa-z-20160227T075317_oi[S9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956cfb1-r-20160410T071633_oi[S9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ff0f-g-20170725T011917_oi[S9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95536a2-r-20150327T084021_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9556f51-g-20150327T083747_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b0ee-z-20160803T230319_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b0ee-z-20160803T230656_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560631-r-20180516T081702_oi[S10,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95675e1-g-20160410T072041_oi[S10,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d4d0-z-20160410T100056_oi[S10,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9517988-z-20170521T084523_oi[S14,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ff0f-g-20170725T011917_oi[S15,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532e22-g-20180812T010716_oi[S14,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95503fa-z-20160227T075317_oi[S15,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180808T023756_oi[S14,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 97.87 s, CPU: 0.99 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 181 MB, VmData: 215 MB, maxrss: 0.185348 MB Stage tims finished: 2020-08-10T10:35:06.122960 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560631-r-20180516T081702_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956cfb1-r-20160410T071633_oi[S9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95675e1-g-20160410T072041_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95503fa-z-20160227T075317_oi[S9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d4d0-z-20160410T100056_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ff0f-g-20170725T011917_oi[S9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9517988-z-20170521T084523_oi[S14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b0ee-z-20160803T230656_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532e22-g-20180812T010716_oi[S14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95536a2-r-20150327T084021_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95503fa-z-20160227T075317_oi[S15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9556f51-g-20150327T083747_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180808T023756_oi[S14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b0ee-z-20160803T230319_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ff0f-g-20170725T011917_oi[S15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 6.942 s worker CPU, 572.089 s worker Wall, Wall: 97.874 s, Cores in use: 0.08, Total efficiency (on 8 cores): 1.0 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/PGC1217238-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/PGC1217238-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-10T10:35:06.183834 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05910.fits Matched 3 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/metrics/cus/reference-custom-243333p02141.fits Stage refs : Wall: 9.34 s, CPU: 4.58 s, VmPeak: 1061 MB, VmSize: 1055 MB, VmRSS: 233 MB, VmData: 265 MB, maxrss: 0.239048 MB Stage refs finished: 2020-08-10T10:35:15.528571 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.346 s, Cores in use: 0.49, Total efficiency (on 8 cores): 6.1 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/PGC1217238-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/PGC1217238-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-10T10:35:15.579454 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/metrics/cus/outlier-mask-custom-243333p02141.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/metrics/cus/outliers-pre-custom-243333p02141.jpg Image c4d_160410_072316_ooi_g_ls9-S10 g : masking 0 positive outlier pixels and 40 negative outlier pixels Image c4d_180812_010716_ooi_g_ls9-S14 g : masking 1250 positive outlier pixels and 0 negative outlier pixels Image c4d_180808_023756_ooi_r_ls9-S14 r : masking 1358 positive outlier pixels and 0 negative outlier pixels Image c4d_150327_084324_ooi_r_ls9-N24 r : masking 304 positive outlier pixels and 0 negative outlier pixels Image c4d_160227_075631_ooi_z_ls9-S9 z : masking 163 positive outlier pixels and 71 negative outlier pixels Image c4d_160803_230929_ooi_z_ls9-N24 z : masking 115 positive outlier pixels and 0 negative outlier pixels Image c4d_160410_100348_ooi_z_ls9-S10 z : masking 490 positive outlier pixels and 0 negative outlier pixels Image c4d_160803_230529_ooi_z_ls9-N24 z : masking 1443 positive outlier pixels and 0 negative outlier pixels Image c4d_170521_084928_ooi_z_ls9-S14 z : masking 201 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/metrics/cus/outlier-mask-custom-243333p02141.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/metrics/cus/outliers-post-custom-243333p02141.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/metrics/cus/outliers-masked-pos-custom-243333p02141.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/metrics/cus/outliers-masked-neg-custom-243333p02141.jpg Stage outliers : Wall: 1.37 s, CPU: 1.03 s, VmPeak: 1065 MB, VmSize: 1065 MB, VmRSS: 253 MB, VmData: 281 MB, maxrss: 0.258732 MB Stage outliers finished: 2020-08-10T10:35:16.951539 Resources for stage outliers : 1.549 s worker CPU, 1.549 s worker Wall, Wall: 1.373 s, Cores in use: 1.88, Total efficiency (on 8 cores): 23.5 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/PGC1217238-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/PGC1217238-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-10T10:35:17.333699 Stage halos : Wall: 1.11 s, CPU: 0.31 s, VmPeak: 1065 MB, VmSize: 1065 MB, VmRSS: 253 MB, VmData: 281 MB, maxrss: 0.258904 MB Stage halos finished: 2020-08-10T10:35:18.446601 Resources for stage halos : 0.166 s worker CPU, 2.075 s worker Wall, Wall: 1.114 s, Cores in use: 0.43, Total efficiency (on 8 cores): 5.4 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/PGC1217238-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/PGC1217238-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-10T10:35:18.558608 PSF sigmas in coadd pixels: ['3.07', '2.46', '2.21', '1.70'] Using average PSF sigma 2.3617559322435935 Gaussian PSF norm 0.11944282130198655 vs pixelized 0.10092053 average tim pixel scale / coadd scale: 1.0010986637771981 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.95', '2.04', '1.66', '2.10'] Using average PSF sigma 2.18928910572352 Gaussian PSF norm 0.12885223383078545 vs pixelized 0.08914935 average tim pixel scale / coadd scale: 1.0011862668622895 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.88', '1.86', '1.54', '1.55', '1.95'] Using average PSF sigma 1.7577788272903745 Gaussian PSF norm 0.1604836668835799 vs pixelized 0.12991974 average tim pixel scale / coadd scale: 1.0011445522976627 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.27 s, CPU: 0.24 s, VmPeak: 1065 MB, VmSize: 1065 MB, VmRSS: 254 MB, VmData: 281 MB, maxrss: 0.260524 MB Stage fit_on_coadds finished: 2020-08-10T10:35:18.832620 Resources for stage fit_on_coadds : 0.362 s worker CPU, 0.362 s worker Wall, Wall: 0.275 s, Cores in use: 2.19, Total efficiency (on 8 cores): 27.4 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/PGC1217238-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/PGC1217238-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-10T10:35:18.843644 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 32 potential peaks Of 32 potential peaks: 3 in veto map, 5 cut by saddle test, 0 cut by aper test, 24 kept SED z : 24 new peaks Found 27 potential peaks Of 27 potential peaks: 22 in veto map, 2 cut by saddle test, 0 cut by aper test, 3 kept SED r : 3 new peaks Found 21 potential peaks Of 21 potential peaks: 17 in veto map, 1 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 39 potential peaks Of 39 potential peaks: 30 in veto map, 5 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 41 potential peaks Of 41 potential peaks: 36 in veto map, 4 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 35 new sources Median coadd sky for g : -0.00010114108 Median coadd sky for r : -6.4121356e-05 Median coadd sky for z : 0.00020119909 Stage srcs : Wall: 0.50 s, CPU: 0.45 s, VmPeak: 1065 MB, VmSize: 1065 MB, VmRSS: 255 MB, VmData: 281 MB, maxrss: 0.261044 MB Stage srcs finished: 2020-08-10T10:35:19.347765 Resources for stage srcs : 0.118 s worker CPU, 0.118 s worker Wall, Wall: 0.505 s, Cores in use: 1.13, Total efficiency (on 8 cores): 14.1 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/PGC1217238-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/PGC1217238-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-10T10:35:19.360313 Blob 1 of 24, id: 6, sources: 6, size: 138x129, npix 11960, brick X: 80,218, Y: 80,209, one pixel: 92 80 Blob 2 of 24, id: 17, sources: 5, size: 125x72, npix 3523, brick X: 74,199, Y: 217,289, one pixel: 182 217 Blob 3 of 24, id: 15, sources: 3, size: 56x37, npix 1330, brick X: 25,81, Y: 196,233, one pixel: 36 196 Blob 4 of 24, id: 14, sources: 1, size: 39x38, npix 1054, brick X: 203,242, Y: 192,230, one pixel: 217 192 Blob 5 of 24, id: 2, sources: 1, size: 38x37, npix 949, brick X: 2,40, Y: 14,51, one pixel: 18 14 Blob 6 of 24, id: 12, sources: 2, size: 27x40, npix 694, brick X: 249,276, Y: 165,205, one pixel: 260 165 Blob 7 of 24, id: 10, sources: 1, size: 30x32, npix 519, brick X: 34,64, Y: 118,150, one pixel: 44 118 Blob 8 of 24, id: 11, sources: 1, size: 23x31, npix 510, brick X: 278,301, Y: 148,179, one pixel: 290 148 Blob 9 of 24, id: 19, sources: 1, size: 27x29, npix 508, brick X: 216,243, Y: 255,284, one pixel: 227 255 Measuring 1 iterative sources Blob 4 finished, total: Wall: 0.86 s, CPU: 0.86 s, VmPeak: 970 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145016 MB Blob 10 of 24, id: 16, sources: 1, size: 28x28, npix 484, brick X: 83,111, Y: 205,233, one pixel: 96 205 Blob 5 finished, total: Wall: 1.10 s, CPU: 1.10 s, VmPeak: 976 MB, VmSize: 728 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147228 MB Blob 7 finished, total: Wall: 1.10 s, CPU: 1.10 s, VmPeak: 966 MB, VmSize: 728 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147612 MB Blob 11 of 24, id: 20, sources: 2, size: 31x31, npix 450, brick X: 166,197, Y: 262,293, one pixel: 175 262 Blob 12 of 24, id: 18, sources: 1, size: 25x27, npix 429, brick X: 258,283, Y: 240,267, one pixel: 268 240 Blob 11 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 966 MB, VmSize: 728 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147612 MB Blob 8 finished, total: Wall: 1.50 s, CPU: 1.49 s, VmPeak: 963 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147388 MB Blob 13 of 24, id: 3, sources: 1, size: 25x27, npix 428, brick X: 87,112, Y: 17,44, one pixel: 99 17 Blob 14 of 24, id: 22, sources: 2, size: 38x20, npix 415, brick X: 256,294, Y: 268,288, one pixel: 264 268 Blob 6 finished, total: Wall: 1.51 s, CPU: 1.51 s, VmPeak: 970 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144884 MB Blob 15 of 24, id: 13, sources: 1, size: 27x24, npix 403, brick X: 14,41, Y: 168,192, one pixel: 25 168 Blob 14 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 970 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144884 MB Blob 16 of 24, id: 5, sources: 1, size: 25x25, npix 402, brick X: 93,118, Y: 55,80, one pixel: 103 55 Blob 9 finished, total: Wall: 1.17 s, CPU: 1.17 s, VmPeak: 970 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146688 MB Blob 17 of 24, id: 9, sources: 1, size: 19x28, npix 370, brick X: 0,19, Y: 115,143, one pixel: 5 115 Blob 10 finished, total: Wall: 1.17 s, CPU: 1.17 s, VmPeak: 976 MB, VmSize: 728 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147228 MB Blob 18 of 24, id: 7, sources: 1, size: 17x27, npix 329, brick X: 284,301, Y: 87,114, one pixel: 294 87 Blob 12 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 966 MB, VmSize: 728 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147612 MB Blob 19 of 24, id: 8, sources: 1, size: 21x21, npix 270, brick X: 235,256, Y: 105,126, one pixel: 244 105 Blob 16 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 970 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146688 MB Blob 20 of 24, id: 1, sources: 1, size: 20x21, npix 239, brick X: 219,239, Y: 6,27, one pixel: 228 6 Blob 13 finished, total: Wall: 0.95 s, CPU: 0.95 s, VmPeak: 963 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147388 MB Blob 21 of 24, id: 23, sources: 1, size: 18x20, npix 230, brick X: 0,18, Y: 274,294, one pixel: 6 274 Blob 15 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 970 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144884 MB Blob 22 of 24, id: 4, sources: 1, size: 19x19, npix 217, brick X: 157,176, Y: 38,57, one pixel: 165 38 Blob 19 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 970 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146688 MB Blob 23 of 24, id: 0, sources: 1, size: 21x14, npix 202, brick X: 79,100, Y: 0,14, one pixel: 80 0 Blob 21 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 970 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144884 MB Blob 24 of 24, id: 21, sources: 1, size: 18x18, npix 180, brick X: 191,209, Y: 264,282, one pixel: 199 264 Measuring 1 iterative sources Blob 17 finished, total: Wall: 0.89 s, CPU: 0.89 s, VmPeak: 976 MB, VmSize: 728 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147228 MB Blob 18 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 966 MB, VmSize: 728 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147612 MB Blob 20 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 963 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147388 MB Blob 24 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 976 MB, VmSize: 728 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147228 MB Blob 22 finished, total: Wall: 0.83 s, CPU: 0.83 s, VmPeak: 970 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146688 MB Measuring 1 iterative sources Blob 23 finished, total: Wall: 0.86 s, CPU: 0.86 s, VmPeak: 970 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144884 MB Blob 3 finished, total: Wall: 4.18 s, CPU: 4.18 s, VmPeak: 966 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147712 MB Measuring 3 iterative sources Blob 2 finished, total: Wall: 5.90 s, CPU: 5.90 s, VmPeak: 957 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148316 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.86814, ee1=-0.0369078, ee2=0.513027 Blob 1 finished, total: Wall: 7.51 s, CPU: 7.51 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149396 MB Old catalog: 42 New catalog: 39 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/metrics/cus/blobs-custom-243333p02141.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/metrics/cus/all-models-custom-243333p02141.fits Stage fitblobs : Wall: 7.86 s, CPU: 0.41 s, VmPeak: 1065 MB, VmSize: 1065 MB, VmRSS: 255 MB, VmData: 281 MB, maxrss: 0.2614 MB Stage fitblobs finished: 2020-08-10T10:35:27.215582 Resources for stage fitblobs : 35.331 s worker CPU, 35.423 s worker Wall, Wall: 7.856 s, Cores in use: 4.55, Total efficiency (on 8 cores): 56.9 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/PGC1217238-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/PGC1217238-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-10T10:35:27.229911 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/tmp-legacysurvey-custom-243333p02141-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/tmp-legacysurvey-custom-243333p02141-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/tmp-legacysurvey-custom-243333p02141-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/tmp-legacysurvey-custom-243333p02141-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-resid.jpg Stage coadds : Wall: 1.64 s, CPU: 0.72 s, VmPeak: 1065 MB, VmSize: 1065 MB, VmRSS: 256 MB, VmData: 281 MB, maxrss: 0.261724 MB Stage coadds finished: 2020-08-10T10:35:28.874569 Resources for stage coadds : 4.494 s worker CPU, 4.894 s worker Wall, Wall: 1.646 s, Cores in use: 3.17, Total efficiency (on 8 cores): 39.6 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/PGC1217238-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/PGC1217238-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-10T10:35:28.889273 Cut to 1 unWISE tiles Reading WISE tile 2435p015 band 1 Reading WISE tile 2435p015 band 3 Reading WISE tile 2435p015 band 2 Reading WISE tile 2435p015 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 970 MB, VmSize: 806 MB, VmRSS: 151 MB, VmData: 177 MB, maxrss: 0.194676 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 966 MB, VmSize: 805 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.210476 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 963 MB, VmSize: 803 MB, VmRSS: 150 MB, VmData: 174 MB, maxrss: 0.21406 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p015/unwise-2435p015-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 966 MB, VmSize: 803 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.209584 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/tmp-legacysurvey-custom-243333p02141-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/tmp-legacysurvey-custom-243333p02141-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.18 s, CPU: 0.52 s, VmPeak: 1065 MB, VmSize: 1065 MB, VmRSS: 256 MB, VmData: 281 MB, maxrss: 0.26224 MB Stage wise_forced finished: 2020-08-10T10:35:32.064688 Resources for stage wise_forced : 3.383 s worker CPU, 5.935 s worker Wall, Wall: 3.177 s, Cores in use: 1.23, Total efficiency (on 8 cores): 15.4 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/PGC1217238-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/PGC1217238-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-10T10:35:32.081155 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/coadd/cus/custom-243333p02141/legacysurvey-custom-243333p02141-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/tractor-i/cus/tractor-custom-243333p02141.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/tractor/cus/tractor-custom-243333p02141.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/tractor/cus/brick-custom-243333p02141.sha256sum Stage writecat : Wall: 1.14 s, CPU: 0.61 s, VmPeak: 1197 MB, VmSize: 1069 MB, VmRSS: 258 MB, VmData: 281 MB, maxrss: 0.3951 MB Stage writecat finished: 2020-08-10T10:35:33.224873 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.145 s, Cores in use: 0.53, Total efficiency (on 8 cores): 6.7 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/PGC1217238-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1217238/PGC1217238-largegalaxy-writecat.p All done: 52.346 s worker CPU, 622.448 s worker Wall, Wall: 124.996 s, Cores in use: 0.50, Total efficiency (on 8 cores): 6.2 % Finished galaxy PGC1217238 in 2.124 minutes.