Started working on galaxy PGC373212 at Wed Aug 5 19:23:35 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 326.4728745 -59.201222200000004 --width 239 --height 239 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T19:23:40.614577 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '326.4728745', '-59.201222200000004', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 326.4728745 -59.201222200000004 --width 239 --height 239 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 326.4728745 -59.201222200000004 Starting process 9751 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 9752 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 9753 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 9754 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 9755 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059404 MB Starting process 9756 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059412 MB Starting process 9757 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059412 MB Starting process 9758 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 9759 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 9760 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 9761 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 9762 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 9763 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 9764 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 9765 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 9766 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T19:23:41.481013 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 23 CCDs: c4d_140920_024213_ooi_r_ls9-N15 r expnum 360562 exptime 90.0 propid 2012B-0001 seeing 1.02 MJD 56920.111 object DES survey hex -309-592 tiling 2 decam/CP/V4.8.2a/CP20140919/c4d_140920_024213_ooi_r_ls9.fits.fz c4d_140920_024011_ooi_g_ls9-N15 g expnum 360561 exptime 90.0 propid 2012B-0001 seeing 1.19 MJD 56920.110 object DES survey hex -309-592 tiling 2 decam/CP/V4.8.2a/CP20140919/c4d_140920_024011_ooi_g_ls9.fits.fz c4d_160929_004039_ooi_z_ls9-N14 z expnum 578591 exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 57660.027 object DES survey hex -309-592 tiling 6 decam/CP/V4.8.2a/CP20160928/c4d_160929_004039_ooi_z_ls9.fits.fz c4d_160927_004624_ooi_r_ls9-N14 r expnum 577698 exptime 90.0 propid 2012B-0001 seeing 0.93 MJD 57658.031 object DES survey hex -309-592 tiling 6 decam/CP/V4.8.2a/CP20160926/c4d_160927_004624_ooi_r_ls9.fits.fz c4d_160927_004823_ooi_g_ls9-N14 g expnum 577699 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 57658.032 object DES survey hex -309-592 tiling 6 decam/CP/V4.8.2a/CP20160926/c4d_160927_004823_ooi_g_ls9.fits.fz c4d_160912_001556_ooi_z_ls9-N14 z expnum 573739 exptime 90.0 propid 2012B-0001 seeing 1.62 MJD 57643.009 object DES survey hex -309-592 tiling 6 decam/CP/V4.8.2a/CP20160911/c4d_160912_001556_ooi_z_ls9.fits.fz c4d_170924_023159_ooi_g_v1-N31 g expnum 680734 exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 58020.106 object DES survey hex -336-582 tiling 8 decam/CP/V4.1/CP20170923/c4d_170924_023159_ooi_g_v1.fits.fz c4d_170924_023002_ooi_r_v1-N31 r expnum 680733 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 58020.104 object DES survey hex -336-582 tiling 8 decam/CP/V4.1/CP20170923/c4d_170924_023002_ooi_r_v1.fits.fz c4d_131010_011710_ooi_r_ls9-N6 r expnum 242402 exptime 90.0 propid 2012B-0001 seeing 0.92 MJD 56575.054 object DES survey hex -336-582 tiling 3 decam/CP/V4.8.2a/CP20131009/c4d_131010_011710_ooi_r_ls9.fits.fz c4d_170924_015203_ooi_z_v1-S20 z expnum 680714 exptime 90.0 propid 2012B-0001 seeing 0.76 MJD 58020.078 object DES survey hex -344-603 tiling 7 decam/CP/V4.1/CP20170923/c4d_170924_015203_ooi_z_v1.fits.fz c4d_170911_025539_ooi_g_v1-S20 g expnum 676317 exptime 90.0 propid 2012B-0001 seeing 1.45 MJD 58007.122 object DES survey hex -344-603 tiling 7 decam/CP/V4.1/CP20170910/c4d_170911_025539_ooi_g_v1.fits.fz c4d_170911_025339_ooi_r_v1-S20 r expnum 676316 exptime 90.0 propid 2012B-0001 seeing 1.26 MJD 58007.121 object DES survey hex -344-603 tiling 7 decam/CP/V4.1/CP20170910/c4d_170911_025339_ooi_r_v1.fits.fz c4d_171118_013919_ooi_r_v1-S21 r expnum 697240 exptime 90.0 propid 2012B-0001 seeing 0.90 MJD 58075.069 object DES survey hex -344-603 tiling 9 decam/CP/V4.1/CP20171117/c4d_171118_013919_ooi_r_v1.fits.fz c4d_171101_010109_ooi_z_v1-S21 z expnum 692992 exptime 90.0 propid 2012B-0001 seeing 0.76 MJD 58058.042 object DES survey hex -344-603 tiling 9 decam/CP/V4.1/CP20171031/c4d_171101_010109_ooi_z_v1.fits.fz c4d_171019_014725_ooi_g_v1-S21 g expnum 688455 exptime 90.0 propid 2012B-0001 seeing 1.52 MJD 58045.075 object DES survey hex -344-603 tiling 9 decam/CP/V4.1/CP20171018/c4d_171019_014725_ooi_g_v1.fits.fz c4d_171019_014525_ooi_r_v1-S21 r expnum 688454 exptime 90.0 propid 2012B-0001 seeing 1.79 MJD 58045.073 object DES survey hex -344-603 tiling 9 decam/CP/V4.1/CP20171018/c4d_171019_014525_ooi_r_v1.fits.fz c4d_130923_035155_ooi_z_ls9-S12 z expnum 237737 exptime 90.0 propid 2012B-0001 seeing 0.82 MJD 56558.161 object DES survey hex -344-603 tiling 4 decam/CP/V4.8.2a/CP20130922/c4d_130923_035155_ooi_z_ls9.fits.fz c4d_130929_010743_ooi_r_ls9-S12 r expnum 239228 exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 56564.047 object DES survey hex -344-603 tiling 4 decam/CP/V4.8.2a/CP20130928/c4d_130929_010743_ooi_r_ls9.fits.fz c4d_130908_014116_ooi_g_ls9-S12 g expnum 231462 exptime 90.0 propid 2012B-0001 seeing 1.56 MJD 56543.070 object DES survey hex -344-603 tiling 4 decam/CP/V4.8.2a/CP20130907/c4d_130908_014116_ooi_g_ls9.fits.fz c4d_151017_002403_ooi_z_ls9-S28 z expnum 484791 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 57312.015 object DES survey hex -344-603 tiling 5 decam/CP/V4.8.2a/CP20151016/c4d_151017_002403_ooi_z_ls9.fits.fz c4d_151017_002802_ooi_r_ls9-S28 r expnum 484793 exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 57312.018 object DES survey hex -344-603 tiling 5 decam/CP/V4.8.2a/CP20151016/c4d_151017_002802_ooi_r_ls9.fits.fz c4d_151017_003001_ooi_g_ls9-S28 g expnum 484794 exptime 90.0 propid 2012B-0001 seeing 1.33 MJD 57312.019 object DES survey hex -344-603 tiling 5 decam/CP/V4.8.2a/CP20151016/c4d_151017_003001_ooi_g_ls9.fits.fz c4d_180914_061255_ooi_r_v1-S28 r expnum 773343 exptime 90.0 propid 2012B-0001 seeing 1.40 MJD 58375.259 object DES survey hex -344-603 tiling 10 decam/CP/V4.1/CP20180913/c4d_180914_061255_ooi_r_v1.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962b000-z-20160912T001335_oi[N14,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962c6a7-r-20160927T004402_oi[N14,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171113_901ed81-r-20171118T013919_oi[S21,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171017_8fe5678-g-20171019T014725_oi[S21,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171017_8fe5678-r-20171019T014525_oi[S21,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-g-20170924T023159_oi[N31,noinherit][2046,4094][real]: DE Zeroing out 4320 weight-map pixels below quantization error (= median 0.000224) Clipping 1 pixels with anomalously large oow values: max 0.0485376 vs median 0.0365221 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962c093-z-20160929T003818_oi[N14,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-g-20170911T025539_oi[S20,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-z-20170924T015203_oi[S20,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962b589-g-20160927T004601_oi[N14,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-r-20170911T025339_oi[S20,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96158ea-r-20140920T023952_oi[N15,noinherit][2046,4094][real]: DES sur Clipping 192 pixels with anomalously large oow values: max 12.3239 vs median 0.0159149 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9614f7e-g-20140920T023753_oi[N15,noinherit][2046,4094][real]: DES sur Clipping 227 pixels with anomalously large oow values: max 3.90347 vs median 0.0427674 The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-r-20170924T023002_oi[N31,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9634008-r-20131010T011710_oi[N6,noinherit][2046,4094][real]: DES surv Zeroing out 0 weight-map pixels below quantization error (= median 0.000195) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 0 weight-map pixels below quantization error (= median 5.32e-05) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 0 weight-map pixels below quantization error (= median 4.36e-05) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 3404 weight-map pixels below quantization error (= median 3.98e-06) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 3416 weight-map pixels below quantization error (= median 0.000215) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 3159 weight-map pixels below quantization error (= median 6.29e-05) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 4320 weight-map pixels below quantization error (= median 5e-05) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171028_8ff6460-z-20171101T010109_oi[S21,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9621c99-g-20151017T002741_oi[S28,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96334f7-r-20130929T010743_oi[S12,noinherit][2046,4094][real]: DES sur Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DES18B_20180912_92acf38-r-20180914T061255_oi[S28,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633379-g-20130908T014116_oi[S12,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9622f50-r-20151017T002543_oi[S28,noinherit][2046,4094][real]: DES sur Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962286b-z-20151017T002145_oi[S28,noinherit][2046,4094][real]: DES sur Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 49 weight-map pixels below quantization error (= median 2.95e-06) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96323ad-z-20130923T035155_oi[S12,noinherit][2046,4094][real]: DES sur Stage tims : Wall: 60.56 s, CPU: 1.14 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 189 MB, VmData: 221 MB, maxrss: 0.19344 MB Stage tims finished: 2020-08-05T19:24:42.039381 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-g-20170911T025539_oi[S20,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-r-20170911T025339_oi[S20,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-r-20170924T023002_oi[N31,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96158ea-r-20140920T023952_oi[N15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962c093-z-20160929T003818_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9614f7e-g-20140920T023753_oi[N15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Zeroing out 3360 weight-map pixels below quantization error (= median 7.5e-05) Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-z-20170924T015203_oi[S20,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES18B_20180912_92acf38-r-20180914T061255_oi[S28,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171113_901ed81-r-20171118T013919_oi[S21,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96334f7-r-20130929T010743_oi[S12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-g-20170924T023159_oi[N31,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9621c99-g-20151017T002741_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962b000-z-20160912T001335_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9622f50-r-20151017T002543_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171017_8fe5678-r-20171019T014525_oi[S21,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633379-g-20130908T014116_oi[S12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962c6a7-r-20160927T004402_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962286b-z-20151017T002145_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Resources for stage tims : 11.944 s worker CPU, 383.157 s worker Wall, Wall: 60.560 s, Cores in use: 0.22, Total efficiency (on 16 cores): 1.4 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171017_8fe5678-g-20171019T014725_oi[S21,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96323ad-z-20130923T035155_oi[S12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9634008-r-20131010T011710_oi[N6,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171028_8ff6460-z-20171101T010109_oi[S21,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962b589-g-20160927T004601_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T19:24:42.325421 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11440.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11520.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11355.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11439.fits Matched 11 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/metrics/cus/reference-custom-326472m59201.fits Stage refs : Wall: 6.89 s, CPU: 3.60 s, VmPeak: 1050 MB, VmSize: 1047 MB, VmRSS: 222 MB, VmData: 254 MB, maxrss: 0.227784 MB Stage refs finished: 2020-08-05T19:24:49.214193 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.890 s, Cores in use: 0.52, Total efficiency (on 16 cores): 3.3 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T19:24:49.276293 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/metrics/cus/outlier-mask-custom-326472m59201.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/metrics/cus/outliers-pre-custom-326472m59201.jpg Image c4d_170911_025539_ooi_g_v1-S20 g : masking 1536 positive outlier pixels and 0 negative outlier pixels Image c4d_171019_014725_ooi_g_v1-S21 g : masking 1720 positive outlier pixels and 0 negative outlier pixels Image c4d_130908_014116_ooi_g_ls9-S12 g : masking 1255 positive outlier pixels and 0 negative outlier pixels Image c4d_140920_024011_ooi_g_ls9-N15 g : masking 948 positive outlier pixels and 1726 negative outlier pixels Image c4d_170924_023159_ooi_g_v1-N31 g : masking 1092 positive outlier pixels and 0 negative outlier pixels Image c4d_151017_003001_ooi_g_ls9-S28 g : masking 821 positive outlier pixels and 0 negative outlier pixels Image c4d_160927_004823_ooi_g_ls9-N14 g : masking 1302 positive outlier pixels and 0 negative outlier pixels Image c4d_160927_004624_ooi_r_ls9-N14 r : masking 1635 positive outlier pixels and 0 negative outlier pixels Image c4d_170911_025339_ooi_r_v1-S20 r : masking 1317 positive outlier pixels and 0 negative outlier pixels Image c4d_171019_014525_ooi_r_v1-S21 r : masking 1542 positive outlier pixels and 0 negative outlier pixels Image c4d_130929_010743_ooi_r_ls9-S12 r : masking 1466 positive outlier pixels and 0 negative outlier pixels Image c4d_151017_002802_ooi_r_ls9-S28 r : masking 1203 positive outlier pixels and 0 negative outlier pixels Image c4d_140920_024213_ooi_r_ls9-N15 r : masking 0 positive outlier pixels and 2284 negative outlier pixels Image c4d_170924_023002_ooi_r_v1-N31 r : masking 1476 positive outlier pixels and 0 negative outlier pixels Image c4d_131010_011710_ooi_r_ls9-N6 r : masking 1444 positive outlier pixels and 0 negative outlier pixels Image c4d_171118_013919_ooi_r_v1-S21 r : masking 1358 positive outlier pixels and 0 negative outlier pixels Image c4d_160912_001556_ooi_z_ls9-N14 z : masking 2183 positive outlier pixels and 0 negative outlier pixels Image c4d_151017_002403_ooi_z_ls9-S28 z : masking 320 positive outlier pixels and 0 negative outlier pixels Image c4d_171101_010109_ooi_z_v1-S21 z : masking 627 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/metrics/cus/outlier-mask-custom-326472m59201.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/metrics/cus/outliers-post-custom-326472m59201.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/metrics/cus/outliers-masked-pos-custom-326472m59201.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/metrics/cus/outliers-masked-neg-custom-326472m59201.jpg Stage outliers : Wall: 1.58 s, CPU: 1.32 s, VmPeak: 1056 MB, VmSize: 1056 MB, VmRSS: 245 MB, VmData: 274 MB, maxrss: 0.250868 MB Stage outliers finished: 2020-08-05T19:24:50.857924 Resources for stage outliers : 2.163 s worker CPU, 2.163 s worker Wall, Wall: 1.583 s, Cores in use: 2.20, Total efficiency (on 16 cores): 13.7 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T19:24:51.157594 Stage halos : Wall: 0.95 s, CPU: 0.66 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 245 MB, VmData: 274 MB, maxrss: 0.251172 MB Stage halos finished: 2020-08-05T19:24:52.108325 Resources for stage halos : 0.922 s worker CPU, 3.191 s worker Wall, Wall: 0.952 s, Cores in use: 1.66, Total efficiency (on 16 cores): 10.4 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T19:24:52.154452 PSF sigmas in coadd pixels: ['1.93', '1.78', '1.80', '2.35', '2.47', '2.54', '2.16'] Using average PSF sigma 2.1461420758726364 Gaussian PSF norm 0.1314427385517692 vs pixelized 0.11226593 average tim pixel scale / coadd scale: 1.00103020947325 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.66', '1.51', '1.71', '1.50', '2.04', '1.46', '2.90', '1.82', '2.03', '2.27'] Using average PSF sigma 1.8896943017212204 Gaussian PSF norm 0.14928064900070517 vs pixelized 0.12750384 average tim pixel scale / coadd scale: 1.0010578939762278 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.64', '2.62', '1.24', '1.24', '1.33', '1.74'] Using average PSF sigma 1.6356483127061445 Gaussian PSF norm 0.1724666540982508 vs pixelized 0.14504454 average tim pixel scale / coadd scale: 1.0009885413255826 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.30 s, CPU: 0.29 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 247 MB, VmData: 274 MB, maxrss: 0.25288 MB Stage fit_on_coadds finished: 2020-08-05T19:24:52.457836 Resources for stage fit_on_coadds : 0.507 s worker CPU, 0.507 s worker Wall, Wall: 0.305 s, Cores in use: 2.63, Total efficiency (on 16 cores): 16.5 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T19:24:52.470851 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 61 potential peaks Of 61 potential peaks: 42 in veto map, 6 cut by saddle test, 0 cut by aper test, 13 kept SED z : 13 new peaks Found 99 potential peaks Of 99 potential peaks: 75 in veto map, 11 cut by saddle test, 0 cut by aper test, 13 kept SED r : 13 new peaks Found 44 potential peaks Of 44 potential peaks: 37 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 93 potential peaks Of 93 potential peaks: 80 in veto map, 8 cut by saddle test, 0 cut by aper test, 5 kept SED Flat : 5 new peaks Found 114 potential peaks Of 114 potential peaks: 105 in veto map, 9 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 34 new sources Median coadd sky for g : -3.8820596e-07 Median coadd sky for r : 0.00019634291 Median coadd sky for z : 0.0003661471 Stage srcs : Wall: 1.00 s, CPU: 0.97 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 247 MB, VmData: 274 MB, maxrss: 0.253412 MB Stage srcs finished: 2020-08-05T19:24:53.472659 Resources for stage srcs : 0.070 s worker CPU, 0.070 s worker Wall, Wall: 1.003 s, Cores in use: 1.04, Total efficiency (on 16 cores): 6.5 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T19:24:53.483703 Blob 1 of 11, id: 4, sources: 25, size: 228x213, npix 28928, brick X: 0,228, Y: 14,227, one pixel: 101 14 Blob 2 of 11, id: 3, sources: 4, size: 112x50, npix 3614, brick X: 119,231, Y: 0,50, one pixel: 126 0 Blob 3 of 11, id: 8, sources: 1, size: 28x31, npix 535, brick X: 198,226, Y: 96,127, one pixel: 211 96 Blob 4 of 11, id: 9, sources: 1, size: 32x21, npix 495, brick X: 42,74, Y: 218,239, one pixel: 55 218 Blob 5 of 11, id: 1, sources: 1, size: 28x20, npix 368, brick X: 51,79, Y: 0,20, one pixel: 58 0 Blob 6 of 11, id: 7, sources: 1, size: 24x23, npix 359, brick X: 186,210, Y: 83,106, one pixel: 196 83 Blob 7 of 11, id: 10, sources: 2, size: 23x18, npix 281, brick X: 107,130, Y: 221,239, one pixel: 118 221 Blob 8 of 11, id: 6, sources: 1, size: 18x22, npix 263, brick X: 221,239, Y: 67,89, one pixel: 231 67 Blob 9 of 11, id: 5, sources: 1, size: 21x21, npix 250, brick X: 176,197, Y: 43,64, one pixel: 186 43 Blob 10 of 11, id: 0, sources: 1, size: 21x16, npix 230, brick X: 24,45, Y: 0,16, one pixel: 28 0 Blob 11 of 11, id: 2, sources: 1, size: 21x15, npix 219, brick X: 85,106, Y: 0,15, one pixel: 87 0 Blob 10 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 1011 MB, VmSize: 733 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148828 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (326.47220, -59.14234), pm (15.9, -6.7), parallax 2.017 with NanoMaggies: g=9.71, r=9.86, z=10.1 Reset brightness to NanoMaggies: g=9.71, r=9.86, z=10.1 Blob 7 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 1030 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150648 MB Blob 8 finished, total: Wall: 0.43 s, CPU: 0.43 s, VmPeak: 970 MB, VmSize: 737 MB, VmRSS: 152 MB, VmData: 186 MB, maxrss: 0.155536 MB Measuring 1 iterative sources Blob 6 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 1016 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.15048 MB Blob 11 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 950 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.150012 MB Blob 4 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 1012 MB, VmSize: 733 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148984 MB Blob 5 finished, total: Wall: 0.89 s, CPU: 0.88 s, VmPeak: 974 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149784 MB Blob 9 finished, total: Wall: 1.00 s, CPU: 0.99 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149456 MB Blob 3 finished, total: Wall: 1.17 s, CPU: 1.16 s, VmPeak: 1010 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150352 MB Measuring 1 iterative sources Blob 2 finished, total: Wall: 6.28 s, CPU: 6.28 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.15164 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.11568, ee1=-0.0999148, ee2=-0.265892 Measuring 6 iterative sources Blob 1 finished, total: Wall: 22.75 s, CPU: 22.75 s, VmPeak: 953 MB, VmSize: 741 MB, VmRSS: 162 MB, VmData: 190 MB, maxrss: 0.166248 MB Old catalog: 41 New catalog: 45 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/metrics/cus/blobs-custom-326472m59201.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/metrics/cus/all-models-custom-326472m59201.fits Stage fitblobs : Wall: 23.15 s, CPU: 0.38 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 248 MB, VmData: 274 MB, maxrss: 0.254264 MB Stage fitblobs finished: 2020-08-05T19:25:16.629379 Resources for stage fitblobs : 35.480 s worker CPU, 35.606 s worker Wall, Wall: 23.147 s, Cores in use: 1.55, Total efficiency (on 16 cores): 9.7 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T19:25:16.642394 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/tmp-legacysurvey-custom-326472m59201-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/tmp-legacysurvey-custom-326472m59201-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/tmp-legacysurvey-custom-326472m59201-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/tmp-legacysurvey-custom-326472m59201-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-resid.jpg Stage coadds : Wall: 2.16 s, CPU: 0.62 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 249 MB, VmData: 274 MB, maxrss: 0.25478 MB Stage coadds finished: 2020-08-05T19:25:18.804824 Resources for stage coadds : 15.303 s worker CPU, 20.998 s worker Wall, Wall: 2.164 s, Cores in use: 7.36, Total efficiency (on 16 cores): 46.0 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-05T19:25:18.825680 Cut to 1 unWISE tiles Reading WISE tile 3254m591 band 3 Reading WISE tile 3254m591 band 1 Reading WISE tile 3254m591 band 2 Reading WISE tile 3254m591 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 1012 MB, VmSize: 808 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.192152 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 1012 MB, VmSize: 810 MB, VmRSS: 149 MB, VmData: 174 MB, maxrss: 0.211768 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 1010 MB, VmSize: 805 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.207536 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 970 MB, VmSize: 809 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.211388 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/tmp-legacysurvey-custom-326472m59201-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/tmp-legacysurvey-custom-326472m59201-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 5.29 s, CPU: 1.66 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 249 MB, VmData: 274 MB, maxrss: 0.255484 MB Stage wise_forced finished: 2020-08-05T19:25:24.119533 Resources for stage wise_forced : 3.213 s worker CPU, 7.355 s worker Wall, Wall: 5.295 s, Cores in use: 0.92, Total efficiency (on 16 cores): 5.7 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T19:25:24.136576 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/tractor-i/cus/tractor-custom-326472m59201.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/tractor/cus/tractor-custom-326472m59201.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/tractor/cus/brick-custom-326472m59201.sha256sum Stage writecat : Wall: 7.58 s, CPU: 1.16 s, VmPeak: 1189 MB, VmSize: 1061 MB, VmRSS: 251 MB, VmData: 274 MB, maxrss: 0.38836 MB Stage writecat finished: 2020-08-05T19:25:31.713330 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.578 s, Cores in use: 0.15, Total efficiency (on 16 cores): 1.0 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-writecat.p All done: 69.604 s worker CPU, 453.051 s worker Wall, Wall: 110.259 s, Cores in use: 0.74, Total efficiency (on 16 cores): 4.6 % Finished galaxy PGC373212 in 1.951 minutes. Started working on galaxy PGC373212 at Wed Aug 5 19:48:35 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 326.4728745 -59.201222200000004 --width 239 --height 239 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T19:48:37.259115 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '326.4728745', '-59.201222200000004', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 326.4728745 -59.201222200000004 --width 239 --height 239 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 326.4728745 -59.201222200000004 Starting process 15064 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 15066 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 15068 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 15071 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 15073 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059404 MB Starting process 15075 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059412 MB Starting process 15077 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059412 MB Starting process 15079 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 15081 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 15083 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 15085 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 15089 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 15091 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 15087 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 15093 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 15095 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 15099 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 15100 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 15101 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 15102 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 15103 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 15105 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 15107 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 15108 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 15109 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 15110 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 15111 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 15112 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 15113 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 15114 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 15115 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 15116 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T19:48:37.989223 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 23 CCDs: c4d_140920_024213_ooi_r_ls9-N15 r expnum 360562 exptime 90.0 propid 2012B-0001 seeing 1.02 MJD 56920.111 object DES survey hex -309-592 tiling 2 decam/CP/V4.8.2a/CP20140919/c4d_140920_024213_ooi_r_ls9.fits.fz c4d_140920_024011_ooi_g_ls9-N15 g expnum 360561 exptime 90.0 propid 2012B-0001 seeing 1.19 MJD 56920.110 object DES survey hex -309-592 tiling 2 decam/CP/V4.8.2a/CP20140919/c4d_140920_024011_ooi_g_ls9.fits.fz c4d_160929_004039_ooi_z_ls9-N14 z expnum 578591 exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 57660.027 object DES survey hex -309-592 tiling 6 decam/CP/V4.8.2a/CP20160928/c4d_160929_004039_ooi_z_ls9.fits.fz c4d_160927_004624_ooi_r_ls9-N14 r expnum 577698 exptime 90.0 propid 2012B-0001 seeing 0.93 MJD 57658.031 object DES survey hex -309-592 tiling 6 decam/CP/V4.8.2a/CP20160926/c4d_160927_004624_ooi_r_ls9.fits.fz c4d_160927_004823_ooi_g_ls9-N14 g expnum 577699 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 57658.032 object DES survey hex -309-592 tiling 6 decam/CP/V4.8.2a/CP20160926/c4d_160927_004823_ooi_g_ls9.fits.fz c4d_160912_001556_ooi_z_ls9-N14 z expnum 573739 exptime 90.0 propid 2012B-0001 seeing 1.62 MJD 57643.009 object DES survey hex -309-592 tiling 6 decam/CP/V4.8.2a/CP20160911/c4d_160912_001556_ooi_z_ls9.fits.fz c4d_170924_023159_ooi_g_v1-N31 g expnum 680734 exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 58020.106 object DES survey hex -336-582 tiling 8 decam/CP/V4.1/CP20170923/c4d_170924_023159_ooi_g_v1.fits.fz c4d_170924_023002_ooi_r_v1-N31 r expnum 680733 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 58020.104 object DES survey hex -336-582 tiling 8 decam/CP/V4.1/CP20170923/c4d_170924_023002_ooi_r_v1.fits.fz c4d_131010_011710_ooi_r_ls9-N6 r expnum 242402 exptime 90.0 propid 2012B-0001 seeing 0.92 MJD 56575.054 object DES survey hex -336-582 tiling 3 decam/CP/V4.8.2a/CP20131009/c4d_131010_011710_ooi_r_ls9.fits.fz c4d_170924_015203_ooi_z_v1-S20 z expnum 680714 exptime 90.0 propid 2012B-0001 seeing 0.76 MJD 58020.078 object DES survey hex -344-603 tiling 7 decam/CP/V4.1/CP20170923/c4d_170924_015203_ooi_z_v1.fits.fz c4d_170911_025539_ooi_g_v1-S20 g expnum 676317 exptime 90.0 propid 2012B-0001 seeing 1.45 MJD 58007.122 object DES survey hex -344-603 tiling 7 decam/CP/V4.1/CP20170910/c4d_170911_025539_ooi_g_v1.fits.fz c4d_170911_025339_ooi_r_v1-S20 r expnum 676316 exptime 90.0 propid 2012B-0001 seeing 1.26 MJD 58007.121 object DES survey hex -344-603 tiling 7 decam/CP/V4.1/CP20170910/c4d_170911_025339_ooi_r_v1.fits.fz c4d_171118_013919_ooi_r_v1-S21 r expnum 697240 exptime 90.0 propid 2012B-0001 seeing 0.90 MJD 58075.069 object DES survey hex -344-603 tiling 9 decam/CP/V4.1/CP20171117/c4d_171118_013919_ooi_r_v1.fits.fz c4d_171101_010109_ooi_z_v1-S21 z expnum 692992 exptime 90.0 propid 2012B-0001 seeing 0.76 MJD 58058.042 object DES survey hex -344-603 tiling 9 decam/CP/V4.1/CP20171031/c4d_171101_010109_ooi_z_v1.fits.fz c4d_171019_014725_ooi_g_v1-S21 g expnum 688455 exptime 90.0 propid 2012B-0001 seeing 1.52 MJD 58045.075 object DES survey hex -344-603 tiling 9 decam/CP/V4.1/CP20171018/c4d_171019_014725_ooi_g_v1.fits.fz c4d_171019_014525_ooi_r_v1-S21 r expnum 688454 exptime 90.0 propid 2012B-0001 seeing 1.79 MJD 58045.073 object DES survey hex -344-603 tiling 9 decam/CP/V4.1/CP20171018/c4d_171019_014525_ooi_r_v1.fits.fz c4d_130923_035155_ooi_z_ls9-S12 z expnum 237737 exptime 90.0 propid 2012B-0001 seeing 0.82 MJD 56558.161 object DES survey hex -344-603 tiling 4 decam/CP/V4.8.2a/CP20130922/c4d_130923_035155_ooi_z_ls9.fits.fz c4d_130929_010743_ooi_r_ls9-S12 r expnum 239228 exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 56564.047 object DES survey hex -344-603 tiling 4 decam/CP/V4.8.2a/CP20130928/c4d_130929_010743_ooi_r_ls9.fits.fz c4d_130908_014116_ooi_g_ls9-S12 g expnum 231462 exptime 90.0 propid 2012B-0001 seeing 1.56 MJD 56543.070 object DES survey hex -344-603 tiling 4 decam/CP/V4.8.2a/CP20130907/c4d_130908_014116_ooi_g_ls9.fits.fz c4d_151017_002403_ooi_z_ls9-S28 z expnum 484791 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 57312.015 object DES survey hex -344-603 tiling 5 decam/CP/V4.8.2a/CP20151016/c4d_151017_002403_ooi_z_ls9.fits.fz c4d_151017_002802_ooi_r_ls9-S28 r expnum 484793 exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 57312.018 object DES survey hex -344-603 tiling 5 decam/CP/V4.8.2a/CP20151016/c4d_151017_002802_ooi_r_ls9.fits.fz c4d_151017_003001_ooi_g_ls9-S28 g expnum 484794 exptime 90.0 propid 2012B-0001 seeing 1.33 MJD 57312.019 object DES survey hex -344-603 tiling 5 decam/CP/V4.8.2a/CP20151016/c4d_151017_003001_ooi_g_ls9.fits.fz c4d_180914_061255_ooi_r_v1-S28 r expnum 773343 exptime 90.0 propid 2012B-0001 seeing 1.40 MJD 58375.259 object DES survey hex -344-603 tiling 10 decam/CP/V4.1/CP20180913/c4d_180914_061255_ooi_r_v1.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962b000-z-20160912T001335_oi[N14,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DES18B_20180912_92acf38-r-20180914T061255_oi[S28,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633379-g-20130908T014116_oi[S12,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-r-20170924T023002_oi[N31,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962c6a7-r-20160927T004402_oi[N14,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9634008-r-20131010T011710_oi[N6,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-g-20170924T023159_oi[N31,noinherit][2046,4094][real]: DE Zeroing out 4320 weight-map pixels below quantization error (= median 0.000224) Clipping 1 pixels with anomalously large oow values: max 0.0485376 vs median 0.0365221 The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-g-20170911T025539_oi[S20,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171017_8fe5678-r-20171019T014525_oi[S21,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171017_8fe5678-g-20171019T014725_oi[S21,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96334f7-r-20130929T010743_oi[S12,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171113_901ed81-r-20171118T013919_oi[S21,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962b589-g-20160927T004601_oi[N14,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9621c99-g-20151017T002741_oi[S28,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-r-20170911T025339_oi[S20,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-z-20170924T015203_oi[S20,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9622f50-r-20151017T002543_oi[S28,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9614f7e-g-20140920T023753_oi[N15,noinherit][2046,4094][real]: DES sur Clipping 227 pixels with anomalously large oow values: max 3.90347 vs median 0.0427674 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962286b-z-20151017T002145_oi[S28,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96158ea-r-20140920T023952_oi[N15,noinherit][2046,4094][real]: DES sur Clipping 192 pixels with anomalously large oow values: max 12.3239 vs median 0.0159149 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962c093-z-20160929T003818_oi[N14,noinherit][2046,4094][real]: DES sur Zeroing out 3360 weight-map pixels below quantization error (= median 7.5e-05) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 4320 weight-map pixels below quantization error (= median 5e-05) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171028_8ff6460-z-20171101T010109_oi[S21,noinherit][2046,4094][real]: DE Zeroing out 0 weight-map pixels below quantization error (= median 4.36e-05) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 3416 weight-map pixels below quantization error (= median 0.000215) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 0 weight-map pixels below quantization error (= median 0.000195) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 0 weight-map pixels below quantization error (= median 5.32e-05) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 3159 weight-map pixels below quantization error (= median 6.29e-05) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 3404 weight-map pixels below quantization error (= median 3.98e-06) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 49 weight-map pixels below quantization error (= median 2.95e-06) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96323ad-z-20130923T035155_oi[S12,noinherit][2046,4094][real]: DES sur Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 33.17 s, CPU: 0.98 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 189 MB, VmData: 221 MB, maxrss: 0.193628 MB Stage tims finished: 2020-08-05T19:49:11.154372 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-r-20170924T023002_oi[N31,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633379-g-20130908T014116_oi[S12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-g-20170911T025539_oi[S20,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171113_901ed81-r-20171118T013919_oi[S21,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962b000-z-20160912T001335_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962c6a7-r-20160927T004402_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9634008-r-20131010T011710_oi[N6,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962b589-g-20160927T004601_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9614f7e-g-20140920T023753_oi[N15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96158ea-r-20140920T023952_oi[N15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9622f50-r-20151017T002543_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9621c99-g-20151017T002741_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962286b-z-20151017T002145_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96323ad-z-20130923T035155_oi[S12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 15.541 s worker CPU, 343.558 s worker Wall, Wall: 33.167 s, Cores in use: 0.50, Total efficiency (on 32 cores): 1.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES18B_20180912_92acf38-r-20180914T061255_oi[S28,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-g-20170924T023159_oi[N31,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171017_8fe5678-r-20171019T014525_oi[S21,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171017_8fe5678-g-20171019T014725_oi[S21,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170910_8f9120a-r-20170911T025339_oi[S20,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962c093-z-20160929T003818_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T19:49:11.202171 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11440.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11520.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11355.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11439.fits Matched 11 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/metrics/cus/reference-custom-326472m59201.fits Stage refs : Wall: 8.69 s, CPU: 4.96 s, VmPeak: 1050 MB, VmSize: 1047 MB, VmRSS: 223 MB, VmData: 254 MB, maxrss: 0.227968 MB Stage refs finished: 2020-08-05T19:49:19.893897 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20170922_8faaec5-z-20170924T015203_oi[S20,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171028_8ff6460-z-20171101T010109_oi[S21,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 8.694 s, Cores in use: 0.57, Total efficiency (on 32 cores): 1.8 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T19:49:19.936470 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/metrics/cus/outlier-mask-custom-326472m59201.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/metrics/cus/outliers-pre-custom-326472m59201.jpg Image c4d_140920_024011_ooi_g_ls9-N15 g : masking 948 positive outlier pixels and 1726 negative outlier pixels Image c4d_170924_023159_ooi_g_v1-N31 g : masking 1092 positive outlier pixels and 0 negative outlier pixels Image c4d_170911_025539_ooi_g_v1-S20 g : masking 1536 positive outlier pixels and 0 negative outlier pixels Image c4d_160927_004823_ooi_g_ls9-N14 g : masking 1302 positive outlier pixels and 0 negative outlier pixels Image c4d_130908_014116_ooi_g_ls9-S12 g : masking 1255 positive outlier pixels and 0 negative outlier pixels Image c4d_171019_014725_ooi_g_v1-S21 g : masking 1720 positive outlier pixels and 0 negative outlier pixels Image c4d_151017_003001_ooi_g_ls9-S28 g : masking 821 positive outlier pixels and 0 negative outlier pixels Image c4d_151017_002802_ooi_r_ls9-S28 r : masking 1203 positive outlier pixels and 0 negative outlier pixels Image c4d_140920_024213_ooi_r_ls9-N15 r : masking 0 positive outlier pixels and 2284 negative outlier pixels Image c4d_170924_023002_ooi_r_v1-N31 r : masking 1476 positive outlier pixels and 0 negative outlier pixels Image c4d_160927_004624_ooi_r_ls9-N14 r : masking 1635 positive outlier pixels and 0 negative outlier pixels Image c4d_131010_011710_ooi_r_ls9-N6 r : masking 1444 positive outlier pixels and 0 negative outlier pixels Image c4d_171118_013919_ooi_r_v1-S21 r : masking 1358 positive outlier pixels and 0 negative outlier pixels Image c4d_170911_025339_ooi_r_v1-S20 r : masking 1317 positive outlier pixels and 0 negative outlier pixels Image c4d_171019_014525_ooi_r_v1-S21 r : masking 1542 positive outlier pixels and 0 negative outlier pixels Image c4d_130929_010743_ooi_r_ls9-S12 r : masking 1466 positive outlier pixels and 0 negative outlier pixels Image c4d_160912_001556_ooi_z_ls9-N14 z : masking 2183 positive outlier pixels and 0 negative outlier pixels Image c4d_171101_010109_ooi_z_v1-S21 z : masking 627 positive outlier pixels and 0 negative outlier pixels Image c4d_151017_002403_ooi_z_ls9-S28 z : masking 320 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/metrics/cus/outlier-mask-custom-326472m59201.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/metrics/cus/outliers-post-custom-326472m59201.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/metrics/cus/outliers-masked-pos-custom-326472m59201.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/metrics/cus/outliers-masked-neg-custom-326472m59201.jpg Stage outliers : Wall: 1.95 s, CPU: 1.31 s, VmPeak: 1056 MB, VmSize: 1056 MB, VmRSS: 244 MB, VmData: 273 MB, maxrss: 0.250224 MB Stage outliers finished: 2020-08-05T19:49:21.890697 Resources for stage outliers : 1.984 s worker CPU, 2.396 s worker Wall, Wall: 1.956 s, Cores in use: 1.68, Total efficiency (on 32 cores): 5.3 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-outliers.p Running stage halos WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96334f7-r-20130929T010743_oi[S12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage halos at 2020-08-05T19:49:21.941276 Stage halos : Wall: 1.44 s, CPU: 1.12 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 245 MB, VmData: 273 MB, maxrss: 0.250584 MB Stage halos finished: 2020-08-05T19:49:23.378367 Resources for stage halos : 0.973 s worker CPU, 4.368 s worker Wall, Wall: 1.439 s, Cores in use: 1.46, Total efficiency (on 32 cores): 4.6 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T19:49:23.431311 PSF sigmas in coadd pixels: ['1.93', '1.78', '1.80', '2.35', '2.47', '2.54', '2.16'] Using average PSF sigma 2.1461420758726364 Gaussian PSF norm 0.1314427385517692 vs pixelized 0.11226593 average tim pixel scale / coadd scale: 1.00103020947325 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.66', '1.51', '1.71', '1.50', '2.04', '1.46', '2.90', '1.82', '2.03', '2.27'] Using average PSF sigma 1.8896943017212204 Gaussian PSF norm 0.14928064900070517 vs pixelized 0.12750384 average tim pixel scale / coadd scale: 1.0010578939762278 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.64', '2.62', '1.24', '1.24', '1.33', '1.74'] Using average PSF sigma 1.6356483127061445 Gaussian PSF norm 0.1724666540982508 vs pixelized 0.14504452 average tim pixel scale / coadd scale: 1.0009885413255826 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.33 s, CPU: 0.31 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 247 MB, VmData: 274 MB, maxrss: 0.252756 MB Stage fit_on_coadds finished: 2020-08-05T19:49:23.759929 Resources for stage fit_on_coadds : 0.444 s worker CPU, 0.444 s worker Wall, Wall: 0.331 s, Cores in use: 2.30, Total efficiency (on 32 cores): 7.2 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T19:49:23.776086 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 61 potential peaks Of 61 potential peaks: 42 in veto map, 6 cut by saddle test, 0 cut by aper test, 13 kept SED z : 13 new peaks Found 99 potential peaks Of 99 potential peaks: 75 in veto map, 11 cut by saddle test, 0 cut by aper test, 13 kept SED r : 13 new peaks Found 44 potential peaks Of 44 potential peaks: 37 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 93 potential peaks Of 93 potential peaks: 80 in veto map, 8 cut by saddle test, 0 cut by aper test, 5 kept SED Flat : 5 new peaks Found 114 potential peaks Of 114 potential peaks: 105 in veto map, 9 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 34 new sources Median coadd sky for g : -3.8820588e-07 Median coadd sky for r : 0.0001963428 Median coadd sky for z : 0.0003661471 Stage srcs : Wall: 1.22 s, CPU: 1.14 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 247 MB, VmData: 274 MB, maxrss: 0.2533 MB Stage srcs finished: 2020-08-05T19:49:24.991600 Resources for stage srcs : 0.073 s worker CPU, 0.073 s worker Wall, Wall: 1.218 s, Cores in use: 1.00, Total efficiency (on 32 cores): 3.1 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T19:49:25.007195 Blob 1 of 11, id: 4, sources: 25, size: 228x213, npix 28928, brick X: 0,228, Y: 14,227, one pixel: 101 14 Blob 2 of 11, id: 3, sources: 4, size: 112x50, npix 3614, brick X: 119,231, Y: 0,50, one pixel: 126 0 Blob 3 of 11, id: 8, sources: 1, size: 28x31, npix 535, brick X: 198,226, Y: 96,127, one pixel: 211 96 Blob 4 of 11, id: 9, sources: 1, size: 32x21, npix 495, brick X: 42,74, Y: 218,239, one pixel: 55 218 Blob 5 of 11, id: 1, sources: 1, size: 28x20, npix 368, brick X: 51,79, Y: 0,20, one pixel: 58 0 Blob 6 of 11, id: 7, sources: 1, size: 24x23, npix 359, brick X: 186,210, Y: 83,106, one pixel: 196 83 Blob 7 of 11, id: 10, sources: 2, size: 23x18, npix 281, brick X: 107,130, Y: 221,239, one pixel: 118 221 Blob 8 of 11, id: 6, sources: 1, size: 18x22, npix 263, brick X: 221,239, Y: 67,89, one pixel: 231 67 Blob 9 of 11, id: 5, sources: 1, size: 21x21, npix 250, brick X: 176,197, Y: 43,64, one pixel: 186 43 Blob 10 of 11, id: 0, sources: 1, size: 21x16, npix 230, brick X: 24,45, Y: 0,16, one pixel: 28 0 Blob 11 of 11, id: 2, sources: 1, size: 21x15, npix 219, brick X: 85,106, Y: 0,15, one pixel: 87 0 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (326.47220, -59.14234), pm (15.9, -6.7), parallax 2.017 with NanoMaggies: g=9.71, r=9.86, z=10.1 Reset brightness to NanoMaggies: g=9.71, r=9.86, z=10.1 Blob 7 finished, total: Wall: 0.29 s, CPU: 0.28 s, VmPeak: 952 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147712 MB Blob 10 finished, total: Wall: 0.33 s, CPU: 0.32 s, VmPeak: 1011 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149988 MB Blob 8 finished, total: Wall: 0.34 s, CPU: 0.33 s, VmPeak: 937 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148384 MB Measuring 1 iterative sources Blob 6 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147016 MB Blob 11 finished, total: Wall: 0.69 s, CPU: 0.68 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095172 MB Blob 4 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095096 MB Blob 5 finished, total: Wall: 0.77 s, CPU: 0.76 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.11502 MB Blob 9 finished, total: Wall: 1.05 s, CPU: 1.04 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 166 MB, maxrss: 0.114904 MB Blob 3 finished, total: Wall: 1.26 s, CPU: 1.25 s, VmPeak: 1000 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150552 MB Measuring 1 iterative sources Blob 2 finished, total: Wall: 6.78 s, CPU: 6.77 s, VmPeak: 1010 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.151548 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.11567, ee1=-0.099914, ee2=-0.265891 Measuring 6 iterative sources Blob 1 finished, total: Wall: 24.31 s, CPU: 24.31 s, VmPeak: 959 MB, VmSize: 741 MB, VmRSS: 162 MB, VmData: 190 MB, maxrss: 0.16628 MB Old catalog: 41 New catalog: 45 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/metrics/cus/blobs-custom-326472m59201.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/metrics/cus/all-models-custom-326472m59201.fits Stage fitblobs : Wall: 25.34 s, CPU: 0.94 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 248 MB, VmData: 274 MB, maxrss: 0.254152 MB Stage fitblobs finished: 2020-08-05T19:49:50.345592 Resources for stage fitblobs : 37.217 s worker CPU, 37.469 s worker Wall, Wall: 25.341 s, Cores in use: 1.51, Total efficiency (on 32 cores): 4.7 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T19:49:50.366027 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/tmp-legacysurvey-custom-326472m59201-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/tmp-legacysurvey-custom-326472m59201-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/tmp-legacysurvey-custom-326472m59201-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/tmp-legacysurvey-custom-326472m59201-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-resid.jpg Stage coadds : Wall: 4.82 s, CPU: 1.47 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 249 MB, VmData: 274 MB, maxrss: 0.254668 MB Stage coadds finished: 2020-08-05T19:49:55.188834 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 34.041 s worker CPU, 60.322 s worker Wall, Wall: 4.825 s, Cores in use: 7.36, Total efficiency (on 32 cores): 23.0 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T19:49:55.250735 Cut to 1 unWISE tiles Reading WISE tile 3254m591 band 1 Reading WISE tile 3254m591 band 2 Reading WISE tile 3254m591 band 4 Reading WISE tile 3254m591 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 937 MB, VmSize: 815 MB, VmRSS: 154 MB, VmData: 180 MB, maxrss: 0.196612 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 1010 MB, VmSize: 805 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.207156 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 956 MB, VmSize: 805 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.207664 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/325/3254m591/unwise-3254m591-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 864 MB, VmSize: 864 MB, VmRSS: 203 MB, VmData: 236 MB, maxrss: 0.207936 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/tmp-legacysurvey-custom-326472m59201-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/tmp-legacysurvey-custom-326472m59201-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.60 s, CPU: 0.78 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 249 MB, VmData: 274 MB, maxrss: 0.255372 MB Stage wise_forced finished: 2020-08-05T19:49:57.854411 Resources for stage wise_forced : 3.314 s worker CPU, 4.700 s worker Wall, Wall: 2.606 s, Cores in use: 1.57, Total efficiency (on 32 cores): 4.9 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T19:49:57.877087 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/coadd/cus/custom-326472m59201/legacysurvey-custom-326472m59201-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/tractor-i/cus/tractor-custom-326472m59201.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/tractor/cus/tractor-custom-326472m59201.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/tractor/cus/brick-custom-326472m59201.sha256sum Stage writecat : Wall: 3.04 s, CPU: 1.52 s, VmPeak: 1189 MB, VmSize: 1061 MB, VmRSS: 251 MB, VmData: 274 MB, maxrss: 0.388248 MB Stage writecat finished: 2020-08-05T19:50:00.915730 Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 3.041 s, Cores in use: 0.50, Total efficiency (on 32 cores): 1.6 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/326/PGC373212/PGC373212-largegalaxy-writecat.p All done: 93.594 s worker CPU, 453.337 s worker Wall, Wall: 82.952 s, Cores in use: 1.31, Total efficiency (on 32 cores): 4.1 % Finished galaxy PGC373212 in 1.425 minutes.