Started working on galaxy PGC123007 at Wed Aug  5 19:27:14 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.1330005 -44.5997639 --width 243 --height 243 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T19:27:15.458905
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '336.1330005', '-44.5997639', '--width', '243', '--height', '243', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.1330005 -44.5997639 --width 243 --height 243 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 336.1330005 -44.5997639
Starting process 64812 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB
Starting process 64813 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 64814 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 64815 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 64816 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059524 MB
Starting process 64817 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059472 MB
Starting process 64818 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059472 MB
Starting process 64819 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 64820 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 64821 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 64822 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 64823 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 64824 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 64825 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 64826 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 64827 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T19:27:16.054405
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 24 CCDs:
  c4d_140927_031350_ooi_r_ls9-N26 r expnum 362835 exptime 90.0 propid 2012B-0001 seeing 0.90 MJD 56927.133 object DES survey hex -230-430 tiling 3 
    decam/CP/V4.8.2a/CP20140926/c4d_140927_031350_ooi_r_ls9.fits.fz
  c4d_141001_022246_ooi_z_ls9-N26 z expnum 364228 exptime 90.0 propid 2012B-0001 seeing 0.94 MJD 56931.098 object DES survey hex -230-430 tiling 3 
    decam/CP/V4.8.2a/CP20140930/c4d_141001_022246_ooi_z_ls9.fits.fz
  c4d_180918_044428_ooi_z_v1-S2 z expnum 775098 exptime 90.0 propid 2012B-0001 seeing 1.17 MJD 58379.198 object DES survey hex -231-450 tiling 10 
    decam/CP/V4.1/CP20180917/c4d_180918_044428_ooi_z_v1.fits.fz
  c4d_180915_045137_ooi_r_v1-S2 r expnum 773728 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 58376.203 object DES survey hex -231-450 tiling 10 
    decam/CP/V4.1/CP20180914/c4d_180915_045137_ooi_r_v1.fits.fz
  c4d_180915_050049_ooi_g_v1-S2 g expnum 773732 exptime 90.0 propid 2012B-0001 seeing 1.45 MJD 58376.209 object DES survey hex -231-450 tiling 10 
    decam/CP/V4.1/CP20180914/c4d_180915_050049_ooi_g_v1.fits.fz
  c4d_140915_040251_ooi_g_ls9-N15 g expnum 359209 exptime 90.0 propid 2012B-0001 seeing 1.51 MJD 56915.167 object DES survey hex -231-450 tiling 4 
    decam/CP/V4.8.2a/CP20140914/c4d_140915_040251_ooi_g_ls9.fits.fz
  c4d_140904_041809_ooi_z_ls9-N15 z expnum 355326 exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 56904.178 object DES survey hex -231-450 tiling 4 
    decam/CP/V4.8.2a/CP20140903/c4d_140904_041809_ooi_z_ls9.fits.fz
  c4d_141022_023036_ooi_r_ls9-N15 r expnum 370173 exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 56952.103 object DES survey hex -231-450 tiling 4 
    decam/CP/V4.8.2a/CP20141021/c4d_141022_023036_ooi_r_ls9.fits.fz
  c4d_150913_032424_ooi_g_ls9-S2 g expnum 474280 exptime 90.0 propid 2012B-0001 seeing 1.21 MJD 57278.140 object DES survey hex -231-450 tiling 5 
    decam/CP/V4.8.2a/CP20150912/c4d_150913_032424_ooi_g_ls9.fits.fz
  c4d_150913_032023_ooi_r_ls9-S2 r expnum 474278 exptime 90.0 propid 2012B-0001 seeing 1.16 MJD 57278.138 object DES survey hex -231-450 tiling 5 
    decam/CP/V4.8.2a/CP20150912/c4d_150913_032023_ooi_r_ls9.fits.fz
  c4d_151017_012249_ooi_z_ls9-S2 z expnum 484820 exptime 90.0 propid 2012B-0001 seeing 1.27 MJD 57312.056 object DES survey hex -231-450 tiling 5 
    decam/CP/V4.8.2a/CP20151016/c4d_151017_012249_ooi_z_ls9.fits.fz
  c4d_140822_050146_ooi_g_ls9-N5 g expnum 350856 exptime 90.0 propid 2012B-0001 seeing 1.23 MJD 56891.208 object DES survey hex -231-450 tiling 2 
    decam/CP/V4.8.2a/CP20140821/c4d_140822_050146_ooi_g_ls9.fits.fz
  c4d_140926_025215_ooi_r_ls9-N5 r expnum 362382 exptime 90.0 propid 2012B-0001 seeing 0.88 MJD 56926.118 object DES survey hex -231-450 tiling 2 
    decam/CP/V4.8.2a/CP20140925/c4d_140926_025215_ooi_r_ls9.fits.fz
  c4d_141028_022323_ooi_z_ls9-N5 z expnum 372062 exptime 90.0 propid 2012B-0001 seeing 0.87 MJD 56958.098 object DES survey hex -231-450 tiling 2 
    decam/CP/V4.8.2a/CP20141027/c4d_141028_022323_ooi_z_ls9.fits.fz
  c4d_160924_022947_ooi_r_ls9-N4 r expnum 576496 exptime 90.0 propid 2012B-0001 seeing 0.93 MJD 57655.102 object DES survey hex -231-450 tiling 6 
    decam/CP/V4.8.2a/CP20160923/c4d_160924_022947_ooi_r_ls9.fits.fz
  c4d_160924_023144_ooi_g_ls9-N4 g expnum 576497 exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 57655.104 object DES survey hex -231-450 tiling 6 
    decam/CP/V4.8.2a/CP20160923/c4d_160924_023144_ooi_g_ls9.fits.fz
  c4d_160928_021348_ooi_z_ls9-N4 z expnum 578174 exptime 90.0 propid 2012B-0001 seeing 0.82 MJD 57659.091 object DES survey hex -231-450 tiling 6 
    decam/CP/V4.8.2a/CP20160927/c4d_160928_021348_ooi_z_ls9.fits.fz
  c4d_160912_013054_ooi_z_ls9-N4 z expnum 573769 exptime 90.0 propid 2012B-0001 seeing 1.52 MJD 57643.062 object DES survey hex -231-450 tiling 6 
    decam/CP/V4.8.2a/CP20160911/c4d_160912_013054_ooi_z_ls9.fits.fz
  c4d_140912_035445_ooi_z_ls9-S15 z expnum 358477 exptime 90.0 propid 2012B-0001 seeing 1.02 MJD 56912.161 object DES survey hex -231-450 tiling 1 
    decam/CP/V4.8.2a/CP20140911/c4d_140912_035445_ooi_z_ls9.fits.fz
  c4d_140924_031051_ooi_r_ls9-S15 r expnum 361598 exptime 90.0 propid 2012B-0001 seeing 1.17 MJD 56924.131 object DES survey hex -231-450 tiling 1 
    decam/CP/V4.8.2a/CP20140923/c4d_140924_031051_ooi_r_ls9.fits.fz
  c4d_141021_034417_ooi_g_ls9-S15 g expnum 369800 exptime 90.0 propid 2012B-0001 seeing 1.04 MJD 56951.154 object DES survey hex -231-450 tiling 1 
    decam/CP/V4.8.2a/CP20141020/c4d_141021_034417_ooi_g_ls9.fits.fz
  c4d_170911_040714_ooi_z_v1-S21 z expnum 676353 exptime 90.0 propid 2012B-0001 seeing 1.27 MJD 58007.172 object DES survey hex -231-450 tiling 8 
    decam/CP/V4.1/CP20170910/c4d_170911_040714_ooi_z_v1.fits.fz
  c4d_170825_051946_ooi_g_ls9-S21 g expnum 671606 exptime 90.0 propid 2012B-0001 seeing 1.36 MJD 57990.222 object DES survey hex -231-450 tiling 8 
    decam/CP/V4.8.2a/CP20170824/c4d_170825_051946_ooi_g_ls9.fits.fz
  c4d_170825_051548_ooi_r_ls9-S21 r expnum 671604 exptime 90.0 propid 2012B-0001 seeing 1.22 MJD 57990.219 object DES survey hex -231-450 tiling 8 
    decam/CP/V4.8.2a/CP20170824/c4d_170825_051548_ooi_r_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962aa8f-g-20160924T022924_oi[N4,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962286b-z-20151017T012029_oi[S2,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180914_92a89f0-r-20180915T045137_oi[S2,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961f647-g-20150913T032200_oi[S2,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9620e86-r-20150913T031802_oi[S2,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9618ce3-z-20141028T022103_oi[N5,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96170bc-r-20140927T031130_oi[N26,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961465e-g-20140915T040031_oi[N15,noinherit][2046,4094][real]: DES sur
Clipping 40 pixels with anomalously large oow values: max 0.668382 vs median 0.0364892
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616298-z-20140904T041548_oi[N15,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c053-r-20160924T022727_oi[N4,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616998-r-20140926T024954_oi[N5,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96171a4-z-20141001T022027_oi[N26,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96137ee-g-20140822T045926_oi[N5,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180914_92a89f0-g-20180915T050049_oi[S2,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9618b69-r-20141022T022816_oi[N15,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180912_92acf38-z-20180918T044428_oi[S2,noinherit][2046,4094][real]: DES
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 0 weight-map pixels below quantization error (= median 6.66e-05)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c093-z-20160928T021124_oi[N4,noinherit][2046,4094][real]: DES surv
Zeroing out 0 weight-map pixels below quantization error (= median 0.000266)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616a63-z-20140912T035224_oi[S15,noinherit][2046,4094][real]: DES sur
Zeroing out 0 weight-map pixels below quantization error (= median 9.12e-06)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616125-r-20140924T030831_oi[S15,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9617035-g-20141021T034200_oi[S15,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170910_8f9120a-z-20170911T040714_oi[S21,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522b69-g-20170825T051946_oi[S21,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522538-r-20170825T051548_oi[S21,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b000-z-20160912T012835_oi[N4,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 64.13 s, CPU: 1.32 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 191 MB, VmData: 223 MB, maxrss: 0.195576 MB
Stage tims finished: 2020-08-05T19:28:20.187113
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c053-r-20160924T022727_oi[N4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180914_92a89f0-g-20180915T050049_oi[S2,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616998-r-20140926T024954_oi[N5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180912_92acf38-z-20180918T044428_oi[S2,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9618b69-r-20141022T022816_oi[N15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96171a4-z-20141001T022027_oi[N26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96137ee-g-20140822T045926_oi[N5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962aa8f-g-20160924T022924_oi[N4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c093-z-20160928T021124_oi[N4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962286b-z-20151017T012029_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616a63-z-20140912T035224_oi[S15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Zeroing out 0 weight-map pixels below quantization error (= median 7.12e-06)
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9620e86-r-20150913T031802_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170910_8f9120a-z-20170911T040714_oi[S21,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9618ce3-z-20141028T022103_oi[N5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9617035-g-20141021T034200_oi[S15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961465e-g-20140915T040031_oi[N15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522538-r-20170825T051548_oi[S21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96170bc-r-20140927T031130_oi[N26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522b69-g-20170825T051946_oi[S21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616298-z-20140904T041548_oi[N15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180914_92a89f0-r-20180915T045137_oi[S2,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b000-z-20160912T012835_oi[N4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Resources for stage tims : 13.184 s worker CPU, 491.391 s worker Wall, Wall: 64.134 s, Cores in use: 0.23, Total efficiency (on 16 cores): 1.4 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-tims.p
Running stage refs
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961f647-g-20150913T032200_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616125-r-20140924T030831_oi[S15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Running stage refs at 2020-08-05T19:28:20.233413
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10656.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10539.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10540.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10419.fits
Matched 4 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/metrics/cus/reference-custom-336133m44599.fits
Stage refs : Wall: 6.16 s, CPU: 2.40 s, VmPeak: 1046 MB, VmSize: 1036 MB, VmRSS: 213 MB, VmData: 245 MB, maxrss: 0.218588 MB
Stage refs finished: 2020-08-05T19:28:26.393852
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.162 s, Cores in use: 0.39, Total efficiency (on 16 cores): 2.4 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T19:28:26.465191
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/metrics/cus/outlier-mask-custom-336133m44599.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/metrics/cus/outliers-pre-custom-336133m44599.jpg
Image c4d_180915_045137_ooi_r_v1-S2 r : masking 618 positive outlier pixels and 0 negative outlier pixels
Image c4d_140924_031051_ooi_r_ls9-S15 r : masking 119 positive outlier pixels and 0 negative outlier pixels
Image c4d_170825_051548_ooi_r_ls9-S21 r : masking 771 positive outlier pixels and 0 negative outlier pixels
Image c4d_151017_012249_ooi_z_ls9-S2 z : masking 1003 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/metrics/cus/outlier-mask-custom-336133m44599.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/metrics/cus/outliers-post-custom-336133m44599.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/metrics/cus/outliers-masked-pos-custom-336133m44599.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/metrics/cus/outliers-masked-neg-custom-336133m44599.jpg
Stage outliers : Wall: 4.84 s, CPU: 4.36 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 239 MB, VmData: 266 MB, maxrss: 0.24448 MB
Stage outliers finished: 2020-08-05T19:28:31.306410
Resources for stage outliers : 1.669 s worker CPU, 1.669 s worker Wall, Wall: 4.843 s, Cores in use: 1.24, Total efficiency (on 16 cores): 7.8 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T19:28:31.362378
Stage halos : Wall: 1.06 s, CPU: 0.67 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 239 MB, VmData: 267 MB, maxrss: 0.244656 MB
Stage halos finished: 2020-08-05T19:28:32.425092
Resources for stage halos : 1.057 s worker CPU, 2.567 s worker Wall, Wall: 1.064 s, Cores in use: 1.62, Total efficiency (on 16 cores): 10.2 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T19:28:32.478604
PSF sigmas in coadd pixels: ['2.36', '2.45', '1.96', '2.00', '1.59', '1.68', '2.22']
Using average PSF sigma 2.039065679530097
Gaussian PSF norm 0.1383451227715661 vs pixelized 0.11282478
average tim pixel scale / coadd scale: 1.0010294525197534
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.46', '1.70', '1.64', '1.89', '1.43', '1.51', '1.90', '1.99']
Using average PSF sigma 1.6893383041726346
Gaussian PSF norm 0.16698537591736906 vs pixelized 0.14269865
average tim pixel scale / coadd scale: 1.0010370541895377
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.52', '1.90', '1.64', '2.06', '1.42', '1.34', '2.47', '1.65', '2.06']
Using average PSF sigma 1.784471686386554
Gaussian PSF norm 0.1580830863980268 vs pixelized 0.1326803
average tim pixel scale / coadd scale: 1.00097349508957
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.35 s, CPU: 0.33 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 240 MB, VmData: 267 MB, maxrss: 0.246256 MB
Stage fit_on_coadds finished: 2020-08-05T19:28:32.828084
Resources for stage fit_on_coadds : 0.394 s worker CPU, 0.394 s worker Wall, Wall: 0.351 s, Cores in use: 2.06, Total efficiency (on 16 cores): 12.9 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T19:28:32.849395
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 108 potential peaks
Of 108 potential peaks: 72 in veto map, 6 cut by saddle test, 0 cut by aper test, 30 kept
SED z : 30 new peaks
Found 170 potential peaks
Of 170 potential peaks: 151 in veto map, 9 cut by saddle test, 0 cut by aper test, 10 kept
SED r : 10 new peaks
Found 74 potential peaks
Of 74 potential peaks: 69 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 148 potential peaks
Of 148 potential peaks: 137 in veto map, 9 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 164 potential peaks
Of 164 potential peaks: 153 in veto map, 9 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 44 new sources
Median coadd sky for g : 3.7841088e-05
Median coadd sky for r : 0.0002769826
Median coadd sky for z : 0.0005446968
Stage srcs : Wall: 1.42 s, CPU: 1.36 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 241 MB, VmData: 267 MB, maxrss: 0.246728 MB
Stage srcs finished: 2020-08-05T19:28:34.267483
Resources for stage srcs : 0.080 s worker CPU, 0.080 s worker Wall, Wall: 1.420 s, Cores in use: 1.02, Total efficiency (on 16 cores): 6.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T19:28:34.282636
Blob 1 of 10, id: 1, sources: 38, size: 243x243, npix 37096, brick X: 0,243, Y: 0,243, one pixel: 27 0
Blob 2 of 10, id: 9, sources: 3, size: 44x35, npix 926, brick X: 31,75, Y: 208,243, one pixel: 62 208
Blob 3 of 10, id: 8, sources: 2, size: 37x27, npix 658, brick X: 41,78, Y: 177,204, one pixel: 63 177
Blob 4 of 10, id: 4, sources: 1, size: 22x33, npix 523, brick X: 221,243, Y: 11,44, one pixel: 235 11
Blob 5 of 10, id: 6, sources: 1, size: 23x29, npix 462, brick X: 220,243, Y: 47,76, one pixel: 231 47
Blob 6 of 10, id: 5, sources: 1, size: 26x26, npix 433, brick X: 191,217, Y: 28,54, one pixel: 201 28
Blob 7 of 10, id: 7, sources: 1, size: 22x29, npix 430, brick X: 0,22, Y: 146,175, one pixel: 4 146
Blob 8 of 10, id: 3, sources: 1, size: 25x26, npix 407, brick X: 117,142, Y: 7,33, one pixel: 127 7
Blob 9 of 10, id: 0, sources: 2, size: 19x19, npix 270, brick X: 0,19, Y: 0,19, one pixel: 0 0
Blob 10 of 10, id: 2, sources: 1, size: 18x18, npix 180, brick X: 205,223, Y: 6,24, one pixel: 213 6
Blob 10 finished, total: Wall: 0.06 s, CPU: 0.05 s, VmPeak: 1014 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148328 MB
Blob 4 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 952 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150076 MB
Blob 6 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150172 MB
Blob 8 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.15006 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (336.15737, -44.61605), pm (49.0, 5.7), parallax 2.145 with NanoMaggies: g=14.1, r=13.6, z=13.4
Reset brightness to NanoMaggies: g=14.1, r=13.6, z=13.4
Blob 9 finished, total: Wall: 0.91 s, CPU: 0.91 s, VmPeak: 973 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 186 MB, maxrss: 0.15586 MB
Blob 7 finished, total: Wall: 1.01 s, CPU: 1.00 s, VmPeak: 973 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148256 MB
Blob 5 finished, total: Wall: 1.08 s, CPU: 1.08 s, VmPeak: 974 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 186 MB, maxrss: 0.157136 MB
Blob 2 finished, total: Wall: 1.18 s, CPU: 1.18 s, VmPeak: 970 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148576 MB
Blob 3 finished, total: Wall: 1.26 s, CPU: 1.26 s, VmPeak: 1009 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148712 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.32394, ee1=0.0146465, ee2=-0.254494
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (336.11999, -44.59103), pm (13.7, -4.1), parallax 0.717 with NanoMaggies: g=19.9, r=18.6, z=18
Reset brightness to NanoMaggies: g=19.9, r=18.8, z=18.2
Measuring 35 iterative sources
Blob 1 finished, total: Wall: 61.54 s, CPU: 61.50 s, VmPeak: 952 MB, VmSize: 753 MB, VmRSS: 174 MB, VmData: 202 MB, maxrss: 0.178376 MB
Old catalog: 55
New catalog: 78
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/metrics/cus/blobs-custom-336133m44599.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/metrics/cus/all-models-custom-336133m44599.fits
Stage fitblobs : Wall: 62.22 s, CPU: 0.60 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 244 MB, VmData: 270 MB, maxrss: 0.250052 MB
Stage fitblobs finished: 2020-08-05T19:29:36.497810
Resources for stage fitblobs : 69.178 s worker CPU, 69.258 s worker Wall, Wall: 62.217 s, Cores in use: 1.12, Total efficiency (on 16 cores): 7.0 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T19:29:36.516491
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/tmp-legacysurvey-custom-336133m44599-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/tmp-legacysurvey-custom-336133m44599-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/tmp-legacysurvey-custom-336133m44599-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/tmp-legacysurvey-custom-336133m44599-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-resid.jpg
Stage coadds : Wall: 7.12 s, CPU: 4.72 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 245 MB, VmData: 270 MB, maxrss: 0.250568 MB
Stage coadds finished: 2020-08-05T19:29:43.636195
Resources for stage coadds : 6.681 s worker CPU, 25.278 s worker Wall, Wall: 7.121 s, Cores in use: 1.60, Total efficiency (on 16 cores): 10.0 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-05T19:29:43.653249
Cut to 2 unWISE tiles
Reading WISE tile 3350m440 band 2
Reading WISE tile 3350m440 band 1
Reading WISE tile 3350m440 band 3
Reading WISE tile 3350m440 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 3371m440 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 3371m440 band 3
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 3371m440 band 2
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 3371m440 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.24 s, CPU: 0.61 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 153 MB, VmData: 192 MB, maxrss: 0.194164 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.22 s, CPU: 0.54 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 149 MB, VmData: 187 MB, maxrss: 0.211972 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.18 s, CPU: 0.39 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 147 MB, VmData: 187 MB, maxrss: 0.207348 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.17 s, CPU: 0.34 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 147 MB, VmData: 187 MB, maxrss: 0.207624 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/tmp-legacysurvey-custom-336133m44599-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/tmp-legacysurvey-custom-336133m44599-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 6.93 s, CPU: 2.19 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 245 MB, VmData: 270 MB, maxrss: 0.251272 MB
Stage wise_forced finished: 2020-08-05T19:29:50.582890
Resources for stage wise_forced : 7.631 s worker CPU, 13.997 s worker Wall, Wall: 6.931 s, Cores in use: 1.42, Total efficiency (on 16 cores): 8.9 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T19:29:50.601295
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/tractor-i/cus/tractor-custom-336133m44599.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/tractor/cus/tractor-custom-336133m44599.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/tractor/cus/brick-custom-336133m44599.sha256sum
Stage writecat : Wall: 4.70 s, CPU: 4.52 s, VmPeak: 1178 MB, VmSize: 1050 MB, VmRSS: 247 MB, VmData: 270 MB, maxrss: 0.384152 MB
Stage writecat finished: 2020-08-05T19:29:55.300779
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.701 s, Cores in use: 0.96, Total efficiency (on 16 cores): 6.0 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-writecat.p
All done: 99.877 s worker CPU, 604.637 s worker Wall, Wall: 159.281 s, Cores in use: 0.77, Total efficiency (on 16 cores): 4.8 %
Finished galaxy PGC123007 in 2.693 minutes.
Started working on galaxy PGC123007 at Wed Aug  5 20:06:51 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.1330005 -44.5997639 --width 243 --height 243 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T20:06:52.580141
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '336.1330005', '-44.5997639', '--width', '243', '--height', '243', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.1330005 -44.5997639 --width 243 --height 243 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 336.1330005 -44.5997639
Starting process 8024 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 8025 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 8026 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 8027 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 8028 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0594 MB
Starting process 8029 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059348 MB
Starting process 8030 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059348 MB
Starting process 8031 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 8032 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 8033 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 8034 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 8035 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 8036 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 8037 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 8038 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 8039 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 8040 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 8041 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 8042 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 8043 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 8044 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 8045 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 8046 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 8047 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 8048 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 8051 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 8050 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 8049 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 8052 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 8053 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 8054 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 8055 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T20:06:53.252410
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 24 CCDs:
  c4d_140927_031350_ooi_r_ls9-N26 r expnum 362835 exptime 90.0 propid 2012B-0001 seeing 0.90 MJD 56927.133 object DES survey hex -230-430 tiling 3 
    decam/CP/V4.8.2a/CP20140926/c4d_140927_031350_ooi_r_ls9.fits.fz
  c4d_141001_022246_ooi_z_ls9-N26 z expnum 364228 exptime 90.0 propid 2012B-0001 seeing 0.94 MJD 56931.098 object DES survey hex -230-430 tiling 3 
    decam/CP/V4.8.2a/CP20140930/c4d_141001_022246_ooi_z_ls9.fits.fz
  c4d_180918_044428_ooi_z_v1-S2 z expnum 775098 exptime 90.0 propid 2012B-0001 seeing 1.17 MJD 58379.198 object DES survey hex -231-450 tiling 10 
    decam/CP/V4.1/CP20180917/c4d_180918_044428_ooi_z_v1.fits.fz
  c4d_180915_045137_ooi_r_v1-S2 r expnum 773728 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 58376.203 object DES survey hex -231-450 tiling 10 
    decam/CP/V4.1/CP20180914/c4d_180915_045137_ooi_r_v1.fits.fz
  c4d_180915_050049_ooi_g_v1-S2 g expnum 773732 exptime 90.0 propid 2012B-0001 seeing 1.45 MJD 58376.209 object DES survey hex -231-450 tiling 10 
    decam/CP/V4.1/CP20180914/c4d_180915_050049_ooi_g_v1.fits.fz
  c4d_140915_040251_ooi_g_ls9-N15 g expnum 359209 exptime 90.0 propid 2012B-0001 seeing 1.51 MJD 56915.167 object DES survey hex -231-450 tiling 4 
    decam/CP/V4.8.2a/CP20140914/c4d_140915_040251_ooi_g_ls9.fits.fz
  c4d_140904_041809_ooi_z_ls9-N15 z expnum 355326 exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 56904.178 object DES survey hex -231-450 tiling 4 
    decam/CP/V4.8.2a/CP20140903/c4d_140904_041809_ooi_z_ls9.fits.fz
  c4d_141022_023036_ooi_r_ls9-N15 r expnum 370173 exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 56952.103 object DES survey hex -231-450 tiling 4 
    decam/CP/V4.8.2a/CP20141021/c4d_141022_023036_ooi_r_ls9.fits.fz
  c4d_150913_032424_ooi_g_ls9-S2 g expnum 474280 exptime 90.0 propid 2012B-0001 seeing 1.21 MJD 57278.140 object DES survey hex -231-450 tiling 5 
    decam/CP/V4.8.2a/CP20150912/c4d_150913_032424_ooi_g_ls9.fits.fz
  c4d_150913_032023_ooi_r_ls9-S2 r expnum 474278 exptime 90.0 propid 2012B-0001 seeing 1.16 MJD 57278.138 object DES survey hex -231-450 tiling 5 
    decam/CP/V4.8.2a/CP20150912/c4d_150913_032023_ooi_r_ls9.fits.fz
  c4d_151017_012249_ooi_z_ls9-S2 z expnum 484820 exptime 90.0 propid 2012B-0001 seeing 1.27 MJD 57312.056 object DES survey hex -231-450 tiling 5 
    decam/CP/V4.8.2a/CP20151016/c4d_151017_012249_ooi_z_ls9.fits.fz
  c4d_140822_050146_ooi_g_ls9-N5 g expnum 350856 exptime 90.0 propid 2012B-0001 seeing 1.23 MJD 56891.208 object DES survey hex -231-450 tiling 2 
    decam/CP/V4.8.2a/CP20140821/c4d_140822_050146_ooi_g_ls9.fits.fz
  c4d_140926_025215_ooi_r_ls9-N5 r expnum 362382 exptime 90.0 propid 2012B-0001 seeing 0.88 MJD 56926.118 object DES survey hex -231-450 tiling 2 
    decam/CP/V4.8.2a/CP20140925/c4d_140926_025215_ooi_r_ls9.fits.fz
  c4d_141028_022323_ooi_z_ls9-N5 z expnum 372062 exptime 90.0 propid 2012B-0001 seeing 0.87 MJD 56958.098 object DES survey hex -231-450 tiling 2 
    decam/CP/V4.8.2a/CP20141027/c4d_141028_022323_ooi_z_ls9.fits.fz
  c4d_160924_022947_ooi_r_ls9-N4 r expnum 576496 exptime 90.0 propid 2012B-0001 seeing 0.93 MJD 57655.102 object DES survey hex -231-450 tiling 6 
    decam/CP/V4.8.2a/CP20160923/c4d_160924_022947_ooi_r_ls9.fits.fz
  c4d_160924_023144_ooi_g_ls9-N4 g expnum 576497 exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 57655.104 object DES survey hex -231-450 tiling 6 
    decam/CP/V4.8.2a/CP20160923/c4d_160924_023144_ooi_g_ls9.fits.fz
  c4d_160928_021348_ooi_z_ls9-N4 z expnum 578174 exptime 90.0 propid 2012B-0001 seeing 0.82 MJD 57659.091 object DES survey hex -231-450 tiling 6 
    decam/CP/V4.8.2a/CP20160927/c4d_160928_021348_ooi_z_ls9.fits.fz
  c4d_160912_013054_ooi_z_ls9-N4 z expnum 573769 exptime 90.0 propid 2012B-0001 seeing 1.52 MJD 57643.062 object DES survey hex -231-450 tiling 6 
    decam/CP/V4.8.2a/CP20160911/c4d_160912_013054_ooi_z_ls9.fits.fz
  c4d_140912_035445_ooi_z_ls9-S15 z expnum 358477 exptime 90.0 propid 2012B-0001 seeing 1.02 MJD 56912.161 object DES survey hex -231-450 tiling 1 
    decam/CP/V4.8.2a/CP20140911/c4d_140912_035445_ooi_z_ls9.fits.fz
  c4d_140924_031051_ooi_r_ls9-S15 r expnum 361598 exptime 90.0 propid 2012B-0001 seeing 1.17 MJD 56924.131 object DES survey hex -231-450 tiling 1 
    decam/CP/V4.8.2a/CP20140923/c4d_140924_031051_ooi_r_ls9.fits.fz
  c4d_141021_034417_ooi_g_ls9-S15 g expnum 369800 exptime 90.0 propid 2012B-0001 seeing 1.04 MJD 56951.154 object DES survey hex -231-450 tiling 1 
    decam/CP/V4.8.2a/CP20141020/c4d_141021_034417_ooi_g_ls9.fits.fz
  c4d_170911_040714_ooi_z_v1-S21 z expnum 676353 exptime 90.0 propid 2012B-0001 seeing 1.27 MJD 58007.172 object DES survey hex -231-450 tiling 8 
    decam/CP/V4.1/CP20170910/c4d_170911_040714_ooi_z_v1.fits.fz
  c4d_170825_051946_ooi_g_ls9-S21 g expnum 671606 exptime 90.0 propid 2012B-0001 seeing 1.36 MJD 57990.222 object DES survey hex -231-450 tiling 8 
    decam/CP/V4.8.2a/CP20170824/c4d_170825_051946_ooi_g_ls9.fits.fz
  c4d_170825_051548_ooi_r_ls9-S21 r expnum 671604 exptime 90.0 propid 2012B-0001 seeing 1.22 MJD 57990.219 object DES survey hex -231-450 tiling 8 
    decam/CP/V4.8.2a/CP20170824/c4d_170825_051548_ooi_r_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522538-r-20170825T051548_oi[S21,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96170bc-r-20140927T031130_oi[N26,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616298-z-20140904T041548_oi[N15,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616125-r-20140924T030831_oi[S15,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170910_8f9120a-z-20170911T040714_oi[S21,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961f647-g-20150913T032200_oi[S2,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9620e86-r-20150913T031802_oi[S2,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9618ce3-z-20141028T022103_oi[N5,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616a63-z-20140912T035224_oi[S15,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9617035-g-20141021T034200_oi[S15,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962aa8f-g-20160924T022924_oi[N4,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962286b-z-20151017T012029_oi[S2,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180914_92a89f0-g-20180915T050049_oi[S2,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961465e-g-20140915T040031_oi[N15,noinherit][2046,4094][real]: DES sur
Clipping 40 pixels with anomalously large oow values: max 0.668382 vs median 0.0364892
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522b69-g-20170825T051946_oi[S21,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c053-r-20160924T022727_oi[N4,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c093-z-20160928T021124_oi[N4,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616998-r-20140926T024954_oi[N5,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96137ee-g-20140822T045926_oi[N5,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180914_92a89f0-r-20180915T045137_oi[S2,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9618b69-r-20141022T022816_oi[N15,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96171a4-z-20141001T022027_oi[N26,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180912_92acf38-z-20180918T044428_oi[S2,noinherit][2046,4094][real]: DES
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 0 weight-map pixels below quantization error (= median 7.12e-06)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 0 weight-map pixels below quantization error (= median 0.000266)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 0 weight-map pixels below quantization error (= median 6.66e-05)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 0 weight-map pixels below quantization error (= median 9.12e-06)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b000-z-20160912T012835_oi[N4,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 68.84 s, CPU: 1.54 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 191 MB, VmData: 223 MB, maxrss: 0.19554 MB
Stage tims finished: 2020-08-05T20:08:02.093156
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522538-r-20170825T051548_oi[S21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616125-r-20140924T030831_oi[S15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170910_8f9120a-z-20170911T040714_oi[S21,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96170bc-r-20140927T031130_oi[N26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180914_92a89f0-r-20180915T045137_oi[S2,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961f647-g-20150913T032200_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9617035-g-20141021T034200_oi[S15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962286b-z-20151017T012029_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180912_92acf38-z-20180918T044428_oi[S2,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962aa8f-g-20160924T022924_oi[N4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616a63-z-20140912T035224_oi[S15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c093-z-20160928T021124_oi[N4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c053-r-20160924T022727_oi[N4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96137ee-g-20140822T045926_oi[N5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9618b69-r-20141022T022816_oi[N15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616998-r-20140926T024954_oi[N5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616298-z-20140904T041548_oi[N15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 16.690 s worker CPU, 888.998 s worker Wall, Wall: 68.843 s, Cores in use: 0.26, Total efficiency (on 32 cores): 0.8 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9620e86-r-20150913T031802_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180914_92a89f0-g-20180915T050049_oi[S2,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961465e-g-20140915T040031_oi[N15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9618ce3-z-20141028T022103_oi[N5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522b69-g-20170825T051946_oi[S21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96171a4-z-20141001T022027_oi[N26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b000-z-20160912T012835_oi[N4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T20:08:02.143634
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10656.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10539.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10540.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10419.fits
Matched 4 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/metrics/cus/reference-custom-336133m44599.fits
Stage refs : Wall: 9.66 s, CPU: 4.01 s, VmPeak: 1046 MB, VmSize: 1036 MB, VmRSS: 213 MB, VmData: 245 MB, maxrss: 0.218588 MB
Stage refs finished: 2020-08-05T20:08:11.805968
Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 9.665 s, Cores in use: 0.42, Total efficiency (on 32 cores): 1.3 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T20:08:11.856592
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/metrics/cus/outlier-mask-custom-336133m44599.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/metrics/cus/outliers-pre-custom-336133m44599.jpg
Image c4d_170825_051548_ooi_r_ls9-S21 r : masking 771 positive outlier pixels and 0 negative outlier pixels
Image c4d_180915_045137_ooi_r_v1-S2 r : masking 618 positive outlier pixels and 0 negative outlier pixels
Image c4d_140924_031051_ooi_r_ls9-S15 r : masking 119 positive outlier pixels and 0 negative outlier pixels
Image c4d_151017_012249_ooi_z_ls9-S2 z : masking 1003 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/metrics/cus/outlier-mask-custom-336133m44599.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/metrics/cus/outliers-post-custom-336133m44599.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/metrics/cus/outliers-masked-pos-custom-336133m44599.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/metrics/cus/outliers-masked-neg-custom-336133m44599.jpg
Stage outliers : Wall: 2.10 s, CPU: 1.82 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 238 MB, VmData: 266 MB, maxrss: 0.243616 MB
Stage outliers finished: 2020-08-05T20:08:13.955279
Resources for stage outliers : 1.613 s worker CPU, 1.918 s worker Wall, Wall: 2.101 s, Cores in use: 1.63, Total efficiency (on 32 cores): 5.1 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T20:08:14.011578
Stage halos : Wall: 1.20 s, CPU: 0.80 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 238 MB, VmData: 266 MB, maxrss: 0.2439 MB
Stage halos finished: 2020-08-05T20:08:15.211902
Resources for stage halos : 1.126 s worker CPU, 3.266 s worker Wall, Wall: 1.203 s, Cores in use: 1.60, Total efficiency (on 32 cores): 5.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T20:08:15.265492
PSF sigmas in coadd pixels: ['2.36', '2.45', '1.96', '2.00', '1.59', '1.68', '2.22']
Using average PSF sigma 2.039065679530097
Gaussian PSF norm 0.1383451227715661 vs pixelized 0.1128248
average tim pixel scale / coadd scale: 1.0010294525197534
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.46', '1.70', '1.64', '1.89', '1.43', '1.51', '1.90', '1.99']
Using average PSF sigma 1.6893383041726346
Gaussian PSF norm 0.16698537591736906 vs pixelized 0.14269865
average tim pixel scale / coadd scale: 1.0010370541895377
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.52', '1.90', '1.64', '2.06', '1.42', '1.34', '2.47', '1.65', '2.06']
Using average PSF sigma 1.784471686386554
Gaussian PSF norm 0.1580830863980268 vs pixelized 0.13268027
average tim pixel scale / coadd scale: 1.00097349508957
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.33 s, CPU: 0.34 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 240 MB, VmData: 267 MB, maxrss: 0.246212 MB
Stage fit_on_coadds finished: 2020-08-05T20:08:15.597349
Resources for stage fit_on_coadds : 0.375 s worker CPU, 0.376 s worker Wall, Wall: 0.334 s, Cores in use: 2.14, Total efficiency (on 32 cores): 6.7 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T20:08:15.610552
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 108 potential peaks
Of 108 potential peaks: 72 in veto map, 6 cut by saddle test, 0 cut by aper test, 30 kept
SED z : 30 new peaks
Found 170 potential peaks
Of 170 potential peaks: 151 in veto map, 9 cut by saddle test, 0 cut by aper test, 10 kept
SED r : 10 new peaks
Found 74 potential peaks
Of 74 potential peaks: 69 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 148 potential peaks
Of 148 potential peaks: 137 in veto map, 9 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 164 potential peaks
Of 164 potential peaks: 153 in veto map, 9 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 44 new sources
Median coadd sky for g : 3.7841073e-05
Median coadd sky for r : 0.00027698258
Median coadd sky for z : 0.0005446968
Stage srcs : Wall: 0.94 s, CPU: 0.91 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 241 MB, VmData: 267 MB, maxrss: 0.24678 MB
Stage srcs finished: 2020-08-05T20:08:16.550900
Resources for stage srcs : 0.066 s worker CPU, 0.066 s worker Wall, Wall: 0.943 s, Cores in use: 1.04, Total efficiency (on 32 cores): 3.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T20:08:16.567589
Blob 1 of 10, id: 1, sources: 38, size: 243x243, npix 37096, brick X: 0,243, Y: 0,243, one pixel: 27 0
Blob 2 of 10, id: 9, sources: 3, size: 44x35, npix 926, brick X: 31,75, Y: 208,243, one pixel: 62 208
Blob 3 of 10, id: 8, sources: 2, size: 37x27, npix 658, brick X: 41,78, Y: 177,204, one pixel: 63 177
Blob 4 of 10, id: 4, sources: 1, size: 22x33, npix 523, brick X: 221,243, Y: 11,44, one pixel: 235 11
Blob 5 of 10, id: 6, sources: 1, size: 23x29, npix 462, brick X: 220,243, Y: 47,76, one pixel: 231 47
Blob 6 of 10, id: 5, sources: 1, size: 26x26, npix 433, brick X: 191,217, Y: 28,54, one pixel: 201 28
Blob 7 of 10, id: 7, sources: 1, size: 22x29, npix 430, brick X: 0,22, Y: 146,175, one pixel: 4 146
Blob 8 of 10, id: 3, sources: 1, size: 25x26, npix 407, brick X: 117,142, Y: 7,33, one pixel: 127 7
Blob 9 of 10, id: 0, sources: 2, size: 19x19, npix 270, brick X: 0,19, Y: 0,19, one pixel: 0 0
Blob 10 of 10, id: 2, sources: 1, size: 18x18, npix 180, brick X: 205,223, Y: 6,24, one pixel: 213 6
Blob 10 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149404 MB
Blob 6 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149848 MB
Blob 4 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 950 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149948 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (336.15737, -44.61605), pm (49.0, 5.7), parallax 2.145 with NanoMaggies: g=14.1, r=13.6, z=13.4
Reset brightness to NanoMaggies: g=14.1, r=13.6, z=13.4
Blob 9 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147608 MB
Blob 8 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.094684 MB
Blob 7 finished, total: Wall: 0.99 s, CPU: 0.98 s, VmPeak: 952 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.15008 MB
Blob 5 finished, total: Wall: 1.03 s, CPU: 1.03 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148232 MB
Blob 3 finished, total: Wall: 1.04 s, CPU: 1.04 s, VmPeak: 951 MB, VmSize: 737 MB, VmRSS: 152 MB, VmData: 186 MB, maxrss: 0.15566 MB
Blob 2 finished, total: Wall: 1.19 s, CPU: 1.19 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.14994 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.32394, ee1=0.0146466, ee2=-0.254494
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (336.11999, -44.59103), pm (13.7, -4.1), parallax 0.717 with NanoMaggies: g=19.9, r=18.6, z=18
Reset brightness to NanoMaggies: g=19.9, r=18.8, z=18.2
Measuring 35 iterative sources
Blob 1 finished, total: Wall: 63.78 s, CPU: 63.74 s, VmPeak: 716 MB, VmSize: 716 MB, VmRSS: 152 MB, VmData: 187 MB, maxrss: 0.15536 MB
Old catalog: 55
New catalog: 78
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/metrics/cus/blobs-custom-336133m44599.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/metrics/cus/all-models-custom-336133m44599.fits
Stage fitblobs : Wall: 64.43 s, CPU: 0.62 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 244 MB, VmData: 270 MB, maxrss: 0.250104 MB
Stage fitblobs finished: 2020-08-05T20:09:20.994352
Resources for stage fitblobs : 70.989 s worker CPU, 71.166 s worker Wall, Wall: 64.429 s, Cores in use: 1.11, Total efficiency (on 32 cores): 3.5 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T20:09:21.018147
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/tmp-legacysurvey-custom-336133m44599-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/tmp-legacysurvey-custom-336133m44599-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/tmp-legacysurvey-custom-336133m44599-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/tmp-legacysurvey-custom-336133m44599-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-resid.jpg
Stage coadds : Wall: 5.57 s, CPU: 2.79 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 245 MB, VmData: 270 MB, maxrss: 0.25062 MB
Stage coadds finished: 2020-08-05T20:09:26.590633
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 19.298 s worker CPU, 35.234 s worker Wall, Wall: 5.575 s, Cores in use: 3.96, Total efficiency (on 32 cores): 12.4 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-05T20:09:26.611736
Cut to 2 unWISE tiles
Reading WISE tile 3350m440 band 2
Reading WISE tile 3350m440 band 1
Reading WISE tile 3350m440 band 3
Reading WISE tile 3350m440 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 3371m440 band 4
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 3371m440 band 2
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 3371m440 band 3
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 3371m440 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.25 s, CPU: 0.63 s, VmPeak: 1015 MB, VmSize: 1015 MB, VmRSS: 154 MB, VmData: 193 MB, maxrss: 0.192136 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.23 s, CPU: 0.58 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 147 MB, VmData: 187 MB, maxrss: 0.207256 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.20 s, CPU: 0.42 s, VmPeak: 1010 MB, VmSize: 1009 MB, VmRSS: 148 MB, VmData: 187 MB, maxrss: 0.207972 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.17 s, CPU: 0.34 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 142 MB, VmData: 185 MB, maxrss: 0.19898 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/tmp-legacysurvey-custom-336133m44599-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/tmp-legacysurvey-custom-336133m44599-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 10.69 s, CPU: 6.69 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 245 MB, VmData: 270 MB, maxrss: 0.251324 MB
Stage wise_forced finished: 2020-08-05T20:09:37.302267
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 7.948 s worker CPU, 12.896 s worker Wall, Wall: 10.693 s, Cores in use: 1.37, Total efficiency (on 32 cores): 4.3 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T20:09:37.335881
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/coadd/cus/custom-336133m44599/legacysurvey-custom-336133m44599-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/tractor-i/cus/tractor-custom-336133m44599.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/tractor/cus/tractor-custom-336133m44599.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/tractor/cus/brick-custom-336133m44599.sha256sum
Stage writecat : Wall: 8.70 s, CPU: 8.18 s, VmPeak: 1178 MB, VmSize: 1050 MB, VmRSS: 247 MB, VmData: 270 MB, maxrss: 0.384204 MB
Stage writecat finished: 2020-08-05T20:09:46.037002
Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 8.703 s, Cores in use: 0.94, Total efficiency (on 32 cores): 2.9 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC123007/PGC123007-largegalaxy-writecat.p
All done: 118.111 s worker CPU, 1013.927 s worker Wall, Wall: 172.812 s, Cores in use: 0.85, Total efficiency (on 32 cores): 2.6 %
Finished galaxy PGC123007 in 2.914 minutes.
Started working on galaxy PGC123007 at Mon Aug 10 07:57:47 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.13282062128604 -44.59930032393866 --width 243 --height 243 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/PGC123007-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/PGC123007-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-10T07:57:48.981565
legacypipe git version: DR9.5.11-watershed-6-g6a2880fc
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '336.13282062128604', '-44.59930032393866', '--width', '243', '--height', '243', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/PGC123007-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/PGC123007-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.13282062128604 -44.59930032393866 --width 243 --height 243 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/PGC123007-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/PGC123007-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 336.13282062128604 -44.59930032393866
Starting process 2384 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05922 MB
Starting process 2386 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB
Starting process 2390 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB
Starting process 2393 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB
Starting process 2399 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 2403 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 2406 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 2411 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-10T07:57:49.493159
Keeping 24 CCDs:
  c4d_140927_031350_ooi_r_ls9-N26 r expnum 362835 exptime 90.0 propid 2012B-0001 seeing 0.90 MJD 56927.133 object DES survey hex -230-430 tiling 3 
    decam/CP/V4.8.2a/CP20140926/c4d_140927_031350_ooi_r_ls9.fits.fz
  c4d_141001_022246_ooi_z_ls9-N26 z expnum 364228 exptime 90.0 propid 2012B-0001 seeing 0.94 MJD 56931.098 object DES survey hex -230-430 tiling 3 
    decam/CP/V4.8.2a/CP20140930/c4d_141001_022246_ooi_z_ls9.fits.fz
  c4d_180918_044428_ooi_z_v1-S2 z expnum 775098 exptime 90.0 propid 2012B-0001 seeing 1.17 MJD 58379.198 object DES survey hex -231-450 tiling 10 
    decam/CP/V4.1/CP20180917/c4d_180918_044428_ooi_z_v1.fits.fz
  c4d_180915_045137_ooi_r_v1-S2 r expnum 773728 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 58376.203 object DES survey hex -231-450 tiling 10 
    decam/CP/V4.1/CP20180914/c4d_180915_045137_ooi_r_v1.fits.fz
  c4d_180915_050049_ooi_g_v1-S2 g expnum 773732 exptime 90.0 propid 2012B-0001 seeing 1.45 MJD 58376.209 object DES survey hex -231-450 tiling 10 
    decam/CP/V4.1/CP20180914/c4d_180915_050049_ooi_g_v1.fits.fz
  c4d_140915_040251_ooi_g_ls9-N15 g expnum 359209 exptime 90.0 propid 2012B-0001 seeing 1.51 MJD 56915.167 object DES survey hex -231-450 tiling 4 
    decam/CP/V4.8.2a/CP20140914/c4d_140915_040251_ooi_g_ls9.fits.fz
  c4d_140904_041809_ooi_z_ls9-N15 z expnum 355326 exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 56904.178 object DES survey hex -231-450 tiling 4 
    decam/CP/V4.8.2a/CP20140903/c4d_140904_041809_ooi_z_ls9.fits.fz
  c4d_141022_023036_ooi_r_ls9-N15 r expnum 370173 exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 56952.103 object DES survey hex -231-450 tiling 4 
    decam/CP/V4.8.2a/CP20141021/c4d_141022_023036_ooi_r_ls9.fits.fz
  c4d_150913_032424_ooi_g_ls9-S2 g expnum 474280 exptime 90.0 propid 2012B-0001 seeing 1.21 MJD 57278.140 object DES survey hex -231-450 tiling 5 
    decam/CP/V4.8.2a/CP20150912/c4d_150913_032424_ooi_g_ls9.fits.fz
  c4d_150913_032023_ooi_r_ls9-S2 r expnum 474278 exptime 90.0 propid 2012B-0001 seeing 1.16 MJD 57278.138 object DES survey hex -231-450 tiling 5 
    decam/CP/V4.8.2a/CP20150912/c4d_150913_032023_ooi_r_ls9.fits.fz
  c4d_151017_012249_ooi_z_ls9-S2 z expnum 484820 exptime 90.0 propid 2012B-0001 seeing 1.27 MJD 57312.056 object DES survey hex -231-450 tiling 5 
    decam/CP/V4.8.2a/CP20151016/c4d_151017_012249_ooi_z_ls9.fits.fz
  c4d_140822_050146_ooi_g_ls9-N5 g expnum 350856 exptime 90.0 propid 2012B-0001 seeing 1.23 MJD 56891.208 object DES survey hex -231-450 tiling 2 
    decam/CP/V4.8.2a/CP20140821/c4d_140822_050146_ooi_g_ls9.fits.fz
  c4d_140926_025215_ooi_r_ls9-N5 r expnum 362382 exptime 90.0 propid 2012B-0001 seeing 0.88 MJD 56926.118 object DES survey hex -231-450 tiling 2 
    decam/CP/V4.8.2a/CP20140925/c4d_140926_025215_ooi_r_ls9.fits.fz
  c4d_141028_022323_ooi_z_ls9-N5 z expnum 372062 exptime 90.0 propid 2012B-0001 seeing 0.87 MJD 56958.098 object DES survey hex -231-450 tiling 2 
    decam/CP/V4.8.2a/CP20141027/c4d_141028_022323_ooi_z_ls9.fits.fz
  c4d_160924_022947_ooi_r_ls9-N4 r expnum 576496 exptime 90.0 propid 2012B-0001 seeing 0.93 MJD 57655.102 object DES survey hex -231-450 tiling 6 
    decam/CP/V4.8.2a/CP20160923/c4d_160924_022947_ooi_r_ls9.fits.fz
  c4d_160924_023144_ooi_g_ls9-N4 g expnum 576497 exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 57655.104 object DES survey hex -231-450 tiling 6 
    decam/CP/V4.8.2a/CP20160923/c4d_160924_023144_ooi_g_ls9.fits.fz
  c4d_160928_021348_ooi_z_ls9-N4 z expnum 578174 exptime 90.0 propid 2012B-0001 seeing 0.82 MJD 57659.091 object DES survey hex -231-450 tiling 6 
    decam/CP/V4.8.2a/CP20160927/c4d_160928_021348_ooi_z_ls9.fits.fz
  c4d_160912_013054_ooi_z_ls9-N4 z expnum 573769 exptime 90.0 propid 2012B-0001 seeing 1.52 MJD 57643.062 object DES survey hex -231-450 tiling 6 
    decam/CP/V4.8.2a/CP20160911/c4d_160912_013054_ooi_z_ls9.fits.fz
  c4d_140912_035445_ooi_z_ls9-S15 z expnum 358477 exptime 90.0 propid 2012B-0001 seeing 1.02 MJD 56912.161 object DES survey hex -231-450 tiling 1 
    decam/CP/V4.8.2a/CP20140911/c4d_140912_035445_ooi_z_ls9.fits.fz
  c4d_140924_031051_ooi_r_ls9-S15 r expnum 361598 exptime 90.0 propid 2012B-0001 seeing 1.17 MJD 56924.131 object DES survey hex -231-450 tiling 1 
    decam/CP/V4.8.2a/CP20140923/c4d_140924_031051_ooi_r_ls9.fits.fz
  c4d_141021_034417_ooi_g_ls9-S15 g expnum 369800 exptime 90.0 propid 2012B-0001 seeing 1.04 MJD 56951.154 object DES survey hex -231-450 tiling 1 
    decam/CP/V4.8.2a/CP20141020/c4d_141021_034417_ooi_g_ls9.fits.fz
  c4d_170911_040714_ooi_z_v1-S21 z expnum 676353 exptime 90.0 propid 2012B-0001 seeing 1.27 MJD 58007.172 object DES survey hex -231-450 tiling 8 
    decam/CP/V4.1/CP20170910/c4d_170911_040714_ooi_z_v1.fits.fz
  c4d_170825_051946_ooi_g_ls9-S21 g expnum 671606 exptime 90.0 propid 2012B-0001 seeing 1.36 MJD 57990.222 object DES survey hex -231-450 tiling 8 
    decam/CP/V4.8.2a/CP20170824/c4d_170825_051946_ooi_g_ls9.fits.fz
  c4d_170825_051548_ooi_r_ls9-S21 r expnum 671604 exptime 90.0 propid 2012B-0001 seeing 1.22 MJD 57990.219 object DES survey hex -231-450 tiling 8 
    decam/CP/V4.8.2a/CP20170824/c4d_170825_051548_ooi_r_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961465e-g-20140915T040031_oi[N15,noinherit][2046,4094][real]: DES sur
Clipping 40 pixels with anomalously large oow values: max 0.668382 vs median 0.0364892
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180914_92a89f0-r-20180915T045137_oi[S2,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616298-z-20140904T041548_oi[N15,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9618b69-r-20141022T022816_oi[N15,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96170bc-r-20140927T031130_oi[N26,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180912_92acf38-z-20180918T044428_oi[S2,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96171a4-z-20141001T022027_oi[N26,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180914_92a89f0-g-20180915T050049_oi[S2,noinherit][2046,4094][real]: DES
Zeroing out 0 weight-map pixels below quantization error (= median 6.66e-05)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961f647-g-20150913T032200_oi[S2,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962286b-z-20151017T012029_oi[S2,noinherit][2046,4094][real]: DES surv
Zeroing out 0 weight-map pixels below quantization error (= median 9.12e-06)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96137ee-g-20140822T045926_oi[N5,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9620e86-r-20150913T031802_oi[S2,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616998-r-20140926T024954_oi[N5,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9618ce3-z-20141028T022103_oi[N5,noinherit][2046,4094][real]: DES surv
Zeroing out 0 weight-map pixels below quantization error (= median 0.000266)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c053-r-20160924T022727_oi[N4,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962aa8f-g-20160924T022924_oi[N4,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616a63-z-20140912T035224_oi[S15,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c093-z-20160928T021124_oi[N4,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616125-r-20140924T030831_oi[S15,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170910_8f9120a-z-20170911T040714_oi[S21,noinherit][2046,4094][real]: DE
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9617035-g-20141021T034200_oi[S15,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522b69-g-20170825T051946_oi[S21,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522538-r-20170825T051548_oi[S21,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b000-z-20160912T012835_oi[N4,noinherit][2046,4094][real]: DES surv
Stage tims : Wall: 110.90 s, CPU: 0.92 s, VmPeak: 1008 MB, VmSize: 1008 MB, VmRSS: 189 MB, VmData: 223 MB, maxrss: 0.193676 MB
Stage tims finished: 2020-08-10T07:59:40.397052
Warning: splinesky does not have sky-template version/run/scale values
Zeroing out 0 weight-map pixels below quantization error (= median 7.12e-06)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9618b69-r-20141022T022816_oi[N15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962286b-z-20151017T012029_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616125-r-20140924T030831_oi[S15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180914_92a89f0-g-20180915T050049_oi[S2,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c053-r-20160924T022727_oi[N4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170910_8f9120a-z-20170911T040714_oi[S21,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180912_92acf38-z-20180918T044428_oi[S2,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96137ee-g-20140822T045926_oi[N5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c093-z-20160928T021124_oi[N4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96171a4-z-20141001T022027_oi[N26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9618ce3-z-20141028T022103_oi[N5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9617035-g-20141021T034200_oi[S15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616298-z-20140904T041548_oi[N15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180914_92a89f0-r-20180915T045137_oi[S2,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961f647-g-20150913T032200_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962aa8f-g-20160924T022924_oi[N4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522b69-g-20170825T051946_oi[S21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961465e-g-20140915T040031_oi[N15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9620e86-r-20150913T031802_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b000-z-20160912T012835_oi[N4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Resources for stage tims : 9.148 s worker CPU, 749.340 s worker Wall, Wall: 110.905 s, Cores in use: 0.09, Total efficiency (on 8 cores): 1.1 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/PGC123007-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/PGC123007-largegalaxy-tims.p
Running stage refs
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96170bc-r-20140927T031130_oi[N26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616998-r-20140926T024954_oi[N5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616a63-z-20140912T035224_oi[S15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522538-r-20170825T051548_oi[S21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Running stage refs at 2020-08-10T07:59:40.745137
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10656.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10539.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10540.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10419.fits
Matched 4 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/metrics/cus/reference-custom-336132m44599.fits
Stage refs : Wall: 9.11 s, CPU: 2.06 s, VmPeak: 1039 MB, VmSize: 1029 MB, VmRSS: 211 MB, VmData: 244 MB, maxrss: 0.21656 MB
Stage refs finished: 2020-08-10T07:59:49.859041
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.115 s, Cores in use: 0.23, Total efficiency (on 8 cores): 2.8 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/PGC123007-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/PGC123007-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-10T07:59:49.907720
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/metrics/cus/outlier-mask-custom-336132m44599.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/metrics/cus/outliers-pre-custom-336132m44599.jpg
Image c4d_180915_045137_ooi_r_v1-S2 r : masking 626 positive outlier pixels and 0 negative outlier pixels
Image c4d_160924_022947_ooi_r_ls9-N4 r : masking 209 positive outlier pixels and 0 negative outlier pixels
Image c4d_170825_051548_ooi_r_ls9-S21 r : masking 751 positive outlier pixels and 0 negative outlier pixels
Image c4d_151017_012249_ooi_z_ls9-S2 z : masking 1013 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/metrics/cus/outlier-mask-custom-336132m44599.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/metrics/cus/outliers-post-custom-336132m44599.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/metrics/cus/outliers-masked-pos-custom-336132m44599.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/metrics/cus/outliers-masked-neg-custom-336132m44599.jpg
Stage outliers : Wall: 1.57 s, CPU: 1.38 s, VmPeak: 1039 MB, VmSize: 1039 MB, VmRSS: 234 MB, VmData: 264 MB, maxrss: 0.240048 MB
Stage outliers finished: 2020-08-10T07:59:51.478844
Resources for stage outliers : 1.870 s worker CPU, 1.871 s worker Wall, Wall: 1.572 s, Cores in use: 2.07, Total efficiency (on 8 cores): 25.8 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/PGC123007-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/PGC123007-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-10T07:59:51.774121
Stage halos : Wall: 0.95 s, CPU: 0.22 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 235 MB, VmData: 264 MB, maxrss: 0.24042 MB
Stage halos finished: 2020-08-10T07:59:52.728282
Resources for stage halos : 0.855 s worker CPU, 3.653 s worker Wall, Wall: 0.955 s, Cores in use: 1.13, Total efficiency (on 8 cores): 14.1 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/PGC123007-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/PGC123007-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-10T07:59:52.776275
PSF sigmas in coadd pixels: ['2.36', '2.45', '1.96', '2.00', '1.59', '1.68', '2.22']
Using average PSF sigma 2.039065679530097
Gaussian PSF norm 0.1383451227715661 vs pixelized 0.11282298
average tim pixel scale / coadd scale: 1.0010294525197534
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.46', '1.70', '1.64', '1.89', '1.43', '1.51', '1.90', '1.99']
Using average PSF sigma 1.6893383041726346
Gaussian PSF norm 0.16698537591736906 vs pixelized 0.14270326
average tim pixel scale / coadd scale: 1.0010370541895377
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.52', '1.90', '1.64', '2.06', '1.42', '1.34', '2.47', '1.65', '2.06']
Using average PSF sigma 1.784471686386554
Gaussian PSF norm 0.1580830863980268 vs pixelized 0.13268165
average tim pixel scale / coadd scale: 1.00097349508957
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.34 s, CPU: 0.33 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 236 MB, VmData: 264 MB, maxrss: 0.242016 MB
Stage fit_on_coadds finished: 2020-08-10T07:59:53.113730
Resources for stage fit_on_coadds : 0.392 s worker CPU, 0.394 s worker Wall, Wall: 0.338 s, Cores in use: 2.12, Total efficiency (on 8 cores): 26.5 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/PGC123007-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/PGC123007-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-10T07:59:53.124026
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 110 potential peaks
Of 110 potential peaks: 78 in veto map, 6 cut by saddle test, 0 cut by aper test, 26 kept
SED z : 26 new peaks
Found 175 potential peaks
Of 175 potential peaks: 151 in veto map, 11 cut by saddle test, 0 cut by aper test, 13 kept
SED r : 13 new peaks
Found 79 potential peaks
Of 79 potential peaks: 72 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 148 potential peaks
Of 148 potential peaks: 134 in veto map, 11 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 170 potential peaks
Of 170 potential peaks: 158 in veto map, 10 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 45 new sources
Median coadd sky for g : 3.8493683e-05
Median coadd sky for r : 0.0002608096
Median coadd sky for z : 0.0004717665
Stage srcs : Wall: 0.63 s, CPU: 0.60 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 237 MB, VmData: 264 MB, maxrss: 0.242536 MB
Stage srcs finished: 2020-08-10T07:59:53.757363
Resources for stage srcs : 0.064 s worker CPU, 0.064 s worker Wall, Wall: 0.634 s, Cores in use: 1.05, Total efficiency (on 8 cores): 13.2 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/PGC123007-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/PGC123007-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-10T07:59:53.773512
Blob 1 of 9, id: 0, sources: 40, size: 243x243, npix 37742, brick X: 0,243, Y: 0,243, one pixel: 76 0
Blob 2 of 9, id: 8, sources: 4, size: 50x41, npix 1298, brick X: 29,79, Y: 202,243, one pixel: 60 202
Blob 3 of 9, id: 7, sources: 2, size: 36x28, npix 668, brick X: 40,76, Y: 170,198, one pixel: 63 170
Blob 4 of 9, id: 3, sources: 1, size: 24x33, npix 578, brick X: 219,243, Y: 4,37, one pixel: 234 4
Blob 5 of 9, id: 5, sources: 1, size: 25x29, npix 485, brick X: 218,243, Y: 41,70, one pixel: 229 41
Blob 6 of 9, id: 4, sources: 1, size: 26x27, npix 454, brick X: 189,215, Y: 21,48, one pixel: 200 21
Blob 7 of 9, id: 2, sources: 1, size: 25x26, npix 416, brick X: 115,140, Y: 1,27, one pixel: 125 1
Blob 8 of 9, id: 6, sources: 1, size: 20x27, npix 369, brick X: 0,20, Y: 140,167, one pixel: 4 140
Blob 9 of 9, id: 1, sources: 1, size: 18x18, npix 180, brick X: 203,221, Y: 0,18, one pixel: 211 0
Blob 6 finished, total: Wall: 0.83 s, CPU: 0.83 s, VmPeak: 968 MB, VmSize: 725 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143768 MB
Blob 9 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 968 MB, VmSize: 725 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143768 MB
Blob 7 finished, total: Wall: 1.03 s, CPU: 1.03 s, VmPeak: 1026 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.143988 MB
Blob 4 finished, total: Wall: 1.08 s, CPU: 1.08 s, VmPeak: 955 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145344 MB
Blob 3 finished, total: Wall: 1.30 s, CPU: 1.30 s, VmPeak: 967 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.143888 MB
Blob 5 finished, total: Wall: 1.37 s, CPU: 1.37 s, VmPeak: 967 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.14604 MB
Blob 8 finished, total: Wall: 1.38 s, CPU: 1.38 s, VmPeak: 1014 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.14384 MB
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 2.70 s, CPU: 2.70 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145836 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (336.12392, -44.57204), pm (6.8, -11.3), parallax 1.213 with NanoMaggies: g=13.7, r=13.1, z=12.9
Reset brightness to NanoMaggies: g=13.7, r=13.1, z=12.9
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.765833, ee1=0.0190303, ee2=-0.226299
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (336.11999, -44.59103), pm (13.7, -4.1), parallax 0.717 with NanoMaggies: g=20.8, r=19.3, z=18.7
Reset brightness to NanoMaggies: g=19.9, r=18.8, z=18.2
Measuring 24 iterative sources
Blob 1 finished, total: Wall: 44.40 s, CPU: 44.39 s, VmPeak: 1009 MB, VmSize: 734 MB, VmRSS: 158 MB, VmData: 189 MB, maxrss: 0.161308 MB
Old catalog: 56
New catalog: 68
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/metrics/cus/blobs-custom-336132m44599.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/metrics/cus/all-models-custom-336132m44599.fits
Stage fitblobs : Wall: 44.90 s, CPU: 0.42 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 240 MB, VmData: 267 MB, maxrss: 0.245816 MB
Stage fitblobs finished: 2020-08-10T08:00:38.670299
Resources for stage fitblobs : 54.306 s worker CPU, 54.334 s worker Wall, Wall: 44.898 s, Cores in use: 1.22, Total efficiency (on 8 cores): 15.2 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/PGC123007-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/PGC123007-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-10T08:00:38.683223
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/tmp-legacysurvey-custom-336132m44599-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/tmp-legacysurvey-custom-336132m44599-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/tmp-legacysurvey-custom-336132m44599-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/tmp-legacysurvey-custom-336132m44599-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-resid.jpg
Stage coadds : Wall: 1.51 s, CPU: 0.55 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 241 MB, VmData: 267 MB, maxrss: 0.246384 MB
Stage coadds finished: 2020-08-10T08:00:40.189947
Resources for stage coadds : 4.703 s worker CPU, 5.234 s worker Wall, Wall: 1.508 s, Cores in use: 3.49, Total efficiency (on 8 cores): 43.6 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/PGC123007-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/PGC123007-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-10T08:00:40.206714
Cut to 2 unWISE tiles
Reading WISE tile 3350m440 band 1
Reading WISE tile 3350m440 band 2
Reading WISE tile 3350m440 band 3
Reading WISE tile 3350m440 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 3371m440 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 3371m440 band 3
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 3371m440 band 2
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3350m440/unwise-3350m440-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 3371m440 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.24 s, CPU: 0.64 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 155 MB, VmData: 193 MB, maxrss: 0.195224 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.20 s, CPU: 0.41 s, VmPeak: 1017 MB, VmSize: 1017 MB, VmRSS: 161 MB, VmData: 197 MB, maxrss: 0.22494 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.13 s, CPU: 0.27 s, VmPeak: 1008 MB, VmSize: 1008 MB, VmRSS: 146 MB, VmData: 187 MB, maxrss: 0.209668 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3371m440/unwise-3371m440-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.16 s, CPU: 0.35 s, VmPeak: 1072 MB, VmSize: 1008 MB, VmRSS: 148 MB, VmData: 187 MB, maxrss: 0.208632 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/tmp-legacysurvey-custom-336132m44599-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/tmp-legacysurvey-custom-336132m44599-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.61 s, CPU: 0.83 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 241 MB, VmData: 267 MB, maxrss: 0.247088 MB
Stage wise_forced finished: 2020-08-10T08:00:43.820831
Resources for stage wise_forced : 7.631 s worker CPU, 8.700 s worker Wall, Wall: 3.615 s, Cores in use: 2.34, Total efficiency (on 8 cores): 29.3 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/PGC123007-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/PGC123007-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-10T08:00:43.840188
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/coadd/cus/custom-336132m44599/legacysurvey-custom-336132m44599-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/tractor-i/cus/tractor-custom-336132m44599.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/tractor/cus/tractor-custom-336132m44599.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/tractor/cus/brick-custom-336132m44599.sha256sum
Stage writecat : Wall: 1.14 s, CPU: 0.93 s, VmPeak: 1172 MB, VmSize: 1044 MB, VmRSS: 243 MB, VmData: 267 MB, maxrss: 0.379944 MB
Stage writecat finished: 2020-08-10T08:00:44.979901
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.141 s, Cores in use: 0.82, Total efficiency (on 8 cores): 10.2 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/PGC123007-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC123007/PGC123007-largegalaxy-writecat.p
All done: 78.971 s worker CPU, 823.590 s worker Wall, Wall: 175.505 s, Cores in use: 0.50, Total efficiency (on 8 cores): 6.2 %
Finished galaxy PGC123007 in 2.970 minutes.