Started working on galaxy PGC412095 at Wed Aug  5 18:53:45 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.79300049999995 -55.162540899999996 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T18:53:50.771748
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '336.79300049999995', '-55.162540899999996', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.79300049999995 -55.162540899999996 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 336.79300049999995 -55.162540899999996
Starting process 58507 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB
Starting process 58508 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 58509 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 58510 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 58511 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 58512 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 58513 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 58514 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 58515 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 58516 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 58517 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 58518 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 58519 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 58520 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 58521 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 58522 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 58523 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 58524 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 58525 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 58526 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 58527 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 58528 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 58529 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 58530 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 58531 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 58532 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 58533 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 58534 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 58535 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 58536 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 58537 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 58538 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T18:54:32.270936
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 31 CCDs:
  c4d_140915_032043_ooi_r_ls9-S6 r expnum 359189 exptime 90.0 propid 2012B-0001 seeing 1.42 MJD 56915.138 object DES survey hex -240-552 tiling 1 
    decam/CP/V4.8.2a/CP20140914/c4d_140915_032043_ooi_r_ls9.fits.fz
  c4d_131213_010910_ooi_z_ls9-S6 z expnum 263501 exptime 90.0 propid 2012B-0001 seeing 0.91 MJD 56639.046 object DES survey hex -240-552 tiling 1 
    decam/CP/V4.8.2a/CP20131212/c4d_131213_010910_ooi_z_ls9.fits.fz
  c4d_130903_052045_ooi_g_ls9-S6 g expnum 230127 exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 56538.223 object DES survey hex -240-552 tiling 1 
    decam/CP/V4.8.2a/CP20130902/c4d_130903_052045_ooi_g_ls9.fits.fz
  c4d_171015_014021_ooi_z_v1-N16 z expnum 687130 exptime 90.0 propid 2012B-0001 seeing 1.15 MJD 58041.070 object DES survey hex -240-552 tiling 9 
    decam/CP/V4.1/CP20171014/c4d_171015_014021_ooi_z_v1.fits.fz
  c4d_171015_013823_ooi_g_v1-N16 g expnum 687129 exptime 90.0 propid 2012B-0001 seeing 1.31 MJD 58041.068 object DES survey hex -240-552 tiling 9 
    decam/CP/V4.1/CP20171014/c4d_171015_013823_ooi_g_v1.fits.fz
  c4d_171015_013426_ooi_r_v1-N16 r expnum 687127 exptime 90.0 propid 2012B-0001 seeing 1.28 MJD 58041.066 object DES survey hex -240-552 tiling 9 
    decam/CP/V4.1/CP20171014/c4d_171015_013426_ooi_r_v1.fits.fz
  c4d_171014_013632_ooi_g_v1-N16 g expnum 686814 exptime 90.0 propid 2012B-0001 seeing 1.86 MJD 58040.067 object DES survey hex -240-552 tiling 9 
    decam/CP/V4.1/CP20171013/c4d_171014_013632_ooi_g_v1.fits.fz
  c4d_171014_013433_ooi_r_v1-N16 r expnum 686813 exptime 90.0 propid 2012B-0001 seeing 1.78 MJD 58040.066 object DES survey hex -240-552 tiling 9 
    decam/CP/V4.1/CP20171013/c4d_171014_013433_ooi_r_v1.fits.fz
  c4d_171014_013831_ooi_z_v1-N16 z expnum 686815 exptime 90.0 propid 2012B-0001 seeing 1.52 MJD 58040.068 object DES survey hex -240-552 tiling 9 
    decam/CP/V4.1/CP20171013/c4d_171014_013831_ooi_z_v1.fits.fz
  c4d_130913_055149_ooi_g_ls9-N9 g expnum 233559 exptime 90.0 propid 2012B-0001 seeing 1.14 MJD 56548.244 object DES survey hex -212-542 tiling 3 
    decam/CP/V4.8.2a/CP20130912/c4d_130913_055149_ooi_g_ls9.fits.fz
  c4d_130913_054722_ooi_r_ls9-N9 r expnum 233557 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 56548.241 object DES survey hex -212-542 tiling 3 
    decam/CP/V4.8.2a/CP20130912/c4d_130913_054722_ooi_r_ls9.fits.fz
  c4d_131121_021445_ooi_z_ls9-N9 z expnum 256589 exptime 90.0 propid 2012B-0001 seeing 1.14 MJD 56617.094 object DES survey hex -212-542 tiling 3 
    decam/CP/V4.8.2a/CP20131120/c4d_131121_021445_ooi_z_ls9.fits.fz
  c4d_130905_012746_ooi_g_ls9-N9 g expnum 230831 exptime 90.0 propid 2012B-0001 seeing 1.62 MJD 56540.061 object DES survey hex -212-542 tiling 3 
    decam/CP/V4.8.2a/CP20130904/c4d_130905_012746_ooi_g_ls9.fits.fz
  c4d_170926_022406_ooi_z_v1-S6 z expnum 681538 exptime 90.0 propid 2012B-0001 seeing 0.87 MJD 58022.100 object DES survey hex -240-552 tiling 8 
    decam/CP/V4.1/CP20170925/c4d_170926_022406_ooi_z_v1.fits.fz
  c4d_170924_025158_ooi_r_v1-S6 r expnum 680744 exptime 90.0 propid 2012B-0001 seeing 0.79 MJD 58020.119 object DES survey hex -240-552 tiling 8 
    decam/CP/V4.1/CP20170923/c4d_170924_025158_ooi_r_v1.fits.fz
  c4d_170924_025357_ooi_g_v1-S6 g expnum 680745 exptime 90.0 propid 2012B-0001 seeing 0.86 MJD 58020.121 object DES survey hex -240-552 tiling 8 
    decam/CP/V4.1/CP20170923/c4d_170924_025357_ooi_g_v1.fits.fz
  c4d_180915_060455_ooi_r_v1-N18 r expnum 773761 exptime 90.0 propid 2012B-0001 seeing 1.74 MJD 58376.253 object DES survey hex -240-552 tiling 10 
    decam/CP/V4.1/CP20180914/c4d_180915_060455_ooi_r_v1.fits.fz
  c4d_180915_060653_ooi_g_v1-N18 g expnum 773762 exptime 90.0 propid 2012B-0001 seeing 1.52 MJD 58376.255 object DES survey hex -240-552 tiling 10 
    decam/CP/V4.1/CP20180914/c4d_180915_060653_ooi_g_v1.fits.fz
  c4d_181018_012945_ooi_z_v1-N18 z expnum 784540 exptime 90.0 propid 2012B-0001 seeing 0.78 MJD 58409.062 object DES survey hex -240-552 tiling 10 
    decam/CP/V4.1/CP20181017/c4d_181018_012945_ooi_z_v1.fits.fz
  c4d_160928_025233_ooi_g_ls9-S20 g expnum 578193 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 57659.118 object DES survey hex -213-562 tiling 6 
    decam/CP/V4.8.2a/CP20160927/c4d_160928_025233_ooi_g_ls9.fits.fz
  c4d_160929_022100_ooi_z_ls9-S20 z expnum 578635 exptime 90.0 propid 2012B-0001 seeing 0.93 MJD 57660.096 object DES survey hex -213-562 tiling 6 
    decam/CP/V4.8.2a/CP20160928/c4d_160929_022100_ooi_z_ls9.fits.fz
  c4d_160928_025037_ooi_r_ls9-S20 r expnum 578192 exptime 90.0 propid 2012B-0001 seeing 0.97 MJD 57659.117 object DES survey hex -213-562 tiling 6 
    decam/CP/V4.8.2a/CP20160927/c4d_160928_025037_ooi_r_ls9.fits.fz
  c4d_161003_020033_ooi_r_ls9-N15 r expnum 580250 exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57664.082 object DES survey hex -240-552 tiling 7 
    decam/CP/V4.8.2a/CP20161002/c4d_161003_020033_ooi_r_ls9.fits.fz
  c4d_161003_020235_ooi_g_ls9-N15 g expnum 580251 exptime 90.0 propid 2012B-0001 seeing 1.29 MJD 57664.084 object DES survey hex -240-552 tiling 7 
    decam/CP/V4.8.2a/CP20161002/c4d_161003_020235_ooi_g_ls9.fits.fz
  c4d_170902_040125_ooi_z_v1-N15 z expnum 674345 exptime 90.0 propid 2012B-0001 seeing 0.90 MJD 57998.168 object DES survey hex -240-552 tiling 7 
    decam/CP/V4.1/CP20170901/c4d_170902_040125_ooi_z_v1.fits.fz
  c4d_131012_034519_ooi_z_ls9-S21 z expnum 243133 exptime 90.0 propid 2012B-0001 seeing 0.82 MJD 56577.156 object DES survey hex -213-562 tiling 2 
    decam/CP/V4.8.2a/CP20131011/c4d_131012_034519_ooi_z_ls9.fits.fz
  c4d_130902_030848_ooi_g_ls9-N28 g expnum 229614 exptime 90.0 propid 2012B-0001 seeing 1.54 MJD 56537.131 object DES survey hex -240-552 tiling 4 
    decam/CP/V4.8.2a/CP20130901/c4d_130902_030848_ooi_g_ls9.fits.fz
  c4d_131004_015250_ooi_r_ls9-N28 r expnum 241044 exptime 90.0 propid 2012B-0001 seeing 1.04 MJD 56569.078 object DES survey hex -240-552 tiling 4 
    decam/CP/V4.8.2a/CP20131003/c4d_131004_015250_ooi_r_ls9.fits.fz
  c4d_150815_052551_ooi_r_ls9-N12 r expnum 463798 exptime 90.0 propid 2012B-0001 seeing 1.29 MJD 57249.225 object DES survey hex -240-552 tiling 5 
    decam/CP/V4.8.2a/CP20150814/c4d_150815_052551_ooi_r_ls9.fits.fz
  c4d_150815_052748_ooi_g_ls9-N12 g expnum 463799 exptime 90.0 propid 2012B-0001 seeing 1.32 MJD 57249.226 object DES survey hex -240-552 tiling 5 
    decam/CP/V4.8.2a/CP20150814/c4d_150815_052748_ooi_g_ls9.fits.fz
  c4d_151017_015844_ooi_z_ls9-N12 z expnum 484835 exptime 90.0 propid 2012B-0001 seeing 1.09 MJD 57312.081 object DES survey hex -240-552 tiling 5 
    decam/CP/V4.8.2a/CP20151016/c4d_151017_015844_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9615034-r-20140915T031823_oi[S6,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962bb1a-g-20160928T025013_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-r-20170924T025158_oi[S6,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9632a66-z-20131012T034519_oi[S21,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-r-20171015T013426_oi[N16,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-z-20171015T014021_oi[N16,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961f0e3-r-20150815T052330_oi[N12,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c093-z-20160929T021839_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_960fe80-z-20131213T010648_oi[S6,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-r-20171014T013433_oi[N16,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-g-20171014T013632_oi[N16,noinherit][2046,4094][real]: DE
Zeroing out 235 weight-map pixels below quantization error (= median 0.000253)
Clipping 1 pixels with anomalously large oow values: max 0.0526569 vs median 0.0397265
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-z-20171014T013831_oi[N16,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9632e5d-g-20130905T012746_oi[N9,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962286b-z-20151017T015625_oi[N12,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9631ab1-g-20130902T030848_oi[N28,noinherit][2046,4094][real]: DES sur
Clipping 1 pixels with anomalously large oow values: max 0.0616437 vs median 0.047084
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_963392e-g-20130913T055149_oi[N9,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-g-20171015T013823_oi[N16,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962d774-g-20161003T020015_oi[N15,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96334f7-r-20130913T054722_oi[N9,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9635985-z-20131121T021445_oi[N9,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961cecb-g-20150815T052528_oi[N12,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-z-20170926T022406_oi[S6,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962d087-r-20160928T024814_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-g-20170924T025357_oi[S6,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9634008-r-20131004T015250_oi[N28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e768-r-20161003T015814_oi[N15,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180914_92a89f0-r-20180915T060455_oi[N18,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96324a3-g-20130903T052045_oi[S6,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180914_92a89f0-g-20180915T060653_oi[N18,noinherit][2046,4094][real]: DE
Zeroing out 0 weight-map pixels below quantization error (= median 0.000286)
Clipping 1 pixels with anomalously large oow values: max 0.0571829 vs median 0.0439666
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 235 weight-map pixels below quantization error (= median 2.46e-06)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 234 weight-map pixels below quantization error (= median 5.01e-05)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 234 weight-map pixels below quantization error (= median 4.03e-06)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 3792 weight-map pixels below quantization error (= median 4.5e-06)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 235 weight-map pixels below quantization error (= median 6.2e-05)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 3776 weight-map pixels below quantization error (= median 0.000204)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 235 weight-map pixels below quantization error (= median 0.00027)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 0 weight-map pixels below quantization error (= median 5.33e-05)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 3776 weight-map pixels below quantization error (= median 5.33e-05)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20181017_92f9aa3-z-20181018T012945_oi[N18,noinherit][2046,4094][real]: DE
Zeroing out 0 weight-map pixels below quantization error (= median 2.74e-06)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170831_8f79ebc-z-20170902T040125_oi[N15,noinherit][2046,4094][real]: DE
Zeroing out 236 weight-map pixels below quantization error (= median 4.51e-06)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 117.93 s, CPU: 17.57 s, VmPeak: 1016 MB, VmSize: 1016 MB, VmRSS: 194 MB, VmData: 226 MB, maxrss: 0.198704 MB
Stage tims finished: 2020-08-05T18:56:30.199992
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962bb1a-g-20160928T025013_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9615034-r-20140915T031823_oi[S6,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-z-20171014T013831_oi[N16,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-z-20170926T022406_oi[S6,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-g-20171014T013632_oi[N16,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-r-20170924T025158_oi[S6,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-z-20171015T014021_oi[N16,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961cecb-g-20150815T052528_oi[N12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962286b-z-20151017T015625_oi[N12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_963392e-g-20130913T055149_oi[N9,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9634008-r-20131004T015250_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c093-z-20160929T021839_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9632a66-z-20131012T034519_oi[S21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9635985-z-20131121T021445_oi[N9,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e768-r-20161003T015814_oi[N15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962d087-r-20160928T024814_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962d774-g-20161003T020015_oi[N15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180914_92a89f0-g-20180915T060653_oi[N18,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96334f7-r-20130913T054722_oi[N9,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9631ab1-g-20130902T030848_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9632e5d-g-20130905T012746_oi[N9,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96324a3-g-20130903T052045_oi[S6,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_960fe80-z-20131213T010648_oi[S6,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20181017_92f9aa3-z-20181018T012945_oi[N18,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170831_8f79ebc-z-20170902T040125_oi[N15,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 21.217 s worker CPU, 1670.899 s worker Wall, Wall: 117.931 s, Cores in use: 0.33, Total efficiency (on 32 cores): 1.0 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-g-20170924T025357_oi[S6,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-r-20171015T013426_oi[N16,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-g-20171015T013823_oi[N16,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-r-20171014T013433_oi[N16,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961f0e3-r-20150815T052330_oi[N12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Started working on galaxy PGC412095 at Wed Aug  5 18:56:40 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.79300049999995 -55.162540899999996 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 
Running stage refs at 2020-08-05T18:56:30.269736
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11177.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11269.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11270.fits
Matched 20 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/metrics/cus/reference-custom-336793m55162.fits
Stage refs : Wall: 37.91 s, CPU: 28.39 s, VmPeak: 1048 MB, VmSize: 1042 MB, VmRSS: 221 MB, VmData: 252 MB, maxrss: 0.226204 MB
Stage refs finished: 2020-08-05T18:57:08.179891
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180914_92a89f0-r-20180915T060455_oi[N18,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 37.912 s, Cores in use: 0.75, Total efficiency (on 32 cores): 2.3 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T18:57:08.306008
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/metrics/cus/outlier-mask-custom-336793m55162.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/metrics/cus/outliers-pre-custom-336793m55162.jpg
Image c4d_130905_012746_ooi_g_ls9-N9 g : masking 0 positive outlier pixels and 89 negative outlier pixels
Image c4d_180915_060653_ooi_g_v1-N18 g : masking 471 positive outlier pixels and 0 negative outlier pixels
Image c4d_130913_054722_ooi_r_ls9-N9 r : masking 322 positive outlier pixels and 0 negative outlier pixels
Image c4d_171015_013426_ooi_r_v1-N16 r : masking 0 positive outlier pixels and 140 negative outlier pixels
Image c4d_180915_060455_ooi_r_v1-N18 r : masking 0 positive outlier pixels and 137 negative outlier pixels
Image c4d_160928_025037_ooi_r_ls9-S20 r : masking 263 positive outlier pixels and 0 negative outlier pixels
Image c4d_161003_020033_ooi_r_ls9-N15 r : masking 210 positive outlier pixels and 0 negative outlier pixels
Image c4d_131213_010910_ooi_z_ls9-S6 z : masking 238 positive outlier pixels and 0 negative outlier pixels
Image c4d_171015_014021_ooi_z_v1-N16 z : masking 375 positive outlier pixels and 0 negative outlier pixels
Image c4d_181018_012945_ooi_z_v1-N18 z : masking 300 positive outlier pixels and 0 negative outlier pixels
Image c4d_131012_034519_ooi_z_ls9-S21 z : masking 300 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/metrics/cus/outlier-mask-custom-336793m55162.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/metrics/cus/outliers-post-custom-336793m55162.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/metrics/cus/outliers-masked-pos-custom-336793m55162.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/metrics/cus/outliers-masked-neg-custom-336793m55162.jpg
Stage outliers : Wall: 17.97 s, CPU: 17.60 s, VmPeak: 1052 MB, VmSize: 1052 MB, VmRSS: 246 MB, VmData: 274 MB, maxrss: 0.251792 MB
Stage outliers finished: 2020-08-05T18:57:26.278577
Resources for stage outliers : 1.657 s worker CPU, 1.711 s worker Wall, Wall: 17.975 s, Cores in use: 1.07, Total efficiency (on 32 cores): 3.3 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T18:57:26.334030
Stage halos : Wall: 9.81 s, CPU: 9.83 s, VmPeak: 1053 MB, VmSize: 1053 MB, VmRSS: 246 MB, VmData: 275 MB, maxrss: 0.252228 MB
Stage halos finished: 2020-08-05T18:57:36.148496
Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.817 s, Cores in use: 1.00, Total efficiency (on 32 cores): 3.1 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T18:57:36.206271
PSF sigmas in coadd pixels: ['1.80', '2.14', '3.02', '1.85', '2.63', '1.40', '2.47', '1.74', '2.09', '2.50', '2.14']
Using average PSF sigma 2.1626542323360702
Gaussian PSF norm 0.13043915553211813 vs pixelized 0.11107262
average tim pixel scale / coadd scale: 1.0010441592303128
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.30', '2.08', '2.89', '1.71', '1.29', '2.82', '1.57', '1.84', '1.69', '2.09']
Using average PSF sigma 2.029167833519154
Gaussian PSF norm 0.1390199406446561 vs pixelized 0.12006234
average tim pixel scale / coadd scale: 1.00105038585447
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.48', '1.87', '2.47', '1.84', '1.42', '1.26', '1.51', '1.47', '1.32', '1.78']
Using average PSF sigma 1.6422655515040172
Gaussian PSF norm 0.17177172809569713 vs pixelized 0.14514074
average tim pixel scale / coadd scale: 1.0009821529237142
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 5.02 s, CPU: 0.34 s, VmPeak: 1053 MB, VmSize: 1053 MB, VmRSS: 249 MB, VmData: 276 MB, maxrss: 0.254956 MB
Stage fit_on_coadds finished: 2020-08-05T18:57:41.222611
Resources for stage fit_on_coadds : 0.354 s worker CPU, 0.354 s worker Wall, Wall: 5.018 s, Cores in use: 0.14, Total efficiency (on 32 cores): 0.4 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-fit_on_coadds.p
Running stage srcs

runbrick.py starting at 2020-08-05T18:56:49.520281
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '336.79300049999995', '-55.162540899999996', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.79300049999995 -55.162540899999996 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 336.79300049999995 -55.162540899999996
Starting process 58798 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 58799 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 58800 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 58801 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 58802 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059528 MB
Starting process 58803 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB
Starting process 58804 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB
Starting process 58805 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 58806 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 58807 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 58808 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 58809 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 58810 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 58811 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 58812 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 58813 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Reading pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T18:57:41.243182
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 21 potential peaks
Of 21 potential peaks: 2 in veto map, 1 cut by saddle test, 0 cut by aper test, 18 kept
SED z : 18 new peaks
Found 23 potential peaks
Of 23 potential peaks: 18 in veto map, 1 cut by saddle test, 0 cut by aper test, 4 kept
SED r : 4 new peaks
Found 20 potential peaks
Of 20 potential peaks: 15 in veto map, 0 cut by saddle test, 0 cut by aper test, 5 kept
SED g : 5 new peaks
Found 34 potential peaks
Of 34 potential peaks: 26 in veto map, 1 cut by saddle test, 0 cut by aper test, 7 kept
SED Flat : 7 new peaks
Found 36 potential peaks
Of 36 potential peaks: 33 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 35 new sources
Median coadd sky for g : -0.0001288927
Median coadd sky for r : -0.00013389657
Median coadd sky for z : -0.00021518863
Stage srcs : Wall: 13.46 s, CPU: 12.82 s, VmPeak: 1053 MB, VmSize: 1053 MB, VmRSS: 250 MB, VmData: 276 MB, maxrss: 0.255532 MB
Stage srcs finished: 2020-08-05T18:57:54.699566
Resources for stage srcs : 0.061 s worker CPU, 0.061 s worker Wall, Wall: 13.458 s, Cores in use: 0.96, Total efficiency (on 32 cores): 3.0 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T18:57:54.712395
Blob 1 of 20, id: 10, sources: 13, size: 148x139, npix 8903, brick X: 70,218, Y: 58,197, one pixel: 133 58
Blob 2 of 20, id: 7, sources: 4, size: 71x68, npix 2818, brick X: 32,103, Y: 28,96, one pixel: 72 28
Blob 3 of 20, id: 11, sources: 1, size: 33x33, npix 689, brick X: 160,193, Y: 58,91, one pixel: 174 58
Blob 4 of 20, id: 15, sources: 2, size: 35x34, npix 686, brick X: 38,73, Y: 118,152, one pixel: 61 118
Blob 5 of 20, id: 1, sources: 1, size: 31x25, npix 577, brick X: 77,108, Y: 0,25, one pixel: 83 0
Blob 6 of 20, id: 9, sources: 1, size: 30x30, npix 577, brick X: 92,122, Y: 32,62, one pixel: 106 32
Blob 7 of 20, id: 19, sources: 2, size: 36x24, npix 502, brick X: 136,172, Y: 202,226, one pixel: 145 202
Blob 8 of 20, id: 5, sources: 1, size: 19x27, npix 363, brick X: 214,233, Y: 18,45, one pixel: 223 18
Blob 9 of 20, id: 16, sources: 1, size: 19x27, npix 353, brick X: 0,19, Y: 163,190, one pixel: 5 163
Blob 10 of 20, id: 4, sources: 1, size: 21x24, npix 335, brick X: 0,21, Y: 16,40, one pixel: 7 16
Blob 11 of 20, id: 12, sources: 1, size: 18x25, npix 313, brick X: 215,233, Y: 81,106, one pixel: 224 81
Blob 12 of 20, id: 18, sources: 1, size: 21x22, npix 282, brick X: 20,41, Y: 181,203, one pixel: 29 181
Blob 13 of 20, id: 14, sources: 1, size: 22x21, npix 272, brick X: 36,58, Y: 97,118, one pixel: 45 97
Blob 14 of 20, id: 17, sources: 1, size: 21x21, npix 261, brick X: 84,105, Y: 163,184, one pixel: 93 163
Blob 15 of 20, id: 6, sources: 1, size: 19x19, npix 217, brick X: 154,173, Y: 23,42, one pixel: 162 23
Blob 16 of 20, id: 13, sources: 1, size: 19x19, npix 217, brick X: 183,202, Y: 86,105, one pixel: 191 86
Blob 17 of 20, id: 2, sources: 1, size: 20x18, npix 215, brick X: 209,229, Y: 0,18, one pixel: 216 0
Blob 18 of 20, id: 0, sources: 1, size: 18x16, npix 165, brick X: 26,44, Y: 0,16, one pixel: 32 0
Blob 19 of 20, id: 3, sources: 1, size: 17x17, npix 145, brick X: 149,166, Y: 6,23, one pixel: 157 6
Blob 20 of 20, id: 8, sources: 1, size: 17x17, npix 145, brick X: 184,201, Y: 29,46, one pixel: 192 29
Blob 19 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 935 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.14848 MB
Blob 20 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148056 MB
Blob 12 finished, total: Wall: 0.20 s, CPU: 0.20 s, VmPeak: 952 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148148 MB
Blob 15 finished, total: Wall: 0.20 s, CPU: 0.19 s, VmPeak: 952 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148216 MB
Blob 13 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 1010 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148124 MB
Blob 16 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 995 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.14854 MB
Blob 14 finished, total: Wall: 0.37 s, CPU: 0.36 s, VmPeak: 943 MB, VmSize: 733 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149952 MB
Blob 7 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 996 MB, VmSize: 732 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146916 MB
Blob 11 finished, total: Wall: 0.54 s, CPU: 0.54 s, VmPeak: 954 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148252 MB
Blob 17 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 1010 MB, VmSize: 732 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146236 MB
Blob 3 finished, total: Wall: 0.61 s, CPU: 0.61 s, VmPeak: 1008 MB, VmSize: 732 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146364 MB
Blob 18 finished, total: Wall: 0.58 s, CPU: 0.58 s, VmPeak: 940 MB, VmSize: 733 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149548 MB
Blob 6 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 939 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148448 MB
Blob 9 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.092848 MB
Blob 5 finished, total: Wall: 0.78 s, CPU: 0.77 s, VmPeak: 1000 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148636 MB
Blob 8 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 937 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.14882 MB
Blob 10 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 950 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148168 MB
Blob 4 finished, total: Wall: 1.29 s, CPU: 1.29 s, VmPeak: 1016 MB, VmSize: 732 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146444 MB
Measuring 3 iterative sources
Running stage srcs at 2020-08-05T18:57:43.408037
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 21 potential peaks
Of 21 potential peaks: 2 in veto map, 1 cut by saddle test, 0 cut by aper test, 18 kept
SED z : 18 new peaks
Found 23 potential peaks
Of 23 potential peaks: 18 in veto map, 1 cut by saddle test, 0 cut by aper test, 4 kept
SED r : 4 new peaks
Found 20 potential peaks
Of 20 potential peaks: 15 in veto map, 0 cut by saddle test, 0 cut by aper test, 5 kept
SED g : 5 new peaks
Found 34 potential peaks
Of 34 potential peaks: 26 in veto map, 1 cut by saddle test, 0 cut by aper test, 7 kept
SED Flat : 7 new peaks
Found 36 potential peaks
Of 36 potential peaks: 33 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 35 new sources
Median coadd sky for g : -0.0001288927
Median coadd sky for r : -0.00013389657
Median coadd sky for z : -0.00021518863
Stage srcs : Wall: 29.88 s, CPU: 29.82 s, VmPeak: 860 MB, VmSize: 860 MB, VmRSS: 115 MB, VmData: 153 MB, maxrss: 0.11796 MB
Stage srcs finished: 2020-08-05T18:58:13.286330
Resources for stage srcs : 0.101 s worker CPU, 0.185 s worker Wall, Wall: 29.880 s, Cores in use: 1.00, Total efficiency (on 16 cores): 6.3 %
Blob 2 finished, total: Wall: 5.15 s, CPU: 5.15 s, VmPeak: 1016 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149728 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.84412, ee1=-0.379019, ee2=0.237189
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 11.10 s, CPU: 11.10 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150912 MB
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-srcs.p
Running stage fitblobs
Old catalog: 38
New catalog: 36
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/metrics/cus/blobs-custom-336793m55162.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/metrics/cus/all-models-custom-336793m55162.fits
Stage fitblobs : Wall: 26.96 s, CPU: 14.46 s, VmPeak: 1053 MB, VmSize: 1053 MB, VmRSS: 250 MB, VmData: 276 MB, maxrss: 0.255696 MB
Stage fitblobs finished: 2020-08-05T18:58:21.668035
Resources for stage fitblobs : 25.645 s worker CPU, 32.585 s worker Wall, Wall: 26.958 s, Cores in use: 1.49, Total efficiency (on 32 cores): 4.6 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T18:58:21.709187
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-blobmodel-z.fits.fz
Running stage fitblobs at 2020-08-05T18:58:21.301898
Reading /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-checkpoint.p
Keeping 20 of 20 checkpointed results
Skipping blob 10
Skipping blob 7
Skipping blob 11
Skipping blob 15
Skipping blob 1
Skipping blob 9
Skipping blob 19
Skipping blob 5
Skipping blob 16
Skipping blob 4
Skipping blob 12
Skipping blob 18
Skipping blob 14
Skipping blob 17
Skipping blob 6
Skipping blob 13
Skipping blob 2
Skipping blob 0
Skipping blob 3
Skipping blob 8
Old catalog: 38
New catalog: 36
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/metrics/cus/blobs-custom-336793m55162.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/metrics/cus/all-models-custom-336793m55162.fits
Stage fitblobs : Wall: 18.89 s, CPU: 19.03 s, VmPeak: 866 MB, VmSize: 866 MB, VmRSS: 121 MB, VmData: 158 MB, maxrss: 0.12392 MB
Stage fitblobs finished: 2020-08-05T18:58:40.194166
Resources for stage fitblobs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 18.894 s, Cores in use: 1.01, Total efficiency (on 16 cores): 6.3 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-fitblobs.p
Running stage coadds
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/tmp-legacysurvey-custom-336793m55162-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/tmp-legacysurvey-custom-336793m55162-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/tmp-legacysurvey-custom-336793m55162-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/tmp-legacysurvey-custom-336793m55162-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-resid.jpg
Stage coadds : Wall: 21.56 s, CPU: 13.27 s, VmPeak: 1053 MB, VmSize: 1053 MB, VmRSS: 250 MB, VmData: 276 MB, maxrss: 0.256208 MB
Stage coadds finished: 2020-08-05T18:58:43.270920
Resources for stage coadds : 9.877 s worker CPU, 168.779 s worker Wall, Wall: 21.564 s, Cores in use: 1.07, Total efficiency (on 32 cores): 3.4 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T18:58:43.321264
Cut to 1 unWISE tiles
Reading WISE tile 3370m546 band 1
Reading WISE tile 3370m546 band 3
Reading WISE tile 3370m546 band 2
Reading WISE tile 3370m546 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 1016 MB, VmSize: 808 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.191672 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 939 MB, VmSize: 869 MB, VmRSS: 209 MB, VmData: 238 MB, maxrss: 0.21436 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 951 MB, VmSize: 805 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.20868 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 955 MB, VmSize: 813 MB, VmRSS: 153 MB, VmData: 178 MB, maxrss: 0.217696 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/tmp-legacysurvey-custom-336793m55162-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/tmp-legacysurvey-custom-336793m55162-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 18.81 s, CPU: 15.73 s, VmPeak: 1053 MB, VmSize: 1053 MB, VmRSS: 251 MB, VmData: 276 MB, maxrss: 0.256916 MB
Stage wise_forced finished: 2020-08-05T18:59:02.134920
Resources for stage wise_forced : 3.142 s worker CPU, 5.968 s worker Wall, Wall: 18.816 s, Cores in use: 1.00, Total efficiency (on 32 cores): 3.1 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-wise_forced.p
Running stage writecat
Running stage coadds at 2020-08-05T18:58:40.208561
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-ccds.fits
Running stage writecat at 2020-08-05T18:59:02.166503
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/tractor-i/cus/tractor-custom-336793m55162.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/tractor/cus/tractor-custom-336793m55162.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/tractor/cus/brick-custom-336793m55162.sha256sum
Stage writecat : Wall: 13.37 s, CPU: 13.24 s, VmPeak: 1185 MB, VmSize: 1057 MB, VmRSS: 253 MB, VmData: 276 MB, maxrss: 0.38992 MB
Stage writecat finished: 2020-08-05T18:59:15.533278
Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 13.369 s, Cores in use: 0.99, Total efficiency (on 32 cores): 3.1 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-writecat.p
All done: 61.959 s worker CPU, 1880.365 s worker Wall, Wall: 283.284 s, Cores in use: 0.73, Total efficiency (on 32 cores): 2.3 %
Finished galaxy PGC412095 in 5.542 minutes.
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/tmp-legacysurvey-custom-336793m55162-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/tmp-legacysurvey-custom-336793m55162-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/tmp-legacysurvey-custom-336793m55162-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/tmp-legacysurvey-custom-336793m55162-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-resid.jpg
Stage coadds : Wall: 60.90 s, CPU: 30.54 s, VmPeak: 912 MB, VmSize: 912 MB, VmRSS: 150 MB, VmData: 185 MB, maxrss: 0.153292 MB
Stage coadds finished: 2020-08-05T18:59:41.105641
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 13.242 s worker CPU, 178.848 s worker Wall, Wall: 60.899 s, Cores in use: 0.72, Total efficiency (on 16 cores): 4.5 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T18:59:41.152734
Cut to 1 unWISE tiles
Reading WISE tile 3370m546 band 4
Reading WISE tile 3370m546 band 1
Reading WISE tile 3370m546 band 3
Reading WISE tile 3370m546 band 2
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 798 MB, VmSize: 798 MB, VmRSS: 138 MB, VmData: 170 MB, maxrss: 0.201012 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 804 MB, VmSize: 804 MB, VmRSS: 143 MB, VmData: 176 MB, maxrss: 0.180616 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 862 MB, VmSize: 862 MB, VmRSS: 201 MB, VmData: 234 MB, maxrss: 0.20584 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 799 MB, VmSize: 799 MB, VmRSS: 138 MB, VmData: 171 MB, maxrss: 0.197832 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/tmp-legacysurvey-custom-336793m55162-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/tmp-legacysurvey-custom-336793m55162-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 41.83 s, CPU: 21.71 s, VmPeak: 935 MB, VmSize: 935 MB, VmRSS: 156 MB, VmData: 186 MB, maxrss: 0.160228 MB
Stage wise_forced finished: 2020-08-05T19:00:22.987247
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 3.155 s worker CPU, 9.501 s worker Wall, Wall: 41.836 s, Cores in use: 0.59, Total efficiency (on 16 cores): 3.7 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T19:00:23.115183
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/coadd/cus/custom-336793m55162/legacysurvey-custom-336793m55162-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/tractor-i/cus/tractor-custom-336793m55162.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/tractor/cus/tractor-custom-336793m55162.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/tractor/cus/brick-custom-336793m55162.sha256sum
Stage writecat : Wall: 13.00 s, CPU: 12.65 s, VmPeak: 1081 MB, VmSize: 953 MB, VmRSS: 175 MB, VmData: 200 MB, maxrss: 0.310536 MB
Stage writecat finished: 2020-08-05T19:00:36.113660
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 13.000 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.1 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC412095/PGC412095-largegalaxy-writecat.p
All done: 16.500 s worker CPU, 188.536 s worker Wall, Wall: 172.729 s, Cores in use: 0.75, Total efficiency (on 16 cores): 4.7 %
No photometric CCDs touching brick.
Finished galaxy PGC412095 in 3.931 minutes.
Started working on galaxy PGC412095 at Mon Aug 10 07:36:41 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.7924235941169 -55.16281763284811 --width 233 --height 233 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-10T07:36:42.783252
legacypipe git version: DR9.5.11-watershed-6-g6a2880fc
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '336.7924235941169', '-55.16281763284811', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.7924235941169 -55.16281763284811 --width 233 --height 233 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 336.7924235941169 -55.16281763284811
Starting process 34636 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB
Starting process 34637 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 34638 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 34639 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 34640 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 34641 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 34642 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 34643 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-10T07:36:43.515125
Keeping 31 CCDs:
  c4d_140915_032043_ooi_r_ls9-S6 r expnum 359189 exptime 90.0 propid 2012B-0001 seeing 1.42 MJD 56915.138 object DES survey hex -240-552 tiling 1 
    decam/CP/V4.8.2a/CP20140914/c4d_140915_032043_ooi_r_ls9.fits.fz
  c4d_131213_010910_ooi_z_ls9-S6 z expnum 263501 exptime 90.0 propid 2012B-0001 seeing 0.91 MJD 56639.046 object DES survey hex -240-552 tiling 1 
    decam/CP/V4.8.2a/CP20131212/c4d_131213_010910_ooi_z_ls9.fits.fz
  c4d_130903_052045_ooi_g_ls9-S6 g expnum 230127 exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 56538.223 object DES survey hex -240-552 tiling 1 
    decam/CP/V4.8.2a/CP20130902/c4d_130903_052045_ooi_g_ls9.fits.fz
  c4d_171015_014021_ooi_z_v1-N16 z expnum 687130 exptime 90.0 propid 2012B-0001 seeing 1.15 MJD 58041.070 object DES survey hex -240-552 tiling 9 
    decam/CP/V4.1/CP20171014/c4d_171015_014021_ooi_z_v1.fits.fz
  c4d_171015_013823_ooi_g_v1-N16 g expnum 687129 exptime 90.0 propid 2012B-0001 seeing 1.31 MJD 58041.068 object DES survey hex -240-552 tiling 9 
    decam/CP/V4.1/CP20171014/c4d_171015_013823_ooi_g_v1.fits.fz
  c4d_171015_013426_ooi_r_v1-N16 r expnum 687127 exptime 90.0 propid 2012B-0001 seeing 1.28 MJD 58041.066 object DES survey hex -240-552 tiling 9 
    decam/CP/V4.1/CP20171014/c4d_171015_013426_ooi_r_v1.fits.fz
  c4d_171014_013632_ooi_g_v1-N16 g expnum 686814 exptime 90.0 propid 2012B-0001 seeing 1.86 MJD 58040.067 object DES survey hex -240-552 tiling 9 
    decam/CP/V4.1/CP20171013/c4d_171014_013632_ooi_g_v1.fits.fz
  c4d_171014_013433_ooi_r_v1-N16 r expnum 686813 exptime 90.0 propid 2012B-0001 seeing 1.78 MJD 58040.066 object DES survey hex -240-552 tiling 9 
    decam/CP/V4.1/CP20171013/c4d_171014_013433_ooi_r_v1.fits.fz
  c4d_171014_013831_ooi_z_v1-N16 z expnum 686815 exptime 90.0 propid 2012B-0001 seeing 1.52 MJD 58040.068 object DES survey hex -240-552 tiling 9 
    decam/CP/V4.1/CP20171013/c4d_171014_013831_ooi_z_v1.fits.fz
  c4d_130913_055149_ooi_g_ls9-N9 g expnum 233559 exptime 90.0 propid 2012B-0001 seeing 1.14 MJD 56548.244 object DES survey hex -212-542 tiling 3 
    decam/CP/V4.8.2a/CP20130912/c4d_130913_055149_ooi_g_ls9.fits.fz
  c4d_130913_054722_ooi_r_ls9-N9 r expnum 233557 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 56548.241 object DES survey hex -212-542 tiling 3 
    decam/CP/V4.8.2a/CP20130912/c4d_130913_054722_ooi_r_ls9.fits.fz
  c4d_131121_021445_ooi_z_ls9-N9 z expnum 256589 exptime 90.0 propid 2012B-0001 seeing 1.14 MJD 56617.094 object DES survey hex -212-542 tiling 3 
    decam/CP/V4.8.2a/CP20131120/c4d_131121_021445_ooi_z_ls9.fits.fz
  c4d_130905_012746_ooi_g_ls9-N9 g expnum 230831 exptime 90.0 propid 2012B-0001 seeing 1.62 MJD 56540.061 object DES survey hex -212-542 tiling 3 
    decam/CP/V4.8.2a/CP20130904/c4d_130905_012746_ooi_g_ls9.fits.fz
  c4d_170926_022406_ooi_z_v1-S6 z expnum 681538 exptime 90.0 propid 2012B-0001 seeing 0.87 MJD 58022.100 object DES survey hex -240-552 tiling 8 
    decam/CP/V4.1/CP20170925/c4d_170926_022406_ooi_z_v1.fits.fz
  c4d_170924_025158_ooi_r_v1-S6 r expnum 680744 exptime 90.0 propid 2012B-0001 seeing 0.79 MJD 58020.119 object DES survey hex -240-552 tiling 8 
    decam/CP/V4.1/CP20170923/c4d_170924_025158_ooi_r_v1.fits.fz
  c4d_170924_025357_ooi_g_v1-S6 g expnum 680745 exptime 90.0 propid 2012B-0001 seeing 0.86 MJD 58020.121 object DES survey hex -240-552 tiling 8 
    decam/CP/V4.1/CP20170923/c4d_170924_025357_ooi_g_v1.fits.fz
  c4d_180915_060455_ooi_r_v1-N18 r expnum 773761 exptime 90.0 propid 2012B-0001 seeing 1.74 MJD 58376.253 object DES survey hex -240-552 tiling 10 
    decam/CP/V4.1/CP20180914/c4d_180915_060455_ooi_r_v1.fits.fz
  c4d_180915_060653_ooi_g_v1-N18 g expnum 773762 exptime 90.0 propid 2012B-0001 seeing 1.52 MJD 58376.255 object DES survey hex -240-552 tiling 10 
    decam/CP/V4.1/CP20180914/c4d_180915_060653_ooi_g_v1.fits.fz
  c4d_181018_012945_ooi_z_v1-N18 z expnum 784540 exptime 90.0 propid 2012B-0001 seeing 0.78 MJD 58409.062 object DES survey hex -240-552 tiling 10 
    decam/CP/V4.1/CP20181017/c4d_181018_012945_ooi_z_v1.fits.fz
  c4d_160928_025233_ooi_g_ls9-S20 g expnum 578193 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 57659.118 object DES survey hex -213-562 tiling 6 
    decam/CP/V4.8.2a/CP20160927/c4d_160928_025233_ooi_g_ls9.fits.fz
  c4d_160929_022100_ooi_z_ls9-S20 z expnum 578635 exptime 90.0 propid 2012B-0001 seeing 0.93 MJD 57660.096 object DES survey hex -213-562 tiling 6 
    decam/CP/V4.8.2a/CP20160928/c4d_160929_022100_ooi_z_ls9.fits.fz
  c4d_160928_025037_ooi_r_ls9-S20 r expnum 578192 exptime 90.0 propid 2012B-0001 seeing 0.97 MJD 57659.117 object DES survey hex -213-562 tiling 6 
    decam/CP/V4.8.2a/CP20160927/c4d_160928_025037_ooi_r_ls9.fits.fz
  c4d_161003_020033_ooi_r_ls9-N15 r expnum 580250 exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57664.082 object DES survey hex -240-552 tiling 7 
    decam/CP/V4.8.2a/CP20161002/c4d_161003_020033_ooi_r_ls9.fits.fz
  c4d_161003_020235_ooi_g_ls9-N15 g expnum 580251 exptime 90.0 propid 2012B-0001 seeing 1.29 MJD 57664.084 object DES survey hex -240-552 tiling 7 
    decam/CP/V4.8.2a/CP20161002/c4d_161003_020235_ooi_g_ls9.fits.fz
  c4d_170902_040125_ooi_z_v1-N15 z expnum 674345 exptime 90.0 propid 2012B-0001 seeing 0.90 MJD 57998.168 object DES survey hex -240-552 tiling 7 
    decam/CP/V4.1/CP20170901/c4d_170902_040125_ooi_z_v1.fits.fz
  c4d_131012_034519_ooi_z_ls9-S21 z expnum 243133 exptime 90.0 propid 2012B-0001 seeing 0.82 MJD 56577.156 object DES survey hex -213-562 tiling 2 
    decam/CP/V4.8.2a/CP20131011/c4d_131012_034519_ooi_z_ls9.fits.fz
  c4d_130902_030848_ooi_g_ls9-N28 g expnum 229614 exptime 90.0 propid 2012B-0001 seeing 1.54 MJD 56537.131 object DES survey hex -240-552 tiling 4 
    decam/CP/V4.8.2a/CP20130901/c4d_130902_030848_ooi_g_ls9.fits.fz
  c4d_131004_015250_ooi_r_ls9-N28 r expnum 241044 exptime 90.0 propid 2012B-0001 seeing 1.04 MJD 56569.078 object DES survey hex -240-552 tiling 4 
    decam/CP/V4.8.2a/CP20131003/c4d_131004_015250_ooi_r_ls9.fits.fz
  c4d_150815_052551_ooi_r_ls9-N12 r expnum 463798 exptime 90.0 propid 2012B-0001 seeing 1.29 MJD 57249.225 object DES survey hex -240-552 tiling 5 
    decam/CP/V4.8.2a/CP20150814/c4d_150815_052551_ooi_r_ls9.fits.fz
  c4d_150815_052748_ooi_g_ls9-N12 g expnum 463799 exptime 90.0 propid 2012B-0001 seeing 1.32 MJD 57249.226 object DES survey hex -240-552 tiling 5 
    decam/CP/V4.8.2a/CP20150814/c4d_150815_052748_ooi_g_ls9.fits.fz
  c4d_151017_015844_ooi_z_ls9-N12 z expnum 484835 exptime 90.0 propid 2012B-0001 seeing 1.09 MJD 57312.081 object DES survey hex -240-552 tiling 5 
    decam/CP/V4.8.2a/CP20151016/c4d_151017_015844_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-r-20171015T013426_oi[N16,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-r-20171014T013433_oi[N16,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-z-20171015T014021_oi[N16,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-g-20171014T013632_oi[N16,noinherit][2046,4094][real]: DE
Zeroing out 235 weight-map pixels below quantization error (= median 0.000252)
Clipping 1 pixels with anomalously large oow values: max 0.0526569 vs median 0.0397265
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_960fe80-z-20131213T010648_oi[S6,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9615034-r-20140915T031823_oi[S6,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-g-20171015T013823_oi[N16,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96324a3-g-20130903T052045_oi[S6,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-z-20171014T013831_oi[N16,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_963392e-g-20130913T055149_oi[N9,noinherit][2046,4094][real]: DES surv
Zeroing out 235 weight-map pixels below quantization error (= median 0.00027)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9632e5d-g-20130905T012746_oi[N9,noinherit][2046,4094][real]: DES surv
Zeroing out 235 weight-map pixels below quantization error (= median 4.03e-06)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9635985-z-20131121T021445_oi[N9,noinherit][2046,4094][real]: DES surv
Zeroing out 235 weight-map pixels below quantization error (= median 6.2e-05)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96334f7-r-20130913T054722_oi[N9,noinherit][2046,4094][real]: DES surv
Zeroing out 235 weight-map pixels below quantization error (= median 5.01e-05)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-z-20170926T022406_oi[S6,noinherit][2046,4094][real]: DES
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-r-20170924T025158_oi[S6,noinherit][2046,4094][real]: DES
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-g-20170924T025357_oi[S6,noinherit][2046,4094][real]: DES
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962bb1a-g-20160928T025013_oi[S20,noinherit][2046,4094][real]: DES sur
Zeroing out 235 weight-map pixels below quantization error (= median 2.46e-06)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180914_92a89f0-r-20180915T060455_oi[N18,noinherit][2046,4094][real]: DE
Zeroing out 3792 weight-map pixels below quantization error (= median 4.51e-06)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c093-z-20160929T021839_oi[S20,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962d087-r-20160928T024814_oi[S20,noinherit][2046,4094][real]: DES sur
Zeroing out 3792 weight-map pixels below quantization error (= median 0.000204)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962d774-g-20161003T020015_oi[N15,noinherit][2046,4094][real]: DES sur
Zeroing out 3792 weight-map pixels below quantization error (= median 5.32e-05)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e768-r-20161003T015814_oi[N15,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180914_92a89f0-g-20180915T060653_oi[N18,noinherit][2046,4094][real]: DE
Zeroing out 0 weight-map pixels below quantization error (= median 0.000286)
Clipping 1 pixels with anomalously large oow values: max 0.0571829 vs median 0.0439666
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9632a66-z-20131012T034519_oi[S21,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9631ab1-g-20130902T030848_oi[N28,noinherit][2046,4094][real]: DES sur
Clipping 1 pixels with anomalously large oow values: max 0.0616437 vs median 0.047084
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9634008-r-20131004T015250_oi[N28,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961cecb-g-20150815T052528_oi[N12,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961f0e3-r-20150815T052330_oi[N12,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962286b-z-20151017T015625_oi[N12,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20181017_92f9aa3-z-20181018T012945_oi[N18,noinherit][2046,4094][real]: DE
Zeroing out 0 weight-map pixels below quantization error (= median 5.33e-05)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170831_8f79ebc-z-20170902T040125_oi[N15,noinherit][2046,4094][real]: DE
Stage tims : Wall: 208.31 s, CPU: 1.18 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 192 MB, VmData: 226 MB, maxrss: 0.19666 MB
Stage tims finished: 2020-08-10T07:40:11.829148
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-g-20171015T013823_oi[N16,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9632e5d-g-20130905T012746_oi[N9,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962d087-r-20160928T024814_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9631ab1-g-20130902T030848_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-z-20171015T014021_oi[N16,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9635985-z-20131121T021445_oi[N9,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962bb1a-g-20160928T025013_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9632a66-z-20131012T034519_oi[S21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-r-20171014T013433_oi[N16,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-z-20170926T022406_oi[S6,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c093-z-20160929T021839_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9634008-r-20131004T015250_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_960fe80-z-20131213T010648_oi[S6,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-r-20170924T025158_oi[S6,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e768-r-20161003T015814_oi[N15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961cecb-g-20150815T052528_oi[N12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96324a3-g-20130903T052045_oi[S6,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-g-20170924T025357_oi[S6,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962d774-g-20161003T020015_oi[N15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961f0e3-r-20150815T052330_oi[N12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Zeroing out 0 weight-map pixels below quantization error (= median 2.74e-06)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-g-20171014T013632_oi[N16,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_963392e-g-20130913T055149_oi[N9,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180914_92a89f0-g-20180915T060653_oi[N18,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962286b-z-20151017T015625_oi[N12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-r-20171015T013426_oi[N16,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96334f7-r-20130913T054722_oi[N9,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20181017_92f9aa3-z-20181018T012945_oi[N18,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Resources for stage tims : 10.883 s worker CPU, 1176.770 s worker Wall, Wall: 208.315 s, Cores in use: 0.06, Total efficiency (on 8 cores): 0.7 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-tims.p
Running stage refs
Zeroing out 0 weight-map pixels below quantization error (= median 4.51e-06)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9615034-r-20140915T031823_oi[S6,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-z-20171014T013831_oi[N16,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180914_92a89f0-r-20180915T060455_oi[N18,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170831_8f79ebc-z-20170902T040125_oi[N15,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Running stage refs at 2020-08-10T07:40:11.884140
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11177.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11269.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11270.fits
Matched 20 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/metrics/cus/reference-custom-336792m55162.fits
Stage refs : Wall: 9.55 s, CPU: 2.48 s, VmPeak: 1041 MB, VmSize: 1036 MB, VmRSS: 219 MB, VmData: 252 MB, maxrss: 0.22418 MB
Stage refs finished: 2020-08-10T07:40:21.433545
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.551 s, Cores in use: 0.26, Total efficiency (on 8 cores): 3.2 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-10T07:40:21.486677
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/metrics/cus/outlier-mask-custom-336792m55162.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/metrics/cus/outliers-pre-custom-336792m55162.jpg
Image c4d_130905_012746_ooi_g_ls9-N9 g : masking 0 positive outlier pixels and 78 negative outlier pixels
Image c4d_180915_060653_ooi_g_v1-N18 g : masking 455 positive outlier pixels and 0 negative outlier pixels
Image c4d_150815_052748_ooi_g_ls9-N12 g : masking 0 positive outlier pixels and 81 negative outlier pixels
Image c4d_160928_025037_ooi_r_ls9-S20 r : masking 370 positive outlier pixels and 0 negative outlier pixels
Image c4d_131213_010910_ooi_z_ls9-S6 z : masking 242 positive outlier pixels and 0 negative outlier pixels
Image c4d_171015_014021_ooi_z_v1-N16 z : masking 369 positive outlier pixels and 0 negative outlier pixels
Image c4d_181018_012945_ooi_z_v1-N18 z : masking 307 positive outlier pixels and 0 negative outlier pixels
Image c4d_131012_034519_ooi_z_ls9-S21 z : masking 296 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/metrics/cus/outlier-mask-custom-336792m55162.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/metrics/cus/outliers-post-custom-336792m55162.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/metrics/cus/outliers-masked-pos-custom-336792m55162.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/metrics/cus/outliers-masked-neg-custom-336792m55162.jpg
Stage outliers : Wall: 1.42 s, CPU: 1.19 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 241 MB, VmData: 271 MB, maxrss: 0.247168 MB
Stage outliers finished: 2020-08-10T07:40:22.902316
Resources for stage outliers : 1.981 s worker CPU, 1.984 s worker Wall, Wall: 1.417 s, Cores in use: 2.24, Total efficiency (on 8 cores): 28.0 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-10T07:40:23.263702
Stage halos : Wall: 0.63 s, CPU: 0.63 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 242 MB, VmData: 272 MB, maxrss: 0.24756 MB
Stage halos finished: 2020-08-10T07:40:23.897575
Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.635 s, Cores in use: 1.00, Total efficiency (on 8 cores): 12.5 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-10T07:40:24.208253
PSF sigmas in coadd pixels: ['1.80', '2.14', '3.02', '1.85', '2.63', '1.40', '2.47', '1.74', '2.09', '2.50', '2.14']
Using average PSF sigma 2.1626542323360702
Gaussian PSF norm 0.13043915553211813 vs pixelized 0.11107049
average tim pixel scale / coadd scale: 1.0010441592303128
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.30', '2.08', '2.89', '1.71', '1.29', '2.82', '1.57', '1.84', '1.69', '2.09']
Using average PSF sigma 2.029167833519154
Gaussian PSF norm 0.1390199406446561 vs pixelized 0.12005948
average tim pixel scale / coadd scale: 1.00105038585447
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.48', '1.87', '2.47', '1.84', '1.42', '1.26', '1.51', '1.47', '1.32', '1.78']
Using average PSF sigma 1.6422655515040172
Gaussian PSF norm 0.17177172809569713 vs pixelized 0.14513822
average tim pixel scale / coadd scale: 1.0009821529237142
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.38 s, CPU: 0.36 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 244 MB, VmData: 272 MB, maxrss: 0.250064 MB
Stage fit_on_coadds finished: 2020-08-10T07:40:24.585457
Resources for stage fit_on_coadds : 0.458 s worker CPU, 0.460 s worker Wall, Wall: 0.378 s, Cores in use: 2.16, Total efficiency (on 8 cores): 27.0 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-10T07:40:24.602837
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 22 potential peaks
Of 22 potential peaks: 2 in veto map, 1 cut by saddle test, 0 cut by aper test, 19 kept
SED z : 19 new peaks
Found 24 potential peaks
Of 24 potential peaks: 18 in veto map, 2 cut by saddle test, 0 cut by aper test, 4 kept
SED r : 4 new peaks
Found 22 potential peaks
Of 22 potential peaks: 17 in veto map, 0 cut by saddle test, 0 cut by aper test, 5 kept
SED g : 5 new peaks
Found 36 potential peaks
Of 36 potential peaks: 27 in veto map, 1 cut by saddle test, 0 cut by aper test, 8 kept
SED Flat : 8 new peaks
Found 37 potential peaks
Of 37 potential peaks: 35 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 37 new sources
Median coadd sky for g : -0.00013729397
Median coadd sky for r : -0.00011859397
Median coadd sky for z : -0.00019104582
Stage srcs : Wall: 0.88 s, CPU: 0.81 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 245 MB, VmData: 272 MB, maxrss: 0.250476 MB
Stage srcs finished: 2020-08-10T07:40:25.482174
Resources for stage srcs : 0.076 s worker CPU, 0.077 s worker Wall, Wall: 0.880 s, Cores in use: 1.01, Total efficiency (on 8 cores): 12.6 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-10T07:40:25.926273
Blob 1 of 21, id: 10, sources: 13, size: 148x140, npix 8716, brick X: 65,213, Y: 61,201, one pixel: 130 61
Blob 2 of 21, id: 8, sources: 5, size: 90x68, npix 3418, brick X: 27,117, Y: 32,100, one pixel: 67 32
Blob 3 of 21, id: 11, sources: 1, size: 32x33, npix 700, brick X: 156,188, Y: 62,95, one pixel: 169 62
Blob 4 of 21, id: 15, sources: 2, size: 35x34, npix 676, brick X: 34,69, Y: 122,156, one pixel: 57 122
Blob 5 of 21, id: 1, sources: 1, size: 32x29, npix 634, brick X: 72,104, Y: 0,29, one pixel: 81 0
Blob 6 of 21, id: 20, sources: 2, size: 37x25, npix 495, brick X: 131,168, Y: 205,230, one pixel: 141 205
Blob 7 of 21, id: 6, sources: 1, size: 24x28, npix 470, brick X: 209,233, Y: 21,49, one pixel: 219 21
Blob 8 of 21, id: 12, sources: 1, size: 23x25, npix 379, brick X: 210,233, Y: 85,110, one pixel: 219 85
Blob 9 of 21, id: 19, sources: 1, size: 22x22, npix 289, brick X: 15,37, Y: 185,207, one pixel: 24 185
Blob 6 finished, total: Wall: 0.72 s, CPU: 0.72 s, VmPeak: 1028 MB, VmSize: 700 MB, VmRSS: 115 MB, VmData: 155 MB, maxrss: 0.142732 MB
Blob 10 of 21, id: 2, sources: 1, size: 24x16, npix 281, brick X: 113,137, Y: 0,16, one pixel: 116 0
Blob 3 finished, total: Wall: 0.81 s, CPU: 0.80 s, VmPeak: 1022 MB, VmSize: 700 MB, VmRSS: 114 MB, VmData: 155 MB, maxrss: 0.142664 MB
Blob 11 of 21, id: 14, sources: 1, size: 21x21, npix 278, brick X: 32,53, Y: 101,122, one pixel: 40 101
Blob 8 finished, total: Wall: 0.81 s, CPU: 0.80 s, VmPeak: 1010 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143604 MB
Blob 12 of 21, id: 16, sources: 1, size: 22x21, npix 270, brick X: 79,101, Y: 167,188, one pixel: 88 167
Blob 5 finished, total: Wall: 0.97 s, CPU: 0.95 s, VmPeak: 1027 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143232 MB
Blob 13 of 21, id: 5, sources: 1, size: 16x23, npix 257, brick X: 0,16, Y: 20,43, one pixel: 4 20
Blob 7 finished, total: Wall: 1.06 s, CPU: 1.05 s, VmPeak: 1020 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143484 MB
Blob 9 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 1028 MB, VmSize: 700 MB, VmRSS: 115 MB, VmData: 155 MB, maxrss: 0.142732 MB
Blob 14 of 21, id: 3, sources: 1, size: 20x20, npix 247, brick X: 204,224, Y: 2,22, one pixel: 213 2
Blob 15 of 21, id: 7, sources: 1, size: 20x20, npix 219, brick X: 149,169, Y: 26,46, one pixel: 158 26
Blob 11 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 1010 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143604 MB
Blob 16 of 21, id: 0, sources: 1, size: 19x20, npix 218, brick X: 21,40, Y: 0,20, one pixel: 29 0
Blob 4 finished, total: Wall: 1.19 s, CPU: 1.19 s, VmPeak: 1028 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.143928 MB
Blob 17 of 21, id: 17, sources: 1, size: 14x23, npix 218, brick X: 0,14, Y: 169,192, one pixel: 2 169
Blob 12 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 1027 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143232 MB
Blob 18 of 21, id: 13, sources: 1, size: 19x19, npix 208, brick X: 178,197, Y: 90,109, one pixel: 187 90
Blob 15 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 1010 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143604 MB
Blob 19 of 21, id: 4, sources: 1, size: 18x17, npix 162, brick X: 144,162, Y: 10,27, one pixel: 152 10
Blob 10 finished, total: Wall: 0.88 s, CPU: 0.88 s, VmPeak: 1022 MB, VmSize: 700 MB, VmRSS: 114 MB, VmData: 155 MB, maxrss: 0.142664 MB
Blob 20 of 21, id: 18, sources: 1, size: 12x19, npix 154, brick X: 221,233, Y: 169,188, one pixel: 229 169
Blob 21 of 21, id: 9, sources: 1, size: 17x17, npix 145, brick X: 180,197, Y: 33,50, one pixel: 188 33
Blob 19 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 1022 MB, VmSize: 700 MB, VmRSS: 114 MB, VmData: 155 MB, maxrss: 0.142664 MB
Blob 18 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 1010 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143604 MB
Blob 21 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 1010 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143604 MB
Blob 16 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 1028 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.143928 MB
Blob 13 finished, total: Wall: 1.05 s, CPU: 1.05 s, VmPeak: 1028 MB, VmSize: 700 MB, VmRSS: 115 MB, VmData: 155 MB, maxrss: 0.142732 MB
Blob 14 finished, total: Wall: 1.19 s, CPU: 1.19 s, VmPeak: 1020 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143484 MB
Blob 17 finished, total: Wall: 0.98 s, CPU: 0.98 s, VmPeak: 1027 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143232 MB
Blob 20 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 1022 MB, VmSize: 700 MB, VmRSS: 114 MB, VmData: 155 MB, maxrss: 0.142664 MB
Measuring 3 iterative sources
Blob 2 finished, total: Wall: 6.78 s, CPU: 6.77 s, VmPeak: 1024 MB, VmSize: 702 MB, VmRSS: 120 MB, VmData: 157 MB, maxrss: 0.142644 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.93925, ee1=-0.384668, ee2=0.251601
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 12.03 s, CPU: 12.03 s, VmPeak: 1015 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148264 MB
Old catalog: 40
New catalog: 39
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/metrics/cus/blobs-custom-336792m55162.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/metrics/cus/all-models-custom-336792m55162.fits
Stage fitblobs : Wall: 12.83 s, CPU: 0.80 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 245 MB, VmData: 272 MB, maxrss: 0.25064 MB
Stage fitblobs finished: 2020-08-10T07:40:38.753715
Resources for stage fitblobs : 31.797 s worker CPU, 31.932 s worker Wall, Wall: 12.828 s, Cores in use: 2.54, Total efficiency (on 8 cores): 31.8 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-10T07:40:38.803332
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/tmp-legacysurvey-custom-336792m55162-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/tmp-legacysurvey-custom-336792m55162-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/tmp-legacysurvey-custom-336792m55162-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/tmp-legacysurvey-custom-336792m55162-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-resid.jpg
Stage coadds : Wall: 1.55 s, CPU: 0.59 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 245 MB, VmData: 272 MB, maxrss: 0.251152 MB
Stage coadds finished: 2020-08-10T07:40:40.351292
Resources for stage coadds : 4.250 s worker CPU, 4.608 s worker Wall, Wall: 1.549 s, Cores in use: 3.12, Total efficiency (on 8 cores): 39.0 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-10T07:40:40.364703
Cut to 1 unWISE tiles
Reading WISE tile 3370m546 band 1
Reading WISE tile 3370m546 band 3
Reading WISE tile 3370m546 band 2
Reading WISE tile 3370m546 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 1010 MB, VmSize: 806 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.1929 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 1022 MB, VmSize: 800 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.205452 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 1028 MB, VmSize: 800 MB, VmRSS: 143 MB, VmData: 172 MB, maxrss: 0.20746 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 1027 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.208344 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/tmp-legacysurvey-custom-336792m55162-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/tmp-legacysurvey-custom-336792m55162-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 5.16 s, CPU: 0.79 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 246 MB, VmData: 272 MB, maxrss: 0.25186 MB
Stage wise_forced finished: 2020-08-10T07:40:45.521840
Resources for stage wise_forced : 3.349 s worker CPU, 7.437 s worker Wall, Wall: 5.158 s, Cores in use: 0.80, Total efficiency (on 8 cores): 10.0 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-10T07:40:45.534087
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/tractor-i/cus/tractor-custom-336792m55162.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/tractor/cus/tractor-custom-336792m55162.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/tractor/cus/brick-custom-336792m55162.sha256sum
Stage writecat : Wall: 0.69 s, CPU: 0.58 s, VmPeak: 1178 MB, VmSize: 1050 MB, VmRSS: 248 MB, VmData: 272 MB, maxrss: 0.384844 MB
Stage writecat finished: 2020-08-10T07:40:46.227146
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.694 s, Cores in use: 0.84, Total efficiency (on 8 cores): 10.5 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-writecat.p
All done: 52.796 s worker CPU, 1223.269 s worker Wall, Wall: 242.733 s, Cores in use: 0.26, Total efficiency (on 8 cores): 3.2 %
Finished galaxy PGC412095 in 4.081 minutes.
Started working on galaxy PGC412095 at Sun Aug 16 19:57:35 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.7924235941169 -55.16281763284811 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-16T19:57:36.964969
legacypipe git version: DR9.5.11-watershed-9-g82106209
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '336.7924235941169', '-55.16281763284811', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.7924235941169 -55.16281763284811 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 336.7924235941169 -55.16281763284811
Starting process 21848 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 21849 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 21850 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 21851 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 21852 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB
Starting process 21853 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 21854 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 21855 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 21856 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 21857 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 21858 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 21859 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 21860 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 21861 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 21862 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 21863 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 21864 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 21865 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 21866 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 21867 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 21868 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 21869 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 21870 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 21871 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 21872 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 21873 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 21874 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 21875 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 21876 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 21877 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 21878 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 21879 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-16T19:57:38.070380
Keeping 31 CCDs:
  c4d_140915_032043_ooi_r_ls9-S6 r expnum 359189 exptime 90.0 propid 2012B-0001 seeing 1.42 MJD 56915.138 object DES survey hex -240-552 tiling 1 
    decam/CP/V4.8.2a/CP20140914/c4d_140915_032043_ooi_r_ls9.fits.fz
  c4d_131213_010910_ooi_z_ls9-S6 z expnum 263501 exptime 90.0 propid 2012B-0001 seeing 0.91 MJD 56639.046 object DES survey hex -240-552 tiling 1 
    decam/CP/V4.8.2a/CP20131212/c4d_131213_010910_ooi_z_ls9.fits.fz
  c4d_130903_052045_ooi_g_ls9-S6 g expnum 230127 exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 56538.223 object DES survey hex -240-552 tiling 1 
    decam/CP/V4.8.2a/CP20130902/c4d_130903_052045_ooi_g_ls9.fits.fz
  c4d_171015_014021_ooi_z_v1-N16 z expnum 687130 exptime 90.0 propid 2012B-0001 seeing 1.15 MJD 58041.070 object DES survey hex -240-552 tiling 9 
    decam/CP/V4.1/CP20171014/c4d_171015_014021_ooi_z_v1.fits.fz
  c4d_171015_013823_ooi_g_v1-N16 g expnum 687129 exptime 90.0 propid 2012B-0001 seeing 1.31 MJD 58041.068 object DES survey hex -240-552 tiling 9 
    decam/CP/V4.1/CP20171014/c4d_171015_013823_ooi_g_v1.fits.fz
  c4d_171015_013426_ooi_r_v1-N16 r expnum 687127 exptime 90.0 propid 2012B-0001 seeing 1.28 MJD 58041.066 object DES survey hex -240-552 tiling 9 
    decam/CP/V4.1/CP20171014/c4d_171015_013426_ooi_r_v1.fits.fz
  c4d_171014_013632_ooi_g_v1-N16 g expnum 686814 exptime 90.0 propid 2012B-0001 seeing 1.86 MJD 58040.067 object DES survey hex -240-552 tiling 9 
    decam/CP/V4.1/CP20171013/c4d_171014_013632_ooi_g_v1.fits.fz
  c4d_171014_013433_ooi_r_v1-N16 r expnum 686813 exptime 90.0 propid 2012B-0001 seeing 1.78 MJD 58040.066 object DES survey hex -240-552 tiling 9 
    decam/CP/V4.1/CP20171013/c4d_171014_013433_ooi_r_v1.fits.fz
  c4d_171014_013831_ooi_z_v1-N16 z expnum 686815 exptime 90.0 propid 2012B-0001 seeing 1.52 MJD 58040.068 object DES survey hex -240-552 tiling 9 
    decam/CP/V4.1/CP20171013/c4d_171014_013831_ooi_z_v1.fits.fz
  c4d_130913_055149_ooi_g_ls9-N9 g expnum 233559 exptime 90.0 propid 2012B-0001 seeing 1.14 MJD 56548.244 object DES survey hex -212-542 tiling 3 
    decam/CP/V4.8.2a/CP20130912/c4d_130913_055149_ooi_g_ls9.fits.fz
  c4d_130913_054722_ooi_r_ls9-N9 r expnum 233557 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 56548.241 object DES survey hex -212-542 tiling 3 
    decam/CP/V4.8.2a/CP20130912/c4d_130913_054722_ooi_r_ls9.fits.fz
  c4d_131121_021445_ooi_z_ls9-N9 z expnum 256589 exptime 90.0 propid 2012B-0001 seeing 1.14 MJD 56617.094 object DES survey hex -212-542 tiling 3 
    decam/CP/V4.8.2a/CP20131120/c4d_131121_021445_ooi_z_ls9.fits.fz
  c4d_130905_012746_ooi_g_ls9-N9 g expnum 230831 exptime 90.0 propid 2012B-0001 seeing 1.62 MJD 56540.061 object DES survey hex -212-542 tiling 3 
    decam/CP/V4.8.2a/CP20130904/c4d_130905_012746_ooi_g_ls9.fits.fz
  c4d_170926_022406_ooi_z_v1-S6 z expnum 681538 exptime 90.0 propid 2012B-0001 seeing 0.87 MJD 58022.100 object DES survey hex -240-552 tiling 8 
    decam/CP/V4.1/CP20170925/c4d_170926_022406_ooi_z_v1.fits.fz
  c4d_170924_025158_ooi_r_v1-S6 r expnum 680744 exptime 90.0 propid 2012B-0001 seeing 0.79 MJD 58020.119 object DES survey hex -240-552 tiling 8 
    decam/CP/V4.1/CP20170923/c4d_170924_025158_ooi_r_v1.fits.fz
  c4d_170924_025357_ooi_g_v1-S6 g expnum 680745 exptime 90.0 propid 2012B-0001 seeing 0.86 MJD 58020.121 object DES survey hex -240-552 tiling 8 
    decam/CP/V4.1/CP20170923/c4d_170924_025357_ooi_g_v1.fits.fz
  c4d_180915_060455_ooi_r_v1-N18 r expnum 773761 exptime 90.0 propid 2012B-0001 seeing 1.74 MJD 58376.253 object DES survey hex -240-552 tiling 10 
    decam/CP/V4.1/CP20180914/c4d_180915_060455_ooi_r_v1.fits.fz
  c4d_180915_060653_ooi_g_v1-N18 g expnum 773762 exptime 90.0 propid 2012B-0001 seeing 1.52 MJD 58376.255 object DES survey hex -240-552 tiling 10 
    decam/CP/V4.1/CP20180914/c4d_180915_060653_ooi_g_v1.fits.fz
  c4d_181018_012945_ooi_z_v1-N18 z expnum 784540 exptime 90.0 propid 2012B-0001 seeing 0.78 MJD 58409.062 object DES survey hex -240-552 tiling 10 
    decam/CP/V4.1/CP20181017/c4d_181018_012945_ooi_z_v1.fits.fz
  c4d_160928_025233_ooi_g_ls9-S20 g expnum 578193 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 57659.118 object DES survey hex -213-562 tiling 6 
    decam/CP/V4.8.2a/CP20160927/c4d_160928_025233_ooi_g_ls9.fits.fz
  c4d_160929_022100_ooi_z_ls9-S20 z expnum 578635 exptime 90.0 propid 2012B-0001 seeing 0.93 MJD 57660.096 object DES survey hex -213-562 tiling 6 
    decam/CP/V4.8.2a/CP20160928/c4d_160929_022100_ooi_z_ls9.fits.fz
  c4d_160928_025037_ooi_r_ls9-S20 r expnum 578192 exptime 90.0 propid 2012B-0001 seeing 0.97 MJD 57659.117 object DES survey hex -213-562 tiling 6 
    decam/CP/V4.8.2a/CP20160927/c4d_160928_025037_ooi_r_ls9.fits.fz
  c4d_161003_020033_ooi_r_ls9-N15 r expnum 580250 exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57664.082 object DES survey hex -240-552 tiling 7 
    decam/CP/V4.8.2a/CP20161002/c4d_161003_020033_ooi_r_ls9.fits.fz
  c4d_161003_020235_ooi_g_ls9-N15 g expnum 580251 exptime 90.0 propid 2012B-0001 seeing 1.29 MJD 57664.084 object DES survey hex -240-552 tiling 7 
    decam/CP/V4.8.2a/CP20161002/c4d_161003_020235_ooi_g_ls9.fits.fz
  c4d_170902_040125_ooi_z_v1-N15 z expnum 674345 exptime 90.0 propid 2012B-0001 seeing 0.90 MJD 57998.168 object DES survey hex -240-552 tiling 7 
    decam/CP/V4.1/CP20170901/c4d_170902_040125_ooi_z_v1.fits.fz
  c4d_131012_034519_ooi_z_ls9-S21 z expnum 243133 exptime 90.0 propid 2012B-0001 seeing 0.82 MJD 56577.156 object DES survey hex -213-562 tiling 2 
    decam/CP/V4.8.2a/CP20131011/c4d_131012_034519_ooi_z_ls9.fits.fz
  c4d_130902_030848_ooi_g_ls9-N28 g expnum 229614 exptime 90.0 propid 2012B-0001 seeing 1.54 MJD 56537.131 object DES survey hex -240-552 tiling 4 
    decam/CP/V4.8.2a/CP20130901/c4d_130902_030848_ooi_g_ls9.fits.fz
  c4d_131004_015250_ooi_r_ls9-N28 r expnum 241044 exptime 90.0 propid 2012B-0001 seeing 1.04 MJD 56569.078 object DES survey hex -240-552 tiling 4 
    decam/CP/V4.8.2a/CP20131003/c4d_131004_015250_ooi_r_ls9.fits.fz
  c4d_150815_052551_ooi_r_ls9-N12 r expnum 463798 exptime 90.0 propid 2012B-0001 seeing 1.29 MJD 57249.225 object DES survey hex -240-552 tiling 5 
    decam/CP/V4.8.2a/CP20150814/c4d_150815_052551_ooi_r_ls9.fits.fz
  c4d_150815_052748_ooi_g_ls9-N12 g expnum 463799 exptime 90.0 propid 2012B-0001 seeing 1.32 MJD 57249.226 object DES survey hex -240-552 tiling 5 
    decam/CP/V4.8.2a/CP20150814/c4d_150815_052748_ooi_g_ls9.fits.fz
  c4d_151017_015844_ooi_z_ls9-N12 z expnum 484835 exptime 90.0 propid 2012B-0001 seeing 1.09 MJD 57312.081 object DES survey hex -240-552 tiling 5 
    decam/CP/V4.8.2a/CP20151016/c4d_151017_015844_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-r-20171014T013433_oi[N16,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-g-20171014T013632_oi[N16,noinherit][2046,4094][real]: DE
Zeroing out 235 weight-map pixels below quantization error (= median 0.000252)
Clipping 1 pixels with anomalously large oow values: max 0.0526569 vs median 0.0397265
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9615034-r-20140915T031823_oi[S6,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c093-z-20160929T021839_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e768-r-20161003T015814_oi[N15,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-g-20170924T025357_oi[S6,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9632a66-z-20131012T034519_oi[S21,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-r-20170924T025158_oi[S6,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180914_92a89f0-r-20180915T060455_oi[N18,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96324a3-g-20130903T052045_oi[S6,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9632e5d-g-20130905T012746_oi[N9,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961cecb-g-20150815T052528_oi[N12,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9635985-z-20131121T021445_oi[N9,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96334f7-r-20130913T054722_oi[N9,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-z-20171014T013831_oi[N16,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962d087-r-20160928T024814_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9634008-r-20131004T015250_oi[N28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962d774-g-20161003T020015_oi[N15,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-r-20171015T013426_oi[N16,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-g-20171015T013823_oi[N16,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-z-20171015T014021_oi[N16,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_963392e-g-20130913T055149_oi[N9,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-z-20170926T022406_oi[S6,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9631ab1-g-20130902T030848_oi[N28,noinherit][2046,4094][real]: DES sur
Clipping 1 pixels with anomalously large oow values: max 0.0616437 vs median 0.047084
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962bb1a-g-20160928T025013_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_960fe80-z-20131213T010648_oi[S6,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961f0e3-r-20150815T052330_oi[N12,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962286b-z-20151017T015625_oi[N12,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180914_92a89f0-g-20180915T060653_oi[N18,noinherit][2046,4094][real]: DE
Zeroing out 0 weight-map pixels below quantization error (= median 0.000286)
Clipping 1 pixels with anomalously large oow values: max 0.0571829 vs median 0.0439666
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20181017_92f9aa3-z-20181018T012945_oi[N18,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170831_8f79ebc-z-20170902T040125_oi[N15,noinherit][2046,4094][real]: DE
Stage tims : Wall: 42.24 s, CPU: 1.16 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 192 MB, VmData: 226 MB, maxrss: 0.196548 MB
Stage tims finished: 2020-08-16T19:58:20.308500
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-g-20171014T013632_oi[N16,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c093-z-20160929T021839_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Zeroing out 3792 weight-map pixels below quantization error (= median 0.000204)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-g-20170924T025357_oi[S6,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
Zeroing out 0 weight-map pixels below quantization error (= median 5.33e-05)
Zeroing out 235 weight-map pixels below quantization error (= median 6.2e-05)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180914_92a89f0-r-20180915T060455_oi[N18,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-r-20171015T013426_oi[N16,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Zeroing out 235 weight-map pixels below quantization error (= median 2.46e-06)
Zeroing out 235 weight-map pixels below quantization error (= median 5.01e-05)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-z-20171014T013831_oi[N16,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-r-20171014T013433_oi[N16,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Zeroing out 235 weight-map pixels below quantization error (= median 0.00027)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-g-20171015T013823_oi[N16,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Zeroing out 235 weight-map pixels below quantization error (= median 4.03e-06)
Zeroing out 3792 weight-map pixels below quantization error (= median 4.51e-06)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-z-20171015T014021_oi[N16,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-z-20170926T022406_oi[S6,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9615034-r-20140915T031823_oi[S6,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e768-r-20161003T015814_oi[N15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9632a66-z-20131012T034519_oi[S21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962d087-r-20160928T024814_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96334f7-r-20130913T054722_oi[N9,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_963392e-g-20130913T055149_oi[N9,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9631ab1-g-20130902T030848_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180914_92a89f0-g-20180915T060653_oi[N18,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9632e5d-g-20130905T012746_oi[N9,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962286b-z-20151017T015625_oi[N12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961cecb-g-20150815T052528_oi[N12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_960fe80-z-20131213T010648_oi[S6,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96324a3-g-20130903T052045_oi[S6,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9634008-r-20131004T015250_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962d774-g-20161003T020015_oi[N15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962bb1a-g-20160928T025013_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Zeroing out 0 weight-map pixels below quantization error (= median 4.51e-06)
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170831_8f79ebc-z-20170902T040125_oi[N15,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961f0e3-r-20150815T052330_oi[N12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Resources for stage tims : 20.462 s worker CPU, 819.014 s worker Wall, Wall: 42.241 s, Cores in use: 0.51, Total efficiency (on 32 cores): 1.6 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-tims.p
Running stage refs
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9635985-z-20131121T021445_oi[N9,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Zeroing out 0 weight-map pixels below quantization error (= median 2.74e-06)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20181017_92f9aa3-z-20181018T012945_oi[N18,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Zeroing out 3792 weight-map pixels below quantization error (= median 5.32e-05)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-r-20170924T025158_oi[S6,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
Running stage refs at 2020-08-16T19:58:20.742212
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11177.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11269.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11270.fits
Matched 20 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/metrics/cus/reference-custom-336792m55162.fits
Stage refs : Wall: 5.37 s, CPU: 2.59 s, VmPeak: 1041 MB, VmSize: 1036 MB, VmRSS: 219 MB, VmData: 252 MB, maxrss: 0.224284 MB
Stage refs finished: 2020-08-16T19:58:26.108634
Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 5.369 s, Cores in use: 0.48, Total efficiency (on 32 cores): 1.5 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-16T19:58:26.169577
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/metrics/cus/outlier-mask-custom-336792m55162.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/metrics/cus/outliers-pre-custom-336792m55162.jpg
Image c4d_130905_012746_ooi_g_ls9-N9 g : masking 0 positive outlier pixels and 78 negative outlier pixels
Image c4d_180915_060653_ooi_g_v1-N18 g : masking 455 positive outlier pixels and 0 negative outlier pixels
Image c4d_150815_052748_ooi_g_ls9-N12 g : masking 0 positive outlier pixels and 81 negative outlier pixels
Image c4d_160928_025037_ooi_r_ls9-S20 r : masking 370 positive outlier pixels and 0 negative outlier pixels
Image c4d_131213_010910_ooi_z_ls9-S6 z : masking 242 positive outlier pixels and 0 negative outlier pixels
Image c4d_171015_014021_ooi_z_v1-N16 z : masking 369 positive outlier pixels and 0 negative outlier pixels
Image c4d_181018_012945_ooi_z_v1-N18 z : masking 307 positive outlier pixels and 0 negative outlier pixels
Image c4d_131012_034519_ooi_z_ls9-S21 z : masking 296 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/metrics/cus/outlier-mask-custom-336792m55162.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/metrics/cus/outliers-post-custom-336792m55162.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/metrics/cus/outliers-masked-pos-custom-336792m55162.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/metrics/cus/outliers-masked-neg-custom-336792m55162.jpg
Stage outliers : Wall: 1.88 s, CPU: 1.60 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 244 MB, VmData: 273 MB, maxrss: 0.249352 MB
Stage outliers finished: 2020-08-16T19:58:28.049704
Resources for stage outliers : 1.647 s worker CPU, 1.682 s worker Wall, Wall: 1.882 s, Cores in use: 1.73, Total efficiency (on 32 cores): 5.4 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-16T19:58:28.428904
Stage halos : Wall: 0.90 s, CPU: 0.90 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 244 MB, VmData: 274 MB, maxrss: 0.249636 MB
Stage halos finished: 2020-08-16T19:58:29.325876
Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.899 s, Cores in use: 1.00, Total efficiency (on 32 cores): 3.1 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-16T19:58:29.404616
PSF sigmas in coadd pixels: ['1.80', '2.14', '3.02', '1.85', '2.63', '1.40', '2.47', '1.74', '2.09', '2.50', '2.14']
Using average PSF sigma 2.1626542323360702
Gaussian PSF norm 0.13043915553211813 vs pixelized 0.11107049
average tim pixel scale / coadd scale: 1.0010441592303128
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.30', '2.08', '2.89', '1.71', '1.29', '2.82', '1.57', '1.84', '1.69', '2.09']
Using average PSF sigma 2.029167833519154
Gaussian PSF norm 0.1390199406446561 vs pixelized 0.12005948
average tim pixel scale / coadd scale: 1.00105038585447
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.48', '1.87', '2.47', '1.84', '1.42', '1.26', '1.51', '1.47', '1.32', '1.78']
Using average PSF sigma 1.6422655515040172
Gaussian PSF norm 0.17177172809569713 vs pixelized 0.14513822
average tim pixel scale / coadd scale: 1.0009821529237142
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.36 s, CPU: 0.33 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 246 MB, VmData: 274 MB, maxrss: 0.251888 MB
Stage fit_on_coadds finished: 2020-08-16T19:58:29.762162
Resources for stage fit_on_coadds : 0.402 s worker CPU, 0.402 s worker Wall, Wall: 0.360 s, Cores in use: 2.04, Total efficiency (on 32 cores): 6.4 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-16T19:58:29.778432
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 22 potential peaks
Of 22 potential peaks: 2 in veto map, 1 cut by saddle test, 0 cut by aper test, 19 kept
SED z : 19 new peaks
Found 24 potential peaks
Of 24 potential peaks: 18 in veto map, 2 cut by saddle test, 0 cut by aper test, 4 kept
SED r : 4 new peaks
Found 22 potential peaks
Of 22 potential peaks: 17 in veto map, 0 cut by saddle test, 0 cut by aper test, 5 kept
SED g : 5 new peaks
Found 36 potential peaks
Of 36 potential peaks: 27 in veto map, 1 cut by saddle test, 0 cut by aper test, 8 kept
SED Flat : 8 new peaks
Found 37 potential peaks
Of 37 potential peaks: 35 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 37 new sources
Median coadd sky for g : -0.00013729396
Median coadd sky for r : -0.000118594005
Median coadd sky for z : -0.0001910456
Stage srcs : Wall: 1.52 s, CPU: 1.44 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 246 MB, VmData: 274 MB, maxrss: 0.25228 MB
Stage srcs finished: 2020-08-16T19:58:31.300636
Resources for stage srcs : 0.060 s worker CPU, 0.060 s worker Wall, Wall: 1.524 s, Cores in use: 0.99, Total efficiency (on 32 cores): 3.1 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-16T19:58:31.335800
Blob 1 of 21, id: 10, sources: 13, size: 148x140, npix 8716, brick X: 65,213, Y: 61,201, one pixel: 130 61
Blob 2 of 21, id: 8, sources: 5, size: 90x68, npix 3418, brick X: 27,117, Y: 32,100, one pixel: 67 32
Blob 3 of 21, id: 11, sources: 1, size: 32x33, npix 700, brick X: 156,188, Y: 62,95, one pixel: 169 62
Blob 4 of 21, id: 15, sources: 2, size: 35x34, npix 676, brick X: 34,69, Y: 122,156, one pixel: 57 122
Blob 5 of 21, id: 1, sources: 1, size: 32x29, npix 634, brick X: 72,104, Y: 0,29, one pixel: 81 0
Blob 6 of 21, id: 20, sources: 2, size: 37x25, npix 495, brick X: 131,168, Y: 205,230, one pixel: 141 205
Blob 7 of 21, id: 6, sources: 1, size: 24x28, npix 470, brick X: 209,233, Y: 21,49, one pixel: 219 21
Blob 8 of 21, id: 12, sources: 1, size: 23x25, npix 379, brick X: 210,233, Y: 85,110, one pixel: 219 85
Blob 9 of 21, id: 19, sources: 1, size: 22x22, npix 289, brick X: 15,37, Y: 185,207, one pixel: 24 185
Blob 10 of 21, id: 2, sources: 1, size: 24x16, npix 281, brick X: 113,137, Y: 0,16, one pixel: 116 0
Blob 11 of 21, id: 14, sources: 1, size: 21x21, npix 278, brick X: 32,53, Y: 101,122, one pixel: 40 101
Blob 12 of 21, id: 16, sources: 1, size: 22x21, npix 270, brick X: 79,101, Y: 167,188, one pixel: 88 167
Blob 13 of 21, id: 5, sources: 1, size: 16x23, npix 257, brick X: 0,16, Y: 20,43, one pixel: 4 20
Blob 14 of 21, id: 3, sources: 1, size: 20x20, npix 247, brick X: 204,224, Y: 2,22, one pixel: 213 2
Blob 15 of 21, id: 7, sources: 1, size: 20x20, npix 219, brick X: 149,169, Y: 26,46, one pixel: 158 26
Blob 16 of 21, id: 0, sources: 1, size: 19x20, npix 218, brick X: 21,40, Y: 0,20, one pixel: 29 0
Blob 17 of 21, id: 17, sources: 1, size: 14x23, npix 218, brick X: 0,14, Y: 169,192, one pixel: 2 169
Blob 18 of 21, id: 13, sources: 1, size: 19x19, npix 208, brick X: 178,197, Y: 90,109, one pixel: 187 90
Blob 19 of 21, id: 4, sources: 1, size: 18x17, npix 162, brick X: 144,162, Y: 10,27, one pixel: 152 10
Blob 20 of 21, id: 18, sources: 1, size: 12x19, npix 154, brick X: 221,233, Y: 169,188, one pixel: 229 169
Blob 21 of 21, id: 9, sources: 1, size: 17x17, npix 145, brick X: 180,197, Y: 33,50, one pixel: 188 33
Blob 19 finished, total: Wall: 0.07 s, CPU: 0.05 s, VmPeak: 995 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145092 MB
Blob 21 finished, total: Wall: 0.08 s, CPU: 0.07 s, VmPeak: 1010 MB, VmSize: 725 MB, VmRSS: 140 MB, VmData: 180 MB, maxrss: 0.142888 MB
Blob 9 finished, total: Wall: 0.23 s, CPU: 0.21 s, VmPeak: 954 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.14294 MB
Blob 15 finished, total: Wall: 0.23 s, CPU: 0.22 s, VmPeak: 1000 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143424 MB
Blob 18 finished, total: Wall: 0.27 s, CPU: 0.26 s, VmPeak: 939 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143336 MB
Blob 12 finished, total: Wall: 0.30 s, CPU: 0.29 s, VmPeak: 937 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.14334 MB
Blob 11 finished, total: Wall: 0.33 s, CPU: 0.32 s, VmPeak: 1016 MB, VmSize: 725 MB, VmRSS: 139 MB, VmData: 180 MB, maxrss: 0.142804 MB
Blob 8 finished, total: Wall: 0.60 s, CPU: 0.58 s, VmPeak: 951 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144396 MB
Blob 10 finished, total: Wall: 0.63 s, CPU: 0.62 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.142948 MB
Blob 6 finished, total: Wall: 0.64 s, CPU: 0.63 s, VmPeak: 951 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144552 MB
Blob 16 finished, total: Wall: 0.66 s, CPU: 0.65 s, VmPeak: 939 MB, VmSize: 727 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144308 MB
Blob 3 finished, total: Wall: 0.69 s, CPU: 0.68 s, VmPeak: 951 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.142996 MB
Blob 5 finished, total: Wall: 0.70 s, CPU: 0.68 s, VmPeak: 1016 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143296 MB
Blob 20 finished, total: Wall: 0.79 s, CPU: 0.78 s, VmPeak: 1008 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144888 MB
Blob 17 finished, total: Wall: 0.85 s, CPU: 0.84 s, VmPeak: 959 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144724 MB
Blob 7 finished, total: Wall: 0.87 s, CPU: 0.87 s, VmPeak: 1012 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.14482 MB
Blob 13 finished, total: Wall: 0.90 s, CPU: 0.90 s, VmPeak: 1010 MB, VmSize: 725 MB, VmRSS: 140 MB, VmData: 180 MB, maxrss: 0.143076 MB
Blob 4 finished, total: Wall: 0.91 s, CPU: 0.91 s, VmPeak: 940 MB, VmSize: 722 MB, VmRSS: 136 MB, VmData: 177 MB, maxrss: 0.139556 MB
Blob 14 finished, total: Wall: 0.96 s, CPU: 0.95 s, VmPeak: 1015 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144696 MB
Measuring 3 iterative sources
Blob 2 finished, total: Wall: 5.74 s, CPU: 5.74 s, VmPeak: 950 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146344 MB
Reference source: GaiaSource at GaiaPosition: RA, Dec = (336.78979, -55.15966), pm (-1.0, -2.1), parallax -0.786 with NanoMaggies: g=20.4, r=20.1, z=19.9
  cat entry: tabledata object with 1 rows and 62 columns
Reference source: ExpGalaxy at RaDecPos: RA, Dec = (336.79270, -55.16273) with NanoMaggies: g=18.5, r=17.6, z=17 and EllipseWithPriors(0.25): log r_e=1.93925, ee1=-0.384668, ee2=0.2516
  cat entry: tabledata object with 1 rows and 62 columns
  cat entry: tabledata object with 2 rows and 62 columns
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.93925, ee1=-0.384668, ee2=0.2516
Measuring 2 iterative sources
Blob 1 finished, total: Wall: 11.54 s, CPU: 11.54 s, VmPeak: 1012 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.14814 MB
Old catalog: 40
New catalog: 41
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/metrics/cus/blobs-custom-336792m55162.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/metrics/cus/all-models-custom-336792m55162.fits
Stage fitblobs : Wall: 16.02 s, CPU: 1.04 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 247 MB, VmData: 274 MB, maxrss: 0.252444 MB
Stage fitblobs finished: 2020-08-16T19:58:47.355769
Resources for stage fitblobs : 28.066 s worker CPU, 28.863 s worker Wall, Wall: 16.023 s, Cores in use: 1.82, Total efficiency (on 32 cores): 5.7 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-16T19:58:47.371747
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/tmp-legacysurvey-custom-336792m55162-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/tmp-legacysurvey-custom-336792m55162-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/tmp-legacysurvey-custom-336792m55162-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/tmp-legacysurvey-custom-336792m55162-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-resid.jpg
Stage coadds : Wall: 2.37 s, CPU: 0.72 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 247 MB, VmData: 274 MB, maxrss: 0.25296 MB
Stage coadds finished: 2020-08-16T19:58:49.742348
Resources for stage coadds : 23.580 s worker CPU, 35.246 s worker Wall, Wall: 2.373 s, Cores in use: 10.24, Total efficiency (on 32 cores): 32.0 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-16T19:58:49.758287
Cut to 1 unWISE tiles
Reading WISE tile 3370m546 band 2
Reading WISE tile 3370m546 band 1
Reading WISE tile 3370m546 band 4
Reading WISE tile 3370m546 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 955 MB, VmSize: 801 MB, VmRSS: 146 MB, VmData: 176 MB, maxrss: 0.18788 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 943 MB, VmSize: 859 MB, VmRSS: 201 MB, VmData: 234 MB, maxrss: 0.206152 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 1016 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.20802 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/337/3370m546/unwise-3370m546-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 1016 MB, VmSize: 803 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.207716 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/tmp-legacysurvey-custom-336792m55162-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/tmp-legacysurvey-custom-336792m55162-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.31 s, CPU: 1.43 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 248 MB, VmData: 274 MB, maxrss: 0.253664 MB
Stage wise_forced finished: 2020-08-16T19:58:53.073360
Resources for stage wise_forced : 3.214 s worker CPU, 5.440 s worker Wall, Wall: 3.317 s, Cores in use: 1.40, Total efficiency (on 32 cores): 4.4 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-16T19:58:53.093546
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/coadd/cus/custom-336792m55162/legacysurvey-custom-336792m55162-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/tractor-i/cus/tractor-custom-336792m55162.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/tractor/cus/tractor-custom-336792m55162.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/tractor/cus/brick-custom-336792m55162.sha256sum
Stage writecat : Wall: 1.25 s, CPU: 0.55 s, VmPeak: 1178 MB, VmSize: 1050 MB, VmRSS: 250 MB, VmData: 274 MB, maxrss: 0.386652 MB
Stage writecat finished: 2020-08-16T19:58:54.339866
Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 1.249 s, Cores in use: 0.44, Total efficiency (on 32 cores): 1.4 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC412095/PGC412095-largegalaxy-writecat.p
All done: 77.437 s worker CPU, 890.715 s worker Wall, Wall: 76.315 s, Cores in use: 1.17, Total efficiency (on 32 cores): 3.7 %
Finished galaxy PGC412095 in 1.327 minutes.