Started working on galaxy PGC370638 at Wed Aug  5 19:42:36 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 318.89775 -59.542198 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T19:42:43.300892
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '318.89775', '-59.542198', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 318.89775 -59.542198 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 318.89775 -59.542198
Starting process 2508 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 2509 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 2510 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 2511 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 2512 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB
Starting process 2513 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059324 MB
Starting process 2514 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 2515 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 2516 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 2517 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 2518 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 2519 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 2520 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 2521 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 2522 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 2523 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T19:42:44.586676
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 25 CCDs:
  c4d_160901_055047_ooi_g_ls9-S15 g expnum 569857 exptime 90.0 propid 2012B-0001 seeing 1.37 MJD 57632.242 object DES survey hex -406-603 tiling 5 
    decam/CP/V4.8.2a/CP20160831/c4d_160901_055047_ooi_g_ls9.fits.fz
  c4d_151017_001800_ooi_z_ls9-S15 z expnum 484788 exptime 90.0 propid 2012B-0001 seeing 0.95 MJD 57312.011 object DES survey hex -406-603 tiling 5 
    decam/CP/V4.8.2a/CP20151016/c4d_151017_001800_ooi_z_ls9.fits.fz
  c4d_151017_001958_ooi_r_ls9-S15 r expnum 484789 exptime 90.0 propid 2012B-0001 seeing 1.08 MJD 57312.012 object DES survey hex -406-603 tiling 5 
    decam/CP/V4.8.2a/CP20151016/c4d_151017_001958_ooi_r_ls9.fits.fz
  c4d_170924_012411_ooi_z_v1-N28 z expnum 680700 exptime 90.0 propid 2012B-0001 seeing 0.73 MJD 58020.058 object DES survey hex -441-592 tiling 7 
    decam/CP/V4.1/CP20170923/c4d_170924_012411_ooi_z_v1.fits.fz
  c4d_160930_005302_ooi_r_ls9-N28 r expnum 578940 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 57661.035 object DES survey hex -441-592 tiling 7 
    decam/CP/V4.8.2a/CP20160929/c4d_160930_005302_ooi_r_ls9.fits.fz
  c4d_160930_005658_ooi_g_ls9-N28 g expnum 578942 exptime 90.0 propid 2012B-0001 seeing 1.26 MJD 57661.038 object DES survey hex -441-592 tiling 7 
    decam/CP/V4.8.2a/CP20160929/c4d_160930_005658_ooi_g_ls9.fits.fz
  c4d_160901_055047_ooi_g_ls9-S16 g expnum 569857 exptime 90.0 propid 2012B-0001 seeing 1.34 MJD 57632.242 object DES survey hex -406-603 tiling 5 
    decam/CP/V4.8.2a/CP20160831/c4d_160901_055047_ooi_g_ls9.fits.fz
  c4d_151017_001800_ooi_z_ls9-S16 z expnum 484788 exptime 90.0 propid 2012B-0001 seeing 0.95 MJD 57312.011 object DES survey hex -406-603 tiling 5 
    decam/CP/V4.8.2a/CP20151016/c4d_151017_001800_ooi_z_ls9.fits.fz
  c4d_151017_001958_ooi_r_ls9-S16 r expnum 484789 exptime 90.0 propid 2012B-0001 seeing 1.08 MJD 57312.012 object DES survey hex -406-603 tiling 5 
    decam/CP/V4.8.2a/CP20151016/c4d_151017_001958_ooi_r_ls9.fits.fz
  c4d_131010_010456_ooi_r_ls9-N18 r expnum 242396 exptime 90.0 propid 2012B-0001 seeing 0.89 MJD 56575.045 object DES survey hex -412-582 tiling 3 
    decam/CP/V4.8.2a/CP20131009/c4d_131010_010456_ooi_r_ls9.fits.fz
  c4d_130901_005324_ooi_g_ls9-N18 g expnum 229278 exptime 90.0 propid 2012B-0001 seeing 1.38 MJD 56536.037 object DES survey hex -412-582 tiling 3 
    decam/CP/V4.8.2a/CP20130831/c4d_130901_005324_ooi_g_ls9.fits.fz
  c4d_160925_001743_ooi_r_ls9-S11 r expnum 576840 exptime 90.0 propid 2012B-0001 seeing 1.24 MJD 57656.011 object DES survey hex -406-603 tiling 6 
    decam/CP/V4.8.2a/CP20160924/c4d_160925_001743_ooi_r_ls9.fits.fz
  c4d_160925_001943_ooi_g_ls9-S11 g expnum 576841 exptime 90.0 propid 2012B-0001 seeing 1.40 MJD 57656.012 object DES survey hex -406-603 tiling 6 
    decam/CP/V4.8.2a/CP20160924/c4d_160925_001943_ooi_g_ls9.fits.fz
  c4d_160911_020659_ooi_z_ls9-S11 z expnum 573403 exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 57642.087 object DES survey hex -406-603 tiling 6 
    decam/CP/V4.8.2a/CP20160910/c4d_160911_020659_ooi_z_ls9.fits.fz
  c4d_140904_010005_ooi_z_ls9-S12 z expnum 355220 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 56904.040 object DES survey hex -406-603 tiling 2 
    decam/CP/V4.8.2a/CP20140903/c4d_140904_010005_ooi_z_ls9.fits.fz
  c4d_170919_015154_ooi_g_v1-S30 g expnum 679219 exptime 90.0 propid 2012B-0001 seeing 1.88 MJD 58015.078 object DES survey hex -406-603 tiling 8 
    decam/CP/V4.1/CP20170918/c4d_170919_015154_ooi_g_v1.fits.fz
  c4d_170908_021954_ooi_z_v1-S30 z expnum 675579 exptime 90.0 propid 2012B-0001 seeing 1.27 MJD 58004.097 object DES survey hex -406-603 tiling 8 
    decam/CP/V4.1/CP20170907/c4d_170908_021954_ooi_z_v1.fits.fz
  c4d_170924_020404_ooi_r_v1-S30 r expnum 680720 exptime 90.0 propid 2012B-0001 seeing 0.91 MJD 58020.086 object DES survey hex -406-603 tiling 8 
    decam/CP/V4.1/CP20170923/c4d_170924_020404_ooi_r_v1.fits.fz
  c4d_170924_020800_ooi_g_v1-S30 g expnum 680722 exptime 90.0 propid 2012B-0001 seeing 1.03 MJD 58020.089 object DES survey hex -406-603 tiling 8 
    decam/CP/V4.1/CP20170923/c4d_170924_020800_ooi_g_v1.fits.fz
  c4d_130908_011212_ooi_g_ls9-N3 g expnum 231448 exptime 90.0 propid 2012B-0001 seeing 1.57 MJD 56543.050 object DES survey hex -406-603 tiling 4 
    decam/CP/V4.8.2a/CP20130907/c4d_130908_011212_ooi_g_ls9.fits.fz
  c4d_130929_002333_ooi_r_ls9-N3 r expnum 239206 exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 56564.016 object DES survey hex -406-603 tiling 4 
    decam/CP/V4.8.2a/CP20130928/c4d_130929_002333_ooi_r_ls9.fits.fz
  c4d_130923_003115_ooi_g_ls9-N3 g expnum 237649 exptime 90.0 propid 2012B-0001 seeing 1.42 MJD 56558.022 object DES survey hex -406-603 tiling 4 
    decam/CP/V4.8.2a/CP20130922/c4d_130923_003115_ooi_g_ls9.fits.fz
  c4d_140915_020516_ooi_r_ls9-S26 r expnum 359152 exptime 90.0 propid 2012B-0001 seeing 1.44 MJD 56915.085 object DES survey hex -406-603 tiling 1 
    decam/CP/V4.8.2a/CP20140914/c4d_140915_020516_ooi_r_ls9.fits.fz
  c4d_141002_003033_ooi_z_ls9-S26 z expnum 364539 exptime 90.0 propid 2012B-0001 seeing 0.91 MJD 56932.020 object DES survey hex -406-603 tiling 1 
    decam/CP/V4.8.2a/CP20141001/c4d_141002_003033_ooi_z_ls9.fits.fz
  c4d_181021_002937_ooi_z_v1-S10 z expnum 785719 exptime 90.0 propid 2012B-0001 seeing 0.87 MJD 58412.021 object DES survey hex -406-603 tiling 10 
    decam/CP/V4.1/CP20181020/c4d_181021_002937_ooi_z_v1.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170917_8f9b913-g-20170919T015154_oi[S30,noinherit][2046,4094][real]: DE
Zeroing out 246 weight-map pixels below quantization error (= median 0.000328)
Clipping 1 pixels with anomalously large oow values: max 0.0629155 vs median 0.0477972
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962aa8f-g-20160925T001722_oi[S11,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9627f4e-g-20160901T054826_oi[S15,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9627f4e-g-20160901T054826_oi[S16,noinherit][2046,4094][real]: DES sur
Clipping 1 pixels with anomalously large oow values: max 0.050007 vs median 0.0378973
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c605-g-20160930T005438_oi[N28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616298-z-20140904T005744_oi[S12,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c053-r-20160925T001523_oi[S11,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b000-z-20160911T020439_oi[S11,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9634008-r-20131010T010456_oi[N18,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962d087-r-20160930T005039_oi[N28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9622f50-r-20151017T001738_oi[S16,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962286b-z-20151017T001540_oi[S15,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9622f50-r-20151017T001738_oi[S15,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962286b-z-20151017T001540_oi[S16,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962fa53-g-20130901T005324_oi[N18,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-z-20170924T012411_oi[N28,noinherit][2046,4094][real]: DE
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-r-20170924T020404_oi[S30,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9633379-g-20130908T011212_oi[N3,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170906_8f8458f-z-20170908T021954_oi[S30,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-g-20170924T020800_oi[S30,noinherit][2046,4094][real]: DE
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 4 weight-map pixels below quantization error (= median 4.16e-06)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96334f7-r-20130929T002333_oi[N3,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9615034-r-20140915T020256_oi[S26,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_963392e-g-20130923T003115_oi[N3,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96171a4-z-20141002T002813_oi[S26,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20181017_92f9aa3-z-20181021T002937_oi[S10,noinherit][2046,4094][real]: DE
Zeroing out 3444 weight-map pixels below quantization error (= median 2.27e-06)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 95.76 s, CPU: 2.09 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 187 MB, VmData: 220 MB, maxrss: 0.191656 MB
Stage tims finished: 2020-08-05T19:44:20.347769
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-z-20170924T012411_oi[N28,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9622f50-r-20151017T001738_oi[S16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962d087-r-20160930T005039_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9622f50-r-20151017T001738_oi[S15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962fa53-g-20130901T005324_oi[N18,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Zeroing out 247 weight-map pixels below quantization error (= median 5.31e-05)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9627f4e-g-20160901T054826_oi[S15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-r-20170924T020404_oi[S30,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170917_8f9b913-g-20170919T015154_oi[S30,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9633379-g-20130908T011212_oi[N3,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b000-z-20160911T020439_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9615034-r-20140915T020256_oi[S26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9634008-r-20131010T010456_oi[N18,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96171a4-z-20141002T002813_oi[S26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616298-z-20140904T005744_oi[S12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c053-r-20160925T001523_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_963392e-g-20130923T003115_oi[N3,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Resources for stage tims : 12.352 s worker CPU, 798.745 s worker Wall, Wall: 95.763 s, Cores in use: 0.15, Total efficiency (on 16 cores): 0.9 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962286b-z-20151017T001540_oi[S16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Zeroing out 247 weight-map pixels below quantization error (= median 0.000244)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962aa8f-g-20160925T001722_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-g-20170924T020800_oi[S30,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Zeroing out 246 weight-map pixels below quantization error (= median 3.78e-06)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9627f4e-g-20160901T054826_oi[S16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170906_8f8458f-z-20170908T021954_oi[S30,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962286b-z-20151017T001540_oi[S15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20181017_92f9aa3-z-20181021T002937_oi[S10,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T19:44:20.387097
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11518.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11438.fits
Matched 29 large galaxies to Gaia stars.
Matched 1 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/metrics/cus/reference-custom-318897m59542.fits
Stage refs : Wall: 11.14 s, CPU: 3.69 s, VmPeak: 1057 MB, VmSize: 1052 MB, VmRSS: 227 MB, VmData: 258 MB, maxrss: 0.232768 MB
Stage refs finished: 2020-08-05T19:44:31.528814
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c605-g-20160930T005438_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96334f7-r-20130929T002333_oi[N3,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 11.143 s, Cores in use: 0.33, Total efficiency (on 16 cores): 2.1 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T19:44:31.575333
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/metrics/cus/outlier-mask-custom-318897m59542.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/metrics/cus/outliers-pre-custom-318897m59542.jpg
Image c4d_130923_003115_ooi_g_ls9-N3 g : masking 493 positive outlier pixels and 0 negative outlier pixels
Image c4d_160930_005658_ooi_g_ls9-N28 g : masking 9558 positive outlier pixels and 0 negative outlier pixels
Image c4d_170924_020800_ooi_g_v1-S30 g : masking 713 positive outlier pixels and 0 negative outlier pixels
Image c4d_160930_005302_ooi_r_ls9-N28 r : masking 5318 positive outlier pixels and 0 negative outlier pixels
Image c4d_140915_020516_ooi_r_ls9-S26 r : masking 0 positive outlier pixels and 207 negative outlier pixels
Image c4d_170924_020404_ooi_r_v1-S30 r : masking 462 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/metrics/cus/outlier-mask-custom-318897m59542.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/metrics/cus/outliers-post-custom-318897m59542.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/metrics/cus/outliers-masked-pos-custom-318897m59542.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/metrics/cus/outliers-masked-neg-custom-318897m59542.jpg
Stage outliers : Wall: 2.52 s, CPU: 2.31 s, VmPeak: 1062 MB, VmSize: 1062 MB, VmRSS: 247 MB, VmData: 274 MB, maxrss: 0.252756 MB
Stage outliers finished: 2020-08-05T19:44:34.097091
Resources for stage outliers : 1.397 s worker CPU, 1.430 s worker Wall, Wall: 2.523 s, Cores in use: 1.47, Total efficiency (on 16 cores): 9.2 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T19:44:34.144420
Stage halos : Wall: 1.40 s, CPU: 0.88 s, VmPeak: 1062 MB, VmSize: 1062 MB, VmRSS: 247 MB, VmData: 275 MB, maxrss: 0.253208 MB
Stage halos finished: 2020-08-05T19:44:35.541247
Resources for stage halos : 1.677 s worker CPU, 3.621 s worker Wall, Wall: 1.398 s, Cores in use: 1.83, Total efficiency (on 16 cores): 11.4 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T19:44:35.583871
PSF sigmas in coadd pixels: ['2.22', '2.05', '2.17', '2.24', '2.28', '3.05', '1.68', '2.54', '2.31']
Using average PSF sigma 2.2826198548600316
Gaussian PSF norm 0.12358378079173239 vs pixelized 0.10403496
average tim pixel scale / coadd scale: 1.001040611632936
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.70', '1.76', '1.44', '2.01', '1.48', '1.59', '2.33']
Using average PSF sigma 1.7593163623012167
Gaussian PSF norm 0.16034341396387244 vs pixelized 0.13312745
average tim pixel scale / coadd scale: 1.0010433204790967
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.19', '1.54', '2.03', '1.79', '2.06', '1.48', '1.41']
Using average PSF sigma 1.6420956073184487
Gaussian PSF norm 0.17178950514004512 vs pixelized 0.13751507
average tim pixel scale / coadd scale: 1.0009796506925328
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.26 s, CPU: 0.26 s, VmPeak: 1062 MB, VmSize: 1062 MB, VmRSS: 249 MB, VmData: 275 MB, maxrss: 0.255456 MB
Stage fit_on_coadds finished: 2020-08-05T19:44:35.841636
Resources for stage fit_on_coadds : 0.393 s worker CPU, 0.393 s worker Wall, Wall: 0.259 s, Cores in use: 2.53, Total efficiency (on 16 cores): 15.8 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T19:44:35.852527
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 46 potential peaks
Of 46 potential peaks: 25 in veto map, 4 cut by saddle test, 1 cut by aper test, 16 kept
SED z : 16 new peaks
Found 26 potential peaks
Of 26 potential peaks: 18 in veto map, 3 cut by saddle test, 0 cut by aper test, 5 kept
SED r : 5 new peaks
Found 23 potential peaks
Of 23 potential peaks: 21 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 41 potential peaks
Of 41 potential peaks: 32 in veto map, 6 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 53 potential peaks
Of 53 potential peaks: 44 in veto map, 6 cut by saddle test, 0 cut by aper test, 3 kept
SED Red : 3 new peaks
Adding 28 new sources
Median coadd sky for g : -2.6397447e-05
Median coadd sky for r : 0.00012508288
Median coadd sky for z : 0.0030365584
Stage srcs : Wall: 0.62 s, CPU: 0.59 s, VmPeak: 1062 MB, VmSize: 1062 MB, VmRSS: 250 MB, VmData: 275 MB, maxrss: 0.25602 MB
Stage srcs finished: 2020-08-05T19:44:36.470560
Resources for stage srcs : 0.065 s worker CPU, 0.066 s worker Wall, Wall: 0.619 s, Cores in use: 1.06, Total efficiency (on 16 cores): 6.6 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T19:44:36.483084
Blob 1 of 15, id: 3, sources: 9, size: 156x138, npix 8581, brick X: 30,186, Y: 37,175, one pixel: 150 37
Blob 2 of 15, id: 6, sources: 2, size: 57x108, npix 3969, brick X: 0,57, Y: 133,241, one pixel: 11 133
Blob 3 of 15, id: 1, sources: 3, size: 63x94, npix 3103, brick X: 0,63, Y: 3,97, one pixel: 8 3
Blob 4 of 15, id: 0, sources: 4, size: 79x47, npix 2315, brick X: 143,222, Y: 0,47, one pixel: 149 0
Blob 5 of 15, id: 8, sources: 3, size: 43x44, npix 1065, brick X: 95,138, Y: 174,218, one pixel: 120 174
Blob 6 of 15, id: 12, sources: 2, size: 37x42, npix 825, brick X: 164,201, Y: 203,245, one pixel: 175 203
Blob 7 of 15, id: 13, sources: 1, size: 32x33, npix 562, brick X: 117,149, Y: 205,238, one pixel: 130 205
Blob 8 of 15, id: 2, sources: 1, size: 28x26, npix 482, brick X: 119,147, Y: 16,42, one pixel: 132 16
Blob 9 of 15, id: 5, sources: 1, size: 24x24, npix 365, brick X: 145,169, Y: 77,101, one pixel: 154 77
Blob 10 of 15, id: 4, sources: 1, size: 23x23, npix 337, brick X: 189,212, Y: 59,82, one pixel: 198 59
Blob 11 of 15, id: 7, sources: 1, size: 19x25, npix 315, brick X: 226,245, Y: 155,180, one pixel: 235 155
Blob 12 of 15, id: 10, sources: 1, size: 20x22, npix 250, brick X: 56,76, Y: 196,218, one pixel: 65 196
Blob 13 of 15, id: 11, sources: 1, size: 19x21, npix 227, brick X: 214,233, Y: 199,220, one pixel: 222 199
Blob 14 of 15, id: 9, sources: 1, size: 19x20, npix 200, brick X: 218,237, Y: 182,202, one pixel: 227 182
Blob 15 of 15, id: 14, sources: 1, size: 17x17, npix 161, brick X: 79,96, Y: 228,245, one pixel: 87 228
Blob 15 finished, total: Wall: 0.10 s, CPU: 0.07 s, VmPeak: 975 MB, VmSize: 733 MB, VmRSS: 147 MB, VmData: 182 MB, maxrss: 0.1506 MB
Blob 14 finished, total: Wall: 0.10 s, CPU: 0.07 s, VmPeak: 975 MB, VmSize: 738 MB, VmRSS: 150 MB, VmData: 187 MB, maxrss: 0.153928 MB
Blob 12 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 1035 MB, VmSize: 734 MB, VmRSS: 149 MB, VmData: 182 MB, maxrss: 0.152264 MB
Blob 9 finished, total: Wall: 0.37 s, CPU: 0.34 s, VmPeak: 1028 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 187 MB, maxrss: 0.15594 MB
Blob 7 finished, total: Wall: 0.58 s, CPU: 0.55 s, VmPeak: 973 MB, VmSize: 733 MB, VmRSS: 148 MB, VmData: 182 MB, maxrss: 0.15112 MB
Blob 13 finished, total: Wall: 0.58 s, CPU: 0.54 s, VmPeak: 936 MB, VmSize: 734 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151944 MB
Blob 10 finished, total: Wall: 1.13 s, CPU: 1.09 s, VmPeak: 940 MB, VmSize: 734 MB, VmRSS: 149 MB, VmData: 183 MB, maxrss: 0.152128 MB
Blob 5 finished, total: Wall: 1.23 s, CPU: 1.20 s, VmPeak: 1016 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149952 MB
Blob 8 finished, total: Wall: 1.28 s, CPU: 1.25 s, VmPeak: 936 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144864 MB
Blob 4 finished, total: Wall: 1.57 s, CPU: 1.55 s, VmPeak: 1010 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.151 MB
Blob 2 finished, total: Wall: 1.70 s, CPU: 1.67 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149812 MB
Blob 11 finished, total: Wall: 1.79 s, CPU: 1.77 s, VmPeak: 952 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150376 MB
Blob 6 finished, total: Wall: 2.54 s, CPU: 2.54 s, VmPeak: 971 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.15114 MB
Blob 3 finished, total: Wall: 2.80 s, CPU: 2.79 s, VmPeak: 939 MB, VmSize: 734 MB, VmRSS: 150 MB, VmData: 183 MB, maxrss: 0.153316 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.35837, ee1=0.463807, ee2=-0.26903
Blob 1 finished, total: Wall: 10.47 s, CPU: 10.45 s, VmPeak: 1031 MB, VmSize: 733 MB, VmRSS: 150 MB, VmData: 182 MB, maxrss: 0.1539 MB
Old catalog: 40
New catalog: 26
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/metrics/cus/blobs-custom-318897m59542.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/metrics/cus/all-models-custom-318897m59542.fits
Stage fitblobs : Wall: 11.36 s, CPU: 0.55 s, VmPeak: 1062 MB, VmSize: 1062 MB, VmRSS: 250 MB, VmData: 275 MB, maxrss: 0.256184 MB
Stage fitblobs finished: 2020-08-05T19:44:47.843273
Resources for stage fitblobs : 26.359 s worker CPU, 26.881 s worker Wall, Wall: 11.362 s, Cores in use: 2.37, Total efficiency (on 16 cores): 14.8 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T19:44:47.863343
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/tmp-legacysurvey-custom-318897m59542-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/tmp-legacysurvey-custom-318897m59542-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/tmp-legacysurvey-custom-318897m59542-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/tmp-legacysurvey-custom-318897m59542-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-resid.jpg
Stage coadds : Wall: 3.77 s, CPU: 2.30 s, VmPeak: 1062 MB, VmSize: 1062 MB, VmRSS: 251 MB, VmData: 275 MB, maxrss: 0.256632 MB
Stage coadds finished: 2020-08-05T19:44:51.629099
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 7.421 s worker CPU, 10.145 s worker Wall, Wall: 3.767 s, Cores in use: 2.58, Total efficiency (on 16 cores): 16.1 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-05T19:44:51.644937
Cut to 1 unWISE tiles
Reading WISE tile 3196m591 band 3
Reading WISE tile 3196m591 band 4
Reading WISE tile 3196m591 band 1
Reading WISE tile 3196m591 band 2
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 1028 MB, VmSize: 812 MB, VmRSS: 152 MB, VmData: 177 MB, maxrss: 0.198336 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 952 MB, VmSize: 809 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.212272 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 973 MB, VmSize: 810 MB, VmRSS: 149 MB, VmData: 175 MB, maxrss: 0.211896 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 1020 MB, VmSize: 806 MB, VmRSS: 146 MB, VmData: 175 MB, maxrss: 0.208544 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/tmp-legacysurvey-custom-318897m59542-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/tmp-legacysurvey-custom-318897m59542-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.22 s, CPU: 1.05 s, VmPeak: 1062 MB, VmSize: 1062 MB, VmRSS: 251 MB, VmData: 275 MB, maxrss: 0.257216 MB
Stage wise_forced finished: 2020-08-05T19:44:54.867042
Resources for stage wise_forced : 2.962 s worker CPU, 5.418 s worker Wall, Wall: 3.223 s, Cores in use: 1.24, Total efficiency (on 16 cores): 7.8 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T19:44:54.884341
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/tractor-i/cus/tractor-custom-318897m59542.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/tractor/cus/tractor-custom-318897m59542.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/tractor/cus/brick-custom-318897m59542.sha256sum
Stage writecat : Wall: 3.53 s, CPU: 1.59 s, VmPeak: 1195 MB, VmSize: 1067 MB, VmRSS: 253 MB, VmData: 275 MB, maxrss: 0.390092 MB
Stage writecat finished: 2020-08-05T19:44:58.415730
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.533 s, Cores in use: 0.45, Total efficiency (on 16 cores): 2.8 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-writecat.p
All done: 52.630 s worker CPU, 846.702 s worker Wall, Wall: 133.854 s, Cores in use: 0.51, Total efficiency (on 16 cores): 3.2 %
Finished galaxy PGC370638 in 2.376 minutes.
Started working on galaxy PGC370638 at Wed Aug  5 20:28:07 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 318.89775 -59.542198 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T20:28:10.710670
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '318.89775', '-59.542198', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 318.89775 -59.542198 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 318.89775 -59.542198
Starting process 12426 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 12428 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 12430 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 12432 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 12433 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB
Starting process 12435 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 12437 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 12440 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 12442 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 12445 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 12447 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 12451 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 12452 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 12453 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 12454 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 12455 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 12456 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 12458 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 12459 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 12461 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 12462 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 12463 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 12464 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 12465 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 12466 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 12467 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 12468 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 12469 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 12470 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 12471 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 12472 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 12473 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T20:28:13.001507
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 25 CCDs:
  c4d_160901_055047_ooi_g_ls9-S15 g expnum 569857 exptime 90.0 propid 2012B-0001 seeing 1.37 MJD 57632.242 object DES survey hex -406-603 tiling 5 
    decam/CP/V4.8.2a/CP20160831/c4d_160901_055047_ooi_g_ls9.fits.fz
  c4d_151017_001800_ooi_z_ls9-S15 z expnum 484788 exptime 90.0 propid 2012B-0001 seeing 0.95 MJD 57312.011 object DES survey hex -406-603 tiling 5 
    decam/CP/V4.8.2a/CP20151016/c4d_151017_001800_ooi_z_ls9.fits.fz
  c4d_151017_001958_ooi_r_ls9-S15 r expnum 484789 exptime 90.0 propid 2012B-0001 seeing 1.08 MJD 57312.012 object DES survey hex -406-603 tiling 5 
    decam/CP/V4.8.2a/CP20151016/c4d_151017_001958_ooi_r_ls9.fits.fz
  c4d_170924_012411_ooi_z_v1-N28 z expnum 680700 exptime 90.0 propid 2012B-0001 seeing 0.73 MJD 58020.058 object DES survey hex -441-592 tiling 7 
    decam/CP/V4.1/CP20170923/c4d_170924_012411_ooi_z_v1.fits.fz
  c4d_160930_005302_ooi_r_ls9-N28 r expnum 578940 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 57661.035 object DES survey hex -441-592 tiling 7 
    decam/CP/V4.8.2a/CP20160929/c4d_160930_005302_ooi_r_ls9.fits.fz
  c4d_160930_005658_ooi_g_ls9-N28 g expnum 578942 exptime 90.0 propid 2012B-0001 seeing 1.26 MJD 57661.038 object DES survey hex -441-592 tiling 7 
    decam/CP/V4.8.2a/CP20160929/c4d_160930_005658_ooi_g_ls9.fits.fz
  c4d_160901_055047_ooi_g_ls9-S16 g expnum 569857 exptime 90.0 propid 2012B-0001 seeing 1.34 MJD 57632.242 object DES survey hex -406-603 tiling 5 
    decam/CP/V4.8.2a/CP20160831/c4d_160901_055047_ooi_g_ls9.fits.fz
  c4d_151017_001800_ooi_z_ls9-S16 z expnum 484788 exptime 90.0 propid 2012B-0001 seeing 0.95 MJD 57312.011 object DES survey hex -406-603 tiling 5 
    decam/CP/V4.8.2a/CP20151016/c4d_151017_001800_ooi_z_ls9.fits.fz
  c4d_151017_001958_ooi_r_ls9-S16 r expnum 484789 exptime 90.0 propid 2012B-0001 seeing 1.08 MJD 57312.012 object DES survey hex -406-603 tiling 5 
    decam/CP/V4.8.2a/CP20151016/c4d_151017_001958_ooi_r_ls9.fits.fz
  c4d_131010_010456_ooi_r_ls9-N18 r expnum 242396 exptime 90.0 propid 2012B-0001 seeing 0.89 MJD 56575.045 object DES survey hex -412-582 tiling 3 
    decam/CP/V4.8.2a/CP20131009/c4d_131010_010456_ooi_r_ls9.fits.fz
  c4d_130901_005324_ooi_g_ls9-N18 g expnum 229278 exptime 90.0 propid 2012B-0001 seeing 1.38 MJD 56536.037 object DES survey hex -412-582 tiling 3 
    decam/CP/V4.8.2a/CP20130831/c4d_130901_005324_ooi_g_ls9.fits.fz
  c4d_160925_001743_ooi_r_ls9-S11 r expnum 576840 exptime 90.0 propid 2012B-0001 seeing 1.24 MJD 57656.011 object DES survey hex -406-603 tiling 6 
    decam/CP/V4.8.2a/CP20160924/c4d_160925_001743_ooi_r_ls9.fits.fz
  c4d_160925_001943_ooi_g_ls9-S11 g expnum 576841 exptime 90.0 propid 2012B-0001 seeing 1.40 MJD 57656.012 object DES survey hex -406-603 tiling 6 
    decam/CP/V4.8.2a/CP20160924/c4d_160925_001943_ooi_g_ls9.fits.fz
  c4d_160911_020659_ooi_z_ls9-S11 z expnum 573403 exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 57642.087 object DES survey hex -406-603 tiling 6 
    decam/CP/V4.8.2a/CP20160910/c4d_160911_020659_ooi_z_ls9.fits.fz
  c4d_140904_010005_ooi_z_ls9-S12 z expnum 355220 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 56904.040 object DES survey hex -406-603 tiling 2 
    decam/CP/V4.8.2a/CP20140903/c4d_140904_010005_ooi_z_ls9.fits.fz
  c4d_170919_015154_ooi_g_v1-S30 g expnum 679219 exptime 90.0 propid 2012B-0001 seeing 1.88 MJD 58015.078 object DES survey hex -406-603 tiling 8 
    decam/CP/V4.1/CP20170918/c4d_170919_015154_ooi_g_v1.fits.fz
  c4d_170908_021954_ooi_z_v1-S30 z expnum 675579 exptime 90.0 propid 2012B-0001 seeing 1.27 MJD 58004.097 object DES survey hex -406-603 tiling 8 
    decam/CP/V4.1/CP20170907/c4d_170908_021954_ooi_z_v1.fits.fz
  c4d_170924_020404_ooi_r_v1-S30 r expnum 680720 exptime 90.0 propid 2012B-0001 seeing 0.91 MJD 58020.086 object DES survey hex -406-603 tiling 8 
    decam/CP/V4.1/CP20170923/c4d_170924_020404_ooi_r_v1.fits.fz
  c4d_170924_020800_ooi_g_v1-S30 g expnum 680722 exptime 90.0 propid 2012B-0001 seeing 1.03 MJD 58020.089 object DES survey hex -406-603 tiling 8 
    decam/CP/V4.1/CP20170923/c4d_170924_020800_ooi_g_v1.fits.fz
  c4d_130908_011212_ooi_g_ls9-N3 g expnum 231448 exptime 90.0 propid 2012B-0001 seeing 1.57 MJD 56543.050 object DES survey hex -406-603 tiling 4 
    decam/CP/V4.8.2a/CP20130907/c4d_130908_011212_ooi_g_ls9.fits.fz
  c4d_130929_002333_ooi_r_ls9-N3 r expnum 239206 exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 56564.016 object DES survey hex -406-603 tiling 4 
    decam/CP/V4.8.2a/CP20130928/c4d_130929_002333_ooi_r_ls9.fits.fz
  c4d_130923_003115_ooi_g_ls9-N3 g expnum 237649 exptime 90.0 propid 2012B-0001 seeing 1.42 MJD 56558.022 object DES survey hex -406-603 tiling 4 
    decam/CP/V4.8.2a/CP20130922/c4d_130923_003115_ooi_g_ls9.fits.fz
  c4d_140915_020516_ooi_r_ls9-S26 r expnum 359152 exptime 90.0 propid 2012B-0001 seeing 1.44 MJD 56915.085 object DES survey hex -406-603 tiling 1 
    decam/CP/V4.8.2a/CP20140914/c4d_140915_020516_ooi_r_ls9.fits.fz
  c4d_141002_003033_ooi_z_ls9-S26 z expnum 364539 exptime 90.0 propid 2012B-0001 seeing 0.91 MJD 56932.020 object DES survey hex -406-603 tiling 1 
    decam/CP/V4.8.2a/CP20141001/c4d_141002_003033_ooi_z_ls9.fits.fz
  c4d_181021_002937_ooi_z_v1-S10 z expnum 785719 exptime 90.0 propid 2012B-0001 seeing 0.87 MJD 58412.021 object DES survey hex -406-603 tiling 10 
    decam/CP/V4.1/CP20181020/c4d_181021_002937_ooi_z_v1.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9633379-g-20130908T011212_oi[N3,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170917_8f9b913-g-20170919T015154_oi[S30,noinherit][2046,4094][real]: DE
Zeroing out 246 weight-map pixels below quantization error (= median 0.000328)
Clipping 1 pixels with anomalously large oow values: max 0.0629155 vs median 0.0477972
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96334f7-r-20130929T002333_oi[N3,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-z-20170924T012411_oi[N28,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c605-g-20160930T005438_oi[N28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96171a4-z-20141002T002813_oi[S26,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-r-20170924T020404_oi[S30,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c053-r-20160925T001523_oi[S11,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962aa8f-g-20160925T001722_oi[S11,noinherit][2046,4094][real]: DES sur
Clipping 1 pixels with anomalously large oow values: max 0.050007 vs median 0.0378973
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_963392e-g-20130923T003115_oi[N3,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20181017_92f9aa3-z-20181021T002937_oi[S10,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9627f4e-g-20160901T054826_oi[S15,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9627f4e-g-20160901T054826_oi[S16,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616298-z-20140904T005744_oi[S12,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b000-z-20160911T020439_oi[S11,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962fa53-g-20130901T005324_oi[N18,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9634008-r-20131010T010456_oi[N18,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962d087-r-20160930T005039_oi[N28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-g-20170924T020800_oi[S30,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9615034-r-20140915T020256_oi[S26,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170906_8f8458f-z-20170908T021954_oi[S30,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962286b-z-20151017T001540_oi[S15,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962286b-z-20151017T001540_oi[S16,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9622f50-r-20151017T001738_oi[S15,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9622f50-r-20151017T001738_oi[S16,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 4 weight-map pixels below quantization error (= median 4.16e-06)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 3444 weight-map pixels below quantization error (= median 2.27e-06)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 247 weight-map pixels below quantization error (= median 5.31e-05)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 246 weight-map pixels below quantization error (= median 3.78e-06)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 247 weight-map pixels below quantization error (= median 0.000244)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 117.41 s, CPU: 1.87 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 187 MB, VmData: 220 MB, maxrss: 0.191704 MB
Stage tims finished: 2020-08-05T20:30:10.412429
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9633379-g-20130908T011212_oi[N3,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c605-g-20160930T005438_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96171a4-z-20141002T002813_oi[S26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96334f7-r-20130929T002333_oi[N3,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20181017_92f9aa3-z-20181021T002937_oi[S10,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962aa8f-g-20160925T001722_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9634008-r-20131010T010456_oi[N18,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-z-20170924T012411_oi[N28,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962286b-z-20151017T001540_oi[S16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-g-20170924T020800_oi[S30,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9627f4e-g-20160901T054826_oi[S15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170906_8f8458f-z-20170908T021954_oi[S30,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962d087-r-20160930T005039_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962286b-z-20151017T001540_oi[S15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616298-z-20140904T005744_oi[S12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_963392e-g-20130923T003115_oi[N3,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 16.656 s worker CPU, 1499.273 s worker Wall, Wall: 117.413 s, Cores in use: 0.16, Total efficiency (on 32 cores): 0.5 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-r-20170924T020404_oi[S30,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b000-z-20160911T020439_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9627f4e-g-20160901T054826_oi[S16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962fa53-g-20130901T005324_oi[N18,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c053-r-20160925T001523_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9622f50-r-20151017T001738_oi[S15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9622f50-r-20151017T001738_oi[S16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9615034-r-20140915T020256_oi[S26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T20:30:10.493504
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11518.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11438.fits
Matched 29 large galaxies to Gaia stars.
Matched 1 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/metrics/cus/reference-custom-318897m59542.fits
Stage refs : Wall: 9.97 s, CPU: 4.43 s, VmPeak: 1057 MB, VmSize: 1052 MB, VmRSS: 227 MB, VmData: 258 MB, maxrss: 0.232436 MB
Stage refs finished: 2020-08-05T20:30:20.461933
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.971 s, Cores in use: 0.44, Total efficiency (on 32 cores): 1.4 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T20:30:20.510056
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/metrics/cus/outlier-mask-custom-318897m59542.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/metrics/cus/outliers-pre-custom-318897m59542.jpg
Image c4d_160930_005658_ooi_g_ls9-N28 g : masking 9558 positive outlier pixels and 0 negative outlier pixels
Image c4d_170924_020800_ooi_g_v1-S30 g : masking 713 positive outlier pixels and 0 negative outlier pixels
Image c4d_130923_003115_ooi_g_ls9-N3 g : masking 493 positive outlier pixels and 0 negative outlier pixels
Image c4d_170924_020404_ooi_r_v1-S30 r : masking 462 positive outlier pixels and 0 negative outlier pixels
Image c4d_140915_020516_ooi_r_ls9-S26 r : masking 0 positive outlier pixels and 207 negative outlier pixels
Image c4d_160930_005302_ooi_r_ls9-N28 r : masking 5318 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/metrics/cus/outlier-mask-custom-318897m59542.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/metrics/cus/outliers-post-custom-318897m59542.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/metrics/cus/outliers-masked-pos-custom-318897m59542.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/metrics/cus/outliers-masked-neg-custom-318897m59542.jpg
Stage outliers : Wall: 2.05 s, CPU: 1.72 s, VmPeak: 1062 MB, VmSize: 1062 MB, VmRSS: 246 MB, VmData: 274 MB, maxrss: 0.251952 MB
Stage outliers finished: 2020-08-05T20:30:22.559042
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170917_8f9b913-g-20170919T015154_oi[S30,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage outliers : 1.517 s worker CPU, 1.831 s worker Wall, Wall: 2.051 s, Cores in use: 1.58, Total efficiency (on 32 cores): 4.9 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T20:30:22.605827
Stage halos : Wall: 1.52 s, CPU: 0.95 s, VmPeak: 1063 MB, VmSize: 1063 MB, VmRSS: 247 MB, VmData: 274 MB, maxrss: 0.252484 MB
Stage halos finished: 2020-08-05T20:30:24.122765
Resources for stage halos : 1.971 s worker CPU, 4.607 s worker Wall, Wall: 1.519 s, Cores in use: 1.93, Total efficiency (on 32 cores): 6.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T20:30:24.181485
PSF sigmas in coadd pixels: ['2.22', '2.05', '2.17', '2.24', '2.28', '3.05', '1.68', '2.54', '2.31']
Using average PSF sigma 2.2826198548600316
Gaussian PSF norm 0.12358378079173239 vs pixelized 0.10403496
average tim pixel scale / coadd scale: 1.001040611632936
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.70', '1.76', '1.44', '2.01', '1.48', '1.59', '2.33']
Using average PSF sigma 1.7593163623012167
Gaussian PSF norm 0.16034341396387244 vs pixelized 0.13312745
average tim pixel scale / coadd scale: 1.0010433204790967
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.19', '1.54', '2.03', '1.79', '2.06', '1.48', '1.41']
Using average PSF sigma 1.6420956073184487
Gaussian PSF norm 0.17178950514004512 vs pixelized 0.13751507
average tim pixel scale / coadd scale: 1.0009796506925328
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.33 s, CPU: 0.32 s, VmPeak: 1063 MB, VmSize: 1063 MB, VmRSS: 250 MB, VmData: 276 MB, maxrss: 0.255616 MB
Stage fit_on_coadds finished: 2020-08-05T20:30:24.508293
Resources for stage fit_on_coadds : 0.426 s worker CPU, 0.426 s worker Wall, Wall: 0.329 s, Cores in use: 2.27, Total efficiency (on 32 cores): 7.1 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T20:30:24.525000
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 46 potential peaks
Of 46 potential peaks: 25 in veto map, 4 cut by saddle test, 1 cut by aper test, 16 kept
SED z : 16 new peaks
Found 26 potential peaks
Of 26 potential peaks: 18 in veto map, 3 cut by saddle test, 0 cut by aper test, 5 kept
SED r : 5 new peaks
Found 23 potential peaks
Of 23 potential peaks: 21 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 41 potential peaks
Of 41 potential peaks: 32 in veto map, 6 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 53 potential peaks
Of 53 potential peaks: 44 in veto map, 6 cut by saddle test, 0 cut by aper test, 3 kept
SED Red : 3 new peaks
Adding 28 new sources
Median coadd sky for g : -2.6397447e-05
Median coadd sky for r : 0.00012508297
Median coadd sky for z : 0.0030365586
Stage srcs : Wall: 1.10 s, CPU: 1.06 s, VmPeak: 1063 MB, VmSize: 1063 MB, VmRSS: 250 MB, VmData: 276 MB, maxrss: 0.256312 MB
Stage srcs finished: 2020-08-05T20:30:25.625626
Resources for stage srcs : 0.073 s worker CPU, 0.073 s worker Wall, Wall: 1.103 s, Cores in use: 1.03, Total efficiency (on 32 cores): 3.2 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T20:30:25.643213
Blob 1 of 15, id: 3, sources: 9, size: 156x138, npix 8581, brick X: 30,186, Y: 37,175, one pixel: 150 37
Blob 2 of 15, id: 6, sources: 2, size: 57x108, npix 3969, brick X: 0,57, Y: 133,241, one pixel: 11 133
Blob 3 of 15, id: 1, sources: 3, size: 63x94, npix 3103, brick X: 0,63, Y: 3,97, one pixel: 8 3
Blob 4 of 15, id: 0, sources: 4, size: 79x47, npix 2315, brick X: 143,222, Y: 0,47, one pixel: 149 0
Blob 5 of 15, id: 8, sources: 3, size: 43x44, npix 1065, brick X: 95,138, Y: 174,218, one pixel: 120 174
Blob 6 of 15, id: 12, sources: 2, size: 37x42, npix 825, brick X: 164,201, Y: 203,245, one pixel: 175 203
Blob 7 of 15, id: 13, sources: 1, size: 32x33, npix 562, brick X: 117,149, Y: 205,238, one pixel: 130 205
Blob 8 of 15, id: 2, sources: 1, size: 28x26, npix 482, brick X: 119,147, Y: 16,42, one pixel: 132 16
Blob 9 of 15, id: 5, sources: 1, size: 24x24, npix 365, brick X: 145,169, Y: 77,101, one pixel: 154 77
Blob 10 of 15, id: 4, sources: 1, size: 23x23, npix 337, brick X: 189,212, Y: 59,82, one pixel: 198 59
Blob 11 of 15, id: 7, sources: 1, size: 19x25, npix 315, brick X: 226,245, Y: 155,180, one pixel: 235 155
Blob 12 of 15, id: 10, sources: 1, size: 20x22, npix 250, brick X: 56,76, Y: 196,218, one pixel: 65 196
Blob 13 of 15, id: 11, sources: 1, size: 19x21, npix 227, brick X: 214,233, Y: 199,220, one pixel: 222 199
Blob 14 of 15, id: 9, sources: 1, size: 19x20, npix 200, brick X: 218,237, Y: 182,202, one pixel: 227 182
Blob 15 of 15, id: 14, sources: 1, size: 17x17, npix 161, brick X: 79,96, Y: 228,245, one pixel: 87 228
Blob 15 finished, total: Wall: 0.07 s, CPU: 0.05 s, VmPeak: 940 MB, VmSize: 726 MB, VmRSS: 137 MB, VmData: 181 MB, maxrss: 0.14058 MB
Blob 14 finished, total: Wall: 0.10 s, CPU: 0.07 s, VmPeak: 934 MB, VmSize: 733 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.14962 MB
Blob 12 finished, total: Wall: 0.19 s, CPU: 0.17 s, VmPeak: 936 MB, VmSize: 733 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149796 MB
Blob 9 finished, total: Wall: 0.29 s, CPU: 0.27 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 113 MB, VmData: 166 MB, maxrss: 0.115368 MB
Blob 7 finished, total: Wall: 0.36 s, CPU: 0.34 s, VmPeak: 1016 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148096 MB
Blob 13 finished, total: Wall: 0.39 s, CPU: 0.36 s, VmPeak: 1011 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148532 MB
Blob 5 finished, total: Wall: 1.07 s, CPU: 1.05 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.09472 MB
Blob 8 finished, total: Wall: 1.05 s, CPU: 1.03 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095596 MB
Blob 10 finished, total: Wall: 1.11 s, CPU: 1.09 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095516 MB
Blob 11 finished, total: Wall: 1.50 s, CPU: 1.48 s, VmPeak: 936 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147192 MB
Blob 4 finished, total: Wall: 1.65 s, CPU: 1.63 s, VmPeak: 934 MB, VmSize: 733 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149896 MB
Blob 2 finished, total: Wall: 1.69 s, CPU: 1.66 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 113 MB, VmData: 165 MB, maxrss: 0.115204 MB
Blob 6 finished, total: Wall: 2.46 s, CPU: 2.43 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150504 MB
Blob 3 finished, total: Wall: 2.80 s, CPU: 2.78 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.1512 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.35837, ee1=0.463807, ee2=-0.26903
Blob 1 finished, total: Wall: 10.66 s, CPU: 10.65 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 181 MB, maxrss: 0.152456 MB
Old catalog: 40
New catalog: 26
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/metrics/cus/blobs-custom-318897m59542.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/metrics/cus/all-models-custom-318897m59542.fits
Stage fitblobs : Wall: 12.20 s, CPU: 1.47 s, VmPeak: 1063 MB, VmSize: 1063 MB, VmRSS: 250 MB, VmData: 276 MB, maxrss: 0.256476 MB
Stage fitblobs finished: 2020-08-05T20:30:37.841347
Resources for stage fitblobs : 25.290 s worker CPU, 26.443 s worker Wall, Wall: 12.201 s, Cores in use: 2.19, Total efficiency (on 32 cores): 6.9 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T20:30:37.857671
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/tmp-legacysurvey-custom-318897m59542-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/tmp-legacysurvey-custom-318897m59542-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/tmp-legacysurvey-custom-318897m59542-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/tmp-legacysurvey-custom-318897m59542-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-resid.jpg
Stage coadds : Wall: 2.87 s, CPU: 0.63 s, VmPeak: 1063 MB, VmSize: 1063 MB, VmRSS: 251 MB, VmData: 276 MB, maxrss: 0.256928 MB
Stage coadds finished: 2020-08-05T20:30:40.723819
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 29.474 s worker CPU, 46.693 s worker Wall, Wall: 2.868 s, Cores in use: 10.49, Total efficiency (on 32 cores): 32.8 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T20:30:40.741159
Cut to 1 unWISE tiles
Reading WISE tile 3196m591 band 1
Reading WISE tile 3196m591 band 2
Reading WISE tile 3196m591 band 4
Reading WISE tile 3196m591 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 952 MB, VmSize: 805 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.20886 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 956 MB, VmSize: 806 MB, VmRSS: 147 MB, VmData: 175 MB, maxrss: 0.191696 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 941 MB, VmSize: 804 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.206588 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 950 MB, VmSize: 805 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.207196 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/tmp-legacysurvey-custom-318897m59542-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/tmp-legacysurvey-custom-318897m59542-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.38 s, CPU: 0.98 s, VmPeak: 1063 MB, VmSize: 1063 MB, VmRSS: 251 MB, VmData: 276 MB, maxrss: 0.257508 MB
Stage wise_forced finished: 2020-08-05T20:30:44.119202
Resources for stage wise_forced : 3.460 s worker CPU, 5.626 s worker Wall, Wall: 3.380 s, Cores in use: 1.32, Total efficiency (on 32 cores): 4.1 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T20:30:44.137009
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/coadd/cus/custom-318897m59542/legacysurvey-custom-318897m59542-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/tractor-i/cus/tractor-custom-318897m59542.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/tractor/cus/tractor-custom-318897m59542.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/tractor/cus/brick-custom-318897m59542.sha256sum
Stage writecat : Wall: 1.96 s, CPU: 0.83 s, VmPeak: 1195 MB, VmSize: 1067 MB, VmRSS: 253 MB, VmData: 276 MB, maxrss: 0.390384 MB
Stage writecat finished: 2020-08-05T20:30:46.099727
Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 1.965 s, Cores in use: 0.43, Total efficiency (on 32 cores): 1.3 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/318/PGC370638/PGC370638-largegalaxy-writecat.p
All done: 78.873 s worker CPU, 1584.979 s worker Wall, Wall: 153.121 s, Cores in use: 0.61, Total efficiency (on 32 cores): 1.9 %
Finished galaxy PGC370638 in 2.651 minutes.
Started working on galaxy PGC370638 at Mon Aug 10 08:32:35 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 318.89666237488655 -59.54201661339707 --width 245 --height 245 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/PGC370638-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/PGC370638-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-10T08:32:36.474291
legacypipe git version: DR9.5.11-watershed-6-g6a2880fc
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '318.89666237488655', '-59.54201661339707', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/PGC370638-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/PGC370638-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 318.89666237488655 -59.54201661339707 --width 245 --height 245 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/PGC370638-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/PGC370638-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 318.89666237488655 -59.54201661339707
Starting process 39384 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05922 MB
Starting process 39385 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB
Starting process 39386 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB
Starting process 39387 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB
Starting process 39388 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059456 MB
Starting process 39389 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059468 MB
Starting process 39390 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059468 MB
Starting process 39391 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-10T08:32:36.997478
Keeping 25 CCDs:
  c4d_160901_055047_ooi_g_ls9-S15 g expnum 569857 exptime 90.0 propid 2012B-0001 seeing 1.37 MJD 57632.242 object DES survey hex -406-603 tiling 5 
    decam/CP/V4.8.2a/CP20160831/c4d_160901_055047_ooi_g_ls9.fits.fz
  c4d_151017_001800_ooi_z_ls9-S15 z expnum 484788 exptime 90.0 propid 2012B-0001 seeing 0.95 MJD 57312.011 object DES survey hex -406-603 tiling 5 
    decam/CP/V4.8.2a/CP20151016/c4d_151017_001800_ooi_z_ls9.fits.fz
  c4d_151017_001958_ooi_r_ls9-S15 r expnum 484789 exptime 90.0 propid 2012B-0001 seeing 1.08 MJD 57312.012 object DES survey hex -406-603 tiling 5 
    decam/CP/V4.8.2a/CP20151016/c4d_151017_001958_ooi_r_ls9.fits.fz
  c4d_170924_012411_ooi_z_v1-N28 z expnum 680700 exptime 90.0 propid 2012B-0001 seeing 0.73 MJD 58020.058 object DES survey hex -441-592 tiling 7 
    decam/CP/V4.1/CP20170923/c4d_170924_012411_ooi_z_v1.fits.fz
  c4d_160930_005302_ooi_r_ls9-N28 r expnum 578940 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 57661.035 object DES survey hex -441-592 tiling 7 
    decam/CP/V4.8.2a/CP20160929/c4d_160930_005302_ooi_r_ls9.fits.fz
  c4d_160930_005658_ooi_g_ls9-N28 g expnum 578942 exptime 90.0 propid 2012B-0001 seeing 1.26 MJD 57661.038 object DES survey hex -441-592 tiling 7 
    decam/CP/V4.8.2a/CP20160929/c4d_160930_005658_ooi_g_ls9.fits.fz
  c4d_160901_055047_ooi_g_ls9-S16 g expnum 569857 exptime 90.0 propid 2012B-0001 seeing 1.34 MJD 57632.242 object DES survey hex -406-603 tiling 5 
    decam/CP/V4.8.2a/CP20160831/c4d_160901_055047_ooi_g_ls9.fits.fz
  c4d_151017_001800_ooi_z_ls9-S16 z expnum 484788 exptime 90.0 propid 2012B-0001 seeing 0.95 MJD 57312.011 object DES survey hex -406-603 tiling 5 
    decam/CP/V4.8.2a/CP20151016/c4d_151017_001800_ooi_z_ls9.fits.fz
  c4d_151017_001958_ooi_r_ls9-S16 r expnum 484789 exptime 90.0 propid 2012B-0001 seeing 1.08 MJD 57312.012 object DES survey hex -406-603 tiling 5 
    decam/CP/V4.8.2a/CP20151016/c4d_151017_001958_ooi_r_ls9.fits.fz
  c4d_131010_010456_ooi_r_ls9-N18 r expnum 242396 exptime 90.0 propid 2012B-0001 seeing 0.89 MJD 56575.045 object DES survey hex -412-582 tiling 3 
    decam/CP/V4.8.2a/CP20131009/c4d_131010_010456_ooi_r_ls9.fits.fz
  c4d_130901_005324_ooi_g_ls9-N18 g expnum 229278 exptime 90.0 propid 2012B-0001 seeing 1.38 MJD 56536.037 object DES survey hex -412-582 tiling 3 
    decam/CP/V4.8.2a/CP20130831/c4d_130901_005324_ooi_g_ls9.fits.fz
  c4d_160925_001743_ooi_r_ls9-S11 r expnum 576840 exptime 90.0 propid 2012B-0001 seeing 1.24 MJD 57656.011 object DES survey hex -406-603 tiling 6 
    decam/CP/V4.8.2a/CP20160924/c4d_160925_001743_ooi_r_ls9.fits.fz
  c4d_160925_001943_ooi_g_ls9-S11 g expnum 576841 exptime 90.0 propid 2012B-0001 seeing 1.40 MJD 57656.012 object DES survey hex -406-603 tiling 6 
    decam/CP/V4.8.2a/CP20160924/c4d_160925_001943_ooi_g_ls9.fits.fz
  c4d_160911_020659_ooi_z_ls9-S11 z expnum 573403 exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 57642.087 object DES survey hex -406-603 tiling 6 
    decam/CP/V4.8.2a/CP20160910/c4d_160911_020659_ooi_z_ls9.fits.fz
  c4d_140904_010005_ooi_z_ls9-S12 z expnum 355220 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 56904.040 object DES survey hex -406-603 tiling 2 
    decam/CP/V4.8.2a/CP20140903/c4d_140904_010005_ooi_z_ls9.fits.fz
  c4d_170919_015154_ooi_g_v1-S30 g expnum 679219 exptime 90.0 propid 2012B-0001 seeing 1.88 MJD 58015.078 object DES survey hex -406-603 tiling 8 
    decam/CP/V4.1/CP20170918/c4d_170919_015154_ooi_g_v1.fits.fz
  c4d_170908_021954_ooi_z_v1-S30 z expnum 675579 exptime 90.0 propid 2012B-0001 seeing 1.27 MJD 58004.097 object DES survey hex -406-603 tiling 8 
    decam/CP/V4.1/CP20170907/c4d_170908_021954_ooi_z_v1.fits.fz
  c4d_170924_020404_ooi_r_v1-S30 r expnum 680720 exptime 90.0 propid 2012B-0001 seeing 0.91 MJD 58020.086 object DES survey hex -406-603 tiling 8 
    decam/CP/V4.1/CP20170923/c4d_170924_020404_ooi_r_v1.fits.fz
  c4d_170924_020800_ooi_g_v1-S30 g expnum 680722 exptime 90.0 propid 2012B-0001 seeing 1.03 MJD 58020.089 object DES survey hex -406-603 tiling 8 
    decam/CP/V4.1/CP20170923/c4d_170924_020800_ooi_g_v1.fits.fz
  c4d_130908_011212_ooi_g_ls9-N3 g expnum 231448 exptime 90.0 propid 2012B-0001 seeing 1.57 MJD 56543.050 object DES survey hex -406-603 tiling 4 
    decam/CP/V4.8.2a/CP20130907/c4d_130908_011212_ooi_g_ls9.fits.fz
  c4d_130929_002333_ooi_r_ls9-N3 r expnum 239206 exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 56564.016 object DES survey hex -406-603 tiling 4 
    decam/CP/V4.8.2a/CP20130928/c4d_130929_002333_ooi_r_ls9.fits.fz
  c4d_130923_003115_ooi_g_ls9-N3 g expnum 237649 exptime 90.0 propid 2012B-0001 seeing 1.42 MJD 56558.022 object DES survey hex -406-603 tiling 4 
    decam/CP/V4.8.2a/CP20130922/c4d_130923_003115_ooi_g_ls9.fits.fz
  c4d_140915_020516_ooi_r_ls9-S26 r expnum 359152 exptime 90.0 propid 2012B-0001 seeing 1.44 MJD 56915.085 object DES survey hex -406-603 tiling 1 
    decam/CP/V4.8.2a/CP20140914/c4d_140915_020516_ooi_r_ls9.fits.fz
  c4d_141002_003033_ooi_z_ls9-S26 z expnum 364539 exptime 90.0 propid 2012B-0001 seeing 0.91 MJD 56932.020 object DES survey hex -406-603 tiling 1 
    decam/CP/V4.8.2a/CP20141001/c4d_141002_003033_ooi_z_ls9.fits.fz
  c4d_181021_002937_ooi_z_v1-S10 z expnum 785719 exptime 90.0 propid 2012B-0001 seeing 0.87 MJD 58412.021 object DES survey hex -406-603 tiling 10 
    decam/CP/V4.1/CP20181020/c4d_181021_002937_ooi_z_v1.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9627f4e-g-20160901T054826_oi[S15,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9627f4e-g-20160901T054826_oi[S16,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962286b-z-20151017T001540_oi[S15,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962286b-z-20151017T001540_oi[S16,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9622f50-r-20151017T001738_oi[S15,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c605-g-20160930T005438_oi[N28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962d087-r-20160930T005039_oi[N28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-z-20170924T012411_oi[N28,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9622f50-r-20151017T001738_oi[S16,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9634008-r-20131010T010456_oi[N18,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962fa53-g-20130901T005324_oi[N18,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962aa8f-g-20160925T001722_oi[S11,noinherit][2046,4094][real]: DES sur
Clipping 1 pixels with anomalously large oow values: max 0.050007 vs median 0.0378973
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c053-r-20160925T001523_oi[S11,noinherit][2046,4094][real]: DES sur
Zeroing out 4 weight-map pixels below quantization error (= median 4.16e-06)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b000-z-20160911T020439_oi[S11,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170917_8f9b913-g-20170919T015154_oi[S30,noinherit][2046,4094][real]: DE
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616298-z-20140904T005744_oi[S12,noinherit][2046,4094][real]: DES sur
Zeroing out 246 weight-map pixels below quantization error (= median 0.000328)
Clipping 1 pixels with anomalously large oow values: max 0.0629155 vs median 0.0477972
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170906_8f8458f-z-20170908T021954_oi[S30,noinherit][2046,4094][real]: DE
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-r-20170924T020404_oi[S30,noinherit][2046,4094][real]: DE
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-g-20170924T020800_oi[S30,noinherit][2046,4094][real]: DE
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9633379-g-20130908T011212_oi[N3,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96334f7-r-20130929T002333_oi[N3,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9615034-r-20140915T020256_oi[S26,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_963392e-g-20130923T003115_oi[N3,noinherit][2046,4094][real]: DES surv
Zeroing out 246 weight-map pixels below quantization error (= median 5.31e-05)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96171a4-z-20141002T002813_oi[S26,noinherit][2046,4094][real]: DES sur
Zeroing out 246 weight-map pixels below quantization error (= median 0.000244)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20181017_92f9aa3-z-20181021T002937_oi[S10,noinherit][2046,4094][real]: DE
Stage tims : Wall: 176.44 s, CPU: 1.00 s, VmPeak: 1008 MB, VmSize: 1008 MB, VmRSS: 186 MB, VmData: 220 MB, maxrss: 0.190176 MB
Stage tims finished: 2020-08-10T08:35:33.440684
Zeroing out 247 weight-map pixels below quantization error (= median 3.78e-06)
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962286b-z-20151017T001540_oi[S15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9622f50-r-20151017T001738_oi[S16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170906_8f8458f-z-20170908T021954_oi[S30,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962d087-r-20160930T005039_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170917_8f9b913-g-20170919T015154_oi[S30,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9615034-r-20140915T020256_oi[S26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-z-20170924T012411_oi[N28,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b000-z-20160911T020439_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9633379-g-20130908T011212_oi[N3,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9627f4e-g-20160901T054826_oi[S15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c053-r-20160925T001523_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96334f7-r-20130929T002333_oi[N3,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Zeroing out 3444 weight-map pixels below quantization error (= median 2.27e-06)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962286b-z-20151017T001540_oi[S16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9634008-r-20131010T010456_oi[N18,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-r-20170924T020404_oi[S30,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96171a4-z-20141002T002813_oi[S26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9622f50-r-20151017T001738_oi[S15,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962aa8f-g-20160925T001722_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-g-20170924T020800_oi[S30,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20181017_92f9aa3-z-20181021T002937_oi[S10,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c605-g-20160930T005438_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9616298-z-20140904T005744_oi[S12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Resources for stage tims : 9.065 s worker CPU, 1009.043 s worker Wall, Wall: 176.445 s, Cores in use: 0.06, Total efficiency (on 8 cores): 0.7 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/PGC370638-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/PGC370638-largegalaxy-tims.p
Running stage refs
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9627f4e-g-20160901T054826_oi[S16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962fa53-g-20130901T005324_oi[N18,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_963392e-g-20130923T003115_oi[N3,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Running stage refs at 2020-08-10T08:35:33.703445
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11518.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11438.fits
Matched 29 large galaxies to Gaia stars.
Matched 1 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/metrics/cus/reference-custom-318896m59542.fits
Stage refs : Wall: 13.16 s, CPU: 3.96 s, VmPeak: 1051 MB, VmSize: 1046 MB, VmRSS: 226 MB, VmData: 258 MB, maxrss: 0.230912 MB
Stage refs finished: 2020-08-10T08:35:46.864181
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 13.162 s, Cores in use: 0.30, Total efficiency (on 8 cores): 3.8 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/PGC370638-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/PGC370638-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-10T08:35:46.905655
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/metrics/cus/outlier-mask-custom-318896m59542.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/metrics/cus/outliers-pre-custom-318896m59542.jpg
Image c4d_160901_055047_ooi_g_ls9-S15 g : masking 49 positive outlier pixels and 0 negative outlier pixels
Image c4d_130901_005324_ooi_g_ls9-N18 g : masking 0 positive outlier pixels and 144 negative outlier pixels
Image c4d_170924_020800_ooi_g_v1-S30 g : masking 692 positive outlier pixels and 0 negative outlier pixels
Image c4d_160930_005658_ooi_g_ls9-N28 g : masking 9130 positive outlier pixels and 0 negative outlier pixels
Image c4d_130923_003115_ooi_g_ls9-N3 g : masking 497 positive outlier pixels and 0 negative outlier pixels
Image c4d_160930_005302_ooi_r_ls9-N28 r : masking 5485 positive outlier pixels and 0 negative outlier pixels
Image c4d_170924_020404_ooi_r_v1-S30 r : masking 461 positive outlier pixels and 0 negative outlier pixels
Image c4d_140915_020516_ooi_r_ls9-S26 r : masking 0 positive outlier pixels and 207 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/metrics/cus/outlier-mask-custom-318896m59542.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/metrics/cus/outliers-post-custom-318896m59542.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/metrics/cus/outliers-masked-pos-custom-318896m59542.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/metrics/cus/outliers-masked-neg-custom-318896m59542.jpg
Stage outliers : Wall: 1.26 s, CPU: 1.06 s, VmPeak: 1056 MB, VmSize: 1056 MB, VmRSS: 245 MB, VmData: 274 MB, maxrss: 0.251328 MB
Stage outliers finished: 2020-08-10T08:35:48.170012
Resources for stage outliers : 1.650 s worker CPU, 1.652 s worker Wall, Wall: 1.265 s, Cores in use: 2.15, Total efficiency (on 8 cores): 26.8 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/PGC370638-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/PGC370638-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-10T08:35:48.486385
Stage halos : Wall: 2.71 s, CPU: 0.35 s, VmPeak: 1056 MB, VmSize: 1056 MB, VmRSS: 246 MB, VmData: 275 MB, maxrss: 0.251896 MB
Stage halos finished: 2020-08-10T08:35:51.192092
Resources for stage halos : 1.462 s worker CPU, 8.304 s worker Wall, Wall: 2.707 s, Cores in use: 0.67, Total efficiency (on 8 cores): 8.4 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/PGC370638-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/PGC370638-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-10T08:35:51.472410
PSF sigmas in coadd pixels: ['2.22', '2.05', '2.17', '2.24', '2.28', '3.05', '1.68', '2.54', '2.31']
Using average PSF sigma 2.2826198548600316
Gaussian PSF norm 0.12358378079173239 vs pixelized 0.104034945
average tim pixel scale / coadd scale: 1.001040611632936
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.76', '1.70', '1.76', '1.44', '2.01', '1.48', '1.59', '2.33']
Using average PSF sigma 1.7592644431798485
Gaussian PSF norm 0.16034814599219396 vs pixelized 0.13301532
average tim pixel scale / coadd scale: 1.0010425403171204
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.19', '1.54', '2.03', '1.79', '2.06', '1.48', '1.41']
Using average PSF sigma 1.6420956073184487
Gaussian PSF norm 0.17178950514004512 vs pixelized 0.13752131
average tim pixel scale / coadd scale: 1.0009796506925328
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.29 s, CPU: 0.28 s, VmPeak: 1056 MB, VmSize: 1056 MB, VmRSS: 248 MB, VmData: 275 MB, maxrss: 0.253536 MB
Stage fit_on_coadds finished: 2020-08-10T08:35:51.757924
Resources for stage fit_on_coadds : 0.402 s worker CPU, 0.405 s worker Wall, Wall: 0.287 s, Cores in use: 2.37, Total efficiency (on 8 cores): 29.6 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/PGC370638-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/PGC370638-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-10T08:35:51.769615
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 39 potential peaks
Of 39 potential peaks: 18 in veto map, 4 cut by saddle test, 0 cut by aper test, 17 kept
SED z : 17 new peaks
Found 30 potential peaks
Of 30 potential peaks: 20 in veto map, 2 cut by saddle test, 0 cut by aper test, 8 kept
SED r : 8 new peaks
Found 26 potential peaks
Of 26 potential peaks: 24 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 44 potential peaks
Of 44 potential peaks: 37 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 55 potential peaks
Of 55 potential peaks: 46 in veto map, 6 cut by saddle test, 0 cut by aper test, 3 kept
SED Red : 3 new peaks
Adding 31 new sources
Median coadd sky for g : -4.1938638e-05
Median coadd sky for r : 0.000118140175
Median coadd sky for z : 0.0028788599
Stage srcs : Wall: 0.62 s, CPU: 0.58 s, VmPeak: 1056 MB, VmSize: 1056 MB, VmRSS: 248 MB, VmData: 275 MB, maxrss: 0.254056 MB
Stage srcs finished: 2020-08-10T08:35:52.388353
Resources for stage srcs : 0.078 s worker CPU, 0.078 s worker Wall, Wall: 0.620 s, Cores in use: 1.06, Total efficiency (on 8 cores): 13.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/PGC370638-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/PGC370638-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-10T08:35:52.399513
Blob 1 of 16, id: 4, sources: 8, size: 156x138, npix 8582, brick X: 22,178, Y: 34,172, one pixel: 143 34
Blob 2 of 16, id: 8, sources: 4, size: 50x114, npix 3500, brick X: 0,50, Y: 131,245, one pixel: 7 131
Blob 3 of 16, id: 3, sources: 3, size: 56x72, npix 2460, brick X: 0,56, Y: 22,94, one pixel: 13 22
Blob 4 of 16, id: 0, sources: 4, size: 79x44, npix 2114, brick X: 135,214, Y: 0,44, one pixel: 141 0
Blob 5 of 16, id: 10, sources: 3, size: 43x45, npix 1054, brick X: 87,130, Y: 171,216, one pixel: 114 171
Blob 6 of 16, id: 13, sources: 2, size: 37x43, npix 818, brick X: 156,193, Y: 201,244, one pixel: 167 201
Blob 7 of 16, id: 1, sources: 3, size: 20x47, npix 765, brick X: 225,245, Y: 0,47, one pixel: 234 0
Blob 8 of 16, id: 14, sources: 1, size: 32x33, npix 578, brick X: 109,141, Y: 203,236, one pixel: 122 203
Blob 9 of 16, id: 2, sources: 1, size: 28x26, npix 481, brick X: 111,139, Y: 14,40, one pixel: 123 14
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (318.61673, -59.70928), pm (4.7, -4.4), parallax 4.166 with NanoMaggies: g=8.03, r=7, z=6.5
Reset brightness to NanoMaggies: g=8.03, r=7, z=6.5
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (318.92408, -59.54051), pm (13.9, -25.8), parallax 1.217 with NanoMaggies: g=13.5, r=13, z=12.8
Reset brightness to NanoMaggies: g=13.5, r=13, z=12.8
Blob 8 finished, total: Wall: 0.75 s, CPU: 0.50 s, VmPeak: 1016 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145576 MB
Blob 10 of 16, id: 9, sources: 1, size: 27x27, npix 452, brick X: 218,245, Y: 152,179, one pixel: 228 152
Blob 5 finished, total: Wall: 1.41 s, CPU: 1.41 s, VmPeak: 968 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144188 MB
Blob 11 of 16, id: 11, sources: 2, size: 23x37, npix 429, brick X: 206,229, Y: 180,217, one pixel: 219 180
Blob 4 finished, total: Wall: 1.74 s, CPU: 1.74 s, VmPeak: 1026 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144528 MB
Blob 12 of 16, id: 6, sources: 1, size: 24x24, npix 362, brick X: 137,161, Y: 74,98, one pixel: 148 74
Blob 9 finished, total: Wall: 1.28 s, CPU: 1.28 s, VmPeak: 1016 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145576 MB
Blob 13 of 16, id: 5, sources: 1, size: 24x24, npix 330, brick X: 181,205, Y: 56,80, one pixel: 191 56
Blob 11 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 1026 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144528 MB
Blob 14 of 16, id: 7, sources: 1, size: 19x24, npix 317, brick X: 226,245, Y: 122,146, one pixel: 238 122
Blob 12 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 1016 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145576 MB
Blob 15 of 16, id: 12, sources: 1, size: 20x21, npix 240, brick X: 48,68, Y: 194,215, one pixel: 57 194
Blob 6 finished, total: Wall: 2.41 s, CPU: 2.41 s, VmPeak: 968 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149788 MB
Blob 16 of 16, id: 15, sources: 1, size: 18x18, npix 180, brick X: 71,89, Y: 226,244, one pixel: 79 226
Blob 15 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 968 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149788 MB
Blob 16 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 968 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149788 MB
Blob 10 finished, total: Wall: 1.97 s, CPU: 1.97 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146132 MB
Blob 14 finished, total: Wall: 1.06 s, CPU: 1.06 s, VmPeak: 1016 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145576 MB
Blob 13 finished, total: Wall: 1.22 s, CPU: 1.22 s, VmPeak: 1026 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 180 MB, maxrss: 0.14666 MB
Blob 3 finished, total: Wall: 3.60 s, CPU: 3.60 s, VmPeak: 969 MB, VmSize: 727 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149212 MB
Blob 7 finished, total: Wall: 3.68 s, CPU: 3.40 s, VmPeak: 1030 MB, VmSize: 727 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149144 MB
Blob 2 finished, total: Wall: 3.95 s, CPU: 3.74 s, VmPeak: 1029 MB, VmSize: 727 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148572 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.22149, ee1=0.420093, ee2=-0.242388
Blob 1 finished, total: Wall: 8.09 s, CPU: 8.09 s, VmPeak: 1022 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148372 MB
Old catalog: 43
New catalog: 31
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/metrics/cus/blobs-custom-318896m59542.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/metrics/cus/all-models-custom-318896m59542.fits
Stage fitblobs : Wall: 8.52 s, CPU: 0.41 s, VmPeak: 1056 MB, VmSize: 1056 MB, VmRSS: 248 MB, VmData: 275 MB, maxrss: 0.25422 MB
Stage fitblobs finished: 2020-08-10T08:36:00.923520
Resources for stage fitblobs : 31.585 s worker CPU, 32.401 s worker Wall, Wall: 8.525 s, Cores in use: 3.75, Total efficiency (on 8 cores): 46.9 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/PGC370638-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/PGC370638-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-10T08:36:00.939313
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/tmp-legacysurvey-custom-318896m59542-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/tmp-legacysurvey-custom-318896m59542-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/tmp-legacysurvey-custom-318896m59542-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/tmp-legacysurvey-custom-318896m59542-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-resid.jpg
Stage coadds : Wall: 2.08 s, CPU: 0.54 s, VmPeak: 1056 MB, VmSize: 1056 MB, VmRSS: 249 MB, VmData: 275 MB, maxrss: 0.254672 MB
Stage coadds finished: 2020-08-10T08:36:03.021628
Resources for stage coadds : 3.926 s worker CPU, 4.249 s worker Wall, Wall: 2.083 s, Cores in use: 2.15, Total efficiency (on 8 cores): 26.8 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/PGC370638-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/PGC370638-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-10T08:36:03.035492
Cut to 1 unWISE tiles
Reading WISE tile 3196m591 band 4
Reading WISE tile 3196m591 band 3
Reading WISE tile 3196m591 band 1
Reading WISE tile 3196m591 band 2
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 969 MB, VmSize: 804 MB, VmRSS: 147 MB, VmData: 175 MB, maxrss: 0.210712 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 968 MB, VmSize: 805 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.211512 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 1029 MB, VmSize: 807 MB, VmRSS: 149 MB, VmData: 178 MB, maxrss: 0.194632 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/319/3196m591/unwise-3196m591-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 1016 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209196 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/tmp-legacysurvey-custom-318896m59542-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/tmp-legacysurvey-custom-318896m59542-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.20 s, CPU: 0.41 s, VmPeak: 1056 MB, VmSize: 1056 MB, VmRSS: 249 MB, VmData: 275 MB, maxrss: 0.255252 MB
Stage wise_forced finished: 2020-08-10T08:36:06.233681
Resources for stage wise_forced : 3.363 s worker CPU, 7.110 s worker Wall, Wall: 3.199 s, Cores in use: 1.18, Total efficiency (on 8 cores): 14.7 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/PGC370638-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/PGC370638-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-10T08:36:06.248679
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/coadd/cus/custom-318896m59542/legacysurvey-custom-318896m59542-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/tractor-i/cus/tractor-custom-318896m59542.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/tractor/cus/tractor-custom-318896m59542.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/tractor/cus/brick-custom-318896m59542.sha256sum
Stage writecat : Wall: 0.91 s, CPU: 0.72 s, VmPeak: 1189 MB, VmSize: 1061 MB, VmRSS: 251 MB, VmData: 275 MB, maxrss: 0.387912 MB
Stage writecat finished: 2020-08-10T08:36:07.163334
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.916 s, Cores in use: 0.79, Total efficiency (on 8 cores): 9.9 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/PGC370638-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/318/PGC370638/PGC370638-largegalaxy-writecat.p
All done: 51.534 s worker CPU, 1063.245 s worker Wall, Wall: 210.247 s, Cores in use: 0.29, Total efficiency (on 8 cores): 3.6 %
Finished galaxy PGC370638 in 3.540 minutes.