Started working on galaxy PGC699843 at Wed Aug  5 19:28:23 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 39.496077 -31.883464 --width 239 --height 239 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T19:28:24.131437
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '39.496077', '-31.883464', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 39.496077 -31.883464 --width 239 --height 239 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 39.496077 -31.883464
Starting process 36698 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 36699 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 36700 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 36701 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 36702 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB
Starting process 36703 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 36704 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 36705 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 36706 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 36707 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 36708 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 36709 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 36710 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 36711 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 36713 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 36712 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T19:28:26.026425
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 27 CCDs:
  c4d_171128_045842_ooi_z_v1-S5 z expnum 700674 exptime 90.0 propid 2012B-0001 seeing 1.24 MJD 58085.207 object DES survey hex 396-318 tiling 8 
    decam/CP/V4.1/CP20171127/c4d_171128_045842_ooi_z_v1.fits.fz
  c4d_171015_073429_ooi_r_v1-S5 r expnum 687281 exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 58041.316 object DES survey hex 396-318 tiling 8 
    decam/CP/V4.1/CP20171014/c4d_171015_073429_ooi_r_v1.fits.fz
  c4d_141020_082719_ooi_z_ls9-N4 z expnum 369529 exptime 90.0 propid 2012B-0001 seeing 0.97 MJD 56950.351 object DES survey hex 396-318 tiling 1 
    decam/CP/V4.8.2a/CP20141019/c4d_141020_082719_ooi_z_ls9.fits.fz
  c4d_141225_043745_ooi_r_ls9-N4 r expnum 391334 exptime 90.0 propid 2012B-0001 seeing 1.20 MJD 57016.191 object DES survey hex 396-318 tiling 1 
    decam/CP/V4.8.2a/CP20141224/c4d_141225_043745_ooi_r_ls9.fits.fz
  c4d_150210_013334_ooi_g_ls9-N4 g expnum 408314 exptime 90.0 propid 2012B-0001 seeing 0.99 MJD 57063.063 object DES survey hex 396-318 tiling 1 
    decam/CP/V4.8.2a/CP20150209/c4d_150210_013334_ooi_g_ls9.fits.fz
  c4d_141230_030656_ooi_z_ls9-S28 z expnum 393099 exptime 90.0 propid 2012B-0001 seeing 1.14 MJD 57021.128 object DES survey hex 396-318 tiling 3 
    decam/CP/V4.8.2a/CP20141229/c4d_141230_030656_ooi_z_ls9.fits.fz
  c4d_141225_043547_ooi_g_ls9-S28 g expnum 391333 exptime 90.0 propid 2012B-0001 seeing 1.15 MJD 57016.190 object DES survey hex 396-318 tiling 3 
    decam/CP/V4.8.2a/CP20141224/c4d_141225_043547_ooi_g_ls9.fits.fz
  c4d_150119_025733_ooi_r_ls9-S28 r expnum 400413 exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 57041.122 object DES survey hex 396-318 tiling 3 
    decam/CP/V4.8.2a/CP20150118/c4d_150119_025733_ooi_r_ls9.fits.fz
  c4d_151017_072238_ooi_r_ls9-N24 r expnum 484987 exptime 90.0 propid 2012B-0001 seeing 1.19 MJD 57312.306 object DES survey hex 396-318 tiling 2 
    decam/CP/V4.8.2a/CP20151016/c4d_151017_072238_ooi_r_ls9.fits.fz
  c4d_150124_023243_ooi_g_ls9-N24 g expnum 402280 exptime 90.0 propid 2012B-0001 seeing 0.94 MJD 57046.104 object DES survey hex 396-318 tiling 2 
    decam/CP/V4.8.2a/CP20150123/c4d_150124_023243_ooi_g_ls9.fits.fz
  c4d_141201_052926_ooi_z_ls9-N24 z expnum 383222 exptime 90.0 propid 2012B-0001 seeing 1.15 MJD 56992.227 object DES survey hex 396-318 tiling 2 
    decam/CP/V4.8.2a/CP20141130/c4d_141201_052926_ooi_z_ls9.fits.fz
  c4d_161207_052339_ooi_g_ls9-N23 g expnum 600579 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 57729.223 object DES survey hex 396-318 tiling 6 
    decam/CP/V4.8.2/CP20161206/c4d_161207_052339_ooi_g_ls9.fits.fz
  c4d_161023_065855_ooi_z_ls9-N23 z expnum 585331 exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 57684.289 object DES survey hex 396-318 tiling 6 
    decam/CP/V4.8.2a/CP20161022/c4d_161023_065855_ooi_z_ls9.fits.fz
  c4d_161124_062009_ooi_g_v1-N23 g expnum 595840 exptime 90.0 propid 2012B-0001 seeing 1.60 MJD 57716.262 object DES survey hex 396-318 tiling 6 
    decam/CP/V4.1/CP20161124/c4d_161124_062009_ooi_g_v1.fits.fz
  c4d_160924_060259_ooi_g_ls9-N10 g expnum 576579 exptime 90.0 propid 2012B-0001 seeing 1.19 MJD 57655.250 object DES survey hex 396-318 tiling 5 
    decam/CP/V4.8.2a/CP20160923/c4d_160924_060259_ooi_g_ls9.fits.fz
  c4d_151017_072636_ooi_g_ls9-N26 g expnum 484989 exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 57312.309 object DES survey hex 396-318 tiling 4 
    decam/CP/V4.8.2a/CP20151016/c4d_151017_072636_ooi_g_ls9.fits.fz
  c4d_151215_032355_ooi_r_ls9-N26 r expnum 502008 exptime 90.0 propid 2012B-0001 seeing 1.26 MJD 57371.140 object DES survey hex 396-318 tiling 4 
    decam/CP/V4.8.2a/CP20151214/c4d_151215_032355_ooi_r_ls9.fits.fz
  c4d_151101_065236_ooi_z_ls9-N26 z expnum 488879 exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57327.285 object DES survey hex 396-318 tiling 4 
    decam/CP/V4.8.2a/CP20151031/c4d_151101_065236_ooi_z_ls9.fits.fz
  c4d_171020_082814_ooi_g_v1-S5 g expnum 689057 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 58046.353 object DES survey hex 396-318 tiling 8 
    decam/CP/V4.1/CP20171019/c4d_171020_082814_ooi_g_v1.fits.fz
  c4d_171226_041906_ooi_r_v1-N14 r expnum 707442 exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 58113.180 object DES survey hex 396-318 tiling 9 
    decam/CP/V4.1/CP20171225/c4d_171226_041906_ooi_r_v1.fits.fz
  c4d_180118_024503_ooi_g_v1-N14 g expnum 713101 exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 58136.115 object DES survey hex 396-318 tiling 9 
    decam/CP/V4.1/CP20180117/c4d_180118_024503_ooi_g_v1.fits.fz
  c4d_171226_041509_ooi_z_v1-N14 z expnum 707440 exptime 90.0 propid 2012B-0001 seeing 1.02 MJD 58113.177 object DES survey hex 396-318 tiling 9 
    decam/CP/V4.1/CP20171225/c4d_171226_041509_ooi_z_v1.fits.fz
  c4d_170203_013148_ooi_z_ls9-S24 z expnum 615961 exptime 90.0 propid 2012B-0001 seeing 1.02 MJD 57787.062 object DES survey hex 376-329 tiling 7 
    decam/CP/V4.8.2/CP20170202/c4d_170203_013148_ooi_z_ls9.fits.fz
  c4d_161002_081853_ooi_r_ls9-S24 r expnum 580002 exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 57663.345 object DES survey hex 376-329 tiling 7 
    decam/CP/V4.8.2a/CP20161001/c4d_161002_081853_ooi_r_ls9.fits.fz
  c4d_171015_073033_ooi_g_v1-S24 g expnum 687279 exptime 90.0 propid 2012B-0001 seeing 1.36 MJD 58041.313 object DES survey hex 376-329 tiling 7 
    decam/CP/V4.1/CP20171014/c4d_171015_073033_ooi_g_v1.fits.fz
  c4d_160923_082007_ooi_r_ls9-N10 r expnum 576230 exptime 90.0 propid 2012B-0001 seeing 1.06 MJD 57654.346 object DES survey hex 396-318 tiling 5 
    decam/CP/V4.8.2a/CP20160922/c4d_160923_082007_ooi_r_ls9.fits.fz
  c4d_160117_025738_ooi_z_ls9-N10 z expnum 512154 exptime 90.0 propid 2012B-0001 seeing 1.08 MJD 57404.122 object DES survey hex 396-318 tiling 5 
    decam/CP/V4.8.2a/CP20160116/c4d_160117_025738_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961d4c2-z-20141230T030435_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9622f50-r-20151017T072017_oi[N24,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96186fb-z-20141020T082500_oi[N4,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961a5f3-g-20141225T043326_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-r-20171015T073429_oi[S5,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961d483-r-20150119T025512_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961c524-g-20150210T013115_oi[N4,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961b974-g-20150124T023021_oi[N24,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e7ae-z-20161023T065622_oi[N23,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171125_9031971-z-20171128T045842_oi[S5,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961c811-r-20141225T043525_oi[N4,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9505bd4-g-20161207T052119_oi[N23,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96222a9-g-20151017T072415_oi[N26,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962aa8f-g-20160924T060039_oi[N10,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961c1d5-z-20141201T052709_oi[N24,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES16B_20161121_8e237e6-g-20161124T061750_oi[N23,noinherit][2046,4094][real]: DE
Zeroing out 0 weight-map pixels below quantization error (= median 5.71e-05)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 240 weight-map pixels below quantization error (= median 2.65e-06)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 0 weight-map pixels below quantization error (= median 0.00024)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9623afc-z-20151101T065017_oi[N26,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962667b-r-20151215T032134_oi[N26,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180110_909afae-g-20180118T024503_oi[N14,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-g-20171015T073033_oi[S24,noinherit][2046,4094][real]: DE
Zeroing out 0 weight-map pixels below quantization error (= median 0.000295)
Clipping 1 pixels with anomalously large oow values: max 0.0567825 vs median 0.0430284
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171224_907974d-r-20171226T041906_oi[N14,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9507c56-z-20170203T012929_oi[S24,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b673-r-20160923T081746_oi[N10,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9627520-z-20160117T025517_oi[N10,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171224_907974d-z-20171226T041509_oi[N14,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e768-r-20161002T081634_oi[S24,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171017_8fe5678-g-20171020T082814_oi[S5,noinherit][2046,4094][real]: DES
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 75.85 s, CPU: 3.39 s, VmPeak: 1015 MB, VmSize: 1015 MB, VmRSS: 191 MB, VmData: 224 MB, maxrss: 0.195972 MB
Stage tims finished: 2020-08-05T19:29:41.872819
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9505bd4-g-20161207T052119_oi[N23,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96222a9-g-20151017T072415_oi[N26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961b974-g-20150124T023021_oi[N24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961c1d5-z-20141201T052709_oi[N24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961c524-g-20150210T013115_oi[N4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-g-20171015T073033_oi[S24,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Zeroing out 9 weight-map pixels below quantization error (= median 0.000277)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171125_9031971-z-20171128T045842_oi[S5,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9623afc-z-20151101T065017_oi[N26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961d483-r-20150119T025512_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180110_909afae-g-20180118T024503_oi[N14,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-r-20171015T073429_oi[S5,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962667b-r-20151215T032134_oi[N26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9622f50-r-20151017T072017_oi[N24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9507c56-z-20170203T012929_oi[S24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e7ae-z-20161023T065622_oi[N23,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b673-r-20160923T081746_oi[N10,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961c811-r-20141225T043525_oi[N4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9627520-z-20160117T025517_oi[N10,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Zeroing out 240 weight-map pixels below quantization error (= median 0.000179)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96186fb-z-20141020T082500_oi[N4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961a5f3-g-20141225T043326_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171017_8fe5678-g-20171020T082814_oi[S5,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
Resources for stage tims : 15.199 s worker CPU, 617.327 s worker Wall, Wall: 75.848 s, Cores in use: 0.25, Total efficiency (on 16 cores): 1.5 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-tims.p
Running stage refs
Zeroing out 4 weight-map pixels below quantization error (= median 3.3e-05)
Zeroing out 5 weight-map pixels below quantization error (= median 4.31e-06)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES16B_20161121_8e237e6-g-20161124T061750_oi[N23,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171224_907974d-r-20171226T041906_oi[N14,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961d4c2-z-20141230T030435_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171224_907974d-z-20171226T041509_oi[N14,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962aa8f-g-20160924T060039_oi[N10,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e768-r-20161002T081634_oi[S24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Running stage refs at 2020-08-05T19:29:42.149713
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09294.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09422.fits
Matched 1 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/metrics/cus/reference-custom-039496m31883.fits
Stage refs : Wall: 25.93 s, CPU: 2.97 s, VmPeak: 1046 MB, VmSize: 1027 MB, VmRSS: 204 MB, VmData: 235 MB, maxrss: 0.208508 MB
Stage refs finished: 2020-08-05T19:30:08.083853
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 25.936 s, Cores in use: 0.11, Total efficiency (on 16 cores): 0.7 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T19:30:08.142032
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/metrics/cus/outlier-mask-custom-039496m31883.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/metrics/cus/outliers-pre-custom-039496m31883.jpg
Image c4d_160924_060259_ooi_g_ls9-N10 g : masking 319 positive outlier pixels and 0 negative outlier pixels
Image c4d_151017_072636_ooi_g_ls9-N26 g : masking 0 positive outlier pixels and 263 negative outlier pixels
Image c4d_150124_023243_ooi_g_ls9-N24 g : masking 0 positive outlier pixels and 260 negative outlier pixels
Image c4d_180118_024503_ooi_g_v1-N14 g : masking 681 positive outlier pixels and 0 negative outlier pixels
Image c4d_171015_073429_ooi_r_v1-S5 r : masking 322 positive outlier pixels and 0 negative outlier pixels
Image c4d_151101_065236_ooi_z_ls9-N26 z : masking 431 positive outlier pixels and 0 negative outlier pixels
Image c4d_160117_025738_ooi_z_ls9-N10 z : masking 402 positive outlier pixels and 57 negative outlier pixels
Image c4d_141201_052926_ooi_z_ls9-N24 z : masking 71 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/metrics/cus/outlier-mask-custom-039496m31883.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/metrics/cus/outliers-post-custom-039496m31883.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/metrics/cus/outliers-masked-pos-custom-039496m31883.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/metrics/cus/outliers-masked-neg-custom-039496m31883.jpg
Stage outliers : Wall: 1.91 s, CPU: 1.66 s, VmPeak: 1046 MB, VmSize: 1036 MB, VmRSS: 228 MB, VmData: 255 MB, maxrss: 0.23328 MB
Stage outliers finished: 2020-08-05T19:30:10.047093
Resources for stage outliers : 1.717 s worker CPU, 1.717 s worker Wall, Wall: 1.906 s, Cores in use: 1.77, Total efficiency (on 16 cores): 11.1 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T19:30:10.411031
Stage halos : Wall: 1.07 s, CPU: 1.07 s, VmPeak: 1046 MB, VmSize: 1036 MB, VmRSS: 228 MB, VmData: 256 MB, maxrss: 0.233488 MB
Stage halos finished: 2020-08-05T19:30:11.483032
Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.073 s, Cores in use: 1.00, Total efficiency (on 16 cores): 6.2 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T19:30:11.795531
PSF sigmas in coadd pixels: ['1.61', '1.87', '1.53', '1.74', '2.60', '1.93', '1.92', '1.74', '1.91', '2.22']
Using average PSF sigma 1.9078322260230878
Gaussian PSF norm 0.1478614250907744 vs pixelized 0.12745284
average tim pixel scale / coadd scale: 1.001072360357298
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.04', '1.95', '1.92', '1.93', '2.05', '1.80', '2.02', '1.72']
Using average PSF sigma 1.9296365500974786
Gaussian PSF norm 0.14619063458329898 vs pixelized 0.14695922
average tim pixel scale / coadd scale: 1.0010781814010976
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.02', '1.58', '1.84', '1.87', '1.92', '1.84', '1.65', '1.66', '1.75']
Using average PSF sigma 1.7937375307187269
Gaussian PSF norm 0.1572664823826519 vs pixelized 0.15433344
average tim pixel scale / coadd scale: 1.0010053871114177
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.36 s, CPU: 0.32 s, VmPeak: 1046 MB, VmSize: 1036 MB, VmRSS: 230 MB, VmData: 256 MB, maxrss: 0.235088 MB
Stage fit_on_coadds finished: 2020-08-05T19:30:12.153208
Resources for stage fit_on_coadds : 0.388 s worker CPU, 0.388 s worker Wall, Wall: 0.359 s, Cores in use: 1.98, Total efficiency (on 16 cores): 12.4 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T19:30:12.171222
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 18 potential peaks
Of 18 potential peaks: 1 in veto map, 0 cut by saddle test, 0 cut by aper test, 17 kept
SED z : 17 new peaks
Found 26 potential peaks
Of 26 potential peaks: 19 in veto map, 1 cut by saddle test, 0 cut by aper test, 6 kept
SED r : 6 new peaks
Found 20 potential peaks
Of 20 potential peaks: 19 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 32 potential peaks
Of 32 potential peaks: 25 in veto map, 2 cut by saddle test, 0 cut by aper test, 5 kept
SED Flat : 5 new peaks
Found 32 potential peaks
Of 32 potential peaks: 29 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 29 new sources
Median coadd sky for g : -0.00014660711
Median coadd sky for r : -0.00018559121
Median coadd sky for z : -5.4352e-05
Stage srcs : Wall: 1.48 s, CPU: 1.41 s, VmPeak: 1046 MB, VmSize: 1036 MB, VmRSS: 230 MB, VmData: 256 MB, maxrss: 0.235492 MB
Stage srcs finished: 2020-08-05T19:30:13.652491
Resources for stage srcs : 0.066 s worker CPU, 0.066 s worker Wall, Wall: 1.483 s, Cores in use: 1.00, Total efficiency (on 16 cores): 6.2 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T19:30:13.702394
Blob 1 of 19, id: 10, sources: 10, size: 131x130, npix 8425, brick X: 62,193, Y: 73,203, one pixel: 143 73
Blob 2 of 19, id: 8, sources: 2, size: 54x37, npix 1144, brick X: 36,90, Y: 46,83, one pixel: 71 46
Blob 3 of 19, id: 5, sources: 2, size: 27x54, npix 1067, brick X: 212,239, Y: 21,75, one pixel: 232 21
Blob 4 of 19, id: 11, sources: 2, size: 49x39, npix 1059, brick X: 190,239, Y: 88,127, one pixel: 221 88
Blob 5 of 19, id: 2, sources: 1, size: 31x29, npix 594, brick X: 0,31, Y: 1,30, one pixel: 3 1
Blob 6 of 19, id: 17, sources: 1, size: 28x29, npix 584, brick X: 130,158, Y: 210,239, one pixel: 143 210
Blob 7 of 19, id: 6, sources: 1, size: 25x28, npix 453, brick X: 20,45, Y: 24,52, one pixel: 30 24
Blob 8 of 19, id: 4, sources: 1, size: 24x27, npix 419, brick X: 199,223, Y: 10,37, one pixel: 209 10
Blob 9 of 19, id: 14, sources: 1, size: 24x23, npix 342, brick X: 35,59, Y: 182,205, one pixel: 44 182
Blob 10 of 19, id: 3, sources: 1, size: 22x23, npix 314, brick X: 168,190, Y: 9,32, one pixel: 178 9
Blob 11 of 19, id: 15, sources: 1, size: 19x23, npix 296, brick X: 220,239, Y: 191,214, one pixel: 230 191
Blob 12 of 19, id: 0, sources: 1, size: 23x19, npix 287, brick X: 31,54, Y: 0,19, one pixel: 36 0
Blob 13 of 19, id: 1, sources: 1, size: 25x17, npix 284, brick X: 65,90, Y: 0,17, one pixel: 70 0
Blob 14 of 19, id: 16, sources: 1, size: 21x22, npix 282, brick X: 111,132, Y: 204,226, one pixel: 120 204
Blob 15 of 19, id: 12, sources: 1, size: 20x20, npix 247, brick X: 55,75, Y: 128,148, one pixel: 64 128
Blob 16 of 19, id: 18, sources: 1, size: 20x19, npix 234, brick X: 102,122, Y: 220,239, one pixel: 111 220
Blob 17 of 19, id: 9, sources: 1, size: 20x21, npix 229, brick X: 181,201, Y: 70,91, one pixel: 191 70
Blob 16 finished, total: Wall: 0.33 s, CPU: 0.32 s, VmPeak: 1029 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148344 MB
Blob 18 of 19, id: 7, sources: 1, size: 16x21, npix 206, brick X: 0,16, Y: 36,57, one pixel: 5 36
Blob 17 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 1029 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148344 MB
Blob 19 of 19, id: 13, sources: 1, size: 18x17, npix 162, brick X: 53,71, Y: 151,168, one pixel: 61 151
Blob 10 finished, total: Wall: 0.75 s, CPU: 0.73 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.14776 MB
Blob 5 finished, total: Wall: 0.82 s, CPU: 0.81 s, VmPeak: 975 MB, VmSize: 733 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149164 MB
Blob 14 finished, total: Wall: 0.81 s, CPU: 0.80 s, VmPeak: 1034 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149064 MB
Blob 11 finished, total: Wall: 0.91 s, CPU: 0.90 s, VmPeak: 1012 MB, VmSize: 733 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149016 MB
Blob 15 finished, total: Wall: 0.91 s, CPU: 0.90 s, VmPeak: 1016 MB, VmSize: 733 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149228 MB
Blob 9 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147732 MB
Blob 12 finished, total: Wall: 1.01 s, CPU: 1.01 s, VmPeak: 935 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.14876 MB
Blob 8 finished, total: Wall: 1.11 s, CPU: 1.09 s, VmPeak: 971 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149044 MB
Blob 19 finished, total: Wall: 0.42 s, CPU: 0.42 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148316 MB
Blob 18 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 1029 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148344 MB
Blob 13 finished, total: Wall: 1.23 s, CPU: 1.23 s, VmPeak: 972 MB, VmSize: 734 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148892 MB
Blob 7 finished, total: Wall: 1.35 s, CPU: 1.34 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148852 MB
Blob 2 finished, total: Wall: 1.64 s, CPU: 1.63 s, VmPeak: 978 MB, VmSize: 738 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.153912 MB
Blob 6 finished, total: Wall: 1.71 s, CPU: 1.70 s, VmPeak: 1029 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149192 MB
Blob 3 finished, total: Wall: 1.90 s, CPU: 1.89 s, VmPeak: 1029 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.14886 MB
Measuring 1 iterative sources
Blob 4 finished, total: Wall: 2.35 s, CPU: 2.34 s, VmPeak: 1031 MB, VmSize: 738 MB, VmRSS: 151 MB, VmData: 187 MB, maxrss: 0.155024 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.56036, ee1=0.19504, ee2=0.392301
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 10.85 s, CPU: 10.82 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150948 MB
Old catalog: 31
New catalog: 33
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/metrics/cus/blobs-custom-039496m31883.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/metrics/cus/all-models-custom-039496m31883.fits
Stage fitblobs : Wall: 12.09 s, CPU: 1.15 s, VmPeak: 1046 MB, VmSize: 1036 MB, VmRSS: 230 MB, VmData: 256 MB, maxrss: 0.235656 MB
Stage fitblobs finished: 2020-08-05T19:30:25.792653
Resources for stage fitblobs : 29.932 s worker CPU, 30.657 s worker Wall, Wall: 12.092 s, Cores in use: 2.57, Total efficiency (on 16 cores): 16.1 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T19:30:25.811517
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/tmp-legacysurvey-custom-039496m31883-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/tmp-legacysurvey-custom-039496m31883-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/tmp-legacysurvey-custom-039496m31883-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/tmp-legacysurvey-custom-039496m31883-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-resid.jpg
Stage coadds : Wall: 2.47 s, CPU: 1.07 s, VmPeak: 1046 MB, VmSize: 1036 MB, VmRSS: 231 MB, VmData: 256 MB, maxrss: 0.236168 MB
Stage coadds finished: 2020-08-05T19:30:28.285906
Resources for stage coadds : 13.036 s worker CPU, 17.507 s worker Wall, Wall: 2.476 s, Cores in use: 5.70, Total efficiency (on 16 cores): 35.6 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-05T19:30:28.298389
Cut to 1 unWISE tiles
Reading WISE tile 0388m319 band 1
Reading WISE tile 0388m319 band 2
Reading WISE tile 0388m319 band 3
Reading WISE tile 0388m319 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 935 MB, VmSize: 812 MB, VmRSS: 152 MB, VmData: 177 MB, maxrss: 0.192684 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 1034 MB, VmSize: 810 MB, VmRSS: 149 MB, VmData: 175 MB, maxrss: 0.213832 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 1016 MB, VmSize: 810 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.211508 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 972 MB, VmSize: 811 MB, VmRSS: 150 MB, VmData: 176 MB, maxrss: 0.213352 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/tmp-legacysurvey-custom-039496m31883-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/tmp-legacysurvey-custom-039496m31883-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.66 s, CPU: 0.98 s, VmPeak: 1046 MB, VmSize: 1036 MB, VmRSS: 231 MB, VmData: 256 MB, maxrss: 0.236876 MB
Stage wise_forced finished: 2020-08-05T19:30:30.959574
Resources for stage wise_forced : 3.215 s worker CPU, 4.826 s worker Wall, Wall: 2.663 s, Cores in use: 1.58, Total efficiency (on 16 cores): 9.9 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T19:30:30.981063
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/tractor-i/cus/tractor-custom-039496m31883.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/tractor/cus/tractor-custom-039496m31883.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/tractor/cus/brick-custom-039496m31883.sha256sum
Stage writecat : Wall: 1.44 s, CPU: 1.13 s, VmPeak: 1169 MB, VmSize: 1041 MB, VmRSS: 233 MB, VmData: 256 MB, maxrss: 0.36988 MB
Stage writecat finished: 2020-08-05T19:30:32.421246
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.442 s, Cores in use: 0.79, Total efficiency (on 16 cores): 4.9 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-writecat.p
All done: 63.555 s worker CPU, 672.491 s worker Wall, Wall: 126.431 s, Cores in use: 0.62, Total efficiency (on 16 cores): 3.9 %
Finished galaxy PGC699843 in 2.161 minutes.
Started working on galaxy PGC699843 at Wed Aug  5 19:45:59 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 39.496077 -31.883464 --width 239 --height 239 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T19:46:02.610439
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '39.496077', '-31.883464', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 39.496077 -31.883464 --width 239 --height 239 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 39.496077 -31.883464
Starting process 40968 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 40970 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 40972 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 40976 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 40977 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059404 MB
Starting process 40978 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059352 MB
Starting process 40979 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059352 MB
Starting process 40980 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 40982 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 40983 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 40985 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 40986 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 40987 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 40988 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 40989 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 40990 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 40991 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 40992 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 40993 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 40994 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 40995 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 40996 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 40997 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 40998 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 40999 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 41000 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 41001 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 41002 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 41003 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 41004 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 41005 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 41006 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T19:46:03.122499
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 27 CCDs:
  c4d_171128_045842_ooi_z_v1-S5 z expnum 700674 exptime 90.0 propid 2012B-0001 seeing 1.24 MJD 58085.207 object DES survey hex 396-318 tiling 8 
    decam/CP/V4.1/CP20171127/c4d_171128_045842_ooi_z_v1.fits.fz
  c4d_171015_073429_ooi_r_v1-S5 r expnum 687281 exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 58041.316 object DES survey hex 396-318 tiling 8 
    decam/CP/V4.1/CP20171014/c4d_171015_073429_ooi_r_v1.fits.fz
  c4d_141020_082719_ooi_z_ls9-N4 z expnum 369529 exptime 90.0 propid 2012B-0001 seeing 0.97 MJD 56950.351 object DES survey hex 396-318 tiling 1 
    decam/CP/V4.8.2a/CP20141019/c4d_141020_082719_ooi_z_ls9.fits.fz
  c4d_141225_043745_ooi_r_ls9-N4 r expnum 391334 exptime 90.0 propid 2012B-0001 seeing 1.20 MJD 57016.191 object DES survey hex 396-318 tiling 1 
    decam/CP/V4.8.2a/CP20141224/c4d_141225_043745_ooi_r_ls9.fits.fz
  c4d_150210_013334_ooi_g_ls9-N4 g expnum 408314 exptime 90.0 propid 2012B-0001 seeing 0.99 MJD 57063.063 object DES survey hex 396-318 tiling 1 
    decam/CP/V4.8.2a/CP20150209/c4d_150210_013334_ooi_g_ls9.fits.fz
  c4d_141230_030656_ooi_z_ls9-S28 z expnum 393099 exptime 90.0 propid 2012B-0001 seeing 1.14 MJD 57021.128 object DES survey hex 396-318 tiling 3 
    decam/CP/V4.8.2a/CP20141229/c4d_141230_030656_ooi_z_ls9.fits.fz
  c4d_141225_043547_ooi_g_ls9-S28 g expnum 391333 exptime 90.0 propid 2012B-0001 seeing 1.15 MJD 57016.190 object DES survey hex 396-318 tiling 3 
    decam/CP/V4.8.2a/CP20141224/c4d_141225_043547_ooi_g_ls9.fits.fz
  c4d_150119_025733_ooi_r_ls9-S28 r expnum 400413 exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 57041.122 object DES survey hex 396-318 tiling 3 
    decam/CP/V4.8.2a/CP20150118/c4d_150119_025733_ooi_r_ls9.fits.fz
  c4d_151017_072238_ooi_r_ls9-N24 r expnum 484987 exptime 90.0 propid 2012B-0001 seeing 1.19 MJD 57312.306 object DES survey hex 396-318 tiling 2 
    decam/CP/V4.8.2a/CP20151016/c4d_151017_072238_ooi_r_ls9.fits.fz
  c4d_150124_023243_ooi_g_ls9-N24 g expnum 402280 exptime 90.0 propid 2012B-0001 seeing 0.94 MJD 57046.104 object DES survey hex 396-318 tiling 2 
    decam/CP/V4.8.2a/CP20150123/c4d_150124_023243_ooi_g_ls9.fits.fz
  c4d_141201_052926_ooi_z_ls9-N24 z expnum 383222 exptime 90.0 propid 2012B-0001 seeing 1.15 MJD 56992.227 object DES survey hex 396-318 tiling 2 
    decam/CP/V4.8.2a/CP20141130/c4d_141201_052926_ooi_z_ls9.fits.fz
  c4d_161207_052339_ooi_g_ls9-N23 g expnum 600579 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 57729.223 object DES survey hex 396-318 tiling 6 
    decam/CP/V4.8.2/CP20161206/c4d_161207_052339_ooi_g_ls9.fits.fz
  c4d_161023_065855_ooi_z_ls9-N23 z expnum 585331 exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 57684.289 object DES survey hex 396-318 tiling 6 
    decam/CP/V4.8.2a/CP20161022/c4d_161023_065855_ooi_z_ls9.fits.fz
  c4d_161124_062009_ooi_g_v1-N23 g expnum 595840 exptime 90.0 propid 2012B-0001 seeing 1.60 MJD 57716.262 object DES survey hex 396-318 tiling 6 
    decam/CP/V4.1/CP20161124/c4d_161124_062009_ooi_g_v1.fits.fz
  c4d_160924_060259_ooi_g_ls9-N10 g expnum 576579 exptime 90.0 propid 2012B-0001 seeing 1.19 MJD 57655.250 object DES survey hex 396-318 tiling 5 
    decam/CP/V4.8.2a/CP20160923/c4d_160924_060259_ooi_g_ls9.fits.fz
  c4d_151017_072636_ooi_g_ls9-N26 g expnum 484989 exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 57312.309 object DES survey hex 396-318 tiling 4 
    decam/CP/V4.8.2a/CP20151016/c4d_151017_072636_ooi_g_ls9.fits.fz
  c4d_151215_032355_ooi_r_ls9-N26 r expnum 502008 exptime 90.0 propid 2012B-0001 seeing 1.26 MJD 57371.140 object DES survey hex 396-318 tiling 4 
    decam/CP/V4.8.2a/CP20151214/c4d_151215_032355_ooi_r_ls9.fits.fz
  c4d_151101_065236_ooi_z_ls9-N26 z expnum 488879 exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57327.285 object DES survey hex 396-318 tiling 4 
    decam/CP/V4.8.2a/CP20151031/c4d_151101_065236_ooi_z_ls9.fits.fz
  c4d_171020_082814_ooi_g_v1-S5 g expnum 689057 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 58046.353 object DES survey hex 396-318 tiling 8 
    decam/CP/V4.1/CP20171019/c4d_171020_082814_ooi_g_v1.fits.fz
  c4d_171226_041906_ooi_r_v1-N14 r expnum 707442 exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 58113.180 object DES survey hex 396-318 tiling 9 
    decam/CP/V4.1/CP20171225/c4d_171226_041906_ooi_r_v1.fits.fz
  c4d_180118_024503_ooi_g_v1-N14 g expnum 713101 exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 58136.115 object DES survey hex 396-318 tiling 9 
    decam/CP/V4.1/CP20180117/c4d_180118_024503_ooi_g_v1.fits.fz
  c4d_171226_041509_ooi_z_v1-N14 z expnum 707440 exptime 90.0 propid 2012B-0001 seeing 1.02 MJD 58113.177 object DES survey hex 396-318 tiling 9 
    decam/CP/V4.1/CP20171225/c4d_171226_041509_ooi_z_v1.fits.fz
  c4d_170203_013148_ooi_z_ls9-S24 z expnum 615961 exptime 90.0 propid 2012B-0001 seeing 1.02 MJD 57787.062 object DES survey hex 376-329 tiling 7 
    decam/CP/V4.8.2/CP20170202/c4d_170203_013148_ooi_z_ls9.fits.fz
  c4d_161002_081853_ooi_r_ls9-S24 r expnum 580002 exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 57663.345 object DES survey hex 376-329 tiling 7 
    decam/CP/V4.8.2a/CP20161001/c4d_161002_081853_ooi_r_ls9.fits.fz
  c4d_171015_073033_ooi_g_v1-S24 g expnum 687279 exptime 90.0 propid 2012B-0001 seeing 1.36 MJD 58041.313 object DES survey hex 376-329 tiling 7 
    decam/CP/V4.1/CP20171014/c4d_171015_073033_ooi_g_v1.fits.fz
  c4d_160923_082007_ooi_r_ls9-N10 r expnum 576230 exptime 90.0 propid 2012B-0001 seeing 1.06 MJD 57654.346 object DES survey hex 396-318 tiling 5 
    decam/CP/V4.8.2a/CP20160922/c4d_160923_082007_ooi_r_ls9.fits.fz
  c4d_160117_025738_ooi_z_ls9-N10 z expnum 512154 exptime 90.0 propid 2012B-0001 seeing 1.08 MJD 57404.122 object DES survey hex 396-318 tiling 5 
    decam/CP/V4.8.2a/CP20160116/c4d_160117_025738_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9507c56-z-20170203T012929_oi[S24,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96186fb-z-20141020T082500_oi[N4,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961d4c2-z-20141230T030435_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962aa8f-g-20160924T060039_oi[N10,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES16B_20161121_8e237e6-g-20161124T061750_oi[N23,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961a5f3-g-20141225T043326_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961d483-r-20150119T025512_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961b974-g-20150124T023021_oi[N24,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171125_9031971-z-20171128T045842_oi[S5,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b673-r-20160923T081746_oi[N10,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9627520-z-20160117T025517_oi[N10,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961c811-r-20141225T043525_oi[N4,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9622f50-r-20151017T072017_oi[N24,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e7ae-z-20161023T065622_oi[N23,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171224_907974d-z-20171226T041509_oi[N14,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962667b-r-20151215T032134_oi[N26,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171224_907974d-r-20171226T041906_oi[N14,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-r-20171015T073429_oi[S5,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961c524-g-20150210T013115_oi[N4,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-g-20171015T073033_oi[S24,noinherit][2046,4094][real]: DE
Zeroing out 0 weight-map pixels below quantization error (= median 0.000295)
Clipping 1 pixels with anomalously large oow values: max 0.0567825 vs median 0.0430284
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9505bd4-g-20161207T052119_oi[N23,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9623afc-z-20151101T065017_oi[N26,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961c1d5-z-20141201T052709_oi[N24,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e768-r-20161002T081634_oi[S24,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180110_909afae-g-20180118T024503_oi[N14,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96222a9-g-20151017T072415_oi[N26,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171017_8fe5678-g-20171020T082814_oi[S5,noinherit][2046,4094][real]: DES
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 240 weight-map pixels below quantization error (= median 2.65e-06)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 9 weight-map pixels below quantization error (= median 0.000277)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 4 weight-map pixels below quantization error (= median 3.3e-05)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 0 weight-map pixels below quantization error (= median 0.00024)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 5 weight-map pixels below quantization error (= median 4.31e-06)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 0 weight-map pixels below quantization error (= median 5.71e-05)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 240 weight-map pixels below quantization error (= median 0.000179)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 112.19 s, CPU: 1.22 s, VmPeak: 1015 MB, VmSize: 1015 MB, VmRSS: 192 MB, VmData: 224 MB, maxrss: 0.19614 MB
Stage tims finished: 2020-08-05T19:47:55.309088
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961d4c2-z-20141230T030435_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES16B_20161121_8e237e6-g-20161124T061750_oi[N23,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171224_907974d-z-20171226T041509_oi[N14,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-r-20171015T073429_oi[S5,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-g-20171015T073033_oi[S24,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180110_909afae-g-20180118T024503_oi[N14,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171224_907974d-r-20171226T041906_oi[N14,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e768-r-20161002T081634_oi[S24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9623afc-z-20151101T065017_oi[N26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961c811-r-20141225T043525_oi[N4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961d483-r-20150119T025512_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962667b-r-20151215T032134_oi[N26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961a5f3-g-20141225T043326_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961c1d5-z-20141201T052709_oi[N24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961b974-g-20150124T023021_oi[N24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9627520-z-20160117T025517_oi[N10,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171017_8fe5678-g-20171020T082814_oi[S5,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96186fb-z-20141020T082500_oi[N4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 19.409 s worker CPU, 1952.818 s worker Wall, Wall: 112.189 s, Cores in use: 0.18, Total efficiency (on 32 cores): 0.6 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b673-r-20160923T081746_oi[N10,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961c524-g-20150210T013115_oi[N4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96222a9-g-20151017T072415_oi[N26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9505bd4-g-20161207T052119_oi[N23,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9507c56-z-20170203T012929_oi[S24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T19:47:55.614392
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09294.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09422.fits
Matched 1 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/metrics/cus/reference-custom-039496m31883.fits
Stage refs : Wall: 6.14 s, CPU: 2.19 s, VmPeak: 1046 MB, VmSize: 1027 MB, VmRSS: 204 MB, VmData: 235 MB, maxrss: 0.208668 MB
Stage refs finished: 2020-08-05T19:48:01.755275
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171125_9031971-z-20171128T045842_oi[S5,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9622f50-r-20151017T072017_oi[N24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 6.143 s, Cores in use: 0.36, Total efficiency (on 32 cores): 1.1 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-refs.p
Running stage outliers
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962aa8f-g-20160924T060039_oi[N10,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e7ae-z-20161023T065622_oi[N23,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage outliers at 2020-08-05T19:48:02.323655
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/metrics/cus/outlier-mask-custom-039496m31883.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/metrics/cus/outliers-pre-custom-039496m31883.jpg
Image c4d_160924_060259_ooi_g_ls9-N10 g : masking 319 positive outlier pixels and 0 negative outlier pixels
Image c4d_150124_023243_ooi_g_ls9-N24 g : masking 0 positive outlier pixels and 260 negative outlier pixels
Image c4d_151017_072636_ooi_g_ls9-N26 g : masking 0 positive outlier pixels and 263 negative outlier pixels
Image c4d_180118_024503_ooi_g_v1-N14 g : masking 681 positive outlier pixels and 0 negative outlier pixels
Image c4d_171015_073429_ooi_r_v1-S5 r : masking 322 positive outlier pixels and 0 negative outlier pixels
Image c4d_151101_065236_ooi_z_ls9-N26 z : masking 431 positive outlier pixels and 0 negative outlier pixels
Image c4d_160117_025738_ooi_z_ls9-N10 z : masking 402 positive outlier pixels and 57 negative outlier pixels
Image c4d_141201_052926_ooi_z_ls9-N24 z : masking 71 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/metrics/cus/outlier-mask-custom-039496m31883.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/metrics/cus/outliers-post-custom-039496m31883.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/metrics/cus/outliers-masked-pos-custom-039496m31883.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/metrics/cus/outliers-masked-neg-custom-039496m31883.jpg
Stage outliers : Wall: 1.19 s, CPU: 1.03 s, VmPeak: 1046 MB, VmSize: 1036 MB, VmRSS: 228 MB, VmData: 255 MB, maxrss: 0.232992 MB
Stage outliers finished: 2020-08-05T19:48:03.514498
Resources for stage outliers : 1.685 s worker CPU, 2.047 s worker Wall, Wall: 1.193 s, Cores in use: 2.27, Total efficiency (on 32 cores): 7.1 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T19:48:03.860881
Stage halos : Wall: 0.25 s, CPU: 0.24 s, VmPeak: 1046 MB, VmSize: 1036 MB, VmRSS: 228 MB, VmData: 255 MB, maxrss: 0.233036 MB
Stage halos finished: 2020-08-05T19:48:04.107672
Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.249 s, Cores in use: 0.99, Total efficiency (on 32 cores): 3.1 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T19:48:04.159325
PSF sigmas in coadd pixels: ['1.61', '1.87', '1.53', '1.74', '2.60', '1.93', '1.92', '1.74', '1.91', '2.22']
Using average PSF sigma 1.9078322260230878
Gaussian PSF norm 0.1478614250907744 vs pixelized 0.12745284
average tim pixel scale / coadd scale: 1.001072360357298
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.04', '1.95', '1.92', '1.93', '2.05', '1.80', '2.02', '1.72']
Using average PSF sigma 1.9296365500974786
Gaussian PSF norm 0.14619063458329898 vs pixelized 0.14695922
average tim pixel scale / coadd scale: 1.0010781814010976
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.02', '1.58', '1.84', '1.87', '1.92', '1.84', '1.65', '1.66', '1.75']
Using average PSF sigma 1.7937375307187269
Gaussian PSF norm 0.1572664823826519 vs pixelized 0.15433344
average tim pixel scale / coadd scale: 1.0010053871114177
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.30 s, CPU: 0.30 s, VmPeak: 1046 MB, VmSize: 1036 MB, VmRSS: 229 MB, VmData: 256 MB, maxrss: 0.234736 MB
Stage fit_on_coadds finished: 2020-08-05T19:48:04.461373
Resources for stage fit_on_coadds : 0.353 s worker CPU, 0.353 s worker Wall, Wall: 0.304 s, Cores in use: 2.17, Total efficiency (on 32 cores): 6.8 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T19:48:04.496666
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 18 potential peaks
Of 18 potential peaks: 1 in veto map, 0 cut by saddle test, 0 cut by aper test, 17 kept
SED z : 17 new peaks
Found 26 potential peaks
Of 26 potential peaks: 19 in veto map, 1 cut by saddle test, 0 cut by aper test, 6 kept
SED r : 6 new peaks
Found 20 potential peaks
Of 20 potential peaks: 19 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 32 potential peaks
Of 32 potential peaks: 25 in veto map, 2 cut by saddle test, 0 cut by aper test, 5 kept
SED Flat : 5 new peaks
Found 32 potential peaks
Of 32 potential peaks: 29 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 29 new sources
Median coadd sky for g : -0.00014660713
Median coadd sky for r : -0.00018559117
Median coadd sky for z : -5.4352e-05
Stage srcs : Wall: 0.54 s, CPU: 0.50 s, VmPeak: 1046 MB, VmSize: 1036 MB, VmRSS: 230 MB, VmData: 256 MB, maxrss: 0.235392 MB
Stage srcs finished: 2020-08-05T19:48:05.035375
Resources for stage srcs : 0.069 s worker CPU, 0.069 s worker Wall, Wall: 0.541 s, Cores in use: 1.06, Total efficiency (on 32 cores): 3.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T19:48:05.164503
Blob 1 of 19, id: 10, sources: 10, size: 131x130, npix 8425, brick X: 62,193, Y: 73,203, one pixel: 143 73
Blob 2 of 19, id: 8, sources: 2, size: 54x37, npix 1144, brick X: 36,90, Y: 46,83, one pixel: 71 46
Blob 3 of 19, id: 5, sources: 2, size: 27x54, npix 1067, brick X: 212,239, Y: 21,75, one pixel: 232 21
Blob 4 of 19, id: 11, sources: 2, size: 49x39, npix 1059, brick X: 190,239, Y: 88,127, one pixel: 221 88
Blob 5 of 19, id: 2, sources: 1, size: 31x29, npix 594, brick X: 0,31, Y: 1,30, one pixel: 3 1
Blob 6 of 19, id: 17, sources: 1, size: 28x29, npix 584, brick X: 130,158, Y: 210,239, one pixel: 143 210
Blob 7 of 19, id: 6, sources: 1, size: 25x28, npix 453, brick X: 20,45, Y: 24,52, one pixel: 30 24
Blob 8 of 19, id: 4, sources: 1, size: 24x27, npix 419, brick X: 199,223, Y: 10,37, one pixel: 209 10
Blob 9 of 19, id: 14, sources: 1, size: 24x23, npix 342, brick X: 35,59, Y: 182,205, one pixel: 44 182
Blob 10 of 19, id: 3, sources: 1, size: 22x23, npix 314, brick X: 168,190, Y: 9,32, one pixel: 178 9
Blob 11 of 19, id: 15, sources: 1, size: 19x23, npix 296, brick X: 220,239, Y: 191,214, one pixel: 230 191
Blob 12 of 19, id: 0, sources: 1, size: 23x19, npix 287, brick X: 31,54, Y: 0,19, one pixel: 36 0
Blob 13 of 19, id: 1, sources: 1, size: 25x17, npix 284, brick X: 65,90, Y: 0,17, one pixel: 70 0
Blob 14 of 19, id: 16, sources: 1, size: 21x22, npix 282, brick X: 111,132, Y: 204,226, one pixel: 120 204
Blob 15 of 19, id: 12, sources: 1, size: 20x20, npix 247, brick X: 55,75, Y: 128,148, one pixel: 64 128
Blob 16 of 19, id: 18, sources: 1, size: 20x19, npix 234, brick X: 102,122, Y: 220,239, one pixel: 111 220
Blob 17 of 19, id: 9, sources: 1, size: 20x21, npix 229, brick X: 181,201, Y: 70,91, one pixel: 191 70
Blob 18 of 19, id: 7, sources: 1, size: 16x21, npix 206, brick X: 0,16, Y: 36,57, one pixel: 5 36
Blob 19 of 19, id: 13, sources: 1, size: 18x17, npix 162, brick X: 53,71, Y: 151,168, one pixel: 61 151
Blob 17 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 937 MB, VmSize: 734 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150032 MB
Blob 16 finished, total: Wall: 0.35 s, CPU: 0.34 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 141 MB, maxrss: 0.095412 MB
Blob 19 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 952 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147964 MB
Blob 10 finished, total: Wall: 0.54 s, CPU: 0.54 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.093408 MB
Blob 14 finished, total: Wall: 0.58 s, CPU: 0.58 s, VmPeak: 954 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.14796 MB
Blob 9 finished, total: Wall: 0.63 s, CPU: 0.62 s, VmPeak: 940 MB, VmSize: 734 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149932 MB
Blob 11 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 1011 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148224 MB
Blob 18 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 935 MB, VmSize: 733 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149192 MB
Blob 5 finished, total: Wall: 0.70 s, CPU: 0.69 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147372 MB
Blob 15 finished, total: Wall: 0.72 s, CPU: 0.71 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 141 MB, maxrss: 0.095744 MB
Blob 8 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147884 MB
Blob 12 finished, total: Wall: 0.79 s, CPU: 0.78 s, VmPeak: 950 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.14816 MB
Blob 7 finished, total: Wall: 1.01 s, CPU: 1.00 s, VmPeak: 1010 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148532 MB
Blob 13 finished, total: Wall: 1.09 s, CPU: 1.09 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093292 MB
Blob 6 finished, total: Wall: 1.31 s, CPU: 1.31 s, VmPeak: 1012 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148612 MB
Blob 2 finished, total: Wall: 1.48 s, CPU: 1.48 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148492 MB
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 1.85 s, CPU: 1.84 s, VmPeak: 936 MB, VmSize: 733 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148988 MB
Blob 4 finished, total: Wall: 1.99 s, CPU: 1.99 s, VmPeak: 1011 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.14912 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.56036, ee1=0.19504, ee2=0.392301
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 10.55 s, CPU: 10.55 s, VmPeak: 1016 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.151444 MB
Old catalog: 31
New catalog: 33
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/metrics/cus/blobs-custom-039496m31883.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/metrics/cus/all-models-custom-039496m31883.fits
Stage fitblobs : Wall: 11.23 s, CPU: 0.67 s, VmPeak: 1046 MB, VmSize: 1036 MB, VmRSS: 230 MB, VmData: 256 MB, maxrss: 0.235556 MB
Stage fitblobs finished: 2020-08-05T19:48:16.391895
Resources for stage fitblobs : 26.438 s worker CPU, 26.709 s worker Wall, Wall: 11.230 s, Cores in use: 2.41, Total efficiency (on 32 cores): 7.5 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T19:48:16.415349
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/tmp-legacysurvey-custom-039496m31883-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/tmp-legacysurvey-custom-039496m31883-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/tmp-legacysurvey-custom-039496m31883-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/tmp-legacysurvey-custom-039496m31883-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-resid.jpg
Stage coadds : Wall: 3.44 s, CPU: 0.92 s, VmPeak: 1046 MB, VmSize: 1036 MB, VmRSS: 231 MB, VmData: 256 MB, maxrss: 0.236072 MB
Stage coadds finished: 2020-08-05T19:48:19.859166
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 18.891 s worker CPU, 38.364 s worker Wall, Wall: 3.446 s, Cores in use: 5.75, Total efficiency (on 32 cores): 18.0 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T19:48:19.879154
Cut to 1 unWISE tiles
Reading WISE tile 0388m319 band 3
Reading WISE tile 0388m319 band 2
Reading WISE tile 0388m319 band 1
Reading WISE tile 0388m319 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 951 MB, VmSize: 807 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.1913 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 955 MB, VmSize: 805 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.206612 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 951 MB, VmSize: 805 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.206856 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 952 MB, VmSize: 870 MB, VmRSS: 210 MB, VmData: 239 MB, maxrss: 0.21488 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/tmp-legacysurvey-custom-039496m31883-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/tmp-legacysurvey-custom-039496m31883-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 4.72 s, CPU: 1.59 s, VmPeak: 1046 MB, VmSize: 1036 MB, VmRSS: 231 MB, VmData: 256 MB, maxrss: 0.236776 MB
Stage wise_forced finished: 2020-08-05T19:48:24.598705
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 3.347 s worker CPU, 8.501 s worker Wall, Wall: 4.722 s, Cores in use: 1.05, Total efficiency (on 32 cores): 3.3 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T19:48:24.663760
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/tractor-i/cus/tractor-custom-039496m31883.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/tractor/cus/tractor-custom-039496m31883.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/tractor/cus/brick-custom-039496m31883.sha256sum
Stage writecat : Wall: 2.67 s, CPU: 1.66 s, VmPeak: 1169 MB, VmSize: 1041 MB, VmRSS: 233 MB, VmData: 256 MB, maxrss: 0.36978 MB
Stage writecat finished: 2020-08-05T19:48:27.331103
Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 2.670 s, Cores in use: 0.62, Total efficiency (on 32 cores): 1.9 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/039/PGC699843/PGC699843-largegalaxy-writecat.p
All done: 70.199 s worker CPU, 2028.869 s worker Wall, Wall: 144.243 s, Cores in use: 0.56, Total efficiency (on 32 cores): 1.8 %
Finished galaxy PGC699843 in 2.474 minutes.
Started working on galaxy PGC699843 at Mon Aug 10 08:05:10 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 39.49615150989933 -31.883122996622493 --width 239 --height 239 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/PGC699843-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/PGC699843-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-10T08:05:11.822523
legacypipe git version: DR9.5.11-watershed-6-g6a2880fc
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '39.49615150989933', '-31.883122996622493', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/PGC699843-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/PGC699843-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 39.49615150989933 -31.883122996622493 --width 239 --height 239 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/PGC699843-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/PGC699843-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 39.49615150989933 -31.883122996622493
Starting process 3087 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB
Starting process 3089 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 3091 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 3094 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 3097 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059524 MB
Starting process 3100 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059472 MB
Starting process 3103 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059472 MB
Starting process 3110 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-10T08:05:12.568473
Keeping 27 CCDs:
  c4d_171128_045842_ooi_z_v1-S5 z expnum 700674 exptime 90.0 propid 2012B-0001 seeing 1.24 MJD 58085.207 object DES survey hex 396-318 tiling 8 
    decam/CP/V4.1/CP20171127/c4d_171128_045842_ooi_z_v1.fits.fz
  c4d_171015_073429_ooi_r_v1-S5 r expnum 687281 exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 58041.316 object DES survey hex 396-318 tiling 8 
    decam/CP/V4.1/CP20171014/c4d_171015_073429_ooi_r_v1.fits.fz
  c4d_141020_082719_ooi_z_ls9-N4 z expnum 369529 exptime 90.0 propid 2012B-0001 seeing 0.97 MJD 56950.351 object DES survey hex 396-318 tiling 1 
    decam/CP/V4.8.2a/CP20141019/c4d_141020_082719_ooi_z_ls9.fits.fz
  c4d_141225_043745_ooi_r_ls9-N4 r expnum 391334 exptime 90.0 propid 2012B-0001 seeing 1.20 MJD 57016.191 object DES survey hex 396-318 tiling 1 
    decam/CP/V4.8.2a/CP20141224/c4d_141225_043745_ooi_r_ls9.fits.fz
  c4d_150210_013334_ooi_g_ls9-N4 g expnum 408314 exptime 90.0 propid 2012B-0001 seeing 0.99 MJD 57063.063 object DES survey hex 396-318 tiling 1 
    decam/CP/V4.8.2a/CP20150209/c4d_150210_013334_ooi_g_ls9.fits.fz
  c4d_141230_030656_ooi_z_ls9-S28 z expnum 393099 exptime 90.0 propid 2012B-0001 seeing 1.14 MJD 57021.128 object DES survey hex 396-318 tiling 3 
    decam/CP/V4.8.2a/CP20141229/c4d_141230_030656_ooi_z_ls9.fits.fz
  c4d_141225_043547_ooi_g_ls9-S28 g expnum 391333 exptime 90.0 propid 2012B-0001 seeing 1.15 MJD 57016.190 object DES survey hex 396-318 tiling 3 
    decam/CP/V4.8.2a/CP20141224/c4d_141225_043547_ooi_g_ls9.fits.fz
  c4d_150119_025733_ooi_r_ls9-S28 r expnum 400413 exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 57041.122 object DES survey hex 396-318 tiling 3 
    decam/CP/V4.8.2a/CP20150118/c4d_150119_025733_ooi_r_ls9.fits.fz
  c4d_151017_072238_ooi_r_ls9-N24 r expnum 484987 exptime 90.0 propid 2012B-0001 seeing 1.19 MJD 57312.306 object DES survey hex 396-318 tiling 2 
    decam/CP/V4.8.2a/CP20151016/c4d_151017_072238_ooi_r_ls9.fits.fz
  c4d_150124_023243_ooi_g_ls9-N24 g expnum 402280 exptime 90.0 propid 2012B-0001 seeing 0.94 MJD 57046.104 object DES survey hex 396-318 tiling 2 
    decam/CP/V4.8.2a/CP20150123/c4d_150124_023243_ooi_g_ls9.fits.fz
  c4d_141201_052926_ooi_z_ls9-N24 z expnum 383222 exptime 90.0 propid 2012B-0001 seeing 1.15 MJD 56992.227 object DES survey hex 396-318 tiling 2 
    decam/CP/V4.8.2a/CP20141130/c4d_141201_052926_ooi_z_ls9.fits.fz
  c4d_161207_052339_ooi_g_ls9-N23 g expnum 600579 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 57729.223 object DES survey hex 396-318 tiling 6 
    decam/CP/V4.8.2/CP20161206/c4d_161207_052339_ooi_g_ls9.fits.fz
  c4d_161023_065855_ooi_z_ls9-N23 z expnum 585331 exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 57684.289 object DES survey hex 396-318 tiling 6 
    decam/CP/V4.8.2a/CP20161022/c4d_161023_065855_ooi_z_ls9.fits.fz
  c4d_161124_062009_ooi_g_v1-N23 g expnum 595840 exptime 90.0 propid 2012B-0001 seeing 1.60 MJD 57716.262 object DES survey hex 396-318 tiling 6 
    decam/CP/V4.1/CP20161124/c4d_161124_062009_ooi_g_v1.fits.fz
  c4d_160924_060259_ooi_g_ls9-N10 g expnum 576579 exptime 90.0 propid 2012B-0001 seeing 1.19 MJD 57655.250 object DES survey hex 396-318 tiling 5 
    decam/CP/V4.8.2a/CP20160923/c4d_160924_060259_ooi_g_ls9.fits.fz
  c4d_151017_072636_ooi_g_ls9-N26 g expnum 484989 exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 57312.309 object DES survey hex 396-318 tiling 4 
    decam/CP/V4.8.2a/CP20151016/c4d_151017_072636_ooi_g_ls9.fits.fz
  c4d_151215_032355_ooi_r_ls9-N26 r expnum 502008 exptime 90.0 propid 2012B-0001 seeing 1.26 MJD 57371.140 object DES survey hex 396-318 tiling 4 
    decam/CP/V4.8.2a/CP20151214/c4d_151215_032355_ooi_r_ls9.fits.fz
  c4d_151101_065236_ooi_z_ls9-N26 z expnum 488879 exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57327.285 object DES survey hex 396-318 tiling 4 
    decam/CP/V4.8.2a/CP20151031/c4d_151101_065236_ooi_z_ls9.fits.fz
  c4d_171020_082814_ooi_g_v1-S5 g expnum 689057 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 58046.353 object DES survey hex 396-318 tiling 8 
    decam/CP/V4.1/CP20171019/c4d_171020_082814_ooi_g_v1.fits.fz
  c4d_171226_041906_ooi_r_v1-N14 r expnum 707442 exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 58113.180 object DES survey hex 396-318 tiling 9 
    decam/CP/V4.1/CP20171225/c4d_171226_041906_ooi_r_v1.fits.fz
  c4d_180118_024503_ooi_g_v1-N14 g expnum 713101 exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 58136.115 object DES survey hex 396-318 tiling 9 
    decam/CP/V4.1/CP20180117/c4d_180118_024503_ooi_g_v1.fits.fz
  c4d_171226_041509_ooi_z_v1-N14 z expnum 707440 exptime 90.0 propid 2012B-0001 seeing 1.02 MJD 58113.177 object DES survey hex 396-318 tiling 9 
    decam/CP/V4.1/CP20171225/c4d_171226_041509_ooi_z_v1.fits.fz
  c4d_170203_013148_ooi_z_ls9-S24 z expnum 615961 exptime 90.0 propid 2012B-0001 seeing 1.02 MJD 57787.062 object DES survey hex 376-329 tiling 7 
    decam/CP/V4.8.2/CP20170202/c4d_170203_013148_ooi_z_ls9.fits.fz
  c4d_161002_081853_ooi_r_ls9-S24 r expnum 580002 exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 57663.345 object DES survey hex 376-329 tiling 7 
    decam/CP/V4.8.2a/CP20161001/c4d_161002_081853_ooi_r_ls9.fits.fz
  c4d_171015_073033_ooi_g_v1-S24 g expnum 687279 exptime 90.0 propid 2012B-0001 seeing 1.36 MJD 58041.313 object DES survey hex 376-329 tiling 7 
    decam/CP/V4.1/CP20171014/c4d_171015_073033_ooi_g_v1.fits.fz
  c4d_160923_082007_ooi_r_ls9-N10 r expnum 576230 exptime 90.0 propid 2012B-0001 seeing 1.06 MJD 57654.346 object DES survey hex 396-318 tiling 5 
    decam/CP/V4.8.2a/CP20160922/c4d_160923_082007_ooi_r_ls9.fits.fz
  c4d_160117_025738_ooi_z_ls9-N10 z expnum 512154 exptime 90.0 propid 2012B-0001 seeing 1.08 MJD 57404.122 object DES survey hex 396-318 tiling 5 
    decam/CP/V4.8.2a/CP20160116/c4d_160117_025738_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961a5f3-g-20141225T043326_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-r-20171015T073429_oi[S5,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171125_9031971-z-20171128T045842_oi[S5,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96186fb-z-20141020T082500_oi[N4,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961d483-r-20150119T025512_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961c524-g-20150210T013115_oi[N4,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961d4c2-z-20141230T030435_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961c811-r-20141225T043525_oi[N4,noinherit][2046,4094][real]: DES surv
Zeroing out 0 weight-map pixels below quantization error (= median 2.65e-06)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9622f50-r-20151017T072017_oi[N24,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961b974-g-20150124T023021_oi[N24,noinherit][2046,4094][real]: DES sur
Zeroing out 0 weight-map pixels below quantization error (= median 5.71e-05)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961c1d5-z-20141201T052709_oi[N24,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e7ae-z-20161023T065622_oi[N23,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9505bd4-g-20161207T052119_oi[N23,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962aa8f-g-20160924T060039_oi[N10,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES16B_20161121_8e237e6-g-20161124T061750_oi[N23,noinherit][2046,4094][real]: DE
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96222a9-g-20151017T072415_oi[N26,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962667b-r-20151215T032134_oi[N26,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9623afc-z-20151101T065017_oi[N26,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171224_907974d-r-20171226T041906_oi[N14,noinherit][2046,4094][real]: DE
Zeroing out 0 weight-map pixels below quantization error (= median 0.00024)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180110_909afae-g-20180118T024503_oi[N14,noinherit][2046,4094][real]: DE
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171224_907974d-z-20171226T041509_oi[N14,noinherit][2046,4094][real]: DE
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9507c56-z-20170203T012929_oi[S24,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e768-r-20161002T081634_oi[S24,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-g-20171015T073033_oi[S24,noinherit][2046,4094][real]: DE
Zeroing out 5 weight-map pixels below quantization error (= median 4.31e-06)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b673-r-20160923T081746_oi[N10,noinherit][2046,4094][real]: DES sur
Zeroing out 4 weight-map pixels below quantization error (= median 3.3e-05)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9627520-z-20160117T025517_oi[N10,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171017_8fe5678-g-20171020T082814_oi[S5,noinherit][2046,4094][real]: DES
Stage tims : Wall: 128.95 s, CPU: 1.30 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 189 MB, VmData: 223 MB, maxrss: 0.193992 MB
Stage tims finished: 2020-08-10T08:07:21.518887
Zeroing out 8 weight-map pixels below quantization error (= median 0.000277)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961c811-r-20141225T043525_oi[N4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES16B_20161121_8e237e6-g-20161124T061750_oi[N23,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180110_909afae-g-20180118T024503_oi[N14,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96186fb-z-20141020T082500_oi[N4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171125_9031971-z-20171128T045842_oi[S5,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9622f50-r-20151017T072017_oi[N24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96222a9-g-20151017T072415_oi[N26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9507c56-z-20170203T012929_oi[S24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-r-20171015T073429_oi[S5,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961c1d5-z-20141201T052709_oi[N24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962667b-r-20151215T032134_oi[N26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e768-r-20161002T081634_oi[S24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Zeroing out 0 weight-map pixels below quantization error (= median 0.000296)
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961d483-r-20150119T025512_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e7ae-z-20161023T065622_oi[N23,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9623afc-z-20151101T065017_oi[N26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171013_8fd9711-g-20171015T073033_oi[S24,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Zeroing out 240 weight-map pixels below quantization error (= median 0.000179)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961d4c2-z-20141230T030435_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962aa8f-g-20160924T060039_oi[N10,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171224_907974d-z-20171226T041509_oi[N14,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b673-r-20160923T081746_oi[N10,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961a5f3-g-20141225T043326_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961b974-g-20150124T023021_oi[N24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171224_907974d-r-20171226T041906_oi[N14,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9627520-z-20160117T025517_oi[N10,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961c524-g-20150210T013115_oi[N4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9505bd4-g-20161207T052119_oi[N23,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171017_8fe5678-g-20171020T082814_oi[S5,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
Resources for stage tims : 10.078 s worker CPU, 922.698 s worker Wall, Wall: 128.952 s, Cores in use: 0.09, Total efficiency (on 8 cores): 1.1 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/PGC699843-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/PGC699843-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-10T08:07:21.979343
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09294.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09422.fits
Matched 1 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/metrics/cus/reference-custom-039496m31883.fits
Stage refs : Wall: 7.21 s, CPU: 1.69 s, VmPeak: 1040 MB, VmSize: 1020 MB, VmRSS: 202 MB, VmData: 235 MB, maxrss: 0.206768 MB
Stage refs finished: 2020-08-10T08:07:29.186299
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.208 s, Cores in use: 0.24, Total efficiency (on 8 cores): 2.9 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/PGC699843-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/PGC699843-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-10T08:07:29.266041
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/metrics/cus/outlier-mask-custom-039496m31883.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/metrics/cus/outliers-pre-custom-039496m31883.jpg
Image c4d_160924_060259_ooi_g_ls9-N10 g : masking 304 positive outlier pixels and 0 negative outlier pixels
Image c4d_141225_043547_ooi_g_ls9-S28 g : masking 0 positive outlier pixels and 88 negative outlier pixels
Image c4d_180118_024503_ooi_g_v1-N14 g : masking 692 positive outlier pixels and 0 negative outlier pixels
Image c4d_171015_073429_ooi_r_v1-S5 r : masking 334 positive outlier pixels and 0 negative outlier pixels
Image c4d_151101_065236_ooi_z_ls9-N26 z : masking 449 positive outlier pixels and 0 negative outlier pixels
Image c4d_160117_025738_ooi_z_ls9-N10 z : masking 410 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/metrics/cus/outlier-mask-custom-039496m31883.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/metrics/cus/outliers-post-custom-039496m31883.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/metrics/cus/outliers-masked-pos-custom-039496m31883.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/metrics/cus/outliers-masked-neg-custom-039496m31883.jpg
Stage outliers : Wall: 1.36 s, CPU: 1.15 s, VmPeak: 1040 MB, VmSize: 1030 MB, VmRSS: 225 MB, VmData: 254 MB, maxrss: 0.230656 MB
Stage outliers finished: 2020-08-10T08:07:30.623424
Resources for stage outliers : 1.969 s worker CPU, 1.969 s worker Wall, Wall: 1.359 s, Cores in use: 2.30, Total efficiency (on 8 cores): 28.7 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/PGC699843-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/PGC699843-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-10T08:07:30.753236
Stage halos : Wall: 0.32 s, CPU: 0.31 s, VmPeak: 1040 MB, VmSize: 1030 MB, VmRSS: 225 MB, VmData: 255 MB, maxrss: 0.230868 MB
Stage halos finished: 2020-08-10T08:07:31.069411
Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.317 s, Cores in use: 0.99, Total efficiency (on 8 cores): 12.4 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/PGC699843-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/PGC699843-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-10T08:07:31.468884
PSF sigmas in coadd pixels: ['1.61', '1.87', '1.53', '1.74', '2.60', '1.93', '1.92', '1.74', '1.91', '2.22']
Using average PSF sigma 1.9078322260230878
Gaussian PSF norm 0.1478614250907744 vs pixelized 0.12744237
average tim pixel scale / coadd scale: 1.001072360357298
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.04', '1.95', '1.92', '1.93', '2.05', '1.80', '2.02', '1.72']
Using average PSF sigma 1.9296365500974786
Gaussian PSF norm 0.14619063458329898 vs pixelized 0.14695917
average tim pixel scale / coadd scale: 1.0010781814010976
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.02', '1.58', '1.84', '1.87', '1.92', '1.84', '1.65', '1.66', '1.75']
Using average PSF sigma 1.7937375307187269
Gaussian PSF norm 0.1572664823826519 vs pixelized 0.1543393
average tim pixel scale / coadd scale: 1.0010053871114177
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.34 s, CPU: 0.33 s, VmPeak: 1040 MB, VmSize: 1030 MB, VmRSS: 228 MB, VmData: 255 MB, maxrss: 0.233168 MB
Stage fit_on_coadds finished: 2020-08-10T08:07:31.805493
Resources for stage fit_on_coadds : 0.423 s worker CPU, 0.423 s worker Wall, Wall: 0.338 s, Cores in use: 2.22, Total efficiency (on 8 cores): 27.8 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/PGC699843-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/PGC699843-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-10T08:07:31.817049
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 17 potential peaks
Of 17 potential peaks: 2 in veto map, 0 cut by saddle test, 0 cut by aper test, 15 kept
SED z : 15 new peaks
Found 25 potential peaks
Of 25 potential peaks: 18 in veto map, 2 cut by saddle test, 0 cut by aper test, 5 kept
SED r : 5 new peaks
Found 19 potential peaks
Of 19 potential peaks: 19 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 32 potential peaks
Of 32 potential peaks: 24 in veto map, 2 cut by saddle test, 0 cut by aper test, 6 kept
SED Flat : 6 new peaks
Found 32 potential peaks
Of 32 potential peaks: 28 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 28 new sources
Median coadd sky for g : -0.00014388507
Median coadd sky for r : -0.00016598184
Median coadd sky for z : -6.457112e-05
Stage srcs : Wall: 0.62 s, CPU: 0.58 s, VmPeak: 1040 MB, VmSize: 1030 MB, VmRSS: 228 MB, VmData: 255 MB, maxrss: 0.233568 MB
Stage srcs finished: 2020-08-10T08:07:32.436042
Resources for stage srcs : 0.079 s worker CPU, 0.079 s worker Wall, Wall: 0.620 s, Cores in use: 1.07, Total efficiency (on 8 cores): 13.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/PGC699843-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/PGC699843-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-10T08:07:32.448870
Blob 1 of 19, id: 9, sources: 8, size: 119x129, npix 8049, brick X: 75,194, Y: 69,198, one pixel: 138 69
Blob 2 of 19, id: 7, sources: 2, size: 55x37, npix 1154, brick X: 36,91, Y: 41,78, one pixel: 74 41
Blob 3 of 19, id: 10, sources: 2, size: 48x39, npix 1041, brick X: 191,239, Y: 83,122, one pixel: 223 83
Blob 4 of 19, id: 4, sources: 2, size: 26x53, npix 1018, brick X: 213,239, Y: 17,70, one pixel: 232 17
Blob 5 of 19, id: 17, sources: 1, size: 28x33, npix 623, brick X: 131,159, Y: 206,239, one pixel: 143 206
Blob 6 of 19, id: 0, sources: 1, size: 32x25, npix 578, brick X: 0,32, Y: 0,25, one pixel: 0 0
Blob 7 of 19, id: 16, sources: 2, size: 30x38, npix 545, brick X: 103,133, Y: 199,237, one pixel: 122 199
Blob 8 of 19, id: 5, sources: 1, size: 25x28, npix 464, brick X: 21,46, Y: 19,47, one pixel: 31 19
Blob 9 of 19, id: 3, sources: 1, size: 24x27, npix 411, brick X: 200,224, Y: 5,32, one pixel: 210 5
Blob 6 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 1016 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.14392 MB
Blob 10 of 19, id: 14, sources: 1, size: 24x23, npix 340, brick X: 36,60, Y: 177,200, one pixel: 46 177
Blob 8 finished, total: Wall: 1.34 s, CPU: 1.33 s, VmPeak: 1023 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145628 MB
Blob 11 of 19, id: 13, sources: 1, size: 26x22, npix 338, brick X: 62,88, Y: 156,178, one pixel: 75 156
Blob 7 finished, total: Wall: 1.57 s, CPU: 1.57 s, VmPeak: 955 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.144896 MB
Blob 12 of 19, id: 2, sources: 1, size: 22x23, npix 315, brick X: 169,191, Y: 4,27, one pixel: 179 4
Blob 5 finished, total: Wall: 1.71 s, CPU: 1.70 s, VmPeak: 1024 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146036 MB
Blob 13 of 19, id: 15, sources: 1, size: 18x22, npix 270, brick X: 221,239, Y: 187,209, one pixel: 230 187
Blob 2 finished, total: Wall: 1.74 s, CPU: 1.73 s, VmPeak: 1023 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143468 MB
Blob 14 of 19, id: 11, sources: 1, size: 20x21, npix 248, brick X: 56,76, Y: 123,144, one pixel: 65 123
Blob 9 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 1016 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.14392 MB
Blob 15 of 19, id: 8, sources: 1, size: 20x20, npix 238, brick X: 182,202, Y: 66,86, one pixel: 191 66
Blob 10 finished, total: Wall: 0.89 s, CPU: 0.89 s, VmPeak: 1023 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145628 MB
Blob 16 of 19, id: 6, sources: 1, size: 17x21, npix 221, brick X: 0,17, Y: 31,52, one pixel: 6 31
Blob 12 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 1024 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146036 MB
Blob 17 of 19, id: 12, sources: 1, size: 18x18, npix 171, brick X: 54,72, Y: 146,164, one pixel: 62 146
Blob 13 finished, total: Wall: 0.87 s, CPU: 0.87 s, VmPeak: 1023 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14554 MB
Blob 18 of 19, id: 18, sources: 1, size: 19x12, npix 147, brick X: 187,206, Y: 227,239, one pixel: 195 227
Blob 19 of 19, id: 1, sources: 1, size: 17x13, npix 129, brick X: 35,52, Y: 0,13, one pixel: 39 0
Measuring 1 iterative sources
Blob 4 finished, total: Wall: 2.77 s, CPU: 2.76 s, VmPeak: 1023 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.1458 MB
Blob 14 finished, total: Wall: 0.97 s, CPU: 0.97 s, VmPeak: 1016 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.14392 MB
Blob 15 finished, total: Wall: 0.78 s, CPU: 0.77 s, VmPeak: 1023 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145628 MB
Blob 17 finished, total: Wall: 0.43 s, CPU: 0.43 s, VmPeak: 1023 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14554 MB
Blob 3 finished, total: Wall: 3.11 s, CPU: 3.11 s, VmPeak: 1028 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145736 MB
Blob 11 finished, total: Wall: 1.60 s, CPU: 1.60 s, VmPeak: 955 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14536 MB
Blob 16 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 1024 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146036 MB
Blob 19 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 1016 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.14392 MB
Blob 18 finished, total: Wall: 0.83 s, CPU: 0.83 s, VmPeak: 1023 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.1458 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.43216, ee1=0.187165, ee2=0.37452
Measuring 2 iterative sources
Blob 1 finished, total: Wall: 9.83 s, CPU: 9.83 s, VmPeak: 1012 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.147988 MB
Old catalog: 30
New catalog: 32
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/metrics/cus/blobs-custom-039496m31883.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/metrics/cus/all-models-custom-039496m31883.fits
Stage fitblobs : Wall: 10.42 s, CPU: 0.59 s, VmPeak: 1040 MB, VmSize: 1030 MB, VmRSS: 228 MB, VmData: 255 MB, maxrss: 0.233732 MB
Stage fitblobs finished: 2020-08-10T08:07:42.869754
Resources for stage fitblobs : 32.529 s worker CPU, 32.686 s worker Wall, Wall: 10.422 s, Cores in use: 3.18, Total efficiency (on 8 cores): 39.7 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/PGC699843-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/PGC699843-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-10T08:07:42.882702
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/tmp-legacysurvey-custom-039496m31883-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/tmp-legacysurvey-custom-039496m31883-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/tmp-legacysurvey-custom-039496m31883-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/tmp-legacysurvey-custom-039496m31883-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-resid.jpg
Stage coadds : Wall: 1.85 s, CPU: 0.78 s, VmPeak: 1040 MB, VmSize: 1030 MB, VmRSS: 229 MB, VmData: 255 MB, maxrss: 0.234244 MB
Stage coadds finished: 2020-08-10T08:07:44.728720
Resources for stage coadds : 4.027 s worker CPU, 5.001 s worker Wall, Wall: 1.847 s, Cores in use: 2.60, Total efficiency (on 8 cores): 32.5 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/PGC699843-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/PGC699843-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-10T08:07:44.740833
Cut to 1 unWISE tiles
Reading WISE tile 0388m319 band 1
Reading WISE tile 0388m319 band 2
Reading WISE tile 0388m319 band 3
Reading WISE tile 0388m319 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 1028 MB, VmSize: 806 MB, VmRSS: 149 MB, VmData: 177 MB, maxrss: 0.195056 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 1012 MB, VmSize: 803 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210572 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 1016 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.208432 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/038/0388m319/unwise-0388m319-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 955 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209292 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/tmp-legacysurvey-custom-039496m31883-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/tmp-legacysurvey-custom-039496m31883-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 1.74 s, CPU: 0.44 s, VmPeak: 1040 MB, VmSize: 1030 MB, VmRSS: 229 MB, VmData: 255 MB, maxrss: 0.234952 MB
Stage wise_forced finished: 2020-08-10T08:07:46.482281
Resources for stage wise_forced : 3.357 s worker CPU, 4.213 s worker Wall, Wall: 1.743 s, Cores in use: 2.18, Total efficiency (on 8 cores): 27.2 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/PGC699843-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/PGC699843-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-10T08:07:46.533380
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/coadd/cus/custom-039496m31883/legacysurvey-custom-039496m31883-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/tractor-i/cus/tractor-custom-039496m31883.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/tractor/cus/tractor-custom-039496m31883.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/tractor/cus/brick-custom-039496m31883.sha256sum
Stage writecat : Wall: 0.90 s, CPU: 0.63 s, VmPeak: 1162 MB, VmSize: 1034 MB, VmRSS: 231 MB, VmData: 255 MB, maxrss: 0.367812 MB
Stage writecat finished: 2020-08-10T08:07:47.435654
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.903 s, Cores in use: 0.69, Total efficiency (on 8 cores): 8.7 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/PGC699843-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/039/PGC699843/PGC699843-largegalaxy-writecat.p
All done: 52.463 s worker CPU, 967.072 s worker Wall, Wall: 154.906 s, Cores in use: 0.39, Total efficiency (on 8 cores): 4.9 %
Finished galaxy PGC699843 in 2.616 minutes.