Started working on galaxy PGC428323 at Wed Aug  5 21:24:09 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 299.8071405 -53.594598100000006 --width 301 --height 301 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/PGC428323-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/PGC428323-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T21:24:10.749972
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '299.8071405', '-53.594598100000006', '--width', '301', '--height', '301', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/PGC428323-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/PGC428323-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 299.8071405 -53.594598100000006 --width 301 --height 301 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/PGC428323-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/PGC428323-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 299.8071405 -53.594598100000006
Starting process 33751 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 33752 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 33753 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 33754 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 33755 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB
Starting process 33756 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 33757 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 33758 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 33759 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 33760 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 33761 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 33762 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 33763 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 33764 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 33765 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 33766 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T21:24:14.325719
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 12 CCDs:
  c4d_160909_235459_ooi_z_ls9-N29 z expnum 572890 exptime 90.0 propid 2012B-0001 seeing 1.69 MJD 57640.995 object DES survey hex -611-532 tiling 7 
    decam/CP/V4.8.2a/CP20160909/c4d_160909_235459_ooi_z_ls9.fits.fz
  c4d_160929_000425_ooi_r_ls9-N29 r expnum 578577 exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 57660.001 object DES survey hex -611-532 tiling 7 
    decam/CP/V4.8.2a/CP20160928/c4d_160929_000425_ooi_r_ls9.fits.fz
  c4d_160929_000621_ooi_g_ls9-N29 g expnum 578578 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 57660.003 object DES survey hex -611-532 tiling 7 
    decam/CP/V4.8.2a/CP20160928/c4d_160929_000621_ooi_g_ls9.fits.fz
  c4d_160910_234044_ooi_z_ls9-N29 z expnum 573333 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 57641.985 object DES survey hex -611-532 tiling 7 
    decam/CP/V4.8.2a/CP20160910/c4d_160910_234044_ooi_z_ls9.fits.fz
  c4d_150912_005854_ooi_g_ls9-S2 g expnum 473858 exptime 90.0 propid 2012B-0001 seeing 1.45 MJD 57277.039 object DES survey hex -586-542 tiling 6 
    decam/CP/V4.8.2a/CP20150911/c4d_150912_005854_ooi_g_ls9.fits.fz
  c4d_150912_005704_ooi_r_ls9-S2 r expnum 473857 exptime 90.0 propid 2012B-0001 seeing 1.34 MJD 57277.038 object DES survey hex -586-542 tiling 6 
    decam/CP/V4.8.2a/CP20150911/c4d_150912_005704_ooi_r_ls9.fits.fz
  c4d_170912_005509_ooi_z_v1-N29 z expnum 676727 exptime 90.0 propid 2012B-0001 seeing 1.49 MJD 58008.038 object DES survey hex -611-532 tiling 9 
    decam/CP/V4.1/CP20170911/c4d_170912_005509_ooi_z_v1.fits.fz
  c4d_170923_000749_ooi_r_v1-N29 r expnum 680410 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 58019.005 object DES survey hex -611-532 tiling 9 
    decam/CP/V4.1/CP20170922/c4d_170923_000749_ooi_r_v1.fits.fz
  c4d_170912_005113_ooi_r_v1-N29 r expnum 676725 exptime 90.0 propid 2012B-0001 seeing 1.75 MJD 58008.036 object DES survey hex -611-532 tiling 9 
    decam/CP/V4.1/CP20170911/c4d_170912_005113_ooi_r_v1.fits.fz
  c4d_170923_001545_ooi_g_v1-N29 g expnum 680414 exptime 90.0 propid 2012B-0001 seeing 1.23 MJD 58019.011 object DES survey hex -611-532 tiling 9 
    decam/CP/V4.1/CP20170922/c4d_170923_001545_ooi_g_v1.fits.fz
  c4d_130901_013104_ooi_r_ls9-N20 r expnum 229293 exptime 90.0 propid 2012B-0001 seeing 1.00 MJD 56536.063 object DES survey hex -582-521 tiling 3 
    decam/CP/V4.8.2a/CP20130831/c4d_130901_013104_ooi_r_ls9.fits.fz
  c4d_130831_235707_ooi_g_ls9-N20 g expnum 229251 exptime 90.0 propid 2012B-0001 seeing 1.29 MJD 56535.998 object DES survey hex -582-521 tiling 3 
    decam/CP/V4.8.2a/CP20130831/c4d_130831_235707_ooi_g_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962d087-r-20160929T000201_oi[N29,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-g-20170923T001545_oi[N29,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962a9d4-z-20160910T233824_oi[N29,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9632a12-r-20130901T013104_oi[N20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962fa53-g-20130831T235707_oi[N20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170910_8f9120a-z-20170912T005509_oi[N29,noinherit][2046,4094][real]: DE
Zeroing out 0 weight-map pixels below quantization error (= median 0.000191)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9620e86-r-20150912T005434_oi[S2,noinherit][2046,4094][real]: DES surv
Zeroing out 0 weight-map pixels below quantization error (= median 4.27e-06)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c605-g-20160929T000400_oi[N29,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961f01b-g-20150912T005632_oi[S2,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962a9d4-z-20160909T235241_oi[N29,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-r-20170923T000749_oi[N29,noinherit][2046,4094][real]: DE
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 0 weight-map pixels below quantization error (= median 4.17e-05)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170910_8f9120a-r-20170912T005113_oi[N29,noinherit][2046,4094][real]: DE
Zeroing out 0 weight-map pixels below quantization error (= median 5.29e-05)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 152.04 s, CPU: 2.39 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 184 MB, VmData: 216 MB, maxrss: 0.188336 MB
Stage tims finished: 2020-08-05T21:26:46.365170
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962a9d4-z-20160910T233824_oi[N29,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962d087-r-20160929T000201_oi[N29,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9620e86-r-20150912T005434_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962fa53-g-20130831T235707_oi[N20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c605-g-20160929T000400_oi[N29,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961f01b-g-20150912T005632_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962a9d4-z-20160909T235241_oi[N29,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-r-20170923T000749_oi[N29,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170910_8f9120a-r-20170912T005113_oi[N29,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 7.817 s worker CPU, 305.431 s worker Wall, Wall: 152.041 s, Cores in use: 0.07, Total efficiency (on 16 cores): 0.4 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/PGC428323-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/PGC428323-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-g-20170923T001545_oi[N29,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170910_8f9120a-z-20170912T005509_oi[N29,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9632a12-r-20130901T013104_oi[N20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T21:26:46.396752
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11168.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11167.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11071.fits
Matched 5 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/metrics/cus/reference-custom-299807m53594.fits
Stage refs : Wall: 10.21 s, CPU: 6.77 s, VmPeak: 1099 MB, VmSize: 1095 MB, VmRSS: 269 MB, VmData: 299 MB, maxrss: 0.275716 MB
Stage refs finished: 2020-08-05T21:26:56.611703
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 10.217 s, Cores in use: 0.66, Total efficiency (on 16 cores): 4.1 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/PGC428323-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/PGC428323-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T21:26:56.654383
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/metrics/cus/outlier-mask-custom-299807m53594.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/metrics/cus/outliers-pre-custom-299807m53594.jpg
Image c4d_150912_005854_ooi_g_ls9-S2 g : masking 36 positive outlier pixels and 0 negative outlier pixels
Image c4d_160929_000621_ooi_g_ls9-N29 g : masking 138 positive outlier pixels and 0 negative outlier pixels
Image c4d_170912_005113_ooi_r_v1-N29 r : masking 0 positive outlier pixels and 317 negative outlier pixels
Image c4d_160929_000425_ooi_r_ls9-N29 r : masking 514 positive outlier pixels and 0 negative outlier pixels
Image c4d_160909_235459_ooi_z_ls9-N29 z : masking 319 positive outlier pixels and 0 negative outlier pixels
Image c4d_160910_234044_ooi_z_ls9-N29 z : masking 325 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/metrics/cus/outlier-mask-custom-299807m53594.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/metrics/cus/outliers-post-custom-299807m53594.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/metrics/cus/outliers-masked-pos-custom-299807m53594.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/metrics/cus/outliers-masked-neg-custom-299807m53594.jpg
Stage outliers : Wall: 3.97 s, CPU: 3.09 s, VmPeak: 1104 MB, VmSize: 1104 MB, VmRSS: 290 MB, VmData: 317 MB, maxrss: 0.297356 MB
Stage outliers finished: 2020-08-05T21:27:00.628553
Resources for stage outliers : 1.378 s worker CPU, 1.528 s worker Wall, Wall: 3.976 s, Cores in use: 1.12, Total efficiency (on 16 cores): 7.0 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/PGC428323-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/PGC428323-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T21:27:01.891948
Stage halos : Wall: 1.74 s, CPU: 1.59 s, VmPeak: 1105 MB, VmSize: 1105 MB, VmRSS: 291 MB, VmData: 318 MB, maxrss: 0.297688 MB
Stage halos finished: 2020-08-05T21:27:03.630297
Resources for stage halos : 0.572 s worker CPU, 1.046 s worker Wall, Wall: 1.740 s, Cores in use: 1.24, Total efficiency (on 16 cores): 7.8 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/PGC428323-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/PGC428323-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T21:27:03.840533
PSF sigmas in coadd pixels: ['1.78', '2.36', '2.00', '2.10']
Using average PSF sigma 2.06012777828486
Gaussian PSF norm 0.13693072572844656 vs pixelized 0.116142824
average tim pixel scale / coadd scale: 1.0010071366737447
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.65', '2.17', '1.70', '2.85', '1.62']
Using average PSF sigma 1.9984492341943958
Gaussian PSF norm 0.14115684649232269 vs pixelized 0.12030806
average tim pixel scale / coadd scale: 1.0010241024295679
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.74', '1.74', '2.42']
Using average PSF sigma 2.30022138074381
Gaussian PSF norm 0.1226381052430087 vs pixelized 0.0959648
average tim pixel scale / coadd scale: 1.0009625311656534
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.26 s, CPU: 0.25 s, VmPeak: 1105 MB, VmSize: 1105 MB, VmRSS: 292 MB, VmData: 318 MB, maxrss: 0.29924 MB
Stage fit_on_coadds finished: 2020-08-05T21:27:04.104241
Resources for stage fit_on_coadds : 0.331 s worker CPU, 0.331 s worker Wall, Wall: 0.265 s, Cores in use: 2.18, Total efficiency (on 16 cores): 13.6 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/PGC428323-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/PGC428323-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T21:27:04.117296
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 26 potential peaks
Of 26 potential peaks: 7 in veto map, 2 cut by saddle test, 0 cut by aper test, 17 kept
SED z : 17 new peaks
Found 49 potential peaks
Of 49 potential peaks: 25 in veto map, 5 cut by saddle test, 0 cut by aper test, 19 kept
SED r : 19 new peaks
Found 31 potential peaks
Of 31 potential peaks: 26 in veto map, 4 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 64 potential peaks
Of 64 potential peaks: 45 in veto map, 9 cut by saddle test, 0 cut by aper test, 10 kept
SED Flat : 10 new peaks
Found 63 potential peaks
Of 63 potential peaks: 56 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 48 new sources
Median coadd sky for g : -3.3114156e-06
Median coadd sky for r : -3.3454777e-05
Median coadd sky for z : -0.000108542554
Stage srcs : Wall: 1.63 s, CPU: 1.59 s, VmPeak: 1105 MB, VmSize: 1105 MB, VmRSS: 293 MB, VmData: 318 MB, maxrss: 0.299776 MB
Stage srcs finished: 2020-08-05T21:27:05.744662
Resources for stage srcs : 0.095 s worker CPU, 0.095 s worker Wall, Wall: 1.629 s, Cores in use: 1.03, Total efficiency (on 16 cores): 6.5 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/PGC428323-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/PGC428323-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T21:27:05.758106
Blob 1 of 31, id: 6, sources: 12, size: 128x185, npix 12850, brick X: 73,201, Y: 56,241, one pixel: 168 56
Blob 2 of 31, id: 1, sources: 3, size: 63x56, npix 2009, brick X: 99,162, Y: 0,56, one pixel: 134 0
Blob 3 of 31, id: 13, sources: 3, size: 53x58, npix 1753, brick X: 206,259, Y: 144,202, one pixel: 214 144
Blob 4 of 31, id: 11, sources: 2, size: 49x52, npix 1670, brick X: 11,60, Y: 120,172, one pixel: 49 120
Blob 5 of 31, id: 18, sources: 3, size: 48x57, npix 1424, brick X: 223,271, Y: 204,261, one pixel: 245 204
Blob 6 of 31, id: 12, sources: 2, size: 40x43, npix 1071, brick X: 261,301, Y: 138,181, one pixel: 277 138
Blob 7 of 31, id: 17, sources: 1, size: 37x37, npix 982, brick X: 0,37, Y: 197,234, one pixel: 16 197
Blob 8 of 31, id: 24, sources: 3, size: 44x41, npix 939, brick X: 194,238, Y: 260,301, one pixel: 225 260
Blob 9 of 31, id: 2, sources: 2, size: 38x34, npix 796, brick X: 176,214, Y: 0,34, one pixel: 179 0
Blob 10 of 31, id: 20, sources: 2, size: 45x29, npix 677, brick X: 88,133, Y: 233,262, one pixel: 98 233
Blob 11 of 31, id: 22, sources: 1, size: 32x31, npix 666, brick X: 54,86, Y: 248,279, one pixel: 70 248
Blob 12 of 31, id: 14, sources: 1, size: 30x31, npix 660, brick X: 35,65, Y: 179,210, one pixel: 46 179
Blob 13 of 31, id: 27, sources: 1, size: 34x23, npix 567, brick X: 107,141, Y: 278,301, one pixel: 122 278
Blob 14 of 31, id: 21, sources: 1, size: 33x26, npix 566, brick X: 178,211, Y: 241,267, one pixel: 189 241
Blob 15 of 31, id: 16, sources: 1, size: 29x30, npix 561, brick X: 196,225, Y: 193,223, one pixel: 209 193
Blob 16 of 31, id: 15, sources: 1, size: 28x26, npix 478, brick X: 267,295, Y: 183,209, one pixel: 277 183
Blob 17 of 31, id: 26, sources: 1, size: 26x25, npix 438, brick X: 168,194, Y: 276,301, one pixel: 178 276
Blob 15 finished, total: Wall: 0.89 s, CPU: 0.89 s, VmPeak: 957 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150344 MB
Blob 18 of 31, id: 19, sources: 1, size: 28x25, npix 435, brick X: 135,163, Y: 232,257, one pixel: 149 232
Blob 16 finished, total: Wall: 0.91 s, CPU: 0.91 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149284 MB
Blob 19 of 31, id: 9, sources: 1, size: 24x26, npix 409, brick X: 227,251, Y: 105,131, one pixel: 238 105
Measuring 1 iterative sources
Blob 10 finished, total: Wall: 1.12 s, CPU: 1.12 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150064 MB
Blob 20 of 31, id: 28, sources: 1, size: 26x22, npix 392, brick X: 274,300, Y: 279,301, one pixel: 285 279
Blob 12 finished, total: Wall: 1.29 s, CPU: 1.29 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 96 MB, VmData: 143 MB, maxrss: 0.09834 MB
Blob 21 of 31, id: 8, sources: 1, size: 24x24, npix 365, brick X: 112,136, Y: 77,101, one pixel: 122 77
Blob 11 finished, total: Wall: 1.30 s, CPU: 1.25 s, VmPeak: 1013 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150036 MB
Blob 22 of 31, id: 3, sources: 1, size: 21x22, npix 278, brick X: 0,21, Y: 30,52, one pixel: 9 30
Blob 14 finished, total: Wall: 1.53 s, CPU: 1.53 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 114 MB, VmData: 167 MB, maxrss: 0.116836 MB
Blob 23 of 31, id: 25, sources: 1, size: 22x21, npix 271, brick X: 89,111, Y: 261,282, one pixel: 98 261
Measuring 1 iterative sources
Measuring 1 iterative sources
Blob 17 finished, total: Wall: 0.83 s, CPU: 0.83 s, VmPeak: 957 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150344 MB
Blob 24 of 31, id: 5, sources: 1, size: 21x21, npix 269, brick X: 15,36, Y: 45,66, one pixel: 23 45
Blob 21 finished, total: Wall: 0.42 s, CPU: 0.42 s, VmPeak: 1013 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150036 MB
Blob 25 of 31, id: 23, sources: 1, size: 21x20, npix 249, brick X: 156,177, Y: 257,277, one pixel: 165 257
Blob 13 finished, total: Wall: 1.97 s, CPU: 1.97 s, VmPeak: 1013 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150848 MB
Blob 26 of 31, id: 29, sources: 1, size: 22x20, npix 240, brick X: 27,49, Y: 280,300, one pixel: 36 280
Measuring 1 iterative sources
Blob 18 finished, total: Wall: 1.12 s, CPU: 1.12 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149284 MB
Blob 27 of 31, id: 4, sources: 1, size: 20x20, npix 228, brick X: 186,206, Y: 42,62, one pixel: 195 42
Blob 24 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 1013 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150036 MB
Blob 28 of 31, id: 7, sources: 1, size: 21x20, npix 220, brick X: 236,257, Y: 72,92, one pixel: 245 72
Blob 19 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150292 MB
Blob 29 of 31, id: 10, sources: 1, size: 18x19, npix 180, brick X: 80,98, Y: 118,137, one pixel: 89 118
Blob 23 finished, total: Wall: 0.45 s, CPU: 0.45 s, VmPeak: 957 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150344 MB
Blob 30 of 31, id: 0, sources: 1, size: 18x16, npix 165, brick X: 30,48, Y: 0,16, one pixel: 36 0
Blob 26 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149284 MB
Blob 31 of 31, id: 30, sources: 1, size: 17x16, npix 158, brick X: 60,77, Y: 285,301, one pixel: 68 285
Blob 7 finished, total: Wall: 2.42 s, CPU: 2.42 s, VmPeak: 1011 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.15028 MB
Blob 27 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 1013 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150036 MB
Blob 20 finished, total: Wall: 1.15 s, CPU: 1.15 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 96 MB, VmData: 143 MB, maxrss: 0.098452 MB
Blob 22 finished, total: Wall: 0.97 s, CPU: 0.97 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 114 MB, VmData: 167 MB, maxrss: 0.117 MB
Blob 30 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149284 MB
Blob 6 finished, total: Wall: 2.67 s, CPU: 2.63 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150604 MB
Blob 31 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 1011 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.15028 MB
Blob 25 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 1013 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.15158 MB
Blob 8 finished, total: Wall: 2.81 s, CPU: 2.81 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 96 MB, VmData: 143 MB, maxrss: 0.098768 MB
Blob 28 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150488 MB
Blob 5 finished, total: Wall: 2.94 s, CPU: 2.93 s, VmPeak: 952 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149932 MB
Measuring 1 iterative sources
Blob 9 finished, total: Wall: 2.95 s, CPU: 2.95 s, VmPeak: 957 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149876 MB
Blob 29 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 957 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150344 MB
Measuring 2 iterative sources
Blob 4 finished, total: Wall: 3.30 s, CPU: 3.30 s, VmPeak: 953 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150088 MB
Blob 3 finished, total: Wall: 3.48 s, CPU: 3.48 s, VmPeak: 1016 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150484 MB
Blob 2 finished, total: Wall: 3.77 s, CPU: 3.77 s, VmPeak: 957 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.151604 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.82183, ee1=0.334736, ee2=0.0373489
Measuring 2 iterative sources
Blob 1 finished, total: Wall: 9.80 s, CPU: 9.77 s, VmPeak: 697 MB, VmSize: 697 MB, VmRSS: 128 MB, VmData: 168 MB, maxrss: 0.130872 MB
Old catalog: 59
New catalog: 59
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/metrics/cus/blobs-custom-299807m53594.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/metrics/cus/all-models-custom-299807m53594.fits
Stage fitblobs : Wall: 11.22 s, CPU: 1.42 s, VmPeak: 1105 MB, VmSize: 1105 MB, VmRSS: 293 MB, VmData: 318 MB, maxrss: 0.30014 MB
Stage fitblobs finished: 2020-08-05T21:27:16.974776
Resources for stage fitblobs : 53.234 s worker CPU, 53.884 s worker Wall, Wall: 11.218 s, Cores in use: 4.87, Total efficiency (on 16 cores): 30.5 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/PGC428323-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/PGC428323-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T21:27:17.076106
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/tmp-legacysurvey-custom-299807m53594-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/tmp-legacysurvey-custom-299807m53594-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/tmp-legacysurvey-custom-299807m53594-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/tmp-legacysurvey-custom-299807m53594-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-resid.jpg
Stage coadds : Wall: 3.67 s, CPU: 1.66 s, VmPeak: 1105 MB, VmSize: 1105 MB, VmRSS: 293 MB, VmData: 318 MB, maxrss: 0.300464 MB
Stage coadds finished: 2020-08-05T21:27:20.741344
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 8.121 s worker CPU, 18.889 s worker Wall, Wall: 3.667 s, Cores in use: 2.67, Total efficiency (on 16 cores): 16.7 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/PGC428323-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/PGC428323-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T21:27:20.846153
Cut to 1 unWISE tiles
Reading WISE tile 3008m531 band 1
Reading WISE tile 3008m531 band 3
Reading WISE tile 3008m531 band 2
Reading WISE tile 3008m531 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 1013 MB, VmSize: 813 MB, VmRSS: 153 MB, VmData: 178 MB, maxrss: 0.196404 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 957 MB, VmSize: 807 MB, VmRSS: 146 MB, VmData: 172 MB, maxrss: 0.21002 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 1011 MB, VmSize: 806 MB, VmRSS: 145 MB, VmData: 171 MB, maxrss: 0.208604 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 808 MB, VmSize: 806 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.20924 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/tmp-legacysurvey-custom-299807m53594-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/tmp-legacysurvey-custom-299807m53594-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 5.87 s, CPU: 1.99 s, VmPeak: 1105 MB, VmSize: 1105 MB, VmRSS: 294 MB, VmData: 318 MB, maxrss: 0.30098 MB
Stage wise_forced finished: 2020-08-05T21:27:26.719266
Resources for stage wise_forced : 3.271 s worker CPU, 7.950 s worker Wall, Wall: 5.875 s, Cores in use: 0.90, Total efficiency (on 16 cores): 5.6 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/PGC428323-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/PGC428323-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T21:27:26.739129
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/tractor-i/cus/tractor-custom-299807m53594.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/tractor/cus/tractor-custom-299807m53594.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/tractor/cus/brick-custom-299807m53594.sha256sum
Stage writecat : Wall: 2.49 s, CPU: 2.12 s, VmPeak: 1237 MB, VmSize: 1109 MB, VmRSS: 296 MB, VmData: 318 MB, maxrss: 0.433856 MB
Stage writecat finished: 2020-08-05T21:27:29.233687
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.496 s, Cores in use: 0.85, Total efficiency (on 16 cores): 5.3 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/PGC428323-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/299/PGC428323/PGC428323-largegalaxy-writecat.p
All done: 74.823 s worker CPU, 389.158 s worker Wall, Wall: 194.992 s, Cores in use: 0.50, Total efficiency (on 16 cores): 3.1 %
Finished galaxy PGC428323 in 3.346 minutes.
Started working on galaxy PGC428323 at Mon Aug 10 10:31:51 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 299.8075126042441 -53.594995530461865 --width 301 --height 301 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/PGC428323-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/PGC428323-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-10T10:31:52.973882
legacypipe git version: DR9.5.11-watershed-6-g6a2880fc
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '299.8075126042441', '-53.594995530461865', '--width', '301', '--height', '301', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/PGC428323-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/PGC428323-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 299.8075126042441 -53.594995530461865 --width 301 --height 301 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/PGC428323-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/PGC428323-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 299.8075126042441 -53.594995530461865
Starting process 46582 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 46583 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 46584 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 46585 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 46586 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059528 MB
Starting process 46587 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB
Starting process 46588 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB
Starting process 46589 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-10T10:31:53.631724
Keeping 12 CCDs:
  c4d_160909_235459_ooi_z_ls9-N29 z expnum 572890 exptime 90.0 propid 2012B-0001 seeing 1.69 MJD 57640.995 object DES survey hex -611-532 tiling 7 
    decam/CP/V4.8.2a/CP20160909/c4d_160909_235459_ooi_z_ls9.fits.fz
  c4d_160929_000425_ooi_r_ls9-N29 r expnum 578577 exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 57660.001 object DES survey hex -611-532 tiling 7 
    decam/CP/V4.8.2a/CP20160928/c4d_160929_000425_ooi_r_ls9.fits.fz
  c4d_160929_000621_ooi_g_ls9-N29 g expnum 578578 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 57660.003 object DES survey hex -611-532 tiling 7 
    decam/CP/V4.8.2a/CP20160928/c4d_160929_000621_ooi_g_ls9.fits.fz
  c4d_160910_234044_ooi_z_ls9-N29 z expnum 573333 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 57641.985 object DES survey hex -611-532 tiling 7 
    decam/CP/V4.8.2a/CP20160910/c4d_160910_234044_ooi_z_ls9.fits.fz
  c4d_150912_005854_ooi_g_ls9-S2 g expnum 473858 exptime 90.0 propid 2012B-0001 seeing 1.45 MJD 57277.039 object DES survey hex -586-542 tiling 6 
    decam/CP/V4.8.2a/CP20150911/c4d_150912_005854_ooi_g_ls9.fits.fz
  c4d_150912_005704_ooi_r_ls9-S2 r expnum 473857 exptime 90.0 propid 2012B-0001 seeing 1.34 MJD 57277.038 object DES survey hex -586-542 tiling 6 
    decam/CP/V4.8.2a/CP20150911/c4d_150912_005704_ooi_r_ls9.fits.fz
  c4d_170912_005509_ooi_z_v1-N29 z expnum 676727 exptime 90.0 propid 2012B-0001 seeing 1.49 MJD 58008.038 object DES survey hex -611-532 tiling 9 
    decam/CP/V4.1/CP20170911/c4d_170912_005509_ooi_z_v1.fits.fz
  c4d_170923_000749_ooi_r_v1-N29 r expnum 680410 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 58019.005 object DES survey hex -611-532 tiling 9 
    decam/CP/V4.1/CP20170922/c4d_170923_000749_ooi_r_v1.fits.fz
  c4d_170912_005113_ooi_r_v1-N29 r expnum 676725 exptime 90.0 propid 2012B-0001 seeing 1.75 MJD 58008.036 object DES survey hex -611-532 tiling 9 
    decam/CP/V4.1/CP20170911/c4d_170912_005113_ooi_r_v1.fits.fz
  c4d_170923_001545_ooi_g_v1-N29 g expnum 680414 exptime 90.0 propid 2012B-0001 seeing 1.23 MJD 58019.011 object DES survey hex -611-532 tiling 9 
    decam/CP/V4.1/CP20170922/c4d_170923_001545_ooi_g_v1.fits.fz
  c4d_130901_013104_ooi_r_ls9-N20 r expnum 229293 exptime 90.0 propid 2012B-0001 seeing 1.00 MJD 56536.063 object DES survey hex -582-521 tiling 3 
    decam/CP/V4.8.2a/CP20130831/c4d_130901_013104_ooi_r_ls9.fits.fz
  c4d_130831_235707_ooi_g_ls9-N20 g expnum 229251 exptime 90.0 propid 2012B-0001 seeing 1.29 MJD 56535.998 object DES survey hex -582-521 tiling 3 
    decam/CP/V4.8.2a/CP20130831/c4d_130831_235707_ooi_g_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9620e86-r-20150912T005434_oi[S2,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962a9d4-z-20160910T233824_oi[N29,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170910_8f9120a-z-20170912T005509_oi[N29,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962d087-r-20160929T000201_oi[N29,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961f01b-g-20150912T005632_oi[S2,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c605-g-20160929T000400_oi[N29,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-r-20170923T000749_oi[N29,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962a9d4-z-20160909T235241_oi[N29,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-g-20170923T001545_oi[N29,noinherit][2046,4094][real]: DE
Zeroing out 0 weight-map pixels below quantization error (= median 4.27e-06)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9632a12-r-20130901T013104_oi[N20,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962fa53-g-20130831T235707_oi[N20,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170910_8f9120a-r-20170912T005113_oi[N29,noinherit][2046,4094][real]: DE
Stage tims : Wall: 167.36 s, CPU: 1.02 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 182 MB, VmData: 216 MB, maxrss: 0.186464 MB
Stage tims finished: 2020-08-10T10:34:40.996353
Zeroing out 0 weight-map pixels below quantization error (= median 4.17e-05)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-r-20170923T000749_oi[N29,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962d087-r-20160929T000201_oi[N29,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962c605-g-20160929T000400_oi[N29,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Zeroing out 0 weight-map pixels below quantization error (= median 0.000191)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962a9d4-z-20160909T235241_oi[N29,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Zeroing out 0 weight-map pixels below quantization error (= median 5.29e-05)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962a9d4-z-20160910T233824_oi[N29,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170922_8faaec5-g-20170923T001545_oi[N29,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9620e86-r-20150912T005434_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170910_8f9120a-r-20170912T005113_oi[N29,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Resources for stage tims : 6.281 s worker CPU, 386.540 s worker Wall, Wall: 167.366 s, Cores in use: 0.04, Total efficiency (on 8 cores): 0.5 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/PGC428323-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/PGC428323-largegalaxy-tims.p
Running stage refs
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170910_8f9120a-z-20170912T005509_oi[N29,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9632a12-r-20130901T013104_oi[N20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Running stage refs at 2020-08-10T10:34:41.030894
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11168.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11167.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11071.fits
Matched 5 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/metrics/cus/reference-custom-299807m53594.fits
Stage refs : Wall: 12.51 s, CPU: 6.51 s, VmPeak: 1092 MB, VmSize: 1088 MB, VmRSS: 267 MB, VmData: 299 MB, maxrss: 0.273832 MB
Stage refs finished: 2020-08-10T10:34:53.539239
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961f01b-g-20150912T005632_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962fa53-g-20130831T235707_oi[N20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 12.509 s, Cores in use: 0.52, Total efficiency (on 8 cores): 6.5 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/PGC428323-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/PGC428323-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-10T10:34:53.857246
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/metrics/cus/outlier-mask-custom-299807m53594.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/metrics/cus/outliers-pre-custom-299807m53594.jpg
Image c4d_150912_005854_ooi_g_ls9-S2 g : masking 136 positive outlier pixels and 48 negative outlier pixels
Image c4d_160929_000621_ooi_g_ls9-N29 g : masking 141 positive outlier pixels and 0 negative outlier pixels
Image c4d_170923_001545_ooi_g_v1-N29 g : masking 141 positive outlier pixels and 70 negative outlier pixels
Image c4d_160929_000425_ooi_r_ls9-N29 r : masking 522 positive outlier pixels and 0 negative outlier pixels
Image c4d_170912_005113_ooi_r_v1-N29 r : masking 0 positive outlier pixels and 314 negative outlier pixels
Image c4d_160909_235459_ooi_z_ls9-N29 z : masking 312 positive outlier pixels and 0 negative outlier pixels
Image c4d_160910_234044_ooi_z_ls9-N29 z : masking 342 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/metrics/cus/outlier-mask-custom-299807m53594.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/metrics/cus/outliers-post-custom-299807m53594.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/metrics/cus/outliers-masked-pos-custom-299807m53594.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/metrics/cus/outliers-masked-neg-custom-299807m53594.jpg
Stage outliers : Wall: 1.23 s, CPU: 0.88 s, VmPeak: 1098 MB, VmSize: 1098 MB, VmRSS: 288 MB, VmData: 316 MB, maxrss: 0.294456 MB
Stage outliers finished: 2020-08-10T10:34:55.089082
Resources for stage outliers : 1.470 s worker CPU, 1.472 s worker Wall, Wall: 1.233 s, Cores in use: 1.90, Total efficiency (on 8 cores): 23.8 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/PGC428323-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/PGC428323-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-10T10:34:55.124705
Stage halos : Wall: 1.22 s, CPU: 0.69 s, VmPeak: 1098 MB, VmSize: 1098 MB, VmRSS: 288 MB, VmData: 316 MB, maxrss: 0.29476 MB
Stage halos finished: 2020-08-10T10:34:56.343790
Resources for stage halos : 0.522 s worker CPU, 2.141 s worker Wall, Wall: 1.220 s, Cores in use: 1.00, Total efficiency (on 8 cores): 12.5 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/PGC428323-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/PGC428323-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-10T10:34:56.636743
PSF sigmas in coadd pixels: ['1.78', '2.36', '2.00', '2.10']
Using average PSF sigma 2.06012777828486
Gaussian PSF norm 0.13693072572844656 vs pixelized 0.11614054
average tim pixel scale / coadd scale: 1.0010071366737447
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.65', '2.17', '1.70', '2.85', '1.62']
Using average PSF sigma 1.9984492341943958
Gaussian PSF norm 0.14115684649232269 vs pixelized 0.120304145
average tim pixel scale / coadd scale: 1.0010241024295679
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.74', '1.74', '2.42']
Using average PSF sigma 2.30022138074381
Gaussian PSF norm 0.1226381052430087 vs pixelized 0.09596156
average tim pixel scale / coadd scale: 1.0009625311656534
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.29 s, CPU: 0.25 s, VmPeak: 1098 MB, VmSize: 1098 MB, VmRSS: 290 MB, VmData: 317 MB, maxrss: 0.297408 MB
Stage fit_on_coadds finished: 2020-08-10T10:34:56.924021
Resources for stage fit_on_coadds : 0.286 s worker CPU, 0.286 s worker Wall, Wall: 0.288 s, Cores in use: 1.87, Total efficiency (on 8 cores): 23.4 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/PGC428323-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/PGC428323-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-10T10:34:56.946286
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 28 potential peaks
Of 28 potential peaks: 8 in veto map, 3 cut by saddle test, 0 cut by aper test, 17 kept
SED z : 17 new peaks
Found 50 potential peaks
Of 50 potential peaks: 24 in veto map, 6 cut by saddle test, 0 cut by aper test, 20 kept
SED r : 20 new peaks
Found 33 potential peaks
Of 33 potential peaks: 27 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 64 potential peaks
Of 64 potential peaks: 46 in veto map, 9 cut by saddle test, 0 cut by aper test, 9 kept
SED Flat : 9 new peaks
Found 66 potential peaks
Of 66 potential peaks: 58 in veto map, 7 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 48 new sources
Median coadd sky for g : 8.24655e-06
Median coadd sky for r : -5.8486236e-05
Median coadd sky for z : -0.00021611783
Stage srcs : Wall: 0.85 s, CPU: 0.81 s, VmPeak: 1098 MB, VmSize: 1098 MB, VmRSS: 291 MB, VmData: 317 MB, maxrss: 0.297992 MB
Stage srcs finished: 2020-08-10T10:34:57.800205
Resources for stage srcs : 0.116 s worker CPU, 0.116 s worker Wall, Wall: 0.855 s, Cores in use: 1.08, Total efficiency (on 8 cores): 13.5 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/PGC428323-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/PGC428323-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-10T10:34:57.907455
Blob 1 of 32, id: 8, sources: 11, size: 128x185, npix 12861, brick X: 76,204, Y: 61,246, one pixel: 172 61
Blob 2 of 32, id: 16, sources: 4, size: 63x79, npix 2325, brick X: 199,262, Y: 149,228, one pixel: 218 149
Blob 3 of 32, id: 2, sources: 3, size: 64x61, npix 2123, brick X: 102,166, Y: 0,61, one pixel: 145 0
Blob 4 of 32, id: 14, sources: 2, size: 49x52, npix 1677, brick X: 15,64, Y: 125,177, one pixel: 53 125
Blob 5 of 32, id: 20, sources: 3, size: 48x58, npix 1410, brick X: 226,274, Y: 209,267, one pixel: 249 209
Blob 6 of 32, id: 19, sources: 1, size: 41x37, npix 1050, brick X: 0,41, Y: 203,240, one pixel: 18 203
Blob 7 of 32, id: 15, sources: 2, size: 37x42, npix 1025, brick X: 264,301, Y: 144,186, one pixel: 279 144
Blob 8 of 32, id: 3, sources: 2, size: 40x39, npix 1014, brick X: 178,218, Y: 0,39, one pixel: 183 0
Blob 9 of 32, id: 27, sources: 2, size: 42x28, npix 700, brick X: 199,241, Y: 266,294, one pixel: 226 266
Measuring 1 iterative sources
Measuring 1 iterative sources
Blob 6 finished, total: Wall: 2.25 s, CPU: 2.25 s, VmPeak: 1013 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14524 MB
Blob 10 of 32, id: 22, sources: 2, size: 45x29, npix 671, brick X: 91,136, Y: 239,268, one pixel: 100 239
Blob 7 finished, total: Wall: 2.31 s, CPU: 2.31 s, VmPeak: 953 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147168 MB
Blob 11 of 32, id: 24, sources: 1, size: 32x30, npix 661, brick X: 57,89, Y: 254,284, one pixel: 71 254
Blob 8 finished, total: Wall: 2.56 s, CPU: 2.55 s, VmPeak: 957 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14536 MB
Blob 12 of 32, id: 17, sources: 1, size: 30x32, npix 652, brick X: 38,68, Y: 184,216, one pixel: 50 184
Blob 4 finished, total: Wall: 2.89 s, CPU: 2.89 s, VmPeak: 1025 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146084 MB
Blob 13 of 32, id: 23, sources: 1, size: 33x26, npix 564, brick X: 181,214, Y: 246,272, one pixel: 194 246
Blob 5 finished, total: Wall: 2.91 s, CPU: 2.91 s, VmPeak: 1023 MB, VmSize: 728 MB, VmRSS: 145 MB, VmData: 184 MB, maxrss: 0.148312 MB
Blob 14 of 32, id: 18, sources: 1, size: 28x27, npix 474, brick X: 270,298, Y: 188,215, one pixel: 281 188
Measuring 2 iterative sources
Blob 10 finished, total: Wall: 1.12 s, CPU: 1.12 s, VmPeak: 953 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147168 MB
Blob 15 of 32, id: 21, sources: 1, size: 28x26, npix 431, brick X: 138,166, Y: 237,263, one pixel: 154 237
Measuring 1 iterative sources
Blob 11 finished, total: Wall: 1.29 s, CPU: 1.29 s, VmPeak: 957 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14536 MB
Blob 16 of 32, id: 29, sources: 1, size: 31x18, npix 394, brick X: 113,144, Y: 283,301, one pixel: 127 283
Blob 9 finished, total: Wall: 1.79 s, CPU: 1.79 s, VmPeak: 1013 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147076 MB
Blob 17 of 32, id: 12, sources: 1, size: 24x26, npix 392, brick X: 230,254, Y: 111,137, one pixel: 240 111
Blob 12 finished, total: Wall: 1.18 s, CPU: 1.18 s, VmPeak: 1025 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146084 MB
Blob 18 of 32, id: 10, sources: 1, size: 24x25, npix 368, brick X: 115,139, Y: 82,107, one pixel: 126 82
Blob 3 finished, total: Wall: 4.11 s, CPU: 4.11 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147936 MB
Blob 19 of 32, id: 28, sources: 2, size: 26x20, npix 345, brick X: 171,197, Y: 281,301, one pixel: 182 281
Measuring 1 iterative sources
Blob 14 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 953 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147168 MB
Blob 20 of 32, id: 0, sources: 1, size: 23x18, npix 284, brick X: 74,97, Y: 0,18, one pixel: 79 0
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.80291, -53.58320), pm (-5.1, -6.2), parallax 0.280 with NanoMaggies: g=19.3, r=19.1, z=18.6
Reset brightness to NanoMaggies: g=20.9, r=20.8, z=21
Blob 18 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147936 MB
Blob 21 of 32, id: 5, sources: 1, size: 21x22, npix 279, brick X: 3,24, Y: 35,57, one pixel: 13 35
Blob 2 finished, total: Wall: 4.58 s, CPU: 4.58 s, VmPeak: 951 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146788 MB
Blob 22 of 32, id: 26, sources: 1, size: 22x21, npix 270, brick X: 92,114, Y: 266,287, one pixel: 102 266
Measuring 1 iterative sources
Blob 15 finished, total: Wall: 1.13 s, CPU: 1.13 s, VmPeak: 957 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.1473 MB
Blob 23 of 32, id: 30, sources: 1, size: 23x17, npix 263, brick X: 278,301, Y: 284,301, one pixel: 289 284
Blob 17 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 1025 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146084 MB
Blob 24 of 32, id: 7, sources: 1, size: 21x22, npix 262, brick X: 18,39, Y: 50,72, one pixel: 27 50
Blob 13 finished, total: Wall: 2.17 s, CPU: 2.17 s, VmPeak: 1023 MB, VmSize: 728 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.150064 MB
Blob 25 of 32, id: 6, sources: 1, size: 20x20, npix 246, brick X: 189,209, Y: 48,68, one pixel: 197 48
Blob 19 finished, total: Wall: 0.91 s, CPU: 0.91 s, VmPeak: 953 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147168 MB
Blob 26 of 32, id: 25, sources: 1, size: 21x20, npix 239, brick X: 159,180, Y: 263,283, one pixel: 168 263
Blob 20 finished, total: Wall: 0.86 s, CPU: 0.86 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147936 MB
Blob 27 of 32, id: 9, sources: 1, size: 21x20, npix 238, brick X: 239,260, Y: 77,97, one pixel: 248 77
Blob 22 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 957 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.1473 MB
Blob 28 of 32, id: 11, sources: 2, size: 14x24, npix 237, brick X: 0,14, Y: 108,132, one pixel: 2 108
Blob 24 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 1023 MB, VmSize: 728 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.150064 MB
Blob 29 of 32, id: 4, sources: 1, size: 18x19, npix 198, brick X: 33,51, Y: 2,21, one pixel: 41 2
Blob 21 finished, total: Wall: 0.91 s, CPU: 0.91 s, VmPeak: 951 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146788 MB
Blob 30 of 32, id: 1, sources: 1, size: 18x17, npix 192, brick X: 99,117, Y: 0,17, one pixel: 105 0
Blob 25 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 953 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147168 MB
Blob 31 of 32, id: 13, sources: 1, size: 18x18, npix 180, brick X: 83,101, Y: 124,142, one pixel: 91 124
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.82675, -53.59724), pm (0.3, -7.9), parallax 0.749 with NanoMaggies: g=20.9, r=19.4, z=18.2
Reset brightness to NanoMaggies: g=20.4, r=19, z=17.6
Blob 28 finished, total: Wall: 0.13 s, CPU: 0.13 s, VmPeak: 1023 MB, VmSize: 728 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.150064 MB
Blob 32 of 32, id: 31, sources: 1, size: 19x15, npix 171, brick X: 31,50, Y: 286,301, one pixel: 39 286
Blob 16 finished, total: Wall: 1.70 s, CPU: 1.70 s, VmPeak: 1013 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147076 MB
Blob 29 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 951 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146788 MB
Blob 31 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 1023 MB, VmSize: 728 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.150064 MB
Blob 30 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 953 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147168 MB
Blob 23 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 1025 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146084 MB
Blob 27 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 957 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.1473 MB
Blob 26 finished, total: Wall: 0.91 s, CPU: 0.91 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147936 MB
Blob 32 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 1013 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.14792 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.73691, ee1=0.329522, ee2=0.0301073
Measuring 3 iterative sources
Blob 1 finished, total: Wall: 11.58 s, CPU: 11.58 s, VmPeak: 1016 MB, VmSize: 726 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149756 MB
Old catalog: 59
New catalog: 62
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/metrics/cus/blobs-custom-299807m53594.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/metrics/cus/all-models-custom-299807m53594.fits
Stage fitblobs : Wall: 12.19 s, CPU: 0.70 s, VmPeak: 1098 MB, VmSize: 1098 MB, VmRSS: 291 MB, VmData: 317 MB, maxrss: 0.298348 MB
Stage fitblobs finished: 2020-08-10T10:35:10.096066
Resources for stage fitblobs : 54.227 s worker CPU, 54.325 s worker Wall, Wall: 12.190 s, Cores in use: 4.51, Total efficiency (on 8 cores): 56.3 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/PGC428323-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/PGC428323-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-10T10:35:10.222985
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/tmp-legacysurvey-custom-299807m53594-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/tmp-legacysurvey-custom-299807m53594-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/tmp-legacysurvey-custom-299807m53594-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/tmp-legacysurvey-custom-299807m53594-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-resid.jpg
Stage coadds : Wall: 1.51 s, CPU: 0.66 s, VmPeak: 1098 MB, VmSize: 1098 MB, VmRSS: 292 MB, VmData: 317 MB, maxrss: 0.298672 MB
Stage coadds finished: 2020-08-10T10:35:11.728843
Resources for stage coadds : 4.443 s worker CPU, 4.939 s worker Wall, Wall: 1.507 s, Cores in use: 3.39, Total efficiency (on 8 cores): 42.4 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/PGC428323-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/PGC428323-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-10T10:35:11.845064
Cut to 1 unWISE tiles
Reading WISE tile 3008m531 band 2
Reading WISE tile 3008m531 band 1
Reading WISE tile 3008m531 band 3
Reading WISE tile 3008m531 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.15 s, CPU: 0.45 s, VmPeak: 1013 MB, VmSize: 1011 MB, VmRSS: 152 MB, VmData: 190 MB, maxrss: 0.190768 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.23 s, VmPeak: 1004 MB, VmSize: 1004 MB, VmRSS: 144 MB, VmData: 184 MB, maxrss: 0.20562 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.18 s, VmPeak: 1016 MB, VmSize: 1008 MB, VmRSS: 150 MB, VmData: 188 MB, maxrss: 0.211628 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3008m531/unwise-3008m531-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.18 s, VmPeak: 1025 MB, VmSize: 1007 MB, VmRSS: 148 MB, VmData: 187 MB, maxrss: 0.208904 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/tmp-legacysurvey-custom-299807m53594-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/tmp-legacysurvey-custom-299807m53594-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 4.00 s, CPU: 0.65 s, VmPeak: 1098 MB, VmSize: 1098 MB, VmRSS: 292 MB, VmData: 317 MB, maxrss: 0.299188 MB
Stage wise_forced finished: 2020-08-10T10:35:15.842312
Resources for stage wise_forced : 4.154 s worker CPU, 5.739 s worker Wall, Wall: 3.998 s, Cores in use: 1.20, Total efficiency (on 8 cores): 15.0 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/PGC428323-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/PGC428323-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-10T10:35:15.965114
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/coadd/cus/custom-299807m53594/legacysurvey-custom-299807m53594-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/tractor-i/cus/tractor-custom-299807m53594.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/tractor/cus/tractor-custom-299807m53594.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/tractor/cus/brick-custom-299807m53594.sha256sum
Stage writecat : Wall: 0.91 s, CPU: 0.68 s, VmPeak: 1231 MB, VmSize: 1103 MB, VmRSS: 294 MB, VmData: 317 MB, maxrss: 0.432048 MB
Stage writecat finished: 2020-08-10T10:35:16.876376
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.912 s, Cores in use: 0.75, Total efficiency (on 8 cores): 9.3 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/PGC428323-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC428323/PGC428323-largegalaxy-writecat.p
All done: 71.501 s worker CPU, 455.562 s worker Wall, Wall: 203.357 s, Cores in use: 0.42, Total efficiency (on 8 cores): 5.2 %
Finished galaxy PGC428323 in 3.430 minutes.