Started working on galaxy PGC1218635 at Wed Aug  5 19:10:51 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.05927799999995 2.1816294 --width 239 --height 239 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T19:10:52.833718
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '347.05927799999995', '2.1816294', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.05927799999995 2.1816294 --width 239 --height 239 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 347.05927799999995 2.1816294
Starting process 39356 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 39357 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 39358 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 39359 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 39360 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059404 MB
Starting process 39361 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059352 MB
Starting process 39362 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059352 MB
Starting process 39363 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 39364 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 39365 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 39366 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 39367 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 39368 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 39369 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 39370 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 39371 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T19:10:53.455542
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 13 CCDs:
  c4d_160815_055205_ooi_z_ls9-S8 z expnum 564511 exptime 90.0 propid 2012B-0001 seeing 0.96 MJD 57615.243 object DES survey hex -124+16 tiling 5 
    decam/CP/V4.8.2a/CP20160814/c4d_160815_055205_ooi_z_ls9.fits.fz
  c4d_160813_054132_ooi_z_ls9-N28 z expnum 563582 exptime 88.0 propid 2014B-0404 seeing 0.88 MJD 57613.236 object DECaLS_23808_z 
    decam/CP/V4.8.2a/CP20160812/c4d_160813_054132_ooi_z_ls9.fits.fz
  c4d_151108_005726_ooi_g_ls9-S8 g expnum 490993 exptime 90.0 propid 2012B-0001 seeing 1.00 MJD 57334.038 object DES survey hex -124+16 tiling 5 
    decam/CP/V4.8.2a/CP20151107/c4d_151108_005726_ooi_g_ls9.fits.fz
  c4d_151108_005526_ooi_r_ls9-S8 r expnum 490992 exptime 90.0 propid 2012B-0001 seeing 0.91 MJD 57334.037 object DES survey hex -124+16 tiling 5 
    decam/CP/V4.8.2a/CP20151107/c4d_151108_005526_ooi_r_ls9.fits.fz
  c4d_171011_041531_ooi_z_ls9-S25 z expnum 685747 exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 58037.177 object DES survey hex -124+16 tiling 8 
    decam/CP/V4.8.2a/CP20171010/c4d_171011_041531_ooi_z_ls9.fits.fz
  c4d_171011_041331_ooi_r_ls9-S25 r expnum 685746 exptime 90.0 propid 2012B-0001 seeing 1.23 MJD 58037.176 object DES survey hex -124+16 tiling 8 
    decam/CP/V4.8.2a/CP20171010/c4d_171011_041331_ooi_r_ls9.fits.fz
  c4d_171109_003355_ooi_g_ls9-S25 g expnum 694149 exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 58066.024 object DES survey hex -124+16 tiling 8 
    decam/CP/V4.8.2a/CP20171108/c4d_171109_003355_ooi_g_ls9.fits.fz
  c4d_130910_063824_ooi_g_ls9-S20 g expnum 232367 exptime 90.0 propid 2012B-0001 seeing 1.34 MJD 56545.277 object DES survey hex -124+16 tiling 1 
    decam/CP/V4.8.2a/CP20130909/c4d_130910_063824_ooi_g_ls9.fits.fz
  c4d_130930_022428_ooi_r_ls9-S20 r expnum 239620 exptime 90.0 propid 2012B-0001 seeing 0.92 MJD 56565.100 object DES survey hex -124+16 tiling 1 
    decam/CP/V4.8.2a/CP20130929/c4d_130930_022428_ooi_r_ls9.fits.fz
  c4d_131011_022839_ooi_z_ls9-S20 z expnum 242732 exptime 90.0 propid 2012B-0001 seeing 0.85 MJD 56576.103 object DES survey hex -124+16 tiling 1 
    decam/CP/V4.8.2a/CP20131010/c4d_131011_022839_ooi_z_ls9.fits.fz
  c4d_181015_002848_ooi_z_ls9-N31 z expnum 783531 exptime 248.0 propid 2014B-0404 seeing 1.58 MJD 58406.020 object DECaLS_39680_z 
    decam/CP/V4.8.2a/CP20181014/c4d_181015_002848_ooi_z_ls9.fits.fz
  c4d_170721_062818_ooi_r_ls9-N31 r expnum 660482 exptime 62.0 propid 2014B-0404 seeing 1.14 MJD 57955.268 object DECaLS_39680_r 
    decam/CP/V4.8.2/CP20170720/c4d_170721_062818_ooi_r_ls9.fits.fz
  c4d_170730_033436_ooi_z_ls9-N31 z expnum 663268 exptime 250.0 propid 2014B-0404 seeing 1.35 MJD 57964.146 object DECaLS_39680_z 
    decam/CP/V4.8.2/CP20170729/c4d_170730_033436_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95645c8-r-20151108T005308_oi[S8,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9531140-z-20181015T002848_oi[N31,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9545789-r-20130930T022428_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525a23-r-20171011T041331_oi[S25,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958078a-g-20151108T005506_oi[S8,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9546715-g-20130910T063824_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951a9b6-z-20170730T032933_oi[N31,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952682e-g-20171109T003355_oi[S25,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9546420-z-20131011T022839_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951cf8e-r-20170721T062623_oi[N31,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95478a4-z-20160815T054944_oi[S8,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951fbc0-z-20171011T041531_oi[S25,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 39.99 s, CPU: 0.97 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 179 MB, VmData: 212 MB, maxrss: 0.18376 MB
Stage tims finished: 2020-08-05T19:11:33.447982
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958078a-g-20151108T005506_oi[S8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525a23-r-20171011T041331_oi[S25,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95645c8-r-20151108T005308_oi[S8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9546715-g-20130910T063824_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951cf8e-r-20170721T062623_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95478a4-z-20160815T054944_oi[S8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 7.790 s worker CPU, 270.559 s worker Wall, Wall: 39.994 s, Cores in use: 0.22, Total efficiency (on 16 cores): 1.4 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9545789-r-20130930T022428_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952682e-g-20171109T003355_oi[S25,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951a9b6-z-20170730T032933_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951fbc0-z-20171011T041531_oi[S25,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T19:11:33.474784
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05947.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06075.fits
Matched 4 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/metrics/cus/reference-custom-347059p02181.fits
Stage refs : Wall: 7.63 s, CPU: 1.86 s, VmPeak: 1043 MB, VmSize: 1027 MB, VmRSS: 196 MB, VmData: 227 MB, maxrss: 0.20102 MB
Stage refs finished: 2020-08-05T19:11:41.108931
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9531140-z-20181015T002848_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9546420-z-20131011T022839_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.636 s, Cores in use: 0.24, Total efficiency (on 16 cores): 1.5 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T19:11:41.292480
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/metrics/cus/outlier-mask-custom-347059p02181.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/metrics/cus/outliers-pre-custom-347059p02181.jpg
Image c4d_171109_003355_ooi_g_ls9-S25 g : masking 552 positive outlier pixels and 575 negative outlier pixels
Image c4d_151108_005726_ooi_g_ls9-S8 g : masking 1002 positive outlier pixels and 0 negative outlier pixels
Image c4d_130910_063824_ooi_g_ls9-S20 g : masking 0 positive outlier pixels and 96 negative outlier pixels
Image c4d_151108_005526_ooi_r_ls9-S8 r : masking 1945 positive outlier pixels and 0 negative outlier pixels
Image c4d_170721_062818_ooi_r_ls9-N31 r : masking 102 positive outlier pixels and 0 negative outlier pixels
Image c4d_160815_055205_ooi_z_ls9-S8 z : masking 80 positive outlier pixels and 0 negative outlier pixels
Image c4d_181015_002848_ooi_z_ls9-N31 z : masking 172 positive outlier pixels and 0 negative outlier pixels
Image c4d_170730_033436_ooi_z_ls9-N31 z : masking 1016 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/metrics/cus/outlier-mask-custom-347059p02181.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/metrics/cus/outliers-post-custom-347059p02181.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/metrics/cus/outliers-masked-pos-custom-347059p02181.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/metrics/cus/outliers-masked-neg-custom-347059p02181.jpg
Stage outliers : Wall: 3.60 s, CPU: 3.11 s, VmPeak: 1043 MB, VmSize: 1037 MB, VmRSS: 211 MB, VmData: 239 MB, maxrss: 0.215868 MB
Stage outliers finished: 2020-08-05T19:11:44.892423
Resources for stage outliers : 0.947 s worker CPU, 1.041 s worker Wall, Wall: 3.601 s, Cores in use: 1.13, Total efficiency (on 16 cores): 7.1 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T19:11:44.923958
Stage halos : Wall: 1.79 s, CPU: 1.46 s, VmPeak: 1043 MB, VmSize: 1037 MB, VmRSS: 211 MB, VmData: 239 MB, maxrss: 0.215952 MB
Stage halos finished: 2020-08-05T19:11:46.711330
Resources for stage halos : 0.246 s worker CPU, 2.767 s worker Wall, Wall: 1.789 s, Cores in use: 0.96, Total efficiency (on 16 cores): 6.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T19:11:46.743185
PSF sigmas in coadd pixels: ['1.62', '1.81', '2.18']
Using average PSF sigma 1.8706018929439925
Gaussian PSF norm 0.15080429076756224 vs pixelized 0.13214073
average tim pixel scale / coadd scale: 1.001059573556062
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.47', '2.00', '1.49', '1.85']
Using average PSF sigma 1.7064482450718919
Gaussian PSF norm 0.165311073798194 vs pixelized 0.15469354
average tim pixel scale / coadd scale: 1.0011082113887546
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.55', '1.64', '1.38', '2.56', '2.19']
Using average PSF sigma 1.8660698361443575
Gaussian PSF norm 0.15117054373309938 vs pixelized 0.12516996
average tim pixel scale / coadd scale: 1.001136374343471
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 1.11 s, CPU: 0.18 s, VmPeak: 1043 MB, VmSize: 1037 MB, VmRSS: 212 MB, VmData: 239 MB, maxrss: 0.217544 MB
Stage fit_on_coadds finished: 2020-08-05T19:11:47.856882
Resources for stage fit_on_coadds : 0.215 s worker CPU, 0.215 s worker Wall, Wall: 1.115 s, Cores in use: 0.35, Total efficiency (on 16 cores): 2.2 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T19:11:47.885798
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 93 potential peaks
Of 93 potential peaks: 74 in veto map, 7 cut by saddle test, 0 cut by aper test, 12 kept
SED z : 12 new peaks
Found 148 potential peaks
Of 148 potential peaks: 141 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 100 potential peaks
Of 100 potential peaks: 95 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 165 potential peaks
Of 165 potential peaks: 155 in veto map, 9 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 143 potential peaks
Of 143 potential peaks: 134 in veto map, 8 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 15 new sources
Median coadd sky for g : 0.00070905895
Median coadd sky for r : 0.0011214577
Median coadd sky for z : 0.0013918157
Stage srcs : Wall: 1.20 s, CPU: 1.14 s, VmPeak: 1043 MB, VmSize: 1037 MB, VmRSS: 213 MB, VmData: 239 MB, maxrss: 0.218016 MB
Stage srcs finished: 2020-08-05T19:11:49.087855
Resources for stage srcs : 0.074 s worker CPU, 0.074 s worker Wall, Wall: 1.203 s, Cores in use: 1.01, Total efficiency (on 16 cores): 6.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T19:11:49.102181
Blob 1 of 2, id: 0, sources: 17, size: 238x239, npix 38262, brick X: 1,239, Y: 0,239, one pixel: 152 0
Blob 2 of 2, id: 1, sources: 1, size: 16x22, npix 229, brick X: 0,16, Y: 170,192, one pixel: 6 170
Blob 2 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 959 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148976 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.24147, ee1=0.008931, ee2=-0.00565872
Measuring 17 iterative sources
Blob 1 finished, total: Wall: 27.47 s, CPU: 27.46 s, VmPeak: 952 MB, VmSize: 748 MB, VmRSS: 168 MB, VmData: 197 MB, maxrss: 0.172204 MB
Old catalog: 21
New catalog: 32
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/metrics/cus/blobs-custom-347059p02181.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/metrics/cus/all-models-custom-347059p02181.fits
Stage fitblobs : Wall: 41.96 s, CPU: 0.62 s, VmPeak: 1043 MB, VmSize: 1037 MB, VmRSS: 214 MB, VmData: 240 MB, maxrss: 0.219288 MB
Stage fitblobs finished: 2020-08-05T19:12:31.064710
Resources for stage fitblobs : 27.706 s worker CPU, 27.723 s worker Wall, Wall: 41.964 s, Cores in use: 0.68, Total efficiency (on 16 cores): 4.2 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T19:12:31.129537
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/tmp-legacysurvey-custom-347059p02181-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/tmp-legacysurvey-custom-347059p02181-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/tmp-legacysurvey-custom-347059p02181-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/tmp-legacysurvey-custom-347059p02181-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-resid.jpg
Stage coadds : Wall: 5.02 s, CPU: 1.16 s, VmPeak: 1043 MB, VmSize: 1037 MB, VmRSS: 215 MB, VmData: 240 MB, maxrss: 0.219804 MB
Stage coadds finished: 2020-08-05T19:12:36.152667
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 9.589 s worker CPU, 19.801 s worker Wall, Wall: 5.025 s, Cores in use: 2.14, Total efficiency (on 16 cores): 13.4 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T19:12:36.174199
Cut to 1 unWISE tiles
Reading WISE tile 3463p015 band 1
Reading WISE tile 3463p015 band 3
Reading WISE tile 3463p015 band 2
Reading WISE tile 3463p015 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 962 MB, VmSize: 807 MB, VmRSS: 148 MB, VmData: 176 MB, maxrss: 0.191512 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 956 MB, VmSize: 805 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.206708 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 800 MB, VmSize: 800 MB, VmRSS: 140 MB, VmData: 172 MB, maxrss: 0.203348 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 962 MB, VmSize: 805 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.20642 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/tmp-legacysurvey-custom-347059p02181-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/tmp-legacysurvey-custom-347059p02181-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.26 s, CPU: 0.57 s, VmPeak: 1043 MB, VmSize: 1037 MB, VmRSS: 215 MB, VmData: 240 MB, maxrss: 0.220508 MB
Stage wise_forced finished: 2020-08-05T19:12:38.434293
Resources for stage wise_forced : 3.180 s worker CPU, 5.161 s worker Wall, Wall: 2.262 s, Cores in use: 1.66, Total efficiency (on 16 cores): 10.4 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-wise_forced.p
Running stage writecat
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage writecat at 2020-08-05T19:12:38.452151
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/tractor-i/cus/tractor-custom-347059p02181.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/tractor/cus/tractor-custom-347059p02181.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/tractor/cus/brick-custom-347059p02181.sha256sum
Stage writecat : Wall: 1.29 s, CPU: 0.83 s, VmPeak: 1169 MB, VmSize: 1041 MB, VmRSS: 217 MB, VmData: 240 MB, maxrss: 0.353388 MB
Stage writecat finished: 2020-08-05T19:12:39.743615
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.293 s, Cores in use: 0.64, Total efficiency (on 16 cores): 4.0 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-writecat.p
All done: 49.751 s worker CPU, 327.345 s worker Wall, Wall: 106.311 s, Cores in use: 0.58, Total efficiency (on 16 cores): 3.6 %
Finished galaxy PGC1218635 in 1.812 minutes.
Started working on galaxy PGC1218635 at Wed Aug  5 19:45:11 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.05927799999995 2.1816294 --width 239 --height 239 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T19:45:14.449652
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '347.05927799999995', '2.1816294', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.05927799999995 2.1816294 --width 239 --height 239 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 347.05927799999995 2.1816294
Starting process 46668 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 46670 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 46672 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 46674 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 46676 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059472 MB
Starting process 46677 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05942 MB
Starting process 46679 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05942 MB
Starting process 46681 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 46683 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 46685 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 46687 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 46689 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 46691 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 46693 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 46695 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 46696 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 46698 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 46700 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 46703 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 46706 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 46707 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 46708 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 46709 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 46710 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 46711 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 46712 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 46714 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 46715 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 46716 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 46717 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 46718 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 46719 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T19:45:15.817781
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 13 CCDs:
  c4d_160815_055205_ooi_z_ls9-S8 z expnum 564511 exptime 90.0 propid 2012B-0001 seeing 0.96 MJD 57615.243 object DES survey hex -124+16 tiling 5 
    decam/CP/V4.8.2a/CP20160814/c4d_160815_055205_ooi_z_ls9.fits.fz
  c4d_160813_054132_ooi_z_ls9-N28 z expnum 563582 exptime 88.0 propid 2014B-0404 seeing 0.88 MJD 57613.236 object DECaLS_23808_z 
    decam/CP/V4.8.2a/CP20160812/c4d_160813_054132_ooi_z_ls9.fits.fz
  c4d_151108_005726_ooi_g_ls9-S8 g expnum 490993 exptime 90.0 propid 2012B-0001 seeing 1.00 MJD 57334.038 object DES survey hex -124+16 tiling 5 
    decam/CP/V4.8.2a/CP20151107/c4d_151108_005726_ooi_g_ls9.fits.fz
  c4d_151108_005526_ooi_r_ls9-S8 r expnum 490992 exptime 90.0 propid 2012B-0001 seeing 0.91 MJD 57334.037 object DES survey hex -124+16 tiling 5 
    decam/CP/V4.8.2a/CP20151107/c4d_151108_005526_ooi_r_ls9.fits.fz
  c4d_171011_041531_ooi_z_ls9-S25 z expnum 685747 exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 58037.177 object DES survey hex -124+16 tiling 8 
    decam/CP/V4.8.2a/CP20171010/c4d_171011_041531_ooi_z_ls9.fits.fz
  c4d_171011_041331_ooi_r_ls9-S25 r expnum 685746 exptime 90.0 propid 2012B-0001 seeing 1.23 MJD 58037.176 object DES survey hex -124+16 tiling 8 
    decam/CP/V4.8.2a/CP20171010/c4d_171011_041331_ooi_r_ls9.fits.fz
  c4d_171109_003355_ooi_g_ls9-S25 g expnum 694149 exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 58066.024 object DES survey hex -124+16 tiling 8 
    decam/CP/V4.8.2a/CP20171108/c4d_171109_003355_ooi_g_ls9.fits.fz
  c4d_130910_063824_ooi_g_ls9-S20 g expnum 232367 exptime 90.0 propid 2012B-0001 seeing 1.34 MJD 56545.277 object DES survey hex -124+16 tiling 1 
    decam/CP/V4.8.2a/CP20130909/c4d_130910_063824_ooi_g_ls9.fits.fz
  c4d_130930_022428_ooi_r_ls9-S20 r expnum 239620 exptime 90.0 propid 2012B-0001 seeing 0.92 MJD 56565.100 object DES survey hex -124+16 tiling 1 
    decam/CP/V4.8.2a/CP20130929/c4d_130930_022428_ooi_r_ls9.fits.fz
  c4d_131011_022839_ooi_z_ls9-S20 z expnum 242732 exptime 90.0 propid 2012B-0001 seeing 0.85 MJD 56576.103 object DES survey hex -124+16 tiling 1 
    decam/CP/V4.8.2a/CP20131010/c4d_131011_022839_ooi_z_ls9.fits.fz
  c4d_181015_002848_ooi_z_ls9-N31 z expnum 783531 exptime 248.0 propid 2014B-0404 seeing 1.58 MJD 58406.020 object DECaLS_39680_z 
    decam/CP/V4.8.2a/CP20181014/c4d_181015_002848_ooi_z_ls9.fits.fz
  c4d_170721_062818_ooi_r_ls9-N31 r expnum 660482 exptime 62.0 propid 2014B-0404 seeing 1.14 MJD 57955.268 object DECaLS_39680_r 
    decam/CP/V4.8.2/CP20170720/c4d_170721_062818_ooi_r_ls9.fits.fz
  c4d_170730_033436_ooi_z_ls9-N31 z expnum 663268 exptime 250.0 propid 2014B-0404 seeing 1.35 MJD 57964.146 object DECaLS_39680_z 
    decam/CP/V4.8.2/CP20170729/c4d_170730_033436_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95645c8-r-20151108T005308_oi[S8,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9545789-r-20130930T022428_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9546715-g-20130910T063824_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958078a-g-20151108T005506_oi[S8,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9531140-z-20181015T002848_oi[N31,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9546420-z-20131011T022839_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952682e-g-20171109T003355_oi[S25,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95478a4-z-20160815T054944_oi[S8,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525a23-r-20171011T041331_oi[S25,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951cf8e-r-20170721T062623_oi[N31,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951a9b6-z-20170730T032933_oi[N31,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951fbc0-z-20171011T041531_oi[S25,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 28.78 s, CPU: 1.98 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 180 MB, VmData: 212 MB, maxrss: 0.184036 MB
Stage tims finished: 2020-08-05T19:45:44.599792
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9546420-z-20131011T022839_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9531140-z-20181015T002848_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958078a-g-20151108T005506_oi[S8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952682e-g-20171109T003355_oi[S25,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95645c8-r-20151108T005308_oi[S8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525a23-r-20171011T041331_oi[S25,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 7.126 s worker CPU, 203.437 s worker Wall, Wall: 28.784 s, Cores in use: 0.32, Total efficiency (on 32 cores): 1.0 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951cf8e-r-20170721T062623_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951fbc0-z-20171011T041531_oi[S25,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T19:45:44.653089
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05947.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06075.fits
Matched 4 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/metrics/cus/reference-custom-347059p02181.fits
Stage refs : Wall: 4.85 s, CPU: 1.72 s, VmPeak: 1042 MB, VmSize: 1027 MB, VmRSS: 196 MB, VmData: 227 MB, maxrss: 0.201072 MB
Stage refs finished: 2020-08-05T19:45:49.503779
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9546715-g-20130910T063824_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9545789-r-20130930T022428_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95478a4-z-20160815T054944_oi[S8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951a9b6-z-20170730T032933_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 4.853 s, Cores in use: 0.36, Total efficiency (on 32 cores): 1.1 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T19:45:49.726566
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/metrics/cus/outlier-mask-custom-347059p02181.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/metrics/cus/outliers-pre-custom-347059p02181.jpg
Image c4d_171109_003355_ooi_g_ls9-S25 g : masking 552 positive outlier pixels and 575 negative outlier pixels
Image c4d_130910_063824_ooi_g_ls9-S20 g : masking 0 positive outlier pixels and 96 negative outlier pixels
Image c4d_151108_005726_ooi_g_ls9-S8 g : masking 1002 positive outlier pixels and 0 negative outlier pixels
Image c4d_170721_062818_ooi_r_ls9-N31 r : masking 102 positive outlier pixels and 0 negative outlier pixels
Image c4d_151108_005526_ooi_r_ls9-S8 r : masking 1945 positive outlier pixels and 0 negative outlier pixels
Image c4d_160815_055205_ooi_z_ls9-S8 z : masking 80 positive outlier pixels and 0 negative outlier pixels
Image c4d_170730_033436_ooi_z_ls9-N31 z : masking 1016 positive outlier pixels and 0 negative outlier pixels
Image c4d_181015_002848_ooi_z_ls9-N31 z : masking 172 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/metrics/cus/outlier-mask-custom-347059p02181.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/metrics/cus/outliers-post-custom-347059p02181.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/metrics/cus/outliers-masked-pos-custom-347059p02181.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/metrics/cus/outliers-masked-neg-custom-347059p02181.jpg
Stage outliers : Wall: 1.54 s, CPU: 0.72 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 211 MB, VmData: 239 MB, maxrss: 0.21612 MB
Stage outliers finished: 2020-08-05T19:45:51.268664
Resources for stage outliers : 1.119 s worker CPU, 1.468 s worker Wall, Wall: 1.545 s, Cores in use: 1.19, Total efficiency (on 32 cores): 3.7 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T19:45:51.298939
Stage halos : Wall: 0.46 s, CPU: 0.27 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 212 MB, VmData: 239 MB, maxrss: 0.216596 MB
Stage halos finished: 2020-08-05T19:45:51.763850
Resources for stage halos : 0.317 s worker CPU, 1.409 s worker Wall, Wall: 0.467 s, Cores in use: 1.27, Total efficiency (on 32 cores): 4.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T19:45:51.808927
PSF sigmas in coadd pixels: ['1.62', '1.81', '2.18']
Using average PSF sigma 1.8706018929439925
Gaussian PSF norm 0.15080429076756224 vs pixelized 0.13214074
average tim pixel scale / coadd scale: 1.001059573556062
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.47', '2.00', '1.49', '1.85']
Using average PSF sigma 1.7064482450718919
Gaussian PSF norm 0.165311073798194 vs pixelized 0.15469354
average tim pixel scale / coadd scale: 1.0011082113887546
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.55', '1.64', '1.38', '2.56', '2.19']
Using average PSF sigma 1.8660698361443575
Gaussian PSF norm 0.15117054373309938 vs pixelized 0.12516996
average tim pixel scale / coadd scale: 1.001136374343471
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.22 s, CPU: 0.20 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 214 MB, VmData: 240 MB, maxrss: 0.218748 MB
Stage fit_on_coadds finished: 2020-08-05T19:45:52.025327
Resources for stage fit_on_coadds : 0.213 s worker CPU, 0.213 s worker Wall, Wall: 0.219 s, Cores in use: 1.89, Total efficiency (on 32 cores): 5.9 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T19:45:52.044755
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 93 potential peaks
Of 93 potential peaks: 74 in veto map, 7 cut by saddle test, 0 cut by aper test, 12 kept
SED z : 12 new peaks
Found 148 potential peaks
Of 148 potential peaks: 141 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 100 potential peaks
Of 100 potential peaks: 95 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 165 potential peaks
Of 165 potential peaks: 155 in veto map, 9 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 143 potential peaks
Of 143 potential peaks: 134 in veto map, 8 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 15 new sources
Median coadd sky for g : 0.000709059
Median coadd sky for r : 0.0011214577
Median coadd sky for z : 0.0013918154
Stage srcs : Wall: 1.72 s, CPU: 1.64 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 214 MB, VmData: 240 MB, maxrss: 0.21946 MB
Stage srcs finished: 2020-08-05T19:45:53.764742
Resources for stage srcs : 0.070 s worker CPU, 0.070 s worker Wall, Wall: 1.722 s, Cores in use: 0.99, Total efficiency (on 32 cores): 3.1 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T19:45:53.786421
Blob 1 of 2, id: 0, sources: 17, size: 238x239, npix 38262, brick X: 1,239, Y: 0,239, one pixel: 152 0
Blob 2 of 2, id: 1, sources: 1, size: 16x22, npix 229, brick X: 0,16, Y: 170,192, one pixel: 6 170
Blob 2 finished, total: Wall: 0.29 s, CPU: 0.26 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 111 MB, VmData: 166 MB, maxrss: 0.113772 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.24147, ee1=0.00893086, ee2=-0.00565882
Measuring 17 iterative sources
Blob 1 finished, total: Wall: 30.09 s, CPU: 30.09 s, VmPeak: 709 MB, VmSize: 703 MB, VmRSS: 136 MB, VmData: 174 MB, maxrss: 0.14146 MB
Old catalog: 21
New catalog: 32
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/metrics/cus/blobs-custom-347059p02181.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/metrics/cus/all-models-custom-347059p02181.fits
Stage fitblobs : Wall: 31.80 s, CPU: 1.50 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 216 MB, VmData: 241 MB, maxrss: 0.220732 MB
Stage fitblobs finished: 2020-08-05T19:46:25.586957
Resources for stage fitblobs : 30.396 s worker CPU, 30.603 s worker Wall, Wall: 31.803 s, Cores in use: 1.00, Total efficiency (on 32 cores): 3.1 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T19:46:25.603275
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/tmp-legacysurvey-custom-347059p02181-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/tmp-legacysurvey-custom-347059p02181-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/tmp-legacysurvey-custom-347059p02181-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/tmp-legacysurvey-custom-347059p02181-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-resid.jpg
Stage coadds : Wall: 3.94 s, CPU: 0.86 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 216 MB, VmData: 241 MB, maxrss: 0.221248 MB
Stage coadds finished: 2020-08-05T19:46:29.544290
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 22.819 s worker CPU, 55.776 s worker Wall, Wall: 3.944 s, Cores in use: 6.01, Total efficiency (on 32 cores): 18.8 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T19:46:29.569436
Cut to 1 unWISE tiles
Reading WISE tile 3463p015 band 1
Reading WISE tile 3463p015 band 3
Reading WISE tile 3463p015 band 2
Reading WISE tile 3463p015 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 951 MB, VmSize: 807 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.191176 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 956 MB, VmSize: 805 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.206964 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 952 MB, VmSize: 805 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.206844 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 962 MB, VmSize: 805 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.208628 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/tmp-legacysurvey-custom-347059p02181-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/tmp-legacysurvey-custom-347059p02181-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 4.08 s, CPU: 2.26 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 217 MB, VmData: 241 MB, maxrss: 0.221952 MB
Stage wise_forced finished: 2020-08-05T19:46:33.653745
Resources for stage wise_forced : 3.242 s worker CPU, 5.364 s worker Wall, Wall: 4.086 s, Cores in use: 1.35, Total efficiency (on 32 cores): 4.2 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-wise_forced.p
Running stage writecat
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage writecat at 2020-08-05T19:46:33.693531
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/coadd/cus/custom-347059p02181/legacysurvey-custom-347059p02181-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/tractor-i/cus/tractor-custom-347059p02181.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/tractor/cus/tractor-custom-347059p02181.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/tractor/cus/brick-custom-347059p02181.sha256sum
Stage writecat : Wall: 0.74 s, CPU: 0.53 s, VmPeak: 1169 MB, VmSize: 1041 MB, VmRSS: 219 MB, VmData: 241 MB, maxrss: 0.354832 MB
Stage writecat finished: 2020-08-05T19:46:34.433046
Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.742 s, Cores in use: 0.71, Total efficiency (on 32 cores): 2.2 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1218635/PGC1218635-largegalaxy-writecat.p
All done: 65.309 s worker CPU, 298.347 s worker Wall, Wall: 78.639 s, Cores in use: 0.98, Total efficiency (on 32 cores): 3.1 %
Finished galaxy PGC1218635 in 1.395 minutes.
Started working on galaxy PGC1218635 at Mon Aug 10 07:51:17 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.05892101617377 2.1815592731880873 --width 239 --height 239 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/PGC1218635-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/PGC1218635-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-10T07:51:17.973056
legacypipe git version: DR9.5.11-watershed-6-g6a2880fc
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '347.05892101617377', '2.1815592731880873', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/PGC1218635-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/PGC1218635-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.05892101617377 2.1815592731880873 --width 239 --height 239 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/PGC1218635-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/PGC1218635-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 347.05892101617377 2.1815592731880873
Starting process 63235 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 63236 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 63237 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 63238 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 63239 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0594 MB
Starting process 63240 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059348 MB
Starting process 63241 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059348 MB
Starting process 63242 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-10T07:51:18.430426
Keeping 13 CCDs:
  c4d_160815_055205_ooi_z_ls9-S8 z expnum 564511 exptime 90.0 propid 2012B-0001 seeing 0.96 MJD 57615.243 object DES survey hex -124+16 tiling 5 
    decam/CP/V4.8.2a/CP20160814/c4d_160815_055205_ooi_z_ls9.fits.fz
  c4d_160813_054132_ooi_z_ls9-N28 z expnum 563582 exptime 88.0 propid 2014B-0404 seeing 0.88 MJD 57613.236 object DECaLS_23808_z 
    decam/CP/V4.8.2a/CP20160812/c4d_160813_054132_ooi_z_ls9.fits.fz
  c4d_151108_005726_ooi_g_ls9-S8 g expnum 490993 exptime 90.0 propid 2012B-0001 seeing 1.00 MJD 57334.038 object DES survey hex -124+16 tiling 5 
    decam/CP/V4.8.2a/CP20151107/c4d_151108_005726_ooi_g_ls9.fits.fz
  c4d_151108_005526_ooi_r_ls9-S8 r expnum 490992 exptime 90.0 propid 2012B-0001 seeing 0.91 MJD 57334.037 object DES survey hex -124+16 tiling 5 
    decam/CP/V4.8.2a/CP20151107/c4d_151108_005526_ooi_r_ls9.fits.fz
  c4d_171011_041531_ooi_z_ls9-S25 z expnum 685747 exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 58037.177 object DES survey hex -124+16 tiling 8 
    decam/CP/V4.8.2a/CP20171010/c4d_171011_041531_ooi_z_ls9.fits.fz
  c4d_171011_041331_ooi_r_ls9-S25 r expnum 685746 exptime 90.0 propid 2012B-0001 seeing 1.23 MJD 58037.176 object DES survey hex -124+16 tiling 8 
    decam/CP/V4.8.2a/CP20171010/c4d_171011_041331_ooi_r_ls9.fits.fz
  c4d_171109_003355_ooi_g_ls9-S25 g expnum 694149 exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 58066.024 object DES survey hex -124+16 tiling 8 
    decam/CP/V4.8.2a/CP20171108/c4d_171109_003355_ooi_g_ls9.fits.fz
  c4d_130910_063824_ooi_g_ls9-S20 g expnum 232367 exptime 90.0 propid 2012B-0001 seeing 1.34 MJD 56545.277 object DES survey hex -124+16 tiling 1 
    decam/CP/V4.8.2a/CP20130909/c4d_130910_063824_ooi_g_ls9.fits.fz
  c4d_130930_022428_ooi_r_ls9-S20 r expnum 239620 exptime 90.0 propid 2012B-0001 seeing 0.92 MJD 56565.100 object DES survey hex -124+16 tiling 1 
    decam/CP/V4.8.2a/CP20130929/c4d_130930_022428_ooi_r_ls9.fits.fz
  c4d_131011_022839_ooi_z_ls9-S20 z expnum 242732 exptime 90.0 propid 2012B-0001 seeing 0.85 MJD 56576.103 object DES survey hex -124+16 tiling 1 
    decam/CP/V4.8.2a/CP20131010/c4d_131011_022839_ooi_z_ls9.fits.fz
  c4d_181015_002848_ooi_z_ls9-N31 z expnum 783531 exptime 248.0 propid 2014B-0404 seeing 1.58 MJD 58406.020 object DECaLS_39680_z 
    decam/CP/V4.8.2a/CP20181014/c4d_181015_002848_ooi_z_ls9.fits.fz
  c4d_170721_062818_ooi_r_ls9-N31 r expnum 660482 exptime 62.0 propid 2014B-0404 seeing 1.14 MJD 57955.268 object DECaLS_39680_r 
    decam/CP/V4.8.2/CP20170720/c4d_170721_062818_ooi_r_ls9.fits.fz
  c4d_170730_033436_ooi_z_ls9-N31 z expnum 663268 exptime 250.0 propid 2014B-0404 seeing 1.35 MJD 57964.146 object DECaLS_39680_z 
    decam/CP/V4.8.2/CP20170729/c4d_170730_033436_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958078a-g-20151108T005506_oi[S8,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952682e-g-20171109T003355_oi[S25,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9546715-g-20130910T063824_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525a23-r-20171011T041331_oi[S25,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95645c8-r-20151108T005308_oi[S8,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9545789-r-20130930T022428_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95478a4-z-20160815T054944_oi[S8,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9531140-z-20181015T002848_oi[N31,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951cf8e-r-20170721T062623_oi[N31,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951a9b6-z-20170730T032933_oi[N31,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9546420-z-20131011T022839_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951fbc0-z-20171011T041531_oi[S25,noinherit][2046,4094][real]: DES sur
Stage tims : Wall: 56.69 s, CPU: 0.91 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 178 MB, VmData: 211 MB, maxrss: 0.181892 MB
Stage tims finished: 2020-08-10T07:52:15.115506
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95645c8-r-20151108T005308_oi[S8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525a23-r-20171011T041331_oi[S25,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95478a4-z-20160815T054944_oi[S8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9546715-g-20130910T063824_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9531140-z-20181015T002848_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958078a-g-20151108T005506_oi[S8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951cf8e-r-20170721T062623_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952682e-g-20171109T003355_oi[S25,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9546420-z-20131011T022839_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951fbc0-z-20171011T041531_oi[S25,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Resources for stage tims : 6.206 s worker CPU, 290.227 s worker Wall, Wall: 56.686 s, Cores in use: 0.13, Total efficiency (on 8 cores): 1.6 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/PGC1218635-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/PGC1218635-largegalaxy-tims.p
Running stage refs
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9545789-r-20130930T022428_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951a9b6-z-20170730T032933_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Running stage refs at 2020-08-10T07:52:15.142853
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05947.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06075.fits
Matched 4 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/metrics/cus/reference-custom-347058p02181.fits
Stage refs : Wall: 18.96 s, CPU: 1.64 s, VmPeak: 1036 MB, VmSize: 1021 MB, VmRSS: 194 MB, VmData: 227 MB, maxrss: 0.198908 MB
Stage refs finished: 2020-08-10T07:52:34.105892
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 18.964 s, Cores in use: 0.09, Total efficiency (on 8 cores): 1.1 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/PGC1218635-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/PGC1218635-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-10T07:52:34.134456
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/metrics/cus/outlier-mask-custom-347058p02181.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/metrics/cus/outliers-pre-custom-347058p02181.jpg
Image c4d_151108_005726_ooi_g_ls9-S8 g : masking 903 positive outlier pixels and 0 negative outlier pixels
Image c4d_171109_003355_ooi_g_ls9-S25 g : masking 474 positive outlier pixels and 854 negative outlier pixels
Image c4d_171011_041331_ooi_r_ls9-S25 r : masking 0 positive outlier pixels and 232 negative outlier pixels
Image c4d_130930_022428_ooi_r_ls9-S20 r : masking 0 positive outlier pixels and 148 negative outlier pixels
Image c4d_151108_005526_ooi_r_ls9-S8 r : masking 2162 positive outlier pixels and 0 negative outlier pixels
Image c4d_170721_062818_ooi_r_ls9-N31 r : masking 96 positive outlier pixels and 124 negative outlier pixels
Image c4d_181015_002848_ooi_z_ls9-N31 z : masking 170 positive outlier pixels and 0 negative outlier pixels
Image c4d_170730_033436_ooi_z_ls9-N31 z : masking 1022 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/metrics/cus/outlier-mask-custom-347058p02181.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/metrics/cus/outliers-post-custom-347058p02181.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/metrics/cus/outliers-masked-pos-custom-347058p02181.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/metrics/cus/outliers-masked-neg-custom-347058p02181.jpg
Stage outliers : Wall: 0.89 s, CPU: 0.69 s, VmPeak: 1036 MB, VmSize: 1030 MB, VmRSS: 209 MB, VmData: 238 MB, maxrss: 0.214164 MB
Stage outliers finished: 2020-08-10T07:52:35.028752
Resources for stage outliers : 0.978 s worker CPU, 0.983 s worker Wall, Wall: 0.895 s, Cores in use: 1.86, Total efficiency (on 8 cores): 23.3 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/PGC1218635-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/PGC1218635-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-10T07:52:35.056688
Stage halos : Wall: 0.35 s, CPU: 0.26 s, VmPeak: 1036 MB, VmSize: 1030 MB, VmRSS: 209 MB, VmData: 238 MB, maxrss: 0.214172 MB
Stage halos finished: 2020-08-10T07:52:35.411808
Resources for stage halos : 0.258 s worker CPU, 0.635 s worker Wall, Wall: 0.356 s, Cores in use: 1.47, Total efficiency (on 8 cores): 18.3 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/PGC1218635-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/PGC1218635-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-10T07:52:35.441599
PSF sigmas in coadd pixels: ['1.62', '1.81', '2.18']
Using average PSF sigma 1.8706018929439925
Gaussian PSF norm 0.15080429076756224 vs pixelized 0.13213888
average tim pixel scale / coadd scale: 1.001059573556062
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.47', '2.00', '1.49', '1.85']
Using average PSF sigma 1.7064482450718919
Gaussian PSF norm 0.165311073798194 vs pixelized 0.15468729
average tim pixel scale / coadd scale: 1.0011082113887546
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.55', '1.64', '1.38', '2.56', '2.19']
Using average PSF sigma 1.8660698361443575
Gaussian PSF norm 0.15117054373309938 vs pixelized 0.12517025
average tim pixel scale / coadd scale: 1.001136374343471
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.19 s, CPU: 0.18 s, VmPeak: 1036 MB, VmSize: 1030 MB, VmRSS: 211 MB, VmData: 239 MB, maxrss: 0.215776 MB
Stage fit_on_coadds finished: 2020-08-10T07:52:35.635300
Resources for stage fit_on_coadds : 0.242 s worker CPU, 0.248 s worker Wall, Wall: 0.195 s, Cores in use: 2.15, Total efficiency (on 8 cores): 26.9 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/PGC1218635-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/PGC1218635-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-10T07:52:35.645138
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 93 potential peaks
Of 93 potential peaks: 75 in veto map, 7 cut by saddle test, 0 cut by aper test, 11 kept
SED z : 11 new peaks
Found 146 potential peaks
Of 146 potential peaks: 139 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 101 potential peaks
Of 101 potential peaks: 96 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 165 potential peaks
Of 165 potential peaks: 155 in veto map, 9 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 141 potential peaks
Of 141 potential peaks: 134 in veto map, 7 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 13 new sources
Median coadd sky for g : 0.0007185103
Median coadd sky for r : 0.0012002414
Median coadd sky for z : 0.0014943464
Stage srcs : Wall: 0.56 s, CPU: 0.52 s, VmPeak: 1036 MB, VmSize: 1030 MB, VmRSS: 211 MB, VmData: 239 MB, maxrss: 0.216308 MB
Stage srcs finished: 2020-08-10T07:52:36.201966
Resources for stage srcs : 0.080 s worker CPU, 0.080 s worker Wall, Wall: 0.558 s, Cores in use: 1.08, Total efficiency (on 8 cores): 13.5 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/PGC1218635-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/PGC1218635-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-10T07:52:36.212679
Blob 1 of 1, id: 0, sources: 16, size: 235x238, npix 38109, brick X: 0,235, Y: 0,238, one pixel: 127 0
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.956028, ee1=0.0058292, ee2=0.000829344
Measuring 12 iterative sources
Blob 1 finished, total: Wall: 23.04 s, CPU: 23.03 s, VmPeak: 959 MB, VmSize: 729 MB, VmRSS: 153 MB, VmData: 185 MB, maxrss: 0.15714 MB
Old catalog: 19
New catalog: 26
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/metrics/cus/blobs-custom-347058p02181.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/metrics/cus/all-models-custom-347058p02181.fits
Stage fitblobs : Wall: 24.64 s, CPU: 0.34 s, VmPeak: 1036 MB, VmSize: 1030 MB, VmRSS: 212 MB, VmData: 240 MB, maxrss: 0.217484 MB
Stage fitblobs finished: 2020-08-10T07:53:00.855545
Resources for stage fitblobs : 23.058 s worker CPU, 23.075 s worker Wall, Wall: 24.644 s, Cores in use: 0.95, Total efficiency (on 8 cores): 11.9 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/PGC1218635-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/PGC1218635-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-10T07:53:00.900298
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/tmp-legacysurvey-custom-347058p02181-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/tmp-legacysurvey-custom-347058p02181-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/tmp-legacysurvey-custom-347058p02181-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/tmp-legacysurvey-custom-347058p02181-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-resid.jpg
Stage coadds : Wall: 1.96 s, CPU: 1.14 s, VmPeak: 1036 MB, VmSize: 1030 MB, VmRSS: 213 MB, VmData: 240 MB, maxrss: 0.21806 MB
Stage coadds finished: 2020-08-10T07:53:02.859639
Resources for stage coadds : 3.859 s worker CPU, 4.630 s worker Wall, Wall: 1.960 s, Cores in use: 2.55, Total efficiency (on 8 cores): 31.9 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/PGC1218635-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/PGC1218635-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-10T07:53:02.871544
Cut to 1 unWISE tiles
Reading WISE tile 3463p015 band 1
Reading WISE tile 3463p015 band 3
Reading WISE tile 3463p015 band 2
Reading WISE tile 3463p015 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 959 MB, VmSize: 813 MB, VmRSS: 160 MB, VmData: 184 MB, maxrss: 0.206628 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 956 MB, VmSize: 798 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.205664 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 970 MB, VmSize: 799 MB, VmRSS: 142 MB, VmData: 174 MB, maxrss: 0.205828 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/346/3463p015/unwise-3463p015-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 974 MB, VmSize: 799 MB, VmRSS: 141 MB, VmData: 174 MB, maxrss: 0.203888 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/tmp-legacysurvey-custom-347058p02181-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/tmp-legacysurvey-custom-347058p02181-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.74 s, CPU: 0.61 s, VmPeak: 1036 MB, VmSize: 1030 MB, VmRSS: 214 MB, VmData: 240 MB, maxrss: 0.218764 MB
Stage wise_forced finished: 2020-08-10T07:53:06.613424
Resources for stage wise_forced : 3.194 s worker CPU, 7.116 s worker Wall, Wall: 3.743 s, Cores in use: 1.02, Total efficiency (on 8 cores): 12.7 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/PGC1218635-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/PGC1218635-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-10T07:53:06.629331
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/coadd/cus/custom-347058p02181/legacysurvey-custom-347058p02181-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/tractor-i/cus/tractor-custom-347058p02181.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/tractor/cus/tractor-custom-347058p02181.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/tractor/cus/brick-custom-347058p02181.sha256sum
Stage writecat : Wall: 0.62 s, CPU: 0.47 s, VmPeak: 1163 MB, VmSize: 1035 MB, VmRSS: 215 MB, VmData: 240 MB, maxrss: 0.35164 MB
Stage writecat finished: 2020-08-10T07:53:07.252765
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.625 s, Cores in use: 0.75, Total efficiency (on 8 cores): 9.4 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/PGC1218635-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1218635/PGC1218635-largegalaxy-writecat.p
All done: 37.876 s worker CPU, 326.994 s worker Wall, Wall: 108.838 s, Cores in use: 0.41, Total efficiency (on 8 cores): 5.1 %
Finished galaxy PGC1218635 in 1.844 minutes.