Started working on galaxy PGC1247178 at Wed Aug  5 18:32:18 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.235515 3.196 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T18:32:19.096619
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '336.235515', '3.196', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.235515 3.196 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 336.235515 3.196
Starting process 39147 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 39148 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 39149 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 39150 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 39151 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0594 MB
Starting process 39152 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059348 MB
Starting process 39153 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059348 MB
Starting process 39154 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 39155 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 39156 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 39157 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 39158 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 39159 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 39160 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 39161 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 39162 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T18:32:19.514824
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 11 CCDs:
  c4d_160811_050048_ooi_z_ls9-S5 z expnum 562801 exptime 83.0 propid 2014B-0404 seeing 1.33 MJD 57611.207 object DECaLS_27777_z 
    decam/CP/V4.8.2a/CP20160810/c4d_160811_050048_ooi_z_ls9.fits.fz
  c4d_170718_054726_ooi_r_ls9-S5 r expnum 659611 exptime 78.0 propid 2014B-0404 seeing 1.20 MJD 57952.240 object DECaLS_27777_r 
    decam/CP/V4.8.2/CP20170717/c4d_170718_054726_ooi_r_ls9.fits.fz
  c4d_181015_001912_ooi_z_ls9-S4 z expnum 783529 exptime 250.0 propid 2014B-0404 seeing 1.71 MJD 58406.013 object DECaLS_43649_z 
    decam/CP/V4.8.2a/CP20181014/c4d_181015_001912_ooi_z_ls9.fits.fz
  c4d_180909_040323_ooi_r_ls9-S4 r expnum 771070 exptime 47.0 propid 2014B-0404 seeing 1.07 MJD 58370.169 object DECaLS_43649_r 
    decam/CP/V4.8.2a/CP20180908/c4d_180909_040323_ooi_r_ls9.fits.fz
  c4d_170723_051554_ooi_r_ls9-S4 r expnum 661262 exptime 125.0 propid 2014B-0404 seeing 1.78 MJD 57957.217 object DECaLS_43649_r 
    decam/CP/V4.8.2a/CP20170722/c4d_170723_051554_ooi_r_ls9.fits.fz
  c4d_170728_051312_ooi_g_ls9-S4 g expnum 662866 exptime 200.0 propid 2014B-0404 seeing 1.49 MJD 57962.215 object DECaLS_43649_g 
    decam/CP/V4.8.2a/CP20170727/c4d_170728_051312_ooi_g_ls9.fits.fz
  c4d_170916_233146_ooi_z_ls9-S4 z expnum 678246 exptime 120.0 propid 2014B-0404 seeing 1.06 MJD 58012.980 object DECaLS_43649_z 
    decam/CP/V4.8.2a/CP20170916/c4d_170916_233146_ooi_z_ls9.fits.fz
  c4d_170822_032123_ooi_r_ls9-S6 r expnum 670307 exptime 52.0 propid 2014B-0404 seeing 0.90 MJD 57987.140 object DECaLS_11905_r 
    decam/CP/V4.8.2a/CP20170821/c4d_170822_032123_ooi_r_ls9.fits.fz
  c4d_160812_042639_ooi_z_ls9-S6 z expnum 563135 exptime 80.0 propid 2014B-0404 seeing 0.95 MJD 57612.184 object DECaLS_11905_z 
    decam/CP/V4.8.2a/CP20160811/c4d_160812_042639_ooi_z_ls9.fits.fz
  c4d_170822_032242_ooi_g_ls9-S6 g expnum 670308 exptime 106.0 propid 2014B-0404 seeing 1.08 MJD 57987.141 object DECaLS_11905_g 
    decam/CP/V4.8.2a/CP20170821/c4d_170822_032242_ooi_g_ls9.fits.fz
  c4d_170719_053700_ooi_g_ls9-S5 g expnum 660004 exptime 200.0 propid 2014B-0404 seeing 1.74 MJD 57953.231 object DECaLS_27777_g 
    decam/CP/V4.8.2/CP20170718/c4d_170719_053700_ooi_g_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9531140-z-20181015T001912_oi[S4,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a179-z-20160812T042430_oi[S6,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951e8b1-r-20170723T051256_oi[S4,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521d7c-r-20170822T032123_oi[S6,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95355ca-r-20180909T040323_oi[S4,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a387-z-20160811T045835_oi[S5,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95220ee-g-20170822T032242_oi[S6,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ba61-g-20170719T053247_oi[S5,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951b160-r-20170718T054514_oi[S5,noinherit][2046,4094][real]: DECaLS_2
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951e046-z-20170916T233146_oi[S4,noinherit][2046,4094][real]: DECaLS_4
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9520b9e-g-20170728T050900_oi[S4,noinherit][2046,4094][real]: DECaLS_4
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 593.53 s, CPU: 1.35 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 177 MB, VmData: 209 MB, maxrss: 0.18134 MB
Stage tims finished: 2020-08-05T18:42:13.043417
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95355ca-r-20180909T040323_oi[S4,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ba61-g-20170719T053247_oi[S5,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a387-z-20160811T045835_oi[S5,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951b160-r-20170718T054514_oi[S5,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951e046-z-20170916T233146_oi[S4,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 6.739 s worker CPU, 2316.778 s worker Wall, Wall: 593.530 s, Cores in use: 0.01, Total efficiency (on 16 cores): 0.1 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521d7c-r-20170822T032123_oi[S6,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951e8b1-r-20170723T051256_oi[S4,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9531140-z-20181015T001912_oi[S4,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a179-z-20160812T042430_oi[S6,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9520b9e-g-20170728T050900_oi[S4,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T18:42:13.066049
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05816.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05815.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05687.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05943.fits
Matched 5 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/metrics/cus/reference-custom-336235p03196.fits
Stage refs : Wall: 35.80 s, CPU: 2.19 s, VmPeak: 1042 MB, VmSize: 1031 MB, VmRSS: 198 MB, VmData: 229 MB, maxrss: 0.202656 MB
Stage refs finished: 2020-08-05T18:42:48.869602
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95220ee-g-20170822T032242_oi[S6,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 35.805 s, Cores in use: 0.06, Total efficiency (on 16 cores): 0.4 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T18:42:48.902632
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/metrics/cus/outlier-mask-custom-336235p03196.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/metrics/cus/outliers-pre-custom-336235p03196.jpg
Image c4d_170719_053700_ooi_g_ls9-S5 g : masking 408 positive outlier pixels and 0 negative outlier pixels
Image c4d_170723_051554_ooi_r_ls9-S4 r : masking 177 positive outlier pixels and 0 negative outlier pixels
Image c4d_180909_040323_ooi_r_ls9-S4 r : masking 1070 positive outlier pixels and 0 negative outlier pixels
Image c4d_170718_054726_ooi_r_ls9-S5 r : masking 1474 positive outlier pixels and 0 negative outlier pixels
Image c4d_170916_233146_ooi_z_ls9-S4 z : masking 692 positive outlier pixels and 0 negative outlier pixels
Image c4d_181015_001912_ooi_z_ls9-S4 z : masking 2139 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/metrics/cus/outlier-mask-custom-336235p03196.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/metrics/cus/outliers-post-custom-336235p03196.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/metrics/cus/outliers-masked-pos-custom-336235p03196.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/metrics/cus/outliers-masked-neg-custom-336235p03196.jpg
Stage outliers : Wall: 0.71 s, CPU: 0.52 s, VmPeak: 1042 MB, VmSize: 1041 MB, VmRSS: 211 MB, VmData: 239 MB, maxrss: 0.215608 MB
Stage outliers finished: 2020-08-05T18:42:49.609509
Resources for stage outliers : 0.747 s worker CPU, 0.790 s worker Wall, Wall: 0.708 s, Cores in use: 1.79, Total efficiency (on 16 cores): 11.2 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T18:42:49.739090
Stage halos : Wall: 11.36 s, CPU: 0.24 s, VmPeak: 1042 MB, VmSize: 1041 MB, VmRSS: 211 MB, VmData: 240 MB, maxrss: 0.216132 MB
Stage halos finished: 2020-08-05T18:43:01.102906
Resources for stage halos : 0.371 s worker CPU, 15.718 s worker Wall, Wall: 11.365 s, Cores in use: 0.05, Total efficiency (on 16 cores): 0.3 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T18:43:01.199540
PSF sigmas in coadd pixels: ['2.42', '1.75', '2.82']
Using average PSF sigma 2.3299981024868113
Gaussian PSF norm 0.12107082468127243 vs pixelized 0.09455594
average tim pixel scale / coadd scale: 1.0011624811458906
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.94', '1.74', '2.89', '1.46']
Using average PSF sigma 2.0098795355571477
Gaussian PSF norm 0.14035407932828184 vs pixelized 0.10475338
average tim pixel scale / coadd scale: 1.0011772941069266
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.17', '2.78', '1.73', '1.54']
Using average PSF sigma 2.05311603167357
Gaussian PSF norm 0.13739836785743295 vs pixelized 0.10166788
average tim pixel scale / coadd scale: 1.0011607732398093
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.15 s, CPU: 0.14 s, VmPeak: 1042 MB, VmSize: 1041 MB, VmRSS: 213 MB, VmData: 240 MB, maxrss: 0.217888 MB
Stage fit_on_coadds finished: 2020-08-05T18:43:01.348793
Resources for stage fit_on_coadds : 0.196 s worker CPU, 0.196 s worker Wall, Wall: 0.151 s, Cores in use: 2.27, Total efficiency (on 16 cores): 14.2 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T18:43:01.378641
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 22 potential peaks
Of 22 potential peaks: 11 in veto map, 4 cut by saddle test, 0 cut by aper test, 7 kept
SED z : 7 new peaks
Found 27 potential peaks
Of 27 potential peaks: 21 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 18 potential peaks
Of 18 potential peaks: 14 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 27 potential peaks
Of 27 potential peaks: 21 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 31 potential peaks
Of 31 potential peaks: 25 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 13 new sources
Median coadd sky for g : 2.822007e-05
Median coadd sky for r : 2.849771e-06
Median coadd sky for z : 0.00027477602
Stage srcs : Wall: 0.46 s, CPU: 0.43 s, VmPeak: 1042 MB, VmSize: 1041 MB, VmRSS: 213 MB, VmData: 240 MB, maxrss: 0.21842 MB
Stage srcs finished: 2020-08-05T18:43:01.835391
Resources for stage srcs : 0.066 s worker CPU, 0.066 s worker Wall, Wall: 0.458 s, Cores in use: 1.08, Total efficiency (on 16 cores): 6.8 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T18:43:01.845883
Blob 1 of 4, id: 2, sources: 8, size: 175x182, npix 17059, brick X: 54,229, Y: 19,201, one pixel: 127 19
Blob 2 of 4, id: 1, sources: 7, size: 68x66, npix 2519, brick X: 157,225, Y: 0,66, one pixel: 193 0
Blob 3 of 4, id: 3, sources: 1, size: 40x40, npix 1145, brick X: 5,45, Y: 112,152, one pixel: 20 112
Blob 4 of 4, id: 0, sources: 1, size: 36x22, npix 573, brick X: 50,86, Y: 0,22, one pixel: 54 0
Blob 3 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 111 MB, VmData: 165 MB, maxrss: 0.113676 MB
Blob 4 finished, total: Wall: 1.00 s, CPU: 1.00 s, VmPeak: 946 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150976 MB
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 2.36 s, CPU: 2.36 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 113 MB, VmData: 166 MB, maxrss: 0.115728 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.53991, ee1=0.136448, ee2=0.170259
Measuring 6 iterative sources
Blob 1 finished, total: Wall: 10.80 s, CPU: 10.80 s, VmPeak: 941 MB, VmSize: 733 MB, VmRSS: 149 MB, VmData: 181 MB, maxrss: 0.152096 MB
Old catalog: 18
New catalog: 21
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/metrics/cus/blobs-custom-336235p03196.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/metrics/cus/all-models-custom-336235p03196.fits
Stage fitblobs : Wall: 12.49 s, CPU: 0.28 s, VmPeak: 1042 MB, VmSize: 1041 MB, VmRSS: 213 MB, VmData: 240 MB, maxrss: 0.218584 MB
Stage fitblobs finished: 2020-08-05T18:43:14.335487
Resources for stage fitblobs : 14.771 s worker CPU, 14.789 s worker Wall, Wall: 12.491 s, Cores in use: 1.20, Total efficiency (on 16 cores): 7.5 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T18:43:14.375065
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/tmp-legacysurvey-custom-336235p03196-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/tmp-legacysurvey-custom-336235p03196-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/tmp-legacysurvey-custom-336235p03196-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/tmp-legacysurvey-custom-336235p03196-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-resid.jpg
Stage coadds : Wall: 2.27 s, CPU: 0.53 s, VmPeak: 1042 MB, VmSize: 1041 MB, VmRSS: 214 MB, VmData: 240 MB, maxrss: 0.219096 MB
Stage coadds finished: 2020-08-05T18:43:16.648186
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 9.757 s worker CPU, 13.390 s worker Wall, Wall: 2.275 s, Cores in use: 4.52, Total efficiency (on 16 cores): 28.3 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-05T18:43:16.659561
Cut to 1 unWISE tiles
Reading WISE tile 3357p030 band 1
Reading WISE tile 3357p030 band 2
Reading WISE tile 3357p030 band 3
Reading WISE tile 3357p030 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 941 MB, VmSize: 806 MB, VmRSS: 146 MB, VmData: 175 MB, maxrss: 0.189696 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 805 MB, VmSize: 803 MB, VmRSS: 142 MB, VmData: 170 MB, maxrss: 0.2051 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 956 MB, VmSize: 805 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.206688 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 955 MB, VmSize: 805 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.206856 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/tmp-legacysurvey-custom-336235p03196-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/tmp-legacysurvey-custom-336235p03196-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 1.90 s, CPU: 0.46 s, VmPeak: 1042 MB, VmSize: 1041 MB, VmRSS: 215 MB, VmData: 240 MB, maxrss: 0.219804 MB
Stage wise_forced finished: 2020-08-05T18:43:18.557638
Resources for stage wise_forced : 3.137 s worker CPU, 4.566 s worker Wall, Wall: 1.900 s, Cores in use: 1.90, Total efficiency (on 16 cores): 11.9 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T18:43:18.570223
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/tractor-i/cus/tractor-custom-336235p03196.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/tractor/cus/tractor-custom-336235p03196.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/tractor/cus/brick-custom-336235p03196.sha256sum
Stage writecat : Wall: 0.91 s, CPU: 0.68 s, VmPeak: 1174 MB, VmSize: 1046 MB, VmRSS: 216 MB, VmData: 240 MB, maxrss: 0.35268 MB
Stage writecat finished: 2020-08-05T18:43:19.477219
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.909 s, Cores in use: 0.75, Total efficiency (on 16 cores): 4.7 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-writecat.p
All done: 35.787 s worker CPU, 2366.297 s worker Wall, Wall: 659.979 s, Cores in use: 0.06, Total efficiency (on 16 cores): 0.4 %
Finished galaxy PGC1247178 in 11.030 minutes.
Started working on galaxy PGC1247178 at Wed Aug  5 18:50:18 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.235515 3.196 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T18:50:19.319378
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '336.235515', '3.196', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.235515 3.196 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 336.235515 3.196
Starting process 40933 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 40935 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 40937 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 40939 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 40941 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0594 MB
Starting process 40943 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059348 MB
Starting process 40945 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059348 MB
Starting process 40947 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 40949 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 40951 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 40953 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 40955 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 40959 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 40960 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 40961 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 40962 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 40963 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 40965 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 40967 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 40968 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 40969 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 40970 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 40971 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 40972 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 40973 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 40974 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 40975 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 40976 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 40977 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 40978 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 40979 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 40980 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T18:50:19.930977
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 11 CCDs:
  c4d_160811_050048_ooi_z_ls9-S5 z expnum 562801 exptime 83.0 propid 2014B-0404 seeing 1.33 MJD 57611.207 object DECaLS_27777_z 
    decam/CP/V4.8.2a/CP20160810/c4d_160811_050048_ooi_z_ls9.fits.fz
  c4d_170718_054726_ooi_r_ls9-S5 r expnum 659611 exptime 78.0 propid 2014B-0404 seeing 1.20 MJD 57952.240 object DECaLS_27777_r 
    decam/CP/V4.8.2/CP20170717/c4d_170718_054726_ooi_r_ls9.fits.fz
  c4d_181015_001912_ooi_z_ls9-S4 z expnum 783529 exptime 250.0 propid 2014B-0404 seeing 1.71 MJD 58406.013 object DECaLS_43649_z 
    decam/CP/V4.8.2a/CP20181014/c4d_181015_001912_ooi_z_ls9.fits.fz
  c4d_180909_040323_ooi_r_ls9-S4 r expnum 771070 exptime 47.0 propid 2014B-0404 seeing 1.07 MJD 58370.169 object DECaLS_43649_r 
    decam/CP/V4.8.2a/CP20180908/c4d_180909_040323_ooi_r_ls9.fits.fz
  c4d_170723_051554_ooi_r_ls9-S4 r expnum 661262 exptime 125.0 propid 2014B-0404 seeing 1.78 MJD 57957.217 object DECaLS_43649_r 
    decam/CP/V4.8.2a/CP20170722/c4d_170723_051554_ooi_r_ls9.fits.fz
  c4d_170728_051312_ooi_g_ls9-S4 g expnum 662866 exptime 200.0 propid 2014B-0404 seeing 1.49 MJD 57962.215 object DECaLS_43649_g 
    decam/CP/V4.8.2a/CP20170727/c4d_170728_051312_ooi_g_ls9.fits.fz
  c4d_170916_233146_ooi_z_ls9-S4 z expnum 678246 exptime 120.0 propid 2014B-0404 seeing 1.06 MJD 58012.980 object DECaLS_43649_z 
    decam/CP/V4.8.2a/CP20170916/c4d_170916_233146_ooi_z_ls9.fits.fz
  c4d_170822_032123_ooi_r_ls9-S6 r expnum 670307 exptime 52.0 propid 2014B-0404 seeing 0.90 MJD 57987.140 object DECaLS_11905_r 
    decam/CP/V4.8.2a/CP20170821/c4d_170822_032123_ooi_r_ls9.fits.fz
  c4d_160812_042639_ooi_z_ls9-S6 z expnum 563135 exptime 80.0 propid 2014B-0404 seeing 0.95 MJD 57612.184 object DECaLS_11905_z 
    decam/CP/V4.8.2a/CP20160811/c4d_160812_042639_ooi_z_ls9.fits.fz
  c4d_170822_032242_ooi_g_ls9-S6 g expnum 670308 exptime 106.0 propid 2014B-0404 seeing 1.08 MJD 57987.141 object DECaLS_11905_g 
    decam/CP/V4.8.2a/CP20170821/c4d_170822_032242_ooi_g_ls9.fits.fz
  c4d_170719_053700_ooi_g_ls9-S5 g expnum 660004 exptime 200.0 propid 2014B-0404 seeing 1.74 MJD 57953.231 object DECaLS_27777_g 
    decam/CP/V4.8.2/CP20170718/c4d_170719_053700_ooi_g_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521d7c-r-20170822T032123_oi[S6,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9531140-z-20181015T001912_oi[S4,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95220ee-g-20170822T032242_oi[S6,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951e8b1-r-20170723T051256_oi[S4,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ba61-g-20170719T053247_oi[S5,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95355ca-r-20180909T040323_oi[S4,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a179-z-20160812T042430_oi[S6,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a387-z-20160811T045835_oi[S5,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951b160-r-20170718T054514_oi[S5,noinherit][2046,4094][real]: DECaLS_2
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951e046-z-20170916T233146_oi[S4,noinherit][2046,4094][real]: DECaLS_4
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9520b9e-g-20170728T050900_oi[S4,noinherit][2046,4094][real]: DECaLS_4
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 119.68 s, CPU: 1.07 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 177 MB, VmData: 209 MB, maxrss: 0.181716 MB
Stage tims finished: 2020-08-05T18:52:19.615029
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521d7c-r-20170822T032123_oi[S6,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9531140-z-20181015T001912_oi[S4,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95220ee-g-20170822T032242_oi[S6,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a387-z-20160811T045835_oi[S5,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ba61-g-20170719T053247_oi[S5,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a179-z-20160812T042430_oi[S6,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951e046-z-20170916T233146_oi[S4,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9520b9e-g-20170728T050900_oi[S4,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 6.339 s worker CPU, 655.783 s worker Wall, Wall: 119.687 s, Cores in use: 0.06, Total efficiency (on 32 cores): 0.2 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951e8b1-r-20170723T051256_oi[S4,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95355ca-r-20180909T040323_oi[S4,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951b160-r-20170718T054514_oi[S5,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T18:52:20.283151
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05816.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05815.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05687.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05943.fits
Matched 5 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/metrics/cus/reference-custom-336235p03196.fits
Stage refs : Wall: 12.16 s, CPU: 2.03 s, VmPeak: 1042 MB, VmSize: 1031 MB, VmRSS: 198 MB, VmData: 229 MB, maxrss: 0.20284 MB
Stage refs finished: 2020-08-05T18:52:32.441817
Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 12.161 s, Cores in use: 0.17, Total efficiency (on 32 cores): 0.5 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T18:52:32.467395
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/metrics/cus/outlier-mask-custom-336235p03196.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/metrics/cus/outliers-pre-custom-336235p03196.jpg
Image c4d_170719_053700_ooi_g_ls9-S5 g : masking 408 positive outlier pixels and 0 negative outlier pixels
Image c4d_180909_040323_ooi_r_ls9-S4 r : masking 1070 positive outlier pixels and 0 negative outlier pixels
Image c4d_170718_054726_ooi_r_ls9-S5 r : masking 1474 positive outlier pixels and 0 negative outlier pixels
Image c4d_170723_051554_ooi_r_ls9-S4 r : masking 177 positive outlier pixels and 0 negative outlier pixels
Image c4d_170916_233146_ooi_z_ls9-S4 z : masking 692 positive outlier pixels and 0 negative outlier pixels
Image c4d_181015_001912_ooi_z_ls9-S4 z : masking 2139 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/metrics/cus/outlier-mask-custom-336235p03196.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/metrics/cus/outliers-post-custom-336235p03196.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/metrics/cus/outliers-masked-pos-custom-336235p03196.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/metrics/cus/outliers-masked-neg-custom-336235p03196.jpg
Stage outliers : Wall: 1.04 s, CPU: 0.68 s, VmPeak: 1042 MB, VmSize: 1041 MB, VmRSS: 212 MB, VmData: 240 MB, maxrss: 0.216712 MB
Stage outliers finished: 2020-08-05T18:52:33.506866
Resources for stage outliers : 0.821 s worker CPU, 1.041 s worker Wall, Wall: 1.042 s, Cores in use: 1.45, Total efficiency (on 32 cores): 4.5 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T18:52:33.532540
Stage halos : Wall: 3.77 s, CPU: 0.23 s, VmPeak: 1042 MB, VmSize: 1041 MB, VmRSS: 212 MB, VmData: 240 MB, maxrss: 0.216976 MB
Stage halos finished: 2020-08-05T18:52:37.303871
Resources for stage halos : 0.350 s worker CPU, 5.439 s worker Wall, Wall: 3.774 s, Cores in use: 0.15, Total efficiency (on 32 cores): 0.5 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T18:52:37.375995
PSF sigmas in coadd pixels: ['2.42', '1.75', '2.82']
Using average PSF sigma 2.3299981024868113
Gaussian PSF norm 0.12107082468127243 vs pixelized 0.09455594
average tim pixel scale / coadd scale: 1.0011624811458906
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.94', '1.74', '2.89', '1.46']
Using average PSF sigma 2.0098795355571477
Gaussian PSF norm 0.14035407932828184 vs pixelized 0.104753375
average tim pixel scale / coadd scale: 1.0011772941069266
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.17', '2.78', '1.73', '1.54']
Using average PSF sigma 2.05311603167357
Gaussian PSF norm 0.13739836785743295 vs pixelized 0.10166788
average tim pixel scale / coadd scale: 1.0011607732398093
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.14 s, CPU: 0.13 s, VmPeak: 1042 MB, VmSize: 1041 MB, VmRSS: 213 MB, VmData: 240 MB, maxrss: 0.218568 MB
Stage fit_on_coadds finished: 2020-08-05T18:52:37.516483
Resources for stage fit_on_coadds : 0.185 s worker CPU, 0.185 s worker Wall, Wall: 0.142 s, Cores in use: 2.24, Total efficiency (on 32 cores): 7.0 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T18:52:37.588109
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 22 potential peaks
Of 22 potential peaks: 11 in veto map, 4 cut by saddle test, 0 cut by aper test, 7 kept
SED z : 7 new peaks
Found 27 potential peaks
Of 27 potential peaks: 21 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 18 potential peaks
Of 18 potential peaks: 14 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 27 potential peaks
Of 27 potential peaks: 21 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 31 potential peaks
Of 31 potential peaks: 25 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 13 new sources
Median coadd sky for g : 2.822007e-05
Median coadd sky for r : 2.849771e-06
Median coadd sky for z : 0.0002747758
Stage srcs : Wall: 0.70 s, CPU: 0.66 s, VmPeak: 1042 MB, VmSize: 1041 MB, VmRSS: 214 MB, VmData: 240 MB, maxrss: 0.2191 MB
Stage srcs finished: 2020-08-05T18:52:38.286181
Resources for stage srcs : 0.071 s worker CPU, 0.071 s worker Wall, Wall: 0.700 s, Cores in use: 1.05, Total efficiency (on 32 cores): 3.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T18:52:38.299492
Blob 1 of 4, id: 2, sources: 8, size: 175x182, npix 17059, brick X: 54,229, Y: 19,201, one pixel: 127 19
Blob 2 of 4, id: 1, sources: 7, size: 68x66, npix 2519, brick X: 157,225, Y: 0,66, one pixel: 193 0
Blob 3 of 4, id: 3, sources: 1, size: 40x40, npix 1145, brick X: 5,45, Y: 112,152, one pixel: 20 112
Blob 4 of 4, id: 0, sources: 1, size: 36x22, npix 573, brick X: 50,86, Y: 0,22, one pixel: 54 0
Blob 3 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.092768 MB
Blob 4 finished, total: Wall: 0.96 s, CPU: 0.95 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.094512 MB
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 2.40 s, CPU: 2.40 s, VmPeak: 670 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095048 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.53991, ee1=0.136448, ee2=0.170259
Measuring 6 iterative sources
Blob 1 finished, total: Wall: 11.21 s, CPU: 11.21 s, VmPeak: 940 MB, VmSize: 733 MB, VmRSS: 150 MB, VmData: 182 MB, maxrss: 0.153132 MB
Old catalog: 18
New catalog: 21
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/metrics/cus/blobs-custom-336235p03196.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/metrics/cus/all-models-custom-336235p03196.fits
Stage fitblobs : Wall: 11.72 s, CPU: 0.49 s, VmPeak: 1042 MB, VmSize: 1041 MB, VmRSS: 214 MB, VmData: 240 MB, maxrss: 0.219264 MB
Stage fitblobs finished: 2020-08-05T18:52:50.023216
Resources for stage fitblobs : 15.127 s worker CPU, 15.156 s worker Wall, Wall: 11.726 s, Cores in use: 1.33, Total efficiency (on 32 cores): 4.2 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T18:52:50.037425
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/tmp-legacysurvey-custom-336235p03196-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/tmp-legacysurvey-custom-336235p03196-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/tmp-legacysurvey-custom-336235p03196-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/tmp-legacysurvey-custom-336235p03196-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-resid.jpg
Stage coadds : Wall: 3.60 s, CPU: 0.74 s, VmPeak: 1042 MB, VmSize: 1041 MB, VmRSS: 215 MB, VmData: 240 MB, maxrss: 0.219776 MB
Stage coadds finished: 2020-08-05T18:52:53.639785
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 27.596 s worker CPU, 50.255 s worker Wall, Wall: 3.605 s, Cores in use: 7.86, Total efficiency (on 32 cores): 24.6 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T18:52:53.653294
Cut to 1 unWISE tiles
Reading WISE tile 3357p030 band 1
Reading WISE tile 3357p030 band 2
Reading WISE tile 3357p030 band 3
Reading WISE tile 3357p030 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 956 MB, VmSize: 806 MB, VmRSS: 146 MB, VmData: 175 MB, maxrss: 0.191428 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 941 MB, VmSize: 801 MB, VmRSS: 141 MB, VmData: 170 MB, maxrss: 0.203088 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 955 MB, VmSize: 805 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.208924 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 812 MB, VmSize: 812 MB, VmRSS: 151 MB, VmData: 180 MB, maxrss: 0.20802 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/tmp-legacysurvey-custom-336235p03196-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/tmp-legacysurvey-custom-336235p03196-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 1.82 s, CPU: 0.41 s, VmPeak: 1042 MB, VmSize: 1041 MB, VmRSS: 215 MB, VmData: 240 MB, maxrss: 0.220484 MB
Stage wise_forced finished: 2020-08-05T18:52:55.476971
Resources for stage wise_forced : 3.308 s worker CPU, 4.153 s worker Wall, Wall: 1.826 s, Cores in use: 2.04, Total efficiency (on 32 cores): 6.4 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T18:52:56.149986
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/tractor-i/cus/tractor-custom-336235p03196.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/tractor/cus/tractor-custom-336235p03196.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/tractor/cus/brick-custom-336235p03196.sha256sum
Stage writecat : Wall: 0.62 s, CPU: 0.46 s, VmPeak: 1174 MB, VmSize: 1046 MB, VmRSS: 217 MB, VmData: 240 MB, maxrss: 0.35336 MB
Stage writecat finished: 2020-08-05T18:52:56.765693
Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.618 s, Cores in use: 0.75, Total efficiency (on 32 cores): 2.3 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/336/PGC1247178/PGC1247178-largegalaxy-writecat.p
All done: 53.804 s worker CPU, 732.090 s worker Wall, Wall: 156.920 s, Cores in use: 0.39, Total efficiency (on 32 cores): 1.2 %
Finished galaxy PGC1247178 in 2.644 minutes.
Started working on galaxy PGC1247178 at Mon Aug 10 07:46:42 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.23527271549113 3.1963489899830124 --width 233 --height 233 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/PGC1247178-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/PGC1247178-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-10T07:46:43.653604
legacypipe git version: DR9.5.11-watershed-6-g6a2880fc
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '336.23527271549113', '3.1963489899830124', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/PGC1247178-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/PGC1247178-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.23527271549113 3.1963489899830124 --width 233 --height 233 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/PGC1247178-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/PGC1247178-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 336.23527271549113 3.1963489899830124
Starting process 29480 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 29482 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 29484 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 29486 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 29488 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059336 MB
Starting process 29490 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059324 MB
Starting process 29492 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059324 MB
Starting process 29497 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-10T07:46:44.057305
Keeping 11 CCDs:
  c4d_160811_050048_ooi_z_ls9-S5 z expnum 562801 exptime 83.0 propid 2014B-0404 seeing 1.33 MJD 57611.207 object DECaLS_27777_z 
    decam/CP/V4.8.2a/CP20160810/c4d_160811_050048_ooi_z_ls9.fits.fz
  c4d_170718_054726_ooi_r_ls9-S5 r expnum 659611 exptime 78.0 propid 2014B-0404 seeing 1.20 MJD 57952.240 object DECaLS_27777_r 
    decam/CP/V4.8.2/CP20170717/c4d_170718_054726_ooi_r_ls9.fits.fz
  c4d_181015_001912_ooi_z_ls9-S4 z expnum 783529 exptime 250.0 propid 2014B-0404 seeing 1.71 MJD 58406.013 object DECaLS_43649_z 
    decam/CP/V4.8.2a/CP20181014/c4d_181015_001912_ooi_z_ls9.fits.fz
  c4d_180909_040323_ooi_r_ls9-S4 r expnum 771070 exptime 47.0 propid 2014B-0404 seeing 1.07 MJD 58370.169 object DECaLS_43649_r 
    decam/CP/V4.8.2a/CP20180908/c4d_180909_040323_ooi_r_ls9.fits.fz
  c4d_170723_051554_ooi_r_ls9-S4 r expnum 661262 exptime 125.0 propid 2014B-0404 seeing 1.78 MJD 57957.217 object DECaLS_43649_r 
    decam/CP/V4.8.2a/CP20170722/c4d_170723_051554_ooi_r_ls9.fits.fz
  c4d_170728_051312_ooi_g_ls9-S4 g expnum 662866 exptime 200.0 propid 2014B-0404 seeing 1.49 MJD 57962.215 object DECaLS_43649_g 
    decam/CP/V4.8.2a/CP20170727/c4d_170728_051312_ooi_g_ls9.fits.fz
  c4d_170916_233146_ooi_z_ls9-S4 z expnum 678246 exptime 120.0 propid 2014B-0404 seeing 1.06 MJD 58012.980 object DECaLS_43649_z 
    decam/CP/V4.8.2a/CP20170916/c4d_170916_233146_ooi_z_ls9.fits.fz
  c4d_170822_032123_ooi_r_ls9-S6 r expnum 670307 exptime 52.0 propid 2014B-0404 seeing 0.90 MJD 57987.140 object DECaLS_11905_r 
    decam/CP/V4.8.2a/CP20170821/c4d_170822_032123_ooi_r_ls9.fits.fz
  c4d_160812_042639_ooi_z_ls9-S6 z expnum 563135 exptime 80.0 propid 2014B-0404 seeing 0.95 MJD 57612.184 object DECaLS_11905_z 
    decam/CP/V4.8.2a/CP20160811/c4d_160812_042639_ooi_z_ls9.fits.fz
  c4d_170822_032242_ooi_g_ls9-S6 g expnum 670308 exptime 106.0 propid 2014B-0404 seeing 1.08 MJD 57987.141 object DECaLS_11905_g 
    decam/CP/V4.8.2a/CP20170821/c4d_170822_032242_ooi_g_ls9.fits.fz
  c4d_170719_053700_ooi_g_ls9-S5 g expnum 660004 exptime 200.0 propid 2014B-0404 seeing 1.74 MJD 57953.231 object DECaLS_27777_g 
    decam/CP/V4.8.2/CP20170718/c4d_170719_053700_ooi_g_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9531140-z-20181015T001912_oi[S4,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951e8b1-r-20170723T051256_oi[S4,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521d7c-r-20170822T032123_oi[S6,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95355ca-r-20180909T040323_oi[S4,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a387-z-20160811T045835_oi[S5,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951b160-r-20170718T054514_oi[S5,noinherit][2046,4094][real]: DECaLS_2
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ba61-g-20170719T053247_oi[S5,noinherit][2046,4094][real]: DECaLS_2
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95220ee-g-20170822T032242_oi[S6,noinherit][2046,4094][real]: DECaLS_1
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a179-z-20160812T042430_oi[S6,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951e046-z-20170916T233146_oi[S4,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9520b9e-g-20170728T050900_oi[S4,noinherit][2046,4094][real]: DECaLS_4
Stage tims : Wall: 87.23 s, CPU: 0.84 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 176 MB, VmData: 209 MB, maxrss: 0.179728 MB
Stage tims finished: 2020-08-10T07:48:11.290308
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521d7c-r-20170822T032123_oi[S6,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a387-z-20160811T045835_oi[S5,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951b160-r-20170718T054514_oi[S5,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95355ca-r-20180909T040323_oi[S4,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ba61-g-20170719T053247_oi[S5,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9531140-z-20181015T001912_oi[S4,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a179-z-20160812T042430_oi[S6,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951e8b1-r-20170723T051256_oi[S4,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95220ee-g-20170822T032242_oi[S6,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951e046-z-20170916T233146_oi[S4,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9520b9e-g-20170728T050900_oi[S4,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
Resources for stage tims : 5.821 s worker CPU, 414.041 s worker Wall, Wall: 87.234 s, Cores in use: 0.08, Total efficiency (on 8 cores): 1.0 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/PGC1247178-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/PGC1247178-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-10T07:48:11.317202
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05816.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05815.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05687.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05943.fits
Matched 5 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/metrics/cus/reference-custom-336235p03196.fits
Stage refs : Wall: 12.80 s, CPU: 2.11 s, VmPeak: 1036 MB, VmSize: 1025 MB, VmRSS: 196 MB, VmData: 229 MB, maxrss: 0.201048 MB
Stage refs finished: 2020-08-10T07:48:24.117991
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 12.802 s, Cores in use: 0.16, Total efficiency (on 8 cores): 2.1 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/PGC1247178-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/PGC1247178-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-10T07:48:24.230534
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/metrics/cus/outlier-mask-custom-336235p03196.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/metrics/cus/outliers-pre-custom-336235p03196.jpg
Image c4d_170719_053700_ooi_g_ls9-S5 g : masking 430 positive outlier pixels and 0 negative outlier pixels
Image c4d_180909_040323_ooi_r_ls9-S4 r : masking 1074 positive outlier pixels and 0 negative outlier pixels
Image c4d_170723_051554_ooi_r_ls9-S4 r : masking 899 positive outlier pixels and 0 negative outlier pixels
Image c4d_170718_054726_ooi_r_ls9-S5 r : masking 1548 positive outlier pixels and 0 negative outlier pixels
Image c4d_181015_001912_ooi_z_ls9-S4 z : masking 2191 positive outlier pixels and 0 negative outlier pixels
Image c4d_170916_233146_ooi_z_ls9-S4 z : masking 682 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/metrics/cus/outlier-mask-custom-336235p03196.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/metrics/cus/outliers-post-custom-336235p03196.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/metrics/cus/outliers-masked-pos-custom-336235p03196.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/metrics/cus/outliers-masked-neg-custom-336235p03196.jpg
Stage outliers : Wall: 0.93 s, CPU: 0.73 s, VmPeak: 1036 MB, VmSize: 1035 MB, VmRSS: 209 MB, VmData: 239 MB, maxrss: 0.214476 MB
Stage outliers finished: 2020-08-10T07:48:25.156539
Resources for stage outliers : 0.772 s worker CPU, 0.777 s worker Wall, Wall: 0.927 s, Cores in use: 1.62, Total efficiency (on 8 cores): 20.3 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/PGC1247178-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/PGC1247178-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-10T07:48:25.180373
Stage halos : Wall: 1.72 s, CPU: 0.39 s, VmPeak: 1036 MB, VmSize: 1035 MB, VmRSS: 210 MB, VmData: 240 MB, maxrss: 0.21494 MB
Stage halos finished: 2020-08-10T07:48:26.904929
Resources for stage halos : 0.272 s worker CPU, 2.210 s worker Wall, Wall: 1.726 s, Cores in use: 0.39, Total efficiency (on 8 cores): 4.8 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/PGC1247178-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/PGC1247178-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-10T07:48:27.090033
PSF sigmas in coadd pixels: ['2.42', '1.75', '2.82']
Using average PSF sigma 2.3299981024868113
Gaussian PSF norm 0.12107082468127243 vs pixelized 0.09455865
average tim pixel scale / coadd scale: 1.0011624811458906
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.94', '1.74', '2.89', '1.46']
Using average PSF sigma 2.0098795355571477
Gaussian PSF norm 0.14035407932828184 vs pixelized 0.10475469
average tim pixel scale / coadd scale: 1.0011772941069266
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.17', '2.78', '1.73', '1.54']
Using average PSF sigma 2.05311603167357
Gaussian PSF norm 0.13739836785743295 vs pixelized 0.10166731
average tim pixel scale / coadd scale: 1.0011607732398093
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.15 s, CPU: 0.14 s, VmPeak: 1036 MB, VmSize: 1035 MB, VmRSS: 211 MB, VmData: 240 MB, maxrss: 0.21654 MB
Stage fit_on_coadds finished: 2020-08-10T07:48:27.238679
Resources for stage fit_on_coadds : 0.193 s worker CPU, 0.195 s worker Wall, Wall: 0.150 s, Cores in use: 2.24, Total efficiency (on 8 cores): 28.0 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/PGC1247178-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/PGC1247178-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-10T07:48:27.247955
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 21 potential peaks
Of 21 potential peaks: 12 in veto map, 4 cut by saddle test, 0 cut by aper test, 5 kept
SED z : 5 new peaks
Found 29 potential peaks
Of 29 potential peaks: 20 in veto map, 6 cut by saddle test, 0 cut by aper test, 3 kept
SED r : 3 new peaks
Found 19 potential peaks
Of 19 potential peaks: 15 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 27 potential peaks
Of 27 potential peaks: 20 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 32 potential peaks
Of 32 potential peaks: 26 in veto map, 6 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 13 new sources
Median coadd sky for g : 3.124042e-05
Median coadd sky for r : 1.1851655e-05
Median coadd sky for z : 0.000329251
Stage srcs : Wall: 0.51 s, CPU: 0.47 s, VmPeak: 1036 MB, VmSize: 1035 MB, VmRSS: 212 MB, VmData: 240 MB, maxrss: 0.217024 MB
Stage srcs finished: 2020-08-10T07:48:27.757502
Resources for stage srcs : 0.087 s worker CPU, 0.087 s worker Wall, Wall: 0.510 s, Cores in use: 1.09, Total efficiency (on 8 cores): 13.7 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/PGC1247178-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/PGC1247178-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-10T07:48:27.767611
Blob 1 of 5, id: 2, sources: 6, size: 176x182, npix 17166, brick X: 50,226, Y: 15,197, one pixel: 122 15
Blob 2 of 5, id: 1, sources: 8, size: 68x61, npix 2459, brick X: 154,222, Y: 0,61, one pixel: 173 0
Blob 3 of 5, id: 3, sources: 1, size: 41x40, npix 1160, brick X: 1,42, Y: 107,147, one pixel: 17 107
Blob 4 of 5, id: 0, sources: 1, size: 31x17, npix 384, brick X: 50,81, Y: 0,17, one pixel: 52 0
Blob 5 of 5, id: 4, sources: 1, size: 20x19, npix 235, brick X: 0,20, Y: 214,233, one pixel: 9 214
Blob 5 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 967 MB, VmSize: 723 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142768 MB
Blob 3 finished, total: Wall: 0.49 s, CPU: 0.49 s, VmPeak: 946 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147076 MB
Blob 4 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 941 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14544 MB
Blob 2 finished, total: Wall: 2.20 s, CPU: 2.20 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144172 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.35995, ee1=0.137325, ee2=0.160098
Measuring 2 iterative sources
Blob 1 finished, total: Wall: 7.23 s, CPU: 7.23 s, VmPeak: 967 MB, VmSize: 723 MB, VmRSS: 147 MB, VmData: 178 MB, maxrss: 0.15056 MB
Old catalog: 18
New catalog: 17
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/metrics/cus/blobs-custom-336235p03196.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/metrics/cus/all-models-custom-336235p03196.fits
Stage fitblobs : Wall: 7.55 s, CPU: 0.27 s, VmPeak: 1036 MB, VmSize: 1035 MB, VmRSS: 212 MB, VmData: 240 MB, maxrss: 0.217188 MB
Stage fitblobs finished: 2020-08-10T07:48:35.313873
Resources for stage fitblobs : 10.971 s worker CPU, 10.993 s worker Wall, Wall: 7.547 s, Cores in use: 1.49, Total efficiency (on 8 cores): 18.6 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/PGC1247178-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/PGC1247178-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-10T07:48:35.328978
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/tmp-legacysurvey-custom-336235p03196-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/tmp-legacysurvey-custom-336235p03196-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/tmp-legacysurvey-custom-336235p03196-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/tmp-legacysurvey-custom-336235p03196-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-resid.jpg
Stage coadds : Wall: 1.48 s, CPU: 0.70 s, VmPeak: 1036 MB, VmSize: 1035 MB, VmRSS: 213 MB, VmData: 240 MB, maxrss: 0.217704 MB
Stage coadds finished: 2020-08-10T07:48:36.810115
Resources for stage coadds : 3.763 s worker CPU, 4.203 s worker Wall, Wall: 1.482 s, Cores in use: 3.01, Total efficiency (on 8 cores): 37.7 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/PGC1247178-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/PGC1247178-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-10T07:48:36.821673
Cut to 1 unWISE tiles
Reading WISE tile 3357p030 band 1
Reading WISE tile 3357p030 band 2
Reading WISE tile 3357p030 band 3
Reading WISE tile 3357p030 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 940 MB, VmSize: 801 MB, VmRSS: 144 MB, VmData: 176 MB, maxrss: 0.186568 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 967 MB, VmSize: 800 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.204896 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 946 MB, VmSize: 864 MB, VmRSS: 206 MB, VmData: 235 MB, maxrss: 0.211292 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357p030/unwise-3357p030-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 968 MB, VmSize: 800 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.205508 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/tmp-legacysurvey-custom-336235p03196-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/tmp-legacysurvey-custom-336235p03196-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 1.95 s, CPU: 0.42 s, VmPeak: 1036 MB, VmSize: 1035 MB, VmRSS: 213 MB, VmData: 240 MB, maxrss: 0.218408 MB
Stage wise_forced finished: 2020-08-10T07:48:38.771696
Resources for stage wise_forced : 3.574 s worker CPU, 4.748 s worker Wall, Wall: 1.951 s, Cores in use: 2.05, Total efficiency (on 8 cores): 25.6 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/PGC1247178-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/PGC1247178-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-10T07:48:38.782766
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/coadd/cus/custom-336235p03196/legacysurvey-custom-336235p03196-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/tractor-i/cus/tractor-custom-336235p03196.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/tractor/cus/tractor-custom-336235p03196.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/tractor/cus/brick-custom-336235p03196.sha256sum
Stage writecat : Wall: 0.59 s, CPU: 0.44 s, VmPeak: 1167 MB, VmSize: 1039 MB, VmRSS: 215 MB, VmData: 240 MB, maxrss: 0.351268 MB
Stage writecat finished: 2020-08-10T07:48:39.372100
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.591 s, Cores in use: 0.75, Total efficiency (on 8 cores): 9.4 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/PGC1247178-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1247178/PGC1247178-largegalaxy-writecat.p
All done: 25.453 s worker CPU, 437.256 s worker Wall, Wall: 115.336 s, Cores in use: 0.28, Total efficiency (on 8 cores): 3.5 %
Finished galaxy PGC1247178 in 1.951 minutes.