Started working on galaxy PGC1303834 at Wed Aug  5 18:50:22 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.7385425 6.5975633 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T18:50:23.027418
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '347.7385425', '6.5975633', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.7385425 6.5975633 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 347.7385425 6.5975633
Starting process 27007 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 27008 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 27009 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 27010 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 27011 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 27012 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 27013 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 27014 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 27015 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 27016 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 27017 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 27018 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 27019 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 27020 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 27021 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 27022 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 27023 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 27024 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 27025 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 27026 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 27027 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 27028 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 27029 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 27030 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 27031 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 27032 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 27033 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 27034 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB
Starting process 27035 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB
Starting process 27036 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB
Starting process 27037 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB
Starting process 27038 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05932 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T18:50:23.477279
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 13 CCDs:
  c4d_170721_064110_ooi_g_ls9-N27 g expnum 660488 exptime 116.0 propid 2014B-0404 seeing 1.23 MJD 57955.277 object DECaLS_39664_g 
    decam/CP/V4.8.2/CP20170720/c4d_170721_064110_ooi_g_ls9.fits.fz
  c4d_170721_063843_ooi_r_ls9-N27 r expnum 660487 exptime 74.0 propid 2014B-0404 seeing 1.06 MJD 57955.275 object DECaLS_39664_r 
    decam/CP/V4.8.2/CP20170720/c4d_170721_063843_ooi_r_ls9.fits.fz
  c4d_140815_080641_ooi_z_ls9-N27 z expnum 348051 exptime 145.0 propid 2014B-0404 seeing 0.88 MJD 56884.336 object DECaLS_39664_z 
    decam/CP/V4.8.2a/CP20140814/c4d_140815_080641_ooi_z_ls9.fits.fz
  c4d_170801_034558_ooi_z_ls9-N28 z expnum 663678 exptime 106.0 propid 2014B-0404 seeing 1.84 MJD 57966.155 object DECaLS_23792_z 
    decam/CP/V4.8.2/CP20170731/c4d_170801_034558_ooi_z_ls9.fits.fz
  c4d_180915_030915_ooi_z_ls9-N28 z expnum 773683 exptime 86.0 propid 2014B-0404 seeing 1.69 MJD 58376.131 object DECaLS_23792_z 
    decam/CP/V4.8.2a/CP20180914/c4d_180915_030915_ooi_z_ls9.fits.fz
  c4d_170916_044446_ooi_r_ls9-N28 r expnum 678023 exptime 72.0 propid 2014B-0404 seeing 1.20 MJD 58012.198 object DECaLS_23792_r 
    decam/CP/V4.8.2a/CP20170915/c4d_170916_044446_ooi_r_ls9.fits.fz
  c4d_170821_050553_ooi_g_ls9-N28 g expnum 669961 exptime 199.0 propid 2014B-0404 seeing 1.51 MJD 57986.212 object DECaLS_23792_g 
    decam/CP/V4.8.2a/CP20170820/c4d_170821_050553_ooi_g_ls9.fits.fz
  c4d_170801_065120_ooi_g_ls9-S25 g expnum 663746 exptime 198.0 propid 2014B-0404 seeing 1.83 MJD 57966.283 object DECaLS_23806_g 
    decam/CP/V4.8.2a/CP20170731/c4d_170801_065120_ooi_g_ls9.fits.fz
  c4d_180902_031455_ooi_r_ls9-S25 r expnum 767887 exptime 68.0 propid 2014B-0404 seeing 1.55 MJD 58363.135 object DECaLS_23806_r 
    decam/CP/V4.8.2a/CP20180901/c4d_180902_031455_ooi_r_ls9.fits.fz
  c4d_160813_054711_ooi_z_ls9-S25 z expnum 563585 exptime 92.0 propid 2014B-0404 seeing 0.86 MJD 57613.239 object DECaLS_23806_z 
    decam/CP/V4.8.2a/CP20160812/c4d_160813_054711_ooi_z_ls9.fits.fz
  c4d_170730_060231_ooi_g_ls9-S26 g expnum 663315 exptime 104.0 propid 2014B-0404 seeing 1.30 MJD 57964.250 object DECaLS_7934_g 
    decam/CP/V4.8.2a/CP20170729/c4d_170730_060231_ooi_g_ls9.fits.fz
  c4d_180916_031231_ooi_z_ls9-S26 z expnum 774205 exptime 80.0 propid 2014B-0404 seeing 1.39 MJD 58377.134 object DECaLS_7934_z 
    decam/CP/V4.8.2a/CP20180915/c4d_180916_031231_ooi_z_ls9.fits.fz
  c4d_180811_051548_ooi_r_ls9-S26 r expnum 764175 exptime 40.0 propid 2014B-0404 seeing 1.63 MJD 58341.219 object DECaLS_7934_r 
    decam/CP/V4.8.2a/CP20180810/c4d_180811_051548_ooi_r_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180902T031455_oi[S25,noinherit][2046,4094][real]: DECaLS_2380
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9520b9e-g-20170730T055954_oi[S26,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e572-z-20180916T031231_oi[S26,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fc69-z-20160813T054449_oi[S25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954cb27-z-20140815T080321_oi[N27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532014-r-20180811T051548_oi[S26,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521352-g-20170801T064709_oi[S25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ccd4-g-20170721T063822_oi[N27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951cf8e-r-20170721T063637_oi[N27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522dd2-r-20170916T044446_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95220ee-g-20170821T050553_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951a9b6-z-20170801T034320_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e102-z-20180915T030915_oi[N28,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 46.10 s, CPU: 0.90 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 180 MB, VmData: 212 MB, maxrss: 0.183876 MB
Stage tims finished: 2020-08-05T18:51:09.577161
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180902T031455_oi[S25,noinherit][2046,4094][real]: DECaLS_2380 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9520b9e-g-20170730T055954_oi[S26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95220ee-g-20170821T050553_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e572-z-20180916T031231_oi[S26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fc69-z-20160813T054449_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522dd2-r-20170916T044446_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521352-g-20170801T064709_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954cb27-z-20140815T080321_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951cf8e-r-20170721T063637_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532014-r-20180811T051548_oi[S26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951a9b6-z-20170801T034320_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e102-z-20180915T030915_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 7.586 s worker CPU, 543.489 s worker Wall, Wall: 46.103 s, Cores in use: 0.18, Total efficiency (on 32 cores): 0.6 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ccd4-g-20170721T063822_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T18:51:09.606924
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05435.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05564.fits
Matched 5 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/metrics/cus/reference-custom-347738p06597.fits
Stage refs : Wall: 9.71 s, CPU: 1.66 s, VmPeak: 1043 MB, VmSize: 1029 MB, VmRSS: 198 MB, VmData: 229 MB, maxrss: 0.20228 MB
Stage refs finished: 2020-08-05T18:51:19.320473
Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 9.716 s, Cores in use: 0.17, Total efficiency (on 32 cores): 0.5 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T18:51:19.471848
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/metrics/cus/outlier-mask-custom-347738p06597.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/metrics/cus/outliers-pre-custom-347738p06597.jpg
Image c4d_170730_060231_ooi_g_ls9-S26 g : masking 1067 positive outlier pixels and 0 negative outlier pixels
Image c4d_180811_051548_ooi_r_ls9-S26 r : masking 0 positive outlier pixels and 89 negative outlier pixels
Image c4d_160813_054711_ooi_z_ls9-S25 z : masking 123 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/metrics/cus/outlier-mask-custom-347738p06597.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/metrics/cus/outliers-post-custom-347738p06597.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/metrics/cus/outliers-masked-pos-custom-347738p06597.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/metrics/cus/outliers-masked-neg-custom-347738p06597.jpg
Stage outliers : Wall: 0.96 s, CPU: 0.70 s, VmPeak: 1043 MB, VmSize: 1038 MB, VmRSS: 213 MB, VmData: 241 MB, maxrss: 0.217944 MB
Stage outliers finished: 2020-08-05T18:51:20.428111
Resources for stage outliers : 0.943 s worker CPU, 1.143 s worker Wall, Wall: 0.958 s, Cores in use: 1.72, Total efficiency (on 32 cores): 5.4 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T18:51:20.456972
Stage halos : Wall: 1.75 s, CPU: 0.24 s, VmPeak: 1043 MB, VmSize: 1039 MB, VmRSS: 213 MB, VmData: 242 MB, maxrss: 0.218364 MB
Stage halos finished: 2020-08-05T18:51:22.210063
Resources for stage halos : 0.446 s worker CPU, 3.679 s worker Wall, Wall: 1.755 s, Cores in use: 0.39, Total efficiency (on 32 cores): 1.2 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T18:51:22.270906
PSF sigmas in coadd pixels: ['1.99', '2.46', '2.97', '2.11']
Using average PSF sigma 2.380236398989383
Gaussian PSF norm 0.11851545161381949 vs pixelized 0.09448885
average tim pixel scale / coadd scale: 1.0011870666622105
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.72', '1.95', '2.51', '2.64']
Using average PSF sigma 2.2067927857575897
Gaussian PSF norm 0.12783021296538963 vs pixelized 0.11030046
average tim pixel scale / coadd scale: 1.0011868667122303
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.42', '2.99', '2.75', '1.40', '2.25']
Using average PSF sigma 2.162120572098074
Gaussian PSF norm 0.13047135086464656 vs pixelized 0.10960443
average tim pixel scale / coadd scale: 1.0011696060301865
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 1.04 s, CPU: 0.17 s, VmPeak: 1043 MB, VmSize: 1039 MB, VmRSS: 215 MB, VmData: 242 MB, maxrss: 0.219956 MB
Stage fit_on_coadds finished: 2020-08-05T18:51:23.314509
Resources for stage fit_on_coadds : 0.169 s worker CPU, 0.169 s worker Wall, Wall: 1.046 s, Cores in use: 0.32, Total efficiency (on 32 cores): 1.0 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T18:51:23.327134
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 42 potential peaks
Of 42 potential peaks: 29 in veto map, 4 cut by saddle test, 0 cut by aper test, 9 kept
SED z : 9 new peaks
Found 65 potential peaks
Of 65 potential peaks: 56 in veto map, 4 cut by saddle test, 0 cut by aper test, 5 kept
SED r : 5 new peaks
Found 63 potential peaks
Of 63 potential peaks: 52 in veto map, 6 cut by saddle test, 0 cut by aper test, 5 kept
SED g : 5 new peaks
Found 90 potential peaks
Of 90 potential peaks: 80 in veto map, 9 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 112 potential peaks
Of 112 potential peaks: 102 in veto map, 10 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 20 new sources
Median coadd sky for g : 0.00034660043
Median coadd sky for r : 0.00073648983
Median coadd sky for z : 0.001543516
Stage srcs : Wall: 0.59 s, CPU: 0.55 s, VmPeak: 1043 MB, VmSize: 1039 MB, VmRSS: 215 MB, VmData: 242 MB, maxrss: 0.22036 MB
Stage srcs finished: 2020-08-05T18:51:23.913777
Resources for stage srcs : 0.067 s worker CPU, 0.067 s worker Wall, Wall: 0.589 s, Cores in use: 1.06, Total efficiency (on 32 cores): 3.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T18:51:23.937317
Blob 1 of 4, id: 0, sources: 18, size: 233x233, npix 34363, brick X: 0,233, Y: 0,233, one pixel: 49 0
Blob 2 of 4, id: 3, sources: 2, size: 37x44, npix 1046, brick X: 196,233, Y: 189,233, one pixel: 225 189
Blob 3 of 4, id: 2, sources: 1, size: 26x26, npix 403, brick X: 0,26, Y: 92,118, one pixel: 13 92
Blob 4 of 4, id: 1, sources: 1, size: 19x25, npix 311, brick X: 214,233, Y: 3,28, one pixel: 225 3
Blob 3 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 938 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150568 MB
Blob 4 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.091844 MB
Blob 2 finished, total: Wall: 0.77 s, CPU: 0.76 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 113 MB, VmData: 166 MB, maxrss: 0.115244 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.30978, ee1=0.10513, ee2=0.11806
Measuring 20 iterative sources
Blob 1 finished, total: Wall: 24.31 s, CPU: 24.30 s, VmPeak: 707 MB, VmSize: 707 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142056 MB
Old catalog: 26
New catalog: 35
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/metrics/cus/blobs-custom-347738p06597.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/metrics/cus/all-models-custom-347738p06597.fits
Stage fitblobs : Wall: 24.96 s, CPU: 0.39 s, VmPeak: 1043 MB, VmSize: 1037 MB, VmRSS: 215 MB, VmData: 240 MB, maxrss: 0.221196 MB
Stage fitblobs finished: 2020-08-05T18:51:48.894949
Resources for stage fitblobs : 25.582 s worker CPU, 25.654 s worker Wall, Wall: 24.959 s, Cores in use: 1.04, Total efficiency (on 32 cores): 3.3 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T18:51:49.018314
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/tmp-legacysurvey-custom-347738p06597-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/tmp-legacysurvey-custom-347738p06597-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/tmp-legacysurvey-custom-347738p06597-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/tmp-legacysurvey-custom-347738p06597-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-resid.jpg
Stage coadds : Wall: 3.42 s, CPU: 0.55 s, VmPeak: 1043 MB, VmSize: 1037 MB, VmRSS: 215 MB, VmData: 240 MB, maxrss: 0.221196 MB
Stage coadds finished: 2020-08-05T18:51:52.435853
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 25.578 s worker CPU, 47.104 s worker Wall, Wall: 3.420 s, Cores in use: 7.64, Total efficiency (on 32 cores): 23.9 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T18:51:52.448512
Cut to 1 unWISE tiles
Reading WISE tile 3478p060 band 1
Reading WISE tile 3478p060 band 2
Reading WISE tile 3478p060 band 3
Reading WISE tile 3478p060 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 943 MB, VmSize: 809 MB, VmRSS: 149 MB, VmData: 178 MB, maxrss: 0.189184 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 941 MB, VmSize: 801 MB, VmRSS: 141 MB, VmData: 170 MB, maxrss: 0.203692 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 864 MB, VmSize: 864 MB, VmRSS: 204 MB, VmData: 236 MB, maxrss: 0.208748 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 940 MB, VmSize: 801 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.203492 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/tmp-legacysurvey-custom-347738p06597-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/tmp-legacysurvey-custom-347738p06597-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.76 s, CPU: 0.54 s, VmPeak: 1043 MB, VmSize: 1037 MB, VmRSS: 216 MB, VmData: 240 MB, maxrss: 0.221196 MB
Stage wise_forced finished: 2020-08-05T18:51:56.207688
Resources for stage wise_forced : 3.134 s worker CPU, 6.472 s worker Wall, Wall: 3.761 s, Cores in use: 0.98, Total efficiency (on 32 cores): 3.1 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-wise_forced.p
Running stage writecat
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage writecat at 2020-08-05T18:51:56.221933
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/tractor-i/cus/tractor-custom-347738p06597.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/tractor/cus/tractor-custom-347738p06597.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/tractor/cus/brick-custom-347738p06597.sha256sum
Stage writecat : Wall: 0.77 s, CPU: 0.59 s, VmPeak: 1169 MB, VmSize: 1041 MB, VmRSS: 218 MB, VmData: 240 MB, maxrss: 0.353756 MB
Stage writecat finished: 2020-08-05T18:51:56.996535
Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.777 s, Cores in use: 0.76, Total efficiency (on 32 cores): 2.4 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-writecat.p
All done: 63.511 s worker CPU, 627.784 s worker Wall, Wall: 93.541 s, Cores in use: 0.75, Total efficiency (on 32 cores): 2.3 %
Finished galaxy PGC1303834 in 1.588 minutes.
Started working on galaxy PGC1303834 at Wed Aug  5 19:02:01 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.7385425 6.5975633 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T19:02:04.456847
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '347.7385425', '6.5975633', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.7385425 6.5975633 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 347.7385425 6.5975633
Starting process 28840 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 28841 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 28842 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 28843 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 28844 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 28845 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 28846 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 28847 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 28848 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 28849 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 28850 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 28851 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 28853 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 28854 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 28852 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 28855 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T19:02:07.196794
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 13 CCDs:
  c4d_170721_064110_ooi_g_ls9-N27 g expnum 660488 exptime 116.0 propid 2014B-0404 seeing 1.23 MJD 57955.277 object DECaLS_39664_g 
    decam/CP/V4.8.2/CP20170720/c4d_170721_064110_ooi_g_ls9.fits.fz
  c4d_170721_063843_ooi_r_ls9-N27 r expnum 660487 exptime 74.0 propid 2014B-0404 seeing 1.06 MJD 57955.275 object DECaLS_39664_r 
    decam/CP/V4.8.2/CP20170720/c4d_170721_063843_ooi_r_ls9.fits.fz
  c4d_140815_080641_ooi_z_ls9-N27 z expnum 348051 exptime 145.0 propid 2014B-0404 seeing 0.88 MJD 56884.336 object DECaLS_39664_z 
    decam/CP/V4.8.2a/CP20140814/c4d_140815_080641_ooi_z_ls9.fits.fz
  c4d_170801_034558_ooi_z_ls9-N28 z expnum 663678 exptime 106.0 propid 2014B-0404 seeing 1.84 MJD 57966.155 object DECaLS_23792_z 
    decam/CP/V4.8.2/CP20170731/c4d_170801_034558_ooi_z_ls9.fits.fz
  c4d_180915_030915_ooi_z_ls9-N28 z expnum 773683 exptime 86.0 propid 2014B-0404 seeing 1.69 MJD 58376.131 object DECaLS_23792_z 
    decam/CP/V4.8.2a/CP20180914/c4d_180915_030915_ooi_z_ls9.fits.fz
  c4d_170916_044446_ooi_r_ls9-N28 r expnum 678023 exptime 72.0 propid 2014B-0404 seeing 1.20 MJD 58012.198 object DECaLS_23792_r 
    decam/CP/V4.8.2a/CP20170915/c4d_170916_044446_ooi_r_ls9.fits.fz
  c4d_170821_050553_ooi_g_ls9-N28 g expnum 669961 exptime 199.0 propid 2014B-0404 seeing 1.51 MJD 57986.212 object DECaLS_23792_g 
    decam/CP/V4.8.2a/CP20170820/c4d_170821_050553_ooi_g_ls9.fits.fz
  c4d_170801_065120_ooi_g_ls9-S25 g expnum 663746 exptime 198.0 propid 2014B-0404 seeing 1.83 MJD 57966.283 object DECaLS_23806_g 
    decam/CP/V4.8.2a/CP20170731/c4d_170801_065120_ooi_g_ls9.fits.fz
  c4d_180902_031455_ooi_r_ls9-S25 r expnum 767887 exptime 68.0 propid 2014B-0404 seeing 1.55 MJD 58363.135 object DECaLS_23806_r 
    decam/CP/V4.8.2a/CP20180901/c4d_180902_031455_ooi_r_ls9.fits.fz
  c4d_160813_054711_ooi_z_ls9-S25 z expnum 563585 exptime 92.0 propid 2014B-0404 seeing 0.86 MJD 57613.239 object DECaLS_23806_z 
    decam/CP/V4.8.2a/CP20160812/c4d_160813_054711_ooi_z_ls9.fits.fz
  c4d_170730_060231_ooi_g_ls9-S26 g expnum 663315 exptime 104.0 propid 2014B-0404 seeing 1.30 MJD 57964.250 object DECaLS_7934_g 
    decam/CP/V4.8.2a/CP20170729/c4d_170730_060231_ooi_g_ls9.fits.fz
  c4d_180916_031231_ooi_z_ls9-S26 z expnum 774205 exptime 80.0 propid 2014B-0404 seeing 1.39 MJD 58377.134 object DECaLS_7934_z 
    decam/CP/V4.8.2a/CP20180915/c4d_180916_031231_ooi_z_ls9.fits.fz
  c4d_180811_051548_ooi_r_ls9-S26 r expnum 764175 exptime 40.0 propid 2014B-0404 seeing 1.63 MJD 58341.219 object DECaLS_7934_r 
    decam/CP/V4.8.2a/CP20180810/c4d_180811_051548_ooi_r_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521352-g-20170801T064709_oi[S25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9520b9e-g-20170730T055954_oi[S26,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532014-r-20180811T051548_oi[S26,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e102-z-20180915T030915_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95220ee-g-20170821T050553_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fc69-z-20160813T054449_oi[S25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951cf8e-r-20170721T063637_oi[N27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954cb27-z-20140815T080321_oi[N27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180902T031455_oi[S25,noinherit][2046,4094][real]: DECaLS_2380
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e572-z-20180916T031231_oi[S26,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522dd2-r-20170916T044446_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951a9b6-z-20170801T034320_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ccd4-g-20170721T063822_oi[N27,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 31.98 s, CPU: 2.23 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 179 MB, VmData: 211 MB, maxrss: 0.18372 MB
Stage tims finished: 2020-08-05T19:02:39.173361
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521352-g-20170801T064709_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532014-r-20180811T051548_oi[S26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9520b9e-g-20170730T055954_oi[S26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e102-z-20180915T030915_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951cf8e-r-20170721T063637_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95220ee-g-20170821T050553_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e572-z-20180916T031231_oi[S26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fc69-z-20160813T054449_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954cb27-z-20140815T080321_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522dd2-r-20170916T044446_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 8.737 s worker CPU, 271.399 s worker Wall, Wall: 31.978 s, Cores in use: 0.34, Total efficiency (on 16 cores): 2.1 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180902T031455_oi[S25,noinherit][2046,4094][real]: DECaLS_2380 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951a9b6-z-20170801T034320_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T19:02:39.205862
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05435.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05564.fits
Matched 5 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/metrics/cus/reference-custom-347738p06597.fits
Stage refs : Wall: 20.32 s, CPU: 2.09 s, VmPeak: 1043 MB, VmSize: 1029 MB, VmRSS: 197 MB, VmData: 228 MB, maxrss: 0.202068 MB
Stage refs finished: 2020-08-05T19:02:59.525279
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ccd4-g-20170721T063822_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 20.321 s, Cores in use: 0.10, Total efficiency (on 16 cores): 0.6 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T19:02:59.764017
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/metrics/cus/outlier-mask-custom-347738p06597.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/metrics/cus/outliers-pre-custom-347738p06597.jpg
Image c4d_170730_060231_ooi_g_ls9-S26 g : masking 1067 positive outlier pixels and 0 negative outlier pixels
Image c4d_180811_051548_ooi_r_ls9-S26 r : masking 0 positive outlier pixels and 89 negative outlier pixels
Image c4d_160813_054711_ooi_z_ls9-S25 z : masking 123 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/metrics/cus/outlier-mask-custom-347738p06597.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/metrics/cus/outliers-post-custom-347738p06597.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/metrics/cus/outliers-masked-pos-custom-347738p06597.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/metrics/cus/outliers-masked-neg-custom-347738p06597.jpg
Stage outliers : Wall: 1.12 s, CPU: 0.93 s, VmPeak: 1043 MB, VmSize: 1038 MB, VmRSS: 212 MB, VmData: 240 MB, maxrss: 0.216652 MB
Stage outliers finished: 2020-08-05T19:03:00.882650
Resources for stage outliers : 0.804 s worker CPU, 0.868 s worker Wall, Wall: 1.120 s, Cores in use: 1.55, Total efficiency (on 16 cores): 9.7 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T19:03:01.097261
Stage halos : Wall: 2.23 s, CPU: 0.43 s, VmPeak: 1043 MB, VmSize: 1039 MB, VmRSS: 212 MB, VmData: 240 MB, maxrss: 0.21714 MB
Stage halos finished: 2020-08-05T19:03:03.325283
Resources for stage halos : 0.437 s worker CPU, 4.343 s worker Wall, Wall: 2.230 s, Cores in use: 0.39, Total efficiency (on 16 cores): 2.4 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T19:03:03.370465
PSF sigmas in coadd pixels: ['1.99', '2.46', '2.97', '2.11']
Using average PSF sigma 2.380236398989383
Gaussian PSF norm 0.11851545161381949 vs pixelized 0.09448885
average tim pixel scale / coadd scale: 1.0011870666622105
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.72', '1.95', '2.51', '2.64']
Using average PSF sigma 2.2067927857575897
Gaussian PSF norm 0.12783021296538963 vs pixelized 0.11030046
average tim pixel scale / coadd scale: 1.0011868667122303
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.42', '2.99', '2.75', '1.40', '2.25']
Using average PSF sigma 2.162120572098074
Gaussian PSF norm 0.13047135086464656 vs pixelized 0.10960445
average tim pixel scale / coadd scale: 1.0011696060301865
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.27 s, CPU: 0.17 s, VmPeak: 1043 MB, VmSize: 1039 MB, VmRSS: 214 MB, VmData: 241 MB, maxrss: 0.2193 MB
Stage fit_on_coadds finished: 2020-08-05T19:03:03.636546
Resources for stage fit_on_coadds : 0.180 s worker CPU, 0.181 s worker Wall, Wall: 0.268 s, Cores in use: 1.33, Total efficiency (on 16 cores): 8.3 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T19:03:03.660492
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 42 potential peaks
Of 42 potential peaks: 29 in veto map, 4 cut by saddle test, 0 cut by aper test, 9 kept
SED z : 9 new peaks
Found 65 potential peaks
Of 65 potential peaks: 56 in veto map, 4 cut by saddle test, 0 cut by aper test, 5 kept
SED r : 5 new peaks
Found 63 potential peaks
Of 63 potential peaks: 52 in veto map, 6 cut by saddle test, 0 cut by aper test, 5 kept
SED g : 5 new peaks
Found 90 potential peaks
Of 90 potential peaks: 80 in veto map, 9 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 112 potential peaks
Of 112 potential peaks: 102 in veto map, 10 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 20 new sources
Median coadd sky for g : 0.00034660043
Median coadd sky for r : 0.00073648983
Median coadd sky for z : 0.001543516
Stage srcs : Wall: 2.87 s, CPU: 2.75 s, VmPeak: 1043 MB, VmSize: 1039 MB, VmRSS: 215 MB, VmData: 241 MB, maxrss: 0.219876 MB
Stage srcs finished: 2020-08-05T19:03:06.526438
Resources for stage srcs : 0.063 s worker CPU, 0.063 s worker Wall, Wall: 2.867 s, Cores in use: 0.98, Total efficiency (on 16 cores): 6.1 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T19:03:06.573632
Blob 1 of 4, id: 0, sources: 18, size: 233x233, npix 34363, brick X: 0,233, Y: 0,233, one pixel: 49 0
Blob 2 of 4, id: 3, sources: 2, size: 37x44, npix 1046, brick X: 196,233, Y: 189,233, one pixel: 225 189
Blob 3 of 4, id: 2, sources: 1, size: 26x26, npix 403, brick X: 0,26, Y: 92,118, one pixel: 13 92
Blob 4 of 4, id: 1, sources: 1, size: 19x25, npix 311, brick X: 214,233, Y: 3,28, one pixel: 225 3
Blob 3 finished, total: Wall: 0.23 s, CPU: 0.22 s, VmPeak: 940 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.14888 MB
Blob 4 finished, total: Wall: 0.24 s, CPU: 0.23 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.114504 MB
Blob 2 finished, total: Wall: 0.88 s, CPU: 0.86 s, VmPeak: 940 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148792 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.30978, ee1=0.10513, ee2=0.11806
Measuring 20 iterative sources
Blob 1 finished, total: Wall: 24.33 s, CPU: 24.32 s, VmPeak: 939 MB, VmSize: 748 MB, VmRSS: 169 MB, VmData: 197 MB, maxrss: 0.173144 MB
Old catalog: 26
New catalog: 35
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/metrics/cus/blobs-custom-347738p06597.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/metrics/cus/all-models-custom-347738p06597.fits
Stage fitblobs : Wall: 26.26 s, CPU: 1.71 s, VmPeak: 1043 MB, VmSize: 1037 MB, VmRSS: 214 MB, VmData: 239 MB, maxrss: 0.220604 MB
Stage fitblobs finished: 2020-08-05T19:03:32.838554
Resources for stage fitblobs : 25.698 s worker CPU, 25.911 s worker Wall, Wall: 26.267 s, Cores in use: 1.04, Total efficiency (on 16 cores): 6.5 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T19:03:32.852034
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/tmp-legacysurvey-custom-347738p06597-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/tmp-legacysurvey-custom-347738p06597-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/tmp-legacysurvey-custom-347738p06597-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/tmp-legacysurvey-custom-347738p06597-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-resid.jpg
Stage coadds : Wall: 2.80 s, CPU: 0.64 s, VmPeak: 1043 MB, VmSize: 1037 MB, VmRSS: 214 MB, VmData: 239 MB, maxrss: 0.220604 MB
Stage coadds finished: 2020-08-05T19:03:35.650426
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 9.234 s worker CPU, 13.744 s worker Wall, Wall: 2.800 s, Cores in use: 3.53, Total efficiency (on 16 cores): 22.0 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T19:03:35.666013
Cut to 1 unWISE tiles
Reading WISE tile 3478p060 band 1
Reading WISE tile 3478p060 band 2
Reading WISE tile 3478p060 band 3
Reading WISE tile 3478p060 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 959 MB, VmSize: 807 MB, VmRSS: 148 MB, VmData: 176 MB, maxrss: 0.193252 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 937 MB, VmSize: 803 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.206984 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 941 MB, VmSize: 803 MB, VmRSS: 143 MB, VmData: 172 MB, maxrss: 0.205232 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 940 MB, VmSize: 806 MB, VmRSS: 145 MB, VmData: 171 MB, maxrss: 0.20818 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/tmp-legacysurvey-custom-347738p06597-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/tmp-legacysurvey-custom-347738p06597-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.65 s, CPU: 0.73 s, VmPeak: 1043 MB, VmSize: 1037 MB, VmRSS: 215 MB, VmData: 239 MB, maxrss: 0.220604 MB
Stage wise_forced finished: 2020-08-05T19:03:38.314914
Resources for stage wise_forced : 3.168 s worker CPU, 5.254 s worker Wall, Wall: 2.651 s, Cores in use: 1.47, Total efficiency (on 16 cores): 9.2 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T19:03:38.334026
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/tractor-i/cus/tractor-custom-347738p06597.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/tractor/cus/tractor-custom-347738p06597.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/tractor/cus/brick-custom-347738p06597.sha256sum
Stage writecat : Wall: 1.26 s, CPU: 0.79 s, VmPeak: 1169 MB, VmSize: 1041 MB, VmRSS: 217 MB, VmData: 239 MB, maxrss: 0.353016 MB
Stage writecat finished: 2020-08-05T19:03:39.591491
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.259 s, Cores in use: 0.63, Total efficiency (on 16 cores): 4.0 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1303834/PGC1303834-largegalaxy-writecat.p
All done: 48.326 s worker CPU, 321.767 s worker Wall, Wall: 92.420 s, Cores in use: 0.66, Total efficiency (on 16 cores): 4.1 %
Finished galaxy PGC1303834 in 1.644 minutes.
Started working on galaxy PGC1303834 at Mon Aug 10 07:34:47 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.738337412797 6.597696262403913 --width 233 --height 233 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/PGC1303834-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/PGC1303834-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-10T07:34:47.965597
legacypipe git version: DR9.5.11-watershed-6-g6a2880fc
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '347.738337412797', '6.597696262403913', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/PGC1303834-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/PGC1303834-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.738337412797 6.597696262403913 --width 233 --height 233 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/PGC1303834-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/PGC1303834-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 347.738337412797 6.597696262403913
Starting process 35567 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 35568 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 35569 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 35570 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 35571 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB
Starting process 35572 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB
Starting process 35573 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB
Starting process 35574 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-10T07:34:48.367691
Keeping 13 CCDs:
  c4d_170721_064110_ooi_g_ls9-N27 g expnum 660488 exptime 116.0 propid 2014B-0404 seeing 1.23 MJD 57955.277 object DECaLS_39664_g 
    decam/CP/V4.8.2/CP20170720/c4d_170721_064110_ooi_g_ls9.fits.fz
  c4d_170721_063843_ooi_r_ls9-N27 r expnum 660487 exptime 74.0 propid 2014B-0404 seeing 1.06 MJD 57955.275 object DECaLS_39664_r 
    decam/CP/V4.8.2/CP20170720/c4d_170721_063843_ooi_r_ls9.fits.fz
  c4d_140815_080641_ooi_z_ls9-N27 z expnum 348051 exptime 145.0 propid 2014B-0404 seeing 0.88 MJD 56884.336 object DECaLS_39664_z 
    decam/CP/V4.8.2a/CP20140814/c4d_140815_080641_ooi_z_ls9.fits.fz
  c4d_170801_034558_ooi_z_ls9-N28 z expnum 663678 exptime 106.0 propid 2014B-0404 seeing 1.84 MJD 57966.155 object DECaLS_23792_z 
    decam/CP/V4.8.2/CP20170731/c4d_170801_034558_ooi_z_ls9.fits.fz
  c4d_180915_030915_ooi_z_ls9-N28 z expnum 773683 exptime 86.0 propid 2014B-0404 seeing 1.69 MJD 58376.131 object DECaLS_23792_z 
    decam/CP/V4.8.2a/CP20180914/c4d_180915_030915_ooi_z_ls9.fits.fz
  c4d_170916_044446_ooi_r_ls9-N28 r expnum 678023 exptime 72.0 propid 2014B-0404 seeing 1.20 MJD 58012.198 object DECaLS_23792_r 
    decam/CP/V4.8.2a/CP20170915/c4d_170916_044446_ooi_r_ls9.fits.fz
  c4d_170821_050553_ooi_g_ls9-N28 g expnum 669961 exptime 199.0 propid 2014B-0404 seeing 1.51 MJD 57986.212 object DECaLS_23792_g 
    decam/CP/V4.8.2a/CP20170820/c4d_170821_050553_ooi_g_ls9.fits.fz
  c4d_170801_065120_ooi_g_ls9-S25 g expnum 663746 exptime 198.0 propid 2014B-0404 seeing 1.83 MJD 57966.283 object DECaLS_23806_g 
    decam/CP/V4.8.2a/CP20170731/c4d_170801_065120_ooi_g_ls9.fits.fz
  c4d_180902_031455_ooi_r_ls9-S25 r expnum 767887 exptime 68.0 propid 2014B-0404 seeing 1.55 MJD 58363.135 object DECaLS_23806_r 
    decam/CP/V4.8.2a/CP20180901/c4d_180902_031455_ooi_r_ls9.fits.fz
  c4d_160813_054711_ooi_z_ls9-S25 z expnum 563585 exptime 92.0 propid 2014B-0404 seeing 0.86 MJD 57613.239 object DECaLS_23806_z 
    decam/CP/V4.8.2a/CP20160812/c4d_160813_054711_ooi_z_ls9.fits.fz
  c4d_170730_060231_ooi_g_ls9-S26 g expnum 663315 exptime 104.0 propid 2014B-0404 seeing 1.30 MJD 57964.250 object DECaLS_7934_g 
    decam/CP/V4.8.2a/CP20170729/c4d_170730_060231_ooi_g_ls9.fits.fz
  c4d_180916_031231_ooi_z_ls9-S26 z expnum 774205 exptime 80.0 propid 2014B-0404 seeing 1.39 MJD 58377.134 object DECaLS_7934_z 
    decam/CP/V4.8.2a/CP20180915/c4d_180916_031231_ooi_z_ls9.fits.fz
  c4d_180811_051548_ooi_r_ls9-S26 r expnum 764175 exptime 40.0 propid 2014B-0404 seeing 1.63 MJD 58341.219 object DECaLS_7934_r 
    decam/CP/V4.8.2a/CP20180810/c4d_180811_051548_ooi_r_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521352-g-20170801T064709_oi[S25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ccd4-g-20170721T063822_oi[N27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522dd2-r-20170916T044446_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951cf8e-r-20170721T063637_oi[N27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95220ee-g-20170821T050553_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954cb27-z-20140815T080321_oi[N27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951a9b6-z-20170801T034320_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e102-z-20180915T030915_oi[N28,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fc69-z-20160813T054449_oi[S25,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180902T031455_oi[S25,noinherit][2046,4094][real]: DECaLS_2380
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9520b9e-g-20170730T055954_oi[S26,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e572-z-20180916T031231_oi[S26,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532014-r-20180811T051548_oi[S26,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 32.30 s, CPU: 0.84 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 178 MB, VmData: 211 MB, maxrss: 0.181804 MB
Stage tims finished: 2020-08-10T07:35:20.670041
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951a9b6-z-20170801T034320_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954cb27-z-20140815T080321_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e102-z-20180915T030915_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ccd4-g-20170721T063822_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fc69-z-20160813T054449_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521352-g-20170801T064709_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180902T031455_oi[S25,noinherit][2046,4094][real]: DECaLS_2380 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951cf8e-r-20170721T063637_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532014-r-20180811T051548_oi[S26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522dd2-r-20170916T044446_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9520b9e-g-20170730T055954_oi[S26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 6.473 s worker CPU, 176.644 s worker Wall, Wall: 32.304 s, Cores in use: 0.23, Total efficiency (on 8 cores): 2.8 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/PGC1303834-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/PGC1303834-largegalaxy-tims.p
Running stage refs
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95220ee-g-20170821T050553_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e572-z-20180916T031231_oi[S26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Running stage refs at 2020-08-10T07:35:20.925114
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05435.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05564.fits
Matched 5 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/metrics/cus/reference-custom-347738p06597.fits
Stage refs : Wall: 13.87 s, CPU: 2.04 s, VmPeak: 1036 MB, VmSize: 1022 MB, VmRSS: 195 MB, VmData: 228 MB, maxrss: 0.20016 MB
Stage refs finished: 2020-08-10T07:35:34.790558
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 13.867 s, Cores in use: 0.15, Total efficiency (on 8 cores): 1.8 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/PGC1303834-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/PGC1303834-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-10T07:35:34.972587
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/metrics/cus/outlier-mask-custom-347738p06597.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/metrics/cus/outliers-pre-custom-347738p06597.jpg
Image c4d_170730_060231_ooi_g_ls9-S26 g : masking 1059 positive outlier pixels and 0 negative outlier pixels
Image c4d_180811_051548_ooi_r_ls9-S26 r : masking 0 positive outlier pixels and 87 negative outlier pixels
Image c4d_140815_080641_ooi_z_ls9-N27 z : masking 109 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/metrics/cus/outlier-mask-custom-347738p06597.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/metrics/cus/outliers-post-custom-347738p06597.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/metrics/cus/outliers-masked-pos-custom-347738p06597.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/metrics/cus/outliers-masked-neg-custom-347738p06597.jpg
Stage outliers : Wall: 1.21 s, CPU: 1.01 s, VmPeak: 1036 MB, VmSize: 1032 MB, VmRSS: 210 MB, VmData: 240 MB, maxrss: 0.214548 MB
Stage outliers finished: 2020-08-10T07:35:36.185950
Resources for stage outliers : 0.778 s worker CPU, 0.780 s worker Wall, Wall: 1.214 s, Cores in use: 1.47, Total efficiency (on 8 cores): 18.4 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/PGC1303834-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/PGC1303834-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-10T07:35:36.349989
Stage halos : Wall: 1.22 s, CPU: 0.34 s, VmPeak: 1036 MB, VmSize: 1032 MB, VmRSS: 210 MB, VmData: 240 MB, maxrss: 0.214796 MB
Stage halos finished: 2020-08-10T07:35:37.572201
Resources for stage halos : 0.390 s worker CPU, 2.318 s worker Wall, Wall: 1.223 s, Cores in use: 0.60, Total efficiency (on 8 cores): 7.5 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/PGC1303834-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/PGC1303834-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-10T07:35:37.718887
PSF sigmas in coadd pixels: ['1.99', '2.46', '2.97', '2.11']
Using average PSF sigma 2.380236398989383
Gaussian PSF norm 0.11851545161381949 vs pixelized 0.09448895
average tim pixel scale / coadd scale: 1.0011870666622105
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.72', '1.95', '2.51', '2.64']
Using average PSF sigma 2.2067927857575897
Gaussian PSF norm 0.12783021296538963 vs pixelized 0.11030052
average tim pixel scale / coadd scale: 1.0011868667122303
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.42', '2.99', '2.75', '1.40', '2.25']
Using average PSF sigma 2.162120572098074
Gaussian PSF norm 0.13047135086464656 vs pixelized 0.109605104
average tim pixel scale / coadd scale: 1.0011696060301865
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.18 s, CPU: 0.17 s, VmPeak: 1036 MB, VmSize: 1032 MB, VmRSS: 211 MB, VmData: 240 MB, maxrss: 0.216388 MB
Stage fit_on_coadds finished: 2020-08-10T07:35:37.899453
Resources for stage fit_on_coadds : 0.166 s worker CPU, 0.166 s worker Wall, Wall: 0.182 s, Cores in use: 1.88, Total efficiency (on 8 cores): 23.5 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/PGC1303834-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/PGC1303834-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-10T07:35:37.963794
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 42 potential peaks
Of 42 potential peaks: 29 in veto map, 4 cut by saddle test, 0 cut by aper test, 9 kept
SED z : 9 new peaks
Found 66 potential peaks
Of 66 potential peaks: 57 in veto map, 5 cut by saddle test, 0 cut by aper test, 4 kept
SED r : 4 new peaks
Found 63 potential peaks
Of 63 potential peaks: 52 in veto map, 7 cut by saddle test, 0 cut by aper test, 4 kept
SED g : 4 new peaks
Found 90 potential peaks
Of 90 potential peaks: 79 in veto map, 9 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 109 potential peaks
Of 109 potential peaks: 99 in veto map, 10 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 19 new sources
Median coadd sky for g : 0.00034321402
Median coadd sky for r : 0.00076279475
Median coadd sky for z : 0.0017109491
Stage srcs : Wall: 0.61 s, CPU: 0.58 s, VmPeak: 1036 MB, VmSize: 1032 MB, VmRSS: 212 MB, VmData: 240 MB, maxrss: 0.21678 MB
Stage srcs finished: 2020-08-10T07:35:38.577272
Resources for stage srcs : 0.076 s worker CPU, 0.076 s worker Wall, Wall: 0.614 s, Cores in use: 1.08, Total efficiency (on 8 cores): 13.5 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/PGC1303834-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/PGC1303834-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-10T07:35:38.588103
Blob 1 of 4, id: 0, sources: 17, size: 218x233, npix 34302, brick X: 15,233, Y: 0,233, one pixel: 47 0
Blob 2 of 4, id: 3, sources: 2, size: 40x47, npix 1244, brick X: 193,233, Y: 186,233, one pixel: 224 186
Blob 3 of 4, id: 2, sources: 2, size: 23x26, npix 392, brick X: 0,23, Y: 91,117, one pixel: 9 91
Blob 4 of 4, id: 1, sources: 1, size: 22x25, npix 369, brick X: 211,233, Y: 1,26, one pixel: 222 1
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (347.75301, 6.59698), pm (-1.1, -5.3), parallax 0.638 with NanoMaggies: g=16.1, r=15.6, z=15.5
Reset brightness to NanoMaggies: g=16.1, r=15.6, z=15.5
Blob 4 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 959 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145264 MB
Blob 3 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 959 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144368 MB
Blob 2 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 941 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145184 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.856591, ee1=0.0865599, ee2=0.0991386
Measuring 2 iterative sources
Blob 1 finished, total: Wall: 16.07 s, CPU: 16.07 s, VmPeak: 967 MB, VmSize: 729 MB, VmRSS: 153 MB, VmData: 184 MB, maxrss: 0.15678 MB
Old catalog: 25
New catalog: 19
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/metrics/cus/blobs-custom-347738p06597.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/metrics/cus/all-models-custom-347738p06597.fits
Stage fitblobs : Wall: 16.48 s, CPU: 0.36 s, VmPeak: 1036 MB, VmSize: 1027 MB, VmRSS: 208 MB, VmData: 235 MB, maxrss: 0.21738 MB
Stage fitblobs finished: 2020-08-10T07:35:55.065117
Resources for stage fitblobs : 17.519 s worker CPU, 17.557 s worker Wall, Wall: 16.478 s, Cores in use: 1.09, Total efficiency (on 8 cores): 13.6 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/PGC1303834-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/PGC1303834-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-10T07:35:55.076471
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/tmp-legacysurvey-custom-347738p06597-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/tmp-legacysurvey-custom-347738p06597-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/tmp-legacysurvey-custom-347738p06597-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/tmp-legacysurvey-custom-347738p06597-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-resid.jpg
Stage coadds : Wall: 1.33 s, CPU: 0.63 s, VmPeak: 1036 MB, VmSize: 1027 MB, VmRSS: 209 MB, VmData: 235 MB, maxrss: 0.21738 MB
Stage coadds finished: 2020-08-10T07:35:56.406848
Resources for stage coadds : 3.671 s worker CPU, 4.360 s worker Wall, Wall: 1.331 s, Cores in use: 3.23, Total efficiency (on 8 cores): 40.4 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/PGC1303834-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/PGC1303834-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-10T07:35:56.419091
Cut to 1 unWISE tiles
Reading WISE tile 3478p060 band 1
Reading WISE tile 3478p060 band 2
Reading WISE tile 3478p060 band 3
Reading WISE tile 3478p060 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 969 MB, VmSize: 801 MB, VmRSS: 144 MB, VmData: 176 MB, maxrss: 0.184708 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 941 MB, VmSize: 864 MB, VmRSS: 206 MB, VmData: 235 MB, maxrss: 0.210548 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 971 MB, VmSize: 798 MB, VmRSS: 142 MB, VmData: 174 MB, maxrss: 0.205736 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 959 MB, VmSize: 803 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.207448 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/tmp-legacysurvey-custom-347738p06597-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/tmp-legacysurvey-custom-347738p06597-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 4.06 s, CPU: 0.67 s, VmPeak: 1036 MB, VmSize: 1027 MB, VmRSS: 209 MB, VmData: 235 MB, maxrss: 0.21738 MB
Stage wise_forced finished: 2020-08-10T07:36:00.478480
Resources for stage wise_forced : 3.175 s worker CPU, 6.988 s worker Wall, Wall: 4.060 s, Cores in use: 0.95, Total efficiency (on 8 cores): 11.8 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/PGC1303834-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/PGC1303834-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-10T07:36:00.490166
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/coadd/cus/custom-347738p06597/legacysurvey-custom-347738p06597-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/tractor-i/cus/tractor-custom-347738p06597.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/tractor/cus/tractor-custom-347738p06597.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/tractor/cus/brick-custom-347738p06597.sha256sum
Stage writecat : Wall: 0.95 s, CPU: 0.61 s, VmPeak: 1160 MB, VmSize: 1032 MB, VmRSS: 211 MB, VmData: 235 MB, maxrss: 0.347224 MB
Stage writecat finished: 2020-08-10T07:36:01.444289
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.955 s, Cores in use: 0.65, Total efficiency (on 8 cores): 8.1 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/PGC1303834-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1303834/PGC1303834-largegalaxy-writecat.p
All done: 32.250 s worker CPU, 208.891 s worker Wall, Wall: 73.093 s, Cores in use: 0.54, Total efficiency (on 8 cores): 6.8 %
Finished galaxy PGC1303834 in 1.244 minutes.