Started working on galaxy PGC1538003 at Wed Aug  5 19:25:59 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 26.346718499999998 17.6504185 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T19:26:05.125153
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '26.346718499999998', '17.6504185', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 26.346718499999998 17.6504185 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 26.346718499999998 17.6504185
Starting process 15353 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 15354 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 15355 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 15356 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 15357 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059344 MB
Starting process 15359 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059352 MB
Starting process 15360 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059352 MB
Starting process 15361 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 15362 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 15364 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 15365 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 15367 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 15368 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 15366 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 15369 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 15370 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T19:26:05.882631
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 9 CCDs:
  c4d_181007_033955_ooi_r_ls9-S21 r expnum 781344 exptime 61.0 propid 2014B-0404 seeing 1.18 MJD 58398.153 object DECaLS_34050_r 
    decam/CP/V4.8.2a/CP20181006/c4d_181007_033955_ooi_r_ls9.fits.fz
  c4d_181007_033723_ooi_g_ls9-S21 g expnum 781343 exptime 124.0 propid 2014B-0404 seeing 1.40 MJD 58398.151 object DECaLS_34050_g 
    decam/CP/V4.8.2a/CP20181006/c4d_181007_033723_ooi_g_ls9.fits.fz
  c4d_180903_084628_ooi_z_ls9-S21 z expnum 768465 exptime 80.0 propid 2014B-0404 seeing 1.32 MJD 58364.366 object DECaLS_34050_z 
    decam/CP/V4.8.2a/CP20180902/c4d_180903_084628_ooi_z_ls9.fits.fz
  c4d_180808_090158_ooi_g_ls9-S22 g expnum 762964 exptime 164.0 propid 2014B-0404 seeing 1.33 MJD 58338.376 object DECaLS_18178_g 
    decam/CP/V4.8.2a/CP20180807/c4d_180808_090158_ooi_g_ls9.fits.fz
  c4d_180726_095649_ooi_z_ls9-S22 z expnum 759206 exptime 189.0 propid 2014B-0404 seeing 1.27 MJD 58325.414 object DECaLS_18178_z 
    decam/CP/V4.8.2a/CP20180725/c4d_180726_095649_ooi_z_ls9.fits.fz
  c4d_170922_072035_ooi_r_ls9-S22 r expnum 680210 exptime 109.0 propid 2014B-0404 seeing 1.32 MJD 58018.306 object DECaLS_18178_r 
    decam/CP/V4.8.2a/CP20170921/c4d_170922_072035_ooi_r_ls9.fits.fz
  c4d_160812_094453_ooi_g_ls9-S28 g expnum 563286 exptime 157.0 propid 2014B-0404 seeing 1.54 MJD 57612.404 object DECaLS_2306_g 
    decam/CP/V4.8.2a/CP20160811/c4d_160812_094453_ooi_g_ls9.fits.fz
  c4d_171112_031620_ooi_r_ls9-S28 r expnum 695331 exptime 95.0 propid 2014B-0404 seeing 1.05 MJD 58069.136 object DECaLS_2306_r 
    decam/CP/V4.8.2a/CP20171111/c4d_171112_031620_ooi_r_ls9.fits.fz
  c4d_140812_092117_ooi_z_ls9-S28 z expnum 347137 exptime 133.0 propid 2014B-0404 seeing 1.33 MJD 56881.388 object DECaLS_2306_z 
    decam/CP/V4.8.2a/CP20140811/c4d_140812_092117_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b048-z-20140812T091812_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953138d-g-20180808T090158_oi[S22,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9526fce-r-20171112T031620_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955edcd-z-20180726T095649_oi[S22,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953739a-g-20181007T033723_oi[S21,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95618a0-g-20160812T094126_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536bf1-r-20181007T033955_oi[S21,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-z-20180903T084628_oi[S21,noinherit][2046,4094][real]: DECaLS_3405
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524d58-r-20170922T072035_oi[S22,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 49.12 s, CPU: 2.17 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 177 MB, VmData: 209 MB, maxrss: 0.18112 MB
Stage tims finished: 2020-08-05T19:26:55.004296
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953138d-g-20180808T090158_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b048-z-20140812T091812_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-z-20180903T084628_oi[S21,noinherit][2046,4094][real]: DECaLS_3405 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95618a0-g-20160812T094126_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953739a-g-20181007T033723_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536bf1-r-20181007T033955_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955edcd-z-20180726T095649_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9526fce-r-20171112T031620_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524d58-r-20170922T072035_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 5.541 s worker CPU, 186.409 s worker Wall, Wall: 49.124 s, Cores in use: 0.16, Total efficiency (on 16 cores): 1.0 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-05T19:26:55.230004
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04169.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04297.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04170.fits
Matched 3 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/metrics/cus/reference-custom-026346p17650.fits
Stage refs : Wall: 17.82 s, CPU: 3.07 s, VmPeak: 1042 MB, VmSize: 1025 MB, VmRSS: 191 MB, VmData: 223 MB, maxrss: 0.196068 MB
Stage refs finished: 2020-08-05T19:27:13.048930
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 17.821 s, Cores in use: 0.17, Total efficiency (on 16 cores): 1.1 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T19:27:13.075935
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/metrics/cus/outlier-mask-custom-026346p17650.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/metrics/cus/outliers-pre-custom-026346p17650.jpg
Image c4d_181007_033723_ooi_g_ls9-S21 g : masking 335 positive outlier pixels and 0 negative outlier pixels
Image c4d_180808_090158_ooi_g_ls9-S22 g : masking 348 positive outlier pixels and 0 negative outlier pixels
Image c4d_160812_094453_ooi_g_ls9-S28 g : masking 254 positive outlier pixels and 0 negative outlier pixels
Image c4d_171112_031620_ooi_r_ls9-S28 r : masking 486 positive outlier pixels and 0 negative outlier pixels
Image c4d_180726_095649_ooi_z_ls9-S22 z : masking 293 positive outlier pixels and 0 negative outlier pixels
Image c4d_140812_092117_ooi_z_ls9-S28 z : masking 282 positive outlier pixels and 0 negative outlier pixels
Image c4d_180903_084628_ooi_z_ls9-S21 z : masking 750 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/metrics/cus/outlier-mask-custom-026346p17650.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/metrics/cus/outliers-post-custom-026346p17650.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/metrics/cus/outliers-masked-pos-custom-026346p17650.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/metrics/cus/outliers-masked-neg-custom-026346p17650.jpg
Stage outliers : Wall: 1.67 s, CPU: 1.33 s, VmPeak: 1042 MB, VmSize: 1034 MB, VmRSS: 205 MB, VmData: 233 MB, maxrss: 0.210396 MB
Stage outliers finished: 2020-08-05T19:27:14.742031
Resources for stage outliers : 0.772 s worker CPU, 0.906 s worker Wall, Wall: 1.668 s, Cores in use: 1.26, Total efficiency (on 16 cores): 7.9 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T19:27:14.768272
Stage halos : Wall: 0.59 s, CPU: 0.59 s, VmPeak: 1042 MB, VmSize: 1035 MB, VmRSS: 206 MB, VmData: 234 MB, maxrss: 0.210632 MB
Stage halos finished: 2020-08-05T19:27:15.355832
Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.589 s, Cores in use: 1.00, Total efficiency (on 16 cores): 6.2 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T19:27:15.456266
PSF sigmas in coadd pixels: ['2.28', '2.17', '2.50']
Using average PSF sigma 2.314632844716215
Gaussian PSF norm 0.12187453073511721 vs pixelized 0.10840293
average tim pixel scale / coadd scale: 1.0012656220106961
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.92', '2.15', '1.70']
Using average PSF sigma 1.9236228584739374
Gaussian PSF norm 0.14664766044507896 vs pixelized 0.12069979
average tim pixel scale / coadd scale: 1.0012368958635356
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.14', '2.06', '2.16']
Using average PSF sigma 2.121100404142215
Gaussian PSF norm 0.1329945490666006 vs pixelized 0.11010377
average tim pixel scale / coadd scale: 1.0012167342405283
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.15 s, CPU: 0.14 s, VmPeak: 1042 MB, VmSize: 1035 MB, VmRSS: 207 MB, VmData: 234 MB, maxrss: 0.212476 MB
Stage fit_on_coadds finished: 2020-08-05T19:27:15.610701
Resources for stage fit_on_coadds : 0.181 s worker CPU, 0.181 s worker Wall, Wall: 0.156 s, Cores in use: 2.06, Total efficiency (on 16 cores): 12.9 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T19:27:15.623391
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 53 potential peaks
Of 53 potential peaks: 27 in veto map, 6 cut by saddle test, 0 cut by aper test, 20 kept
SED z : 20 new peaks
Found 69 potential peaks
Of 69 potential peaks: 58 in veto map, 8 cut by saddle test, 0 cut by aper test, 3 kept
SED r : 3 new peaks
Found 51 potential peaks
Of 51 potential peaks: 44 in veto map, 7 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 73 potential peaks
Of 73 potential peaks: 61 in veto map, 10 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 90 potential peaks
Of 90 potential peaks: 78 in veto map, 10 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 27 new sources
Median coadd sky for g : 0.00016893377
Median coadd sky for r : 0.00043896228
Median coadd sky for z : 0.0008473625
Stage srcs : Wall: 0.64 s, CPU: 0.62 s, VmPeak: 1042 MB, VmSize: 1035 MB, VmRSS: 208 MB, VmData: 234 MB, maxrss: 0.213012 MB
Stage srcs finished: 2020-08-05T19:27:16.268288
Resources for stage srcs : 0.067 s worker CPU, 0.067 s worker Wall, Wall: 0.646 s, Cores in use: 1.06, Total efficiency (on 16 cores): 6.6 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T19:27:16.281134
Blob 1 of 10, id: 5, sources: 20, size: 245x199, npix 26482, brick X: 0,245, Y: 32,231, one pixel: 233 32
Blob 2 of 10, id: 2, sources: 3, size: 61x44, npix 1304, brick X: 162,223, Y: 0,44, one pixel: 166 0
Blob 3 of 10, id: 4, sources: 1, size: 32x47, npix 1110, brick X: 0,32, Y: 22,69, one pixel: 6 22
Blob 4 of 10, id: 0, sources: 1, size: 32x34, npix 562, brick X: 93,125, Y: 0,34, one pixel: 98 0
Blob 5 of 10, id: 1, sources: 1, size: 31x29, npix 520, brick X: 131,162, Y: 0,29, one pixel: 148 0
Blob 6 of 10, id: 8, sources: 1, size: 27x28, npix 496, brick X: 194,221, Y: 164,192, one pixel: 204 164
Blob 7 of 10, id: 9, sources: 1, size: 23x27, npix 425, brick X: 0,23, Y: 217,244, one pixel: 9 217
Blob 8 of 10, id: 6, sources: 1, size: 15x24, npix 246, brick X: 0,15, Y: 110,134, one pixel: 4 110
Blob 9 of 10, id: 7, sources: 1, size: 20x19, npix 218, brick X: 1,21, Y: 152,171, one pixel: 10 152
Blob 10 of 10, id: 3, sources: 1, size: 18x20, npix 207, brick X: 32,50, Y: 14,34, one pixel: 40 14
Blob 10 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 956 MB, VmSize: 731 MB, VmRSS: 144 MB, VmData: 180 MB, maxrss: 0.147904 MB
Blob 9 finished, total: Wall: 0.06 s, CPU: 0.05 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 86 MB, VmData: 139 MB, maxrss: 0.088528 MB
Measuring 1 iterative sources
Blob 5 finished, total: Wall: 0.49 s, CPU: 0.49 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.09268 MB
Blob 7 finished, total: Wall: 0.53 s, CPU: 0.52 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093208 MB
Blob 4 finished, total: Wall: 0.65 s, CPU: 0.64 s, VmPeak: 957 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147588 MB
Blob 6 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147844 MB
Blob 8 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147548 MB
Blob 3 finished, total: Wall: 1.09 s, CPU: 1.08 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.093876 MB
Blob 2 finished, total: Wall: 1.26 s, CPU: 1.26 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147516 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.66911, ee1=-0.0213552, ee2=0.182103
Measuring 21 iterative sources
Blob 1 finished, total: Wall: 33.17 s, CPU: 33.16 s, VmPeak: 708 MB, VmSize: 705 MB, VmRSS: 138 MB, VmData: 176 MB, maxrss: 0.141572 MB
Old catalog: 31
New catalog: 45
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/metrics/cus/blobs-custom-026346p17650.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/metrics/cus/all-models-custom-026346p17650.fits
Stage fitblobs : Wall: 34.09 s, CPU: 0.53 s, VmPeak: 1042 MB, VmSize: 1035 MB, VmRSS: 209 MB, VmData: 235 MB, maxrss: 0.213968 MB
Stage fitblobs finished: 2020-08-05T19:27:50.366645
Resources for stage fitblobs : 38.883 s worker CPU, 38.961 s worker Wall, Wall: 34.087 s, Cores in use: 1.16, Total efficiency (on 16 cores): 7.2 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T19:27:50.400083
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/tmp-legacysurvey-custom-026346p17650-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/tmp-legacysurvey-custom-026346p17650-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/tmp-legacysurvey-custom-026346p17650-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/tmp-legacysurvey-custom-026346p17650-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-resid.jpg
Stage coadds : Wall: 5.03 s, CPU: 2.04 s, VmPeak: 1042 MB, VmSize: 1035 MB, VmRSS: 209 MB, VmData: 235 MB, maxrss: 0.214484 MB
Stage coadds finished: 2020-08-05T19:27:55.431914
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 12.749 s worker CPU, 20.423 s worker Wall, Wall: 5.033 s, Cores in use: 2.94, Total efficiency (on 16 cores): 18.4 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T19:27:55.485525
Cut to 1 unWISE tiles
Reading WISE tile 0269p181 band 2
Reading WISE tile 0269p181 band 1
Reading WISE tile 0269p181 band 4
Reading WISE tile 0269p181 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 956 MB, VmSize: 809 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.211348 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 957 MB, VmSize: 810 MB, VmRSS: 150 MB, VmData: 175 MB, maxrss: 0.195484 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 955 MB, VmSize: 805 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.206476 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 955 MB, VmSize: 805 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.206704 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/tmp-legacysurvey-custom-026346p17650-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/tmp-legacysurvey-custom-026346p17650-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 6.53 s, CPU: 3.08 s, VmPeak: 1042 MB, VmSize: 1035 MB, VmRSS: 210 MB, VmData: 235 MB, maxrss: 0.215188 MB
Stage wise_forced finished: 2020-08-05T19:28:02.019997
Resources for stage wise_forced : 3.486 s worker CPU, 8.255 s worker Wall, Wall: 6.536 s, Cores in use: 1.00, Total efficiency (on 16 cores): 6.3 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T19:28:02.039768
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/tractor-i/cus/tractor-custom-026346p17650.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/tractor/cus/tractor-custom-026346p17650.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/tractor/cus/brick-custom-026346p17650.sha256sum
Stage writecat : Wall: 1.66 s, CPU: 1.42 s, VmPeak: 1167 MB, VmSize: 1039 MB, VmRSS: 212 MB, VmData: 235 MB, maxrss: 0.348064 MB
Stage writecat finished: 2020-08-05T19:28:03.702184
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.664 s, Cores in use: 0.86, Total efficiency (on 16 cores): 5.4 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-writecat.p
All done: 61.682 s worker CPU, 255.205 s worker Wall, Wall: 117.846 s, Cores in use: 0.65, Total efficiency (on 16 cores): 4.1 %
Finished galaxy PGC1538003 in 2.072 minutes.
Started working on galaxy PGC1538003 at Wed Aug  5 20:09:23 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 26.346718499999998 17.6504185 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T20:09:25.280060
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '26.346718499999998', '17.6504185', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 26.346718499999998 17.6504185 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 26.346718499999998 17.6504185
Starting process 24837 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 24839 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 24841 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 24843 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 24845 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05934 MB
Starting process 24847 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059328 MB
Starting process 24849 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059328 MB
Starting process 24851 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 24853 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 24855 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 24857 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 24859 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 24861 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 24863 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 24865 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 24867 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 24871 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 24872 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 24873 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 24874 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 24875 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 24877 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 24878 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 24876 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 24880 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 24881 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 24883 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 24884 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 24885 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 24886 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 24887 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 24888 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T20:09:27.259229
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 9 CCDs:
  c4d_181007_033955_ooi_r_ls9-S21 r expnum 781344 exptime 61.0 propid 2014B-0404 seeing 1.18 MJD 58398.153 object DECaLS_34050_r 
    decam/CP/V4.8.2a/CP20181006/c4d_181007_033955_ooi_r_ls9.fits.fz
  c4d_181007_033723_ooi_g_ls9-S21 g expnum 781343 exptime 124.0 propid 2014B-0404 seeing 1.40 MJD 58398.151 object DECaLS_34050_g 
    decam/CP/V4.8.2a/CP20181006/c4d_181007_033723_ooi_g_ls9.fits.fz
  c4d_180903_084628_ooi_z_ls9-S21 z expnum 768465 exptime 80.0 propid 2014B-0404 seeing 1.32 MJD 58364.366 object DECaLS_34050_z 
    decam/CP/V4.8.2a/CP20180902/c4d_180903_084628_ooi_z_ls9.fits.fz
  c4d_180808_090158_ooi_g_ls9-S22 g expnum 762964 exptime 164.0 propid 2014B-0404 seeing 1.33 MJD 58338.376 object DECaLS_18178_g 
    decam/CP/V4.8.2a/CP20180807/c4d_180808_090158_ooi_g_ls9.fits.fz
  c4d_180726_095649_ooi_z_ls9-S22 z expnum 759206 exptime 189.0 propid 2014B-0404 seeing 1.27 MJD 58325.414 object DECaLS_18178_z 
    decam/CP/V4.8.2a/CP20180725/c4d_180726_095649_ooi_z_ls9.fits.fz
  c4d_170922_072035_ooi_r_ls9-S22 r expnum 680210 exptime 109.0 propid 2014B-0404 seeing 1.32 MJD 58018.306 object DECaLS_18178_r 
    decam/CP/V4.8.2a/CP20170921/c4d_170922_072035_ooi_r_ls9.fits.fz
  c4d_160812_094453_ooi_g_ls9-S28 g expnum 563286 exptime 157.0 propid 2014B-0404 seeing 1.54 MJD 57612.404 object DECaLS_2306_g 
    decam/CP/V4.8.2a/CP20160811/c4d_160812_094453_ooi_g_ls9.fits.fz
  c4d_171112_031620_ooi_r_ls9-S28 r expnum 695331 exptime 95.0 propid 2014B-0404 seeing 1.05 MJD 58069.136 object DECaLS_2306_r 
    decam/CP/V4.8.2a/CP20171111/c4d_171112_031620_ooi_r_ls9.fits.fz
  c4d_140812_092117_ooi_z_ls9-S28 z expnum 347137 exptime 133.0 propid 2014B-0404 seeing 1.33 MJD 56881.388 object DECaLS_2306_z 
    decam/CP/V4.8.2a/CP20140811/c4d_140812_092117_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536bf1-r-20181007T033955_oi[S21,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9526fce-r-20171112T031620_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-z-20180903T084628_oi[S21,noinherit][2046,4094][real]: DECaLS_3405
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b048-z-20140812T091812_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953138d-g-20180808T090158_oi[S22,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953739a-g-20181007T033723_oi[S21,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95618a0-g-20160812T094126_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955edcd-z-20180726T095649_oi[S22,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524d58-r-20170922T072035_oi[S22,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 53.18 s, CPU: 1.61 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 177 MB, VmData: 209 MB, maxrss: 0.181156 MB
Stage tims finished: 2020-08-05T20:10:20.443145
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536bf1-r-20181007T033955_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b048-z-20140812T091812_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953138d-g-20180808T090158_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9526fce-r-20171112T031620_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95618a0-g-20160812T094126_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524d58-r-20170922T072035_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955edcd-z-20180726T095649_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 5.219 s worker CPU, 255.393 s worker Wall, Wall: 53.187 s, Cores in use: 0.13, Total efficiency (on 32 cores): 0.4 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953739a-g-20181007T033723_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T20:10:20.720529
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04169.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04297.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04170.fits
Matched 3 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/metrics/cus/reference-custom-026346p17650.fits
Stage refs : Wall: 5.47 s, CPU: 1.54 s, VmPeak: 1042 MB, VmSize: 1025 MB, VmRSS: 192 MB, VmData: 223 MB, maxrss: 0.196304 MB
Stage refs finished: 2020-08-05T20:10:26.195492
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-z-20180903T084628_oi[S21,noinherit][2046,4094][real]: DECaLS_3405 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 5.477 s, Cores in use: 0.28, Total efficiency (on 32 cores): 0.9 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T20:10:26.368016
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/metrics/cus/outlier-mask-custom-026346p17650.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/metrics/cus/outliers-pre-custom-026346p17650.jpg
Image c4d_181007_033723_ooi_g_ls9-S21 g : masking 335 positive outlier pixels and 0 negative outlier pixels
Image c4d_180808_090158_ooi_g_ls9-S22 g : masking 348 positive outlier pixels and 0 negative outlier pixels
Image c4d_160812_094453_ooi_g_ls9-S28 g : masking 254 positive outlier pixels and 0 negative outlier pixels
Image c4d_171112_031620_ooi_r_ls9-S28 r : masking 486 positive outlier pixels and 0 negative outlier pixels
Image c4d_180903_084628_ooi_z_ls9-S21 z : masking 750 positive outlier pixels and 0 negative outlier pixels
Image c4d_140812_092117_ooi_z_ls9-S28 z : masking 282 positive outlier pixels and 0 negative outlier pixels
Image c4d_180726_095649_ooi_z_ls9-S22 z : masking 293 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/metrics/cus/outlier-mask-custom-026346p17650.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/metrics/cus/outliers-post-custom-026346p17650.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/metrics/cus/outliers-masked-pos-custom-026346p17650.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/metrics/cus/outliers-masked-neg-custom-026346p17650.jpg
Stage outliers : Wall: 1.99 s, CPU: 1.45 s, VmPeak: 1042 MB, VmSize: 1035 MB, VmRSS: 206 MB, VmData: 234 MB, maxrss: 0.210528 MB
Stage outliers finished: 2020-08-05T20:10:28.362178
Resources for stage outliers : 0.916 s worker CPU, 1.110 s worker Wall, Wall: 1.996 s, Cores in use: 1.19, Total efficiency (on 32 cores): 3.7 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T20:10:28.496992
Stage halos : Wall: 1.20 s, CPU: 1.20 s, VmPeak: 1042 MB, VmSize: 1035 MB, VmRSS: 206 MB, VmData: 234 MB, maxrss: 0.210756 MB
Stage halos finished: 2020-08-05T20:10:29.698487
Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.204 s, Cores in use: 1.00, Total efficiency (on 32 cores): 3.1 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T20:10:29.767692
PSF sigmas in coadd pixels: ['2.28', '2.17', '2.50']
Using average PSF sigma 2.314632844716215
Gaussian PSF norm 0.12187453073511721 vs pixelized 0.10840293
average tim pixel scale / coadd scale: 1.0012656220106961
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.92', '2.15', '1.70']
Using average PSF sigma 1.9236228584739374
Gaussian PSF norm 0.14664766044507896 vs pixelized 0.12069979
average tim pixel scale / coadd scale: 1.0012368958635356
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.14', '2.06', '2.16']
Using average PSF sigma 2.121100404142215
Gaussian PSF norm 0.1329945490666006 vs pixelized 0.11010376
average tim pixel scale / coadd scale: 1.0012167342405283
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.16 s, CPU: 0.14 s, VmPeak: 1042 MB, VmSize: 1035 MB, VmRSS: 208 MB, VmData: 234 MB, maxrss: 0.212484 MB
Stage fit_on_coadds finished: 2020-08-05T20:10:29.923134
Resources for stage fit_on_coadds : 0.166 s worker CPU, 0.166 s worker Wall, Wall: 0.158 s, Cores in use: 1.96, Total efficiency (on 32 cores): 6.1 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T20:10:29.934150
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 53 potential peaks
Of 53 potential peaks: 27 in veto map, 6 cut by saddle test, 0 cut by aper test, 20 kept
SED z : 20 new peaks
Found 69 potential peaks
Of 69 potential peaks: 58 in veto map, 8 cut by saddle test, 0 cut by aper test, 3 kept
SED r : 3 new peaks
Found 51 potential peaks
Of 51 potential peaks: 44 in veto map, 7 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 73 potential peaks
Of 73 potential peaks: 61 in veto map, 10 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 90 potential peaks
Of 90 potential peaks: 78 in veto map, 10 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 27 new sources
Median coadd sky for g : 0.00016893387
Median coadd sky for r : 0.00043896228
Median coadd sky for z : 0.0008473625
Stage srcs : Wall: 1.21 s, CPU: 1.16 s, VmPeak: 1042 MB, VmSize: 1035 MB, VmRSS: 208 MB, VmData: 234 MB, maxrss: 0.21296 MB
Stage srcs finished: 2020-08-05T20:10:31.142368
Resources for stage srcs : 0.074 s worker CPU, 0.074 s worker Wall, Wall: 1.210 s, Cores in use: 1.02, Total efficiency (on 32 cores): 3.2 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T20:10:31.159615
Blob 1 of 10, id: 5, sources: 20, size: 245x199, npix 26482, brick X: 0,245, Y: 32,231, one pixel: 233 32
Blob 2 of 10, id: 2, sources: 3, size: 61x44, npix 1304, brick X: 162,223, Y: 0,44, one pixel: 166 0
Blob 3 of 10, id: 4, sources: 1, size: 32x47, npix 1110, brick X: 0,32, Y: 22,69, one pixel: 6 22
Blob 4 of 10, id: 0, sources: 1, size: 32x34, npix 562, brick X: 93,125, Y: 0,34, one pixel: 98 0
Blob 5 of 10, id: 1, sources: 1, size: 31x29, npix 520, brick X: 131,162, Y: 0,29, one pixel: 148 0
Blob 6 of 10, id: 8, sources: 1, size: 27x28, npix 496, brick X: 194,221, Y: 164,192, one pixel: 204 164
Blob 7 of 10, id: 9, sources: 1, size: 23x27, npix 425, brick X: 0,23, Y: 217,244, one pixel: 9 217
Blob 8 of 10, id: 6, sources: 1, size: 15x24, npix 246, brick X: 0,15, Y: 110,134, one pixel: 4 110
Blob 9 of 10, id: 7, sources: 1, size: 20x19, npix 218, brick X: 1,21, Y: 152,171, one pixel: 10 152
Blob 10 of 10, id: 3, sources: 1, size: 18x20, npix 207, brick X: 32,50, Y: 14,34, one pixel: 40 14
Blob 9 finished, total: Wall: 0.07 s, CPU: 0.06 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 85 MB, VmData: 138 MB, maxrss: 0.087456 MB
Blob 10 finished, total: Wall: 0.08 s, CPU: 0.07 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 85 MB, VmData: 138 MB, maxrss: 0.087268 MB
Measuring 1 iterative sources
Blob 5 finished, total: Wall: 0.43 s, CPU: 0.43 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093176 MB
Blob 7 finished, total: Wall: 0.53 s, CPU: 0.51 s, VmPeak: 951 MB, VmSize: 731 MB, VmRSS: 144 MB, VmData: 180 MB, maxrss: 0.147164 MB
Blob 6 finished, total: Wall: 0.63 s, CPU: 0.61 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148104 MB
Blob 4 finished, total: Wall: 0.68 s, CPU: 0.67 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.094376 MB
Blob 8 finished, total: Wall: 0.75 s, CPU: 0.73 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.093788 MB
Blob 3 finished, total: Wall: 1.07 s, CPU: 1.06 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147372 MB
Blob 2 finished, total: Wall: 1.25 s, CPU: 1.24 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147712 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.66912, ee1=-0.0213551, ee2=0.182103
Measuring 21 iterative sources
Blob 1 finished, total: Wall: 34.01 s, CPU: 33.98 s, VmPeak: 955 MB, VmSize: 746 MB, VmRSS: 166 MB, VmData: 195 MB, maxrss: 0.170328 MB
Old catalog: 31
New catalog: 45
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/metrics/cus/blobs-custom-026346p17650.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/metrics/cus/all-models-custom-026346p17650.fits
Stage fitblobs : Wall: 35.19 s, CPU: 1.14 s, VmPeak: 1042 MB, VmSize: 1035 MB, VmRSS: 209 MB, VmData: 235 MB, maxrss: 0.213916 MB
Stage fitblobs finished: 2020-08-05T20:11:06.347266
Resources for stage fitblobs : 39.493 s worker CPU, 39.931 s worker Wall, Wall: 35.190 s, Cores in use: 1.15, Total efficiency (on 32 cores): 3.6 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T20:11:06.365012
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/tmp-legacysurvey-custom-026346p17650-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/tmp-legacysurvey-custom-026346p17650-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/tmp-legacysurvey-custom-026346p17650-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/tmp-legacysurvey-custom-026346p17650-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-resid.jpg
Stage coadds : Wall: 3.37 s, CPU: 0.76 s, VmPeak: 1042 MB, VmSize: 1035 MB, VmRSS: 209 MB, VmData: 235 MB, maxrss: 0.214432 MB
Stage coadds finished: 2020-08-05T20:11:09.731365
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 30.309 s worker CPU, 51.866 s worker Wall, Wall: 3.369 s, Cores in use: 9.22, Total efficiency (on 32 cores): 28.8 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T20:11:09.817820
Cut to 1 unWISE tiles
Reading WISE tile 0269p181 band 2
Reading WISE tile 0269p181 band 4
Reading WISE tile 0269p181 band 3
Reading WISE tile 0269p181 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 957 MB, VmSize: 805 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.20846 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 955 MB, VmSize: 807 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.191268 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 961 MB, VmSize: 805 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.206372 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 807 MB, VmSize: 807 MB, VmRSS: 148 MB, VmData: 179 MB, maxrss: 0.204408 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/tmp-legacysurvey-custom-026346p17650-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/tmp-legacysurvey-custom-026346p17650-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 5.00 s, CPU: 2.12 s, VmPeak: 1042 MB, VmSize: 1035 MB, VmRSS: 210 MB, VmData: 235 MB, maxrss: 0.215136 MB
Stage wise_forced finished: 2020-08-05T20:11:14.822165
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 3.450 s worker CPU, 7.222 s worker Wall, Wall: 5.007 s, Cores in use: 1.11, Total efficiency (on 32 cores): 3.5 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T20:11:14.842789
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/coadd/cus/custom-026346p17650/legacysurvey-custom-026346p17650-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/tractor-i/cus/tractor-custom-026346p17650.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/tractor/cus/tractor-custom-026346p17650.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/tractor/cus/brick-custom-026346p17650.sha256sum
Stage writecat : Wall: 2.39 s, CPU: 1.44 s, VmPeak: 1167 MB, VmSize: 1039 MB, VmRSS: 212 MB, VmData: 235 MB, maxrss: 0.348016 MB
Stage writecat finished: 2020-08-05T20:11:17.236660
Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 2.396 s, Cores in use: 0.60, Total efficiency (on 32 cores): 1.9 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/026/PGC1538003/PGC1538003-largegalaxy-writecat.p
All done: 79.633 s worker CPU, 355.769 s worker Wall, Wall: 110.010 s, Cores in use: 0.84, Total efficiency (on 32 cores): 2.6 %
Finished galaxy PGC1538003 in 1.900 minutes.
Started working on galaxy PGC1538003 at Mon Aug 10 08:53:06 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 26.347565704894382 17.65088332818286 --width 245 --height 245 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/PGC1538003-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/PGC1538003-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-10T08:53:07.989907
legacypipe git version: DR9.5.11-watershed-6-g6a2880fc
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '26.347565704894382', '17.65088332818286', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/PGC1538003-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/PGC1538003-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 26.347565704894382 17.65088332818286 --width 245 --height 245 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/PGC1538003-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/PGC1538003-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 26.347565704894382 17.65088332818286
Starting process 3370 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059392 MB
Starting process 3371 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059332 MB
Starting process 3372 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059332 MB
Starting process 3373 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059332 MB
Starting process 3374 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 3375 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 3376 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 3377 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-10T08:53:08.420085
Keeping 9 CCDs:
  c4d_181007_033955_ooi_r_ls9-S21 r expnum 781344 exptime 61.0 propid 2014B-0404 seeing 1.18 MJD 58398.153 object DECaLS_34050_r 
    decam/CP/V4.8.2a/CP20181006/c4d_181007_033955_ooi_r_ls9.fits.fz
  c4d_181007_033723_ooi_g_ls9-S21 g expnum 781343 exptime 124.0 propid 2014B-0404 seeing 1.40 MJD 58398.151 object DECaLS_34050_g 
    decam/CP/V4.8.2a/CP20181006/c4d_181007_033723_ooi_g_ls9.fits.fz
  c4d_180903_084628_ooi_z_ls9-S21 z expnum 768465 exptime 80.0 propid 2014B-0404 seeing 1.32 MJD 58364.366 object DECaLS_34050_z 
    decam/CP/V4.8.2a/CP20180902/c4d_180903_084628_ooi_z_ls9.fits.fz
  c4d_180808_090158_ooi_g_ls9-S22 g expnum 762964 exptime 164.0 propid 2014B-0404 seeing 1.33 MJD 58338.376 object DECaLS_18178_g 
    decam/CP/V4.8.2a/CP20180807/c4d_180808_090158_ooi_g_ls9.fits.fz
  c4d_180726_095649_ooi_z_ls9-S22 z expnum 759206 exptime 189.0 propid 2014B-0404 seeing 1.27 MJD 58325.414 object DECaLS_18178_z 
    decam/CP/V4.8.2a/CP20180725/c4d_180726_095649_ooi_z_ls9.fits.fz
  c4d_170922_072035_ooi_r_ls9-S22 r expnum 680210 exptime 109.0 propid 2014B-0404 seeing 1.32 MJD 58018.306 object DECaLS_18178_r 
    decam/CP/V4.8.2a/CP20170921/c4d_170922_072035_ooi_r_ls9.fits.fz
  c4d_160812_094453_ooi_g_ls9-S28 g expnum 563286 exptime 157.0 propid 2014B-0404 seeing 1.54 MJD 57612.404 object DECaLS_2306_g 
    decam/CP/V4.8.2a/CP20160811/c4d_160812_094453_ooi_g_ls9.fits.fz
  c4d_171112_031620_ooi_r_ls9-S28 r expnum 695331 exptime 95.0 propid 2014B-0404 seeing 1.05 MJD 58069.136 object DECaLS_2306_r 
    decam/CP/V4.8.2a/CP20171111/c4d_171112_031620_ooi_r_ls9.fits.fz
  c4d_140812_092117_ooi_z_ls9-S28 z expnum 347137 exptime 133.0 propid 2014B-0404 seeing 1.33 MJD 56881.388 object DECaLS_2306_z 
    decam/CP/V4.8.2a/CP20140811/c4d_140812_092117_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9526fce-r-20171112T031620_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953739a-g-20181007T033723_oi[S21,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536bf1-r-20181007T033955_oi[S21,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955edcd-z-20180726T095649_oi[S22,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-z-20180903T084628_oi[S21,noinherit][2046,4094][real]: DECaLS_3405
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95618a0-g-20160812T094126_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953138d-g-20180808T090158_oi[S22,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b048-z-20140812T091812_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524d58-r-20170922T072035_oi[S22,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 51.41 s, CPU: 0.98 s, VmPeak: 1004 MB, VmSize: 1004 MB, VmRSS: 175 MB, VmData: 209 MB, maxrss: 0.179072 MB
Stage tims finished: 2020-08-10T08:53:59.830817
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953739a-g-20181007T033723_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9526fce-r-20171112T031620_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536bf1-r-20181007T033955_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953138d-g-20180808T090158_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955edcd-z-20180726T095649_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95618a0-g-20160812T094126_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 4.944 s worker CPU, 255.885 s worker Wall, Wall: 51.412 s, Cores in use: 0.12, Total efficiency (on 8 cores): 1.4 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/PGC1538003-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/PGC1538003-largegalaxy-tims.p
Running stage refs
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-z-20180903T084628_oi[S21,noinherit][2046,4094][real]: DECaLS_3405 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b048-z-20140812T091812_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524d58-r-20170922T072035_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Running stage refs at 2020-08-10T08:53:59.962970
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04169.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04297.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04170.fits
Matched 2 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/metrics/cus/reference-custom-026347p17650.fits
Stage refs : Wall: 8.92 s, CPU: 1.58 s, VmPeak: 1035 MB, VmSize: 1018 MB, VmRSS: 190 MB, VmData: 223 MB, maxrss: 0.19442 MB
Stage refs finished: 2020-08-10T08:54:08.882222
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.920 s, Cores in use: 0.18, Total efficiency (on 8 cores): 2.2 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/PGC1538003-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/PGC1538003-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-10T08:54:08.907122
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/metrics/cus/outlier-mask-custom-026347p17650.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/metrics/cus/outliers-pre-custom-026347p17650.jpg
Image c4d_181007_033723_ooi_g_ls9-S21 g : masking 338 positive outlier pixels and 0 negative outlier pixels
Image c4d_180808_090158_ooi_g_ls9-S22 g : masking 194 positive outlier pixels and 0 negative outlier pixels
Image c4d_160812_094453_ooi_g_ls9-S28 g : masking 409 positive outlier pixels and 0 negative outlier pixels
Image c4d_171112_031620_ooi_r_ls9-S28 r : masking 280 positive outlier pixels and 0 negative outlier pixels
Image c4d_180903_084628_ooi_z_ls9-S21 z : masking 1193 positive outlier pixels and 0 negative outlier pixels
Image c4d_180726_095649_ooi_z_ls9-S22 z : masking 143 positive outlier pixels and 0 negative outlier pixels
Image c4d_140812_092117_ooi_z_ls9-S28 z : masking 263 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/metrics/cus/outlier-mask-custom-026347p17650.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/metrics/cus/outliers-post-custom-026347p17650.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/metrics/cus/outliers-masked-pos-custom-026347p17650.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/metrics/cus/outliers-masked-neg-custom-026347p17650.jpg
Stage outliers : Wall: 1.00 s, CPU: 0.76 s, VmPeak: 1035 MB, VmSize: 1028 MB, VmRSS: 203 MB, VmData: 232 MB, maxrss: 0.207632 MB
Stage outliers finished: 2020-08-10T08:54:09.912049
Resources for stage outliers : 0.744 s worker CPU, 0.744 s worker Wall, Wall: 1.006 s, Cores in use: 1.50, Total efficiency (on 8 cores): 18.7 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/PGC1538003-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/PGC1538003-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-10T08:54:10.045485
Stage halos : Wall: 0.56 s, CPU: 0.56 s, VmPeak: 1035 MB, VmSize: 1028 MB, VmRSS: 203 MB, VmData: 233 MB, maxrss: 0.207872 MB
Stage halos finished: 2020-08-10T08:54:10.608354
Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.564 s, Cores in use: 1.00, Total efficiency (on 8 cores): 12.4 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/PGC1538003-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/PGC1538003-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-10T08:54:10.790199
PSF sigmas in coadd pixels: ['2.28', '2.17', '2.50']
Using average PSF sigma 2.314632844716215
Gaussian PSF norm 0.12187453073511721 vs pixelized 0.10840004
average tim pixel scale / coadd scale: 1.0012656220106961
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.92', '2.15', '1.70']
Using average PSF sigma 1.9236228584739374
Gaussian PSF norm 0.14664766044507896 vs pixelized 0.120694585
average tim pixel scale / coadd scale: 1.0012368958635356
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.14', '2.06', '2.16']
Using average PSF sigma 2.121100404142215
Gaussian PSF norm 0.1329945490666006 vs pixelized 0.11011856
average tim pixel scale / coadd scale: 1.0012167342405283
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.18 s, CPU: 0.15 s, VmPeak: 1035 MB, VmSize: 1028 MB, VmRSS: 205 MB, VmData: 233 MB, maxrss: 0.210324 MB
Stage fit_on_coadds finished: 2020-08-10T08:54:10.966615
Resources for stage fit_on_coadds : 0.189 s worker CPU, 0.189 s worker Wall, Wall: 0.177 s, Cores in use: 1.89, Total efficiency (on 8 cores): 23.7 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/PGC1538003-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/PGC1538003-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-10T08:54:10.977402
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 53 potential peaks
Of 53 potential peaks: 27 in veto map, 6 cut by saddle test, 0 cut by aper test, 20 kept
SED z : 20 new peaks
Found 66 potential peaks
Of 66 potential peaks: 57 in veto map, 7 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 49 potential peaks
Of 49 potential peaks: 43 in veto map, 6 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 69 potential peaks
Of 69 potential peaks: 58 in veto map, 10 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 87 potential peaks
Of 87 potential peaks: 75 in veto map, 9 cut by saddle test, 1 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 25 new sources
Median coadd sky for g : 0.00014477801
Median coadd sky for r : 0.00040360168
Median coadd sky for z : 0.0009123314
Stage srcs : Wall: 0.82 s, CPU: 0.79 s, VmPeak: 1035 MB, VmSize: 1028 MB, VmRSS: 206 MB, VmData: 233 MB, maxrss: 0.21098 MB
Stage srcs finished: 2020-08-10T08:54:11.800703
Resources for stage srcs : 0.079 s worker CPU, 0.079 s worker Wall, Wall: 0.824 s, Cores in use: 1.05, Total efficiency (on 8 cores): 13.2 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/PGC1538003-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/PGC1538003-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-10T08:54:11.814825
Blob 1 of 11, id: 5, sources: 18, size: 239x179, npix 24378, brick X: 6,245, Y: 36,215, one pixel: 156 36
Blob 2 of 11, id: 4, sources: 1, size: 43x48, npix 1493, brick X: 0,43, Y: 15,63, one pixel: 17 15
Blob 3 of 11, id: 9, sources: 1, size: 43x45, npix 1401, brick X: 176,219, Y: 179,224, one pixel: 196 179
Blob 4 of 11, id: 3, sources: 2, size: 43x29, npix 745, brick X: 191,234, Y: 9,38, one pixel: 203 9
Blob 5 of 11, id: 8, sources: 1, size: 27x28, npix 487, brick X: 205,232, Y: 157,185, one pixel: 217 157
Blob 6 of 11, id: 6, sources: 1, size: 26x27, npix 478, brick X: 0,26, Y: 102,129, one pixel: 9 102
Blob 7 of 11, id: 10, sources: 1, size: 26x26, npix 451, brick X: 8,34, Y: 211,237, one pixel: 19 211
Blob 8 of 11, id: 0, sources: 1, size: 29x22, npix 388, brick X: 142,171, Y: 0,22, one pixel: 158 0
Blob 9 of 11, id: 1, sources: 1, size: 26x15, npix 278, brick X: 179,205, Y: 0,15, one pixel: 181 0
Measuring 1 iterative sources
Blob 8 finished, total: Wall: 0.36 s, CPU: 0.35 s, VmPeak: 955 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.143924 MB
Blob 10 of 11, id: 7, sources: 1, size: 20x19, npix 218, brick X: 12,32, Y: 146,165, one pixel: 20 146
Blob 7 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 968 MB, VmSize: 725 MB, VmRSS: 140 MB, VmData: 180 MB, maxrss: 0.142848 MB
Blob 11 of 11, id: 2, sources: 1, size: 18x20, npix 207, brick X: 43,61, Y: 8,28, one pixel: 51 8
Blob 10 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 968 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144456 MB
Blob 9 finished, total: Wall: 0.45 s, CPU: 0.45 s, VmPeak: 955 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144172 MB
Blob 5 finished, total: Wall: 0.83 s, CPU: 0.83 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144516 MB
Blob 11 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 968 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144456 MB
Blob 6 finished, total: Wall: 0.90 s, CPU: 0.90 s, VmPeak: 955 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144424 MB
Blob 3 finished, total: Wall: 0.92 s, CPU: 0.92 s, VmPeak: 961 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144352 MB
Blob 4 finished, total: Wall: 0.97 s, CPU: 0.97 s, VmPeak: 951 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.143948 MB
Blob 2 finished, total: Wall: 1.22 s, CPU: 1.22 s, VmPeak: 955 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144076 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.90735, ee1=-0.0697107, ee2=0.164852
Measuring 18 iterative sources
Blob 1 finished, total: Wall: 25.75 s, CPU: 25.74 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 155 MB, VmData: 187 MB, maxrss: 0.159188 MB
Old catalog: 29
New catalog: 38
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/metrics/cus/blobs-custom-026347p17650.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/metrics/cus/all-models-custom-026347p17650.fits
Stage fitblobs : Wall: 26.39 s, CPU: 0.60 s, VmPeak: 1035 MB, VmSize: 1028 MB, VmRSS: 206 MB, VmData: 234 MB, maxrss: 0.211432 MB
Stage fitblobs finished: 2020-08-10T08:54:38.208595
Resources for stage fitblobs : 32.403 s worker CPU, 32.492 s worker Wall, Wall: 26.395 s, Cores in use: 1.25, Total efficiency (on 8 cores): 15.6 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/PGC1538003-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/PGC1538003-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-10T08:54:38.222383
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/tmp-legacysurvey-custom-026347p17650-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/tmp-legacysurvey-custom-026347p17650-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/tmp-legacysurvey-custom-026347p17650-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/tmp-legacysurvey-custom-026347p17650-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-resid.jpg
Stage coadds : Wall: 1.35 s, CPU: 0.56 s, VmPeak: 1035 MB, VmSize: 1028 MB, VmRSS: 207 MB, VmData: 234 MB, maxrss: 0.211948 MB
Stage coadds finished: 2020-08-10T08:54:39.571174
Resources for stage coadds : 3.973 s worker CPU, 4.552 s worker Wall, Wall: 1.350 s, Cores in use: 3.36, Total efficiency (on 8 cores): 42.0 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/PGC1538003-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/PGC1538003-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-10T08:54:39.582819
Cut to 1 unWISE tiles
Reading WISE tile 0269p181 band 1
Reading WISE tile 0269p181 band 2
Reading WISE tile 0269p181 band 3
Reading WISE tile 0269p181 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 951 MB, VmSize: 805 MB, VmRSS: 150 MB, VmData: 176 MB, maxrss: 0.19214 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 956 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.20808 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 955 MB, VmSize: 803 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.209708 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/026/0269p181/unwise-0269p181-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 955 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209592 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/tmp-legacysurvey-custom-026347p17650-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/tmp-legacysurvey-custom-026347p17650-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 4.10 s, CPU: 0.87 s, VmPeak: 1035 MB, VmSize: 1028 MB, VmRSS: 208 MB, VmData: 234 MB, maxrss: 0.212652 MB
Stage wise_forced finished: 2020-08-10T08:54:43.680115
Resources for stage wise_forced : 3.328 s worker CPU, 6.445 s worker Wall, Wall: 4.098 s, Cores in use: 1.02, Total efficiency (on 8 cores): 12.8 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/PGC1538003-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/PGC1538003-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-10T08:54:43.700712
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/coadd/cus/custom-026347p17650/legacysurvey-custom-026347p17650-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/tractor-i/cus/tractor-custom-026347p17650.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/tractor/cus/tractor-custom-026347p17650.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/tractor/cus/brick-custom-026347p17650.sha256sum
Stage writecat : Wall: 0.79 s, CPU: 0.59 s, VmPeak: 1161 MB, VmSize: 1033 MB, VmRSS: 209 MB, VmData: 234 MB, maxrss: 0.345524 MB
Stage writecat finished: 2020-08-10T08:54:44.491105
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.791 s, Cores in use: 0.74, Total efficiency (on 8 cores): 9.3 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/PGC1538003-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/026/PGC1538003/PGC1538003-largegalaxy-writecat.p
All done: 45.661 s worker CPU, 300.387 s worker Wall, Wall: 96.090 s, Cores in use: 0.55, Total efficiency (on 8 cores): 6.9 %
Finished galaxy PGC1538003 in 1.633 minutes.