Started working on galaxy PGC1543589 at Wed Aug  5 20:07:21 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.59755 17.854401 --width 257 --height 257 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T20:07:23.940214
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '323.59755', '17.854401', '--width', '257', '--height', '257', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.59755 17.854401 --width 257 --height 257 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 323.59755 17.854401
Starting process 36054 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 36056 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 36057 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 36058 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 36059 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB
Starting process 36060 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 36061 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 36062 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 36063 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 36065 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 36066 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 36064 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 36067 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 36068 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 36069 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 36070 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T20:07:24.933031
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 9 CCDs:
  c4d_180918_005456_ooi_z_ls9-S15 z expnum 775002 exptime 152.0 propid 2014B-0404 seeing 1.32 MJD 58379.038 object DECaLS_36880_z 
    decam/CP/V4.8.2a/CP20180917/c4d_180918_005456_ooi_z_ls9.fits.fz
  c4d_181002_011347_ooi_r_ls9-S15 r expnum 779833 exptime 87.0 propid 2014B-0404 seeing 1.55 MJD 58393.051 object DECaLS_36880_r 
    decam/CP/V4.8.2a/CP20181001/c4d_181002_011347_ooi_r_ls9.fits.fz
  c4d_160815_043403_ooi_z_ls9-S16 z expnum 564476 exptime 117.0 propid 2014B-0404 seeing 1.27 MJD 57615.188 object DECaLS_21008_z 
    decam/CP/V4.8.2a/CP20160814/c4d_160815_043403_ooi_z_ls9.fits.fz
  c4d_180810_040003_ooi_r_ls9-S16 r expnum 763681 exptime 52.0 propid 2014B-0404 seeing 1.27 MJD 58340.167 object DECaLS_21008_r 
    decam/CP/V4.8.2a/CP20180809/c4d_180810_040003_ooi_r_ls9.fits.fz
  c4d_180810_040123_ooi_g_ls9-S16 g expnum 763682 exptime 169.0 propid 2014B-0404 seeing 1.60 MJD 58340.168 object DECaLS_21008_g 
    decam/CP/V4.8.2a/CP20180809/c4d_180810_040123_ooi_g_ls9.fits.fz
  c4d_160813_035037_ooi_z_ls9-S22 z expnum 563531 exptime 155.0 propid 2014B-0404 seeing 1.08 MJD 57613.158 object DECaLS_5136_z 
    decam/CP/V4.8.2a/CP20160812/c4d_160813_035037_ooi_z_ls9.fits.fz
  c4d_170917_011703_ooi_r_ls9-S22 r expnum 678276 exptime 122.0 propid 2014B-0404 seeing 1.00 MJD 58013.054 object DECaLS_5136_r 
    decam/CP/V4.8.2a/CP20170916/c4d_170917_011703_ooi_r_ls9.fits.fz
  c4d_180518_090325_ooi_g_ls9-S22 g expnum 747475 exptime 200.0 propid 2014B-0404 seeing 1.68 MJD 58256.377 object DECaLS_5136_g 
    decam/CP/V4.8.2a/CP20180517/c4d_180518_090325_ooi_g_ls9.fits.fz
  c4d_181003_004732_ooi_g_ls9-S15 g expnum 780134 exptime 200.0 propid 2014B-0404 seeing 1.28 MJD 58394.033 object DECaLS_36880_g 
    decam/CP/V4.8.2a/CP20181002/c4d_181003_004732_ooi_g_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523600-r-20170917T011703_oi[S22,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95361c2-r-20181002T011347_oi[S15,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536981-g-20181003T004732_oi[S15,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954922e-z-20160813T034712_oi[S22,noinherit][2046,4094][real]: DECaLS_
Clipping 2 pixels with anomalously large oow values: max 0.00141642 vs median 0.000992939
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95478a4-z-20160815T043116_oi[S16,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9531ac3-r-20180810T040003_oi[S16,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9531e27-g-20180810T040123_oi[S16,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530e3b-g-20180518T090325_oi[S22,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f17b-z-20180918T005456_oi[S15,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 80.78 s, CPU: 1.51 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 178 MB, VmData: 209 MB, maxrss: 0.181872 MB
Stage tims finished: 2020-08-05T20:08:45.712904
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95361c2-r-20181002T011347_oi[S15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523600-r-20170917T011703_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9531ac3-r-20180810T040003_oi[S16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954922e-z-20160813T034712_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95478a4-z-20160815T043116_oi[S16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9531e27-g-20180810T040123_oi[S16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f17b-z-20180918T005456_oi[S15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536981-g-20181003T004732_oi[S15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 5.900 s worker CPU, 458.999 s worker Wall, Wall: 80.782 s, Cores in use: 0.09, Total efficiency (on 16 cores): 0.6 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530e3b-g-20180518T090325_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T20:08:45.940145
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04403.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04275.fits
Matched 1 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/metrics/cus/reference-custom-323597p17854.fits
Stage refs : Wall: 10.23 s, CPU: 5.54 s, VmPeak: 1072 MB, VmSize: 1066 MB, VmRSS: 235 MB, VmData: 265 MB, maxrss: 0.240676 MB
Stage refs finished: 2020-08-05T20:08:56.174715
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 10.236 s, Cores in use: 0.54, Total efficiency (on 16 cores): 3.4 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T20:08:56.205596
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/metrics/cus/outlier-mask-custom-323597p17854.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/metrics/cus/outliers-pre-custom-323597p17854.jpg
Image c4d_180518_090325_ooi_g_ls9-S22 g : masking 366 positive outlier pixels and 0 negative outlier pixels
Image c4d_181003_004732_ooi_g_ls9-S15 g : masking 188 positive outlier pixels and 0 negative outlier pixels
Image c4d_181002_011347_ooi_r_ls9-S15 r : masking 0 positive outlier pixels and 235 negative outlier pixels
Image c4d_180810_040003_ooi_r_ls9-S16 r : masking 507 positive outlier pixels and 0 negative outlier pixels
Image c4d_170917_011703_ooi_r_ls9-S22 r : masking 647 positive outlier pixels and 0 negative outlier pixels
Image c4d_160813_035037_ooi_z_ls9-S22 z : masking 315 positive outlier pixels and 0 negative outlier pixels
Image c4d_180918_005456_ooi_z_ls9-S15 z : masking 613 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/metrics/cus/outlier-mask-custom-323597p17854.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/metrics/cus/outliers-post-custom-323597p17854.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/metrics/cus/outliers-masked-pos-custom-323597p17854.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/metrics/cus/outliers-masked-neg-custom-323597p17854.jpg
Stage outliers : Wall: 2.26 s, CPU: 1.85 s, VmPeak: 1076 MB, VmSize: 1076 MB, VmRSS: 248 MB, VmData: 275 MB, maxrss: 0.25444 MB
Stage outliers finished: 2020-08-05T20:08:58.462731
Resources for stage outliers : 0.941 s worker CPU, 1.088 s worker Wall, Wall: 2.259 s, Cores in use: 1.23, Total efficiency (on 16 cores): 7.7 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T20:08:58.485822
Stage halos : Wall: 0.74 s, CPU: 0.55 s, VmPeak: 1076 MB, VmSize: 1076 MB, VmRSS: 249 MB, VmData: 275 MB, maxrss: 0.254804 MB
Stage halos finished: 2020-08-05T20:08:59.223680
Resources for stage halos : 0.725 s worker CPU, 1.157 s worker Wall, Wall: 0.740 s, Cores in use: 1.72, Total efficiency (on 16 cores): 10.8 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T20:08:59.293894
PSF sigmas in coadd pixels: ['2.61', '2.73', '2.08']
Using average PSF sigma 2.4730670879549455
Gaussian PSF norm 0.11406677689732668 vs pixelized 0.10141857
average tim pixel scale / coadd scale: 1.0012118354660124
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.51', '2.06', '1.62']
Using average PSF sigma 2.0634446246787217
Gaussian PSF norm 0.13671061893303793 vs pixelized 0.115031525
average tim pixel scale / coadd scale: 1.0011829760188649
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.15', '2.07', '1.76']
Using average PSF sigma 1.9916369913168885
Gaussian PSF norm 0.14163966275167167 vs pixelized 0.11608212
average tim pixel scale / coadd scale: 1.0011459519475243
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.20 s, CPU: 0.19 s, VmPeak: 1076 MB, VmSize: 1076 MB, VmRSS: 250 MB, VmData: 275 MB, maxrss: 0.256272 MB
Stage fit_on_coadds finished: 2020-08-05T20:08:59.494484
Resources for stage fit_on_coadds : 0.197 s worker CPU, 0.197 s worker Wall, Wall: 0.202 s, Cores in use: 1.92, Total efficiency (on 16 cores): 12.0 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T20:08:59.564908
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 88 potential peaks
Of 88 potential peaks: 56 in veto map, 11 cut by saddle test, 0 cut by aper test, 21 kept
SED z : 21 new peaks
Found 94 potential peaks
Of 94 potential peaks: 77 in veto map, 12 cut by saddle test, 0 cut by aper test, 5 kept
SED r : 5 new peaks
Found 78 potential peaks
Of 78 potential peaks: 69 in veto map, 6 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 105 potential peaks
Of 105 potential peaks: 96 in veto map, 9 cut by saddle test, 0 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 114 potential peaks
Of 114 potential peaks: 101 in veto map, 13 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 29 new sources
Median coadd sky for g : 0.00030292984
Median coadd sky for r : 0.0005103787
Median coadd sky for z : 0.0015698785
Stage srcs : Wall: 0.92 s, CPU: 0.89 s, VmPeak: 1076 MB, VmSize: 1076 MB, VmRSS: 251 MB, VmData: 275 MB, maxrss: 0.256804 MB
Stage srcs finished: 2020-08-05T20:09:00.489824
Resources for stage srcs : 0.097 s worker CPU, 0.097 s worker Wall, Wall: 0.927 s, Cores in use: 1.07, Total efficiency (on 16 cores): 6.7 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T20:09:00.509724
Blob 1 of 4, id: 0, sources: 35, size: 235x257, npix 48323, brick X: 22,257, Y: 0,257, one pixel: 111 0
Blob 2 of 4, id: 2, sources: 3, size: 33x52, npix 885, brick X: 13,46, Y: 15,67, one pixel: 23 15
Blob 3 of 4, id: 3, sources: 1, size: 36x32, npix 662, brick X: 0,36, Y: 64,96, one pixel: 5 64
Blob 4 of 4, id: 1, sources: 1, size: 30x27, npix 543, brick X: 70,100, Y: 10,37, one pixel: 84 10
Blob 4 finished, total: Wall: 0.29 s, CPU: 0.28 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.094572 MB
Blob 3 finished, total: Wall: 0.99 s, CPU: 0.98 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149412 MB
Blob 2 finished, total: Wall: 1.17 s, CPU: 1.16 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.114732 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (323.59350, 17.84251), pm (7.0, -8.3), parallax 2.103 with NanoMaggies: g=12.4, r=11.9, z=11.8
Reset brightness to NanoMaggies: g=12.4, r=11.9, z=11.8
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.6054, ee1=-0.117042, ee2=-0.202228
Measuring 17 iterative sources
Blob 1 finished, total: Wall: 41.95 s, CPU: 41.90 s, VmPeak: 736 MB, VmSize: 732 MB, VmRSS: 167 MB, VmData: 203 MB, maxrss: 0.175468 MB
Old catalog: 42
New catalog: 55
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/metrics/cus/blobs-custom-323597p17854.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/metrics/cus/all-models-custom-323597p17854.fits
Stage fitblobs : Wall: 43.08 s, CPU: 0.68 s, VmPeak: 1076 MB, VmSize: 1076 MB, VmRSS: 252 MB, VmData: 277 MB, maxrss: 0.2582 MB
Stage fitblobs finished: 2020-08-05T20:09:43.594121
Resources for stage fitblobs : 44.400 s worker CPU, 44.558 s worker Wall, Wall: 43.086 s, Cores in use: 1.05, Total efficiency (on 16 cores): 6.5 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T20:09:43.614713
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/tmp-legacysurvey-custom-323597p17854-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/tmp-legacysurvey-custom-323597p17854-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/tmp-legacysurvey-custom-323597p17854-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/tmp-legacysurvey-custom-323597p17854-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-resid.jpg
Stage coadds : Wall: 3.83 s, CPU: 1.22 s, VmPeak: 1076 MB, VmSize: 1076 MB, VmRSS: 252 MB, VmData: 277 MB, maxrss: 0.258524 MB
Stage coadds finished: 2020-08-05T20:09:47.448670
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 12.710 s worker CPU, 19.246 s worker Wall, Wall: 3.835 s, Cores in use: 3.63, Total efficiency (on 16 cores): 22.7 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T20:09:47.462893
Cut to 1 unWISE tiles
Reading WISE tile 3235p181 band 2
Reading WISE tile 3235p181 band 1
Reading WISE tile 3235p181 band 4
Reading WISE tile 3235p181 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 956 MB, VmSize: 806 MB, VmRSS: 146 MB, VmData: 176 MB, maxrss: 0.191428 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 955 MB, VmSize: 805 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.207812 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 956 MB, VmSize: 805 MB, VmRSS: 149 MB, VmData: 174 MB, maxrss: 0.212172 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 962 MB, VmSize: 805 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.207512 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/tmp-legacysurvey-custom-323597p17854-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/tmp-legacysurvey-custom-323597p17854-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.62 s, CPU: 1.30 s, VmPeak: 1076 MB, VmSize: 1076 MB, VmRSS: 253 MB, VmData: 277 MB, maxrss: 0.259036 MB
Stage wise_forced finished: 2020-08-05T20:09:51.078571
Resources for stage wise_forced : 3.398 s worker CPU, 6.329 s worker Wall, Wall: 3.617 s, Cores in use: 1.30, Total efficiency (on 16 cores): 8.1 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T20:09:51.138246
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/tractor-i/cus/tractor-custom-323597p17854.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/tractor/cus/tractor-custom-323597p17854.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/tractor/cus/brick-custom-323597p17854.sha256sum
Stage writecat : Wall: 2.53 s, CPU: 1.23 s, VmPeak: 1208 MB, VmSize: 1080 MB, VmRSS: 255 MB, VmData: 277 MB, maxrss: 0.391912 MB
Stage writecat finished: 2020-08-05T20:09:53.667447
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.531 s, Cores in use: 0.49, Total efficiency (on 16 cores): 3.0 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-writecat.p
All done: 68.372 s worker CPU, 531.675 s worker Wall, Wall: 148.760 s, Cores in use: 0.56, Total efficiency (on 16 cores): 3.5 %
Finished galaxy PGC1543589 in 2.551 minutes.
Started working on galaxy PGC1543589 at Wed Aug  5 21:29:01 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.59755 17.854401 --width 257 --height 257 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T21:29:02.849025
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '323.59755', '17.854401', '--width', '257', '--height', '257', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.59755 17.854401 --width 257 --height 257 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 323.59755 17.854401
Starting process 51484 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 51485 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 51486 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 51487 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 51488 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB
Starting process 51489 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 51490 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 51491 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 51492 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 51493 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 51494 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 51495 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 51496 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 51497 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 51498 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 51499 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 51500 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 51501 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 51502 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 51503 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 51504 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 51505 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 51506 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 51507 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 51508 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 51509 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 51510 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 51511 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 51512 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 51513 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 51514 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 51515 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T21:29:07.021503
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 9 CCDs:
  c4d_180918_005456_ooi_z_ls9-S15 z expnum 775002 exptime 152.0 propid 2014B-0404 seeing 1.32 MJD 58379.038 object DECaLS_36880_z 
    decam/CP/V4.8.2a/CP20180917/c4d_180918_005456_ooi_z_ls9.fits.fz
  c4d_181002_011347_ooi_r_ls9-S15 r expnum 779833 exptime 87.0 propid 2014B-0404 seeing 1.55 MJD 58393.051 object DECaLS_36880_r 
    decam/CP/V4.8.2a/CP20181001/c4d_181002_011347_ooi_r_ls9.fits.fz
  c4d_160815_043403_ooi_z_ls9-S16 z expnum 564476 exptime 117.0 propid 2014B-0404 seeing 1.27 MJD 57615.188 object DECaLS_21008_z 
    decam/CP/V4.8.2a/CP20160814/c4d_160815_043403_ooi_z_ls9.fits.fz
  c4d_180810_040003_ooi_r_ls9-S16 r expnum 763681 exptime 52.0 propid 2014B-0404 seeing 1.27 MJD 58340.167 object DECaLS_21008_r 
    decam/CP/V4.8.2a/CP20180809/c4d_180810_040003_ooi_r_ls9.fits.fz
  c4d_180810_040123_ooi_g_ls9-S16 g expnum 763682 exptime 169.0 propid 2014B-0404 seeing 1.60 MJD 58340.168 object DECaLS_21008_g 
    decam/CP/V4.8.2a/CP20180809/c4d_180810_040123_ooi_g_ls9.fits.fz
  c4d_160813_035037_ooi_z_ls9-S22 z expnum 563531 exptime 155.0 propid 2014B-0404 seeing 1.08 MJD 57613.158 object DECaLS_5136_z 
    decam/CP/V4.8.2a/CP20160812/c4d_160813_035037_ooi_z_ls9.fits.fz
  c4d_170917_011703_ooi_r_ls9-S22 r expnum 678276 exptime 122.0 propid 2014B-0404 seeing 1.00 MJD 58013.054 object DECaLS_5136_r 
    decam/CP/V4.8.2a/CP20170916/c4d_170917_011703_ooi_r_ls9.fits.fz
  c4d_180518_090325_ooi_g_ls9-S22 g expnum 747475 exptime 200.0 propid 2014B-0404 seeing 1.68 MJD 58256.377 object DECaLS_5136_g 
    decam/CP/V4.8.2a/CP20180517/c4d_180518_090325_ooi_g_ls9.fits.fz
  c4d_181003_004732_ooi_g_ls9-S15 g expnum 780134 exptime 200.0 propid 2014B-0404 seeing 1.28 MJD 58394.033 object DECaLS_36880_g 
    decam/CP/V4.8.2a/CP20181002/c4d_181003_004732_ooi_g_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536981-g-20181003T004732_oi[S15,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95361c2-r-20181002T011347_oi[S15,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954922e-z-20160813T034712_oi[S22,noinherit][2046,4094][real]: DECaLS_
Clipping 2 pixels with anomalously large oow values: max 0.00141642 vs median 0.000992939
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523600-r-20170917T011703_oi[S22,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95478a4-z-20160815T043116_oi[S16,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f17b-z-20180918T005456_oi[S15,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9531e27-g-20180810T040123_oi[S16,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530e3b-g-20180518T090325_oi[S22,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9531ac3-r-20180810T040003_oi[S16,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 59.47 s, CPU: 3.29 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 177 MB, VmData: 209 MB, maxrss: 0.18158 MB
Stage tims finished: 2020-08-05T21:30:06.487930
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954922e-z-20160813T034712_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95361c2-r-20181002T011347_oi[S15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530e3b-g-20180518T090325_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9531e27-g-20180810T040123_oi[S16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9531ac3-r-20180810T040003_oi[S16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523600-r-20170917T011703_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536981-g-20181003T004732_oi[S15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 5.000 s worker CPU, 229.455 s worker Wall, Wall: 59.469 s, Cores in use: 0.14, Total efficiency (on 32 cores): 0.4 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95478a4-z-20160815T043116_oi[S16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f17b-z-20180918T005456_oi[S15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T21:30:06.513174
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04403.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04275.fits
Matched 1 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/metrics/cus/reference-custom-323597p17854.fits
Stage refs : Wall: 9.41 s, CPU: 5.69 s, VmPeak: 1073 MB, VmSize: 1067 MB, VmRSS: 235 MB, VmData: 265 MB, maxrss: 0.240972 MB
Stage refs finished: 2020-08-05T21:30:15.921465
Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 9.410 s, Cores in use: 0.61, Total efficiency (on 32 cores): 1.9 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T21:30:15.945613
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/metrics/cus/outlier-mask-custom-323597p17854.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/metrics/cus/outliers-pre-custom-323597p17854.jpg
Image c4d_181003_004732_ooi_g_ls9-S15 g : masking 188 positive outlier pixels and 0 negative outlier pixels
Image c4d_180518_090325_ooi_g_ls9-S22 g : masking 366 positive outlier pixels and 0 negative outlier pixels
Image c4d_180810_040003_ooi_r_ls9-S16 r : masking 507 positive outlier pixels and 0 negative outlier pixels
Image c4d_170917_011703_ooi_r_ls9-S22 r : masking 647 positive outlier pixels and 0 negative outlier pixels
Image c4d_181002_011347_ooi_r_ls9-S15 r : masking 0 positive outlier pixels and 235 negative outlier pixels
Image c4d_160813_035037_ooi_z_ls9-S22 z : masking 315 positive outlier pixels and 0 negative outlier pixels
Image c4d_180918_005456_ooi_z_ls9-S15 z : masking 613 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/metrics/cus/outlier-mask-custom-323597p17854.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/metrics/cus/outliers-post-custom-323597p17854.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/metrics/cus/outliers-masked-pos-custom-323597p17854.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/metrics/cus/outliers-masked-neg-custom-323597p17854.jpg
Stage outliers : Wall: 1.95 s, CPU: 1.21 s, VmPeak: 1076 MB, VmSize: 1076 MB, VmRSS: 250 MB, VmData: 277 MB, maxrss: 0.255828 MB
Stage outliers finished: 2020-08-05T21:30:17.894901
Resources for stage outliers : 0.960 s worker CPU, 1.563 s worker Wall, Wall: 1.951 s, Cores in use: 1.11, Total efficiency (on 32 cores): 3.5 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T21:30:17.921314
Stage halos : Wall: 2.42 s, CPU: 2.09 s, VmPeak: 1076 MB, VmSize: 1076 MB, VmRSS: 250 MB, VmData: 277 MB, maxrss: 0.255916 MB
Stage halos finished: 2020-08-05T21:30:20.341016
Resources for stage halos : 0.666 s worker CPU, 2.239 s worker Wall, Wall: 2.422 s, Cores in use: 1.14, Total efficiency (on 32 cores): 3.6 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T21:30:20.471365
PSF sigmas in coadd pixels: ['2.61', '2.73', '2.08']
Using average PSF sigma 2.4730670879549455
Gaussian PSF norm 0.11406677689732668 vs pixelized 0.10141857
average tim pixel scale / coadd scale: 1.0012118354660124
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.51', '2.06', '1.62']
Using average PSF sigma 2.0634446246787217
Gaussian PSF norm 0.13671061893303793 vs pixelized 0.115031525
average tim pixel scale / coadd scale: 1.0011829760188649
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.15', '2.07', '1.76']
Using average PSF sigma 1.9916369913168885
Gaussian PSF norm 0.14163966275167167 vs pixelized 0.11608212
average tim pixel scale / coadd scale: 1.0011459519475243
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.21 s, CPU: 0.17 s, VmPeak: 1076 MB, VmSize: 1076 MB, VmRSS: 251 MB, VmData: 277 MB, maxrss: 0.257392 MB
Stage fit_on_coadds finished: 2020-08-05T21:30:20.682981
Resources for stage fit_on_coadds : 0.174 s worker CPU, 0.174 s worker Wall, Wall: 0.215 s, Cores in use: 1.62, Total efficiency (on 32 cores): 5.1 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T21:30:20.701104
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 88 potential peaks
Of 88 potential peaks: 56 in veto map, 11 cut by saddle test, 0 cut by aper test, 21 kept
SED z : 21 new peaks
Found 94 potential peaks
Of 94 potential peaks: 77 in veto map, 12 cut by saddle test, 0 cut by aper test, 5 kept
SED r : 5 new peaks
Found 78 potential peaks
Of 78 potential peaks: 69 in veto map, 6 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 105 potential peaks
Of 105 potential peaks: 96 in veto map, 9 cut by saddle test, 0 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 114 potential peaks
Of 114 potential peaks: 101 in veto map, 13 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 29 new sources
Median coadd sky for g : 0.00030292984
Median coadd sky for r : 0.0005103787
Median coadd sky for z : 0.0015698785
Stage srcs : Wall: 3.26 s, CPU: 3.18 s, VmPeak: 1076 MB, VmSize: 1076 MB, VmRSS: 252 MB, VmData: 277 MB, maxrss: 0.257924 MB
Stage srcs finished: 2020-08-05T21:30:23.958828
Resources for stage srcs : 0.094 s worker CPU, 0.094 s worker Wall, Wall: 3.260 s, Cores in use: 1.00, Total efficiency (on 32 cores): 3.1 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T21:30:23.976425
Blob 1 of 4, id: 0, sources: 35, size: 235x257, npix 48323, brick X: 22,257, Y: 0,257, one pixel: 111 0
Blob 2 of 4, id: 2, sources: 3, size: 33x52, npix 885, brick X: 13,46, Y: 15,67, one pixel: 23 15
Blob 3 of 4, id: 3, sources: 1, size: 36x32, npix 662, brick X: 0,36, Y: 64,96, one pixel: 5 64
Blob 4 of 4, id: 1, sources: 1, size: 30x27, npix 543, brick X: 70,100, Y: 10,37, one pixel: 84 10
Blob 4 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 957 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147104 MB
Blob 3 finished, total: Wall: 0.95 s, CPU: 0.95 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147808 MB
Blob 2 finished, total: Wall: 1.13 s, CPU: 1.13 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.096152 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (323.59350, 17.84251), pm (7.0, -8.3), parallax 2.103 with NanoMaggies: g=12.4, r=11.9, z=11.8
Reset brightness to NanoMaggies: g=12.4, r=11.9, z=11.8
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.6054, ee1=-0.117042, ee2=-0.202228
Measuring 17 iterative sources
Blob 1 finished, total: Wall: 41.78 s, CPU: 41.76 s, VmPeak: 957 MB, VmSize: 770 MB, VmRSS: 194 MB, VmData: 219 MB, maxrss: 0.199084 MB
Old catalog: 42
New catalog: 55
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/metrics/cus/blobs-custom-323597p17854.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/metrics/cus/all-models-custom-323597p17854.fits
Stage fitblobs : Wall: 44.03 s, CPU: 1.44 s, VmPeak: 1076 MB, VmSize: 1076 MB, VmRSS: 253 MB, VmData: 278 MB, maxrss: 0.25932 MB
Stage fitblobs finished: 2020-08-05T21:31:08.010531
Resources for stage fitblobs : 44.165 s worker CPU, 44.346 s worker Wall, Wall: 44.037 s, Cores in use: 1.04, Total efficiency (on 32 cores): 3.2 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T21:31:08.028900
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/tmp-legacysurvey-custom-323597p17854-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/tmp-legacysurvey-custom-323597p17854-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/tmp-legacysurvey-custom-323597p17854-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/tmp-legacysurvey-custom-323597p17854-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-resid.jpg
Stage coadds : Wall: 4.22 s, CPU: 1.40 s, VmPeak: 1076 MB, VmSize: 1076 MB, VmRSS: 254 MB, VmData: 278 MB, maxrss: 0.259644 MB
Stage coadds finished: 2020-08-05T21:31:12.246766
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 29.170 s worker CPU, 53.455 s worker Wall, Wall: 4.220 s, Cores in use: 7.24, Total efficiency (on 32 cores): 22.6 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T21:31:12.262079
Cut to 1 unWISE tiles
Reading WISE tile 3235p181 band 1
Reading WISE tile 3235p181 band 2
Reading WISE tile 3235p181 band 3
Reading WISE tile 3235p181 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 957 MB, VmSize: 827 MB, VmRSS: 174 MB, VmData: 192 MB, maxrss: 0.22104 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 955 MB, VmSize: 805 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.206916 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 962 MB, VmSize: 805 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.2071 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 865 MB, VmSize: 865 MB, VmRSS: 206 MB, VmData: 237 MB, maxrss: 0.211432 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/tmp-legacysurvey-custom-323597p17854-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/tmp-legacysurvey-custom-323597p17854-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.02 s, CPU: 1.55 s, VmPeak: 1076 MB, VmSize: 1076 MB, VmRSS: 254 MB, VmData: 278 MB, maxrss: 0.260156 MB
Stage wise_forced finished: 2020-08-05T21:31:15.279596
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 3.268 s worker CPU, 4.328 s worker Wall, Wall: 3.020 s, Cores in use: 1.59, Total efficiency (on 32 cores): 5.0 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-wise_forced.p
Running stage writecat
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage writecat at 2020-08-05T21:31:15.297705
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/tractor-i/cus/tractor-custom-323597p17854.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/tractor/cus/tractor-custom-323597p17854.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/tractor/cus/brick-custom-323597p17854.sha256sum
Stage writecat : Wall: 2.44 s, CPU: 1.95 s, VmPeak: 1208 MB, VmSize: 1080 MB, VmRSS: 256 MB, VmData: 278 MB, maxrss: 0.393032 MB
Stage writecat finished: 2020-08-05T21:31:17.733604
Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 2.439 s, Cores in use: 0.80, Total efficiency (on 32 cores): 2.5 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1543589/PGC1543589-largegalaxy-writecat.p
All done: 83.502 s worker CPU, 335.661 s worker Wall, Wall: 130.827 s, Cores in use: 0.81, Total efficiency (on 32 cores): 2.5 %
Finished galaxy PGC1543589 in 2.281 minutes.
Started working on galaxy PGC1543589 at Mon Aug 10 09:17:39 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.59727136867076 17.854426735163596 --width 257 --height 257 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/PGC1543589-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/PGC1543589-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-10T09:17:40.144330
legacypipe git version: DR9.5.11-watershed-6-g6a2880fc
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '323.59727136867076', '17.854426735163596', '--width', '257', '--height', '257', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/PGC1543589-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/PGC1543589-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.59727136867076 17.854426735163596 --width 257 --height 257 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/PGC1543589-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/PGC1543589-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 323.59727136867076 17.854426735163596
Starting process 38952 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 38953 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 38954 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 38955 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 38956 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059528 MB
Starting process 38957 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB
Starting process 38958 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB
Starting process 38959 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-10T09:17:40.703747
Keeping 9 CCDs:
  c4d_180918_005456_ooi_z_ls9-S15 z expnum 775002 exptime 152.0 propid 2014B-0404 seeing 1.32 MJD 58379.038 object DECaLS_36880_z 
    decam/CP/V4.8.2a/CP20180917/c4d_180918_005456_ooi_z_ls9.fits.fz
  c4d_181002_011347_ooi_r_ls9-S15 r expnum 779833 exptime 87.0 propid 2014B-0404 seeing 1.55 MJD 58393.051 object DECaLS_36880_r 
    decam/CP/V4.8.2a/CP20181001/c4d_181002_011347_ooi_r_ls9.fits.fz
  c4d_160815_043403_ooi_z_ls9-S16 z expnum 564476 exptime 117.0 propid 2014B-0404 seeing 1.27 MJD 57615.188 object DECaLS_21008_z 
    decam/CP/V4.8.2a/CP20160814/c4d_160815_043403_ooi_z_ls9.fits.fz
  c4d_180810_040003_ooi_r_ls9-S16 r expnum 763681 exptime 52.0 propid 2014B-0404 seeing 1.27 MJD 58340.167 object DECaLS_21008_r 
    decam/CP/V4.8.2a/CP20180809/c4d_180810_040003_ooi_r_ls9.fits.fz
  c4d_180810_040123_ooi_g_ls9-S16 g expnum 763682 exptime 169.0 propid 2014B-0404 seeing 1.60 MJD 58340.168 object DECaLS_21008_g 
    decam/CP/V4.8.2a/CP20180809/c4d_180810_040123_ooi_g_ls9.fits.fz
  c4d_160813_035037_ooi_z_ls9-S22 z expnum 563531 exptime 155.0 propid 2014B-0404 seeing 1.08 MJD 57613.158 object DECaLS_5136_z 
    decam/CP/V4.8.2a/CP20160812/c4d_160813_035037_ooi_z_ls9.fits.fz
  c4d_170917_011703_ooi_r_ls9-S22 r expnum 678276 exptime 122.0 propid 2014B-0404 seeing 1.00 MJD 58013.054 object DECaLS_5136_r 
    decam/CP/V4.8.2a/CP20170916/c4d_170917_011703_ooi_r_ls9.fits.fz
  c4d_180518_090325_ooi_g_ls9-S22 g expnum 747475 exptime 200.0 propid 2014B-0404 seeing 1.68 MJD 58256.377 object DECaLS_5136_g 
    decam/CP/V4.8.2a/CP20180517/c4d_180518_090325_ooi_g_ls9.fits.fz
  c4d_181003_004732_ooi_g_ls9-S15 g expnum 780134 exptime 200.0 propid 2014B-0404 seeing 1.28 MJD 58394.033 object DECaLS_36880_g 
    decam/CP/V4.8.2a/CP20181002/c4d_181003_004732_ooi_g_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9531ac3-r-20180810T040003_oi[S16,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954922e-z-20160813T034712_oi[S22,noinherit][2046,4094][real]: DECaLS_
Clipping 2 pixels with anomalously large oow values: max 0.00141642 vs median 0.000992939
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f17b-z-20180918T005456_oi[S15,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95361c2-r-20181002T011347_oi[S15,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530e3b-g-20180518T090325_oi[S22,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523600-r-20170917T011703_oi[S22,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9531e27-g-20180810T040123_oi[S16,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95478a4-z-20160815T043116_oi[S16,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536981-g-20181003T004732_oi[S15,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 100.06 s, CPU: 0.92 s, VmPeak: 1004 MB, VmSize: 1004 MB, VmRSS: 175 MB, VmData: 209 MB, maxrss: 0.179676 MB
Stage tims finished: 2020-08-10T09:19:20.765075
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954922e-z-20160813T034712_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530e3b-g-20180518T090325_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9531ac3-r-20180810T040003_oi[S16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95361c2-r-20181002T011347_oi[S15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95478a4-z-20160815T043116_oi[S16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523600-r-20170917T011703_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f17b-z-20180918T005456_oi[S15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536981-g-20181003T004732_oi[S15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 5.138 s worker CPU, 256.406 s worker Wall, Wall: 100.062 s, Cores in use: 0.06, Total efficiency (on 8 cores): 0.8 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/PGC1543589-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/PGC1543589-largegalaxy-tims.p
Running stage refs
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9531e27-g-20180810T040123_oi[S16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Running stage refs at 2020-08-10T09:19:20.907029
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04403.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04275.fits
Matched 1 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/metrics/cus/reference-custom-323597p17854.fits
Stage refs : Wall: 13.63 s, CPU: 4.66 s, VmPeak: 1066 MB, VmSize: 1060 MB, VmRSS: 233 MB, VmData: 264 MB, maxrss: 0.238724 MB
Stage refs finished: 2020-08-10T09:19:34.540429
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 13.635 s, Cores in use: 0.34, Total efficiency (on 8 cores): 4.3 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/PGC1543589-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/PGC1543589-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-10T09:19:34.594398
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/metrics/cus/outlier-mask-custom-323597p17854.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/metrics/cus/outliers-pre-custom-323597p17854.jpg
Image c4d_180810_040123_ooi_g_ls9-S16 g : masking 349 positive outlier pixels and 0 negative outlier pixels
Image c4d_180518_090325_ooi_g_ls9-S22 g : masking 303 positive outlier pixels and 0 negative outlier pixels
Image c4d_181003_004732_ooi_g_ls9-S15 g : masking 193 positive outlier pixels and 0 negative outlier pixels
Image c4d_180810_040003_ooi_r_ls9-S16 r : masking 494 positive outlier pixels and 0 negative outlier pixels
Image c4d_170917_011703_ooi_r_ls9-S22 r : masking 652 positive outlier pixels and 0 negative outlier pixels
Image c4d_180918_005456_ooi_z_ls9-S15 z : masking 604 positive outlier pixels and 0 negative outlier pixels
Image c4d_160813_035037_ooi_z_ls9-S22 z : masking 318 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/metrics/cus/outlier-mask-custom-323597p17854.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/metrics/cus/outliers-post-custom-323597p17854.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/metrics/cus/outliers-masked-pos-custom-323597p17854.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/metrics/cus/outliers-masked-neg-custom-323597p17854.jpg
Stage outliers : Wall: 1.00 s, CPU: 0.77 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 248 MB, VmData: 276 MB, maxrss: 0.25378 MB
Stage outliers finished: 2020-08-10T09:19:35.593651
Resources for stage outliers : 0.811 s worker CPU, 0.813 s worker Wall, Wall: 1.000 s, Cores in use: 1.58, Total efficiency (on 8 cores): 19.8 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/PGC1543589-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/PGC1543589-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-10T09:19:35.620603
Stage halos : Wall: 0.48 s, CPU: 0.31 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 248 MB, VmData: 276 MB, maxrss: 0.253912 MB
Stage halos finished: 2020-08-10T09:19:36.102946
Resources for stage halos : 0.556 s worker CPU, 1.064 s worker Wall, Wall: 0.483 s, Cores in use: 1.79, Total efficiency (on 8 cores): 22.3 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/PGC1543589-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/PGC1543589-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-10T09:19:36.149551
PSF sigmas in coadd pixels: ['2.61', '2.73', '2.08']
Using average PSF sigma 2.4730670879549455
Gaussian PSF norm 0.11406677689732668 vs pixelized 0.10141727
average tim pixel scale / coadd scale: 1.0012118354660124
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.51', '2.06', '1.62']
Using average PSF sigma 2.0634446246787217
Gaussian PSF norm 0.13671061893303793 vs pixelized 0.11503105
average tim pixel scale / coadd scale: 1.0011829760188649
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.15', '2.07', '1.76']
Using average PSF sigma 1.9916369913168885
Gaussian PSF norm 0.14163966275167167 vs pixelized 0.11608244
average tim pixel scale / coadd scale: 1.0011459519475243
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.17 s, CPU: 0.15 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 249 MB, VmData: 276 MB, maxrss: 0.255384 MB
Stage fit_on_coadds finished: 2020-08-10T09:19:36.322339
Resources for stage fit_on_coadds : 0.200 s worker CPU, 0.200 s worker Wall, Wall: 0.174 s, Cores in use: 2.00, Total efficiency (on 8 cores): 25.1 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/PGC1543589-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/PGC1543589-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-10T09:19:36.334702
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 92 potential peaks
Of 92 potential peaks: 61 in veto map, 11 cut by saddle test, 1 cut by aper test, 19 kept
SED z : 19 new peaks
Found 96 potential peaks
Of 96 potential peaks: 80 in veto map, 11 cut by saddle test, 0 cut by aper test, 5 kept
SED r : 5 new peaks
Found 79 potential peaks
Of 79 potential peaks: 69 in veto map, 7 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 105 potential peaks
Of 105 potential peaks: 96 in veto map, 9 cut by saddle test, 0 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 119 potential peaks
Of 119 potential peaks: 104 in veto map, 14 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 28 new sources
Median coadd sky for g : 0.0003239829
Median coadd sky for r : 0.0005412212
Median coadd sky for z : 0.0016327017
Stage srcs : Wall: 0.85 s, CPU: 0.80 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 250 MB, VmData: 276 MB, maxrss: 0.255904 MB
Stage srcs finished: 2020-08-10T09:19:37.184044
Resources for stage srcs : 0.104 s worker CPU, 0.104 s worker Wall, Wall: 0.850 s, Cores in use: 1.07, Total efficiency (on 8 cores): 13.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/PGC1543589-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/PGC1543589-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-10T09:19:37.195520
Blob 1 of 4, id: 0, sources: 34, size: 239x257, npix 48713, brick X: 18,257, Y: 0,257, one pixel: 107 0
Blob 2 of 4, id: 2, sources: 3, size: 34x52, npix 895, brick X: 9,43, Y: 15,67, one pixel: 18 15
Blob 3 of 4, id: 1, sources: 1, size: 30x28, npix 547, brick X: 67,97, Y: 9,37, one pixel: 83 9
Blob 4 of 4, id: 3, sources: 1, size: 33x28, npix 519, brick X: 0,33, Y: 66,94, one pixel: 1 66
Blob 4 finished, total: Wall: 0.13 s, CPU: 0.13 s, VmPeak: 955 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145176 MB
Blob 3 finished, total: Wall: 0.29 s, CPU: 0.28 s, VmPeak: 957 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146416 MB
Blob 2 finished, total: Wall: 1.25 s, CPU: 1.25 s, VmPeak: 957 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146548 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (323.59350, 17.84251), pm (7.0, -8.3), parallax 2.103 with NanoMaggies: g=12.4, r=11.9, z=11.8
Reset brightness to NanoMaggies: g=12.4, r=11.9, z=11.8
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.46083, ee1=-0.129501, ee2=-0.22966
Measuring 16 iterative sources
Blob 1 finished, total: Wall: 46.56 s, CPU: 46.56 s, VmPeak: 958 MB, VmSize: 768 MB, VmRSS: 195 MB, VmData: 223 MB, maxrss: 0.199972 MB
Old catalog: 41
New catalog: 51
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/metrics/cus/blobs-custom-323597p17854.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/metrics/cus/all-models-custom-323597p17854.fits
Stage fitblobs : Wall: 47.13 s, CPU: 0.51 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 251 MB, VmData: 278 MB, maxrss: 0.257192 MB
Stage fitblobs finished: 2020-08-10T09:20:24.322594
Resources for stage fitblobs : 48.294 s worker CPU, 48.325 s worker Wall, Wall: 47.128 s, Cores in use: 1.04, Total efficiency (on 8 cores): 12.9 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/PGC1543589-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/PGC1543589-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-10T09:20:24.338687
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/tmp-legacysurvey-custom-323597p17854-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/tmp-legacysurvey-custom-323597p17854-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/tmp-legacysurvey-custom-323597p17854-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/tmp-legacysurvey-custom-323597p17854-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-resid.jpg
Stage coadds : Wall: 1.93 s, CPU: 0.94 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 252 MB, VmData: 278 MB, maxrss: 0.25774 MB
Stage coadds finished: 2020-08-10T09:20:26.267528
Resources for stage coadds : 5.139 s worker CPU, 5.574 s worker Wall, Wall: 1.930 s, Cores in use: 3.15, Total efficiency (on 8 cores): 39.4 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/PGC1543589-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/PGC1543589-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-10T09:20:26.281421
Cut to 1 unWISE tiles
Reading WISE tile 3235p181 band 1
Reading WISE tile 3235p181 band 2
Reading WISE tile 3235p181 band 3
Reading WISE tile 3235p181 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 956 MB, VmSize: 801 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.188732 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 956 MB, VmSize: 799 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.204096 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 957 MB, VmSize: 803 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.208528 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235p181/unwise-3235p181-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 968 MB, VmSize: 799 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.209576 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/tmp-legacysurvey-custom-323597p17854-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/tmp-legacysurvey-custom-323597p17854-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.98 s, CPU: 0.73 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 252 MB, VmData: 278 MB, maxrss: 0.258256 MB
Stage wise_forced finished: 2020-08-10T09:20:29.258832
Resources for stage wise_forced : 3.839 s worker CPU, 5.367 s worker Wall, Wall: 2.979 s, Cores in use: 1.53, Total efficiency (on 8 cores): 19.2 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/PGC1543589-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/PGC1543589-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-10T09:20:29.275137
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/coadd/cus/custom-323597p17854/legacysurvey-custom-323597p17854-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/tractor-i/cus/tractor-custom-323597p17854.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/tractor/cus/tractor-custom-323597p17854.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/tractor/cus/brick-custom-323597p17854.sha256sum
Stage writecat : Wall: 1.03 s, CPU: 0.78 s, VmPeak: 1202 MB, VmSize: 1074 MB, VmRSS: 254 MB, VmData: 278 MB, maxrss: 0.391116 MB
Stage writecat finished: 2020-08-10T09:20:30.302199
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.028 s, Cores in use: 0.76, Total efficiency (on 8 cores): 9.5 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/PGC1543589-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1543589/PGC1543589-largegalaxy-writecat.p
All done: 64.082 s worker CPU, 317.855 s worker Wall, Wall: 169.617 s, Cores in use: 0.44, Total efficiency (on 8 cores): 5.5 %
Finished galaxy PGC1543589 in 2.858 minutes.